2024-09-19T09:18:04.991 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T09:18:05.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T09:18:05.107 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911916 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/ffsb}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911916' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 1 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 filestore flush min: 0 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd heartbeat grace: 60 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request - SLOW_OPS - slow request sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.dir_split install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi001.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCbxU3lxY5yJ49Unk5gYeOB2PchjJ1HeHw6DBgee0f7FoOXvMrR4vi1wp1ih9aAGMOit7YtOSXwLbvc3sHdvDls= smithi022.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJiHCcPo4T8lhmqIcbVuMCsUYo5Lw5PwWWUz5PyN6OUMyzC/PHGmVOEdsFc/6vJ525yH9sWDe0p3fakHSy8wkxU= smithi121.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNFd+oQFWYE4/gUqmQTJkb2NUrrN3PBfa0UxiZyGHbUjn/MFLgNbjyhFOG1tpG75Lut4oabl2tLftQlJ1dUDLNY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T09:18:05.108 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T09:18:05.108 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T09:18:05.108 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T09:18:05.115 INFO:teuthology.task.internal:Checking packages... 2024-09-19T09:18:05.140 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T09:18:05.140 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T09:18:05.140 INFO:teuthology.packaging:ref: None 2024-09-19T09:18:05.140 INFO:teuthology.packaging:tag: None 2024-09-19T09:18:05.140 INFO:teuthology.packaging:branch: squid 2024-09-19T09:18:05.140 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:18:05.140 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T09:18:05.389 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T09:18:05.391 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T09:18:05.396 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T09:18:05.396 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T09:18:05.410 INFO:teuthology.task.internal:Saving configuration 2024-09-19T09:18:05.433 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T09:18:05.440 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T09:18:05.466 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi001.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911916', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 09:13:17.114162', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCbxU3lxY5yJ49Unk5gYeOB2PchjJ1HeHw6DBgee0f7FoOXvMrR4vi1wp1ih9aAGMOit7YtOSXwLbvc3sHdvDls='} 2024-09-19T09:18:05.487 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911916', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 09:13:17.117959', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJiHCcPo4T8lhmqIcbVuMCsUYo5Lw5PwWWUz5PyN6OUMyzC/PHGmVOEdsFc/6vJ525yH9sWDe0p3fakHSy8wkxU='} 2024-09-19T09:18:05.513 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi121.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911916', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 09:13:17.116146', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNFd+oQFWYE4/gUqmQTJkb2NUrrN3PBfa0UxiZyGHbUjn/MFLgNbjyhFOG1tpG75Lut4oabl2tLftQlJ1dUDLNY='} 2024-09-19T09:18:05.514 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T09:18:05.522 INFO:teuthology.task.internal:roles: ubuntu@smithi001.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-19T09:18:05.523 INFO:teuthology.task.internal:roles: ubuntu@smithi022.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-19T09:18:05.523 INFO:teuthology.task.internal:roles: ubuntu@smithi121.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-19T09:18:05.523 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T09:18:05.612 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7faa6a73c5e0>, signals=[15]) 2024-09-19T09:18:05.612 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T09:18:05.618 INFO:teuthology.task.internal:Opening connections... 2024-09-19T09:18:05.618 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi001.front.sepia.ceph.com 2024-09-19T09:18:05.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:18:05.704 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi022.front.sepia.ceph.com 2024-09-19T09:18:05.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:18:05.787 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi121.front.sepia.ceph.com 2024-09-19T09:18:05.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:18:05.864 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T09:18:05.872 DEBUG:teuthology.orchestra.run.smithi001:> uname -m 2024-09-19T09:18:05.890 INFO:teuthology.orchestra.run.smithi001.stdout:x86_64 2024-09-19T09:18:05.890 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release 2024-09-19T09:18:05.949 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="CentOS Stream" 2024-09-19T09:18:05.949 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="9" 2024-09-19T09:18:05.949 INFO:teuthology.orchestra.run.smithi001.stdout:ID="centos" 2024-09-19T09:18:05.949 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="rhel fedora" 2024-09-19T09:18:05.949 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="9" 2024-09-19T09:18:05.949 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el9" 2024-09-19T09:18:05.950 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T09:18:05.950 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31" 2024-09-19T09:18:05.950 INFO:teuthology.orchestra.run.smithi001.stdout:LOGO="fedora-logo-icon" 2024-09-19T09:18:05.950 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T09:18:05.950 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://centos.org/" 2024-09-19T09:18:05.950 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T09:18:05.950 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T09:18:05.950 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T09:18:05.951 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server 2024-09-19T09:18:05.969 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2024-09-19T09:18:05.988 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2024-09-19T09:18:05.988 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2024-09-19T09:18:06.046 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Stream" 2024-09-19T09:18:06.046 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="9" 2024-09-19T09:18:06.046 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos" 2024-09-19T09:18:06.046 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora" 2024-09-19T09:18:06.046 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="9" 2024-09-19T09:18:06.046 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el9" 2024-09-19T09:18:06.046 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T09:18:06.046 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2024-09-19T09:18:06.047 INFO:teuthology.orchestra.run.smithi022.stdout:LOGO="fedora-logo-icon" 2024-09-19T09:18:06.047 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T09:18:06.047 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://centos.org/" 2024-09-19T09:18:06.047 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T09:18:06.047 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T09:18:06.047 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T09:18:06.047 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2024-09-19T09:18:06.069 DEBUG:teuthology.orchestra.run.smithi121:> uname -m 2024-09-19T09:18:06.088 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2024-09-19T09:18:06.088 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2024-09-19T09:18:06.146 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream" 2024-09-19T09:18:06.146 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="9" 2024-09-19T09:18:06.146 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2024-09-19T09:18:06.146 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2024-09-19T09:18:06.146 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="9" 2024-09-19T09:18:06.146 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el9" 2024-09-19T09:18:06.146 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T09:18:06.146 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2024-09-19T09:18:06.146 INFO:teuthology.orchestra.run.smithi121.stdout:LOGO="fedora-logo-icon" 2024-09-19T09:18:06.146 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T09:18:06.146 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/" 2024-09-19T09:18:06.146 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T09:18:06.147 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T09:18:06.147 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T09:18:06.147 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2024-09-19T09:18:06.169 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T09:18:06.179 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T09:18:06.185 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T09:18:06.185 DEBUG:teuthology.orchestra.run.smithi001:> test '!' -e /home/ubuntu/cephtest 2024-09-19T09:18:06.187 DEBUG:teuthology.orchestra.run.smithi022:> test '!' -e /home/ubuntu/cephtest 2024-09-19T09:18:06.189 DEBUG:teuthology.orchestra.run.smithi121:> test '!' -e /home/ubuntu/cephtest 2024-09-19T09:18:06.208 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T09:18:06.214 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T09:18:06.215 DEBUG:teuthology.orchestra.run.smithi001:> test -z $(ls -A /var/lib/ceph) 2024-09-19T09:18:06.245 DEBUG:teuthology.orchestra.run.smithi022:> test -z $(ls -A /var/lib/ceph) 2024-09-19T09:18:06.247 DEBUG:teuthology.orchestra.run.smithi121:> test -z $(ls -A /var/lib/ceph) 2024-09-19T09:18:06.269 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T09:18:06.346 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T09:18:06.410 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-19T09:18:06.411 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-19T09:18:06.411 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-19T09:18:06.411 DEBUG:teuthology.orchestra.run.smithi001:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T09:18:06.429 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:18:06.429 DEBUG:teuthology.orchestra.run.smithi001:> uname -r 2024-09-19T09:18:06.488 INFO:teuthology.orchestra.run.smithi001.stdout:5.14.0-503.el9.x86_64 2024-09-19T09:18:06.488 INFO:teuthology.task.kernel:Running kernel on smithi001: 5.14.0-503.el9.x86_64 2024-09-19T09:18:06.488 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum install -y kernel 2024-09-19T09:18:09.952 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.3 MB 00:01 2024-09-19T09:18:11.828 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-09-19T09:18:18.053 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 6.5 MB 00:02 2024-09-19T09:18:19.462 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - Extras packages 118 kB/s | 19 kB 00:00 2024-09-19T09:18:20.275 INFO:teuthology.orchestra.run.smithi001.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-19T09:18:25.797 INFO:teuthology.orchestra.run.smithi001.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-09-19T09:18:27.754 INFO:teuthology.orchestra.run.smithi001.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T09:18:27.754 INFO:teuthology.orchestra.run.smithi001.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T09:18:27.841 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-09-19T09:18:27.853 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-09-19T09:18:27.853 INFO:teuthology.orchestra.run.smithi001.stdout: Package Architecture Version Repository Size 2024-09-19T09:18:27.853 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-09-19T09:18:27.853 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2024-09-19T09:18:27.853 INFO:teuthology.orchestra.run.smithi001.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T09:18:27.853 INFO:teuthology.orchestra.run.smithi001.stdout:Installing dependencies: 2024-09-19T09:18:27.854 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T09:18:27.854 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T09:18:27.854 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T09:18:27.854 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:18:27.854 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-09-19T09:18:27.854 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-09-19T09:18:27.854 INFO:teuthology.orchestra.run.smithi001.stdout:Install 4 Packages 2024-09-19T09:18:27.854 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:18:27.855 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 79 M 2024-09-19T09:18:27.855 INFO:teuthology.orchestra.run.smithi001.stdout:Installed size: 126 M 2024-09-19T09:18:27.855 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2024-09-19T09:18:27.991 INFO:teuthology.orchestra.run.smithi001.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 313 kB/s | 36 kB 00:00 2024-09-19T09:18:28.587 INFO:teuthology.orchestra.run.smithi001.stdout:(2/4): kernel-modules-core-5.14.0-508.el9.x86_6 48 MB/s | 29 MB 00:00 2024-09-19T09:18:29.033 INFO:teuthology.orchestra.run.smithi001.stdout:(3/4): kernel-core-5.14.0-508.el9.x86_64.rpm 14 MB/s | 16 MB 00:01 2024-09-19T09:18:29.567 INFO:teuthology.orchestra.run.smithi001.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 20 MB/s | 35 MB 00:01 2024-09-19T09:18:29.567 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:18:29.567 INFO:teuthology.orchestra.run.smithi001.stdout:Total 46 MB/s | 79 MB 00:01 2024-09-19T09:18:30.278 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2024-09-19T09:18:30.678 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2024-09-19T09:18:30.678 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2024-09-19T09:18:31.637 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2024-09-19T09:18:31.637 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2024-09-19T09:18:34.225 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2024-09-19T09:18:34.895 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T09:18:35.083 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T09:18:37.817 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T09:18:37.937 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T09:18:43.058 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T09:18:43.104 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:18:48.238 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:19:27.322 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:19:27.363 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:19:27.735 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:19:27.735 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T09:19:27.735 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T09:19:27.735 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T09:19:28.587 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:19:28.587 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:19:28.588 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2024-09-19T09:19:28.588 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T09:19:28.588 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T09:19:28.588 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T09:19:28.588 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T09:19:28.588 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:19:28.588 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-09-19T09:19:28.920 DEBUG:teuthology.orchestra.run.smithi001:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T09:19:29.041 INFO:teuthology.orchestra.run.smithi001.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T09:19:29.041 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T09:19:29.041 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T09:19:29.041 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T09:19:29.041 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T09:19:29.042 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-19T09:19:29.042 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi001.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T09:19:29.042 DEBUG:teuthology.orchestra.run.smithi001:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T09:19:29.100 INFO:teuthology.orchestra.run.smithi001.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T09:19:29.100 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T09:19:29.101 DEBUG:teuthology.orchestra.run.smithi001:> sudo rpm -qi grub2-tools 2024-09-19T09:19:29.138 INFO:teuthology.orchestra.run.smithi001.stdout:Name : grub2-tools 2024-09-19T09:19:29.138 INFO:teuthology.orchestra.run.smithi001.stdout:Epoch : 1 2024-09-19T09:19:29.138 INFO:teuthology.orchestra.run.smithi001.stdout:Version : 2.06 2024-09-19T09:19:29.138 INFO:teuthology.orchestra.run.smithi001.stdout:Release : 82.el9 2024-09-19T09:19:29.138 INFO:teuthology.orchestra.run.smithi001.stdout:Architecture: x86_64 2024-09-19T09:19:29.139 INFO:teuthology.orchestra.run.smithi001.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T09:19:29.139 INFO:teuthology.orchestra.run.smithi001.stdout:Group : Unspecified 2024-09-19T09:19:29.139 INFO:teuthology.orchestra.run.smithi001.stdout:Size : 8274670 2024-09-19T09:19:29.139 INFO:teuthology.orchestra.run.smithi001.stdout:License : GPLv3+ 2024-09-19T09:19:29.139 INFO:teuthology.orchestra.run.smithi001.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T09:19:29.139 INFO:teuthology.orchestra.run.smithi001.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T09:19:29.139 INFO:teuthology.orchestra.run.smithi001.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T09:19:29.139 INFO:teuthology.orchestra.run.smithi001.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T09:19:29.139 INFO:teuthology.orchestra.run.smithi001.stdout:Packager : builder@centos.org 2024-09-19T09:19:29.139 INFO:teuthology.orchestra.run.smithi001.stdout:Vendor : CentOS 2024-09-19T09:19:29.139 INFO:teuthology.orchestra.run.smithi001.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T09:19:29.139 INFO:teuthology.orchestra.run.smithi001.stdout:Summary : Support tools for GRUB. 2024-09-19T09:19:29.139 INFO:teuthology.orchestra.run.smithi001.stdout:Description : 2024-09-19T09:19:29.139 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:19:29.140 INFO:teuthology.orchestra.run.smithi001.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T09:19:29.140 INFO:teuthology.orchestra.run.smithi001.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T09:19:29.140 INFO:teuthology.orchestra.run.smithi001.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T09:19:29.140 INFO:teuthology.orchestra.run.smithi001.stdout:hardware devices. 2024-09-19T09:19:29.140 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:19:29.140 INFO:teuthology.orchestra.run.smithi001.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T09:19:29.141 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T09:19:29.141 INFO:teuthology.task.kernel:Updating grub on smithi001 to boot 5.14.0-508.el9.x86_64 2024-09-19T09:19:29.141 DEBUG:teuthology.orchestra.run.smithi001:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T09:19:29.850 INFO:teuthology.orchestra.run.smithi001.stderr:Generating grub configuration file ... 2024-09-19T09:19:31.197 INFO:teuthology.orchestra.run.smithi001.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T09:19:31.228 INFO:teuthology.orchestra.run.smithi001.stderr:done 2024-09-19T09:19:31.231 DEBUG:teuthology.orchestra.run.smithi001:> mktemp 2024-09-19T09:19:31.246 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/tmp.zDgFQsAiWV 2024-09-19T09:19:31.247 DEBUG:teuthology.orchestra.run.smithi001:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.zDgFQsAiWV 2024-09-19T09:19:31.324 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0666 /tmp/tmp.zDgFQsAiWV 2024-09-19T09:19:31.466 DEBUG:teuthology.orchestra.remote:smithi001:/tmp/tmp.zDgFQsAiWV is 6KB 2024-09-19T09:19:31.513 DEBUG:teuthology.orchestra.run.smithi001:> rm -fr /tmp/tmp.zDgFQsAiWV 2024-09-19T09:19:31.529 DEBUG:teuthology.orchestra.run.smithi001:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T09:19:31.590 INFO:teuthology.orchestra.run.smithi001.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T09:19:31.591 INFO:teuthology.orchestra.run.smithi001.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T09:19:31.591 INFO:teuthology.orchestra.run.smithi001.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T09:19:31.591 INFO:teuthology.orchestra.run.smithi001.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T09:19:31.593 DEBUG:teuthology.orchestra.run.smithi001:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T09:19:31.738 DEBUG:teuthology.orchestra.run.smithi001:> sudo shutdown -r now 2024-09-19T09:20:01.742 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-19T09:20:01.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-19T09:20:01.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:20:20.289 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.1 2024-09-19T09:20:29.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-19T09:20:29.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:20:47.677 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.1 2024-09-19T09:20:59.678 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-19T09:20:59.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:21:02.962 DEBUG:teuthology.orchestra.run.smithi001:> true 2024-09-19T09:21:03.393 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-19T09:21:03.393 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-19T09:21:03.393 DEBUG:teuthology.orchestra.run.smithi001:> uname -r 2024-09-19T09:21:03.408 INFO:teuthology.orchestra.run.smithi001.stdout:5.14.0-508.el9.x86_64 2024-09-19T09:21:03.408 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T09:21:03.408 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T09:21:03.409 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T09:21:04.410 DEBUG:teuthology.parallel:result is None 2024-09-19T09:21:04.410 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T09:21:04.416 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T09:21:04.417 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T09:21:04.420 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T09:21:04.422 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T09:21:04.442 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T09:21:04.448 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T09:21:04.467 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T09:21:04.467 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T09:21:04.476 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T09:21:04.481 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T09:21:04.514 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T09:21:04.521 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T09:21:04.521 DEBUG:teuthology.orchestra.run.smithi022:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T09:21:04.558 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:21:04.558 DEBUG:teuthology.orchestra.run.smithi121:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T09:21:04.575 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:21:04.575 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T09:21:04.577 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T09:21:04.601 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T09:21:04.648 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:21:04.655 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:21:04.672 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:21:04.673 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:21:04.688 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:21:04.691 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:21:04.693 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T09:21:04.700 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T09:21:04.700 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T09:21:04.702 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T09:21:04.705 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T09:21:04.732 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T09:21:04.740 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T09:21:04.740 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T09:21:04.769 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T09:21:04.773 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T09:21:04.790 DEBUG:teuthology.orchestra.run.smithi001:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:21:04.864 DEBUG:teuthology.orchestra.run.smithi001:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:21:04.916 DEBUG:teuthology.orchestra.run.smithi001:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:21:04.991 DEBUG:teuthology.orchestra.run.smithi001:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:21:05.039 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T09:21:05.040 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T09:21:05.128 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:21:05.174 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:21:05.225 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:21:05.312 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:21:05.353 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-19T09:21:05.353 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T09:21:05.421 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:21:05.465 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:21:05.531 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:21:05.577 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:21:05.617 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-19T09:21:05.617 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T09:21:05.683 DEBUG:teuthology.orchestra.run.smithi001:> sudo service rsyslog restart 2024-09-19T09:21:05.685 DEBUG:teuthology.orchestra.run.smithi022:> sudo service rsyslog restart 2024-09-19T09:21:05.688 DEBUG:teuthology.orchestra.run.smithi121:> sudo service rsyslog restart 2024-09-19T09:21:05.725 INFO:teuthology.orchestra.run.smithi022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:21:05.733 INFO:teuthology.orchestra.run.smithi001.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:21:05.759 INFO:teuthology.orchestra.run.smithi121.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:21:06.239 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T09:21:06.246 INFO:teuthology.task.internal:Starting timer... 2024-09-19T09:21:06.246 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T09:21:06.256 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T09:21:06.264 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T09:21:06.265 DEBUG:teuthology.orchestra.run.smithi001:> sudo service auditd rotate 2024-09-19T09:21:06.307 INFO:teuthology.orchestra.run.smithi001.stdout:Rotating logs: 2024-09-19T09:21:06.308 DEBUG:teuthology.orchestra.run.smithi022:> sudo service auditd rotate 2024-09-19T09:21:06.356 INFO:teuthology.orchestra.run.smithi022.stdout:Rotating logs: 2024-09-19T09:21:06.358 DEBUG:teuthology.orchestra.run.smithi121:> sudo service auditd rotate 2024-09-19T09:21:06.403 INFO:teuthology.orchestra.run.smithi121.stdout:Rotating logs: 2024-09-19T09:21:06.405 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T09:21:06.406 DEBUG:teuthology.orchestra.run.smithi001:> /usr/sbin/getenforce 2024-09-19T09:21:06.432 INFO:teuthology.orchestra.run.smithi001.stdout:Permissive 2024-09-19T09:21:06.432 DEBUG:teuthology.orchestra.run.smithi022:> /usr/sbin/getenforce 2024-09-19T09:21:06.464 INFO:teuthology.orchestra.run.smithi022.stdout:Permissive 2024-09-19T09:21:06.464 DEBUG:teuthology.orchestra.run.smithi121:> /usr/sbin/getenforce 2024-09-19T09:21:06.484 INFO:teuthology.orchestra.run.smithi121.stdout:Permissive 2024-09-19T09:21:06.484 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi001.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi022.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi121.front.sepia.ceph.com': 'permissive'} 2024-09-19T09:21:06.484 DEBUG:teuthology.orchestra.run.smithi001:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:21:06.512 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:21:06.512 DEBUG:teuthology.orchestra.run.smithi022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:21:06.540 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:21:06.541 DEBUG:teuthology.orchestra.run.smithi121:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:21:06.567 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:21:06.568 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T09:21:06.569 DEBUG:teuthology.orchestra.run.smithi001:> sudo /usr/sbin/setenforce permissive 2024-09-19T09:21:06.604 DEBUG:teuthology.orchestra.run.smithi022:> sudo /usr/sbin/setenforce permissive 2024-09-19T09:21:06.636 DEBUG:teuthology.orchestra.run.smithi121:> sudo /usr/sbin/setenforce permissive 2024-09-19T09:21:06.668 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T09:21:06.678 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T09:21:06.691 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T09:21:06.693 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi001.front.sepia.ceph.com,smithi022.front.sepia.ceph.com,smithi121.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T09:25:16.823 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi001.front.sepia.ceph.com'), Remote(name='ubuntu@smithi022.front.sepia.ceph.com'), Remote(name='ubuntu@smithi121.front.sepia.ceph.com')] 2024-09-19T09:25:16.825 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-19T09:25:16.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:25:16.903 DEBUG:teuthology.orchestra.run.smithi001:> true 2024-09-19T09:25:16.986 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-09-19T09:25:16.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-09-19T09:25:16.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:25:17.065 DEBUG:teuthology.orchestra.run.smithi022:> true 2024-09-19T09:25:17.155 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-09-19T09:25:17.155 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-19T09:25:17.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:25:17.232 DEBUG:teuthology.orchestra.run.smithi121:> true 2024-09-19T09:25:17.271 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-19T09:25:17.271 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T09:25:17.283 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T09:25:17.283 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T09:25:17.284 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:25:17.286 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T09:25:17.286 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:25:17.289 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T09:25:17.289 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:25:17.319 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T09:25:17.320 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T09:25:17.335 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T09:25:17.336 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T09:25:17.342 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T09:25:17.357 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T09:25:17.362 INFO:teuthology.orchestra.run.smithi001.stderr:sudo: ntpd: command not found 2024-09-19T09:25:17.363 INFO:teuthology.orchestra.run.smithi022.stderr:sudo: ntpd: command not found 2024-09-19T09:25:17.374 INFO:teuthology.orchestra.run.smithi022.stdout:506 Cannot talk to daemon 2024-09-19T09:25:17.375 INFO:teuthology.orchestra.run.smithi001.stdout:506 Cannot talk to daemon 2024-09-19T09:25:17.383 INFO:teuthology.orchestra.run.smithi121.stderr:sudo: ntpd: command not found 2024-09-19T09:25:17.389 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T09:25:17.390 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T09:25:17.394 INFO:teuthology.orchestra.run.smithi121.stdout:506 Cannot talk to daemon 2024-09-19T09:25:17.404 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T09:25:17.405 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T09:25:17.409 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T09:25:17.423 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T09:25:17.460 INFO:teuthology.orchestra.run.smithi022.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:25:17.463 INFO:teuthology.orchestra.run.smithi022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:25:17.463 INFO:teuthology.orchestra.run.smithi022.stdout:=============================================================================== 2024-09-19T09:25:17.463 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:25:17.463 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:25:17.463 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:25:17.463 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:25:17.469 INFO:teuthology.orchestra.run.smithi001.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:25:17.472 INFO:teuthology.orchestra.run.smithi001.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:25:17.472 INFO:teuthology.orchestra.run.smithi001.stdout:=============================================================================== 2024-09-19T09:25:17.473 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:25:17.473 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:25:17.473 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:25:17.473 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:25:17.478 INFO:teuthology.orchestra.run.smithi121.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:25:17.482 INFO:teuthology.orchestra.run.smithi121.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:25:17.482 INFO:teuthology.orchestra.run.smithi121.stdout:=============================================================================== 2024-09-19T09:25:17.482 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:25:17.482 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:25:17.482 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:25:17.482 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:25:17.483 INFO:teuthology.run_tasks:Running task install... 2024-09-19T09:25:17.492 DEBUG:teuthology.task.install:project ceph 2024-09-19T09:25:17.492 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T09:25:17.492 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T09:25:17.492 INFO:teuthology.task.install:Using flavor: default 2024-09-19T09:25:17.497 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T09:25:17.498 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T09:25:17.498 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T09:25:17.499 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:25:17.501 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T09:25:17.501 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:25:17.502 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T09:25:17.502 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:25:17.641 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T09:25:17.641 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T09:25:17.652 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T09:25:17.652 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T09:25:17.655 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T09:25:17.655 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T09:25:17.753 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T09:25:17.754 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T09:25:17.754 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T09:25:17.761 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T09:25:17.761 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-19T09:25:17.761 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T09:25:17.770 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T09:25:17.770 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-19T09:25:17.770 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T09:25:17.781 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T09:25:17.781 DEBUG:teuthology.orchestra.run.smithi001:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T09:25:17.786 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T09:25:17.786 DEBUG:teuthology.orchestra.run.smithi022:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T09:25:17.797 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T09:25:17.797 DEBUG:teuthology.orchestra.run.smithi121:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T09:25:17.848 DEBUG:teuthology.orchestra.run.smithi001:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T09:25:17.852 DEBUG:teuthology.orchestra.run.smithi022:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T09:25:17.863 DEBUG:teuthology.orchestra.run.smithi121:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T09:25:17.925 DEBUG:teuthology.orchestra.run.smithi001:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T09:25:17.927 DEBUG:teuthology.orchestra.run.smithi022:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T09:25:17.938 DEBUG:teuthology.orchestra.run.smithi121:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T09:25:17.990 INFO:teuthology.orchestra.run.smithi001.stdout:check_obsoletes = 1 2024-09-19T09:25:17.993 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum clean all 2024-09-19T09:25:17.994 INFO:teuthology.orchestra.run.smithi022.stdout:check_obsoletes = 1 2024-09-19T09:25:17.994 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum clean all 2024-09-19T09:25:18.002 INFO:teuthology.orchestra.run.smithi121.stdout:check_obsoletes = 1 2024-09-19T09:25:18.003 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum clean all 2024-09-19T09:25:18.226 INFO:teuthology.orchestra.run.smithi121.stdout:45 files removed 2024-09-19T09:25:18.226 INFO:teuthology.orchestra.run.smithi001.stdout:45 files removed 2024-09-19T09:25:18.227 INFO:teuthology.orchestra.run.smithi022.stdout:45 files removed 2024-09-19T09:25:18.252 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T09:25:18.253 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T09:25:18.255 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T09:25:18.795 INFO:teuthology.orchestra.run.smithi121.stdout:ceph packages for x86_64 314 kB/s | 84 kB 00:00 2024-09-19T09:25:18.809 INFO:teuthology.orchestra.run.smithi022.stdout:ceph packages for x86_64 310 kB/s | 84 kB 00:00 2024-09-19T09:25:18.813 INFO:teuthology.orchestra.run.smithi001.stdout:ceph packages for x86_64 321 kB/s | 84 kB 00:00 2024-09-19T09:25:19.080 INFO:teuthology.orchestra.run.smithi121.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-19T09:25:19.093 INFO:teuthology.orchestra.run.smithi022.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-19T09:25:19.106 INFO:teuthology.orchestra.run.smithi001.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-09-19T09:25:19.355 INFO:teuthology.orchestra.run.smithi121.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-19T09:25:19.369 INFO:teuthology.orchestra.run.smithi022.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-19T09:25:19.381 INFO:teuthology.orchestra.run.smithi001.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-19T09:25:19.863 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.3 MB 00:00 2024-09-19T09:25:20.010 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.3 MB 00:00 2024-09-19T09:25:20.057 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.3 MB 00:00 2024-09-19T09:25:21.843 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-19T09:25:24.103 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - AppStream 6.9 MB/s | 20 MB 00:02 2024-09-19T09:25:25.255 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - AppStream 4.7 MB/s | 20 MB 00:04 2024-09-19T09:25:27.402 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 6.5 MB 00:01 2024-09-19T09:25:28.928 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - Extras packages 102 kB/s | 19 kB 00:00 2024-09-19T09:25:29.562 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 6.5 MB 00:01 2024-09-19T09:25:29.681 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-19T09:25:29.899 INFO:teuthology.orchestra.run.smithi001.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-19T09:25:31.013 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - Extras packages 99 kB/s | 19 kB 00:00 2024-09-19T09:25:31.290 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 19 kB 00:00 2024-09-19T09:25:32.258 INFO:teuthology.orchestra.run.smithi022.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-19T09:25:32.310 INFO:teuthology.orchestra.run.smithi121.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-19T09:25:35.513 INFO:teuthology.orchestra.run.smithi001.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-19T09:25:37.691 INFO:teuthology.orchestra.run.smithi121.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-19T09:25:37.817 INFO:teuthology.orchestra.run.smithi001.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:25:37.818 INFO:teuthology.orchestra.run.smithi001.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:25:37.831 INFO:teuthology.orchestra.run.smithi001.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T09:25:37.832 INFO:teuthology.orchestra.run.smithi001.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T09:25:37.833 INFO:teuthology.orchestra.run.smithi001.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T09:25:37.834 INFO:teuthology.orchestra.run.smithi001.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T09:25:37.836 INFO:teuthology.orchestra.run.smithi001.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T09:25:37.839 INFO:teuthology.orchestra.run.smithi001.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T09:25:37.840 INFO:teuthology.orchestra.run.smithi001.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T09:25:37.873 INFO:teuthology.orchestra.run.smithi022.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-19T09:25:37.910 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-09-19T09:25:37.927 INFO:teuthology.orchestra.run.smithi001.stdout:====================================================================================== 2024-09-19T09:25:37.927 INFO:teuthology.orchestra.run.smithi001.stdout: Package Arch Version Repository Size 2024-09-19T09:25:37.927 INFO:teuthology.orchestra.run.smithi001.stdout:====================================================================================== 2024-09-19T09:25:37.927 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2024-09-19T09:25:37.928 INFO:teuthology.orchestra.run.smithi001.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T09:25:37.928 INFO:teuthology.orchestra.run.smithi001.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T09:25:37.928 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T09:25:37.928 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T09:25:37.929 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T09:25:37.929 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T09:25:37.929 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T09:25:37.929 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T09:25:37.929 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T09:25:37.930 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T09:25:37.930 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T09:25:37.930 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T09:25:37.931 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T09:25:37.931 INFO:teuthology.orchestra.run.smithi001.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T09:25:37.931 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T09:25:37.931 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T09:25:37.931 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T09:25:37.932 INFO:teuthology.orchestra.run.smithi001.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T09:25:37.932 INFO:teuthology.orchestra.run.smithi001.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T09:25:37.932 INFO:teuthology.orchestra.run.smithi001.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T09:25:37.932 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T09:25:37.932 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T09:25:37.933 INFO:teuthology.orchestra.run.smithi001.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T09:25:37.933 INFO:teuthology.orchestra.run.smithi001.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T09:25:37.933 INFO:teuthology.orchestra.run.smithi001.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T09:25:37.933 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T09:25:37.933 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T09:25:37.934 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T09:25:37.934 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T09:25:37.934 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T09:25:37.934 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T09:25:37.934 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T09:25:37.935 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T09:25:37.935 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T09:25:37.935 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T09:25:37.935 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T09:25:37.935 INFO:teuthology.orchestra.run.smithi001.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T09:25:37.936 INFO:teuthology.orchestra.run.smithi001.stdout:Upgrading: 2024-09-19T09:25:37.936 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T09:25:37.936 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T09:25:37.936 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T09:25:37.936 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T09:25:37.937 INFO:teuthology.orchestra.run.smithi001.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T09:25:37.937 INFO:teuthology.orchestra.run.smithi001.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T09:25:37.937 INFO:teuthology.orchestra.run.smithi001.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T09:25:37.937 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T09:25:37.937 INFO:teuthology.orchestra.run.smithi001.stdout:Installing dependencies: 2024-09-19T09:25:37.937 INFO:teuthology.orchestra.run.smithi001.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T09:25:37.938 INFO:teuthology.orchestra.run.smithi001.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T09:25:37.938 INFO:teuthology.orchestra.run.smithi001.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T09:25:37.938 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T09:25:37.938 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T09:25:37.938 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T09:25:37.939 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T09:25:37.939 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T09:25:37.939 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T09:25:37.939 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T09:25:37.939 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T09:25:37.940 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T09:25:37.940 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T09:25:37.940 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T09:25:37.940 INFO:teuthology.orchestra.run.smithi001.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T09:25:37.940 INFO:teuthology.orchestra.run.smithi001.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T09:25:37.941 INFO:teuthology.orchestra.run.smithi001.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T09:25:37.941 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T09:25:37.941 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T09:25:37.941 INFO:teuthology.orchestra.run.smithi001.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T09:25:37.941 INFO:teuthology.orchestra.run.smithi001.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T09:25:37.942 INFO:teuthology.orchestra.run.smithi001.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T09:25:37.942 INFO:teuthology.orchestra.run.smithi001.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T09:25:37.942 INFO:teuthology.orchestra.run.smithi001.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T09:25:37.942 INFO:teuthology.orchestra.run.smithi001.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T09:25:37.942 INFO:teuthology.orchestra.run.smithi001.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T09:25:37.943 INFO:teuthology.orchestra.run.smithi001.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T09:25:37.943 INFO:teuthology.orchestra.run.smithi001.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T09:25:37.943 INFO:teuthology.orchestra.run.smithi001.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T09:25:37.943 INFO:teuthology.orchestra.run.smithi001.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T09:25:37.943 INFO:teuthology.orchestra.run.smithi001.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T09:25:37.944 INFO:teuthology.orchestra.run.smithi001.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T09:25:37.944 INFO:teuthology.orchestra.run.smithi001.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T09:25:37.944 INFO:teuthology.orchestra.run.smithi001.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T09:25:37.944 INFO:teuthology.orchestra.run.smithi001.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T09:25:37.944 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T09:25:37.945 INFO:teuthology.orchestra.run.smithi001.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T09:25:37.945 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T09:25:37.945 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T09:25:37.945 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T09:25:37.945 INFO:teuthology.orchestra.run.smithi001.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T09:25:37.945 INFO:teuthology.orchestra.run.smithi001.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T09:25:37.946 INFO:teuthology.orchestra.run.smithi001.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T09:25:37.946 INFO:teuthology.orchestra.run.smithi001.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T09:25:37.946 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T09:25:37.946 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T09:25:37.946 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T09:25:37.946 INFO:teuthology.orchestra.run.smithi001.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T09:25:37.947 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T09:25:37.947 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T09:25:37.947 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T09:25:37.947 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T09:25:37.947 INFO:teuthology.orchestra.run.smithi001.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T09:25:37.947 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T09:25:37.947 INFO:teuthology.orchestra.run.smithi001.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T09:25:37.948 INFO:teuthology.orchestra.run.smithi001.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T09:25:37.948 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T09:25:37.948 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T09:25:37.948 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T09:25:37.948 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T09:25:37.948 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T09:25:37.948 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T09:25:37.948 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T09:25:37.948 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T09:25:37.949 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T09:25:37.949 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T09:25:37.949 INFO:teuthology.orchestra.run.smithi001.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T09:25:37.949 INFO:teuthology.orchestra.run.smithi001.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T09:25:37.949 INFO:teuthology.orchestra.run.smithi001.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T09:25:37.949 INFO:teuthology.orchestra.run.smithi001.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T09:25:37.949 INFO:teuthology.orchestra.run.smithi001.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T09:25:37.949 INFO:teuthology.orchestra.run.smithi001.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T09:25:37.949 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T09:25:37.950 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T09:25:37.950 INFO:teuthology.orchestra.run.smithi001.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T09:25:37.950 INFO:teuthology.orchestra.run.smithi001.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T09:25:37.950 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T09:25:37.950 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T09:25:37.950 INFO:teuthology.orchestra.run.smithi001.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T09:25:37.950 INFO:teuthology.orchestra.run.smithi001.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T09:25:37.950 INFO:teuthology.orchestra.run.smithi001.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T09:25:37.950 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T09:25:37.950 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T09:25:37.950 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T09:25:37.950 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T09:25:37.951 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T09:25:37.951 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T09:25:37.951 INFO:teuthology.orchestra.run.smithi001.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T09:25:37.951 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T09:25:37.951 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T09:25:37.951 INFO:teuthology.orchestra.run.smithi001.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T09:25:37.951 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T09:25:37.951 INFO:teuthology.orchestra.run.smithi001.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T09:25:37.951 INFO:teuthology.orchestra.run.smithi001.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T09:25:37.951 INFO:teuthology.orchestra.run.smithi001.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T09:25:37.952 INFO:teuthology.orchestra.run.smithi001.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T09:25:37.952 INFO:teuthology.orchestra.run.smithi001.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T09:25:37.952 INFO:teuthology.orchestra.run.smithi001.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T09:25:37.952 INFO:teuthology.orchestra.run.smithi001.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T09:25:37.952 INFO:teuthology.orchestra.run.smithi001.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T09:25:37.952 INFO:teuthology.orchestra.run.smithi001.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T09:25:37.952 INFO:teuthology.orchestra.run.smithi001.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T09:25:37.952 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T09:25:37.952 INFO:teuthology.orchestra.run.smithi001.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T09:25:37.952 INFO:teuthology.orchestra.run.smithi001.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T09:25:37.953 INFO:teuthology.orchestra.run.smithi001.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T09:25:37.953 INFO:teuthology.orchestra.run.smithi001.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T09:25:37.953 INFO:teuthology.orchestra.run.smithi001.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T09:25:37.953 INFO:teuthology.orchestra.run.smithi001.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T09:25:37.953 INFO:teuthology.orchestra.run.smithi001.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T09:25:37.953 INFO:teuthology.orchestra.run.smithi001.stdout:Installing weak dependencies: 2024-09-19T09:25:37.953 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T09:25:37.953 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:25:37.953 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-09-19T09:25:37.953 INFO:teuthology.orchestra.run.smithi001.stdout:====================================================================================== 2024-09-19T09:25:37.953 INFO:teuthology.orchestra.run.smithi001.stdout:Install 148 Packages 2024-09-19T09:25:37.953 INFO:teuthology.orchestra.run.smithi001.stdout:Upgrade 8 Packages 2024-09-19T09:25:37.954 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:25:37.954 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 226 M 2024-09-19T09:25:37.954 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2024-09-19T09:25:38.631 INFO:teuthology.orchestra.run.smithi001.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 56 kB/s | 6.6 kB 00:00 2024-09-19T09:25:38.873 INFO:teuthology.orchestra.run.smithi001.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 3.6 MB/s | 896 kB 00:00 2024-09-19T09:25:38.957 INFO:teuthology.orchestra.run.smithi001.stdout:(3/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 12 MB/s | 5.4 MB 00:00 2024-09-19T09:25:38.982 INFO:teuthology.orchestra.run.smithi001.stdout:(4/156): ceph-immutable-object-cache-19.1.1-361 1.3 MB/s | 145 kB 00:00 2024-09-19T09:25:39.090 INFO:teuthology.orchestra.run.smithi001.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 18 MB/s | 2.4 MB 00:00 2024-09-19T09:25:39.207 INFO:teuthology.orchestra.run.smithi001.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 6.8 MB/s | 1.5 MB 00:00 2024-09-19T09:25:39.299 INFO:teuthology.orchestra.run.smithi001.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 23 MB/s | 4.7 MB 00:00 2024-09-19T09:25:39.791 INFO:teuthology.orchestra.run.smithi001.stdout:(8/156): ceph-radosgw-19.1.1-361.g2f599a46.el9. 22 MB/s | 11 MB 00:00 2024-09-19T09:25:39.819 INFO:teuthology.orchestra.run.smithi121.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:25:39.819 INFO:teuthology.orchestra.run.smithi121.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:25:39.833 INFO:teuthology.orchestra.run.smithi121.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T09:25:39.834 INFO:teuthology.orchestra.run.smithi121.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T09:25:39.835 INFO:teuthology.orchestra.run.smithi121.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T09:25:39.836 INFO:teuthology.orchestra.run.smithi121.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T09:25:39.838 INFO:teuthology.orchestra.run.smithi121.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T09:25:39.840 INFO:teuthology.orchestra.run.smithi121.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T09:25:39.841 INFO:teuthology.orchestra.run.smithi121.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T09:25:39.905 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-19T09:25:39.926 INFO:teuthology.orchestra.run.smithi121.stdout:====================================================================================== 2024-09-19T09:25:39.926 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2024-09-19T09:25:39.926 INFO:teuthology.orchestra.run.smithi121.stdout:====================================================================================== 2024-09-19T09:25:39.926 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-09-19T09:25:39.926 INFO:teuthology.orchestra.run.smithi121.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T09:25:39.926 INFO:teuthology.orchestra.run.smithi121.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T09:25:39.926 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T09:25:39.926 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T09:25:39.926 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T09:25:39.927 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T09:25:39.927 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T09:25:39.927 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T09:25:39.927 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T09:25:39.927 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T09:25:39.927 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T09:25:39.927 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T09:25:39.927 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T09:25:39.927 INFO:teuthology.orchestra.run.smithi121.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T09:25:39.927 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T09:25:39.927 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T09:25:39.927 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T09:25:39.928 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T09:25:39.928 INFO:teuthology.orchestra.run.smithi121.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T09:25:39.928 INFO:teuthology.orchestra.run.smithi121.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T09:25:39.928 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T09:25:39.928 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T09:25:39.928 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T09:25:39.928 INFO:teuthology.orchestra.run.smithi121.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T09:25:39.928 INFO:teuthology.orchestra.run.smithi121.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T09:25:39.928 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T09:25:39.928 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T09:25:39.928 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T09:25:39.928 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T09:25:39.928 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T09:25:39.929 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T09:25:39.929 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T09:25:39.929 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T09:25:39.929 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T09:25:39.929 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T09:25:39.929 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T09:25:39.929 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T09:25:39.929 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrading: 2024-09-19T09:25:39.929 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T09:25:39.929 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T09:25:39.929 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T09:25:39.929 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T09:25:39.930 INFO:teuthology.orchestra.run.smithi121.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T09:25:39.930 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T09:25:39.930 INFO:teuthology.orchestra.run.smithi121.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T09:25:39.930 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T09:25:39.930 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2024-09-19T09:25:39.930 INFO:teuthology.orchestra.run.smithi121.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T09:25:39.930 INFO:teuthology.orchestra.run.smithi121.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T09:25:39.930 INFO:teuthology.orchestra.run.smithi121.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T09:25:39.930 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T09:25:39.930 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T09:25:39.930 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T09:25:39.930 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T09:25:39.930 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T09:25:39.930 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T09:25:39.931 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T09:25:39.931 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T09:25:39.931 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T09:25:39.931 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T09:25:39.931 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T09:25:39.931 INFO:teuthology.orchestra.run.smithi121.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T09:25:39.931 INFO:teuthology.orchestra.run.smithi121.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T09:25:39.931 INFO:teuthology.orchestra.run.smithi121.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T09:25:39.931 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T09:25:39.931 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T09:25:39.931 INFO:teuthology.orchestra.run.smithi121.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T09:25:39.931 INFO:teuthology.orchestra.run.smithi121.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T09:25:39.931 INFO:teuthology.orchestra.run.smithi121.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T09:25:39.932 INFO:teuthology.orchestra.run.smithi121.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T09:25:39.932 INFO:teuthology.orchestra.run.smithi121.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T09:25:39.932 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T09:25:39.932 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T09:25:39.932 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T09:25:39.932 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T09:25:39.932 INFO:teuthology.orchestra.run.smithi121.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T09:25:39.932 INFO:teuthology.orchestra.run.smithi121.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T09:25:39.932 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T09:25:39.932 INFO:teuthology.orchestra.run.smithi121.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T09:25:39.932 INFO:teuthology.orchestra.run.smithi121.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T09:25:39.932 INFO:teuthology.orchestra.run.smithi121.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T09:25:39.932 INFO:teuthology.orchestra.run.smithi121.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T09:25:39.933 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T09:25:39.933 INFO:teuthology.orchestra.run.smithi121.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T09:25:39.933 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T09:25:39.933 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T09:25:39.933 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T09:25:39.933 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T09:25:39.933 INFO:teuthology.orchestra.run.smithi121.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T09:25:39.933 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T09:25:39.933 INFO:teuthology.orchestra.run.smithi121.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T09:25:39.933 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T09:25:39.933 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T09:25:39.933 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T09:25:39.933 INFO:teuthology.orchestra.run.smithi121.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T09:25:39.934 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T09:25:39.934 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T09:25:39.934 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T09:25:39.934 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T09:25:39.934 INFO:teuthology.orchestra.run.smithi121.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T09:25:39.934 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T09:25:39.934 INFO:teuthology.orchestra.run.smithi121.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T09:25:39.934 INFO:teuthology.orchestra.run.smithi121.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T09:25:39.934 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T09:25:39.934 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T09:25:39.934 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T09:25:39.934 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T09:25:39.934 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T09:25:39.935 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T09:25:39.935 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T09:25:39.935 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T09:25:39.935 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T09:25:39.935 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T09:25:39.935 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T09:25:39.935 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T09:25:39.935 INFO:teuthology.orchestra.run.smithi121.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T09:25:39.935 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T09:25:39.935 INFO:teuthology.orchestra.run.smithi121.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T09:25:39.935 INFO:teuthology.orchestra.run.smithi121.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T09:25:39.935 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T09:25:39.935 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T09:25:39.935 INFO:teuthology.orchestra.run.smithi121.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T09:25:39.936 INFO:teuthology.orchestra.run.smithi121.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T09:25:39.936 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T09:25:39.936 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T09:25:39.936 INFO:teuthology.orchestra.run.smithi121.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T09:25:39.936 INFO:teuthology.orchestra.run.smithi121.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T09:25:39.936 INFO:teuthology.orchestra.run.smithi121.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T09:25:39.936 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T09:25:39.936 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T09:25:39.936 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T09:25:39.936 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T09:25:39.936 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T09:25:39.936 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T09:25:39.936 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T09:25:39.937 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T09:25:39.937 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T09:25:39.937 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T09:25:39.937 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T09:25:39.937 INFO:teuthology.orchestra.run.smithi121.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T09:25:39.937 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T09:25:39.937 INFO:teuthology.orchestra.run.smithi121.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T09:25:39.937 INFO:teuthology.orchestra.run.smithi121.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T09:25:39.937 INFO:teuthology.orchestra.run.smithi121.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T09:25:39.937 INFO:teuthology.orchestra.run.smithi121.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T09:25:39.937 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T09:25:39.937 INFO:teuthology.orchestra.run.smithi121.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T09:25:39.937 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T09:25:39.937 INFO:teuthology.orchestra.run.smithi121.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T09:25:39.938 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T09:25:39.938 INFO:teuthology.orchestra.run.smithi121.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T09:25:39.938 INFO:teuthology.orchestra.run.smithi121.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T09:25:39.938 INFO:teuthology.orchestra.run.smithi121.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T09:25:39.938 INFO:teuthology.orchestra.run.smithi121.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T09:25:39.938 INFO:teuthology.orchestra.run.smithi121.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T09:25:39.938 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T09:25:39.938 INFO:teuthology.orchestra.run.smithi121.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T09:25:39.938 INFO:teuthology.orchestra.run.smithi121.stdout:Installing weak dependencies: 2024-09-19T09:25:39.938 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T09:25:39.938 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-19T09:25:39.938 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-09-19T09:25:39.938 INFO:teuthology.orchestra.run.smithi121.stdout:====================================================================================== 2024-09-19T09:25:39.938 INFO:teuthology.orchestra.run.smithi121.stdout:Install 148 Packages 2024-09-19T09:25:39.939 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrade 8 Packages 2024-09-19T09:25:39.939 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-19T09:25:39.939 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 226 M 2024-09-19T09:25:39.939 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-09-19T09:25:40.008 INFO:teuthology.orchestra.run.smithi001.stdout:(9/156): ceph-common-19.1.1-361.g2f599a46.el9.x 14 MB/s | 21 MB 00:01 2024-09-19T09:25:40.033 INFO:teuthology.orchestra.run.smithi001.stdout:(10/156): ceph-selinux-19.1.1-361.g2f599a46.el9 104 kB/s | 25 kB 00:00 2024-09-19T09:25:40.092 INFO:teuthology.orchestra.run.smithi001.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.8 MB/s | 228 kB 00:00 2024-09-19T09:25:40.129 INFO:teuthology.orchestra.run.smithi022.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:25:40.129 INFO:teuthology.orchestra.run.smithi022.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:25:40.144 INFO:teuthology.orchestra.run.smithi022.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T09:25:40.145 INFO:teuthology.orchestra.run.smithi022.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T09:25:40.146 INFO:teuthology.orchestra.run.smithi022.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T09:25:40.147 INFO:teuthology.orchestra.run.smithi022.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T09:25:40.149 INFO:teuthology.orchestra.run.smithi022.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T09:25:40.150 INFO:teuthology.orchestra.run.smithi001.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 464 kB/s | 27 kB 00:00 2024-09-19T09:25:40.152 INFO:teuthology.orchestra.run.smithi022.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T09:25:40.153 INFO:teuthology.orchestra.run.smithi022.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T09:25:40.209 INFO:teuthology.orchestra.run.smithi001.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 544 kB/s | 32 kB 00:00 2024-09-19T09:25:40.219 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-09-19T09:25:40.239 INFO:teuthology.orchestra.run.smithi022.stdout:====================================================================================== 2024-09-19T09:25:40.239 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2024-09-19T09:25:40.239 INFO:teuthology.orchestra.run.smithi022.stdout:====================================================================================== 2024-09-19T09:25:40.239 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-09-19T09:25:40.239 INFO:teuthology.orchestra.run.smithi022.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T09:25:40.239 INFO:teuthology.orchestra.run.smithi022.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T09:25:40.239 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T09:25:40.239 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T09:25:40.239 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T09:25:40.239 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T09:25:40.239 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T09:25:40.240 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T09:25:40.240 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T09:25:40.240 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T09:25:40.240 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T09:25:40.240 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T09:25:40.240 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T09:25:40.240 INFO:teuthology.orchestra.run.smithi022.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T09:25:40.240 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T09:25:40.240 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T09:25:40.240 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T09:25:40.240 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T09:25:40.241 INFO:teuthology.orchestra.run.smithi022.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T09:25:40.241 INFO:teuthology.orchestra.run.smithi022.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T09:25:40.241 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T09:25:40.241 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T09:25:40.241 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T09:25:40.241 INFO:teuthology.orchestra.run.smithi022.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T09:25:40.241 INFO:teuthology.orchestra.run.smithi022.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T09:25:40.241 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T09:25:40.241 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T09:25:40.241 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T09:25:40.241 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T09:25:40.241 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T09:25:40.241 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T09:25:40.242 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T09:25:40.242 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T09:25:40.242 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T09:25:40.242 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T09:25:40.242 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T09:25:40.242 INFO:teuthology.orchestra.run.smithi022.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T09:25:40.242 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrading: 2024-09-19T09:25:40.242 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T09:25:40.242 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T09:25:40.242 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T09:25:40.242 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T09:25:40.242 INFO:teuthology.orchestra.run.smithi022.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T09:25:40.242 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T09:25:40.243 INFO:teuthology.orchestra.run.smithi022.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T09:25:40.243 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T09:25:40.243 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2024-09-19T09:25:40.243 INFO:teuthology.orchestra.run.smithi022.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T09:25:40.243 INFO:teuthology.orchestra.run.smithi022.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T09:25:40.243 INFO:teuthology.orchestra.run.smithi022.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T09:25:40.243 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T09:25:40.243 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T09:25:40.243 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T09:25:40.243 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T09:25:40.244 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T09:25:40.244 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T09:25:40.244 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T09:25:40.244 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T09:25:40.244 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T09:25:40.244 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T09:25:40.244 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T09:25:40.244 INFO:teuthology.orchestra.run.smithi022.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T09:25:40.244 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T09:25:40.244 INFO:teuthology.orchestra.run.smithi022.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T09:25:40.244 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T09:25:40.245 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T09:25:40.245 INFO:teuthology.orchestra.run.smithi022.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T09:25:40.245 INFO:teuthology.orchestra.run.smithi022.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T09:25:40.245 INFO:teuthology.orchestra.run.smithi022.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T09:25:40.245 INFO:teuthology.orchestra.run.smithi022.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T09:25:40.245 INFO:teuthology.orchestra.run.smithi022.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T09:25:40.245 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T09:25:40.245 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T09:25:40.245 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T09:25:40.245 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T09:25:40.245 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T09:25:40.245 INFO:teuthology.orchestra.run.smithi022.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T09:25:40.245 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T09:25:40.245 INFO:teuthology.orchestra.run.smithi022.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T09:25:40.246 INFO:teuthology.orchestra.run.smithi022.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T09:25:40.246 INFO:teuthology.orchestra.run.smithi022.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T09:25:40.246 INFO:teuthology.orchestra.run.smithi022.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T09:25:40.246 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T09:25:40.246 INFO:teuthology.orchestra.run.smithi022.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T09:25:40.246 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T09:25:40.246 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T09:25:40.246 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T09:25:40.246 INFO:teuthology.orchestra.run.smithi022.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T09:25:40.246 INFO:teuthology.orchestra.run.smithi022.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T09:25:40.246 INFO:teuthology.orchestra.run.smithi022.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T09:25:40.246 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T09:25:40.246 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T09:25:40.247 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T09:25:40.247 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T09:25:40.247 INFO:teuthology.orchestra.run.smithi022.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T09:25:40.247 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T09:25:40.247 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T09:25:40.247 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T09:25:40.247 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T09:25:40.247 INFO:teuthology.orchestra.run.smithi022.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T09:25:40.247 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T09:25:40.247 INFO:teuthology.orchestra.run.smithi022.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T09:25:40.247 INFO:teuthology.orchestra.run.smithi022.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T09:25:40.247 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T09:25:40.248 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T09:25:40.248 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T09:25:40.248 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T09:25:40.248 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T09:25:40.248 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T09:25:40.248 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T09:25:40.248 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T09:25:40.248 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T09:25:40.248 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T09:25:40.248 INFO:teuthology.orchestra.run.smithi022.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T09:25:40.248 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T09:25:40.248 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T09:25:40.248 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T09:25:40.249 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T09:25:40.249 INFO:teuthology.orchestra.run.smithi022.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T09:25:40.249 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T09:25:40.249 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T09:25:40.249 INFO:teuthology.orchestra.run.smithi022.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T09:25:40.249 INFO:teuthology.orchestra.run.smithi022.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T09:25:40.249 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T09:25:40.249 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T09:25:40.249 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T09:25:40.249 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T09:25:40.249 INFO:teuthology.orchestra.run.smithi022.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T09:25:40.249 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T09:25:40.249 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T09:25:40.249 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T09:25:40.250 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T09:25:40.250 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T09:25:40.250 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T09:25:40.250 INFO:teuthology.orchestra.run.smithi022.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T09:25:40.250 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T09:25:40.250 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T09:25:40.250 INFO:teuthology.orchestra.run.smithi022.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T09:25:40.250 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T09:25:40.250 INFO:teuthology.orchestra.run.smithi022.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T09:25:40.250 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T09:25:40.251 INFO:teuthology.orchestra.run.smithi022.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T09:25:40.251 INFO:teuthology.orchestra.run.smithi022.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T09:25:40.251 INFO:teuthology.orchestra.run.smithi022.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T09:25:40.251 INFO:teuthology.orchestra.run.smithi022.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T09:25:40.251 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T09:25:40.251 INFO:teuthology.orchestra.run.smithi022.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T09:25:40.251 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T09:25:40.251 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T09:25:40.251 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T09:25:40.251 INFO:teuthology.orchestra.run.smithi022.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T09:25:40.251 INFO:teuthology.orchestra.run.smithi022.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T09:25:40.251 INFO:teuthology.orchestra.run.smithi022.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T09:25:40.251 INFO:teuthology.orchestra.run.smithi022.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T09:25:40.252 INFO:teuthology.orchestra.run.smithi022.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T09:25:40.252 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T09:25:40.252 INFO:teuthology.orchestra.run.smithi022.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T09:25:40.252 INFO:teuthology.orchestra.run.smithi022.stdout:Installing weak dependencies: 2024-09-19T09:25:40.252 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T09:25:40.252 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T09:25:40.252 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-09-19T09:25:40.252 INFO:teuthology.orchestra.run.smithi022.stdout:====================================================================================== 2024-09-19T09:25:40.252 INFO:teuthology.orchestra.run.smithi022.stdout:Install 148 Packages 2024-09-19T09:25:40.252 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrade 8 Packages 2024-09-19T09:25:40.253 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T09:25:40.253 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 226 M 2024-09-19T09:25:40.253 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-09-19T09:25:40.284 INFO:teuthology.orchestra.run.smithi001.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 9.8 MB/s | 751 kB 00:00 2024-09-19T09:25:40.352 INFO:teuthology.orchestra.run.smithi001.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.4 MB/s | 163 kB 00:00 2024-09-19T09:25:40.418 INFO:teuthology.orchestra.run.smithi001.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 1.9 MB/s | 127 kB 00:00 2024-09-19T09:25:40.494 INFO:teuthology.orchestra.run.smithi001.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 6.6 MB/s | 506 kB 00:00 2024-09-19T09:25:40.777 INFO:teuthology.orchestra.run.smithi001.stdout:(18/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 19 MB/s | 5.3 MB 00:00 2024-09-19T09:25:40.875 INFO:teuthology.orchestra.run.smithi121.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 48 kB/s | 6.6 kB 00:00 2024-09-19T09:25:40.944 INFO:teuthology.orchestra.run.smithi001.stdout:(19/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 9.7 MB/s | 17 MB 00:01 2024-09-19T09:25:40.961 INFO:teuthology.orchestra.run.smithi001.stdout:(20/156): python3-ceph-argparse-19.1.1-361.g2f5 246 kB/s | 45 kB 00:00 2024-09-19T09:25:40.995 INFO:teuthology.orchestra.run.smithi001.stdout:(21/156): python3-ceph-common-19.1.1-361.g2f599 2.7 MB/s | 136 kB 00:00 2024-09-19T09:25:41.016 INFO:teuthology.orchestra.run.smithi022.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 55 kB/s | 6.6 kB 00:00 2024-09-19T09:25:41.020 INFO:teuthology.orchestra.run.smithi001.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.7 MB/s | 161 kB 00:00 2024-09-19T09:25:41.112 INFO:teuthology.orchestra.run.smithi001.stdout:(23/156): python3-rbd-19.1.1-361.g2f599a46.el9. 3.2 MB/s | 300 kB 00:00 2024-09-19T09:25:41.134 INFO:teuthology.orchestra.run.smithi121.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 3.4 MB/s | 896 kB 00:00 2024-09-19T09:25:41.145 INFO:teuthology.orchestra.run.smithi001.stdout:(24/156): python3-rados-19.1.1-361.g2f599a46.el 2.1 MB/s | 320 kB 00:00 2024-09-19T09:25:41.196 INFO:teuthology.orchestra.run.smithi001.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.2 MB/s | 99 kB 00:00 2024-09-19T09:25:41.235 INFO:teuthology.orchestra.run.smithi121.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.4 MB/s | 145 kB 00:00 2024-09-19T09:25:41.246 INFO:teuthology.orchestra.run.smithi001.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 849 kB/s | 85 kB 00:00 2024-09-19T09:25:41.335 INFO:teuthology.orchestra.run.smithi121.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 9.1 MB/s | 5.4 MB 00:00 2024-09-19T09:25:41.354 INFO:teuthology.orchestra.run.smithi001.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 1.5 MB/s | 171 kB 00:00 2024-09-19T09:25:41.455 INFO:teuthology.orchestra.run.smithi001.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 318 kB/s | 32 kB 00:00 2024-09-19T09:25:41.530 INFO:teuthology.orchestra.run.smithi001.stdout:(29/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 9.3 MB/s | 3.1 MB 00:00 2024-09-19T09:25:41.556 INFO:teuthology.orchestra.run.smithi001.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.4 MB/s | 146 kB 00:00 2024-09-19T09:25:41.660 INFO:teuthology.orchestra.run.smithi121.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 5.6 MB/s | 2.4 MB 00:00 2024-09-19T09:25:41.702 INFO:teuthology.orchestra.run.smithi121.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 4.1 MB/s | 1.5 MB 00:00 2024-09-19T09:25:42.006 INFO:teuthology.orchestra.run.smithi001.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 7.5 MB/s | 3.6 MB 00:00 2024-09-19T09:25:42.008 INFO:teuthology.orchestra.run.smithi022.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 903 kB/s | 896 kB 00:00 2024-09-19T09:25:42.098 INFO:teuthology.orchestra.run.smithi001.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.7 MB/s | 249 kB 00:00 2024-09-19T09:25:42.175 INFO:teuthology.orchestra.run.smithi022.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 871 kB/s | 145 kB 00:00 2024-09-19T09:25:42.190 INFO:teuthology.orchestra.run.smithi001.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 538 kB/s | 49 kB 00:00 2024-09-19T09:25:42.273 INFO:teuthology.orchestra.run.smithi001.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 197 kB/s | 16 kB 00:00 2024-09-19T09:25:42.365 INFO:teuthology.orchestra.run.smithi001.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 3.0 MB/s | 285 kB 00:00 2024-09-19T09:25:42.515 INFO:teuthology.orchestra.run.smithi001.stdout:(36/156): cephadm-19.1.1-361.g2f599a46.el9.noar 5.0 MB/s | 765 kB 00:00 2024-09-19T09:25:42.600 INFO:teuthology.orchestra.run.smithi001.stdout:(37/156): ceph-mgr-diskprediction-local-19.1.1- 7.1 MB/s | 7.4 MB 00:01 2024-09-19T09:25:42.610 INFO:teuthology.orchestra.run.smithi121.stdout:(7/156): ceph-common-19.1.1-361.g2f599a46.el9.x 11 MB/s | 21 MB 00:01 2024-09-19T09:25:42.616 INFO:teuthology.orchestra.run.smithi001.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 182 kB/s | 18 kB 00:00 2024-09-19T09:25:42.685 INFO:teuthology.orchestra.run.smithi121.stdout:(8/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 4.6 MB/s | 4.7 MB 00:01 2024-09-19T09:25:42.727 INFO:teuthology.orchestra.run.smithi121.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 604 kB/s | 25 kB 00:00 2024-09-19T09:25:42.850 INFO:teuthology.orchestra.run.smithi022.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 2.8 MB/s | 5.4 MB 00:01 2024-09-19T09:25:43.067 INFO:teuthology.orchestra.run.smithi001.stdout:(39/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 16 MB/s | 49 MB 00:03 2024-09-19T09:25:43.109 INFO:teuthology.orchestra.run.smithi022.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 5.9 MB/s | 1.5 MB 00:00 2024-09-19T09:25:43.208 INFO:teuthology.orchestra.run.smithi001.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 131 kB/s | 80 kB 00:00 2024-09-19T09:25:43.219 INFO:teuthology.orchestra.run.smithi121.stdout:(10/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 17 MB 00:01 2024-09-19T09:25:43.233 INFO:teuthology.orchestra.run.smithi001.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-19T09:25:43.234 INFO:teuthology.orchestra.run.smithi022.stdout:(6/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 2.3 MB/s | 2.4 MB 00:01 2024-09-19T09:25:43.270 INFO:teuthology.orchestra.run.smithi121.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 4.5 MB/s | 228 kB 00:00 2024-09-19T09:25:43.325 INFO:teuthology.orchestra.run.smithi001.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 801 kB 00:00 2024-09-19T09:25:43.351 INFO:teuthology.orchestra.run.smithi001.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-09-19T09:25:43.378 INFO:teuthology.orchestra.run.smithi121.stdout:(12/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 14 MB/s | 11 MB 00:00 2024-09-19T09:25:43.404 INFO:teuthology.orchestra.run.smithi121.stdout:(13/156): cephfs-shell-19.1.1-361.g2f599a46.el9 202 kB/s | 27 kB 00:00 2024-09-19T09:25:43.417 INFO:teuthology.orchestra.run.smithi001.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 6.7 MB/s | 1.2 MB 00:00 2024-09-19T09:25:43.429 INFO:teuthology.orchestra.run.smithi121.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 633 kB/s | 32 kB 00:00 2024-09-19T09:25:43.442 INFO:teuthology.orchestra.run.smithi022.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 14 MB/s | 4.7 MB 00:00 2024-09-19T09:25:43.443 INFO:teuthology.orchestra.run.smithi001.stdout:(45/156): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-09-19T09:25:43.462 INFO:teuthology.orchestra.run.smithi121.stdout:(15/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 13 MB/s | 751 kB 00:00 2024-09-19T09:25:43.476 INFO:teuthology.orchestra.run.smithi001.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-19T09:25:43.487 INFO:teuthology.orchestra.run.smithi121.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.7 MB/s | 163 kB 00:00 2024-09-19T09:25:43.493 INFO:teuthology.orchestra.run.smithi001.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-19T09:25:43.514 INFO:teuthology.orchestra.run.smithi121.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 2.5 MB/s | 127 kB 00:00 2024-09-19T09:25:43.519 INFO:teuthology.orchestra.run.smithi001.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-19T09:25:43.563 INFO:teuthology.orchestra.run.smithi121.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 6.6 MB/s | 506 kB 00:00 2024-09-19T09:25:43.611 INFO:teuthology.orchestra.run.smithi001.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 107 kB 00:00 2024-09-19T09:25:43.639 INFO:teuthology.orchestra.run.smithi121.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 602 kB/s | 45 kB 00:00 2024-09-19T09:25:43.653 INFO:teuthology.orchestra.run.smithi001.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-09-19T09:25:43.678 INFO:teuthology.orchestra.run.smithi001.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 326 kB/s | 22 kB 00:00 2024-09-19T09:25:43.703 INFO:teuthology.orchestra.run.smithi001.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 4.4 MB/s | 943 kB 00:00 2024-09-19T09:25:43.722 INFO:teuthology.orchestra.run.smithi121.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.6 MB/s | 136 kB 00:00 2024-09-19T09:25:43.728 INFO:teuthology.orchestra.run.smithi001.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-09-19T09:25:43.754 INFO:teuthology.orchestra.run.smithi001.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 432 kB/s | 33 kB 00:00 2024-09-19T09:25:43.796 INFO:teuthology.orchestra.run.smithi001.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 272 kB/s | 18 kB 00:00 2024-09-19T09:25:43.806 INFO:teuthology.orchestra.run.smithi121.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.9 MB/s | 161 kB 00:00 2024-09-19T09:25:43.821 INFO:teuthology.orchestra.run.smithi001.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 167 kB/s | 11 kB 00:00 2024-09-19T09:25:43.871 INFO:teuthology.orchestra.run.smithi001.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 18 MB/s | 3.0 MB 00:00 2024-09-19T09:25:43.896 INFO:teuthology.orchestra.run.smithi001.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 601 kB/s | 45 kB 00:00 2024-09-19T09:25:43.898 INFO:teuthology.orchestra.run.smithi121.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 3.4 MB/s | 320 kB 00:00 2024-09-19T09:25:43.921 INFO:teuthology.orchestra.run.smithi001.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-19T09:25:43.963 INFO:teuthology.orchestra.run.smithi001.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-09-19T09:25:43.989 INFO:teuthology.orchestra.run.smithi001.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 366 kB/s | 24 kB 00:00 2024-09-19T09:25:43.990 INFO:teuthology.orchestra.run.smithi121.stdout:(23/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 11 MB/s | 5.3 MB 00:00 2024-09-19T09:25:44.015 INFO:teuthology.orchestra.run.smithi121.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 2.5 MB/s | 300 kB 00:00 2024-09-19T09:25:44.030 INFO:teuthology.orchestra.run.smithi001.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 4.2 MB/s | 581 kB 00:00 2024-09-19T09:25:44.040 INFO:teuthology.orchestra.run.smithi121.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T09:25:44.056 INFO:teuthology.orchestra.run.smithi001.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 514 kB/s | 47 kB 00:00 2024-09-19T09:25:44.065 INFO:teuthology.orchestra.run.smithi121.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T09:25:44.090 INFO:teuthology.orchestra.run.smithi001.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-19T09:25:44.115 INFO:teuthology.orchestra.run.smithi001.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-19T09:25:44.116 INFO:teuthology.orchestra.run.smithi121.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-19T09:25:44.140 INFO:teuthology.orchestra.run.smithi001.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 458 kB/s | 38 kB 00:00 2024-09-19T09:25:44.159 INFO:teuthology.orchestra.run.smithi022.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 6.5 MB/s | 21 MB 00:03 2024-09-19T09:25:44.166 INFO:teuthology.orchestra.run.smithi121.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 636 kB/s | 32 kB 00:00 2024-09-19T09:25:44.225 INFO:teuthology.orchestra.run.smithi121.stdout:(29/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 17 MB/s | 3.1 MB 00:00 2024-09-19T09:25:44.249 INFO:teuthology.orchestra.run.smithi001.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 31 MB/s | 4.9 MB 00:00 2024-09-19T09:25:44.250 INFO:teuthology.orchestra.run.smithi121.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.7 MB/s | 146 kB 00:00 2024-09-19T09:25:44.285 INFO:teuthology.orchestra.run.smithi022.stdout:(9/156): ceph-radosgw-19.1.1-361.g2f599a46.el9. 13 MB/s | 11 MB 00:00 2024-09-19T09:25:44.291 INFO:teuthology.orchestra.run.smithi001.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-19T09:25:44.310 INFO:teuthology.orchestra.run.smithi022.stdout:(10/156): ceph-selinux-19.1.1-361.g2f599a46.el9 167 kB/s | 25 kB 00:00 2024-09-19T09:25:44.358 INFO:teuthology.orchestra.run.smithi001.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-19T09:25:44.383 INFO:teuthology.orchestra.run.smithi001.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-19T09:25:44.393 INFO:teuthology.orchestra.run.smithi022.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 2.7 MB/s | 228 kB 00:00 2024-09-19T09:25:44.416 INFO:teuthology.orchestra.run.smithi001.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 5.3 MB/s | 910 kB 00:00 2024-09-19T09:25:44.467 INFO:teuthology.orchestra.run.smithi001.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-09-19T09:25:44.477 INFO:teuthology.orchestra.run.smithi022.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 325 kB/s | 27 kB 00:00 2024-09-19T09:25:44.492 INFO:teuthology.orchestra.run.smithi001.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-09-19T09:25:44.526 INFO:teuthology.orchestra.run.smithi121.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 12 MB/s | 3.6 MB 00:00 2024-09-19T09:25:44.536 INFO:teuthology.orchestra.run.smithi022.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 544 kB/s | 32 kB 00:00 2024-09-19T09:25:44.576 INFO:teuthology.orchestra.run.smithi001.stdout:(74/156): postgresql-server-13.16-1.el9.x86_64. 27 MB/s | 5.8 MB 00:00 2024-09-19T09:25:44.592 INFO:teuthology.orchestra.run.smithi121.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 3.7 MB/s | 249 kB 00:00 2024-09-19T09:25:44.593 INFO:teuthology.orchestra.run.smithi001.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 611 kB/s | 61 kB 00:00 2024-09-19T09:25:44.635 INFO:teuthology.orchestra.run.smithi001.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-19T09:25:44.660 INFO:teuthology.orchestra.run.smithi001.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 3.6 MB/s | 248 kB 00:00 2024-09-19T09:25:44.684 INFO:teuthology.orchestra.run.smithi121.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 539 kB/s | 49 kB 00:00 2024-09-19T09:25:44.686 INFO:teuthology.orchestra.run.smithi022.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 4.9 MB/s | 751 kB 00:00 2024-09-19T09:25:44.735 INFO:teuthology.orchestra.run.smithi001.stdout:(78/156): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 6.0 MB 00:00 2024-09-19T09:25:44.743 INFO:teuthology.orchestra.run.smithi121.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 281 kB/s | 16 kB 00:00 2024-09-19T09:25:44.752 INFO:teuthology.orchestra.run.smithi001.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 219 kB/s | 26 kB 00:00 2024-09-19T09:25:44.769 INFO:teuthology.orchestra.run.smithi001.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 176 kB/s | 19 kB 00:00 2024-09-19T09:25:44.769 INFO:teuthology.orchestra.run.smithi022.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 1.9 MB/s | 163 kB 00:00 2024-09-19T09:25:44.827 INFO:teuthology.orchestra.run.smithi001.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-09-19T09:25:44.844 INFO:teuthology.orchestra.run.smithi001.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 462 kB/s | 35 kB 00:00 2024-09-19T09:25:44.845 INFO:teuthology.orchestra.run.smithi022.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 1.6 MB/s | 127 kB 00:00 2024-09-19T09:25:44.928 INFO:teuthology.orchestra.run.smithi001.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 5.1 MB 00:00 2024-09-19T09:25:44.928 INFO:teuthology.orchestra.run.smithi022.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 5.9 MB/s | 506 kB 00:00 2024-09-19T09:25:44.952 INFO:teuthology.orchestra.run.smithi121.stdout:(35/156): ceph-mgr-diskprediction-local-19.1.1- 11 MB/s | 7.4 MB 00:00 2024-09-19T09:25:44.962 INFO:teuthology.orchestra.run.smithi001.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 222 kB 00:00 2024-09-19T09:25:44.977 INFO:teuthology.orchestra.run.smithi121.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 1.2 MB/s | 285 kB 00:00 2024-09-19T09:25:44.987 INFO:teuthology.orchestra.run.smithi001.stdout:(85/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 250 kB 00:00 2024-09-19T09:25:45.012 INFO:teuthology.orchestra.run.smithi001.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 922 kB/s | 77 kB 00:00 2024-09-19T09:25:45.029 INFO:teuthology.orchestra.run.smithi001.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 633 kB/s | 42 kB 00:00 2024-09-19T09:25:45.054 INFO:teuthology.orchestra.run.smithi001.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-09-19T09:25:45.080 INFO:teuthology.orchestra.run.smithi001.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-09-19T09:25:45.085 INFO:teuthology.orchestra.run.smithi121.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 5.6 MB/s | 765 kB 00:00 2024-09-19T09:25:45.105 INFO:teuthology.orchestra.run.smithi001.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-09-19T09:25:45.111 INFO:teuthology.orchestra.run.smithi121.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 136 kB/s | 18 kB 00:00 2024-09-19T09:25:45.138 INFO:teuthology.orchestra.run.smithi001.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 609 kB/s | 51 kB 00:00 2024-09-19T09:25:45.164 INFO:teuthology.orchestra.run.smithi001.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 641 kB/s | 54 kB 00:00 2024-09-19T09:25:45.197 INFO:teuthology.orchestra.run.smithi001.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 712 kB/s | 42 kB 00:00 2024-09-19T09:25:45.239 INFO:teuthology.orchestra.run.smithi001.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 587 kB/s | 44 kB 00:00 2024-09-19T09:25:45.264 INFO:teuthology.orchestra.run.smithi001.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-19T09:25:45.298 INFO:teuthology.orchestra.run.smithi001.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 613 kB/s | 36 kB 00:00 2024-09-19T09:25:45.340 INFO:teuthology.orchestra.run.smithi001.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 627 kB/s | 47 kB 00:00 2024-09-19T09:25:45.366 INFO:teuthology.orchestra.run.smithi001.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 4.4 MB/s | 304 kB 00:00 2024-09-19T09:25:45.420 INFO:teuthology.orchestra.run.smithi022.stdout:(18/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 11 MB/s | 5.3 MB 00:00 2024-09-19T09:25:45.470 INFO:teuthology.orchestra.run.smithi022.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 905 kB/s | 45 kB 00:00 2024-09-19T09:25:45.541 INFO:teuthology.orchestra.run.smithi001.stdout:(99/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-09-19T09:25:45.546 INFO:teuthology.orchestra.run.smithi022.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.8 MB/s | 136 kB 00:00 2024-09-19T09:25:45.566 INFO:teuthology.orchestra.run.smithi001.stdout:(100/156): uuid-1.6.2-55.el9.x86_64.rpm 256 kB/s | 58 kB 00:00 2024-09-19T09:25:45.583 INFO:teuthology.orchestra.run.smithi001.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 441 kB/s | 96 kB 00:00 2024-09-19T09:25:45.608 INFO:teuthology.orchestra.run.smithi001.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 952 kB/s | 64 kB 00:00 2024-09-19T09:25:45.630 INFO:teuthology.orchestra.run.smithi022.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.9 MB/s | 161 kB 00:00 2024-09-19T09:25:45.633 INFO:teuthology.orchestra.run.smithi001.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 668 kB/s | 45 kB 00:00 2024-09-19T09:25:45.684 INFO:teuthology.orchestra.run.smithi001.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-19T09:25:45.705 INFO:teuthology.orchestra.run.smithi022.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 4.2 MB/s | 320 kB 00:00 2024-09-19T09:25:45.717 INFO:teuthology.orchestra.run.smithi001.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-19T09:25:45.742 INFO:teuthology.orchestra.run.smithi001.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 782 kB/s | 19 kB 00:00 2024-09-19T09:25:45.744 INFO:teuthology.orchestra.run.smithi121.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 121 kB/s | 80 kB 00:00 2024-09-19T09:25:45.860 INFO:teuthology.orchestra.run.smithi001.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-19T09:25:45.937 INFO:teuthology.orchestra.run.smithi001.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T09:25:45.938 INFO:teuthology.orchestra.run.smithi001.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T09:25:45.938 INFO:teuthology.orchestra.run.smithi001.stdout:(110/156): lua-devel-5.4.4-4.el9.x86_64.rpm 63 kB/s | 22 kB 00:00 2024-09-19T09:25:45.969 INFO:teuthology.orchestra.run.smithi001.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-19T09:25:46.011 INFO:teuthology.orchestra.run.smithi001.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 21 MB/s | 839 kB 00:00 2024-09-19T09:25:46.036 INFO:teuthology.orchestra.run.smithi001.stdout:(113/156): luarocks-3.9.2-5.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2024-09-19T09:25:46.061 INFO:teuthology.orchestra.run.smithi001.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T09:25:46.081 INFO:teuthology.orchestra.run.smithi001.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-19T09:25:46.104 INFO:teuthology.orchestra.run.smithi001.stdout:(116/156): python3-asyncssh-2.13.2-5.el9.noarch 5.8 MB/s | 548 kB 00:00 2024-09-19T09:25:46.121 INFO:teuthology.orchestra.run.smithi001.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 340 kB/s | 14 kB 00:00 2024-09-19T09:25:46.131 INFO:teuthology.orchestra.run.smithi022.stdout:(23/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 26 MB/s | 49 MB 00:01 2024-09-19T09:25:46.146 INFO:teuthology.orchestra.run.smithi001.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-19T09:25:46.156 INFO:teuthology.orchestra.run.smithi022.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 667 kB/s | 300 kB 00:00 2024-09-19T09:25:46.184 INFO:teuthology.orchestra.run.smithi001.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 9.0 MB/s | 303 kB 00:00 2024-09-19T09:25:46.184 INFO:teuthology.orchestra.run.smithi022.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T09:25:46.204 INFO:teuthology.orchestra.run.smithi001.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-19T09:25:48.028 INFO:teuthology.orchestra.run.smithi121.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 239 kB/s | 191 kB 00:00 2024-09-19T09:25:48.028 INFO:teuthology.orchestra.run.smithi121.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 546 kB/s | 801 kB 00:01 2024-09-19T09:25:48.028 INFO:teuthology.orchestra.run.smithi121.stdout:(42/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 11 MB/s | 49 MB 00:04 2024-09-19T09:25:48.028 INFO:teuthology.orchestra.run.smithi121.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 195 kB/s | 253 kB 00:01 2024-09-19T09:25:48.029 INFO:teuthology.orchestra.run.smithi121.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 147 kB/s | 106 kB 00:00 2024-09-19T09:25:48.032 INFO:teuthology.orchestra.run.smithi022.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T09:25:48.032 INFO:teuthology.orchestra.run.smithi022.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.2 MB/s | 171 kB 00:00 2024-09-19T09:25:48.032 INFO:teuthology.orchestra.run.smithi022.stdout:(28/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 20 MB/s | 3.1 MB 00:00 2024-09-19T09:25:48.032 INFO:teuthology.orchestra.run.smithi022.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 422 kB/s | 32 kB 00:00 2024-09-19T09:25:48.032 INFO:teuthology.orchestra.run.smithi022.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.9 MB/s | 146 kB 00:00 2024-09-19T09:25:48.032 INFO:teuthology.orchestra.run.smithi022.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 11 MB/s | 3.6 MB 00:00 2024-09-19T09:25:48.032 INFO:teuthology.orchestra.run.smithi022.stdout:(32/156): ceph-mgr-diskprediction-local-19.1.1- 20 MB/s | 7.4 MB 00:00 2024-09-19T09:25:48.032 INFO:teuthology.orchestra.run.smithi022.stdout:(33/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.2 MB/s | 249 kB 00:00 2024-09-19T09:25:48.032 INFO:teuthology.orchestra.run.smithi022.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 958 kB/s | 49 kB 00:00 2024-09-19T09:25:48.032 INFO:teuthology.orchestra.run.smithi022.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 329 kB/s | 16 kB 00:00 2024-09-19T09:25:48.032 INFO:teuthology.orchestra.run.smithi022.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.6 MB/s | 285 kB 00:00 2024-09-19T09:25:48.033 INFO:teuthology.orchestra.run.smithi022.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 11 MB/s | 765 kB 00:00 2024-09-19T09:25:48.033 INFO:teuthology.orchestra.run.smithi022.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 272 kB/s | 18 kB 00:00 2024-09-19T09:25:48.033 INFO:teuthology.orchestra.run.smithi022.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 478 kB/s | 80 kB 00:00 2024-09-19T09:25:48.033 INFO:teuthology.orchestra.run.smithi022.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-19T09:25:48.033 INFO:teuthology.orchestra.run.smithi022.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 801 kB 00:00 2024-09-19T09:25:48.033 INFO:teuthology.orchestra.run.smithi022.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-19T09:25:48.033 INFO:teuthology.orchestra.run.smithi022.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-19T09:25:48.033 INFO:teuthology.orchestra.run.smithi022.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-19T09:25:48.033 INFO:teuthology.orchestra.run.smithi022.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 6.1 MB/s | 1.2 MB 00:00 2024-09-19T09:25:48.033 INFO:teuthology.orchestra.run.smithi022.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-09-19T09:25:48.033 INFO:teuthology.orchestra.run.smithi022.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.5 MB/s | 215 kB 00:00 2024-09-19T09:25:48.035 INFO:teuthology.orchestra.run.smithi001.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T09:25:48.035 INFO:teuthology.orchestra.run.smithi001.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-19T09:25:48.035 INFO:teuthology.orchestra.run.smithi001.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 644 kB/s | 11 kB 00:00 2024-09-19T09:25:48.035 INFO:teuthology.orchestra.run.smithi001.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-19T09:25:48.035 INFO:teuthology.orchestra.run.smithi001.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-19T09:25:48.035 INFO:teuthology.orchestra.run.smithi001.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 779 kB/s | 19 kB 00:00 2024-09-19T09:25:48.035 INFO:teuthology.orchestra.run.smithi001.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 792 kB/s | 20 kB 00:00 2024-09-19T09:25:48.035 INFO:teuthology.orchestra.run.smithi001.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 9.3 MB/s | 2.0 MB 00:00 2024-09-19T09:25:48.036 INFO:teuthology.orchestra.run.smithi001.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T09:25:48.036 INFO:teuthology.orchestra.run.smithi001.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 4.6 MB/s | 79 kB 00:00 2024-09-19T09:25:48.036 INFO:teuthology.orchestra.run.smithi001.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T09:25:48.036 INFO:teuthology.orchestra.run.smithi001.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-19T09:25:48.036 INFO:teuthology.orchestra.run.smithi001.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 663 kB/s | 16 kB 00:00 2024-09-19T09:25:48.036 INFO:teuthology.orchestra.run.smithi001.stdout:(134/156): protobuf-compiler-3.14.0-13.el9.x86_ 893 kB/s | 863 kB 00:00 2024-09-19T09:25:48.036 INFO:teuthology.orchestra.run.smithi001.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-19T09:25:48.036 INFO:teuthology.orchestra.run.smithi001.stdout:(136/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-09-19T09:25:48.036 INFO:teuthology.orchestra.run.smithi001.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 337 kB/s | 28 kB 00:00 2024-09-19T09:25:48.036 INFO:teuthology.orchestra.run.smithi001.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 421 kB/s | 31 kB 00:00 2024-09-19T09:25:48.036 INFO:teuthology.orchestra.run.smithi001.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-19T09:25:48.036 INFO:teuthology.orchestra.run.smithi001.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-19T09:25:48.036 INFO:teuthology.orchestra.run.smithi001.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-19T09:25:48.037 INFO:teuthology.orchestra.run.smithi001.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-19T09:25:48.037 INFO:teuthology.orchestra.run.smithi001.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-19T09:25:48.037 INFO:teuthology.orchestra.run.smithi001.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-19T09:25:48.037 INFO:teuthology.orchestra.run.smithi001.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-19T09:25:48.037 INFO:teuthology.orchestra.run.smithi001.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T09:25:48.037 INFO:teuthology.orchestra.run.smithi001.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-19T09:25:48.037 INFO:teuthology.orchestra.run.smithi001.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T09:25:48.037 INFO:teuthology.orchestra.run.smithi001.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 13 MB/s | 3.4 MB 00:00 2024-09-19T09:25:48.037 INFO:teuthology.orchestra.run.smithi001.stdout:(150/156): librbd1-19.1.1-361.g2f599a46.el9.x86 8.8 MB/s | 3.2 MB 00:00 2024-09-19T09:25:48.037 INFO:teuthology.orchestra.run.smithi001.stdout:(151/156): NetworkManager-1.51.0-1.el9.x86_64.r 6.8 MB/s | 2.3 MB 00:00 2024-09-19T09:25:48.037 INFO:teuthology.orchestra.run.smithi001.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 4.9 MB/s | 249 kB 00:00 2024-09-19T09:25:48.037 INFO:teuthology.orchestra.run.smithi001.stdout:(153/156): NetworkManager-libnm-1.51.0-1.el9.x8 7.0 MB/s | 1.8 MB 00:00 2024-09-19T09:25:48.037 INFO:teuthology.orchestra.run.smithi001.stdout:(154/156): NetworkManager-team-1.51.0-1.el9.x86 287 kB/s | 41 kB 00:00 2024-09-19T09:25:48.038 INFO:teuthology.orchestra.run.smithi001.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-09-19T09:25:48.038 INFO:teuthology.orchestra.run.smithi001.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-09-19T09:25:48.038 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:25:48.038 INFO:teuthology.orchestra.run.smithi001.stdout:Total 23 MB/s | 226 MB 00:09 2024-09-19T09:25:48.139 INFO:teuthology.orchestra.run.smithi022.stdout:(48/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 3.4 MB/s | 17 MB 00:04 2024-09-19T09:25:48.348 INFO:teuthology.orchestra.run.smithi022.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 787 kB/s | 689 kB 00:00 2024-09-19T09:25:48.457 INFO:teuthology.orchestra.run.smithi022.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 200 kB/s | 22 kB 00:00 2024-09-19T09:25:48.532 INFO:teuthology.orchestra.run.smithi022.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-09-19T09:25:48.574 INFO:teuthology.orchestra.run.smithi022.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-19T09:25:48.599 INFO:teuthology.orchestra.run.smithi022.stdout:(53/156): boost-program-options-1.75.0-8.el9.x8 233 kB/s | 107 kB 00:00 2024-09-19T09:25:48.604 INFO:teuthology.orchestra.run.smithi121.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 170 kB/s | 125 kB 00:00 2024-09-19T09:25:48.629 INFO:teuthology.orchestra.run.smithi121.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 173 kB/s | 135 kB 00:00 2024-09-19T09:25:48.633 INFO:teuthology.orchestra.run.smithi022.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 325 kB/s | 33 kB 00:00 2024-09-19T09:25:48.708 INFO:teuthology.orchestra.run.smithi022.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 168 kB/s | 18 kB 00:00 2024-09-19T09:25:48.733 INFO:teuthology.orchestra.run.smithi022.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 111 kB/s | 11 kB 00:00 2024-09-19T09:25:48.805 INFO:teuthology.orchestra.run.smithi121.stdout:(47/156): automake-1.16.2-8.el9.noarch.rpm 3.9 MB/s | 689 kB 00:00 2024-09-19T09:25:48.842 INFO:teuthology.orchestra.run.smithi022.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 418 kB/s | 45 kB 00:00 2024-09-19T09:25:48.856 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2024-09-19T09:25:48.880 INFO:teuthology.orchestra.run.smithi121.stdout:(48/156): bison-3.7.4-5.el9.x86_64.rpm 12 MB/s | 943 kB 00:00 2024-09-19T09:25:48.909 INFO:teuthology.orchestra.run.smithi022.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 798 kB/s | 160 kB 00:00 2024-09-19T09:25:48.913 INFO:teuthology.orchestra.run.smithi121.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 107 kB 00:00 2024-09-19T09:25:48.955 INFO:teuthology.orchestra.run.smithi121.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 521 kB/s | 22 kB 00:00 2024-09-19T09:25:48.976 INFO:teuthology.orchestra.run.smithi022.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-09-19T09:25:49.006 INFO:teuthology.orchestra.run.smithi121.stdout:(51/156): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-19T09:25:49.027 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2024-09-19T09:25:49.028 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2024-09-19T09:25:49.048 INFO:teuthology.orchestra.run.smithi121.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 788 kB/s | 33 kB 00:00 2024-09-19T09:25:49.076 INFO:teuthology.orchestra.run.smithi022.stdout:(60/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.0 MB/s | 3.0 MB 00:00 2024-09-19T09:25:49.081 INFO:teuthology.orchestra.run.smithi121.stdout:(53/156): python3-cryptography-36.0.1-4.el9.x86 502 kB/s | 1.2 MB 00:02 2024-09-19T09:25:49.093 INFO:teuthology.orchestra.run.smithi022.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 209 kB/s | 24 kB 00:00 2024-09-19T09:25:49.118 INFO:teuthology.orchestra.run.smithi022.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 2.7 MB/s | 581 kB 00:00 2024-09-19T09:25:49.148 INFO:teuthology.orchestra.run.smithi121.stdout:(54/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 30 MB/s | 3.0 MB 00:00 2024-09-19T09:25:49.174 INFO:teuthology.orchestra.run.smithi121.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 198 kB/s | 18 kB 00:00 2024-09-19T09:25:49.177 INFO:teuthology.orchestra.run.smithi022.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 473 kB/s | 47 kB 00:00 2024-09-19T09:25:49.199 INFO:teuthology.orchestra.run.smithi121.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-19T09:25:49.211 INFO:teuthology.orchestra.run.smithi022.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-19T09:25:49.224 INFO:teuthology.orchestra.run.smithi121.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-19T09:25:49.236 INFO:teuthology.orchestra.run.smithi022.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-19T09:25:49.257 INFO:teuthology.orchestra.run.smithi121.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 773 kB/s | 45 kB 00:00 2024-09-19T09:25:49.286 INFO:teuthology.orchestra.run.smithi022.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 353 kB/s | 38 kB 00:00 2024-09-19T09:25:49.292 INFO:teuthology.orchestra.run.smithi121.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-19T09:25:49.333 INFO:teuthology.orchestra.run.smithi121.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 590 kB/s | 24 kB 00:00 2024-09-19T09:25:49.375 INFO:teuthology.orchestra.run.smithi121.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-19T09:25:49.403 INFO:teuthology.orchestra.run.smithi121.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 3.9 MB/s | 581 kB 00:00 2024-09-19T09:25:49.429 INFO:teuthology.orchestra.run.smithi121.stdout:(63/156): python3-urllib3-1.26.5-6.el9.noarch.r 261 kB/s | 215 kB 00:00 2024-09-19T09:25:49.454 INFO:teuthology.orchestra.run.smithi121.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-19T09:25:49.479 INFO:teuthology.orchestra.run.smithi121.stdout:(65/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-19T09:25:49.520 INFO:teuthology.orchestra.run.smithi022.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2024-09-19T09:25:49.521 INFO:teuthology.orchestra.run.smithi121.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 418 kB/s | 38 kB 00:00 2024-09-19T09:25:49.605 INFO:teuthology.orchestra.run.smithi121.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-09-19T09:25:49.653 INFO:teuthology.orchestra.run.smithi022.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 6.7 MB/s | 910 kB 00:00 2024-09-19T09:25:49.671 INFO:teuthology.orchestra.run.smithi121.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 23 MB/s | 4.9 MB 00:00 2024-09-19T09:25:49.713 INFO:teuthology.orchestra.run.smithi121.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 8.2 MB/s | 910 kB 00:00 2024-09-19T09:25:49.747 INFO:teuthology.orchestra.run.smithi121.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-09-19T09:25:49.762 INFO:teuthology.orchestra.run.smithi022.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 1.2 MB/s | 137 kB 00:00 2024-09-19T09:25:49.789 INFO:teuthology.orchestra.run.smithi121.stdout:(71/156): postgresql-13.16-1.el9.x86_64.rpm 5.9 MB/s | 1.6 MB 00:00 2024-09-19T09:25:49.831 INFO:teuthology.orchestra.run.smithi121.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-09-19T09:25:49.856 INFO:teuthology.orchestra.run.smithi121.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-19T09:25:49.948 INFO:teuthology.orchestra.run.smithi121.stdout:(74/156): postgresql-server-13.16-1.el9.x86_64. 25 MB/s | 5.8 MB 00:00 2024-09-19T09:25:49.965 INFO:teuthology.orchestra.run.smithi121.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 564 kB/s | 61 kB 00:00 2024-09-19T09:25:49.990 INFO:teuthology.orchestra.run.smithi121.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 5.8 MB/s | 245 kB 00:00 2024-09-19T09:25:50.015 INFO:teuthology.orchestra.run.smithi121.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-19T09:25:50.032 INFO:teuthology.orchestra.run.smithi121.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 612 kB/s | 26 kB 00:00 2024-09-19T09:25:50.049 INFO:teuthology.orchestra.run.smithi121.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 570 kB/s | 19 kB 00:00 2024-09-19T09:25:50.075 INFO:teuthology.orchestra.run.smithi121.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-09-19T09:25:50.100 INFO:teuthology.orchestra.run.smithi121.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 691 kB/s | 35 kB 00:00 2024-09-19T09:25:50.184 INFO:teuthology.orchestra.run.smithi121.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-19T09:25:50.209 INFO:teuthology.orchestra.run.smithi121.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-19T09:25:50.234 INFO:teuthology.orchestra.run.smithi121.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-19T09:25:50.259 INFO:teuthology.orchestra.run.smithi121.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-19T09:25:50.285 INFO:teuthology.orchestra.run.smithi121.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-09-19T09:25:50.310 INFO:teuthology.orchestra.run.smithi121.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-19T09:25:50.335 INFO:teuthology.orchestra.run.smithi121.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-19T09:25:50.360 INFO:teuthology.orchestra.run.smithi121.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-19T09:25:50.386 INFO:teuthology.orchestra.run.smithi121.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-19T09:25:50.411 INFO:teuthology.orchestra.run.smithi121.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-19T09:25:50.487 INFO:teuthology.orchestra.run.smithi121.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-19T09:25:50.512 INFO:teuthology.orchestra.run.smithi121.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 414 kB/s | 42 kB 00:00 2024-09-19T09:25:50.537 INFO:teuthology.orchestra.run.smithi121.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 885 kB/s | 44 kB 00:00 2024-09-19T09:25:50.562 INFO:teuthology.orchestra.run.smithi121.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-19T09:25:50.588 INFO:teuthology.orchestra.run.smithi121.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 715 kB/s | 36 kB 00:00 2024-09-19T09:25:50.613 INFO:teuthology.orchestra.run.smithi121.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-19T09:25:50.638 INFO:teuthology.orchestra.run.smithi121.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-19T09:25:50.664 INFO:teuthology.orchestra.run.smithi121.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-19T09:25:50.689 INFO:teuthology.orchestra.run.smithi121.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-19T09:25:50.714 INFO:teuthology.orchestra.run.smithi121.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-19T09:25:50.740 INFO:teuthology.orchestra.run.smithi121.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-09-19T09:25:50.765 INFO:teuthology.orchestra.run.smithi121.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 444 kB/s | 22 kB 00:00 2024-09-19T09:25:50.807 INFO:teuthology.orchestra.run.smithi121.stdout:(104/156): protobuf-compiler-3.14.0-13.el9.x86_ 13 MB/s | 863 kB 00:00 2024-09-19T09:25:50.849 INFO:teuthology.orchestra.run.smithi121.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 6.4 MB/s | 548 kB 00:00 2024-09-19T09:25:50.874 INFO:teuthology.orchestra.run.smithi121.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 845 kB/s | 19 kB 00:00 2024-09-19T09:25:50.907 INFO:teuthology.orchestra.run.smithi121.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 3.1 MB/s | 308 kB 00:00 2024-09-19T09:25:50.933 INFO:teuthology.orchestra.run.smithi121.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T09:25:50.958 INFO:teuthology.orchestra.run.smithi121.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T09:25:50.983 INFO:teuthology.orchestra.run.smithi121.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-19T09:25:51.009 INFO:teuthology.orchestra.run.smithi121.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-19T09:25:51.059 INFO:teuthology.orchestra.run.smithi121.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-19T09:25:51.101 INFO:teuthology.orchestra.run.smithi121.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-19T09:25:51.126 INFO:teuthology.orchestra.run.smithi121.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T09:25:51.151 INFO:teuthology.orchestra.run.smithi121.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.2 MB/s | 32 kB 00:00 2024-09-19T09:25:51.177 INFO:teuthology.orchestra.run.smithi121.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 565 kB/s | 14 kB 00:00 2024-09-19T09:25:51.344 INFO:teuthology.orchestra.run.smithi121.stdout:(117/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-09-19T09:25:51.369 INFO:teuthology.orchestra.run.smithi121.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 895 kB/s | 172 kB 00:00 2024-09-19T09:25:51.376 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2024-09-19T09:25:51.376 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2024-09-19T09:25:51.444 INFO:teuthology.orchestra.run.smithi121.stdout:(119/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.7 MB/s | 4.4 MB 00:00 2024-09-19T09:25:51.478 INFO:teuthology.orchestra.run.smithi121.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.9 MB/s | 303 kB 00:00 2024-09-19T09:25:51.512 INFO:teuthology.orchestra.run.smithi121.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.3 MB/s | 220 kB 00:00 2024-09-19T09:25:51.545 INFO:teuthology.orchestra.run.smithi121.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-19T09:25:51.570 INFO:teuthology.orchestra.run.smithi121.stdout:(123/156): python3-cherrypy-18.6.1-2.el9.noarch 1.5 MB/s | 358 kB 00:00 2024-09-19T09:25:51.596 INFO:teuthology.orchestra.run.smithi121.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-19T09:25:51.621 INFO:teuthology.orchestra.run.smithi121.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-19T09:25:51.646 INFO:teuthology.orchestra.run.smithi121.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-09-19T09:25:51.672 INFO:teuthology.orchestra.run.smithi121.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-19T09:25:51.697 INFO:teuthology.orchestra.run.smithi121.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-19T09:25:51.722 INFO:teuthology.orchestra.run.smithi121.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T09:25:51.748 INFO:teuthology.orchestra.run.smithi121.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T09:25:51.802 INFO:teuthology.orchestra.run.smithi121.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 1.0 MB/s | 58 kB 00:00 2024-09-19T09:25:51.840 INFO:teuthology.orchestra.run.smithi121.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 7.2 MB/s | 272 kB 00:00 2024-09-19T09:25:51.865 INFO:teuthology.orchestra.run.smithi121.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-19T09:25:51.899 INFO:teuthology.orchestra.run.smithi121.stdout:(134/156): python3-kubernetes-26.1.0-2.el9.noar 4.5 MB/s | 1.0 MB 00:00 2024-09-19T09:25:51.925 INFO:teuthology.orchestra.run.smithi121.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-19T09:25:51.949 INFO:teuthology.orchestra.run.smithi121.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-19T09:25:51.991 INFO:teuthology.orchestra.run.smithi121.stdout:(137/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.0 MB/s | 2.0 MB 00:00 2024-09-19T09:25:52.012 INFO:teuthology.orchestra.run.smithi022.stdout:(70/156): openblas-openmp-0.3.26-2.el9.x86_64.r 1.8 MB/s | 4.9 MB 00:02 2024-09-19T09:25:52.016 INFO:teuthology.orchestra.run.smithi121.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 334 kB/s | 31 kB 00:00 2024-09-19T09:25:52.042 INFO:teuthology.orchestra.run.smithi121.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-19T09:25:52.067 INFO:teuthology.orchestra.run.smithi121.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-19T09:25:52.092 INFO:teuthology.orchestra.run.smithi121.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-19T09:25:52.109 INFO:teuthology.orchestra.run.smithi121.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-19T09:25:52.135 INFO:teuthology.orchestra.run.smithi121.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-09-19T09:25:52.137 INFO:teuthology.orchestra.run.smithi022.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 1.5 MB/s | 4.4 MB 00:02 2024-09-19T09:25:52.160 INFO:teuthology.orchestra.run.smithi121.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-19T09:25:52.185 INFO:teuthology.orchestra.run.smithi121.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 401 kB/s | 20 kB 00:00 2024-09-19T09:25:52.210 INFO:teuthology.orchestra.run.smithi121.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T09:25:52.236 INFO:teuthology.orchestra.run.smithi121.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-19T09:25:52.294 INFO:teuthology.orchestra.run.smithi121.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T09:25:52.337 INFO:teuthology.orchestra.run.smithi022.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 438 kB/s | 87 kB 00:00 2024-09-19T09:25:52.495 INFO:teuthology.orchestra.run.smithi121.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-19T09:25:52.545 INFO:teuthology.orchestra.run.smithi121.stdout:(150/156): librbd1-19.1.1-361.g2f599a46.el9.x86 10 MB/s | 3.2 MB 00:00 2024-09-19T09:25:53.195 INFO:teuthology.orchestra.run.smithi121.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 64 kB/s | 41 kB 00:00 2024-09-19T09:25:53.571 INFO:teuthology.orchestra.run.smithi022.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 663 kB/s | 1.0 MB 00:01 2024-09-19T09:25:53.637 INFO:teuthology.orchestra.run.smithi121.stdout:(152/156): NetworkManager-1.51.0-1.el9.x86_64.r 1.7 MB/s | 2.3 MB 00:01 2024-09-19T09:25:53.688 INFO:teuthology.orchestra.run.smithi022.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 525 kB/s | 61 kB 00:00 2024-09-19T09:25:54.062 INFO:teuthology.orchestra.run.smithi121.stdout:(153/156): NetworkManager-tui-1.51.0-1.el9.x86_ 287 kB/s | 249 kB 00:00 2024-09-19T09:25:54.063 INFO:teuthology.orchestra.run.smithi022.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 652 kB/s | 245 kB 00:00 2024-09-19T09:25:54.313 INFO:teuthology.orchestra.run.smithi022.stdout:(76/156): postgresql-server-13.16-1.el9.x86_64. 1.3 MB/s | 5.8 MB 00:04 2024-09-19T09:25:54.422 INFO:teuthology.orchestra.run.smithi022.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 236 kB/s | 26 kB 00:00 2024-09-19T09:25:54.472 INFO:teuthology.orchestra.run.smithi022.stdout:(78/156): python3-jinja2-2.11.3-6.el9.noarch.rp 607 kB/s | 248 kB 00:00 2024-09-19T09:25:54.531 INFO:teuthology.orchestra.run.smithi022.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 176 kB/s | 19 kB 00:00 2024-09-19T09:25:54.640 INFO:teuthology.orchestra.run.smithi022.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 320 kB/s | 35 kB 00:00 2024-09-19T09:25:54.757 INFO:teuthology.orchestra.run.smithi022.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 606 kB/s | 172 kB 00:00 2024-09-19T09:25:55.132 INFO:teuthology.orchestra.run.smithi022.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 668 kB/s | 250 kB 00:00 2024-09-19T09:25:55.279 INFO:teuthology.orchestra.run.smithi121.stdout:(154/156): NetworkManager-libnm-1.51.0-1.el9.x8 665 kB/s | 1.8 MB 00:02 2024-09-19T09:25:55.524 INFO:teuthology.orchestra.run.smithi022.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 567 kB/s | 222 kB 00:00 2024-09-19T09:25:55.732 INFO:teuthology.orchestra.run.smithi022.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 370 kB/s | 77 kB 00:00 2024-09-19T09:25:55.812 INFO:teuthology.orchestra.run.smithi121.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 637 kB/s | 1.4 MB 00:02 2024-09-19T09:25:55.849 INFO:teuthology.orchestra.run.smithi022.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 362 kB/s | 42 kB 00:00 2024-09-19T09:25:56.316 INFO:teuthology.orchestra.run.smithi022.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 577 kB/s | 269 kB 00:00 2024-09-19T09:25:56.471 INFO:teuthology.orchestra.run.smithi121.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 1.0 MB/s | 2.4 MB 00:02 2024-09-19T09:25:56.478 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:25:56.478 INFO:teuthology.orchestra.run.smithi121.stdout:Total 14 MB/s | 226 MB 00:16 2024-09-19T09:25:56.600 INFO:teuthology.orchestra.run.smithi022.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 560 kB/s | 159 kB 00:00 2024-09-19T09:25:57.058 INFO:teuthology.orchestra.run.smithi022.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 608 kB/s | 279 kB 00:00 2024-09-19T09:25:57.167 INFO:teuthology.orchestra.run.smithi022.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 471 kB/s | 51 kB 00:00 2024-09-19T09:25:57.276 INFO:teuthology.orchestra.run.smithi022.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 495 kB/s | 54 kB 00:00 2024-09-19T09:25:57.650 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-09-19T09:25:57.799 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-09-19T09:25:57.799 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-09-19T09:25:57.957 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2024-09-19T09:25:58.102 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T09:25:58.150 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T09:25:58.212 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T09:25:58.253 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T09:25:58.278 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T09:25:58.343 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T09:25:58.685 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T09:25:58.787 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:25:58.895 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:25:58.921 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:25:58.997 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:25:59.009 INFO:teuthology.orchestra.run.smithi022.stdout:(91/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.2 MB/s | 5.1 MB 00:04 2024-09-19T09:25:59.026 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:25:59.185 INFO:teuthology.orchestra.run.smithi022.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 238 kB/s | 42 kB 00:00 2024-09-19T09:25:59.202 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T09:25:59.266 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T09:25:59.292 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:25:59.293 INFO:teuthology.orchestra.run.smithi022.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 408 kB/s | 44 kB 00:00 2024-09-19T09:25:59.398 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:25:59.418 INFO:teuthology.orchestra.run.smithi022.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-09-19T09:25:59.426 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:25:59.490 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:25:59.519 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:25:59.535 INFO:teuthology.orchestra.run.smithi022.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 307 kB/s | 36 kB 00:00 2024-09-19T09:25:59.546 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:25:59.601 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-09-19T09:25:59.601 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-09-19T09:25:59.644 INFO:teuthology.orchestra.run.smithi022.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 438 kB/s | 47 kB 00:00 2024-09-19T09:25:59.732 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:25:59.761 INFO:teuthology.orchestra.run.smithi022.stdout:(97/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-19T09:25:59.869 INFO:teuthology.orchestra.run.smithi022.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 534 kB/s | 58 kB 00:00 2024-09-19T09:25:59.901 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:25:59.978 INFO:teuthology.orchestra.run.smithi022.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 883 kB/s | 96 kB 00:00 2024-09-19T09:26:00.046 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T09:26:00.086 INFO:teuthology.orchestra.run.smithi022.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 588 kB/s | 64 kB 00:00 2024-09-19T09:26:00.160 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:26:00.195 INFO:teuthology.orchestra.run.smithi022.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 413 kB/s | 45 kB 00:00 2024-09-19T09:26:00.235 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:26:00.474 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:26:00.587 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T09:26:00.689 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T09:26:00.723 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T09:26:00.759 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T09:26:00.811 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] lua-devel-5.4.4-4.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.facebook.net/centos-stream/9-stream/CRB/x86_64/os/Packages/lua-devel-5.4.4-4.el9.x86_64.rpm [Failed to connect to mirror.facebook.net port 80: Network is unreachable] 2024-09-19T09:26:00.824 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] lua-devel-5.4.4-4.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://mirror.facebook.net/centos-stream/9-stream/CRB/x86_64/os/Packages/lua-devel-5.4.4-4.el9.x86_64.rpm [Failed to connect to mirror.facebook.net port 443: Network is unreachable] 2024-09-19T09:26:00.833 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T09:26:00.885 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T09:26:00.904 INFO:teuthology.orchestra.run.smithi022.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 31 kB/s | 22 kB 00:00 2024-09-19T09:26:00.924 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] protobuf-compiler-3.14.0-13.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.facebook.net/centos-stream/9-stream/CRB/x86_64/os/Packages/protobuf-compiler-3.14.0-13.el9.x86_64.rpm [Failed to connect to mirror.facebook.net port 80: Network is unreachable] 2024-09-19T09:26:00.924 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T09:26:00.943 INFO:teuthology.orchestra.run.smithi022.stdout:[MIRROR] protobuf-compiler-3.14.0-13.el9.x86_64.rpm: Curl error (7): Couldn't connect to server for https://mirror.facebook.net/centos-stream/9-stream/CRB/x86_64/os/Packages/protobuf-compiler-3.14.0-13.el9.x86_64.rpm [Failed to connect to mirror.facebook.net port 443: Network is unreachable] 2024-09-19T09:26:00.968 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T09:26:01.001 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T09:26:01.028 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T09:26:01.079 INFO:teuthology.orchestra.run.smithi022.stdout:(103/156): protobuf-compiler-3.14.0-13.el9.x86_ 4.8 MB/s | 863 kB 00:00 2024-09-19T09:26:01.100 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T09:26:01.160 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T09:26:01.163 INFO:teuthology.orchestra.run.smithi022.stdout:(104/156): python3-babel-2.9.1-2.el9.noarch.rpm 692 kB/s | 6.0 MB 00:08 2024-09-19T09:26:01.190 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T09:26:01.213 INFO:teuthology.orchestra.run.smithi022.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 4.0 MB/s | 548 kB 00:00 2024-09-19T09:26:01.225 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T09:26:01.239 INFO:teuthology.orchestra.run.smithi022.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 771 kB/s | 19 kB 00:00 2024-09-19T09:26:01.272 INFO:teuthology.orchestra.run.smithi022.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 2.8 MB/s | 308 kB 00:00 2024-09-19T09:26:01.297 INFO:teuthology.orchestra.run.smithi022.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T09:26:01.303 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T09:26:01.323 INFO:teuthology.orchestra.run.smithi022.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T09:26:01.343 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T09:26:01.348 INFO:teuthology.orchestra.run.smithi022.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-19T09:26:01.382 INFO:teuthology.orchestra.run.smithi022.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-19T09:26:01.387 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T09:26:01.415 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T09:26:01.457 INFO:teuthology.orchestra.run.smithi022.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-19T09:26:01.488 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T09:26:01.515 INFO:teuthology.orchestra.run.smithi022.stdout:(113/156): libarrow-9.0.0-11.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-19T09:26:01.530 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T09:26:01.541 INFO:teuthology.orchestra.run.smithi022.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T09:26:01.566 INFO:teuthology.orchestra.run.smithi022.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T09:26:01.591 INFO:teuthology.orchestra.run.smithi022.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 564 kB/s | 14 kB 00:00 2024-09-19T09:26:01.625 INFO:teuthology.orchestra.run.smithi022.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 3.2 MB/s | 548 kB 00:00 2024-09-19T09:26:01.636 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T09:26:01.659 INFO:teuthology.orchestra.run.smithi022.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-09-19T09:26:01.692 INFO:teuthology.orchestra.run.smithi022.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-19T09:26:01.717 INFO:teuthology.orchestra.run.smithi022.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-19T09:26:01.743 INFO:teuthology.orchestra.run.smithi022.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T09:26:01.777 INFO:teuthology.orchestra.run.smithi022.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-19T09:26:01.777 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T09:26:01.802 INFO:teuthology.orchestra.run.smithi022.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-19T09:26:01.827 INFO:teuthology.orchestra.run.smithi022.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 710 kB/s | 18 kB 00:00 2024-09-19T09:26:01.833 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T09:26:01.861 INFO:teuthology.orchestra.run.smithi022.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 697 kB/s | 23 kB 00:00 2024-09-19T09:26:01.886 INFO:teuthology.orchestra.run.smithi022.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 780 kB/s | 19 kB 00:00 2024-09-19T09:26:02.028 INFO:teuthology.orchestra.run.smithi022.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 139 kB/s | 20 kB 00:00 2024-09-19T09:26:02.078 INFO:teuthology.orchestra.run.smithi022.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.7 MB/s | 2.0 MB 00:00 2024-09-19T09:26:02.103 INFO:teuthology.orchestra.run.smithi022.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T09:26:02.129 INFO:teuthology.orchestra.run.smithi022.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T09:26:02.154 INFO:teuthology.orchestra.run.smithi022.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T09:26:02.196 INFO:teuthology.orchestra.run.smithi022.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-19T09:26:02.221 INFO:teuthology.orchestra.run.smithi022.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-19T09:26:02.247 INFO:teuthology.orchestra.run.smithi022.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-19T09:26:02.272 INFO:teuthology.orchestra.run.smithi022.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-09-19T09:26:02.297 INFO:teuthology.orchestra.run.smithi022.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 565 kB/s | 28 kB 00:00 2024-09-19T09:26:02.323 INFO:teuthology.orchestra.run.smithi022.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-19T09:26:02.348 INFO:teuthology.orchestra.run.smithi022.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T09:26:02.373 INFO:teuthology.orchestra.run.smithi022.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-19T09:26:02.389 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T09:26:02.399 INFO:teuthology.orchestra.run.smithi022.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-19T09:26:02.425 INFO:teuthology.orchestra.run.smithi022.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-19T09:26:02.449 INFO:teuthology.orchestra.run.smithi022.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-19T09:26:02.474 INFO:teuthology.orchestra.run.smithi022.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-19T09:26:02.480 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T09:26:02.500 INFO:teuthology.orchestra.run.smithi022.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 799 kB/s | 20 kB 00:00 2024-09-19T09:26:02.515 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T09:26:02.525 INFO:teuthology.orchestra.run.smithi022.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-19T09:26:02.550 INFO:teuthology.orchestra.run.smithi022.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-19T09:26:02.559 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T09:26:02.596 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T09:26:02.623 INFO:teuthology.orchestra.run.smithi022.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-19T09:26:02.639 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T09:26:02.798 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T09:26:02.866 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T09:26:02.910 INFO:teuthology.orchestra.run.smithi022.stdout:(148/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.9 MB/s | 16 MB 00:05 2024-09-19T09:26:02.922 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T09:26:02.997 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T09:26:03.033 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T09:26:03.060 INFO:teuthology.orchestra.run.smithi022.stdout:(149/156): librbd1-19.1.1-361.g2f599a46.el9.x86 7.2 MB/s | 3.2 MB 00:00 2024-09-19T09:26:03.070 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T09:26:03.117 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T09:26:03.152 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T09:26:03.196 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T09:26:03.237 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T09:26:03.335 INFO:teuthology.orchestra.run.smithi022.stdout:(150/156): NetworkManager-1.51.0-1.el9.x86_64.r 5.5 MB/s | 2.3 MB 00:00 2024-09-19T09:26:03.381 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T09:26:03.385 INFO:teuthology.orchestra.run.smithi022.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 823 kB/s | 41 kB 00:00 2024-09-19T09:26:03.422 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T09:26:03.460 INFO:teuthology.orchestra.run.smithi022.stdout:(152/156): librados2-19.1.1-361.g2f599a46.el9.x 3.8 MB/s | 3.4 MB 00:00 2024-09-19T09:26:03.464 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T09:26:03.489 INFO:teuthology.orchestra.run.smithi022.stdout:(153/156): NetworkManager-tui-1.51.0-1.el9.x86_ 2.4 MB/s | 249 kB 00:00 2024-09-19T09:26:03.570 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T09:26:03.619 INFO:teuthology.orchestra.run.smithi022.stdout:(154/156): NetworkManager-libnm-1.51.0-1.el9.x8 3.2 MB/s | 1.8 MB 00:00 2024-09-19T09:26:03.686 INFO:teuthology.orchestra.run.smithi022.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 12 MB/s | 2.4 MB 00:00 2024-09-19T09:26:03.687 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T09:26:03.911 INFO:teuthology.orchestra.run.smithi022.stdout:(156/156): openssl-3.2.2-6.el9.x86_64.rpm 3.0 MB/s | 1.4 MB 00:00 2024-09-19T09:26:03.916 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:26:03.917 INFO:teuthology.orchestra.run.smithi022.stdout:Total 9.6 MB/s | 226 MB 00:23 2024-09-19T09:26:03.946 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T09:26:03.996 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T09:26:04.021 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T09:26:04.123 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T09:26:04.254 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T09:26:04.294 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T09:26:04.322 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T09:26:04.356 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T09:26:04.396 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T09:26:04.436 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T09:26:04.465 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T09:26:04.491 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T09:26:04.520 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T09:26:04.561 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T09:26:04.595 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T09:26:04.686 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T09:26:04.743 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T09:26:04.774 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T09:26:04.883 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T09:26:04.943 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T09:26:05.170 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-09-19T09:26:05.336 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-09-19T09:26:05.336 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-09-19T09:26:05.713 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T09:26:05.755 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T09:26:05.789 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T09:26:05.817 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-09-19T09:26:05.894 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T09:26:05.932 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T09:26:05.945 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T09:26:05.990 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T09:26:06.038 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T09:26:06.088 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T09:26:06.125 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T09:26:06.243 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T09:26:06.284 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T09:26:06.309 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T09:26:06.321 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T09:26:06.347 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T09:26:06.361 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T09:26:06.427 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T09:26:06.699 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T09:26:06.819 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:26:06.941 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:26:06.986 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:26:07.077 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:26:07.107 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:26:07.111 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T09:26:07.232 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-09-19T09:26:07.232 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-09-19T09:26:07.242 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T09:26:07.256 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T09:26:07.312 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T09:26:07.340 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:26:07.427 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:26:07.449 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:26:07.511 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:26:07.534 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:26:07.555 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:26:07.719 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:26:07.846 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:26:07.940 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T09:26:08.043 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:26:08.135 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:26:08.369 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:26:08.485 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T09:26:08.567 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T09:26:08.578 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T09:26:08.614 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T09:26:08.643 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T09:26:08.649 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T09:26:08.671 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T09:26:08.704 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T09:26:08.723 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T09:26:08.775 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T09:26:08.815 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T09:26:08.859 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T09:26:08.891 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T09:26:08.919 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T09:26:08.988 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T09:26:09.022 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T09:26:09.041 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T09:26:09.058 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:26:09.072 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T09:26:09.099 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T09:26:09.150 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:26:09.177 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T09:26:09.189 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T09:26:09.210 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T09:26:09.232 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T09:26:09.253 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T09:26:09.282 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T09:26:09.351 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T09:26:09.399 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T09:26:09.475 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T09:26:09.605 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T09:26:09.661 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T09:26:09.834 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T09:26:09.862 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:26:09.917 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:26:09.947 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T09:26:10.182 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T09:26:10.265 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T09:26:10.294 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T09:26:10.336 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T09:26:10.375 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T09:26:10.453 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T09:26:10.617 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T09:26:10.670 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T09:26:10.724 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T09:26:10.797 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T09:26:10.829 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T09:26:10.865 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T09:26:10.911 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T09:26:10.947 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T09:26:10.991 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T09:26:11.032 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T09:26:11.169 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T09:26:11.226 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T09:26:11.268 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T09:26:11.373 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T09:26:11.412 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T09:26:11.552 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T09:26:11.577 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T09:26:11.602 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T09:26:11.677 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T09:26:11.803 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T09:26:11.852 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T09:26:11.879 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T09:26:11.913 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T09:26:11.953 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T09:26:11.984 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T09:26:12.014 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T09:26:12.049 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T09:26:12.082 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T09:26:12.123 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T09:26:12.158 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T09:26:12.244 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T09:26:12.288 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T09:26:12.320 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T09:26:12.423 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T09:26:12.470 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T09:26:12.677 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:26:12.710 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:26:13.191 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T09:26:13.234 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T09:26:13.268 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T09:26:13.286 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:26:13.346 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:26:13.369 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T09:26:13.422 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:26:13.422 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T09:26:13.422 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T09:26:13.422 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:26:13.423 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T09:26:13.456 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:26:13.467 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T09:26:13.549 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T09:26:13.588 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T09:26:13.771 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T09:26:13.802 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T09:26:13.879 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T09:26:14.012 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-09-19T09:26:14.124 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T09:26:14.163 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T09:26:14.224 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T09:26:14.258 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T09:26:14.283 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T09:26:14.335 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T09:26:14.521 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T09:26:14.644 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T09:26:14.682 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T09:26:14.784 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:26:14.909 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:26:14.935 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:26:15.027 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:26:15.056 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:26:15.217 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T09:26:15.270 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T09:26:15.299 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:26:15.387 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:26:15.416 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:26:15.461 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:26:15.483 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:26:15.509 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:26:15.693 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:26:15.829 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:26:15.882 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T09:26:15.958 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T09:26:15.982 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T09:26:15.994 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T09:26:16.027 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T09:26:16.092 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:26:16.167 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:26:16.336 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T09:26:16.382 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:26:16.414 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:26:16.464 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:26:16.495 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T09:26:16.531 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T09:26:16.551 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T09:26:16.655 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T09:26:16.692 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T09:26:16.727 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T09:26:16.802 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T09:26:16.854 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T09:26:16.902 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T09:26:16.963 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T09:26:16.997 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T09:26:17.014 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T09:26:17.023 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T09:26:17.048 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:26:17.094 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T09:26:17.115 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:26:17.145 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T09:26:17.146 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T09:26:17.179 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T09:26:17.219 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T09:26:17.298 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T09:26:17.347 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T09:26:17.398 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T09:26:17.435 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T09:26:17.509 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T09:26:17.550 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T09:26:17.627 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T09:26:17.773 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T09:26:17.829 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T09:26:18.386 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T09:26:18.467 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T09:26:18.502 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T09:26:18.545 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T09:26:18.583 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T09:26:18.627 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T09:26:18.778 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T09:26:18.829 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T09:26:18.902 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T09:26:18.985 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T09:26:19.031 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T09:26:19.067 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T09:26:19.123 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T09:26:19.158 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T09:26:19.202 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T09:26:19.244 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T09:26:19.385 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T09:26:19.436 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T09:26:19.473 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:26:19.478 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T09:26:19.508 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:26:19.585 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T09:26:19.619 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T09:26:19.659 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T09:26:19.685 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T09:26:19.710 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T09:26:19.788 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T09:26:19.916 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T09:26:19.951 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T09:26:19.979 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T09:26:20.022 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T09:26:20.050 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:26:20.078 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T09:26:20.095 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:26:20.117 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T09:26:20.147 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T09:26:20.181 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T09:26:20.188 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:26:20.188 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T09:26:20.189 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T09:26:20.189 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-19T09:26:20.213 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:26:20.214 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T09:26:20.257 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T09:26:20.291 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T09:26:20.380 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T09:26:20.438 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T09:26:20.477 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T09:26:20.584 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T09:26:20.638 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T09:26:21.409 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T09:26:21.459 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T09:26:21.493 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T09:26:21.598 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T09:26:21.649 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T09:26:21.694 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T09:26:21.785 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T09:26:21.837 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T09:26:22.028 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T09:26:22.068 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T09:26:22.149 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T09:26:22.839 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T09:26:22.962 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T09:26:24.270 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T09:26:24.357 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T09:26:24.385 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T09:26:24.418 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T09:26:24.744 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T09:26:24.789 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:26:24.881 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:26:24.911 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T09:26:24.947 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T09:26:25.463 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T09:26:25.501 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:26:25.555 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:26:25.585 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T09:26:25.901 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:26:25.902 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /sys 2024-09-19T09:26:25.902 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /proc 2024-09-19T09:26:25.902 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /mnt 2024-09-19T09:26:25.902 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /var/tmp 2024-09-19T09:26:25.902 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /home 2024-09-19T09:26:25.902 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /root 2024-09-19T09:26:25.902 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /tmp 2024-09-19T09:26:25.902 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:26:26.094 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:26:26.111 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:26:26.111 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:26:26.111 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T09:26:26.111 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:26:27.640 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:26:27.668 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:26:27.668 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:26:27.668 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T09:26:27.668 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:26:27.668 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:26:27.668 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:26:27.906 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:26:27.931 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:26:27.931 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:26:27.931 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T09:26:27.931 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:26:27.931 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:26:27.932 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:26:28.178 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:26:28.224 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:26:28.390 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:26:28.415 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:26:28.415 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:26:28.415 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T09:26:28.415 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:26:28.415 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:26:28.415 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:26:28.521 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T09:26:28.571 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T09:26:28.634 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T09:26:28.795 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:26:28.829 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T09:26:28.835 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:26:28.875 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T09:26:28.927 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:26:28.927 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T09:26:28.927 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T09:26:28.927 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T09:26:28.955 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T09:26:28.962 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:26:29.053 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T09:26:29.197 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T09:26:29.248 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T09:26:29.281 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T09:26:29.309 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T09:26:29.806 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:26:29.833 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:26:29.864 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T09:26:29.929 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T09:26:29.956 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:26:31.064 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:26:31.099 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:26:31.944 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:26:31.945 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /sys 2024-09-19T09:26:31.945 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /proc 2024-09-19T09:26:31.945 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /mnt 2024-09-19T09:26:31.945 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /var/tmp 2024-09-19T09:26:31.945 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /home 2024-09-19T09:26:31.945 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /root 2024-09-19T09:26:31.945 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /tmp 2024-09-19T09:26:31.945 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-19T09:26:32.109 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:26:32.114 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:26:32.125 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:26:32.125 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:26:32.125 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T09:26:32.125 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-19T09:26:32.149 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:26:32.259 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:26:32.428 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T09:26:32.459 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:26:32.485 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:26:32.485 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:26:32.485 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T09:26:32.485 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:26:32.485 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:26:32.485 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:26:32.535 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:26:32.548 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:26:32.649 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T09:26:32.711 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T09:26:33.612 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:26:33.638 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:26:33.638 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:26:33.639 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T09:26:33.639 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:26:33.639 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:26:33.639 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-19T09:26:33.679 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T09:26:33.704 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:26:33.729 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:26:33.730 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:26:33.730 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T09:26:33.730 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:26:33.730 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:26:33.730 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:26:33.772 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:26:33.796 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:26:33.796 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:26:33.796 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T09:26:33.797 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:26:33.847 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:26:33.871 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:26:33.872 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:26:33.872 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:26:33.872 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T09:26:33.872 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:26:33.872 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:26:33.872 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:26:33.894 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:26:33.894 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:26:33.895 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T09:26:33.895 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:26:33.895 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:26:33.895 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-19T09:26:34.190 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:26:34.214 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:26:34.215 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:26:34.215 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T09:26:34.215 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:26:34.215 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:26:34.215 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:26:34.330 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:26:34.353 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:26:34.353 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:26:34.353 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T09:26:34.353 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:26:34.353 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:26:34.353 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-19T09:26:34.460 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T09:26:34.517 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T09:26:34.572 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T09:26:34.759 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T09:26:34.822 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T09:26:34.891 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T09:26:34.981 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T09:26:35.118 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T09:26:35.164 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T09:26:35.196 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T09:26:35.224 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T09:26:35.636 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:26:35.664 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:26:35.696 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T09:26:35.759 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T09:26:35.787 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:26:36.833 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:26:36.872 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:26:37.836 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:26:37.864 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:26:37.968 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:26:38.134 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T09:26:38.166 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:26:38.190 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:26:38.190 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:26:38.190 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T09:26:38.191 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:26:38.191 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:26:38.191 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-19T09:26:38.242 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:26:38.253 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:26:38.351 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T09:26:38.398 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T09:26:39.052 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T09:26:39.094 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T09:26:39.134 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T09:26:39.166 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T09:26:39.193 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T09:26:39.324 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T09:26:39.353 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:26:39.376 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:26:39.376 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:26:39.376 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T09:26:39.377 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:26:39.377 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:26:39.377 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-19T09:26:39.396 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T09:26:39.420 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:26:39.439 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T09:26:39.442 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:26:39.443 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:26:39.443 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T09:26:39.443 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-19T09:26:39.469 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T09:26:39.488 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:26:39.500 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T09:26:39.510 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:26:39.510 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:26:39.510 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T09:26:39.510 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:26:39.510 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:26:39.511 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-19T09:26:39.545 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T09:26:39.805 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:26:39.828 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:26:39.828 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:26:39.828 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T09:26:39.828 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:26:39.828 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:26:39.828 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-19T09:26:40.223 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:26:40.268 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:26:40.290 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:26:41.129 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:26:41.129 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /sys 2024-09-19T09:26:41.129 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /proc 2024-09-19T09:26:41.129 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /mnt 2024-09-19T09:26:41.129 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /var/tmp 2024-09-19T09:26:41.129 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /home 2024-09-19T09:26:41.129 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /root 2024-09-19T09:26:41.129 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /tmp 2024-09-19T09:26:41.129 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T09:26:41.192 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T09:26:41.273 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T09:26:41.315 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:26:41.321 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T09:26:41.331 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:26:41.331 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:26:41.332 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T09:26:41.332 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T09:26:41.418 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T09:26:41.451 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T09:26:41.476 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T09:26:41.502 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T09:26:41.502 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:26:41.595 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:26:41.595 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:26:41.678 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:26:41.704 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T09:26:41.709 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:26:41.709 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:26:41.897 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:26:41.897 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:26:41.981 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:26:42.050 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:26:42.868 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:26:42.895 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:26:42.895 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:26:42.895 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T09:26:42.895 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:26:42.895 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:26:42.895 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T09:26:43.136 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:26:43.159 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:26:43.160 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:26:43.160 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T09:26:43.160 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:26:43.160 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:26:43.160 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T09:26:43.620 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:26:43.643 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:26:43.643 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:26:43.643 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T09:26:43.643 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:26:43.643 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:26:43.643 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T09:26:43.759 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T09:26:43.818 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T09:26:43.881 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T09:26:44.095 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T09:26:44.146 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T09:26:44.228 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T09:26:44.326 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T09:26:44.375 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T09:26:44.416 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T09:26:44.457 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T09:26:44.478 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T09:26:44.489 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T09:26:44.525 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T09:26:44.530 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T09:26:44.561 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T09:26:44.588 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T09:26:44.705 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T09:26:44.747 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T09:26:44.769 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T09:26:44.798 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T09:26:44.845 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T09:26:45.051 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:26:45.079 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:26:45.111 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T09:26:45.176 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T09:26:45.202 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:26:45.433 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:26:45.467 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:26:45.488 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:26:46.310 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T09:26:46.315 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:26:46.345 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:26:46.406 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T09:26:46.439 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T09:26:46.521 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T09:26:46.559 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T09:26:46.584 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T09:26:46.610 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T09:26:46.610 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:26:46.686 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:26:46.687 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:26:46.771 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:26:46.804 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T09:26:46.809 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:26:46.809 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:26:46.989 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:26:46.989 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:26:47.073 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:26:47.137 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:26:47.358 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:26:47.388 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:26:47.498 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:26:47.577 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:26:47.577 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T09:26:47.577 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T09:26:47.577 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T09:26:47.577 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T09:26:47.577 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T09:26:47.578 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T09:26:47.578 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T09:26:47.578 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:26:47.578 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:26:47.578 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:26:47.578 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T09:26:47.578 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T09:26:47.578 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:26:47.578 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T09:26:47.578 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T09:26:47.578 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T09:26:47.578 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T09:26:47.578 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T09:26:47.579 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T09:26:47.579 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T09:26:47.579 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T09:26:47.579 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T09:26:47.579 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T09:26:47.579 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T09:26:47.579 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T09:26:47.579 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T09:26:47.579 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T09:26:47.579 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T09:26:47.579 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T09:26:47.591 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T09:26:47.591 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T09:26:47.591 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T09:26:47.591 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T09:26:47.591 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T09:26:47.591 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T09:26:47.592 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T09:26:47.592 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T09:26:47.592 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T09:26:47.592 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T09:26:47.592 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T09:26:47.592 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T09:26:47.592 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T09:26:47.592 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T09:26:47.592 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T09:26:47.592 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T09:26:47.592 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T09:26:47.592 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T09:26:47.592 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T09:26:47.593 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T09:26:47.593 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T09:26:47.593 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T09:26:47.593 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T09:26:47.593 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T09:26:47.593 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T09:26:47.593 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T09:26:47.593 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T09:26:47.593 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T09:26:47.593 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T09:26:47.593 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T09:26:47.593 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T09:26:47.593 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T09:26:47.594 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T09:26:47.594 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T09:26:47.594 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T09:26:47.594 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T09:26:47.594 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T09:26:47.594 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T09:26:47.594 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T09:26:47.594 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T09:26:47.594 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T09:26:47.594 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T09:26:47.594 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T09:26:47.594 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T09:26:47.594 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T09:26:47.595 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T09:26:47.595 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T09:26:47.595 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T09:26:47.595 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T09:26:47.595 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T09:26:47.595 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T09:26:47.595 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T09:26:47.595 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T09:26:47.595 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T09:26:47.595 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T09:26:47.595 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T09:26:47.595 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T09:26:47.595 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T09:26:47.595 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T09:26:47.596 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T09:26:47.596 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T09:26:47.596 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T09:26:47.596 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T09:26:47.596 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T09:26:47.596 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T09:26:47.596 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T09:26:47.596 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T09:26:47.596 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T09:26:47.596 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T09:26:47.596 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T09:26:47.596 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T09:26:47.596 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T09:26:47.596 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T09:26:47.597 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T09:26:47.597 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T09:26:47.597 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T09:26:47.597 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T09:26:47.597 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T09:26:47.597 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T09:26:47.597 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T09:26:47.597 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T09:26:47.597 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T09:26:47.597 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T09:26:47.597 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T09:26:47.597 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T09:26:47.597 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T09:26:47.597 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T09:26:47.598 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T09:26:47.598 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T09:26:47.598 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T09:26:47.598 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T09:26:47.598 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T09:26:47.598 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T09:26:47.598 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T09:26:47.598 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T09:26:47.598 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T09:26:47.598 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T09:26:47.598 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T09:26:47.598 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T09:26:47.598 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T09:26:47.599 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T09:26:47.599 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T09:26:47.599 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T09:26:47.599 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T09:26:47.599 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T09:26:47.599 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T09:26:47.599 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T09:26:47.599 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T09:26:47.599 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T09:26:47.599 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T09:26:47.599 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T09:26:47.599 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T09:26:47.599 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T09:26:47.600 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T09:26:47.600 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T09:26:47.600 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T09:26:47.600 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T09:26:47.600 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T09:26:47.600 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T09:26:47.600 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T09:26:47.600 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T09:26:47.600 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T09:26:47.600 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T09:26:47.600 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T09:26:47.600 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T09:26:47.600 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T09:26:47.600 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T09:26:47.601 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T09:26:47.601 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T09:26:47.601 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T09:26:47.601 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T09:26:47.601 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T09:26:47.601 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T09:26:47.601 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T09:26:47.657 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T09:26:47.689 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:26:47.714 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:26:47.714 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:26:47.714 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T09:26:47.714 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:26:47.714 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:26:47.714 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T09:26:47.757 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:26:47.769 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:26:47.862 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T09:26:47.916 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T09:26:48.890 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T09:26:49.159 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:26:49.159 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:26:49.159 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:26:49.159 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T09:26:49.159 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:26:49.159 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:26:49.159 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T09:26:49.159 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:26:49.159 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:26:49.159 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:26:49.160 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T09:26:49.160 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T09:26:49.160 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:26:49.160 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:26:49.160 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:26:49.160 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T09:26:49.160 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:26:49.160 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:26:49.160 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T09:26:49.395 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:26:49.418 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:26:49.418 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:26:49.418 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T09:26:49.418 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:26:49.418 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:26:49.418 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T09:26:50.350 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:26:50.350 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:26:50.350 INFO:teuthology.orchestra.run.smithi001.stdout:Upgraded: 2024-09-19T09:26:50.350 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T09:26:50.350 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T09:26:50.350 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T09:26:50.350 INFO:teuthology.orchestra.run.smithi001.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T09:26:50.350 INFO:teuthology.orchestra.run.smithi001.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:50.350 INFO:teuthology.orchestra.run.smithi001.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:50.350 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T09:26:50.351 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T09:26:50.351 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2024-09-19T09:26:50.351 INFO:teuthology.orchestra.run.smithi001.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T09:26:50.351 INFO:teuthology.orchestra.run.smithi001.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T09:26:50.351 INFO:teuthology.orchestra.run.smithi001.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T09:26:50.351 INFO:teuthology.orchestra.run.smithi001.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T09:26:50.351 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:50.351 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:50.351 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:50.351 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:50.351 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:26:50.351 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:50.351 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:50.351 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:50.352 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:26:50.352 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:26:50.352 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:26:50.352 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:26:50.352 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:26:50.352 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:50.352 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:50.352 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:26:50.352 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:50.352 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:50.352 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:50.352 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:26:50.353 INFO:teuthology.orchestra.run.smithi001.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:26:50.353 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:50.353 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:50.353 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:26:50.353 INFO:teuthology.orchestra.run.smithi001.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T09:26:50.353 INFO:teuthology.orchestra.run.smithi001.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T09:26:50.353 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T09:26:50.353 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T09:26:50.353 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T09:26:50.353 INFO:teuthology.orchestra.run.smithi001.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T09:26:50.353 INFO:teuthology.orchestra.run.smithi001.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T09:26:50.353 INFO:teuthology.orchestra.run.smithi001.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T09:26:50.354 INFO:teuthology.orchestra.run.smithi001.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T09:26:50.354 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T09:26:50.354 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T09:26:50.354 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:50.354 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:50.354 INFO:teuthology.orchestra.run.smithi001.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:50.354 INFO:teuthology.orchestra.run.smithi001.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T09:26:50.354 INFO:teuthology.orchestra.run.smithi001.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T09:26:50.354 INFO:teuthology.orchestra.run.smithi001.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T09:26:50.354 INFO:teuthology.orchestra.run.smithi001.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T09:26:50.354 INFO:teuthology.orchestra.run.smithi001.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T09:26:50.354 INFO:teuthology.orchestra.run.smithi001.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:50.354 INFO:teuthology.orchestra.run.smithi001.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:50.354 INFO:teuthology.orchestra.run.smithi001.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T09:26:50.355 INFO:teuthology.orchestra.run.smithi001.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:50.355 INFO:teuthology.orchestra.run.smithi001.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T09:26:50.355 INFO:teuthology.orchestra.run.smithi001.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T09:26:50.355 INFO:teuthology.orchestra.run.smithi001.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T09:26:50.355 INFO:teuthology.orchestra.run.smithi001.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T09:26:50.355 INFO:teuthology.orchestra.run.smithi001.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T09:26:50.355 INFO:teuthology.orchestra.run.smithi001.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T09:26:50.355 INFO:teuthology.orchestra.run.smithi001.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T09:26:50.355 INFO:teuthology.orchestra.run.smithi001.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T09:26:50.355 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T09:26:50.355 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T09:26:50.355 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T09:26:50.355 INFO:teuthology.orchestra.run.smithi001.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T09:26:50.356 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T09:26:50.356 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T09:26:50.356 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T09:26:50.356 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T09:26:50.356 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T09:26:50.356 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T09:26:50.356 INFO:teuthology.orchestra.run.smithi001.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T09:26:50.356 INFO:teuthology.orchestra.run.smithi001.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T09:26:50.356 INFO:teuthology.orchestra.run.smithi001.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T09:26:50.356 INFO:teuthology.orchestra.run.smithi001.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T09:26:50.356 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T09:26:50.356 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:50.356 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:50.357 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:50.357 INFO:teuthology.orchestra.run.smithi001.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T09:26:50.357 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T09:26:50.357 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T09:26:50.357 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T09:26:50.357 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T09:26:50.357 INFO:teuthology.orchestra.run.smithi001.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T09:26:50.357 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T09:26:50.357 INFO:teuthology.orchestra.run.smithi001.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T09:26:50.357 INFO:teuthology.orchestra.run.smithi001.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T09:26:50.357 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T09:26:50.357 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T09:26:50.357 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T09:26:50.358 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T09:26:50.358 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T09:26:50.358 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T09:26:50.358 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T09:26:50.358 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T09:26:50.358 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T09:26:50.358 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T09:26:50.358 INFO:teuthology.orchestra.run.smithi001.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T09:26:50.358 INFO:teuthology.orchestra.run.smithi001.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T09:26:50.358 INFO:teuthology.orchestra.run.smithi001.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T09:26:50.358 INFO:teuthology.orchestra.run.smithi001.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T09:26:50.358 INFO:teuthology.orchestra.run.smithi001.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T09:26:50.358 INFO:teuthology.orchestra.run.smithi001.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T09:26:50.359 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T09:26:50.359 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T09:26:50.359 INFO:teuthology.orchestra.run.smithi001.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T09:26:50.359 INFO:teuthology.orchestra.run.smithi001.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T09:26:50.359 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T09:26:50.359 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T09:26:50.359 INFO:teuthology.orchestra.run.smithi001.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T09:26:50.359 INFO:teuthology.orchestra.run.smithi001.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T09:26:50.359 INFO:teuthology.orchestra.run.smithi001.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T09:26:50.359 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T09:26:50.359 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T09:26:50.359 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T09:26:50.359 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T09:26:50.359 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T09:26:50.360 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T09:26:50.360 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:50.360 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:50.360 INFO:teuthology.orchestra.run.smithi001.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T09:26:50.360 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T09:26:50.360 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T09:26:50.360 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:50.360 INFO:teuthology.orchestra.run.smithi001.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T09:26:50.360 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T09:26:50.360 INFO:teuthology.orchestra.run.smithi001.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T09:26:50.360 INFO:teuthology.orchestra.run.smithi001.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T09:26:50.360 INFO:teuthology.orchestra.run.smithi001.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T09:26:50.360 INFO:teuthology.orchestra.run.smithi001.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T09:26:50.361 INFO:teuthology.orchestra.run.smithi001.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T09:26:50.361 INFO:teuthology.orchestra.run.smithi001.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T09:26:50.361 INFO:teuthology.orchestra.run.smithi001.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T09:26:50.361 INFO:teuthology.orchestra.run.smithi001.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T09:26:50.361 INFO:teuthology.orchestra.run.smithi001.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T09:26:50.361 INFO:teuthology.orchestra.run.smithi001.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T09:26:50.361 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T09:26:50.361 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T09:26:50.361 INFO:teuthology.orchestra.run.smithi001.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T09:26:50.361 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:50.361 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:50.361 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:50.361 INFO:teuthology.orchestra.run.smithi001.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T09:26:50.361 INFO:teuthology.orchestra.run.smithi001.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T09:26:50.362 INFO:teuthology.orchestra.run.smithi001.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T09:26:50.362 INFO:teuthology.orchestra.run.smithi001.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T09:26:50.362 INFO:teuthology.orchestra.run.smithi001.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T09:26:50.362 INFO:teuthology.orchestra.run.smithi001.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T09:26:50.362 INFO:teuthology.orchestra.run.smithi001.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T09:26:50.362 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:26:50.362 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-09-19T09:26:50.806 DEBUG:teuthology.parallel:result is None 2024-09-19T09:26:52.858 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:26:52.858 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T09:26:52.859 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T09:26:52.859 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T09:26:52.859 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T09:26:52.859 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T09:26:52.859 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T09:26:52.859 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T09:26:52.859 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:26:52.859 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:26:52.859 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:26:52.859 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T09:26:52.860 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T09:26:52.860 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:26:52.860 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T09:26:52.860 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T09:26:52.860 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T09:26:52.860 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T09:26:52.860 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T09:26:52.860 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T09:26:52.860 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T09:26:52.860 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T09:26:52.860 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T09:26:52.860 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T09:26:52.860 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T09:26:52.861 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T09:26:52.861 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T09:26:52.861 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T09:26:52.861 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T09:26:52.861 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T09:26:52.861 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T09:26:52.861 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T09:26:52.861 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T09:26:52.861 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T09:26:52.861 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T09:26:52.861 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T09:26:52.861 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T09:26:52.861 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T09:26:52.861 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T09:26:52.862 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T09:26:52.862 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T09:26:52.862 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T09:26:52.862 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T09:26:52.862 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T09:26:52.862 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T09:26:52.862 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T09:26:52.862 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T09:26:52.862 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T09:26:52.862 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T09:26:52.862 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T09:26:52.862 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T09:26:52.862 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T09:26:52.862 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T09:26:52.863 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T09:26:52.863 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T09:26:52.863 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T09:26:52.863 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T09:26:52.863 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T09:26:52.863 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T09:26:52.863 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T09:26:52.863 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T09:26:52.863 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T09:26:52.863 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T09:26:52.863 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T09:26:52.863 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T09:26:52.863 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T09:26:52.864 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T09:26:52.864 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T09:26:52.864 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T09:26:52.864 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T09:26:52.864 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T09:26:52.864 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T09:26:52.864 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T09:26:52.864 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T09:26:52.864 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T09:26:52.864 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T09:26:52.864 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T09:26:52.864 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T09:26:52.864 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T09:26:52.864 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T09:26:52.865 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T09:26:52.865 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T09:26:52.865 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T09:26:52.865 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T09:26:52.865 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T09:26:52.865 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T09:26:52.865 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T09:26:52.865 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T09:26:52.865 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T09:26:52.865 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T09:26:52.865 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T09:26:52.865 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T09:26:52.865 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T09:26:52.865 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T09:26:52.866 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T09:26:52.866 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T09:26:52.866 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T09:26:52.866 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T09:26:52.866 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T09:26:52.866 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T09:26:52.866 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T09:26:52.866 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T09:26:52.866 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T09:26:52.866 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T09:26:52.866 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T09:26:52.866 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T09:26:52.866 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T09:26:52.866 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T09:26:52.867 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T09:26:52.867 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T09:26:52.867 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T09:26:52.867 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T09:26:52.867 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T09:26:52.867 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T09:26:52.867 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T09:26:52.867 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T09:26:52.867 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T09:26:52.867 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T09:26:52.867 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T09:26:52.867 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T09:26:52.867 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T09:26:52.867 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T09:26:52.867 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T09:26:52.868 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T09:26:52.868 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T09:26:52.868 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T09:26:52.868 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T09:26:52.868 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T09:26:52.868 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T09:26:52.868 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T09:26:52.868 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T09:26:52.868 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T09:26:52.868 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T09:26:52.868 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T09:26:52.868 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T09:26:52.869 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T09:26:52.869 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T09:26:52.869 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T09:26:52.869 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T09:26:52.869 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T09:26:52.869 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T09:26:52.869 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T09:26:52.869 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T09:26:52.869 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T09:26:52.869 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T09:26:52.869 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T09:26:52.869 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T09:26:52.870 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T09:26:52.870 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T09:26:52.870 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T09:26:52.870 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T09:26:52.870 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T09:26:52.870 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T09:26:52.870 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T09:26:52.870 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T09:26:52.870 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T09:26:52.870 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T09:26:52.870 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T09:26:52.870 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T09:26:52.870 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T09:26:52.870 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T09:26:52.871 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T09:26:52.871 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T09:26:52.871 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T09:26:54.224 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T09:26:54.265 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T09:26:54.307 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T09:26:54.338 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T09:26:54.365 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T09:26:54.565 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T09:26:54.603 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T09:26:54.750 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T09:26:54.780 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T09:26:54.826 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T09:26:55.261 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:26:55.262 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-19T09:26:55.262 INFO:teuthology.orchestra.run.smithi121.stdout:Upgraded: 2024-09-19T09:26:55.262 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T09:26:55.262 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T09:26:55.262 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T09:26:55.262 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T09:26:55.262 INFO:teuthology.orchestra.run.smithi121.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:55.262 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:55.262 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T09:26:55.262 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T09:26:55.262 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-09-19T09:26:55.263 INFO:teuthology.orchestra.run.smithi121.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T09:26:55.263 INFO:teuthology.orchestra.run.smithi121.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T09:26:55.263 INFO:teuthology.orchestra.run.smithi121.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T09:26:55.263 INFO:teuthology.orchestra.run.smithi121.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T09:26:55.263 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:55.263 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:55.263 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:55.263 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:55.263 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:26:55.263 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:55.263 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:55.263 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:55.263 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:26:55.264 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:26:55.264 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:26:55.264 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:26:55.264 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:26:55.264 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:55.264 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:55.264 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:26:55.264 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:55.264 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:55.264 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:55.264 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:26:55.264 INFO:teuthology.orchestra.run.smithi121.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:26:55.264 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:55.265 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:55.265 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:26:55.265 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T09:26:55.265 INFO:teuthology.orchestra.run.smithi121.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T09:26:55.265 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T09:26:55.265 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T09:26:55.265 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T09:26:55.265 INFO:teuthology.orchestra.run.smithi121.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T09:26:55.265 INFO:teuthology.orchestra.run.smithi121.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T09:26:55.265 INFO:teuthology.orchestra.run.smithi121.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T09:26:55.265 INFO:teuthology.orchestra.run.smithi121.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T09:26:55.265 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T09:26:55.265 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T09:26:55.265 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:55.266 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:55.266 INFO:teuthology.orchestra.run.smithi121.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:55.266 INFO:teuthology.orchestra.run.smithi121.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T09:26:55.266 INFO:teuthology.orchestra.run.smithi121.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T09:26:55.266 INFO:teuthology.orchestra.run.smithi121.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T09:26:55.266 INFO:teuthology.orchestra.run.smithi121.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T09:26:55.266 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T09:26:55.266 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:55.266 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:55.266 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T09:26:55.266 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:55.266 INFO:teuthology.orchestra.run.smithi121.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T09:26:55.266 INFO:teuthology.orchestra.run.smithi121.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T09:26:55.267 INFO:teuthology.orchestra.run.smithi121.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T09:26:55.267 INFO:teuthology.orchestra.run.smithi121.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T09:26:55.267 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T09:26:55.267 INFO:teuthology.orchestra.run.smithi121.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T09:26:55.267 INFO:teuthology.orchestra.run.smithi121.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T09:26:55.267 INFO:teuthology.orchestra.run.smithi121.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T09:26:55.267 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T09:26:55.267 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T09:26:55.267 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T09:26:55.267 INFO:teuthology.orchestra.run.smithi121.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T09:26:55.267 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T09:26:55.267 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T09:26:55.267 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T09:26:55.267 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T09:26:55.268 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T09:26:55.268 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T09:26:55.268 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T09:26:55.268 INFO:teuthology.orchestra.run.smithi121.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T09:26:55.268 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T09:26:55.268 INFO:teuthology.orchestra.run.smithi121.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T09:26:55.268 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T09:26:55.268 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:55.268 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:55.268 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:55.269 INFO:teuthology.orchestra.run.smithi121.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T09:26:55.269 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T09:26:55.269 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T09:26:55.269 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T09:26:55.269 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T09:26:55.269 INFO:teuthology.orchestra.run.smithi121.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T09:26:55.269 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T09:26:55.269 INFO:teuthology.orchestra.run.smithi121.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T09:26:55.269 INFO:teuthology.orchestra.run.smithi121.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T09:26:55.269 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T09:26:55.269 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T09:26:55.269 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T09:26:55.269 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T09:26:55.270 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T09:26:55.270 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T09:26:55.270 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T09:26:55.270 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T09:26:55.270 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T09:26:55.270 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T09:26:55.270 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T09:26:55.270 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T09:26:55.270 INFO:teuthology.orchestra.run.smithi121.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T09:26:55.270 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T09:26:55.270 INFO:teuthology.orchestra.run.smithi121.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T09:26:55.270 INFO:teuthology.orchestra.run.smithi121.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T09:26:55.270 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T09:26:55.271 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T09:26:55.271 INFO:teuthology.orchestra.run.smithi121.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T09:26:55.271 INFO:teuthology.orchestra.run.smithi121.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T09:26:55.271 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T09:26:55.271 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T09:26:55.271 INFO:teuthology.orchestra.run.smithi121.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T09:26:55.271 INFO:teuthology.orchestra.run.smithi121.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T09:26:55.271 INFO:teuthology.orchestra.run.smithi121.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T09:26:55.271 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T09:26:55.271 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T09:26:55.271 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T09:26:55.271 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T09:26:55.271 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T09:26:55.271 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T09:26:55.272 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:55.272 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:55.272 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T09:26:55.272 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T09:26:55.272 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T09:26:55.272 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:55.272 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T09:26:55.272 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T09:26:55.272 INFO:teuthology.orchestra.run.smithi121.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T09:26:55.272 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T09:26:55.272 INFO:teuthology.orchestra.run.smithi121.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T09:26:55.272 INFO:teuthology.orchestra.run.smithi121.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T09:26:55.272 INFO:teuthology.orchestra.run.smithi121.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T09:26:55.273 INFO:teuthology.orchestra.run.smithi121.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T09:26:55.273 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T09:26:55.273 INFO:teuthology.orchestra.run.smithi121.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T09:26:55.273 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T09:26:55.273 INFO:teuthology.orchestra.run.smithi121.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T09:26:55.273 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T09:26:55.273 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T09:26:55.273 INFO:teuthology.orchestra.run.smithi121.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T09:26:55.273 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:55.273 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:55.273 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:26:55.273 INFO:teuthology.orchestra.run.smithi121.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T09:26:55.273 INFO:teuthology.orchestra.run.smithi121.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T09:26:55.274 INFO:teuthology.orchestra.run.smithi121.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T09:26:55.274 INFO:teuthology.orchestra.run.smithi121.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T09:26:55.274 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T09:26:55.274 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T09:26:55.274 INFO:teuthology.orchestra.run.smithi121.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T09:26:55.274 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-19T09:26:55.274 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-19T09:26:55.437 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:26:55.474 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:26:55.494 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:26:55.694 DEBUG:teuthology.parallel:result is None 2024-09-19T09:26:56.399 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T09:26:56.487 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T09:26:56.529 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T09:26:56.614 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T09:26:56.648 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T09:26:56.674 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T09:26:56.700 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T09:26:56.701 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:26:56.775 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:26:56.776 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:26:56.860 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:26:56.885 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T09:26:56.891 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:26:56.891 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:26:57.078 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:26:57.078 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:26:57.162 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:26:57.228 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:27:02.997 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:27:02.998 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T09:27:02.998 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T09:27:02.998 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T09:27:02.998 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T09:27:02.998 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T09:27:02.998 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T09:27:02.998 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T09:27:02.998 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:27:02.998 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:27:02.998 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:27:02.998 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T09:27:02.999 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T09:27:02.999 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:27:02.999 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T09:27:02.999 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T09:27:02.999 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T09:27:02.999 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T09:27:02.999 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T09:27:02.999 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T09:27:02.999 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T09:27:02.999 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T09:27:02.999 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T09:27:02.999 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T09:27:02.999 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T09:27:02.999 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T09:27:03.000 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T09:27:03.000 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T09:27:03.012 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T09:27:03.012 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T09:27:03.012 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T09:27:03.012 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T09:27:03.012 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T09:27:03.012 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T09:27:03.012 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T09:27:03.012 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T09:27:03.012 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T09:27:03.012 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T09:27:03.012 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T09:27:03.013 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T09:27:03.013 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T09:27:03.013 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T09:27:03.013 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T09:27:03.013 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T09:27:03.013 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T09:27:03.013 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T09:27:03.013 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T09:27:03.013 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T09:27:03.013 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T09:27:03.013 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T09:27:03.013 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T09:27:03.013 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T09:27:03.014 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T09:27:03.014 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T09:27:03.014 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T09:27:03.014 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T09:27:03.014 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T09:27:03.014 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T09:27:03.014 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T09:27:03.014 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T09:27:03.014 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T09:27:03.014 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T09:27:03.014 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T09:27:03.014 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T09:27:03.014 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T09:27:03.015 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T09:27:03.015 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T09:27:03.015 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T09:27:03.015 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T09:27:03.015 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T09:27:03.015 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T09:27:03.015 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T09:27:03.015 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T09:27:03.015 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T09:27:03.015 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T09:27:03.015 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T09:27:03.015 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T09:27:03.015 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T09:27:03.016 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T09:27:03.016 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T09:27:03.016 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T09:27:03.016 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T09:27:03.016 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T09:27:03.016 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T09:27:03.016 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T09:27:03.016 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T09:27:03.016 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T09:27:03.016 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T09:27:03.016 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T09:27:03.016 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T09:27:03.016 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T09:27:03.017 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T09:27:03.017 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T09:27:03.017 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T09:27:03.017 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T09:27:03.017 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T09:27:03.017 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T09:27:03.017 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T09:27:03.017 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T09:27:03.017 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T09:27:03.017 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T09:27:03.017 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T09:27:03.017 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T09:27:03.017 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T09:27:03.017 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T09:27:03.018 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T09:27:03.018 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T09:27:03.018 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T09:27:03.018 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T09:27:03.018 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T09:27:03.018 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T09:27:03.018 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T09:27:03.018 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T09:27:03.018 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T09:27:03.018 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T09:27:03.018 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T09:27:03.018 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T09:27:03.018 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T09:27:03.019 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T09:27:03.019 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T09:27:03.019 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T09:27:03.019 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T09:27:03.019 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T09:27:03.019 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T09:27:03.019 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T09:27:03.019 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T09:27:03.019 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T09:27:03.019 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T09:27:03.019 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T09:27:03.019 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T09:27:03.019 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T09:27:03.020 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T09:27:03.020 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T09:27:03.020 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T09:27:03.020 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T09:27:03.020 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T09:27:03.020 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T09:27:03.020 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T09:27:03.020 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T09:27:03.020 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T09:27:03.020 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T09:27:03.020 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T09:27:03.020 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T09:27:03.020 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T09:27:03.021 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T09:27:03.021 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T09:27:03.021 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T09:27:03.021 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T09:27:03.021 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T09:27:03.021 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T09:27:03.021 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T09:27:03.021 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T09:27:03.021 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T09:27:03.021 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T09:27:03.021 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T09:27:03.021 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T09:27:03.021 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T09:27:03.021 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T09:27:03.022 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T09:27:03.022 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T09:27:03.022 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T09:27:03.022 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T09:27:03.022 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T09:27:03.022 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T09:27:05.551 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:27:05.552 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T09:27:05.552 INFO:teuthology.orchestra.run.smithi022.stdout:Upgraded: 2024-09-19T09:27:05.552 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T09:27:05.552 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T09:27:05.552 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T09:27:05.552 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T09:27:05.552 INFO:teuthology.orchestra.run.smithi022.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:27:05.552 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:27:05.552 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T09:27:05.552 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T09:27:05.553 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-09-19T09:27:05.553 INFO:teuthology.orchestra.run.smithi022.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T09:27:05.553 INFO:teuthology.orchestra.run.smithi022.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T09:27:05.553 INFO:teuthology.orchestra.run.smithi022.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T09:27:05.553 INFO:teuthology.orchestra.run.smithi022.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T09:27:05.553 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:27:05.553 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:27:05.553 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:27:05.553 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:27:05.553 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:27:05.553 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:27:05.553 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:27:05.554 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:27:05.554 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:27:05.554 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:27:05.554 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:27:05.554 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:27:05.554 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:27:05.554 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:27:05.554 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:27:05.554 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:27:05.554 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:27:05.554 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:27:05.555 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:27:05.555 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:27:05.555 INFO:teuthology.orchestra.run.smithi022.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:27:05.555 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:27:05.555 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:27:05.555 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:27:05.555 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T09:27:05.555 INFO:teuthology.orchestra.run.smithi022.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T09:27:05.555 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T09:27:05.555 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T09:27:05.555 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T09:27:05.555 INFO:teuthology.orchestra.run.smithi022.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T09:27:05.556 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T09:27:05.556 INFO:teuthology.orchestra.run.smithi022.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T09:27:05.556 INFO:teuthology.orchestra.run.smithi022.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T09:27:05.556 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T09:27:05.556 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T09:27:05.556 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:27:05.556 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:27:05.556 INFO:teuthology.orchestra.run.smithi022.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:27:05.556 INFO:teuthology.orchestra.run.smithi022.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T09:27:05.556 INFO:teuthology.orchestra.run.smithi022.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T09:27:05.556 INFO:teuthology.orchestra.run.smithi022.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T09:27:05.556 INFO:teuthology.orchestra.run.smithi022.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T09:27:05.557 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T09:27:05.557 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:27:05.557 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:27:05.557 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T09:27:05.557 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:27:05.557 INFO:teuthology.orchestra.run.smithi022.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T09:27:05.557 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T09:27:05.557 INFO:teuthology.orchestra.run.smithi022.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T09:27:05.557 INFO:teuthology.orchestra.run.smithi022.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T09:27:05.557 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T09:27:05.557 INFO:teuthology.orchestra.run.smithi022.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T09:27:05.557 INFO:teuthology.orchestra.run.smithi022.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T09:27:05.557 INFO:teuthology.orchestra.run.smithi022.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T09:27:05.558 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T09:27:05.558 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T09:27:05.558 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T09:27:05.558 INFO:teuthology.orchestra.run.smithi022.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T09:27:05.558 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T09:27:05.558 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T09:27:05.558 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T09:27:05.558 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T09:27:05.558 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T09:27:05.558 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T09:27:05.558 INFO:teuthology.orchestra.run.smithi022.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T09:27:05.559 INFO:teuthology.orchestra.run.smithi022.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T09:27:05.559 INFO:teuthology.orchestra.run.smithi022.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T09:27:05.559 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T09:27:05.559 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T09:27:05.559 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:27:05.559 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:27:05.559 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:27:05.559 INFO:teuthology.orchestra.run.smithi022.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T09:27:05.559 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T09:27:05.559 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T09:27:05.559 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T09:27:05.559 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T09:27:05.559 INFO:teuthology.orchestra.run.smithi022.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T09:27:05.560 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T09:27:05.560 INFO:teuthology.orchestra.run.smithi022.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T09:27:05.560 INFO:teuthology.orchestra.run.smithi022.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T09:27:05.560 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T09:27:05.560 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T09:27:05.560 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T09:27:05.560 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T09:27:05.560 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T09:27:05.560 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T09:27:05.560 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T09:27:05.560 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T09:27:05.561 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T09:27:05.561 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T09:27:05.561 INFO:teuthology.orchestra.run.smithi022.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T09:27:05.561 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T09:27:05.561 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T09:27:05.561 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T09:27:05.561 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T09:27:05.561 INFO:teuthology.orchestra.run.smithi022.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T09:27:05.561 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T09:27:05.561 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T09:27:05.561 INFO:teuthology.orchestra.run.smithi022.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T09:27:05.561 INFO:teuthology.orchestra.run.smithi022.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T09:27:05.561 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T09:27:05.562 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T09:27:05.562 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T09:27:05.562 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T09:27:05.562 INFO:teuthology.orchestra.run.smithi022.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T09:27:05.562 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T09:27:05.562 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T09:27:05.562 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T09:27:05.562 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T09:27:05.562 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T09:27:05.562 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T09:27:05.562 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:27:05.562 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:27:05.562 INFO:teuthology.orchestra.run.smithi022.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T09:27:05.563 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T09:27:05.563 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T09:27:05.563 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:27:05.563 INFO:teuthology.orchestra.run.smithi022.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T09:27:05.563 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T09:27:05.563 INFO:teuthology.orchestra.run.smithi022.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T09:27:05.563 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T09:27:05.563 INFO:teuthology.orchestra.run.smithi022.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T09:27:05.563 INFO:teuthology.orchestra.run.smithi022.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T09:27:05.563 INFO:teuthology.orchestra.run.smithi022.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T09:27:05.563 INFO:teuthology.orchestra.run.smithi022.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T09:27:05.563 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T09:27:05.564 INFO:teuthology.orchestra.run.smithi022.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T09:27:05.564 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T09:27:05.564 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T09:27:05.564 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T09:27:05.564 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T09:27:05.564 INFO:teuthology.orchestra.run.smithi022.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T09:27:05.564 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:27:05.564 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:27:05.564 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:27:05.564 INFO:teuthology.orchestra.run.smithi022.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T09:27:05.564 INFO:teuthology.orchestra.run.smithi022.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T09:27:05.564 INFO:teuthology.orchestra.run.smithi022.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T09:27:05.565 INFO:teuthology.orchestra.run.smithi022.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T09:27:05.565 INFO:teuthology.orchestra.run.smithi022.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T09:27:05.565 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T09:27:05.565 INFO:teuthology.orchestra.run.smithi022.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T09:27:05.565 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T09:27:05.565 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-09-19T09:27:06.142 DEBUG:teuthology.parallel:result is None 2024-09-19T09:27:06.143 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:27:06.287 DEBUG:teuthology.orchestra.run.smithi001:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T09:27:06.316 INFO:teuthology.orchestra.run.smithi001.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T09:27:06.316 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T09:27:06.316 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T09:27:06.318 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:27:06.464 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T09:27:06.487 INFO:teuthology.orchestra.run.smithi022.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T09:27:06.487 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T09:27:06.487 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T09:27:06.489 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:27:06.635 DEBUG:teuthology.orchestra.run.smithi121:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T09:27:06.662 INFO:teuthology.orchestra.run.smithi121.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T09:27:06.662 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T09:27:06.662 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T09:27:06.664 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T09:27:06.664 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T09:27:06.664 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T09:27:06.698 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-19T09:27:06.698 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T09:27:06.729 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-19T09:27:06.730 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T09:27:06.761 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T09:27:06.762 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T09:27:06.762 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T09:27:06.793 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T09:27:06.863 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-19T09:27:06.863 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T09:27:06.889 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T09:27:06.955 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-19T09:27:06.956 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T09:27:06.986 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T09:27:07.056 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T09:27:07.056 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T09:27:07.056 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T09:27:07.088 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T09:27:07.159 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-19T09:27:07.159 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T09:27:07.186 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T09:27:07.252 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-19T09:27:07.253 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T09:27:07.282 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T09:27:07.351 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T09:27:07.351 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T09:27:07.352 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T09:27:07.378 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T09:27:07.444 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-19T09:27:07.445 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T09:27:07.471 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T09:27:07.538 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-19T09:27:07.538 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T09:27:07.570 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T09:27:07.639 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-19T09:27:07.735 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 1, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd heartbeat grace': 60, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request', 'SLOW_OPS', 'slow request'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-19T09:27:07.735 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:27:07.736 INFO:tasks.cephadm:Cluster fsid is 57238232-7669-11ef-bceb-c7b262605968 2024-09-19T09:27:07.736 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-19T09:27:07.736 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.1', 'mon.b': '172.21.15.22', 'mon.c': '172.21.15.121'} 2024-09-19T09:27:07.736 INFO:tasks.cephadm:First mon is mon.a on smithi001 2024-09-19T09:27:07.737 INFO:tasks.cephadm:First mgr is x 2024-09-19T09:27:07.737 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-19T09:27:07.737 DEBUG:teuthology.orchestra.run.smithi001:> sudo hostname $(hostname -s) 2024-09-19T09:27:07.764 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname $(hostname -s) 2024-09-19T09:27:07.798 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname $(hostname -s) 2024-09-19T09:27:07.828 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-19T09:27:07.829 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:27:07.973 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56106/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-361-g2f599a46', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-361.g2f599a46'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-18 17:52:24.287651', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-19T09:27:08.112 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 2f599a46ad10e37c929e5c43da2f6907ddcd1961 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:27:08.113 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T09:27:08.113 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T09:27:08.114 DEBUG:teuthology.orchestra.run.smithi001:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T09:27:08.500 INFO:teuthology.orchestra.run.smithi001.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 09:27 /home/ubuntu/cephtest/cephadm 2024-09-19T09:27:08.500 DEBUG:teuthology.orchestra.run.smithi022:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T09:27:08.893 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 09:27 /home/ubuntu/cephtest/cephadm 2024-09-19T09:27:08.893 DEBUG:teuthology.orchestra.run.smithi121:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T09:27:09.262 INFO:teuthology.orchestra.run.smithi121.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 09:27 /home/ubuntu/cephtest/cephadm 2024-09-19T09:27:09.262 DEBUG:teuthology.orchestra.run.smithi001:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T09:27:09.284 DEBUG:teuthology.orchestra.run.smithi022:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T09:27:09.303 DEBUG:teuthology.orchestra.run.smithi121:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T09:27:09.705 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 on all hosts... 2024-09-19T09:27:09.705 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T09:27:09.708 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T09:27:09.710 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T09:27:11.242 INFO:teuthology.orchestra.run.smithi022.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T09:27:11.249 INFO:teuthology.orchestra.run.smithi001.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T09:27:11.362 INFO:teuthology.orchestra.run.smithi121.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T09:27:42.499 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-19T09:27:42.499 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T09:27:42.499 INFO:teuthology.orchestra.run.smithi121.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T09:27:42.499 INFO:teuthology.orchestra.run.smithi121.stdout: "repo_digests": [ 2024-09-19T09:27:42.499 INFO:teuthology.orchestra.run.smithi121.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T09:27:42.499 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-19T09:27:42.499 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-19T09:27:48.296 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:27:48.296 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T09:27:48.296 INFO:teuthology.orchestra.run.smithi001.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T09:27:48.296 INFO:teuthology.orchestra.run.smithi001.stdout: "repo_digests": [ 2024-09-19T09:27:48.296 INFO:teuthology.orchestra.run.smithi001.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T09:27:48.296 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-19T09:27:48.296 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:28:08.643 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-19T09:28:08.643 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T09:28:08.643 INFO:teuthology.orchestra.run.smithi022.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T09:28:08.643 INFO:teuthology.orchestra.run.smithi022.stdout: "repo_digests": [ 2024-09-19T09:28:08.643 INFO:teuthology.orchestra.run.smithi022.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T09:28:08.643 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-19T09:28:08.644 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-19T09:28:08.669 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /etc/ceph 2024-09-19T09:28:08.704 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /etc/ceph 2024-09-19T09:28:08.732 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /etc/ceph 2024-09-19T09:28:08.765 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 777 /etc/ceph 2024-09-19T09:28:08.796 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 777 /etc/ceph 2024-09-19T09:28:08.821 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 777 /etc/ceph 2024-09-19T09:28:08.851 INFO:tasks.cephadm:Writing seed config... 2024-09-19T09:28:08.852 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-19T09:28:08.852 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-19T09:28:08.852 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-19T09:28:08.852 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-19T09:28:08.852 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-19T09:28:08.853 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-19T09:28:08.853 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-19T09:28:08.853 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-19T09:28:08.853 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-19T09:28:08.853 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-19T09:28:08.853 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-19T09:28:08.853 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-19T09:28:08.853 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-19T09:28:08.853 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-19T09:28:08.854 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-19T09:28:08.854 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-19T09:28:08.854 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-19T09:28:08.854 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-19T09:28:08.854 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-19T09:28:08.854 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-19T09:28:08.854 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-19T09:28:08.854 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-19T09:28:08.854 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-19T09:28:08.854 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-19T09:28:08.854 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-19T09:28:08.854 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-19T09:28:08.854 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-19T09:28:08.854 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-19T09:28:08.854 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-19T09:28:08.855 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-19T09:28:08.855 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-19T09:28:08.855 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-19T09:28:08.855 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-19T09:28:08.855 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-19T09:28:08.855 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-19T09:28:08.855 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-19T09:28:08.855 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-19T09:28:08.855 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-19T09:28:08.855 INFO:tasks.cephadm: override: [osd] filestore flush min = 0 2024-09-19T09:28:08.855 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-19T09:28:08.856 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-19T09:28:08.856 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-19T09:28:08.856 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-19T09:28:08.856 INFO:tasks.cephadm: override: [osd] osd heartbeat grace = 60 2024-09-19T09:28:08.856 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-19T09:28:08.856 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-19T09:28:08.856 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-19T09:28:08.856 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-19T09:28:08.857 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T09:28:08.857 DEBUG:teuthology.orchestra.run.smithi001:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-19T09:28:08.876 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 57238232-7669-11ef-bceb-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 filestore flush min = 0 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd heartbeat grace = 60 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-19T09:28:08.877 DEBUG:teuthology.orchestra.run.smithi001:mon.a> sudo journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mon.a.service 2024-09-19T09:28:08.919 DEBUG:teuthology.orchestra.run.smithi001:mgr.x> sudo journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mgr.x.service 2024-09-19T09:28:08.963 INFO:tasks.cephadm:Bootstrapping... 2024-09-19T09:28:08.963 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 -v bootstrap --fsid 57238232-7669-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.1 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:28:09.177 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:28:09.177 INFO:teuthology.orchestra.run.smithi001.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961', '-v', 'bootstrap', '--fsid', '57238232-7669-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.1', '--skip-admin-label'] 2024-09-19T09:28:09.178 INFO:teuthology.orchestra.run.smithi001.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-19T09:28:09.178 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying podman|docker is present... 2024-09-19T09:28:09.202 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stdout 5.2.2 2024-09-19T09:28:09.202 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying lvm2 is present... 2024-09-19T09:28:09.202 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying time synchronization is in place... 2024-09-19T09:28:09.210 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T09:28:09.210 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T09:28:09.216 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T09:28:09.216 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-19T09:28:09.223 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout enabled 2024-09-19T09:28:09.230 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout active 2024-09-19T09:28:09.230 INFO:teuthology.orchestra.run.smithi001.stdout:Unit chronyd.service is enabled and running 2024-09-19T09:28:09.230 INFO:teuthology.orchestra.run.smithi001.stdout:Repeating the final host check... 2024-09-19T09:28:09.252 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stdout 5.2.2 2024-09-19T09:28:09.252 INFO:teuthology.orchestra.run.smithi001.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-19T09:28:09.252 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl is present 2024-09-19T09:28:09.253 INFO:teuthology.orchestra.run.smithi001.stdout:lvcreate is present 2024-09-19T09:28:09.259 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T09:28:09.259 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T09:28:09.266 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T09:28:09.266 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-19T09:28:09.272 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout enabled 2024-09-19T09:28:09.279 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout active 2024-09-19T09:28:09.279 INFO:teuthology.orchestra.run.smithi001.stdout:Unit chronyd.service is enabled and running 2024-09-19T09:28:09.279 INFO:teuthology.orchestra.run.smithi001.stdout:Host looks OK 2024-09-19T09:28:09.280 INFO:teuthology.orchestra.run.smithi001.stdout:Cluster fsid: 57238232-7669-11ef-bceb-c7b262605968 2024-09-19T09:28:09.280 INFO:teuthology.orchestra.run.smithi001.stdout:Acquiring lock 140060307682304 on /run/cephadm/57238232-7669-11ef-bceb-c7b262605968.lock 2024-09-19T09:28:09.280 INFO:teuthology.orchestra.run.smithi001.stdout:Lock 140060307682304 acquired on /run/cephadm/57238232-7669-11ef-bceb-c7b262605968.lock 2024-09-19T09:28:09.280 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying IP 172.21.15.1 port 3300 ... 2024-09-19T09:28:09.280 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying IP 172.21.15.1 port 6789 ... 2024-09-19T09:28:09.280 INFO:teuthology.orchestra.run.smithi001.stdout:Base mon IP(s) is [172.21.15.1:3300, 172.21.15.1:6789], mon addrv is [v2:172.21.15.1:3300,v1:172.21.15.1:6789] 2024-09-19T09:28:09.284 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.1 metric 100 2024-09-19T09:28:09.284 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.1 metric 100 2024-09-19T09:28:09.286 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-19T09:28:09.287 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-19T09:28:09.287 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1798sec hoplimit 64 pref medium 2024-09-19T09:28:09.289 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-19T09:28:09.289 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-19T09:28:09.289 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T09:28:09.289 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-19T09:28:09.289 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15e8/64 scope link 2024-09-19T09:28:09.289 INFO:teuthology.orchestra.run.smithi001.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T09:28:09.290 INFO:teuthology.orchestra.run.smithi001.stdout:Mon IP `172.21.15.1` is in CIDR network `172.21.0.0/20` 2024-09-19T09:28:09.290 INFO:teuthology.orchestra.run.smithi001.stdout:Mon IP `172.21.15.1` is in CIDR network `172.21.0.0/20` 2024-09-19T09:28:09.290 INFO:teuthology.orchestra.run.smithi001.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-19T09:28:09.290 INFO:teuthology.orchestra.run.smithi001.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-19T09:28:09.291 INFO:teuthology.orchestra.run.smithi001.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T09:28:09.763 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stdout d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T09:28:09.763 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T09:28:09.763 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Getting image source signatures 2024-09-19T09:28:09.763 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-19T09:28:09.763 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Copying blob sha256:c4221751d16d26d2a4b7031ebd71ecffffff13c8cf7401cf95ce80dab3b6d67a 2024-09-19T09:28:09.763 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Copying config sha256:d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T09:28:09.763 INFO:teuthology.orchestra.run.smithi001.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-19T09:28:10.626 INFO:teuthology.orchestra.run.smithi001.stdout:ceph: stdout ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T09:28:10.626 INFO:teuthology.orchestra.run.smithi001.stdout:Ceph version: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T09:28:10.626 INFO:teuthology.orchestra.run.smithi001.stdout:Extracting ceph user uid/gid from container image... 2024-09-19T09:28:16.277 INFO:teuthology.orchestra.run.smithi001.stdout:stat: stdout 167 167 2024-09-19T09:28:16.277 INFO:teuthology.orchestra.run.smithi001.stdout:Creating initial keys... 2024-09-19T09:28:22.291 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph-authtool: stdout AQCz7utmHqHmARAAxYM4j83YG+j/z42WN/8TNw== 2024-09-19T09:28:23.205 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph-authtool: stdout AQC27utmegRGIxAAQbuAT2ExNZDMPOqyX14ofg== 2024-09-19T09:28:24.353 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph-authtool: stdout AQC37utm04uVMBAARET7fI9sI9gEk1CFV1yyXQ== 2024-09-19T09:28:24.353 INFO:teuthology.orchestra.run.smithi001.stdout:Creating initial monmap... 2024-09-19T09:28:25.235 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T09:28:25.235 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-19T09:28:25.235 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 57238232-7669-11ef-bceb-c7b262605968 2024-09-19T09:28:25.235 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T09:28:25.235 INFO:teuthology.orchestra.run.smithi001.stdout:monmaptool for a [v2:172.21.15.1:3300,v1:172.21.15.1:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T09:28:25.235 INFO:teuthology.orchestra.run.smithi001.stdout:setting min_mon_release = quincy 2024-09-19T09:28:25.236 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: set fsid to 57238232-7669-11ef-bceb-c7b262605968 2024-09-19T09:28:25.236 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T09:28:25.236 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:28:25.236 INFO:teuthology.orchestra.run.smithi001.stdout:Creating mon... 2024-09-19T09:28:26.118 INFO:teuthology.orchestra.run.smithi001.stdout:create mon.a on 2024-09-19T09:28:26.419 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-19T09:28:26.573 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-19T09:28:26.753 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-57238232-7669-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-57238232-7669-11ef-bceb-c7b262605968.target. 2024-09-19T09:28:26.753 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-57238232-7669-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-57238232-7669-11ef-bceb-c7b262605968.target. 2024-09-19T09:28:26.995 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-57238232-7669-11ef-bceb-c7b262605968@mon.a 2024-09-19T09:28:26.995 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Failed to reset failed state of unit ceph-57238232-7669-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-57238232-7669-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-19T09:28:27.201 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-57238232-7669-11ef-bceb-c7b262605968.target.wants/ceph-57238232-7669-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-57238232-7669-11ef-bceb-c7b262605968@.service. 2024-09-19T09:28:27.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:27 smithi001 podman[30835]: 2024-09-19 09:28:27.457336377 +0000 UTC m=+0.114737541 container create f1173ba9f36f00c612faa3cf2c2010dce52379fcc59885b167c98dc8e9c3f35b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:28:28.463 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T09:28:28.463 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout disabled 2024-09-19T09:28:28.470 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T09:28:28.470 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-19T09:28:28.471 INFO:teuthology.orchestra.run.smithi001.stdout:firewalld.service is not enabled 2024-09-19T09:28:28.471 INFO:teuthology.orchestra.run.smithi001.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T09:28:28.471 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mon to start... 2024-09-19T09:28:28.471 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mon... 2024-09-19T09:28:28.591 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:28 smithi001 podman[30835]: 2024-09-19 09:28:28.364444298 +0000 UTC m=+1.021845464 container init f1173ba9f36f00c612faa3cf2c2010dce52379fcc59885b167c98dc8e9c3f35b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T09:28:28.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:28 smithi001 podman[30835]: 2024-09-19 09:28:28.368000286 +0000 UTC m=+1.025401442 container start f1173ba9f36f00c612faa3cf2c2010dce52379fcc59885b167c98dc8e9c3f35b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mon-a, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-19T09:28:28.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:28 smithi001 ceph-mon[30855]: mkfs 57238232-7669-11ef-bceb-c7b262605968 2024-09-19T09:28:28.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:28 smithi001 ceph-mon[30855]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T09:28:28.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:28 smithi001 bash[30835]: f1173ba9f36f00c612faa3cf2c2010dce52379fcc59885b167c98dc8e9c3f35b 2024-09-19T09:28:28.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:28 smithi001 systemd[1]: Started Ceph mon.a for 57238232-7669-11ef-bceb-c7b262605968. 2024-09-19T09:28:29.489 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:29 smithi001 ceph-mon[30855]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T09:28:29.489 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:29 smithi001 ceph-mon[30855]: monmap epoch 1 2024-09-19T09:28:29.489 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:29 smithi001 ceph-mon[30855]: fsid 57238232-7669-11ef-bceb-c7b262605968 2024-09-19T09:28:29.489 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:29 smithi001 ceph-mon[30855]: last_changed 2024-09-19T09:28:24.634348+0000 2024-09-19T09:28:29.489 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:29 smithi001 ceph-mon[30855]: created 2024-09-19T09:28:24.634348+0000 2024-09-19T09:28:29.490 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:29 smithi001 ceph-mon[30855]: min_mon_release 19 (squid) 2024-09-19T09:28:29.490 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:29 smithi001 ceph-mon[30855]: election_strategy: 1 2024-09-19T09:28:29.490 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:29 smithi001 ceph-mon[30855]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-19T09:28:29.490 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:29 smithi001 ceph-mon[30855]: fsmap 2024-09-19T09:28:29.490 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:29 smithi001 ceph-mon[30855]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T09:28:29.490 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:29 smithi001 ceph-mon[30855]: mgrmap e1: no daemons active 2024-09-19T09:28:29.490 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:29 smithi001 ceph-mon[30855]: from='client.? 172.21.15.1:0/551140835' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-19T09:28:29.491 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout cluster: 2024-09-19T09:28:29.498 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout id: 57238232-7669-11ef-bceb-c7b262605968 2024-09-19T09:28:29.498 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-19T09:28:29.498 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T09:28:29.498 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout services: 2024-09-19T09:28:29.498 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.523721s) 2024-09-19T09:28:29.498 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-19T09:28:29.499 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-19T09:28:29.499 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T09:28:29.499 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout data: 2024-09-19T09:28:29.499 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-19T09:28:29.499 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-19T09:28:29.499 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-19T09:28:29.499 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout pgs: 2024-09-19T09:28:29.499 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T09:28:29.499 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.856+0000 7f049e6ae640 1 Processor -- start 2024-09-19T09:28:29.499 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.856+0000 7f049e6ae640 1 -- start start 2024-09-19T09:28:29.499 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.856+0000 7f049e6ae640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0498106580 0x7f0498106980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:29.499 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.856+0000 7f049e6ae640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0498106f50 con 0x7f0498106580 2024-09-19T09:28:29.499 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.857+0000 7f0497fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0498106580 0x7f0498106980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:29.499 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.857+0000 7f0497fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0498106580 0x7f0498106980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51150/0 (socket says 172.21.15.1:51150) 2024-09-19T09:28:29.500 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.857+0000 7f0497fff640 1 -- 172.21.15.1:0/2232329673 learned_addr learned my addr 172.21.15.1:0/2232329673 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:28:29.500 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.857+0000 7f0497fff640 1 -- 172.21.15.1:0/2232329673 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0498107780 con 0x7f0498106580 2024-09-19T09:28:29.500 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.859+0000 7f0497fff640 1 --2- 172.21.15.1:0/2232329673 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0498106580 0x7f0498106980 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0488009820 tx=0x7f048802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf62f4d0560e039 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:29.500 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.859+0000 7f0496ffd640 1 -- 172.21.15.1:0/2232329673 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0488037070 con 0x7f0498106580 2024-09-19T09:28:29.500 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.859+0000 7f0496ffd640 1 -- 172.21.15.1:0/2232329673 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0488032440 con 0x7f0498106580 2024-09-19T09:28:29.500 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.859+0000 7f0496ffd640 1 -- 172.21.15.1:0/2232329673 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0488032740 con 0x7f0498106580 2024-09-19T09:28:29.500 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.860+0000 7f049e6ae640 1 -- 172.21.15.1:0/2232329673 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0498106580 msgr2=0x7f0498106980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:29.500 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.860+0000 7f049e6ae640 1 --2- 172.21.15.1:0/2232329673 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0498106580 0x7f0498106980 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0488009820 tx=0x7f048802a270 comp rx=0 tx=0).stop 2024-09-19T09:28:29.500 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.860+0000 7f049e6ae640 1 -- 172.21.15.1:0/2232329673 shutdown_connections 2024-09-19T09:28:29.500 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.860+0000 7f049e6ae640 1 --2- 172.21.15.1:0/2232329673 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0498106580 0x7f0498106980 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:29.500 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.860+0000 7f049e6ae640 1 -- 172.21.15.1:0/2232329673 >> 172.21.15.1:0/2232329673 conn(0x7f0498101d30 msgr2=0x7f0498104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:29.500 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.860+0000 7f049e6ae640 1 -- 172.21.15.1:0/2232329673 shutdown_connections 2024-09-19T09:28:29.501 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.860+0000 7f049e6ae640 1 -- 172.21.15.1:0/2232329673 wait complete. 2024-09-19T09:28:29.501 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.861+0000 7f049e6ae640 1 Processor -- start 2024-09-19T09:28:29.501 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.861+0000 7f049e6ae640 1 -- start start 2024-09-19T09:28:29.501 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.861+0000 7f049e6ae640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0498106580 0x7f049807ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:29.501 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.861+0000 7f049e6ae640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0498107d20 con 0x7f0498106580 2024-09-19T09:28:29.501 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.861+0000 7f0497fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0498106580 0x7f049807ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:29.501 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.861+0000 7f0497fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0498106580 0x7f049807ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51166/0 (socket says 172.21.15.1:51166) 2024-09-19T09:28:29.501 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.861+0000 7f0497fff640 1 -- 172.21.15.1:0/551140835 learned_addr learned my addr 172.21.15.1:0/551140835 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:28:29.501 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.862+0000 7f0497fff640 1 -- 172.21.15.1:0/551140835 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f049819db80 con 0x7f0498106580 2024-09-19T09:28:29.501 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.862+0000 7f0497fff640 1 --2- 172.21.15.1:0/551140835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0498106580 0x7f049807ba70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f04880090b0 tx=0x7f04880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:29.501 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.862+0000 7f04957fa640 1 -- 172.21.15.1:0/551140835 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0488041070 con 0x7f0498106580 2024-09-19T09:28:29.501 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.862+0000 7f04957fa640 1 -- 172.21.15.1:0/551140835 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f048803c7a0 con 0x7f0498106580 2024-09-19T09:28:29.501 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.862+0000 7f049e6ae640 1 -- 172.21.15.1:0/551140835 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f049819dd50 con 0x7f0498106580 2024-09-19T09:28:29.501 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.862+0000 7f04957fa640 1 -- 172.21.15.1:0/551140835 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0488037040 con 0x7f0498106580 2024-09-19T09:28:29.502 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.862+0000 7f049e6ae640 1 -- 172.21.15.1:0/551140835 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f049819e170 con 0x7f0498106580 2024-09-19T09:28:29.502 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.862+0000 7f04957fa640 1 -- 172.21.15.1:0/551140835 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0488044070 con 0x7f0498106580 2024-09-19T09:28:29.502 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.862+0000 7f04957fa640 1 -- 172.21.15.1:0/551140835 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f048803d730 con 0x7f0498106580 2024-09-19T09:28:29.502 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.863+0000 7f049e6ae640 1 -- 172.21.15.1:0/551140835 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0498108370 con 0x7f0498106580 2024-09-19T09:28:29.502 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.866+0000 7f04957fa640 1 -- 172.21.15.1:0/551140835 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f048803cbe0 con 0x7f0498106580 2024-09-19T09:28:29.502 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.928+0000 7f049e6ae640 1 -- 172.21.15.1:0/551140835 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f049819e8d0 con 0x7f0498106580 2024-09-19T09:28:29.502 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.928+0000 7f04957fa640 1 -- 172.21.15.1:0/551140835 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f048803cdc0 con 0x7f0498106580 2024-09-19T09:28:29.502 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.929+0000 7f049e6ae640 1 -- 172.21.15.1:0/551140835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0498106580 msgr2=0x7f049807ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:29.502 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.929+0000 7f049e6ae640 1 --2- 172.21.15.1:0/551140835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0498106580 0x7f049807ba70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f04880090b0 tx=0x7f04880046c0 comp rx=0 tx=0).stop 2024-09-19T09:28:29.502 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.929+0000 7f049e6ae640 1 -- 172.21.15.1:0/551140835 shutdown_connections 2024-09-19T09:28:29.502 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.929+0000 7f049e6ae640 1 --2- 172.21.15.1:0/551140835 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0498106580 0x7f049807ba70 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:29.502 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.929+0000 7f049e6ae640 1 -- 172.21.15.1:0/551140835 >> 172.21.15.1:0/551140835 conn(0x7f0498101d30 msgr2=0x7f049818df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:29.502 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.929+0000 7f049e6ae640 1 -- 172.21.15.1:0/551140835 shutdown_connections 2024-09-19T09:28:29.503 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:28.929+0000 7f049e6ae640 1 -- 172.21.15.1:0/551140835 wait complete. 2024-09-19T09:28:29.503 INFO:teuthology.orchestra.run.smithi001.stdout:mon is available 2024-09-19T09:28:29.503 INFO:teuthology.orchestra.run.smithi001.stdout:Assimilating anything we can from ceph.conf... 2024-09-19T09:28:30.538 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T09:28:30.538 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T09:28:30.538 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout fsid = 57238232-7669-11ef-bceb-c7b262605968 2024-09-19T09:28:30.539 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.1:3300,v1:172.21.15.1:6789] 2024-09-19T09:28:30.539 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T09:28:30.539 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T09:28:30.539 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T09:28:30.539 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T09:28:30.539 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T09:28:30.539 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T09:28:30.539 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T09:28:30.539 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T09:28:30.539 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T09:28:30.540 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout filestore_flush_min = 0 2024-09-19T09:28:30.540 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T09:28:30.540 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T09:28:30.540 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T09:28:30.540 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T09:28:30.540 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T09:28:30.540 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.889+0000 7f0459ab8640 1 Processor -- start 2024-09-19T09:28:30.540 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.889+0000 7f0459ab8640 1 -- start start 2024-09-19T09:28:30.540 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.890+0000 7f0459ab8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04541081f0 0x7f045410a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:30.540 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.890+0000 7f0459ab8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f045407bdb0 con 0x7f04541081f0 2024-09-19T09:28:30.541 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.890+0000 7f04537fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04541081f0 0x7f045410a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:30.541 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.890+0000 7f04537fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04541081f0 0x7f045410a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51176/0 (socket says 172.21.15.1:51176) 2024-09-19T09:28:30.541 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.890+0000 7f04537fe640 1 -- 172.21.15.1:0/2226376766 learned_addr learned my addr 172.21.15.1:0/2226376766 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:28:30.541 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.890+0000 7f04537fe640 1 -- 172.21.15.1:0/2226376766 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f045410ab20 con 0x7f04541081f0 2024-09-19T09:28:30.541 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.891+0000 7f04537fe640 1 --2- 172.21.15.1:0/2226376766 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04541081f0 0x7f045410a5e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0444009820 tx=0x7f044402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9d58f740052bae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:30.541 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.891+0000 7f04527fc640 1 -- 172.21.15.1:0/2226376766 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0444037070 con 0x7f04541081f0 2024-09-19T09:28:30.541 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.891+0000 7f04527fc640 1 -- 172.21.15.1:0/2226376766 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0444032440 con 0x7f04541081f0 2024-09-19T09:28:30.541 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.891+0000 7f04527fc640 1 -- 172.21.15.1:0/2226376766 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0444032740 con 0x7f04541081f0 2024-09-19T09:28:30.541 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.892+0000 7f0459ab8640 1 -- 172.21.15.1:0/2226376766 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04541081f0 msgr2=0x7f045410a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:30.542 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.892+0000 7f0459ab8640 1 --2- 172.21.15.1:0/2226376766 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04541081f0 0x7f045410a5e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0444009820 tx=0x7f044402a270 comp rx=0 tx=0).stop 2024-09-19T09:28:30.542 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.892+0000 7f0459ab8640 1 -- 172.21.15.1:0/2226376766 shutdown_connections 2024-09-19T09:28:30.542 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.892+0000 7f0459ab8640 1 --2- 172.21.15.1:0/2226376766 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04541081f0 0x7f045410a5e0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.542 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.892+0000 7f0459ab8640 1 -- 172.21.15.1:0/2226376766 >> 172.21.15.1:0/2226376766 conn(0x7f0454101d50 msgr2=0x7f0454104170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:30.542 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.892+0000 7f0459ab8640 1 -- 172.21.15.1:0/2226376766 shutdown_connections 2024-09-19T09:28:30.542 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.892+0000 7f0459ab8640 1 -- 172.21.15.1:0/2226376766 wait complete. 2024-09-19T09:28:30.542 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.892+0000 7f0459ab8640 1 Processor -- start 2024-09-19T09:28:30.542 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.893+0000 7f0459ab8640 1 -- start start 2024-09-19T09:28:30.542 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.893+0000 7f0459ab8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04541081f0 0x7f045419ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:30.543 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.893+0000 7f0459ab8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f045410af30 con 0x7f04541081f0 2024-09-19T09:28:30.543 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.893+0000 7f04537fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04541081f0 0x7f045419ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:30.543 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.893+0000 7f04537fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04541081f0 0x7f045419ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51186/0 (socket says 172.21.15.1:51186) 2024-09-19T09:28:30.543 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.893+0000 7f04537fe640 1 -- 172.21.15.1:0/192748369 learned_addr learned my addr 172.21.15.1:0/192748369 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:28:30.543 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.893+0000 7f04537fe640 1 -- 172.21.15.1:0/192748369 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f045419b3b0 con 0x7f04541081f0 2024-09-19T09:28:30.543 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.893+0000 7f04537fe640 1 --2- 172.21.15.1:0/192748369 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04541081f0 0x7f045419ae70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f04440090b0 tx=0x7f04440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:30.543 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.894+0000 7f0450ff9640 1 -- 172.21.15.1:0/192748369 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0444041070 con 0x7f04541081f0 2024-09-19T09:28:30.543 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.894+0000 7f0450ff9640 1 -- 172.21.15.1:0/192748369 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f044403c7a0 con 0x7f04541081f0 2024-09-19T09:28:30.543 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.894+0000 7f0459ab8640 1 -- 172.21.15.1:0/192748369 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f045419b640 con 0x7f04541081f0 2024-09-19T09:28:30.543 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.894+0000 7f0450ff9640 1 -- 172.21.15.1:0/192748369 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0444037040 con 0x7f04541081f0 2024-09-19T09:28:30.543 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.894+0000 7f0459ab8640 1 -- 172.21.15.1:0/192748369 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f045419e330 con 0x7f04541081f0 2024-09-19T09:28:30.543 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.894+0000 7f0450ff9640 1 -- 172.21.15.1:0/192748369 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0444044070 con 0x7f04541081f0 2024-09-19T09:28:30.543 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.894+0000 7f0450ff9640 1 -- 172.21.15.1:0/192748369 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f044403d3f0 con 0x7f04541081f0 2024-09-19T09:28:30.544 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.895+0000 7f0459ab8640 1 -- 172.21.15.1:0/192748369 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0454108650 con 0x7f04541081f0 2024-09-19T09:28:30.544 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.897+0000 7f0450ff9640 1 -- 172.21.15.1:0/192748369 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f0444046450 con 0x7f04541081f0 2024-09-19T09:28:30.544 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.957+0000 7f0459ab8640 1 -- 172.21.15.1:0/192748369 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f045402d910 con 0x7f04541081f0 2024-09-19T09:28:30.544 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.960+0000 7f0450ff9640 1 -- 172.21.15.1:0/192748369 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+452 (secure 0 0 0) 0x7f0444046630 con 0x7f04541081f0 2024-09-19T09:28:30.544 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.960+0000 7f0450ff9640 1 -- 172.21.15.1:0/192748369 <== mon.0 v2:172.21.15.1:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0444056070 con 0x7f04541081f0 2024-09-19T09:28:30.544 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.961+0000 7f0459ab8640 1 -- 172.21.15.1:0/192748369 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04541081f0 msgr2=0x7f045419ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:30.544 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.961+0000 7f0459ab8640 1 --2- 172.21.15.1:0/192748369 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04541081f0 0x7f045419ae70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f04440090b0 tx=0x7f04440046c0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.544 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.961+0000 7f0459ab8640 1 -- 172.21.15.1:0/192748369 shutdown_connections 2024-09-19T09:28:30.544 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.961+0000 7f0459ab8640 1 --2- 172.21.15.1:0/192748369 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f04541081f0 0x7f045419ae70 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:30.544 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.961+0000 7f0459ab8640 1 -- 172.21.15.1:0/192748369 >> 172.21.15.1:0/192748369 conn(0x7f0454101d50 msgr2=0x7f0454102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:30.544 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.961+0000 7f0459ab8640 1 -- 172.21.15.1:0/192748369 shutdown_connections 2024-09-19T09:28:30.544 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:29.961+0000 7f0459ab8640 1 -- 172.21.15.1:0/192748369 wait complete. 2024-09-19T09:28:30.544 INFO:teuthology.orchestra.run.smithi001.stdout:Generating new minimal ceph.conf... 2024-09-19T09:28:30.679 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:30 smithi001 ceph-mon[30855]: from='client.? 172.21.15.1:0/192748369' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T09:28:30.680 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:30 smithi001 ceph-mon[30855]: from='client.? 172.21.15.1:0/192748369' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-19T09:28:31.583 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.979+0000 7f769011d640 1 Processor -- start 2024-09-19T09:28:31.583 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.980+0000 7f769011d640 1 -- start start 2024-09-19T09:28:31.583 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.980+0000 7f769011d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7688107680 0x7f7688107a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:31.583 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.980+0000 7f769011d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7688108050 con 0x7f7688107680 2024-09-19T09:28:31.583 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.980+0000 7f768deb9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7688107680 0x7f7688107a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:31.583 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.980+0000 7f768deb9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7688107680 0x7f7688107a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51194/0 (socket says 172.21.15.1:51194) 2024-09-19T09:28:31.584 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.980+0000 7f768deb9640 1 -- 172.21.15.1:0/4150716331 learned_addr learned my addr 172.21.15.1:0/4150716331 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:28:31.584 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.980+0000 7f768deb9640 1 -- 172.21.15.1:0/4150716331 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7688108880 con 0x7f7688107680 2024-09-19T09:28:31.584 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.981+0000 7f768deb9640 1 --2- 172.21.15.1:0/4150716331 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7688107680 0x7f7688107a80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7684009820 tx=0x7f768402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e0624d472a67eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:31.584 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.981+0000 7f768ceb7640 1 -- 172.21.15.1:0/4150716331 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7684037070 con 0x7f7688107680 2024-09-19T09:28:31.584 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.981+0000 7f768ceb7640 1 -- 172.21.15.1:0/4150716331 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7684032900 con 0x7f7688107680 2024-09-19T09:28:31.584 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.981+0000 7f768ceb7640 1 -- 172.21.15.1:0/4150716331 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7684030850 con 0x7f7688107680 2024-09-19T09:28:31.584 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.982+0000 7f769011d640 1 -- 172.21.15.1:0/4150716331 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7688107680 msgr2=0x7f7688107a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:31.584 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.982+0000 7f769011d640 1 --2- 172.21.15.1:0/4150716331 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7688107680 0x7f7688107a80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7684009820 tx=0x7f768402a270 comp rx=0 tx=0).stop 2024-09-19T09:28:31.584 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.982+0000 7f769011d640 1 -- 172.21.15.1:0/4150716331 shutdown_connections 2024-09-19T09:28:31.584 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.982+0000 7f769011d640 1 --2- 172.21.15.1:0/4150716331 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7688107680 0x7f7688107a80 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:31.584 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.982+0000 7f769011d640 1 -- 172.21.15.1:0/4150716331 >> 172.21.15.1:0/4150716331 conn(0x7f7688102e50 msgr2=0x7f7688105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:31.584 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.982+0000 7f769011d640 1 -- 172.21.15.1:0/4150716331 shutdown_connections 2024-09-19T09:28:31.584 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.982+0000 7f769011d640 1 -- 172.21.15.1:0/4150716331 wait complete. 2024-09-19T09:28:31.585 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.983+0000 7f769011d640 1 Processor -- start 2024-09-19T09:28:31.585 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.983+0000 7f769011d640 1 -- start start 2024-09-19T09:28:31.585 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.983+0000 7f769011d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7688107680 0x7f768819b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:31.585 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.983+0000 7f769011d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f768810bc30 con 0x7f7688107680 2024-09-19T09:28:31.585 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.983+0000 7f768deb9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7688107680 0x7f768819b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:31.585 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.983+0000 7f768deb9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7688107680 0x7f768819b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51204/0 (socket says 172.21.15.1:51204) 2024-09-19T09:28:31.585 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.983+0000 7f768deb9640 1 -- 172.21.15.1:0/3442459024 learned_addr learned my addr 172.21.15.1:0/3442459024 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:28:31.585 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.983+0000 7f768deb9640 1 -- 172.21.15.1:0/3442459024 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f768819bbf0 con 0x7f7688107680 2024-09-19T09:28:31.585 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.983+0000 7f768deb9640 1 --2- 172.21.15.1:0/3442459024 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7688107680 0x7f768819b6b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7684009940 tx=0x7f7684032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:31.585 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.984+0000 7f767effd640 1 -- 172.21.15.1:0/3442459024 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7684042070 con 0x7f7688107680 2024-09-19T09:28:31.585 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.984+0000 7f767effd640 1 -- 172.21.15.1:0/3442459024 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f76840308c0 con 0x7f7688107680 2024-09-19T09:28:31.585 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.984+0000 7f769011d640 1 -- 172.21.15.1:0/3442459024 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f768819be80 con 0x7f7688107680 2024-09-19T09:28:31.585 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.984+0000 7f767effd640 1 -- 172.21.15.1:0/3442459024 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7684037040 con 0x7f7688107680 2024-09-19T09:28:31.585 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.984+0000 7f769011d640 1 -- 172.21.15.1:0/3442459024 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f768819eb70 con 0x7f7688107680 2024-09-19T09:28:31.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.984+0000 7f767effd640 1 -- 172.21.15.1:0/3442459024 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7684045070 con 0x7f7688107680 2024-09-19T09:28:31.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.984+0000 7f767effd640 1 -- 172.21.15.1:0/3442459024 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7684047b70 con 0x7f7688107680 2024-09-19T09:28:31.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.985+0000 7f769011d640 1 -- 172.21.15.1:0/3442459024 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f768810bdb0 con 0x7f7688107680 2024-09-19T09:28:31.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:30.987+0000 7f767effd640 1 -- 172.21.15.1:0/3442459024 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f76840327b0 con 0x7f7688107680 2024-09-19T09:28:31.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:31.047+0000 7f769011d640 1 -- 172.21.15.1:0/3442459024 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f768819f050 con 0x7f7688107680 2024-09-19T09:28:31.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:31.047+0000 7f767effd640 1 -- 172.21.15.1:0/3442459024 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+173 (secure 0 0 0) 0x7f768403c760 con 0x7f7688107680 2024-09-19T09:28:31.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:31.048+0000 7f769011d640 1 -- 172.21.15.1:0/3442459024 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7688107680 msgr2=0x7f768819b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:31.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:31.048+0000 7f769011d640 1 --2- 172.21.15.1:0/3442459024 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7688107680 0x7f768819b6b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7684009940 tx=0x7f7684032ce0 comp rx=0 tx=0).stop 2024-09-19T09:28:31.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:31.048+0000 7f769011d640 1 -- 172.21.15.1:0/3442459024 shutdown_connections 2024-09-19T09:28:31.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:31.048+0000 7f769011d640 1 --2- 172.21.15.1:0/3442459024 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7688107680 0x7f768819b6b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:31.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:31.048+0000 7f769011d640 1 -- 172.21.15.1:0/3442459024 >> 172.21.15.1:0/3442459024 conn(0x7f7688102e50 msgr2=0x7f76881039f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:31.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:31.048+0000 7f769011d640 1 -- 172.21.15.1:0/3442459024 shutdown_connections 2024-09-19T09:28:31.586 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:31.048+0000 7f769011d640 1 -- 172.21.15.1:0/3442459024 wait complete. 2024-09-19T09:28:31.586 INFO:teuthology.orchestra.run.smithi001.stdout:Restarting the monitor... 2024-09-19T09:28:31.603 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:31 smithi001 ceph-mon[30855]: from='client.? 172.21.15.1:0/3442459024' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:28:31.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:31 smithi001 systemd[1]: Stopping Ceph mon.a for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:28:31.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:31 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mon-a[30851]: 2024-09-19T09:28:31.844+0000 7fc56716b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:28:31.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:31 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mon-a[30851]: 2024-09-19T09:28:31.844+0000 7fc56716b640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-19T09:28:32.412 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:32 smithi001 podman[31097]: 2024-09-19 09:28:32.101822078 +0000 UTC m=+0.349362483 container died f1173ba9f36f00c612faa3cf2c2010dce52379fcc59885b167c98dc8e9c3f35b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:28:32.412 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:32 smithi001 podman[31097]: 2024-09-19 09:28:32.411999398 +0000 UTC m=+0.659539794 container cleanup f1173ba9f36f00c612faa3cf2c2010dce52379fcc59885b167c98dc8e9c3f35b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T09:28:32.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:32 smithi001 bash[31097]: ceph-57238232-7669-11ef-bceb-c7b262605968-mon-a 2024-09-19T09:28:33.113 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:32 smithi001 podman[31109]: 2024-09-19 09:28:32.779838283 +0000 UTC m=+0.669679832 container remove f1173ba9f36f00c612faa3cf2c2010dce52379fcc59885b167c98dc8e9c3f35b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T09:28:33.113 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:32 smithi001 systemd[1]: ceph-57238232-7669-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-19T09:28:33.113 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:32 smithi001 systemd[1]: Stopped Ceph mon.a for 57238232-7669-11ef-bceb-c7b262605968. 2024-09-19T09:28:33.113 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:32 smithi001 systemd[1]: Starting Ceph mon.a for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:28:33.383 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 podman[31206]: 2024-09-19 09:28:33.015306322 +0000 UTC m=+0.016206095 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:28:33.383 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 podman[31206]: 2024-09-19 09:28:33.130903744 +0000 UTC m=+0.131803508 container create d867c9163aff5076f45b5af8d1207f1ae9b2c6c9c1ffcc023ae0b30e07ed267e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T09:28:33.383 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 podman[31206]: 2024-09-19 09:28:33.357979564 +0000 UTC m=+0.358879328 container init d867c9163aff5076f45b5af8d1207f1ae9b2c6c9c1ffcc023ae0b30e07ed267e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True) 2024-09-19T09:28:33.383 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 podman[31206]: 2024-09-19 09:28:33.361150649 +0000 UTC m=+0.362050413 container start d867c9163aff5076f45b5af8d1207f1ae9b2c6c9c1ffcc023ae0b30e07ed267e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:28:33.438 INFO:teuthology.orchestra.run.smithi001.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-19T09:28:33.656 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T09:28:33.656 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T09:28:33.656 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: pidfile_write: ignore empty --pid-file 2024-09-19T09:28:33.656 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: load: jerasure load: lrc 2024-09-19T09:28:33.656 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: RocksDB version: 7.9.2 2024-09-19T09:28:33.657 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Git sha 0 2024-09-19T09:28:33.657 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T09:28:33.657 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: DB SUMMARY 2024-09-19T09:28:33.657 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: DB Session ID: H8P7J5ATGQQG5W92CCX1 2024-09-19T09:28:33.657 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: CURRENT file: CURRENT 2024-09-19T09:28:33.657 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T09:28:33.657 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-19T09:28:33.657 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-19T09:28:33.657 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105232 ; 2024-09-19T09:28:33.657 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.error_if_exists: 0 2024-09-19T09:28:33.657 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.create_if_missing: 0 2024-09-19T09:28:33.657 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.paranoid_checks: 1 2024-09-19T09:28:33.657 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T09:28:33.657 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T09:28:33.658 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T09:28:33.658 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.env: 0x55af63123940 2024-09-19T09:28:33.658 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T09:28:33.658 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.info_log: 0x55af656a16e0 2024-09-19T09:28:33.658 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T09:28:33.658 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.statistics: (nil) 2024-09-19T09:28:33.658 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.use_fsync: 0 2024-09-19T09:28:33.658 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.max_log_file_size: 0 2024-09-19T09:28:33.658 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T09:28:33.658 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T09:28:33.658 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T09:28:33.658 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T09:28:33.658 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.allow_fallocate: 1 2024-09-19T09:28:33.659 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T09:28:33.659 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T09:28:33.659 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.use_direct_reads: 0 2024-09-19T09:28:33.659 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T09:28:33.659 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T09:28:33.659 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.db_log_dir: 2024-09-19T09:28:33.659 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.wal_dir: 2024-09-19T09:28:33.659 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T09:28:33.659 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T09:28:33.659 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T09:28:33.659 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T09:28:33.659 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T09:28:33.659 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T09:28:33.659 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T09:28:33.660 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T09:28:33.660 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.write_buffer_manager: 0x55af656b0dc0 2024-09-19T09:28:33.660 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T09:28:33.660 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T09:28:33.660 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T09:28:33.660 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T09:28:33.660 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T09:28:33.660 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T09:28:33.660 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T09:28:33.660 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T09:28:33.660 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.unordered_write: 0 2024-09-19T09:28:33.660 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T09:28:33.660 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T09:28:33.660 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T09:28:33.661 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T09:28:33.661 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.row_cache: None 2024-09-19T09:28:33.661 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.wal_filter: None 2024-09-19T09:28:33.661 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T09:28:33.661 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T09:28:33.661 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.two_write_queues: 0 2024-09-19T09:28:33.661 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T09:28:33.661 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.wal_compression: 0 2024-09-19T09:28:33.662 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.atomic_flush: 0 2024-09-19T09:28:33.662 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T09:28:33.662 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T09:28:33.662 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T09:28:33.662 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.log_readahead_size: 0 2024-09-19T09:28:33.662 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T09:28:33.662 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T09:28:33.662 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T09:28:33.662 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T09:28:33.662 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T09:28:33.662 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T09:28:33.662 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T09:28:33.664 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.max_background_jobs: 2 2024-09-19T09:28:33.664 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.max_background_compactions: -1 2024-09-19T09:28:33.664 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.max_subcompactions: 1 2024-09-19T09:28:33.664 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T09:28:33.664 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T09:28:33.664 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T09:28:33.664 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T09:28:33.664 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T09:28:33.664 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T09:28:33.664 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T09:28:33.665 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T09:28:33.665 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.max_open_files: -1 2024-09-19T09:28:33.665 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T09:28:33.665 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T09:28:33.665 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T09:28:33.665 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T09:28:33.665 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.max_background_flushes: -1 2024-09-19T09:28:33.666 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Compression algorithms supported: 2024-09-19T09:28:33.666 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: kZSTD supported: 0 2024-09-19T09:28:33.666 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: kXpressCompression supported: 0 2024-09-19T09:28:33.666 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: kBZip2Compression supported: 0 2024-09-19T09:28:33.666 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T09:28:33.666 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: kLZ4Compression supported: 1 2024-09-19T09:28:33.666 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: kZlibCompression supported: 1 2024-09-19T09:28:33.666 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T09:28:33.666 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: kSnappyCompression supported: 1 2024-09-19T09:28:33.667 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T09:28:33.667 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T09:28:33.667 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-19T09:28:33.667 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T09:28:33.667 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T09:28:33.667 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.merge_operator: 2024-09-19T09:28:33.667 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.compaction_filter: None 2024-09-19T09:28:33.667 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T09:28:33.667 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T09:28:33.667 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T09:28:33.667 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T09:28:33.667 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55af656a1320) 2024-09-19T09:28:33.667 INFO:journalctl@ceph.mon.a.smithi001.stdout: cache_index_and_filter_blocks: 1 2024-09-19T09:28:33.667 INFO:journalctl@ceph.mon.a.smithi001.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T09:28:33.668 INFO:journalctl@ceph.mon.a.smithi001.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T09:28:33.668 INFO:journalctl@ceph.mon.a.smithi001.stdout: pin_top_level_index_and_filter: 1 2024-09-19T09:28:33.668 INFO:journalctl@ceph.mon.a.smithi001.stdout: index_type: 0 2024-09-19T09:28:33.668 INFO:journalctl@ceph.mon.a.smithi001.stdout: data_block_index_type: 0 2024-09-19T09:28:33.668 INFO:journalctl@ceph.mon.a.smithi001.stdout: index_shortening: 1 2024-09-19T09:28:33.668 INFO:journalctl@ceph.mon.a.smithi001.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T09:28:33.668 INFO:journalctl@ceph.mon.a.smithi001.stdout: checksum: 4 2024-09-19T09:28:33.668 INFO:journalctl@ceph.mon.a.smithi001.stdout: no_block_cache: 0 2024-09-19T09:28:33.668 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_cache: 0x55af656951f0 2024-09-19T09:28:33.668 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_cache_name: BinnedLRUCache 2024-09-19T09:28:33.669 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_cache_options: 2024-09-19T09:28:33.669 INFO:journalctl@ceph.mon.a.smithi001.stdout: capacity : 536870912 2024-09-19T09:28:33.669 INFO:journalctl@ceph.mon.a.smithi001.stdout: num_shard_bits : 4 2024-09-19T09:28:33.669 INFO:journalctl@ceph.mon.a.smithi001.stdout: strict_capacity_limit : 0 2024-09-19T09:28:33.669 INFO:journalctl@ceph.mon.a.smithi001.stdout: high_pri_pool_ratio: 0.000 2024-09-19T09:28:33.669 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_cache_compressed: (nil) 2024-09-19T09:28:33.669 INFO:journalctl@ceph.mon.a.smithi001.stdout: persistent_cache: (nil) 2024-09-19T09:28:33.669 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_size: 4096 2024-09-19T09:28:33.669 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_size_deviation: 10 2024-09-19T09:28:33.669 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_restart_interval: 16 2024-09-19T09:28:33.669 INFO:journalctl@ceph.mon.a.smithi001.stdout: index_block_restart_interval: 1 2024-09-19T09:28:33.669 INFO:journalctl@ceph.mon.a.smithi001.stdout: metadata_block_size: 4096 2024-09-19T09:28:33.669 INFO:journalctl@ceph.mon.a.smithi001.stdout: partition_filters: 0 2024-09-19T09:28:33.669 INFO:journalctl@ceph.mon.a.smithi001.stdout: use_delta_encoding: 1 2024-09-19T09:28:33.669 INFO:journalctl@ceph.mon.a.smithi001.stdout: filter_policy: bloomfilter 2024-09-19T09:28:33.669 INFO:journalctl@ceph.mon.a.smithi001.stdout: whole_key_filtering: 1 2024-09-19T09:28:33.670 INFO:journalctl@ceph.mon.a.smithi001.stdout: verify_compression: 0 2024-09-19T09:28:33.670 INFO:journalctl@ceph.mon.a.smithi001.stdout: read_amp_bytes_per_bit: 0 2024-09-19T09:28:33.670 INFO:journalctl@ceph.mon.a.smithi001.stdout: format_version: 5 2024-09-19T09:28:33.670 INFO:journalctl@ceph.mon.a.smithi001.stdout: enable_index_compression: 1 2024-09-19T09:28:33.670 INFO:journalctl@ceph.mon.a.smithi001.stdout: block_align: 0 2024-09-19T09:28:33.670 INFO:journalctl@ceph.mon.a.smithi001.stdout: max_auto_readahead_size: 262144 2024-09-19T09:28:33.670 INFO:journalctl@ceph.mon.a.smithi001.stdout: prepopulate_block_cache: 0 2024-09-19T09:28:33.670 INFO:journalctl@ceph.mon.a.smithi001.stdout: initial_auto_readahead_size: 8192 2024-09-19T09:28:33.670 INFO:journalctl@ceph.mon.a.smithi001.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T09:28:33.671 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T09:28:33.671 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T09:28:33.671 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.compression: NoCompression 2024-09-19T09:28:33.671 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T09:28:33.671 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T09:28:33.671 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T09:28:33.671 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.num_levels: 7 2024-09-19T09:28:33.671 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T09:28:33.671 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T09:28:33.671 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T09:28:33.671 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T09:28:33.671 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T09:28:33.671 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T09:28:33.671 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T09:28:33.672 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T09:28:33.672 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T09:28:33.672 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T09:28:33.672 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T09:28:33.672 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T09:28:33.672 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T09:28:33.672 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T09:28:33.672 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T09:28:33.672 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T09:28:33.672 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T09:28:33.672 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T09:28:33.673 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T09:28:33.673 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T09:28:33.673 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T09:28:33.673 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T09:28:33.673 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T09:28:33.673 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T09:28:33.673 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T09:28:33.673 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T09:28:33.673 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T09:28:33.673 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T09:28:33.673 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T09:28:33.673 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T09:28:33.673 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T09:28:33.673 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T09:28:33.674 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T09:28:33.674 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T09:28:33.674 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T09:28:33.674 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T09:28:33.674 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T09:28:33.674 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T09:28:33.674 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T09:28:33.674 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T09:28:33.674 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T09:28:33.674 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T09:28:33.674 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T09:28:33.674 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T09:28:33.674 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T09:28:33.674 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T09:28:33.674 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T09:28:33.675 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T09:28:33.675 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T09:28:33.675 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T09:28:33.675 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T09:28:33.675 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T09:28:33.675 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T09:28:33.675 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T09:28:33.675 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.inplace_update_support: 0 2024-09-19T09:28:33.675 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T09:28:33.675 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T09:28:33.675 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T09:28:33.676 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T09:28:33.676 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.bloom_locality: 0 2024-09-19T09:28:33.676 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.max_successive_merges: 0 2024-09-19T09:28:33.676 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T09:28:33.676 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T09:28:33.676 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T09:28:33.676 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T09:28:33.676 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.ttl: 2592000 2024-09-19T09:28:33.676 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T09:28:33.676 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T09:28:33.676 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T09:28:33.676 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.enable_blob_files: false 2024-09-19T09:28:33.676 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.min_blob_size: 0 2024-09-19T09:28:33.676 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T09:28:33.677 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T09:28:33.677 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T09:28:33.677 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T09:28:33.677 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T09:28:33.677 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T09:28:33.677 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T09:28:33.677 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T09:28:33.677 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-19T09:28:33.677 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-19T09:28:33.677 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 65d08ca4-71d6-4c25-9bf1-65df7888226a 2024-09-19T09:28:33.677 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726738113388255, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-19T09:28:33.677 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-19T09:28:33.677 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726738113389274, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100291, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 328, "table_properties": {"data_size": 98180, "index_size": 303, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14296, "raw_average_key_size": 49, "raw_value_size": 90451, "raw_average_value_size": 315, "num_data_blocks": 12, "num_entries": 287, "num_filter_entries": 287, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726738113, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "65d08ca4-71d6-4c25-9bf1-65df7888226a", "db_session_id": "H8P7J5ATGQQG5W92CCX1", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-19T09:28:33.677 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726738113389371, "job": 1, "event": "recovery_finished"} 2024-09-19T09:28:33.678 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-19T09:28:33.678 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T09:28:33.678 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55af656c2e00 2024-09-19T09:28:33.678 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: DB pointer 0x55af657be000 2024-09-19T09:28:33.678 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T09:28:33.678 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T09:28:33.678 INFO:journalctl@ceph.mon.a.smithi001.stdout: ** DB Stats ** 2024-09-19T09:28:33.679 INFO:journalctl@ceph.mon.a.smithi001.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T09:28:33.679 INFO:journalctl@ceph.mon.a.smithi001.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T09:28:33.679 INFO:journalctl@ceph.mon.a.smithi001.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T09:28:33.679 INFO:journalctl@ceph.mon.a.smithi001.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T09:28:33.679 INFO:journalctl@ceph.mon.a.smithi001.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T09:28:33.679 INFO:journalctl@ceph.mon.a.smithi001.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T09:28:33.679 INFO:journalctl@ceph.mon.a.smithi001.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T09:28:33.679 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-19T09:28:33.679 INFO:journalctl@ceph.mon.a.smithi001.stdout: ** Compaction Stats [default] ** 2024-09-19T09:28:33.680 INFO:journalctl@ceph.mon.a.smithi001.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T09:28:33.680 INFO:journalctl@ceph.mon.a.smithi001.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T09:28:33.680 INFO:journalctl@ceph.mon.a.smithi001.stdout: L0 2/0 99.80 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 154.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T09:28:33.680 INFO:journalctl@ceph.mon.a.smithi001.stdout: Sum 2/0 99.80 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 154.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T09:28:33.680 INFO:journalctl@ceph.mon.a.smithi001.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 154.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T09:28:33.680 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-19T09:28:33.680 INFO:journalctl@ceph.mon.a.smithi001.stdout: ** Compaction Stats [default] ** 2024-09-19T09:28:33.680 INFO:journalctl@ceph.mon.a.smithi001.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T09:28:33.680 INFO:journalctl@ceph.mon.a.smithi001.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T09:28:33.680 INFO:journalctl@ceph.mon.a.smithi001.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 154.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T09:28:33.680 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-19T09:28:33.680 INFO:journalctl@ceph.mon.a.smithi001.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T09:28:33.680 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-19T09:28:33.680 INFO:journalctl@ceph.mon.a.smithi001.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T09:28:33.681 INFO:journalctl@ceph.mon.a.smithi001.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T09:28:33.681 INFO:journalctl@ceph.mon.a.smithi001.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T09:28:33.681 INFO:journalctl@ceph.mon.a.smithi001.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T09:28:33.681 INFO:journalctl@ceph.mon.a.smithi001.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T09:28:33.681 INFO:journalctl@ceph.mon.a.smithi001.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T09:28:33.681 INFO:journalctl@ceph.mon.a.smithi001.stdout: Cumulative compaction: 0.00 GB write, 29.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T09:28:33.681 INFO:journalctl@ceph.mon.a.smithi001.stdout: Interval compaction: 0.00 GB write, 29.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T09:28:33.681 INFO:journalctl@ceph.mon.a.smithi001.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T09:28:33.681 INFO:journalctl@ceph.mon.a.smithi001.stdout: Block cache BinnedLRUCache@0x55af656951f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-19T09:28:33.681 INFO:journalctl@ceph.mon.a.smithi001.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-19T09:28:33.681 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-19T09:28:33.681 INFO:journalctl@ceph.mon.a.smithi001.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T09:28:33.681 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: starting mon.a rank 0 at public addrs [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] at bind addrs [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 57238232-7669-11ef-bceb-c7b262605968 2024-09-19T09:28:33.681 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: mon.a@-1(???) e1 preinit fsid 57238232-7669-11ef-bceb-c7b262605968 2024-09-19T09:28:33.682 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: mon.a@-1(???).mds e1 new map 2024-09-19T09:28:33.682 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: mon.a@-1(???).mds e1 print_map 2024-09-19T09:28:33.682 INFO:journalctl@ceph.mon.a.smithi001.stdout: e1 2024-09-19T09:28:33.682 INFO:journalctl@ceph.mon.a.smithi001.stdout: btime 2024-09-19T09:28:28:406821+0000 2024-09-19T09:28:33.682 INFO:journalctl@ceph.mon.a.smithi001.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:28:33.682 INFO:journalctl@ceph.mon.a.smithi001.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T09:28:33.682 INFO:journalctl@ceph.mon.a.smithi001.stdout: legacy client fscid: -1 2024-09-19T09:28:33.682 INFO:journalctl@ceph.mon.a.smithi001.stdout: 2024-09-19T09:28:33.682 INFO:journalctl@ceph.mon.a.smithi001.stdout: No filesystems configured 2024-09-19T09:28:33.682 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T09:28:33.682 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T09:28:33.682 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T09:28:33.682 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T09:28:33.683 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 ceph-mon[31225]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-19T09:28:33.683 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 bash[31206]: d867c9163aff5076f45b5af8d1207f1ae9b2c6c9c1ffcc023ae0b30e07ed267e 2024-09-19T09:28:33.683 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:33 smithi001 systemd[1]: Started Ceph mon.a for 57238232-7669-11ef-bceb-c7b262605968. 2024-09-19T09:28:34.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:34 smithi001 ceph-mon[31225]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T09:28:34.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:34 smithi001 ceph-mon[31225]: monmap epoch 1 2024-09-19T09:28:34.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:34 smithi001 ceph-mon[31225]: fsid 57238232-7669-11ef-bceb-c7b262605968 2024-09-19T09:28:34.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:34 smithi001 ceph-mon[31225]: last_changed 2024-09-19T09:28:24.634348+0000 2024-09-19T09:28:34.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:34 smithi001 ceph-mon[31225]: created 2024-09-19T09:28:24.634348+0000 2024-09-19T09:28:34.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:34 smithi001 ceph-mon[31225]: min_mon_release 19 (squid) 2024-09-19T09:28:34.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:34 smithi001 ceph-mon[31225]: election_strategy: 1 2024-09-19T09:28:34.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:34 smithi001 ceph-mon[31225]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-19T09:28:34.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:34 smithi001 ceph-mon[31225]: fsmap 2024-09-19T09:28:34.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:34 smithi001 ceph-mon[31225]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T09:28:34.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:34 smithi001 ceph-mon[31225]: mgrmap e1: no daemons active 2024-09-19T09:28:34.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:34 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/2185299995' entity='client.admin' 2024-09-19T09:28:34.802 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.827+0000 7f6968ccc640 1 Processor -- start 2024-09-19T09:28:34.807 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.827+0000 7f6968ccc640 1 -- start start 2024-09-19T09:28:34.807 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.827+0000 7f6968ccc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69641098a0 0x7f6964109ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:34.807 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.827+0000 7f6968ccc640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f696410a270 con 0x7f69641098a0 2024-09-19T09:28:34.807 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.828+0000 7f696259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69641098a0 0x7f6964109ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:34.807 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.828+0000 7f696259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69641098a0 0x7f6964109ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51216/0 (socket says 172.21.15.1:51216) 2024-09-19T09:28:34.807 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.828+0000 7f696259c640 1 -- 172.21.15.1:0/1959515599 learned_addr learned my addr 172.21.15.1:0/1959515599 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:28:34.807 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.828+0000 7f696259c640 1 -- 172.21.15.1:0/1959515599 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f696410aaa0 con 0x7f69641098a0 2024-09-19T09:28:34.807 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.830+0000 7f696259c640 1 --2- 172.21.15.1:0/1959515599 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69641098a0 0x7f6964109ca0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6954009820 tx=0x7f695402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625a0637ff362151 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:34.807 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.830+0000 7f6961d9b640 1 -- 172.21.15.1:0/1959515599 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6954037070 con 0x7f69641098a0 2024-09-19T09:28:34.807 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.830+0000 7f6961d9b640 1 -- 172.21.15.1:0/1959515599 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6954032900 con 0x7f69641098a0 2024-09-19T09:28:34.807 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.830+0000 7f6961d9b640 1 -- 172.21.15.1:0/1959515599 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6954030850 con 0x7f69641098a0 2024-09-19T09:28:34.808 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.830+0000 7f6968ccc640 1 -- 172.21.15.1:0/1959515599 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69641098a0 msgr2=0x7f6964109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:34.808 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.830+0000 7f6968ccc640 1 --2- 172.21.15.1:0/1959515599 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69641098a0 0x7f6964109ca0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6954009820 tx=0x7f695402a270 comp rx=0 tx=0).stop 2024-09-19T09:28:34.808 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.831+0000 7f6968ccc640 1 -- 172.21.15.1:0/1959515599 shutdown_connections 2024-09-19T09:28:34.808 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.831+0000 7f6968ccc640 1 --2- 172.21.15.1:0/1959515599 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69641098a0 0x7f6964109ca0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.808 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.831+0000 7f6968ccc640 1 -- 172.21.15.1:0/1959515599 >> 172.21.15.1:0/1959515599 conn(0x7f696407ce60 msgr2=0x7f696407d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:34.808 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.831+0000 7f6968ccc640 1 -- 172.21.15.1:0/1959515599 shutdown_connections 2024-09-19T09:28:34.808 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.831+0000 7f6968ccc640 1 -- 172.21.15.1:0/1959515599 wait complete. 2024-09-19T09:28:34.808 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.831+0000 7f6968ccc640 1 Processor -- start 2024-09-19T09:28:34.808 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.831+0000 7f6968ccc640 1 -- start start 2024-09-19T09:28:34.808 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.832+0000 7f6968ccc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69641098a0 0x7f696419d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:34.808 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.832+0000 7f6968ccc640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f696410de50 con 0x7f69641098a0 2024-09-19T09:28:34.808 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.832+0000 7f696259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69641098a0 0x7f696419d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:34.808 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.832+0000 7f696259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69641098a0 0x7f696419d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51232/0 (socket says 172.21.15.1:51232) 2024-09-19T09:28:34.808 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.832+0000 7f696259c640 1 -- 172.21.15.1:0/2185299995 learned_addr learned my addr 172.21.15.1:0/2185299995 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:28:34.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.832+0000 7f696259c640 1 -- 172.21.15.1:0/2185299995 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f696419de50 con 0x7f69641098a0 2024-09-19T09:28:34.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.832+0000 7f696259c640 1 --2- 172.21.15.1:0/2185299995 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69641098a0 0x7f696419d910 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6954009940 tx=0x7f69540326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:34.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.832+0000 7f695b7fe640 1 -- 172.21.15.1:0/2185299995 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6954042070 con 0x7f69641098a0 2024-09-19T09:28:34.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.832+0000 7f695b7fe640 1 -- 172.21.15.1:0/2185299995 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6954032be0 con 0x7f69641098a0 2024-09-19T09:28:34.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.832+0000 7f6968ccc640 1 -- 172.21.15.1:0/2185299995 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f696419e0e0 con 0x7f69641098a0 2024-09-19T09:28:34.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.832+0000 7f695b7fe640 1 -- 172.21.15.1:0/2185299995 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6954037040 con 0x7f69641098a0 2024-09-19T09:28:34.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.832+0000 7f6968ccc640 1 -- 172.21.15.1:0/2185299995 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69641a0dd0 con 0x7f69641098a0 2024-09-19T09:28:34.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.833+0000 7f695b7fe640 1 -- 172.21.15.1:0/2185299995 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6954045070 con 0x7f69641098a0 2024-09-19T09:28:34.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.833+0000 7f695b7fe640 1 -- 172.21.15.1:0/2185299995 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6954047a30 con 0x7f69641098a0 2024-09-19T09:28:34.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.833+0000 7f6968ccc640 1 -- 172.21.15.1:0/2185299995 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f696410dfd0 con 0x7f69641098a0 2024-09-19T09:28:34.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.836+0000 7f695b7fe640 1 -- 172.21.15.1:0/2185299995 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6954032d90 con 0x7f69641098a0 2024-09-19T09:28:34.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.895+0000 7f6968ccc640 1 -- 172.21.15.1:0/2185299995 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f6964109d20 con 0x7f69641098a0 2024-09-19T09:28:34.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.897+0000 7f695b7fe640 1 -- 172.21.15.1:0/2185299995 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f695403d430 con 0x7f69641098a0 2024-09-19T09:28:34.810 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.897+0000 7f6968ccc640 1 -- 172.21.15.1:0/2185299995 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69641098a0 msgr2=0x7f696419d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:34.810 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.897+0000 7f6968ccc640 1 --2- 172.21.15.1:0/2185299995 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69641098a0 0x7f696419d910 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6954009940 tx=0x7f69540326e0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.810 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.898+0000 7f6968ccc640 1 -- 172.21.15.1:0/2185299995 shutdown_connections 2024-09-19T09:28:34.810 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.898+0000 7f6968ccc640 1 --2- 172.21.15.1:0/2185299995 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69641098a0 0x7f696419d910 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:34.810 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.898+0000 7f6968ccc640 1 -- 172.21.15.1:0/2185299995 >> 172.21.15.1:0/2185299995 conn(0x7f696407ce60 msgr2=0x7f6964107680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:34.810 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.898+0000 7f6968ccc640 1 -- 172.21.15.1:0/2185299995 shutdown_connections 2024-09-19T09:28:34.810 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:33.898+0000 7f6968ccc640 1 -- 172.21.15.1:0/2185299995 wait complete. 2024-09-19T09:28:34.810 INFO:teuthology.orchestra.run.smithi001.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-19T09:28:34.823 INFO:teuthology.orchestra.run.smithi001.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:28:34.823 INFO:teuthology.orchestra.run.smithi001.stdout:Creating mgr... 2024-09-19T09:28:34.824 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-19T09:28:34.825 INFO:teuthology.orchestra.run.smithi001.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-19T09:28:35.090 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-57238232-7669-11ef-bceb-c7b262605968@mgr.x 2024-09-19T09:28:35.091 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Failed to reset failed state of unit ceph-57238232-7669-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-57238232-7669-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-19T09:28:35.246 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-57238232-7669-11ef-bceb-c7b262605968.target.wants/ceph-57238232-7669-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-57238232-7669-11ef-bceb-c7b262605968@.service. 2024-09-19T09:28:35.468 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:35 smithi001 systemd[1]: Starting Ceph mgr.x for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:28:35.747 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:35 smithi001 podman[31439]: 2024-09-19 09:28:35.467294412 +0000 UTC m=+0.102914424 container create e056032c4e14ebda6a7c461eb3643a0926ec76cca1d37065d5dc8dad1e88bf8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:28:35.747 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:35 smithi001 podman[31439]: 2024-09-19 09:28:35.380831474 +0000 UTC m=+0.016451485 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:28:35.748 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:35 smithi001 podman[31439]: 2024-09-19 09:28:35.686133135 +0000 UTC m=+0.321753157 container init e056032c4e14ebda6a7c461eb3643a0926ec76cca1d37065d5dc8dad1e88bf8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-19T09:28:35.748 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:35 smithi001 podman[31439]: 2024-09-19 09:28:35.689038858 +0000 UTC m=+0.324658869 container start e056032c4e14ebda6a7c461eb3643a0926ec76cca1d37065d5dc8dad1e88bf8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:28:35.787 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T09:28:35.788 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout disabled 2024-09-19T09:28:35.795 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T09:28:35.795 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-19T09:28:35.795 INFO:teuthology.orchestra.run.smithi001.stdout:firewalld.service is not enabled 2024-09-19T09:28:35.795 INFO:teuthology.orchestra.run.smithi001.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T09:28:35.804 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T09:28:35.805 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout disabled 2024-09-19T09:28:35.813 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T09:28:35.813 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-19T09:28:35.813 INFO:teuthology.orchestra.run.smithi001.stdout:firewalld.service is not enabled 2024-09-19T09:28:35.813 INFO:teuthology.orchestra.run.smithi001.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-19T09:28:35.813 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mgr to start... 2024-09-19T09:28:35.813 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mgr... 2024-09-19T09:28:36.028 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:35 smithi001 bash[31439]: e056032c4e14ebda6a7c461eb3643a0926ec76cca1d37065d5dc8dad1e88bf8b 2024-09-19T09:28:36.028 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:35 smithi001 systemd[1]: Started Ceph mgr.x for 57238232-7669-11ef-bceb-c7b262605968. 2024-09-19T09:28:36.028 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:35 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:35.813+0000 7ff9524ab040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T09:28:36.028 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:35 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:35.879+0000 7ff9524ab040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:28:36.291 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:36 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:36.040+0000 7ff9524ab040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:28:36.291 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:36 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:36.109+0000 7ff9524ab040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:28:36.292 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:36 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:36.269+0000 7ff9524ab040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:28:36.601 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:36 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/2221663337' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T09:28:36.602 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:36 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:36.420+0000 7ff9524ab040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:28:36.796 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T09:28:36.799 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:28:36.799 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsid": "57238232-7669-11ef-bceb-c7b262605968", 2024-09-19T09:28:36.799 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T09:28:36.799 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T09:28:36.799 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T09:28:36.799 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T09:28:36.799 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:28:36.799 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T09:28:36.799 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T09:28:36.799 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 0 2024-09-19T09:28:36.799 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:28:36.799 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T09:28:36.799 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T09:28:36.800 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:28:36.800 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-19T09:28:36.800 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T09:28:36.800 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:28:36.800 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T09:28:36.800 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T09:28:36.800 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:28:36.800 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T09:28:36.800 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:28:36.800 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T09:28:36.800 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T09:28:36.800 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T09:28:36.808 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T09:28:36.808 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T09:28:36.808 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T09:28:36.808 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:28:36.808 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T09:28:36.808 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T09:28:36.808 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T09:28:36.808 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T09:28:36.808 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T09:28:36.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T09:28:36.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T09:28:36.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T09:28:36.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T09:28:36.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:28:36.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T09:28:36.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:28:36.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T09:28:28:406821+0000", 2024-09-19T09:28:36.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T09:28:36.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T09:28:36.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:28:36.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T09:28:36.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T09:28:36.809 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T09:28:36.810 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T09:28:36.810 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T09:28:36.810 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T09:28:36.810 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T09:28:36.810 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:28:36.810 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:28:36.810 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:28:36.810 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T09:28:36.810 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:28:36.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T09:28:28.407469+0000", 2024-09-19T09:28:36.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:28:36.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:28:36.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T09:28:36.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:28:36.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.218+0000 7fdd2e7d2640 1 Processor -- start 2024-09-19T09:28:36.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.219+0000 7fdd2e7d2640 1 -- start start 2024-09-19T09:28:36.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.219+0000 7fdd2e7d2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd281081f0 0x7fdd2810a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:36.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.219+0000 7fdd2e7d2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdd2807bdb0 con 0x7fdd281081f0 2024-09-19T09:28:36.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.219+0000 7fdd27fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd281081f0 0x7fdd2810a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:36.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.219+0000 7fdd27fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd281081f0 0x7fdd2810a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49452/0 (socket says 172.21.15.1:49452) 2024-09-19T09:28:36.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.219+0000 7fdd27fff640 1 -- 172.21.15.1:0/2665585101 learned_addr learned my addr 172.21.15.1:0/2665585101 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:28:36.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.219+0000 7fdd27fff640 1 -- 172.21.15.1:0/2665585101 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd2810ab20 con 0x7fdd281081f0 2024-09-19T09:28:36.811 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.220+0000 7fdd27fff640 1 --2- 172.21.15.1:0/2665585101 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd281081f0 0x7fdd2810a5e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdd18009820 tx=0x7fdd1802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33c2f730bada3f8f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:36.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.220+0000 7fdd26ffd640 1 -- 172.21.15.1:0/2665585101 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd18037070 con 0x7fdd281081f0 2024-09-19T09:28:36.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.220+0000 7fdd26ffd640 1 -- 172.21.15.1:0/2665585101 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdd18032900 con 0x7fdd281081f0 2024-09-19T09:28:36.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.220+0000 7fdd26ffd640 1 -- 172.21.15.1:0/2665585101 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd18030850 con 0x7fdd281081f0 2024-09-19T09:28:36.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.221+0000 7fdd2e7d2640 1 -- 172.21.15.1:0/2665585101 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd281081f0 msgr2=0x7fdd2810a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:36.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.221+0000 7fdd2e7d2640 1 --2- 172.21.15.1:0/2665585101 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd281081f0 0x7fdd2810a5e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fdd18009820 tx=0x7fdd1802a270 comp rx=0 tx=0).stop 2024-09-19T09:28:36.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.221+0000 7fdd2e7d2640 1 -- 172.21.15.1:0/2665585101 shutdown_connections 2024-09-19T09:28:36.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.221+0000 7fdd2e7d2640 1 --2- 172.21.15.1:0/2665585101 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd281081f0 0x7fdd2810a5e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.221+0000 7fdd2e7d2640 1 -- 172.21.15.1:0/2665585101 >> 172.21.15.1:0/2665585101 conn(0x7fdd28101d50 msgr2=0x7fdd28104170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:36.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.221+0000 7fdd2e7d2640 1 -- 172.21.15.1:0/2665585101 shutdown_connections 2024-09-19T09:28:36.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.221+0000 7fdd2e7d2640 1 -- 172.21.15.1:0/2665585101 wait complete. 2024-09-19T09:28:36.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.222+0000 7fdd2e7d2640 1 Processor -- start 2024-09-19T09:28:36.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.222+0000 7fdd2e7d2640 1 -- start start 2024-09-19T09:28:36.812 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.222+0000 7fdd2e7d2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd281081f0 0x7fdd2819b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:36.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.222+0000 7fdd2e7d2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdd2810baa0 con 0x7fdd281081f0 2024-09-19T09:28:36.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.222+0000 7fdd27fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd281081f0 0x7fdd2819b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:36.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.222+0000 7fdd27fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd281081f0 0x7fdd2819b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49460/0 (socket says 172.21.15.1:49460) 2024-09-19T09:28:36.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.222+0000 7fdd27fff640 1 -- 172.21.15.1:0/2221663337 learned_addr learned my addr 172.21.15.1:0/2221663337 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:28:36.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.223+0000 7fdd27fff640 1 -- 172.21.15.1:0/2221663337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd2819bc30 con 0x7fdd281081f0 2024-09-19T09:28:36.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.223+0000 7fdd27fff640 1 --2- 172.21.15.1:0/2221663337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd281081f0 0x7fdd2819b6f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdd18031000 tx=0x7fdd180326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:36.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.223+0000 7fdd257fa640 1 -- 172.21.15.1:0/2221663337 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd18042070 con 0x7fdd281081f0 2024-09-19T09:28:36.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.223+0000 7fdd257fa640 1 -- 172.21.15.1:0/2221663337 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdd18032be0 con 0x7fdd281081f0 2024-09-19T09:28:36.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.223+0000 7fdd2e7d2640 1 -- 172.21.15.1:0/2221663337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd2819bec0 con 0x7fdd281081f0 2024-09-19T09:28:36.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.223+0000 7fdd257fa640 1 -- 172.21.15.1:0/2221663337 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd18037040 con 0x7fdd281081f0 2024-09-19T09:28:36.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.223+0000 7fdd2e7d2640 1 -- 172.21.15.1:0/2221663337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd2819ebb0 con 0x7fdd281081f0 2024-09-19T09:28:36.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.223+0000 7fdd257fa640 1 -- 172.21.15.1:0/2221663337 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdd18045070 con 0x7fdd281081f0 2024-09-19T09:28:36.813 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.223+0000 7fdd257fa640 1 -- 172.21.15.1:0/2221663337 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdd18047b20 con 0x7fdd281081f0 2024-09-19T09:28:36.814 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.224+0000 7fdd2e7d2640 1 -- 172.21.15.1:0/2221663337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd28108650 con 0x7fdd281081f0 2024-09-19T09:28:36.814 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.226+0000 7fdd257fa640 1 -- 172.21.15.1:0/2221663337 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fdd1804c030 con 0x7fdd281081f0 2024-09-19T09:28:36.814 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.289+0000 7fdd2e7d2640 1 -- 172.21.15.1:0/2221663337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fdd2819ed80 con 0x7fdd281081f0 2024-09-19T09:28:36.814 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.289+0000 7fdd257fa640 1 -- 172.21.15.1:0/2221663337 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fdd180328c0 con 0x7fdd281081f0 2024-09-19T09:28:36.814 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.290+0000 7fdd2e7d2640 1 -- 172.21.15.1:0/2221663337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd281081f0 msgr2=0x7fdd2819b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:36.814 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.290+0000 7fdd2e7d2640 1 --2- 172.21.15.1:0/2221663337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd281081f0 0x7fdd2819b6f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdd18031000 tx=0x7fdd180326e0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.814 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.290+0000 7fdd2e7d2640 1 -- 172.21.15.1:0/2221663337 shutdown_connections 2024-09-19T09:28:36.814 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.290+0000 7fdd2e7d2640 1 --2- 172.21.15.1:0/2221663337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd281081f0 0x7fdd2819b6f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:36.814 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.290+0000 7fdd2e7d2640 1 -- 172.21.15.1:0/2221663337 >> 172.21.15.1:0/2221663337 conn(0x7fdd28101d50 msgr2=0x7fdd28102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:36.815 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.291+0000 7fdd2e7d2640 1 -- 172.21.15.1:0/2221663337 shutdown_connections 2024-09-19T09:28:36.815 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:36.291+0000 7fdd2e7d2640 1 -- 172.21.15.1:0/2221663337 wait complete. 2024-09-19T09:28:36.815 INFO:teuthology.orchestra.run.smithi001.stdout:mgr not available, waiting (1/15)... 2024-09-19T09:28:36.997 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:36 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:36.759+0000 7ff9524ab040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:28:36.997 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:36 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:36.823+0000 7ff9524ab040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:28:37.497 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:37 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:37.017+0000 7ff9524ab040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:28:38.247 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:37 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:37.943+0000 7ff9524ab040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:28:38.247 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:38 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:38.013+0000 7ff9524ab040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:28:39.053 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:38 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:38.769+0000 7ff9524ab040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:28:39.053 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:38 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:38.899+0000 7ff9524ab040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:28:39.307 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:39 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:39.050+0000 7ff9524ab040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:28:39.307 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:39 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:39.115+0000 7ff9524ab040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:28:39.307 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:39 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:39.277+0000 7ff9524ab040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:28:39.584 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:39 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1956771333' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T09:28:39.584 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:39 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:39.349+0000 7ff9524ab040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:28:39.584 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:39 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:39.412+0000 7ff9524ab040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:28:39.584 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:39 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:39.581+0000 7ff9524ab040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:28:39.845 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:39 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:39.650+0000 7ff9524ab040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:28:39.845 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:39 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:39.720+0000 7ff9524ab040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:28:39.845 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:39 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:39.808+0000 7ff9524ab040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:28:39.856 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T09:28:39.856 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:28:39.856 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsid": "57238232-7669-11ef-bceb-c7b262605968", 2024-09-19T09:28:39.856 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T09:28:39.856 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T09:28:39.857 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T09:28:39.857 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T09:28:39.857 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:28:39.857 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T09:28:39.857 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T09:28:39.857 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 0 2024-09-19T09:28:39.857 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:28:39.857 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T09:28:39.857 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T09:28:39.857 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:28:39.857 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-19T09:28:39.857 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T09:28:39.857 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:28:39.857 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T09:28:39.858 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T09:28:39.858 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:28:39.858 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T09:28:39.858 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:28:39.858 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T09:28:39.858 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T09:28:39.858 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T09:28:39.858 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T09:28:39.858 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T09:28:39.858 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T09:28:39.858 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:28:39.858 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T09:28:39.858 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T09:28:39.858 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T09:28:39.859 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T09:28:39.859 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T09:28:39.859 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T09:28:39.859 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T09:28:39.859 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T09:28:39.859 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T09:28:39.859 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:28:39.859 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T09:28:39.859 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:28:39.859 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T09:28:28:406821+0000", 2024-09-19T09:28:39.859 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T09:28:39.859 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T09:28:39.859 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:28:39.859 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T09:28:39.860 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T09:28:39.860 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T09:28:39.860 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T09:28:39.860 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T09:28:39.860 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T09:28:39.860 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T09:28:39.860 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:28:39.860 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:28:39.860 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:28:39.860 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T09:28:39.860 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:28:39.860 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T09:28:28.407469+0000", 2024-09-19T09:28:39.860 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:28:39.860 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:28:39.861 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T09:28:39.861 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:28:39.861 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.184+0000 7f39c5205640 1 Processor -- start 2024-09-19T09:28:39.861 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.184+0000 7f39c5205640 1 -- start start 2024-09-19T09:28:39.861 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.184+0000 7f39c5205640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39c0107690 0x7f39c0107a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:39.861 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.184+0000 7f39c5205640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f39c0108060 con 0x7f39c0107690 2024-09-19T09:28:39.861 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.184+0000 7f39bed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39c0107690 0x7f39c0107a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:39.861 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.184+0000 7f39bed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39c0107690 0x7f39c0107a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49466/0 (socket says 172.21.15.1:49466) 2024-09-19T09:28:39.861 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.184+0000 7f39bed9d640 1 -- 172.21.15.1:0/3297728542 learned_addr learned my addr 172.21.15.1:0/3297728542 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:28:39.861 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.184+0000 7f39bed9d640 1 -- 172.21.15.1:0/3297728542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c0108890 con 0x7f39c0107690 2024-09-19T09:28:39.861 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.185+0000 7f39bed9d640 1 --2- 172.21.15.1:0/3297728542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39c0107690 0x7f39c0107a90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f39b0009820 tx=0x7f39b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc7cc9869735c8ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:39.861 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.185+0000 7f39bdd9b640 1 -- 172.21.15.1:0/3297728542 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39b0037070 con 0x7f39c0107690 2024-09-19T09:28:39.861 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.185+0000 7f39bdd9b640 1 -- 172.21.15.1:0/3297728542 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f39b0032900 con 0x7f39c0107690 2024-09-19T09:28:39.862 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.185+0000 7f39bdd9b640 1 -- 172.21.15.1:0/3297728542 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39b0030850 con 0x7f39c0107690 2024-09-19T09:28:39.862 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.186+0000 7f39c5205640 1 -- 172.21.15.1:0/3297728542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39c0107690 msgr2=0x7f39c0107a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:39.862 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.186+0000 7f39c5205640 1 --2- 172.21.15.1:0/3297728542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39c0107690 0x7f39c0107a90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f39b0009820 tx=0x7f39b002a270 comp rx=0 tx=0).stop 2024-09-19T09:28:39.862 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.186+0000 7f39c5205640 1 -- 172.21.15.1:0/3297728542 shutdown_connections 2024-09-19T09:28:39.862 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.186+0000 7f39c5205640 1 --2- 172.21.15.1:0/3297728542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39c0107690 0x7f39c0107a90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:39.862 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.186+0000 7f39c5205640 1 -- 172.21.15.1:0/3297728542 >> 172.21.15.1:0/3297728542 conn(0x7f39c0102e60 msgr2=0x7f39c0105280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:39.862 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.186+0000 7f39c5205640 1 -- 172.21.15.1:0/3297728542 shutdown_connections 2024-09-19T09:28:39.862 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.186+0000 7f39c5205640 1 -- 172.21.15.1:0/3297728542 wait complete. 2024-09-19T09:28:39.862 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.187+0000 7f39c5205640 1 Processor -- start 2024-09-19T09:28:39.862 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.187+0000 7f39c5205640 1 -- start start 2024-09-19T09:28:39.862 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.187+0000 7f39c5205640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39c0107690 0x7f39c019b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:39.862 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.187+0000 7f39c5205640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f39c010bc40 con 0x7f39c0107690 2024-09-19T09:28:39.862 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.188+0000 7f39bed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39c0107690 0x7f39c019b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:39.862 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.188+0000 7f39bed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39c0107690 0x7f39c019b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49474/0 (socket says 172.21.15.1:49474) 2024-09-19T09:28:39.863 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.188+0000 7f39bed9d640 1 -- 172.21.15.1:0/1956771333 learned_addr learned my addr 172.21.15.1:0/1956771333 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:28:39.863 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.188+0000 7f39bed9d640 1 -- 172.21.15.1:0/1956771333 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c019bc00 con 0x7f39c0107690 2024-09-19T09:28:39.863 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.188+0000 7f39bed9d640 1 --2- 172.21.15.1:0/1956771333 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39c0107690 0x7f39c019b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f39b00097f0 tx=0x7f39b0030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:39.863 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.188+0000 7f39a7fff640 1 -- 172.21.15.1:0/1956771333 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39b0037040 con 0x7f39c0107690 2024-09-19T09:28:39.863 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.188+0000 7f39a7fff640 1 -- 172.21.15.1:0/1956771333 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f39b0040070 con 0x7f39c0107690 2024-09-19T09:28:39.863 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.188+0000 7f39c5205640 1 -- 172.21.15.1:0/1956771333 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c019be90 con 0x7f39c0107690 2024-09-19T09:28:39.863 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.188+0000 7f39a7fff640 1 -- 172.21.15.1:0/1956771333 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39b003a390 con 0x7f39c0107690 2024-09-19T09:28:39.863 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.188+0000 7f39c5205640 1 -- 172.21.15.1:0/1956771333 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c019eb80 con 0x7f39c0107690 2024-09-19T09:28:39.863 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.189+0000 7f39a7fff640 1 -- 172.21.15.1:0/1956771333 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f39b003a5e0 con 0x7f39c0107690 2024-09-19T09:28:39.863 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.189+0000 7f39a7fff640 1 -- 172.21.15.1:0/1956771333 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f39b0045950 con 0x7f39c0107690 2024-09-19T09:28:39.863 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.189+0000 7f39c5205640 1 -- 172.21.15.1:0/1956771333 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39c0107b10 con 0x7f39c0107690 2024-09-19T09:28:39.863 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.191+0000 7f39a7fff640 1 -- 172.21.15.1:0/1956771333 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f39b0045460 con 0x7f39c0107690 2024-09-19T09:28:39.863 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.254+0000 7f39c5205640 1 -- 172.21.15.1:0/1956771333 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f39c019ed50 con 0x7f39c0107690 2024-09-19T09:28:39.864 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.254+0000 7f39a7fff640 1 -- 172.21.15.1:0/1956771333 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f39b003b430 con 0x7f39c0107690 2024-09-19T09:28:39.864 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.255+0000 7f39c5205640 1 -- 172.21.15.1:0/1956771333 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39c0107690 msgr2=0x7f39c019b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:39.864 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.255+0000 7f39c5205640 1 --2- 172.21.15.1:0/1956771333 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39c0107690 0x7f39c019b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f39b00097f0 tx=0x7f39b0030d80 comp rx=0 tx=0).stop 2024-09-19T09:28:39.864 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.255+0000 7f39c5205640 1 -- 172.21.15.1:0/1956771333 shutdown_connections 2024-09-19T09:28:39.864 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.255+0000 7f39c5205640 1 --2- 172.21.15.1:0/1956771333 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f39c0107690 0x7f39c019b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:39.864 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.255+0000 7f39c5205640 1 -- 172.21.15.1:0/1956771333 >> 172.21.15.1:0/1956771333 conn(0x7f39c0102e60 msgr2=0x7f39c0103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:39.864 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.255+0000 7f39c5205640 1 -- 172.21.15.1:0/1956771333 shutdown_connections 2024-09-19T09:28:39.864 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:39.255+0000 7f39c5205640 1 -- 172.21.15.1:0/1956771333 wait complete. 2024-09-19T09:28:39.864 INFO:teuthology.orchestra.run.smithi001.stdout:mgr not available, waiting (2/15)... 2024-09-19T09:28:40.247 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:39 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:39.878+0000 7ff9524ab040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:28:40.247 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:39 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:39.944+0000 7ff9524ab040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:28:41.248 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:40 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:40.774+0000 7ff9524ab040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:28:41.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:40 smithi001 ceph-mon[31225]: Activating manager daemon x 2024-09-19T09:28:41.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:40 smithi001 ceph-mon[31225]: mgrmap e2: x(active, starting, since 0.00323852s) 2024-09-19T09:28:41.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:40 smithi001 ceph-mon[31225]: from='mgr.14100 172.21.15.1:0/3712636447' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:28:41.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:40 smithi001 ceph-mon[31225]: from='mgr.14100 172.21.15.1:0/3712636447' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:28:41.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:40 smithi001 ceph-mon[31225]: from='mgr.14100 172.21.15.1:0/3712636447' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:28:41.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:40 smithi001 ceph-mon[31225]: from='mgr.14100 172.21.15.1:0/3712636447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:28:41.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:40 smithi001 ceph-mon[31225]: from='mgr.14100 172.21.15.1:0/3712636447' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T09:28:41.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:40 smithi001 ceph-mon[31225]: Manager daemon x is now available 2024-09-19T09:28:41.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:40 smithi001 ceph-mon[31225]: from='mgr.14100 172.21.15.1:0/3712636447' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:28:41.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:40 smithi001 ceph-mon[31225]: from='mgr.14100 172.21.15.1:0/3712636447' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T09:28:41.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:40 smithi001 ceph-mon[31225]: from='mgr.14100 172.21.15.1:0/3712636447' entity='mgr.x' 2024-09-19T09:28:41.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:40 smithi001 ceph-mon[31225]: from='mgr.14100 172.21.15.1:0/3712636447' entity='mgr.x' 2024-09-19T09:28:41.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:40 smithi001 ceph-mon[31225]: from='mgr.14100 172.21.15.1:0/3712636447' entity='mgr.x' 2024-09-19T09:28:42.848 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:42 smithi001 ceph-mon[31225]: mgrmap e3: x(active, since 1.00768s) 2024-09-19T09:28:42.848 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:42 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/2465392911' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T09:28:43.131 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T09:28:43.131 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:28:43.131 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsid": "57238232-7669-11ef-bceb-c7b262605968", 2024-09-19T09:28:43.131 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T09:28:43.131 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T09:28:43.131 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T09:28:43.131 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T09:28:43.131 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:28:43.132 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T09:28:43.132 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T09:28:43.132 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 0 2024-09-19T09:28:43.132 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:28:43.132 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T09:28:43.132 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T09:28:43.132 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:28:43.132 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-19T09:28:43.132 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T09:28:43.132 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:28:43.132 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T09:28:43.133 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T09:28:43.133 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:28:43.133 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T09:28:43.133 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:28:43.133 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T09:28:43.133 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T09:28:43.133 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T09:28:43.133 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T09:28:43.133 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T09:28:43.133 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T09:28:43.133 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:28:43.133 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T09:28:43.134 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T09:28:43.134 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T09:28:43.134 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T09:28:43.134 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T09:28:43.134 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T09:28:43.134 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T09:28:43.135 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T09:28:43.135 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T09:28:43.135 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:28:43.135 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T09:28:43.135 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:28:43.135 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T09:28:28:406821+0000", 2024-09-19T09:28:43.135 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T09:28:43.135 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T09:28:43.135 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:28:43.136 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T09:28:43.136 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T09:28:43.136 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T09:28:43.136 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T09:28:43.136 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T09:28:43.136 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T09:28:43.136 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T09:28:43.137 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ], 2024-09-19T09:28:43.137 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:28:43.137 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:28:43.137 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T09:28:43.137 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T09:28:43.137 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T09:28:28.407469+0000", 2024-09-19T09:28:43.137 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T09:28:43.137 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout }, 2024-09-19T09:28:43.137 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T09:28:43.137 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:28:43.137 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.290+0000 7f6dcca8f640 1 Processor -- start 2024-09-19T09:28:43.137 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.290+0000 7f6dcca8f640 1 -- start start 2024-09-19T09:28:43.137 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.290+0000 7f6dcca8f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6dc81065b0 0x7f6dc81069b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:43.138 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.290+0000 7f6dcca8f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc8106f80 con 0x7f6dc81065b0 2024-09-19T09:28:43.138 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.291+0000 7f6dc659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6dc81065b0 0x7f6dc81069b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:43.138 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.291+0000 7f6dc659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6dc81065b0 0x7f6dc81069b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49544/0 (socket says 172.21.15.1:49544) 2024-09-19T09:28:43.138 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.291+0000 7f6dc659c640 1 -- 172.21.15.1:0/3859127666 learned_addr learned my addr 172.21.15.1:0/3859127666 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:28:43.138 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.291+0000 7f6dc659c640 1 -- 172.21.15.1:0/3859127666 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc81077b0 con 0x7f6dc81065b0 2024-09-19T09:28:43.138 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.292+0000 7f6dc659c640 1 --2- 172.21.15.1:0/3859127666 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6dc81065b0 0x7f6dc81069b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6db8009820 tx=0x7f6db802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d600071de4fda server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:43.138 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.292+0000 7f6dc559a640 1 -- 172.21.15.1:0/3859127666 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6db8037070 con 0x7f6dc81065b0 2024-09-19T09:28:43.138 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.292+0000 7f6dc559a640 1 -- 172.21.15.1:0/3859127666 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6db8032900 con 0x7f6dc81065b0 2024-09-19T09:28:43.138 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.292+0000 7f6dc559a640 1 -- 172.21.15.1:0/3859127666 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6db8030850 con 0x7f6dc81065b0 2024-09-19T09:28:43.138 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.293+0000 7f6dcca8f640 1 -- 172.21.15.1:0/3859127666 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6dc81065b0 msgr2=0x7f6dc81069b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:43.138 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.293+0000 7f6dcca8f640 1 --2- 172.21.15.1:0/3859127666 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6dc81065b0 0x7f6dc81069b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6db8009820 tx=0x7f6db802a270 comp rx=0 tx=0).stop 2024-09-19T09:28:43.138 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.293+0000 7f6dcca8f640 1 -- 172.21.15.1:0/3859127666 shutdown_connections 2024-09-19T09:28:43.138 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.293+0000 7f6dcca8f640 1 --2- 172.21.15.1:0/3859127666 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6dc81065b0 0x7f6dc81069b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:43.138 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.293+0000 7f6dcca8f640 1 -- 172.21.15.1:0/3859127666 >> 172.21.15.1:0/3859127666 conn(0x7f6dc8101d80 msgr2=0x7f6dc81041a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:43.139 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.293+0000 7f6dcca8f640 1 -- 172.21.15.1:0/3859127666 shutdown_connections 2024-09-19T09:28:43.139 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.293+0000 7f6dcca8f640 1 -- 172.21.15.1:0/3859127666 wait complete. 2024-09-19T09:28:43.139 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.294+0000 7f6dcca8f640 1 Processor -- start 2024-09-19T09:28:43.139 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.294+0000 7f6dcca8f640 1 -- start start 2024-09-19T09:28:43.139 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.294+0000 7f6dcca8f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6dc81065b0 0x7f6dc81917e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:43.139 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.294+0000 7f6dcca8f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc810ab60 con 0x7f6dc81065b0 2024-09-19T09:28:43.139 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.294+0000 7f6dc659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6dc81065b0 0x7f6dc81917e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:43.139 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.294+0000 7f6dc659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6dc81065b0 0x7f6dc81917e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49546/0 (socket says 172.21.15.1:49546) 2024-09-19T09:28:43.139 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.294+0000 7f6dc659c640 1 -- 172.21.15.1:0/2465392911 learned_addr learned my addr 172.21.15.1:0/2465392911 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:28:43.139 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.294+0000 7f6dc659c640 1 -- 172.21.15.1:0/2465392911 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc8191d20 con 0x7f6dc81065b0 2024-09-19T09:28:43.139 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.295+0000 7f6dc659c640 1 --2- 172.21.15.1:0/2465392911 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6dc81065b0 0x7f6dc81917e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6db8009940 tx=0x7f6db80326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:43.140 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.295+0000 7f6db77fe640 1 -- 172.21.15.1:0/2465392911 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6db8042070 con 0x7f6dc81065b0 2024-09-19T09:28:43.140 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.295+0000 7f6db77fe640 1 -- 172.21.15.1:0/2465392911 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6db8032be0 con 0x7f6dc81065b0 2024-09-19T09:28:43.140 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.295+0000 7f6dcca8f640 1 -- 172.21.15.1:0/2465392911 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc818ff10 con 0x7f6dc81065b0 2024-09-19T09:28:43.140 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.295+0000 7f6db77fe640 1 -- 172.21.15.1:0/2465392911 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6db8037040 con 0x7f6dc81065b0 2024-09-19T09:28:43.140 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.295+0000 7f6dcca8f640 1 -- 172.21.15.1:0/2465392911 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc8190450 con 0x7f6dc81065b0 2024-09-19T09:28:43.140 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.296+0000 7f6db77fe640 1 -- 172.21.15.1:0/2465392911 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 3) ==== 46344+0+0 (secure 0 0 0) 0x7f6db8045070 con 0x7f6dc81065b0 2024-09-19T09:28:43.140 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.296+0000 7f6dcca8f640 1 -- 172.21.15.1:0/2465392911 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dc810ace0 con 0x7f6dc81065b0 2024-09-19T09:28:43.140 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.296+0000 7f6db77fe640 1 --2- 172.21.15.1:0/2465392911 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7f6db0039050 0x7f6db003b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:43.140 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.296+0000 7f6db77fe640 1 -- 172.21.15.1:0/2465392911 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6db806bf80 con 0x7f6dc81065b0 2024-09-19T09:28:43.141 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.296+0000 7f6dc5d9b640 1 --2- 172.21.15.1:0/2465392911 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7f6db0039050 0x7f6db003b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:43.141 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.297+0000 7f6dc5d9b640 1 --2- 172.21.15.1:0/2465392911 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7f6db0039050 0x7f6db003b510 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc0098c0 tx=0x7f6dbc006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:43.141 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.301+0000 7f6db77fe640 1 -- 172.21.15.1:0/2465392911 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6db804b170 con 0x7f6dc81065b0 2024-09-19T09:28:43.141 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.547+0000 7f6dcca8f640 1 -- 172.21.15.1:0/2465392911 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f6dc81950f0 con 0x7f6dc81065b0 2024-09-19T09:28:43.141 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.548+0000 7f6db77fe640 1 -- 172.21.15.1:0/2465392911 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f6dc81950f0 con 0x7f6dc81065b0 2024-09-19T09:28:43.141 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.550+0000 7f6dcca8f640 1 -- 172.21.15.1:0/2465392911 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7f6db0039050 msgr2=0x7f6db003b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:43.141 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.550+0000 7f6dcca8f640 1 --2- 172.21.15.1:0/2465392911 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7f6db0039050 0x7f6db003b510 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc0098c0 tx=0x7f6dbc006db0 comp rx=0 tx=0).stop 2024-09-19T09:28:43.141 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.550+0000 7f6dcca8f640 1 -- 172.21.15.1:0/2465392911 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6dc81065b0 msgr2=0x7f6dc81917e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:43.141 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.550+0000 7f6dcca8f640 1 --2- 172.21.15.1:0/2465392911 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6dc81065b0 0x7f6dc81917e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6db8009940 tx=0x7f6db80326e0 comp rx=0 tx=0).stop 2024-09-19T09:28:43.141 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.550+0000 7f6dcca8f640 1 -- 172.21.15.1:0/2465392911 shutdown_connections 2024-09-19T09:28:43.141 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.550+0000 7f6dcca8f640 1 --2- 172.21.15.1:0/2465392911 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7f6db0039050 0x7f6db003b510 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:43.141 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.550+0000 7f6dcca8f640 1 --2- 172.21.15.1:0/2465392911 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6dc81065b0 0x7f6dc81917e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:43.142 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.550+0000 7f6dcca8f640 1 -- 172.21.15.1:0/2465392911 >> 172.21.15.1:0/2465392911 conn(0x7f6dc8101d80 msgr2=0x7f6dc8102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:43.142 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.550+0000 7f6dcca8f640 1 -- 172.21.15.1:0/2465392911 shutdown_connections 2024-09-19T09:28:43.142 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:42.550+0000 7f6dcca8f640 1 -- 172.21.15.1:0/2465392911 wait complete. 2024-09-19T09:28:43.142 INFO:teuthology.orchestra.run.smithi001.stdout:mgr is available 2024-09-19T09:28:43.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:43 smithi001 ceph-mon[31225]: mgrmap e4: x(active, since 2s) 2024-09-19T09:28:43.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:43 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1809208574' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T09:28:44.288 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T09:28:44.289 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T09:28:44.289 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout fsid = 57238232-7669-11ef-bceb-c7b262605968 2024-09-19T09:28:44.289 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.1:3300,v1:172.21.15.1:6789] 2024-09-19T09:28:44.289 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T09:28:44.289 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T09:28:44.289 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T09:28:44.289 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T09:28:44.289 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T09:28:44.289 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T09:28:44.289 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T09:28:44.289 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 2024-09-19T09:28:44.290 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T09:28:44.290 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout filestore_flush_min = 0 2024-09-19T09:28:44.291 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T09:28:44.291 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T09:28:44.291 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T09:28:44.291 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T09:28:44.292 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T09:28:44.292 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.530+0000 7f9e50451640 1 Processor -- start 2024-09-19T09:28:44.292 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.530+0000 7f9e50451640 1 -- start start 2024-09-19T09:28:44.292 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.531+0000 7f9e50451640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e481065a0 0x7f9e481069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:44.292 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.531+0000 7f9e50451640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9e48106f70 con 0x7f9e481065a0 2024-09-19T09:28:44.292 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.531+0000 7f9e4e1ed640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e481065a0 0x7f9e481069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:44.292 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.531+0000 7f9e4e1ed640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e481065a0 0x7f9e481069a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49560/0 (socket says 172.21.15.1:49560) 2024-09-19T09:28:44.292 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.531+0000 7f9e4e1ed640 1 -- 172.21.15.1:0/4262173146 learned_addr learned my addr 172.21.15.1:0/4262173146 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:28:44.292 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.531+0000 7f9e4e1ed640 1 -- 172.21.15.1:0/4262173146 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e481077a0 con 0x7f9e481065a0 2024-09-19T09:28:44.292 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.532+0000 7f9e4e1ed640 1 --2- 172.21.15.1:0/4262173146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e481065a0 0x7f9e481069a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9e44009820 tx=0x7f9e4402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd7fc499a8ae8d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:44.292 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.532+0000 7f9e4d1eb640 1 -- 172.21.15.1:0/4262173146 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e44037070 con 0x7f9e481065a0 2024-09-19T09:28:44.292 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.532+0000 7f9e4d1eb640 1 -- 172.21.15.1:0/4262173146 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9e44032900 con 0x7f9e481065a0 2024-09-19T09:28:44.292 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.532+0000 7f9e4d1eb640 1 -- 172.21.15.1:0/4262173146 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e44030850 con 0x7f9e481065a0 2024-09-19T09:28:44.293 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.533+0000 7f9e50451640 1 -- 172.21.15.1:0/4262173146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e481065a0 msgr2=0x7f9e481069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:44.293 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.533+0000 7f9e50451640 1 --2- 172.21.15.1:0/4262173146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e481065a0 0x7f9e481069a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9e44009820 tx=0x7f9e4402a270 comp rx=0 tx=0).stop 2024-09-19T09:28:44.293 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.533+0000 7f9e50451640 1 -- 172.21.15.1:0/4262173146 shutdown_connections 2024-09-19T09:28:44.293 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.533+0000 7f9e50451640 1 --2- 172.21.15.1:0/4262173146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e481065a0 0x7f9e481069a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.293 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.533+0000 7f9e50451640 1 -- 172.21.15.1:0/4262173146 >> 172.21.15.1:0/4262173146 conn(0x7f9e48101d50 msgr2=0x7f9e48104170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:44.293 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.533+0000 7f9e50451640 1 -- 172.21.15.1:0/4262173146 shutdown_connections 2024-09-19T09:28:44.293 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.533+0000 7f9e50451640 1 -- 172.21.15.1:0/4262173146 wait complete. 2024-09-19T09:28:44.293 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.533+0000 7f9e50451640 1 Processor -- start 2024-09-19T09:28:44.293 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.533+0000 7f9e50451640 1 -- start start 2024-09-19T09:28:44.293 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.534+0000 7f9e50451640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e481065a0 0x7f9e4819b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:44.293 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.534+0000 7f9e50451640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9e4810ab50 con 0x7f9e481065a0 2024-09-19T09:28:44.293 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.534+0000 7f9e4e1ed640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e481065a0 0x7f9e4819b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:44.293 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.534+0000 7f9e4e1ed640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e481065a0 0x7f9e4819b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49564/0 (socket says 172.21.15.1:49564) 2024-09-19T09:28:44.293 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.534+0000 7f9e4e1ed640 1 -- 172.21.15.1:0/1809208574 learned_addr learned my addr 172.21.15.1:0/1809208574 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:28:44.294 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.534+0000 7f9e4e1ed640 1 -- 172.21.15.1:0/1809208574 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e4819bc50 con 0x7f9e481065a0 2024-09-19T09:28:44.294 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.534+0000 7f9e4e1ed640 1 --2- 172.21.15.1:0/1809208574 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e481065a0 0x7f9e4819b710 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9e44009940 tx=0x7f9e440326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:44.294 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.534+0000 7f9e3f7fe640 1 -- 172.21.15.1:0/1809208574 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e44042070 con 0x7f9e481065a0 2024-09-19T09:28:44.294 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.534+0000 7f9e3f7fe640 1 -- 172.21.15.1:0/1809208574 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9e44032be0 con 0x7f9e481065a0 2024-09-19T09:28:44.294 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.534+0000 7f9e3f7fe640 1 -- 172.21.15.1:0/1809208574 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e44037040 con 0x7f9e481065a0 2024-09-19T09:28:44.294 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.534+0000 7f9e50451640 1 -- 172.21.15.1:0/1809208574 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e4819bee0 con 0x7f9e481065a0 2024-09-19T09:28:44.294 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.534+0000 7f9e50451640 1 -- 172.21.15.1:0/1809208574 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e4819ebd0 con 0x7f9e481065a0 2024-09-19T09:28:44.294 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.535+0000 7f9e3f7fe640 1 -- 172.21.15.1:0/1809208574 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f9e44045070 con 0x7f9e481065a0 2024-09-19T09:28:44.294 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.535+0000 7f9e3f7fe640 1 --2- 172.21.15.1:0/1809208574 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7f9e34039160 0x7f9e3403b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:44.294 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.535+0000 7f9e3f7fe640 1 -- 172.21.15.1:0/1809208574 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9e4406c0c0 con 0x7f9e481065a0 2024-09-19T09:28:44.294 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.535+0000 7f9e50451640 1 -- 172.21.15.1:0/1809208574 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e4810acd0 con 0x7f9e481065a0 2024-09-19T09:28:44.294 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.535+0000 7f9e4d9ec640 1 --2- 172.21.15.1:0/1809208574 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7f9e34039160 0x7f9e3403b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:44.294 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.536+0000 7f9e4d9ec640 1 --2- 172.21.15.1:0/1809208574 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7f9e34039160 0x7f9e3403b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9e380098c0 tx=0x7f9e38006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:44.295 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.540+0000 7f9e3f7fe640 1 -- 172.21.15.1:0/1809208574 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9e44032d90 con 0x7f9e481065a0 2024-09-19T09:28:44.295 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.720+0000 7f9e50451640 1 -- 172.21.15.1:0/1809208574 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f9e48106a20 con 0x7f9e481065a0 2024-09-19T09:28:44.295 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.721+0000 7f9e3f7fe640 1 -- 172.21.15.1:0/1809208574 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+452 (secure 0 0 0) 0x7f9e4402fd90 con 0x7f9e481065a0 2024-09-19T09:28:44.295 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.723+0000 7f9e50451640 1 -- 172.21.15.1:0/1809208574 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7f9e34039160 msgr2=0x7f9e3403b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:44.295 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.723+0000 7f9e50451640 1 --2- 172.21.15.1:0/1809208574 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7f9e34039160 0x7f9e3403b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9e380098c0 tx=0x7f9e38006db0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.295 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.723+0000 7f9e50451640 1 -- 172.21.15.1:0/1809208574 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e481065a0 msgr2=0x7f9e4819b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:44.295 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.723+0000 7f9e50451640 1 --2- 172.21.15.1:0/1809208574 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e481065a0 0x7f9e4819b710 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9e44009940 tx=0x7f9e440326e0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.295 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.723+0000 7f9e50451640 1 -- 172.21.15.1:0/1809208574 shutdown_connections 2024-09-19T09:28:44.295 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.723+0000 7f9e50451640 1 --2- 172.21.15.1:0/1809208574 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7f9e34039160 0x7f9e3403b620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.295 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.723+0000 7f9e50451640 1 --2- 172.21.15.1:0/1809208574 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9e481065a0 0x7f9e4819b710 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:44.295 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.723+0000 7f9e50451640 1 -- 172.21.15.1:0/1809208574 >> 172.21.15.1:0/1809208574 conn(0x7f9e48101d50 msgr2=0x7f9e48102cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:44.295 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.724+0000 7f9e50451640 1 -- 172.21.15.1:0/1809208574 shutdown_connections 2024-09-19T09:28:44.295 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:43.724+0000 7f9e50451640 1 -- 172.21.15.1:0/1809208574 wait complete. 2024-09-19T09:28:44.295 INFO:teuthology.orchestra.run.smithi001.stdout:Enabling cephadm module... 2024-09-19T09:28:45.180 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:44 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/3580785647' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-19T09:28:45.181 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:45 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: ignoring --setuser ceph since I am not root 2024-09-19T09:28:45.181 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:45 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: ignoring --setgroup ceph since I am not root 2024-09-19T09:28:45.181 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:45 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:45.120+0000 7f9831072040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T09:28:45.181 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:45 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:45.179+0000 7f9831072040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:28:45.497 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:45 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:45.334+0000 7f9831072040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:28:45.497 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:45 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:45.404+0000 7f9831072040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:28:45.552 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.690+0000 7f5462102640 1 Processor -- start 2024-09-19T09:28:45.552 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.690+0000 7f5462102640 1 -- start start 2024-09-19T09:28:45.553 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.690+0000 7f5462102640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f545c107710 0x7f545c107b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:45.553 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.690+0000 7f5462102640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f545c1080e0 con 0x7f545c107710 2024-09-19T09:28:45.553 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.690+0000 7f545b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f545c107710 0x7f545c107b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:45.553 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.690+0000 7f545b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f545c107710 0x7f545c107b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49580/0 (socket says 172.21.15.1:49580) 2024-09-19T09:28:45.553 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.690+0000 7f545b7fe640 1 -- 172.21.15.1:0/1871042794 learned_addr learned my addr 172.21.15.1:0/1871042794 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:28:45.553 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.690+0000 7f545b7fe640 1 -- 172.21.15.1:0/1871042794 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f545c108910 con 0x7f545c107710 2024-09-19T09:28:45.553 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.692+0000 7f545b7fe640 1 --2- 172.21.15.1:0/1871042794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f545c107710 0x7f545c107b10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f544c009820 tx=0x7f544c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca8c10be391b2fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:45.553 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.692+0000 7f545a7fc640 1 -- 172.21.15.1:0/1871042794 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f544c037070 con 0x7f545c107710 2024-09-19T09:28:45.553 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.692+0000 7f545a7fc640 1 -- 172.21.15.1:0/1871042794 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f544c032900 con 0x7f545c107710 2024-09-19T09:28:45.553 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.692+0000 7f545a7fc640 1 -- 172.21.15.1:0/1871042794 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f544c030850 con 0x7f545c107710 2024-09-19T09:28:45.553 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.692+0000 7f5462102640 1 -- 172.21.15.1:0/1871042794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f545c107710 msgr2=0x7f545c107b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:45.553 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.692+0000 7f5462102640 1 --2- 172.21.15.1:0/1871042794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f545c107710 0x7f545c107b10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f544c009820 tx=0x7f544c02a270 comp rx=0 tx=0).stop 2024-09-19T09:28:45.554 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.692+0000 7f5462102640 1 -- 172.21.15.1:0/1871042794 shutdown_connections 2024-09-19T09:28:45.554 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.692+0000 7f5462102640 1 --2- 172.21.15.1:0/1871042794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f545c107710 0x7f545c107b10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:45.554 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.692+0000 7f5462102640 1 -- 172.21.15.1:0/1871042794 >> 172.21.15.1:0/1871042794 conn(0x7f545c102f20 msgr2=0x7f545c105340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:45.554 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.692+0000 7f5462102640 1 -- 172.21.15.1:0/1871042794 shutdown_connections 2024-09-19T09:28:45.554 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.692+0000 7f5462102640 1 -- 172.21.15.1:0/1871042794 wait complete. 2024-09-19T09:28:45.554 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.692+0000 7f5462102640 1 Processor -- start 2024-09-19T09:28:45.554 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.693+0000 7f5462102640 1 -- start start 2024-09-19T09:28:45.554 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.693+0000 7f5462102640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f545c107710 0x7f545c19b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:45.554 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.693+0000 7f5462102640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f545c10bcc0 con 0x7f545c107710 2024-09-19T09:28:45.554 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.693+0000 7f545b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f545c107710 0x7f545c19b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:45.554 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.693+0000 7f545b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f545c107710 0x7f545c19b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49588/0 (socket says 172.21.15.1:49588) 2024-09-19T09:28:45.554 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.693+0000 7f545b7fe640 1 -- 172.21.15.1:0/3580785647 learned_addr learned my addr 172.21.15.1:0/3580785647 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:28:45.554 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.693+0000 7f545b7fe640 1 -- 172.21.15.1:0/3580785647 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f545c19bbd0 con 0x7f545c107710 2024-09-19T09:28:45.554 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.693+0000 7f545b7fe640 1 --2- 172.21.15.1:0/3580785647 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f545c107710 0x7f545c19b690 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f544c009940 tx=0x7f544c032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:45.555 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.694+0000 7f5458ff9640 1 -- 172.21.15.1:0/3580785647 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f544c042070 con 0x7f545c107710 2024-09-19T09:28:45.555 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.694+0000 7f5462102640 1 -- 172.21.15.1:0/3580785647 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f545c19be60 con 0x7f545c107710 2024-09-19T09:28:45.555 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.694+0000 7f5458ff9640 1 -- 172.21.15.1:0/3580785647 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f544c0308c0 con 0x7f545c107710 2024-09-19T09:28:45.555 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.694+0000 7f5458ff9640 1 -- 172.21.15.1:0/3580785647 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f544c037040 con 0x7f545c107710 2024-09-19T09:28:45.555 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.694+0000 7f5462102640 1 -- 172.21.15.1:0/3580785647 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f545c19eb50 con 0x7f545c107710 2024-09-19T09:28:45.555 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.696+0000 7f5458ff9640 1 -- 172.21.15.1:0/3580785647 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f544c045070 con 0x7f545c107710 2024-09-19T09:28:45.555 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.696+0000 7f5458ff9640 1 --2- 172.21.15.1:0/3580785647 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7f5444039160 0x7f544403b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:45.555 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.696+0000 7f5462102640 1 -- 172.21.15.1:0/3580785647 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f545c107b90 con 0x7f545c107710 2024-09-19T09:28:45.555 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.696+0000 7f5458ff9640 1 -- 172.21.15.1:0/3580785647 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f544c06c2a0 con 0x7f545c107710 2024-09-19T09:28:45.555 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.696+0000 7f545affd640 1 --2- 172.21.15.1:0/3580785647 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7f5444039160 0x7f544403b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:45.555 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.696+0000 7f545affd640 1 --2- 172.21.15.1:0/3580785647 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7f5444039160 0x7f544403b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f54500098c0 tx=0x7f5450006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:45.555 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.701+0000 7f5458ff9640 1 -- 172.21.15.1:0/3580785647 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f544c06bcc0 con 0x7f545c107710 2024-09-19T09:28:45.556 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.925+0000 7f5462102640 1 -- 172.21.15.1:0/3580785647 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f545c19f1d0 con 0x7f545c107710 2024-09-19T09:28:45.556 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.976+0000 7f5458ff9640 1 -- 172.21.15.1:0/3580785647 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f544c03cd90 con 0x7f545c107710 2024-09-19T09:28:45.556 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.977+0000 7f5458ff9640 1 -- 172.21.15.1:0/3580785647 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f544c0327b0 con 0x7f545c107710 2024-09-19T09:28:45.556 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.979+0000 7f5462102640 1 -- 172.21.15.1:0/3580785647 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7f5444039160 msgr2=0x7f544403b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:45.556 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.979+0000 7f5462102640 1 --2- 172.21.15.1:0/3580785647 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7f5444039160 0x7f544403b620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f54500098c0 tx=0x7f5450006db0 comp rx=0 tx=0).stop 2024-09-19T09:28:45.556 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.979+0000 7f5462102640 1 -- 172.21.15.1:0/3580785647 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f545c107710 msgr2=0x7f545c19b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:45.556 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.979+0000 7f5462102640 1 --2- 172.21.15.1:0/3580785647 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f545c107710 0x7f545c19b690 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f544c009940 tx=0x7f544c032ce0 comp rx=0 tx=0).stop 2024-09-19T09:28:45.556 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.979+0000 7f5462102640 1 -- 172.21.15.1:0/3580785647 shutdown_connections 2024-09-19T09:28:45.556 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.979+0000 7f5462102640 1 --2- 172.21.15.1:0/3580785647 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7f5444039160 0x7f544403b620 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:45.556 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.979+0000 7f5462102640 1 --2- 172.21.15.1:0/3580785647 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f545c107710 0x7f545c19b690 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:45.557 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.979+0000 7f5462102640 1 -- 172.21.15.1:0/3580785647 >> 172.21.15.1:0/3580785647 conn(0x7f545c102f20 msgr2=0x7f545c103a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:45.557 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.979+0000 7f5462102640 1 -- 172.21.15.1:0/3580785647 shutdown_connections 2024-09-19T09:28:45.557 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:44.979+0000 7f5462102640 1 -- 172.21.15.1:0/3580785647 wait complete. 2024-09-19T09:28:45.812 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:45 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:45.562+0000 7f9831072040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:28:45.812 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:45 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:45.712+0000 7f9831072040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:28:46.124 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:46 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:46.059+0000 7f9831072040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:28:46.125 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:45 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/3580785647' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-19T09:28:46.125 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:45 smithi001 ceph-mon[31225]: mgrmap e5: x(active, since 4s) 2024-09-19T09:28:46.497 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:46 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:46.123+0000 7f9831072040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:28:46.497 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:46 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:46.323+0000 7f9831072040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:28:46.817 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:28:46.817 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-19T09:28:46.817 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T09:28:46.817 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T09:28:46.817 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T09:28:46.818 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:28:46.818 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.991+0000 7f65f37d2640 1 Processor -- start 2024-09-19T09:28:46.818 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.991+0000 7f65f37d2640 1 -- start start 2024-09-19T09:28:46.818 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.991+0000 7f65f37d2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65ec1065a0 0x7f65ec1069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:46.818 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.991+0000 7f65f37d2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f65ec106f70 con 0x7f65ec1065a0 2024-09-19T09:28:46.818 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.992+0000 7f65f156e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65ec1065a0 0x7f65ec1069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:46.818 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.992+0000 7f65f156e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65ec1065a0 0x7f65ec1069a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37806/0 (socket says 172.21.15.1:37806) 2024-09-19T09:28:46.818 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.992+0000 7f65f156e640 1 -- 172.21.15.1:0/1066571917 learned_addr learned my addr 172.21.15.1:0/1066571917 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:28:46.818 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.992+0000 7f65f156e640 1 -- 172.21.15.1:0/1066571917 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65ec1077a0 con 0x7f65ec1065a0 2024-09-19T09:28:46.818 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.993+0000 7f65f156e640 1 --2- 172.21.15.1:0/1066571917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65ec1065a0 0x7f65ec1069a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f65e8009820 tx=0x7f65e802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53007a1f3ca2c758 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:46.818 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.993+0000 7f65e3fff640 1 -- 172.21.15.1:0/1066571917 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65e8037070 con 0x7f65ec1065a0 2024-09-19T09:28:46.818 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.993+0000 7f65e3fff640 1 -- 172.21.15.1:0/1066571917 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f65e8032900 con 0x7f65ec1065a0 2024-09-19T09:28:46.818 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.993+0000 7f65e3fff640 1 -- 172.21.15.1:0/1066571917 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65e8030850 con 0x7f65ec1065a0 2024-09-19T09:28:46.819 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.993+0000 7f65f37d2640 1 -- 172.21.15.1:0/1066571917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65ec1065a0 msgr2=0x7f65ec1069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:46.819 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.993+0000 7f65f37d2640 1 --2- 172.21.15.1:0/1066571917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65ec1065a0 0x7f65ec1069a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f65e8009820 tx=0x7f65e802a270 comp rx=0 tx=0).stop 2024-09-19T09:28:46.819 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.994+0000 7f65f37d2640 1 -- 172.21.15.1:0/1066571917 shutdown_connections 2024-09-19T09:28:46.819 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.994+0000 7f65f37d2640 1 --2- 172.21.15.1:0/1066571917 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65ec1065a0 0x7f65ec1069a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:46.819 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.994+0000 7f65f37d2640 1 -- 172.21.15.1:0/1066571917 >> 172.21.15.1:0/1066571917 conn(0x7f65ec101d50 msgr2=0x7f65ec104170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:46.819 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.994+0000 7f65f37d2640 1 -- 172.21.15.1:0/1066571917 shutdown_connections 2024-09-19T09:28:46.819 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.994+0000 7f65f37d2640 1 -- 172.21.15.1:0/1066571917 wait complete. 2024-09-19T09:28:46.819 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.994+0000 7f65f37d2640 1 Processor -- start 2024-09-19T09:28:46.819 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.994+0000 7f65f37d2640 1 -- start start 2024-09-19T09:28:46.819 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.994+0000 7f65f37d2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65ec1065a0 0x7f65ec19b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:46.820 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.994+0000 7f65f37d2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f65ec10ab50 con 0x7f65ec1065a0 2024-09-19T09:28:46.820 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.995+0000 7f65f156e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65ec1065a0 0x7f65ec19b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:46.820 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.995+0000 7f65f156e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65ec1065a0 0x7f65ec19b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37808/0 (socket says 172.21.15.1:37808) 2024-09-19T09:28:46.820 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.995+0000 7f65f156e640 1 -- 172.21.15.1:0/2648607374 learned_addr learned my addr 172.21.15.1:0/2648607374 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:28:46.820 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.995+0000 7f65f156e640 1 -- 172.21.15.1:0/2648607374 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65ec19bca0 con 0x7f65ec1065a0 2024-09-19T09:28:46.820 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.995+0000 7f65f156e640 1 --2- 172.21.15.1:0/2648607374 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65ec1065a0 0x7f65ec19b760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f65e80097f0 tx=0x7f65e8030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:46.820 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.995+0000 7f65e27fc640 1 -- 172.21.15.1:0/2648607374 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65e8042070 con 0x7f65ec1065a0 2024-09-19T09:28:46.820 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.995+0000 7f65e27fc640 1 -- 172.21.15.1:0/2648607374 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f65e8032ca0 con 0x7f65ec1065a0 2024-09-19T09:28:46.820 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.995+0000 7f65f37d2640 1 -- 172.21.15.1:0/2648607374 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65ec19bf30 con 0x7f65ec1065a0 2024-09-19T09:28:46.820 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.995+0000 7f65e27fc640 1 -- 172.21.15.1:0/2648607374 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65e8037040 con 0x7f65ec1065a0 2024-09-19T09:28:46.820 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.995+0000 7f65f37d2640 1 -- 172.21.15.1:0/2648607374 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65ec19ec20 con 0x7f65ec1065a0 2024-09-19T09:28:46.820 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.996+0000 7f65e27fc640 1 -- 172.21.15.1:0/2648607374 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f65e8045070 con 0x7f65ec1065a0 2024-09-19T09:28:46.820 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.996+0000 7f65e27fc640 1 --2- 172.21.15.1:0/2648607374 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7f65d80391b0 0x7f65d803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:46.821 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.996+0000 7f65e27fc640 1 -- 172.21.15.1:0/2648607374 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f65e806c400 con 0x7f65ec1065a0 2024-09-19T09:28:46.821 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.996+0000 7f65f0d6d640 1 -- 172.21.15.1:0/2648607374 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7f65d80391b0 msgr2=0x7f65d803b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/1296304385 2024-09-19T09:28:46.821 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.996+0000 7f65f0d6d640 1 --2- 172.21.15.1:0/2648607374 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7f65d80391b0 0x7f65d803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:28:46.821 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:45.997+0000 7f65f37d2640 1 -- 172.21.15.1:0/2648607374 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65ec10acd0 con 0x7f65ec1065a0 2024-09-19T09:28:46.821 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:46.002+0000 7f65e27fc640 1 -- 172.21.15.1:0/2648607374 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f65e806be20 con 0x7f65ec1065a0 2024-09-19T09:28:46.821 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:46.197+0000 7f65f0d6d640 1 -- 172.21.15.1:0/2648607374 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7f65d80391b0 msgr2=0x7f65d803b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/1296304385 2024-09-19T09:28:46.821 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:46.197+0000 7f65f0d6d640 1 --2- 172.21.15.1:0/2648607374 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7f65d80391b0 0x7f65d803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:28:46.821 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:46.240+0000 7f65f37d2640 1 -- 172.21.15.1:0/2648607374 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f65ec02d860 con 0x7f65ec1065a0 2024-09-19T09:28:46.821 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:46.241+0000 7f65e27fc640 1 -- 172.21.15.1:0/2648607374 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f65e803ccd0 con 0x7f65ec1065a0 2024-09-19T09:28:46.822 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:46.243+0000 7f65f37d2640 1 -- 172.21.15.1:0/2648607374 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7f65d80391b0 msgr2=0x7f65d803b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:28:46.822 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:46.243+0000 7f65f37d2640 1 --2- 172.21.15.1:0/2648607374 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7f65d80391b0 0x7f65d803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:46.822 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:46.243+0000 7f65f37d2640 1 -- 172.21.15.1:0/2648607374 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65ec1065a0 msgr2=0x7f65ec19b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:46.822 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:46.243+0000 7f65f37d2640 1 --2- 172.21.15.1:0/2648607374 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65ec1065a0 0x7f65ec19b760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f65e80097f0 tx=0x7f65e8030ec0 comp rx=0 tx=0).stop 2024-09-19T09:28:46.822 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:46.243+0000 7f65f37d2640 1 -- 172.21.15.1:0/2648607374 shutdown_connections 2024-09-19T09:28:46.822 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:46.243+0000 7f65f37d2640 1 --2- 172.21.15.1:0/2648607374 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7f65d80391b0 0x7f65d803b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:46.822 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:46.243+0000 7f65f37d2640 1 --2- 172.21.15.1:0/2648607374 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65ec1065a0 0x7f65ec19b760 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:46.822 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:46.243+0000 7f65f37d2640 1 -- 172.21.15.1:0/2648607374 >> 172.21.15.1:0/2648607374 conn(0x7f65ec101d50 msgr2=0x7f65ec102cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:46.822 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:46.243+0000 7f65f37d2640 1 -- 172.21.15.1:0/2648607374 shutdown_connections 2024-09-19T09:28:46.822 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:46.243+0000 7f65f37d2640 1 -- 172.21.15.1:0/2648607374 wait complete. 2024-09-19T09:28:46.822 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for the mgr to restart... 2024-09-19T09:28:46.822 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mgr epoch 5... 2024-09-19T09:28:47.145 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:46 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/2648607374' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T09:28:47.433 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:47 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:47.260+0000 7f9831072040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:28:47.433 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:47 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:47.331+0000 7f9831072040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:28:48.359 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:48 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:48.083+0000 7f9831072040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:28:48.359 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:48 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:48.205+0000 7f9831072040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:28:48.636 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:48 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:48.357+0000 7f9831072040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:28:48.636 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:48 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:48.423+0000 7f9831072040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:28:48.636 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:48 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:48.583+0000 7f9831072040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:28:48.891 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:48 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:48.656+0000 7f9831072040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:28:48.891 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:48 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:48.721+0000 7f9831072040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:28:48.891 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:48 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:48.889+0000 7f9831072040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:28:49.180 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:48 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:48.958+0000 7f9831072040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:28:49.180 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:49 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:49.028+0000 7f9831072040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:28:49.180 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:49 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:49.115+0000 7f9831072040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:28:49.180 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:49 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:49.178+0000 7f9831072040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:28:49.439 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:49 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:49.240+0000 7f9831072040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:28:50.497 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:50 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:50.072+0000 7f9831072040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:28:50.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:50 smithi001 ceph-mon[31225]: Active manager daemon x restarted 2024-09-19T09:28:50.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:50 smithi001 ceph-mon[31225]: Activating manager daemon x 2024-09-19T09:28:50.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:50 smithi001 ceph-mon[31225]: osdmap e2: 0 total, 0 up, 0 in 2024-09-19T09:28:50.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:50 smithi001 ceph-mon[31225]: mgrmap e6: x(active, starting, since 0.00326615s) 2024-09-19T09:28:50.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:50 smithi001 ceph-mon[31225]: from='mgr.14118 172.21.15.1:0/3271285817' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:28:50.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:50 smithi001 ceph-mon[31225]: from='mgr.14118 172.21.15.1:0/3271285817' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T09:28:50.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:50 smithi001 ceph-mon[31225]: from='mgr.14118 172.21.15.1:0/3271285817' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:28:50.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:50 smithi001 ceph-mon[31225]: from='mgr.14118 172.21.15.1:0/3271285817' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:28:50.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:50 smithi001 ceph-mon[31225]: from='mgr.14118 172.21.15.1:0/3271285817' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:28:50.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:50 smithi001 ceph-mon[31225]: Manager daemon x is now available 2024-09-19T09:28:50.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:50 smithi001 ceph-mon[31225]: from='mgr.14118 172.21.15.1:0/3271285817' entity='mgr.x' 2024-09-19T09:28:50.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:50 smithi001 ceph-mon[31225]: from='mgr.14118 172.21.15.1:0/3271285817' entity='mgr.x' 2024-09-19T09:28:50.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:50 smithi001 ceph-mon[31225]: from='mgr.14118 172.21.15.1:0/3271285817' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:28:50.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:50 smithi001 ceph-mon[31225]: from='mgr.14118 172.21.15.1:0/3271285817' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:28:50.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:50 smithi001 ceph-mon[31225]: from='mgr.14118 172.21.15.1:0/3271285817' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:28:50.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:50 smithi001 ceph-mon[31225]: from='mgr.14118 172.21.15.1:0/3271285817' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T09:28:51.659 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:28:51.669 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-19T09:28:51.670 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T09:28:51.670 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:28:51.670 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.225+0000 7fa798da2640 1 Processor -- start 2024-09-19T09:28:51.670 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.225+0000 7fa798da2640 1 -- start start 2024-09-19T09:28:51.670 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.225+0000 7fa798da2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa794105db0 0x7fa7941061b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:51.670 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.225+0000 7fa798da2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa79407be10 con 0x7fa794105db0 2024-09-19T09:28:51.670 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.226+0000 7fa7937fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa794105db0 0x7fa7941061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:51.670 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.226+0000 7fa7937fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa794105db0 0x7fa7941061b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37814/0 (socket says 172.21.15.1:37814) 2024-09-19T09:28:51.670 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.226+0000 7fa7937fe640 1 -- 172.21.15.1:0/1608450363 learned_addr learned my addr 172.21.15.1:0/1608450363 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:28:51.670 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.226+0000 7fa7937fe640 1 -- 172.21.15.1:0/1608450363 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7941066f0 con 0x7fa794105db0 2024-09-19T09:28:51.671 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.227+0000 7fa7937fe640 1 --2- 172.21.15.1:0/1608450363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa794105db0 0x7fa7941061b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa784009820 tx=0x7fa78402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c272bd96ec4c0f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:51.671 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.227+0000 7fa7927fc640 1 -- 172.21.15.1:0/1608450363 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa784037070 con 0x7fa794105db0 2024-09-19T09:28:51.671 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.227+0000 7fa7927fc640 1 -- 172.21.15.1:0/1608450363 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa784032900 con 0x7fa794105db0 2024-09-19T09:28:51.671 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.227+0000 7fa7927fc640 1 -- 172.21.15.1:0/1608450363 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa784030850 con 0x7fa794105db0 2024-09-19T09:28:51.671 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.227+0000 7fa798da2640 1 -- 172.21.15.1:0/1608450363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa794105db0 msgr2=0x7fa7941061b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:51.671 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.227+0000 7fa798da2640 1 --2- 172.21.15.1:0/1608450363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa794105db0 0x7fa7941061b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa784009820 tx=0x7fa78402a270 comp rx=0 tx=0).stop 2024-09-19T09:28:51.671 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.228+0000 7fa798da2640 1 -- 172.21.15.1:0/1608450363 shutdown_connections 2024-09-19T09:28:51.671 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.228+0000 7fa798da2640 1 --2- 172.21.15.1:0/1608450363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa794105db0 0x7fa7941061b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:51.672 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.228+0000 7fa798da2640 1 -- 172.21.15.1:0/1608450363 >> 172.21.15.1:0/1608450363 conn(0x7fa794101ba0 msgr2=0x7fa794103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:51.672 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.228+0000 7fa798da2640 1 -- 172.21.15.1:0/1608450363 shutdown_connections 2024-09-19T09:28:51.672 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.228+0000 7fa798da2640 1 -- 172.21.15.1:0/1608450363 wait complete. 2024-09-19T09:28:51.672 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.228+0000 7fa798da2640 1 Processor -- start 2024-09-19T09:28:51.672 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.228+0000 7fa798da2640 1 -- start start 2024-09-19T09:28:51.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.229+0000 7fa798da2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa794105db0 0x7fa79419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:51.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.229+0000 7fa798da2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa7941077f0 con 0x7fa794105db0 2024-09-19T09:28:51.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.229+0000 7fa7937fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa794105db0 0x7fa79419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:51.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.229+0000 7fa7937fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa794105db0 0x7fa79419d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37824/0 (socket says 172.21.15.1:37824) 2024-09-19T09:28:51.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.229+0000 7fa7937fe640 1 -- 172.21.15.1:0/1079147437 learned_addr learned my addr 172.21.15.1:0/1079147437 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:28:51.673 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.229+0000 7fa7937fe640 1 -- 172.21.15.1:0/1079147437 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa79419dbe0 con 0x7fa794105db0 2024-09-19T09:28:51.674 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.229+0000 7fa7937fe640 1 --2- 172.21.15.1:0/1079147437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa794105db0 0x7fa79419d6a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa784032ce0 tx=0x7fa784032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:51.674 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.229+0000 7fa790ff9640 1 -- 172.21.15.1:0/1079147437 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa784042070 con 0x7fa794105db0 2024-09-19T09:28:51.674 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.229+0000 7fa790ff9640 1 -- 172.21.15.1:0/1079147437 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa7840308c0 con 0x7fa794105db0 2024-09-19T09:28:51.674 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.229+0000 7fa798da2640 1 -- 172.21.15.1:0/1079147437 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa79419de70 con 0x7fa794105db0 2024-09-19T09:28:51.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.229+0000 7fa790ff9640 1 -- 172.21.15.1:0/1079147437 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa784037040 con 0x7fa794105db0 2024-09-19T09:28:51.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.229+0000 7fa798da2640 1 -- 172.21.15.1:0/1079147437 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7941a0b60 con 0x7fa794105db0 2024-09-19T09:28:51.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.230+0000 7fa790ff9640 1 -- 172.21.15.1:0/1079147437 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fa784045070 con 0x7fa794105db0 2024-09-19T09:28:51.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.230+0000 7fa790ff9640 1 --2- 172.21.15.1:0/1079147437 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7fa780039200 0x7fa78003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:51.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.230+0000 7fa790ff9640 1 -- 172.21.15.1:0/1079147437 --> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa78003bdd0 con 0x7fa780039200 2024-09-19T09:28:51.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.230+0000 7fa790ff9640 1 -- 172.21.15.1:0/1079147437 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa78406c270 con 0x7fa794105db0 2024-09-19T09:28:51.675 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.230+0000 7fa792ffd640 1 -- 172.21.15.1:0/1079147437 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7fa780039200 msgr2=0x7fa78003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/1296304385 2024-09-19T09:28:51.676 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.231+0000 7fa792ffd640 1 --2- 172.21.15.1:0/1079147437 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7fa780039200 0x7fa78003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:28:51.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.432+0000 7fa792ffd640 1 -- 172.21.15.1:0/1079147437 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7fa780039200 msgr2=0x7fa78003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/1296304385 2024-09-19T09:28:51.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.432+0000 7fa792ffd640 1 --2- 172.21.15.1:0/1079147437 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7fa780039200 0x7fa78003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:28:51.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.833+0000 7fa792ffd640 1 -- 172.21.15.1:0/1079147437 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7fa780039200 msgr2=0x7fa78003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/1296304385 2024-09-19T09:28:51.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:47.833+0000 7fa792ffd640 1 --2- 172.21.15.1:0/1079147437 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7fa780039200 0x7fa78003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:28:51.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:48.634+0000 7fa792ffd640 1 -- 172.21.15.1:0/1079147437 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7fa780039200 msgr2=0x7fa78003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/1296304385 2024-09-19T09:28:51.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:48.634+0000 7fa792ffd640 1 --2- 172.21.15.1:0/1079147437 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7fa780039200 0x7fa78003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:28:51.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:50.076+0000 7fa790ff9640 1 -- 172.21.15.1:0/1079147437 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7fa78406adf0 con 0x7fa794105db0 2024-09-19T09:28:51.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:50.076+0000 7fa790ff9640 1 -- 172.21.15.1:0/1079147437 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7fa780039200 msgr2=0x7fa78003b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:28:51.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:50.076+0000 7fa790ff9640 1 --2- 172.21.15.1:0/1079147437 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7fa780039200 0x7fa78003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:51.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:51.077+0000 7fa790ff9640 1 -- 172.21.15.1:0/1079147437 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7fa78403c760 con 0x7fa794105db0 2024-09-19T09:28:51.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:51.077+0000 7fa790ff9640 1 --2- 172.21.15.1:0/1079147437 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7fa78003cb30 0x7fa78003ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:51.677 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:51.077+0000 7fa790ff9640 1 -- 172.21.15.1:0/1079147437 --> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa78003bdd0 con 0x7fa78003cb30 2024-09-19T09:28:51.678 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:51.078+0000 7fa792ffd640 1 --2- 172.21.15.1:0/1079147437 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7fa78003cb30 0x7fa78003ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:51.678 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:51.078+0000 7fa792ffd640 1 --2- 172.21.15.1:0/1079147437 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7fa78003cb30 0x7fa78003ef20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa77c003980 tx=0x7fa77c0092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:51.678 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:51.079+0000 7fa790ff9640 1 -- 172.21.15.1:0/1079147437 <== mgr.14118 v2:172.21.15.1:6800/1028873727 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fa78003bdd0 con 0x7fa78003cb30 2024-09-19T09:28:51.678 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:51.086+0000 7fa798da2640 1 -- 172.21.15.1:0/1079147437 --> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fa7941061b0 con 0x7fa78003cb30 2024-09-19T09:28:51.678 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:51.086+0000 7fa790ff9640 1 -- 172.21.15.1:0/1079147437 <== mgr.14118 v2:172.21.15.1:6800/1028873727 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fa7941061b0 con 0x7fa78003cb30 2024-09-19T09:28:51.678 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:51.086+0000 7fa798da2640 1 -- 172.21.15.1:0/1079147437 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7fa78003cb30 msgr2=0x7fa78003ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:51.678 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:51.086+0000 7fa798da2640 1 --2- 172.21.15.1:0/1079147437 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7fa78003cb30 0x7fa78003ef20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa77c003980 tx=0x7fa77c0092b0 comp rx=0 tx=0).stop 2024-09-19T09:28:51.678 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:51.086+0000 7fa798da2640 1 -- 172.21.15.1:0/1079147437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa794105db0 msgr2=0x7fa79419d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:51.678 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:51.086+0000 7fa798da2640 1 --2- 172.21.15.1:0/1079147437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa794105db0 0x7fa79419d6a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa784032ce0 tx=0x7fa784032d10 comp rx=0 tx=0).stop 2024-09-19T09:28:51.678 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:51.086+0000 7fa798da2640 1 -- 172.21.15.1:0/1079147437 shutdown_connections 2024-09-19T09:28:51.679 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:51.086+0000 7fa798da2640 1 --2- 172.21.15.1:0/1079147437 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7fa78003cb30 0x7fa78003ef20 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:51.679 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:51.086+0000 7fa798da2640 1 --2- 172.21.15.1:0/1079147437 >> [v2:172.21.15.1:6800/1296304385,v1:172.21.15.1:6801/1296304385] conn(0x7fa780039200 0x7fa78003b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:51.679 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:51.086+0000 7fa798da2640 1 --2- 172.21.15.1:0/1079147437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa794105db0 0x7fa79419d6a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:51.679 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:51.087+0000 7fa798da2640 1 -- 172.21.15.1:0/1079147437 >> 172.21.15.1:0/1079147437 conn(0x7fa794101ba0 msgr2=0x7fa7941919c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:51.679 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:51.087+0000 7fa798da2640 1 -- 172.21.15.1:0/1079147437 shutdown_connections 2024-09-19T09:28:51.679 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:51.087+0000 7fa798da2640 1 -- 172.21.15.1:0/1079147437 wait complete. 2024-09-19T09:28:51.679 INFO:teuthology.orchestra.run.smithi001.stdout:mgr epoch 5 is available 2024-09-19T09:28:51.679 INFO:teuthology.orchestra.run.smithi001.stdout:Setting orchestrator backend to cephadm... 2024-09-19T09:28:51.910 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:51 smithi001 ceph-mon[31225]: Found migration_current of "None". Setting to last migration. 2024-09-19T09:28:51.910 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:51 smithi001 ceph-mon[31225]: from='mgr.14118 172.21.15.1:0/3271285817' entity='mgr.x' 2024-09-19T09:28:51.910 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:51 smithi001 ceph-mon[31225]: from='mgr.14118 172.21.15.1:0/3271285817' entity='mgr.x' 2024-09-19T09:28:51.910 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:51 smithi001 ceph-mon[31225]: mgrmap e7: x(active, since 1.00526s) 2024-09-19T09:28:52.847 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:52 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:52.666+0000 7f979838c640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:09:28:52] ENGINE Error in HTTPServer.serve 2024-09-19T09:28:52.847 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:52 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: Traceback (most recent call last): 2024-09-19T09:28:52.848 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:52 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:28:52.848 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:52 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: self._connections.run(self.expiration_interval) 2024-09-19T09:28:52.848 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:52 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:28:52.848 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:52 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: self._run(expiration_interval) 2024-09-19T09:28:52.848 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:52 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:28:52.848 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:52 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:28:52.848 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:52 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:28:52.848 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:52 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:28:52.848 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:52 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:28:52.848 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:52 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: s = self.context.wrap_socket( 2024-09-19T09:28:52.848 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:52 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:28:52.848 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:52 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: return self.sslsocket_class._create( 2024-09-19T09:28:52.848 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:52 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:28:52.849 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:52 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: self.do_handshake() 2024-09-19T09:28:52.849 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:52 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:28:52.849 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:52 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: self._sslobj.do_handshake() 2024-09-19T09:28:52.849 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:52 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:28:52.849 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:52 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:28:52.855 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.090+0000 7f59907d8640 1 Processor -- start 2024-09-19T09:28:52.855 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.090+0000 7f59907d8640 1 -- start start 2024-09-19T09:28:52.855 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.090+0000 7f59907d8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5988108110 0x7f598810a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:52.855 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.090+0000 7f59907d8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f598807be90 con 0x7f5988108110 2024-09-19T09:28:52.855 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.091+0000 7f598e574640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5988108110 0x7f598810a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:52.855 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.091+0000 7f598e574640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5988108110 0x7f598810a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37910/0 (socket says 172.21.15.1:37910) 2024-09-19T09:28:52.855 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.091+0000 7f598e574640 1 -- 172.21.15.1:0/3056696254 learned_addr learned my addr 172.21.15.1:0/3056696254 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:28:52.855 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.091+0000 7f598e574640 1 -- 172.21.15.1:0/3056696254 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f598810aa40 con 0x7f5988108110 2024-09-19T09:28:52.855 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.092+0000 7f598e574640 1 --2- 172.21.15.1:0/3056696254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5988108110 0x7f598810a500 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5984009820 tx=0x7f598402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee75fdc54f3005f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:52.855 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.092+0000 7f598d572640 1 -- 172.21.15.1:0/3056696254 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5984037070 con 0x7f5988108110 2024-09-19T09:28:52.855 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.092+0000 7f598d572640 1 -- 172.21.15.1:0/3056696254 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5984032900 con 0x7f5988108110 2024-09-19T09:28:52.855 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.092+0000 7f598d572640 1 -- 172.21.15.1:0/3056696254 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5984030850 con 0x7f5988108110 2024-09-19T09:28:52.855 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.092+0000 7f59907d8640 1 -- 172.21.15.1:0/3056696254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5988108110 msgr2=0x7f598810a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:52.856 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.092+0000 7f59907d8640 1 --2- 172.21.15.1:0/3056696254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5988108110 0x7f598810a500 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5984009820 tx=0x7f598402a270 comp rx=0 tx=0).stop 2024-09-19T09:28:52.856 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.092+0000 7f59907d8640 1 -- 172.21.15.1:0/3056696254 shutdown_connections 2024-09-19T09:28:52.856 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.093+0000 7f59907d8640 1 --2- 172.21.15.1:0/3056696254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5988108110 0x7f598810a500 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:52.856 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.093+0000 7f59907d8640 1 -- 172.21.15.1:0/3056696254 >> 172.21.15.1:0/3056696254 conn(0x7f5988101d50 msgr2=0x7f5988104170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:52.856 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.093+0000 7f59907d8640 1 -- 172.21.15.1:0/3056696254 shutdown_connections 2024-09-19T09:28:52.856 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.093+0000 7f59907d8640 1 -- 172.21.15.1:0/3056696254 wait complete. 2024-09-19T09:28:52.856 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.093+0000 7f59907d8640 1 Processor -- start 2024-09-19T09:28:52.856 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.093+0000 7f59907d8640 1 -- start start 2024-09-19T09:28:52.856 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.093+0000 7f59907d8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5988108110 0x7f598819b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:52.856 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.093+0000 7f59907d8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f598810bae0 con 0x7f5988108110 2024-09-19T09:28:52.856 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.094+0000 7f598e574640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5988108110 0x7f598819b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:52.856 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.094+0000 7f598e574640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5988108110 0x7f598819b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37912/0 (socket says 172.21.15.1:37912) 2024-09-19T09:28:52.856 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.094+0000 7f598e574640 1 -- 172.21.15.1:0/3316493385 learned_addr learned my addr 172.21.15.1:0/3316493385 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:28:52.857 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.094+0000 7f598e574640 1 -- 172.21.15.1:0/3316493385 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f598819bc30 con 0x7f5988108110 2024-09-19T09:28:52.857 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.094+0000 7f598e574640 1 --2- 172.21.15.1:0/3316493385 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5988108110 0x7f598819b6f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f59840097f0 tx=0x7f5984030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:52.857 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.094+0000 7f597b7fe640 1 -- 172.21.15.1:0/3316493385 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5984042070 con 0x7f5988108110 2024-09-19T09:28:52.857 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.094+0000 7f59907d8640 1 -- 172.21.15.1:0/3316493385 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f598819bec0 con 0x7f5988108110 2024-09-19T09:28:52.857 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.094+0000 7f597b7fe640 1 -- 172.21.15.1:0/3316493385 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5984032ca0 con 0x7f5988108110 2024-09-19T09:28:52.857 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.094+0000 7f597b7fe640 1 -- 172.21.15.1:0/3316493385 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5984037040 con 0x7f5988108110 2024-09-19T09:28:52.857 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.094+0000 7f59907d8640 1 -- 172.21.15.1:0/3316493385 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f598819ebb0 con 0x7f5988108110 2024-09-19T09:28:52.857 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.095+0000 7f59907d8640 1 -- 172.21.15.1:0/3316493385 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5988108570 con 0x7f5988108110 2024-09-19T09:28:52.857 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.095+0000 7f597b7fe640 1 -- 172.21.15.1:0/3316493385 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f5984045070 con 0x7f5988108110 2024-09-19T09:28:52.857 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.096+0000 7f597b7fe640 1 --2- 172.21.15.1:0/3316493385 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f59740390a0 0x7f597403b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:52.858 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.096+0000 7f597b7fe640 1 -- 172.21.15.1:0/3316493385 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f598406c0b0 con 0x7f5988108110 2024-09-19T09:28:52.858 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.096+0000 7f598dd73640 1 --2- 172.21.15.1:0/3316493385 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f59740390a0 0x7f597403b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:52.858 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.096+0000 7f598dd73640 1 --2- 172.21.15.1:0/3316493385 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f59740390a0 0x7f597403b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f597c0098c0 tx=0x7f597c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:52.858 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.101+0000 7f597b7fe640 1 -- 172.21.15.1:0/3316493385 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5984045360 con 0x7f5988108110 2024-09-19T09:28:52.858 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.290+0000 7f59907d8640 1 -- 172.21.15.1:0/3316493385 --> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f59881030d0 con 0x7f59740390a0 2024-09-19T09:28:52.858 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.295+0000 7f597b7fe640 1 -- 172.21.15.1:0/3316493385 <== mgr.14118 v2:172.21.15.1:6800/1028873727 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f59881030d0 con 0x7f59740390a0 2024-09-19T09:28:52.858 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.297+0000 7f59907d8640 1 -- 172.21.15.1:0/3316493385 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f59740390a0 msgr2=0x7f597403b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:52.858 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.297+0000 7f59907d8640 1 --2- 172.21.15.1:0/3316493385 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f59740390a0 0x7f597403b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f597c0098c0 tx=0x7f597c006db0 comp rx=0 tx=0).stop 2024-09-19T09:28:52.858 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.297+0000 7f59907d8640 1 -- 172.21.15.1:0/3316493385 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5988108110 msgr2=0x7f598819b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:52.858 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.297+0000 7f59907d8640 1 --2- 172.21.15.1:0/3316493385 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5988108110 0x7f598819b6f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f59840097f0 tx=0x7f5984030ec0 comp rx=0 tx=0).stop 2024-09-19T09:28:52.858 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.297+0000 7f59907d8640 1 -- 172.21.15.1:0/3316493385 shutdown_connections 2024-09-19T09:28:52.858 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.297+0000 7f59907d8640 1 --2- 172.21.15.1:0/3316493385 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f59740390a0 0x7f597403b560 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:52.859 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.297+0000 7f59907d8640 1 --2- 172.21.15.1:0/3316493385 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5988108110 0x7f598819b6f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:52.859 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.297+0000 7f59907d8640 1 -- 172.21.15.1:0/3316493385 >> 172.21.15.1:0/3316493385 conn(0x7f5988101d50 msgr2=0x7f59881029c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:52.859 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.298+0000 7f59907d8640 1 -- 172.21.15.1:0/3316493385 shutdown_connections 2024-09-19T09:28:52.859 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:52.298+0000 7f59907d8640 1 -- 172.21.15.1:0/3316493385 wait complete. 2024-09-19T09:28:53.125 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:52 smithi001 ceph-mon[31225]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T09:28:53.125 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:52 smithi001 ceph-mon[31225]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T09:28:53.125 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:52 smithi001 ceph-mon[31225]: from='mgr.14118 172.21.15.1:0/3271285817' entity='mgr.x' 2024-09-19T09:28:53.125 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:52 smithi001 ceph-mon[31225]: from='mgr.14118 172.21.15.1:0/3271285817' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:28:53.125 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:52 smithi001 ceph-mon[31225]: from='mgr.14118 172.21.15.1:0/3271285817' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:28:53.970 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:53 smithi001 ceph-mon[31225]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:28:53.970 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:53 smithi001 ceph-mon[31225]: [19/Sep/2024:09:28:52] ENGINE Bus STARTING 2024-09-19T09:28:53.970 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:53 smithi001 ceph-mon[31225]: [19/Sep/2024:09:28:52] ENGINE Serving on http://172.21.15.1:8765 2024-09-19T09:28:53.971 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:53 smithi001 ceph-mon[31225]: [19/Sep/2024:09:28:52] ENGINE Serving on https://172.21.15.1:7150 2024-09-19T09:28:53.971 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:53 smithi001 ceph-mon[31225]: [19/Sep/2024:09:28:52] ENGINE Bus STARTED 2024-09-19T09:28:53.971 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:53 smithi001 ceph-mon[31225]: [19/Sep/2024:09:28:52] ENGINE Error in HTTPServer.serve 2024-09-19T09:28:53.971 INFO:journalctl@ceph.mon.a.smithi001.stdout: Traceback (most recent call last): 2024-09-19T09:28:53.971 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:28:53.971 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._connections.run(self.expiration_interval) 2024-09-19T09:28:53.971 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:28:53.971 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._run(expiration_interval) 2024-09-19T09:28:53.971 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:28:53.971 INFO:journalctl@ceph.mon.a.smithi001.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:28:53.971 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:28:53.971 INFO:journalctl@ceph.mon.a.smithi001.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:28:53.971 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:28:53.972 INFO:journalctl@ceph.mon.a.smithi001.stdout: s = self.context.wrap_socket( 2024-09-19T09:28:53.972 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:28:53.972 INFO:journalctl@ceph.mon.a.smithi001.stdout: return self.sslsocket_class._create( 2024-09-19T09:28:53.972 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:28:53.972 INFO:journalctl@ceph.mon.a.smithi001.stdout: self.do_handshake() 2024-09-19T09:28:53.972 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:28:53.972 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._sslobj.do_handshake() 2024-09-19T09:28:53.972 INFO:journalctl@ceph.mon.a.smithi001.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:28:53.972 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:53 smithi001 ceph-mon[31225]: mgrmap e8: x(active, since 2s) 2024-09-19T09:28:53.978 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-19T09:28:53.978 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.204+0000 7f20d404f640 1 Processor -- start 2024-09-19T09:28:53.978 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.204+0000 7f20d404f640 1 -- start start 2024-09-19T09:28:53.978 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.205+0000 7f20d404f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20cc108110 0x7f20cc10a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:53.978 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.205+0000 7f20d404f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f20cc07be90 con 0x7f20cc108110 2024-09-19T09:28:53.978 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.205+0000 7f20d1deb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20cc108110 0x7f20cc10a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:53.978 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.205+0000 7f20d1deb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20cc108110 0x7f20cc10a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37916/0 (socket says 172.21.15.1:37916) 2024-09-19T09:28:53.978 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.205+0000 7f20d1deb640 1 -- 172.21.15.1:0/509054996 learned_addr learned my addr 172.21.15.1:0/509054996 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:28:53.979 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.205+0000 7f20d1deb640 1 -- 172.21.15.1:0/509054996 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20cc10aa40 con 0x7f20cc108110 2024-09-19T09:28:53.979 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.206+0000 7f20d1deb640 1 --2- 172.21.15.1:0/509054996 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20cc108110 0x7f20cc10a500 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f20c8009820 tx=0x7f20c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee29f4f9d08084b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:53.979 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.206+0000 7f20d0de9640 1 -- 172.21.15.1:0/509054996 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20c8037070 con 0x7f20cc108110 2024-09-19T09:28:53.979 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.206+0000 7f20d0de9640 1 -- 172.21.15.1:0/509054996 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f20c8032900 con 0x7f20cc108110 2024-09-19T09:28:53.979 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.206+0000 7f20d0de9640 1 -- 172.21.15.1:0/509054996 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20c8030850 con 0x7f20cc108110 2024-09-19T09:28:53.979 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.207+0000 7f20d404f640 1 -- 172.21.15.1:0/509054996 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20cc108110 msgr2=0x7f20cc10a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:53.979 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.207+0000 7f20d404f640 1 --2- 172.21.15.1:0/509054996 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20cc108110 0x7f20cc10a500 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f20c8009820 tx=0x7f20c802a270 comp rx=0 tx=0).stop 2024-09-19T09:28:53.979 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.207+0000 7f20d404f640 1 -- 172.21.15.1:0/509054996 shutdown_connections 2024-09-19T09:28:53.979 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.207+0000 7f20d404f640 1 --2- 172.21.15.1:0/509054996 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20cc108110 0x7f20cc10a500 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:53.979 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.207+0000 7f20d404f640 1 -- 172.21.15.1:0/509054996 >> 172.21.15.1:0/509054996 conn(0x7f20cc101d90 msgr2=0x7f20cc1041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:53.979 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.207+0000 7f20d404f640 1 -- 172.21.15.1:0/509054996 shutdown_connections 2024-09-19T09:28:53.979 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.207+0000 7f20d404f640 1 -- 172.21.15.1:0/509054996 wait complete. 2024-09-19T09:28:53.979 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.207+0000 7f20d404f640 1 Processor -- start 2024-09-19T09:28:53.980 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.207+0000 7f20d404f640 1 -- start start 2024-09-19T09:28:53.980 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.207+0000 7f20d404f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20cc108110 0x7f20cc19b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:53.980 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.207+0000 7f20d404f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f20cc10bae0 con 0x7f20cc108110 2024-09-19T09:28:53.980 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.208+0000 7f20d1deb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20cc108110 0x7f20cc19b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:53.980 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.208+0000 7f20d1deb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20cc108110 0x7f20cc19b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37924/0 (socket says 172.21.15.1:37924) 2024-09-19T09:28:53.980 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.208+0000 7f20d1deb640 1 -- 172.21.15.1:0/3150623621 learned_addr learned my addr 172.21.15.1:0/3150623621 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:28:53.980 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.208+0000 7f20d1deb640 1 -- 172.21.15.1:0/3150623621 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20cc19bbe0 con 0x7f20cc108110 2024-09-19T09:28:53.980 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.208+0000 7f20d1deb640 1 --2- 172.21.15.1:0/3150623621 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20cc108110 0x7f20cc19b6a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f20c8032ce0 tx=0x7f20c8032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:53.980 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.208+0000 7f20c2ffd640 1 -- 172.21.15.1:0/3150623621 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20c8042070 con 0x7f20cc108110 2024-09-19T09:28:53.980 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.208+0000 7f20c2ffd640 1 -- 172.21.15.1:0/3150623621 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f20c80308c0 con 0x7f20cc108110 2024-09-19T09:28:53.980 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.208+0000 7f20d404f640 1 -- 172.21.15.1:0/3150623621 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20cc19be70 con 0x7f20cc108110 2024-09-19T09:28:53.980 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.208+0000 7f20c2ffd640 1 -- 172.21.15.1:0/3150623621 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20c8037040 con 0x7f20cc108110 2024-09-19T09:28:53.982 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.208+0000 7f20d404f640 1 -- 172.21.15.1:0/3150623621 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20cc19eb60 con 0x7f20cc108110 2024-09-19T09:28:53.982 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.209+0000 7f20c2ffd640 1 -- 172.21.15.1:0/3150623621 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f20c8045070 con 0x7f20cc108110 2024-09-19T09:28:53.982 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.209+0000 7f20c2ffd640 1 --2- 172.21.15.1:0/3150623621 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f20b8039200 0x7f20b803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:53.982 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.209+0000 7f20c2ffd640 1 -- 172.21.15.1:0/3150623621 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f20c806c440 con 0x7f20cc108110 2024-09-19T09:28:53.983 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.209+0000 7f20d15ea640 1 --2- 172.21.15.1:0/3150623621 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f20b8039200 0x7f20b803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:53.983 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.209+0000 7f20d404f640 1 -- 172.21.15.1:0/3150623621 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20cc108570 con 0x7f20cc108110 2024-09-19T09:28:53.983 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.210+0000 7f20d15ea640 1 --2- 172.21.15.1:0/3150623621 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f20b8039200 0x7f20b803b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f20bc0098c0 tx=0x7f20bc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:53.983 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.214+0000 7f20c2ffd640 1 -- 172.21.15.1:0/3150623621 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f20c803ad80 con 0x7f20cc108110 2024-09-19T09:28:53.983 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.393+0000 7f20d404f640 1 -- 172.21.15.1:0/3150623621 --> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f20cc103040 con 0x7f20b8039200 2024-09-19T09:28:53.983 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.394+0000 7f20c2ffd640 1 -- 172.21.15.1:0/3150623621 <== mgr.14118 v2:172.21.15.1:6800/1028873727 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f20cc103040 con 0x7f20b8039200 2024-09-19T09:28:53.984 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.396+0000 7f20d404f640 1 -- 172.21.15.1:0/3150623621 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f20b8039200 msgr2=0x7f20b803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:53.984 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.396+0000 7f20d404f640 1 --2- 172.21.15.1:0/3150623621 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f20b8039200 0x7f20b803b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f20bc0098c0 tx=0x7f20bc006db0 comp rx=0 tx=0).stop 2024-09-19T09:28:53.984 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.396+0000 7f20d404f640 1 -- 172.21.15.1:0/3150623621 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20cc108110 msgr2=0x7f20cc19b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:53.984 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.396+0000 7f20d404f640 1 --2- 172.21.15.1:0/3150623621 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20cc108110 0x7f20cc19b6a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f20c8032ce0 tx=0x7f20c8032d10 comp rx=0 tx=0).stop 2024-09-19T09:28:53.984 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.396+0000 7f20d404f640 1 -- 172.21.15.1:0/3150623621 shutdown_connections 2024-09-19T09:28:53.984 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.396+0000 7f20d404f640 1 --2- 172.21.15.1:0/3150623621 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f20b8039200 0x7f20b803b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:53.984 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.396+0000 7f20d404f640 1 --2- 172.21.15.1:0/3150623621 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20cc108110 0x7f20cc19b6a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:53.985 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.396+0000 7f20d404f640 1 -- 172.21.15.1:0/3150623621 >> 172.21.15.1:0/3150623621 conn(0x7f20cc101d90 msgr2=0x7f20cc102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:53.985 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.396+0000 7f20d404f640 1 -- 172.21.15.1:0/3150623621 shutdown_connections 2024-09-19T09:28:53.985 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:53.396+0000 7f20d404f640 1 -- 172.21.15.1:0/3150623621 wait complete. 2024-09-19T09:28:53.985 INFO:teuthology.orchestra.run.smithi001.stdout:Generating ssh key... 2024-09-19T09:28:54.851 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:54 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: Generating public/private rsa key pair. 2024-09-19T09:28:54.851 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:54 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: Your identification has been saved in /tmp/tmpy2724w6l/key 2024-09-19T09:28:54.851 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:54 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: Your public key has been saved in /tmp/tmpy2724w6l/key.pub 2024-09-19T09:28:54.852 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:54 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: The key fingerprint is: 2024-09-19T09:28:54.852 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:54 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: SHA256:W+vukYRwg+G5XMQyX6P7DbM7OMMnRdnbcRTM4+Aoe2s ceph-57238232-7669-11ef-bceb-c7b262605968 2024-09-19T09:28:54.852 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:54 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: The key's randomart image is: 2024-09-19T09:28:54.852 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:54 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: +---[RSA 3072]----+ 2024-09-19T09:28:54.852 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:54 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: | ... o..| 2024-09-19T09:28:54.852 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:54 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: | .o=. o . +.| 2024-09-19T09:28:54.852 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:54 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: | =++o +o o..| 2024-09-19T09:28:54.852 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:54 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: | . =o+o......| 2024-09-19T09:28:54.852 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:54 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: | o So= o o | 2024-09-19T09:28:54.852 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:54 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: | .=++. . | 2024-09-19T09:28:54.852 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:54 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: | ..+==. | 2024-09-19T09:28:54.852 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:54 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: | *.=E. | 2024-09-19T09:28:54.852 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:54 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: | B*o | 2024-09-19T09:28:54.853 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:28:54 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: +----[SHA256]-----+ 2024-09-19T09:28:55.217 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:54 smithi001 ceph-mon[31225]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:28:55.217 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:54 smithi001 ceph-mon[31225]: from='mgr.14118 172.21.15.1:0/3271285817' entity='mgr.x' 2024-09-19T09:28:55.218 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:54 smithi001 ceph-mon[31225]: from='mgr.14118 172.21.15.1:0/3271285817' entity='mgr.x' 2024-09-19T09:28:55.493 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.408+0000 7f0e8f327640 1 Processor -- start 2024-09-19T09:28:55.494 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.408+0000 7f0e8f327640 1 -- start start 2024-09-19T09:28:55.494 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.408+0000 7f0e8f327640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e88106ac0 0x7f0e88106ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:55.494 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.408+0000 7f0e8f327640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0e88107490 con 0x7f0e88106ac0 2024-09-19T09:28:55.494 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.409+0000 7f0e8d0c3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e88106ac0 0x7f0e88106ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:55.494 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.409+0000 7f0e8d0c3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e88106ac0 0x7f0e88106ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37936/0 (socket says 172.21.15.1:37936) 2024-09-19T09:28:55.494 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.409+0000 7f0e8d0c3640 1 -- 172.21.15.1:0/3977091396 learned_addr learned my addr 172.21.15.1:0/3977091396 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:28:55.494 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.409+0000 7f0e8d0c3640 1 -- 172.21.15.1:0/3977091396 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e881077e0 con 0x7f0e88106ac0 2024-09-19T09:28:55.494 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.410+0000 7f0e8d0c3640 1 --2- 172.21.15.1:0/3977091396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e88106ac0 0x7f0e88106ec0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0e84009820 tx=0x7f0e8402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1619d64b9fb0d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:55.494 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.410+0000 7f0e7ffff640 1 -- 172.21.15.1:0/3977091396 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e84037070 con 0x7f0e88106ac0 2024-09-19T09:28:55.495 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.410+0000 7f0e7ffff640 1 -- 172.21.15.1:0/3977091396 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0e84032900 con 0x7f0e88106ac0 2024-09-19T09:28:55.495 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.410+0000 7f0e7ffff640 1 -- 172.21.15.1:0/3977091396 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e84030850 con 0x7f0e88106ac0 2024-09-19T09:28:55.495 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.411+0000 7f0e8f327640 1 -- 172.21.15.1:0/3977091396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e88106ac0 msgr2=0x7f0e88106ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:55.495 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.411+0000 7f0e8f327640 1 --2- 172.21.15.1:0/3977091396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e88106ac0 0x7f0e88106ec0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0e84009820 tx=0x7f0e8402a270 comp rx=0 tx=0).stop 2024-09-19T09:28:55.495 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.411+0000 7f0e8f327640 1 -- 172.21.15.1:0/3977091396 shutdown_connections 2024-09-19T09:28:55.495 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.411+0000 7f0e8f327640 1 --2- 172.21.15.1:0/3977091396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e88106ac0 0x7f0e88106ec0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:55.495 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.411+0000 7f0e8f327640 1 -- 172.21.15.1:0/3977091396 >> 172.21.15.1:0/3977091396 conn(0x7f0e88101530 msgr2=0x7f0e88103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:55.495 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.411+0000 7f0e8f327640 1 -- 172.21.15.1:0/3977091396 shutdown_connections 2024-09-19T09:28:55.495 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.411+0000 7f0e8f327640 1 -- 172.21.15.1:0/3977091396 wait complete. 2024-09-19T09:28:55.495 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.411+0000 7f0e8f327640 1 Processor -- start 2024-09-19T09:28:55.495 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.411+0000 7f0e8f327640 1 -- start start 2024-09-19T09:28:55.495 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.412+0000 7f0e8f327640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e88106ac0 0x7f0e8819b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:55.495 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.412+0000 7f0e8f327640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0e8810ab90 con 0x7f0e88106ac0 2024-09-19T09:28:55.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.412+0000 7f0e8d0c3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e88106ac0 0x7f0e8819b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:55.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.412+0000 7f0e8d0c3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e88106ac0 0x7f0e8819b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37938/0 (socket says 172.21.15.1:37938) 2024-09-19T09:28:55.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.412+0000 7f0e8d0c3640 1 -- 172.21.15.1:0/3497889889 learned_addr learned my addr 172.21.15.1:0/3497889889 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:28:55.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.412+0000 7f0e8d0c3640 1 -- 172.21.15.1:0/3497889889 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e8819bbd0 con 0x7f0e88106ac0 2024-09-19T09:28:55.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.412+0000 7f0e8d0c3640 1 --2- 172.21.15.1:0/3497889889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e88106ac0 0x7f0e8819b690 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0e840097f0 tx=0x7f0e84030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:55.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.412+0000 7f0e7e7fc640 1 -- 172.21.15.1:0/3497889889 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e84037040 con 0x7f0e88106ac0 2024-09-19T09:28:55.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.412+0000 7f0e7e7fc640 1 -- 172.21.15.1:0/3497889889 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0e84040070 con 0x7f0e88106ac0 2024-09-19T09:28:55.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.412+0000 7f0e7e7fc640 1 -- 172.21.15.1:0/3497889889 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e8403a390 con 0x7f0e88106ac0 2024-09-19T09:28:55.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.413+0000 7f0e8f327640 1 -- 172.21.15.1:0/3497889889 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e8819be60 con 0x7f0e88106ac0 2024-09-19T09:28:55.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.413+0000 7f0e8f327640 1 -- 172.21.15.1:0/3497889889 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e8819eb50 con 0x7f0e88106ac0 2024-09-19T09:28:55.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.413+0000 7f0e7e7fc640 1 -- 172.21.15.1:0/3497889889 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f0e8403a5e0 con 0x7f0e88106ac0 2024-09-19T09:28:55.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.414+0000 7f0e7e7fc640 1 --2- 172.21.15.1:0/3497889889 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f0e74039200 0x7f0e7403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:55.496 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.414+0000 7f0e7e7fc640 1 -- 172.21.15.1:0/3497889889 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0e8406d7e0 con 0x7f0e88106ac0 2024-09-19T09:28:55.497 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.414+0000 7f0e8f327640 1 -- 172.21.15.1:0/3497889889 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e88106f40 con 0x7f0e88106ac0 2024-09-19T09:28:55.497 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.414+0000 7f0e8c8c2640 1 --2- 172.21.15.1:0/3497889889 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f0e74039200 0x7f0e7403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:55.497 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.414+0000 7f0e8c8c2640 1 --2- 172.21.15.1:0/3497889889 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f0e74039200 0x7f0e7403b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0e780098c0 tx=0x7f0e78006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:55.497 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.419+0000 7f0e7e7fc640 1 -- 172.21.15.1:0/3497889889 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0e84043760 con 0x7f0e88106ac0 2024-09-19T09:28:55.497 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.596+0000 7f0e8f327640 1 -- 172.21.15.1:0/3497889889 --> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f0e8802d9f0 con 0x7f0e74039200 2024-09-19T09:28:55.497 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.838+0000 7f0e7e7fc640 1 -- 172.21.15.1:0/3497889889 <== mgr.14118 v2:172.21.15.1:6800/1028873727 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0e8802d9f0 con 0x7f0e74039200 2024-09-19T09:28:55.497 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.840+0000 7f0e8f327640 1 -- 172.21.15.1:0/3497889889 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f0e74039200 msgr2=0x7f0e7403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:55.497 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.840+0000 7f0e8f327640 1 --2- 172.21.15.1:0/3497889889 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f0e74039200 0x7f0e7403b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0e780098c0 tx=0x7f0e78006db0 comp rx=0 tx=0).stop 2024-09-19T09:28:55.497 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.840+0000 7f0e8f327640 1 -- 172.21.15.1:0/3497889889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e88106ac0 msgr2=0x7f0e8819b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:55.497 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.840+0000 7f0e8f327640 1 --2- 172.21.15.1:0/3497889889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e88106ac0 0x7f0e8819b690 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0e840097f0 tx=0x7f0e84030d80 comp rx=0 tx=0).stop 2024-09-19T09:28:55.497 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.840+0000 7f0e8f327640 1 -- 172.21.15.1:0/3497889889 shutdown_connections 2024-09-19T09:28:55.497 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.840+0000 7f0e8f327640 1 --2- 172.21.15.1:0/3497889889 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f0e74039200 0x7f0e7403b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:55.498 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.840+0000 7f0e8f327640 1 --2- 172.21.15.1:0/3497889889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e88106ac0 0x7f0e8819b690 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:55.498 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.840+0000 7f0e8f327640 1 -- 172.21.15.1:0/3497889889 >> 172.21.15.1:0/3497889889 conn(0x7f0e88101530 msgr2=0x7f0e88102440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:55.498 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.840+0000 7f0e8f327640 1 -- 172.21.15.1:0/3497889889 shutdown_connections 2024-09-19T09:28:55.498 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:54.840+0000 7f0e8f327640 1 -- 172.21.15.1:0/3497889889 wait complete. 2024-09-19T09:28:56.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:55 smithi001 ceph-mon[31225]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:28:56.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:55 smithi001 ceph-mon[31225]: Generating ssh key... 2024-09-19T09:28:56.727 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMjJuNkNl3QCj7szS0FqFBPQC1mOSFGgfbAgHsMDKucPuW7OgakHdNFdhxVUOpoL5HQFYjZYAqS7W9dGU2I17MXK3BvDJbxRUw7iR7ydRx26sw5aYiNQnPHrgrflQcinSLb2CrbSADTFqX/huJVp1HHssfpuSvYM/L00948a/W5rCcU8YU/vQ/XXivahiM54BEO7JXz61cmXvoG9mGcbard9ewoSBGni309hXS/ZADgKYIIep838Q5JOCnbemrg8JwlbftnafflzVzec5Hg2TcW2fTY4lGSgzhZPqRd3UCtNCk49hRes84NSeOmRYPUnDQTBobHusoarba3om83VJv2PLJJU2tXlwUf+zfpoLUXW47Fd6DX8w9JhzCbhNYZoCZ4qtN79Il4airC5330E7N/WIRgxOXkwufX5SgjXvaq/x6jrMdFHQJ7/xJIkoNwqAX6H/lpOw0yr9XxT5TDoYNs+hflwg68r2Bm9f2jPzhRunoFAG6N7kZ1YqN2Xy5pFc= ceph-57238232-7669-11ef-bceb-c7b262605968 2024-09-19T09:28:56.727 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.935+0000 7f2f7a96b640 1 Processor -- start 2024-09-19T09:28:56.727 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.935+0000 7f2f7a96b640 1 -- start start 2024-09-19T09:28:56.727 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.935+0000 7f2f7a96b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f74105980 0x7f2f74105d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:56.727 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.935+0000 7f2f7a96b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2f74106350 con 0x7f2f74105980 2024-09-19T09:28:56.727 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.935+0000 7f2f73fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f74105980 0x7f2f74105d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:56.727 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.935+0000 7f2f73fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f74105980 0x7f2f74105d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39908/0 (socket says 172.21.15.1:39908) 2024-09-19T09:28:56.728 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.935+0000 7f2f73fff640 1 -- 172.21.15.1:0/4010803343 learned_addr learned my addr 172.21.15.1:0/4010803343 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:28:56.728 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.936+0000 7f2f73fff640 1 -- 172.21.15.1:0/4010803343 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f741064d0 con 0x7f2f74105980 2024-09-19T09:28:56.728 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.936+0000 7f2f73fff640 1 --2- 172.21.15.1:0/4010803343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f74105980 0x7f2f74105d80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2f64009820 tx=0x7f2f6402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb19cdd24a084d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:56.728 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.937+0000 7f2f72ffd640 1 -- 172.21.15.1:0/4010803343 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f64037070 con 0x7f2f74105980 2024-09-19T09:28:56.728 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.937+0000 7f2f72ffd640 1 -- 172.21.15.1:0/4010803343 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2f64032900 con 0x7f2f74105980 2024-09-19T09:28:56.728 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.937+0000 7f2f72ffd640 1 -- 172.21.15.1:0/4010803343 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f64030850 con 0x7f2f74105980 2024-09-19T09:28:56.728 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.937+0000 7f2f7a96b640 1 -- 172.21.15.1:0/4010803343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f74105980 msgr2=0x7f2f74105d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:56.728 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.937+0000 7f2f7a96b640 1 --2- 172.21.15.1:0/4010803343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f74105980 0x7f2f74105d80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2f64009820 tx=0x7f2f6402a270 comp rx=0 tx=0).stop 2024-09-19T09:28:56.728 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.937+0000 7f2f7a96b640 1 -- 172.21.15.1:0/4010803343 shutdown_connections 2024-09-19T09:28:56.728 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.937+0000 7f2f7a96b640 1 --2- 172.21.15.1:0/4010803343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f74105980 0x7f2f74105d80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:56.729 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.937+0000 7f2f7a96b640 1 -- 172.21.15.1:0/4010803343 >> 172.21.15.1:0/4010803343 conn(0x7f2f74101530 msgr2=0x7f2f74103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:56.729 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.937+0000 7f2f7a96b640 1 -- 172.21.15.1:0/4010803343 shutdown_connections 2024-09-19T09:28:56.729 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.938+0000 7f2f7a96b640 1 -- 172.21.15.1:0/4010803343 wait complete. 2024-09-19T09:28:56.729 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.938+0000 7f2f7a96b640 1 Processor -- start 2024-09-19T09:28:56.729 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.938+0000 7f2f7a96b640 1 -- start start 2024-09-19T09:28:56.729 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.939+0000 7f2f7a96b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f74105980 0x7f2f7419b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:56.729 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.939+0000 7f2f7a96b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2f74109860 con 0x7f2f74105980 2024-09-19T09:28:56.730 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.939+0000 7f2f73fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f74105980 0x7f2f7419b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:56.730 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.939+0000 7f2f73fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f74105980 0x7f2f7419b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39912/0 (socket says 172.21.15.1:39912) 2024-09-19T09:28:56.730 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.939+0000 7f2f73fff640 1 -- 172.21.15.1:0/1000130769 learned_addr learned my addr 172.21.15.1:0/1000130769 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:28:56.730 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.939+0000 7f2f73fff640 1 -- 172.21.15.1:0/1000130769 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f7419bb90 con 0x7f2f74105980 2024-09-19T09:28:56.730 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.939+0000 7f2f73fff640 1 --2- 172.21.15.1:0/1000130769 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f74105980 0x7f2f7419b650 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2f64009940 tx=0x7f2f64032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:56.730 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.939+0000 7f2f717fa640 1 -- 172.21.15.1:0/1000130769 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f64042070 con 0x7f2f74105980 2024-09-19T09:28:56.730 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.939+0000 7f2f7a96b640 1 -- 172.21.15.1:0/1000130769 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f7419be80 con 0x7f2f74105980 2024-09-19T09:28:56.730 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.939+0000 7f2f717fa640 1 -- 172.21.15.1:0/1000130769 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2f640308c0 con 0x7f2f74105980 2024-09-19T09:28:56.730 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.939+0000 7f2f717fa640 1 -- 172.21.15.1:0/1000130769 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f64037040 con 0x7f2f74105980 2024-09-19T09:28:56.731 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.940+0000 7f2f7a96b640 1 -- 172.21.15.1:0/1000130769 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f7419eb10 con 0x7f2f74105980 2024-09-19T09:28:56.731 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.940+0000 7f2f717fa640 1 -- 172.21.15.1:0/1000130769 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f2f64045070 con 0x7f2f74105980 2024-09-19T09:28:56.731 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.941+0000 7f2f7a96b640 1 -- 172.21.15.1:0/1000130769 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f74105e00 con 0x7f2f74105980 2024-09-19T09:28:56.731 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.941+0000 7f2f717fa640 1 --2- 172.21.15.1:0/1000130769 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f2f5c0391b0 0x7f2f5c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:28:56.731 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.941+0000 7f2f717fa640 1 -- 172.21.15.1:0/1000130769 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2f6406c340 con 0x7f2f74105980 2024-09-19T09:28:56.731 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.941+0000 7f2f737fe640 1 --2- 172.21.15.1:0/1000130769 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f2f5c0391b0 0x7f2f5c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:28:56.731 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.941+0000 7f2f737fe640 1 --2- 172.21.15.1:0/1000130769 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f2f5c0391b0 0x7f2f5c03b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2f680098c0 tx=0x7f2f68006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:28:56.731 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:55.946+0000 7f2f717fa640 1 -- 172.21.15.1:0/1000130769 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2f64043260 con 0x7f2f74105980 2024-09-19T09:28:56.731 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:56.127+0000 7f2f7a96b640 1 -- 172.21.15.1:0/1000130769 --> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f2f741027f0 con 0x7f2f5c0391b0 2024-09-19T09:28:56.732 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:56.127+0000 7f2f717fa640 1 -- 172.21.15.1:0/1000130769 <== mgr.14118 v2:172.21.15.1:6800/1028873727 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f2f741027f0 con 0x7f2f5c0391b0 2024-09-19T09:28:56.732 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:56.130+0000 7f2f7a96b640 1 -- 172.21.15.1:0/1000130769 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f2f5c0391b0 msgr2=0x7f2f5c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:56.732 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:56.130+0000 7f2f7a96b640 1 --2- 172.21.15.1:0/1000130769 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f2f5c0391b0 0x7f2f5c03b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2f680098c0 tx=0x7f2f68006db0 comp rx=0 tx=0).stop 2024-09-19T09:28:56.732 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:56.130+0000 7f2f7a96b640 1 -- 172.21.15.1:0/1000130769 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f74105980 msgr2=0x7f2f7419b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:28:56.732 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:56.130+0000 7f2f7a96b640 1 --2- 172.21.15.1:0/1000130769 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f74105980 0x7f2f7419b650 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2f64009940 tx=0x7f2f64032ce0 comp rx=0 tx=0).stop 2024-09-19T09:28:56.732 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:56.131+0000 7f2f7a96b640 1 -- 172.21.15.1:0/1000130769 shutdown_connections 2024-09-19T09:28:56.732 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:56.131+0000 7f2f7a96b640 1 --2- 172.21.15.1:0/1000130769 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f2f5c0391b0 0x7f2f5c03b670 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:56.732 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:56.131+0000 7f2f7a96b640 1 --2- 172.21.15.1:0/1000130769 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2f74105980 0x7f2f7419b650 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:28:56.732 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:56.131+0000 7f2f7a96b640 1 -- 172.21.15.1:0/1000130769 >> 172.21.15.1:0/1000130769 conn(0x7f2f74101530 msgr2=0x7f2f741020e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:28:56.732 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:56.131+0000 7f2f7a96b640 1 -- 172.21.15.1:0/1000130769 shutdown_connections 2024-09-19T09:28:56.733 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:56.131+0000 7f2f7a96b640 1 -- 172.21.15.1:0/1000130769 wait complete. 2024-09-19T09:28:56.733 INFO:teuthology.orchestra.run.smithi001.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:28:56.733 INFO:teuthology.orchestra.run.smithi001.stdout:Adding key to root@localhost authorized_keys... 2024-09-19T09:28:56.733 INFO:teuthology.orchestra.run.smithi001.stdout:Adding host smithi001... 2024-09-19T09:28:57.302 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:57 smithi001 ceph-mon[31225]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:28:58.351 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:58 smithi001 ceph-mon[31225]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi001", "addr": "172.21.15.1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:28:59.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:28:59 smithi001 ceph-mon[31225]: Deploying cephadm binary to smithi001 2024-09-19T09:29:01.826 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout Added host 'smithi001' with addr '172.21.15.1' 2024-09-19T09:29:01.826 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.112+0000 7fd367ca5640 1 Processor -- start 2024-09-19T09:29:01.826 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.112+0000 7fd367ca5640 1 -- start start 2024-09-19T09:29:01.826 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.113+0000 7fd367ca5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd360108180 0x7fd36010a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:01.826 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.113+0000 7fd367ca5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd36007be30 con 0x7fd360108180 2024-09-19T09:29:01.826 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.113+0000 7fd365a41640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd360108180 0x7fd36010a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:01.826 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.113+0000 7fd365a41640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd360108180 0x7fd36010a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39920/0 (socket says 172.21.15.1:39920) 2024-09-19T09:29:01.827 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.113+0000 7fd365a41640 1 -- 172.21.15.1:0/2374851741 learned_addr learned my addr 172.21.15.1:0/2374851741 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:29:01.827 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.113+0000 7fd365a41640 1 -- 172.21.15.1:0/2374851741 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd36010aab0 con 0x7fd360108180 2024-09-19T09:29:01.827 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.114+0000 7fd365a41640 1 --2- 172.21.15.1:0/2374851741 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd360108180 0x7fd36010a570 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd358009820 tx=0x7fd35802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f4d7f5014b3442 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:01.827 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.114+0000 7fd364a3f640 1 -- 172.21.15.1:0/2374851741 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd358037070 con 0x7fd360108180 2024-09-19T09:29:01.827 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.114+0000 7fd364a3f640 1 -- 172.21.15.1:0/2374851741 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd358032900 con 0x7fd360108180 2024-09-19T09:29:01.827 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.114+0000 7fd364a3f640 1 -- 172.21.15.1:0/2374851741 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd358030850 con 0x7fd360108180 2024-09-19T09:29:01.827 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.115+0000 7fd367ca5640 1 -- 172.21.15.1:0/2374851741 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd360108180 msgr2=0x7fd36010a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:01.827 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.115+0000 7fd367ca5640 1 --2- 172.21.15.1:0/2374851741 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd360108180 0x7fd36010a570 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd358009820 tx=0x7fd35802a270 comp rx=0 tx=0).stop 2024-09-19T09:29:01.827 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.115+0000 7fd367ca5640 1 -- 172.21.15.1:0/2374851741 shutdown_connections 2024-09-19T09:29:01.827 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.115+0000 7fd367ca5640 1 --2- 172.21.15.1:0/2374851741 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd360108180 0x7fd36010a570 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:01.827 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.115+0000 7fd367ca5640 1 -- 172.21.15.1:0/2374851741 >> 172.21.15.1:0/2374851741 conn(0x7fd360101d80 msgr2=0x7fd3601041a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:01.827 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.115+0000 7fd367ca5640 1 -- 172.21.15.1:0/2374851741 shutdown_connections 2024-09-19T09:29:01.827 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.115+0000 7fd367ca5640 1 -- 172.21.15.1:0/2374851741 wait complete. 2024-09-19T09:29:01.827 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.115+0000 7fd367ca5640 1 Processor -- start 2024-09-19T09:29:01.828 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.115+0000 7fd367ca5640 1 -- start start 2024-09-19T09:29:01.828 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.116+0000 7fd367ca5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd360108180 0x7fd360107a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:01.828 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.116+0000 7fd367ca5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd36010baf0 con 0x7fd360108180 2024-09-19T09:29:01.828 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.116+0000 7fd365a41640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd360108180 0x7fd360107a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:01.828 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.116+0000 7fd365a41640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd360108180 0x7fd360107a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39928/0 (socket says 172.21.15.1:39928) 2024-09-19T09:29:01.828 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.116+0000 7fd365a41640 1 -- 172.21.15.1:0/885901339 learned_addr learned my addr 172.21.15.1:0/885901339 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:29:01.828 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.116+0000 7fd365a41640 1 -- 172.21.15.1:0/885901339 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd360107f40 con 0x7fd360108180 2024-09-19T09:29:01.828 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.116+0000 7fd365a41640 1 --2- 172.21.15.1:0/885901339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd360108180 0x7fd360107a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd358031000 tx=0x7fd3580326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:01.828 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.116+0000 7fd35effd640 1 -- 172.21.15.1:0/885901339 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd358042070 con 0x7fd360108180 2024-09-19T09:29:01.828 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.116+0000 7fd35effd640 1 -- 172.21.15.1:0/885901339 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd358032be0 con 0x7fd360108180 2024-09-19T09:29:01.828 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.116+0000 7fd367ca5640 1 -- 172.21.15.1:0/885901339 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd360106130 con 0x7fd360108180 2024-09-19T09:29:01.828 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.116+0000 7fd35effd640 1 -- 172.21.15.1:0/885901339 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd358037040 con 0x7fd360108180 2024-09-19T09:29:01.828 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.116+0000 7fd367ca5640 1 -- 172.21.15.1:0/885901339 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd360106670 con 0x7fd360108180 2024-09-19T09:29:01.829 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.117+0000 7fd35effd640 1 -- 172.21.15.1:0/885901339 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fd358045070 con 0x7fd360108180 2024-09-19T09:29:01.829 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.117+0000 7fd367ca5640 1 -- 172.21.15.1:0/885901339 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3601085e0 con 0x7fd360108180 2024-09-19T09:29:01.829 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.118+0000 7fd35effd640 1 --2- 172.21.15.1:0/885901339 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7fd348039200 0x7fd34803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:01.829 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.118+0000 7fd35effd640 1 -- 172.21.15.1:0/885901339 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd35806c390 con 0x7fd360108180 2024-09-19T09:29:01.829 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.118+0000 7fd365240640 1 --2- 172.21.15.1:0/885901339 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7fd348039200 0x7fd34803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:01.829 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.118+0000 7fd365240640 1 --2- 172.21.15.1:0/885901339 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7fd348039200 0x7fd34803b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd3540098c0 tx=0x7fd354006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:01.829 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.122+0000 7fd35effd640 1 -- 172.21.15.1:0/885901339 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd358045360 con 0x7fd360108180 2024-09-19T09:29:01.829 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:28:57.301+0000 7fd367ca5640 1 -- 172.21.15.1:0/885901339 --> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi001", "addr": "172.21.15.1", "target": ["mon-mgr", ""]}) -- 0x7fd360106f20 con 0x7fd348039200 2024-09-19T09:29:01.829 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:01.240+0000 7fd35effd640 1 -- 172.21.15.1:0/885901339 <== mgr.14118 v2:172.21.15.1:6800/1028873727 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7fd360106f20 con 0x7fd348039200 2024-09-19T09:29:01.829 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:01.243+0000 7fd367ca5640 1 -- 172.21.15.1:0/885901339 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7fd348039200 msgr2=0x7fd34803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:01.829 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:01.243+0000 7fd367ca5640 1 --2- 172.21.15.1:0/885901339 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7fd348039200 0x7fd34803b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd3540098c0 tx=0x7fd354006db0 comp rx=0 tx=0).stop 2024-09-19T09:29:01.829 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:01.243+0000 7fd367ca5640 1 -- 172.21.15.1:0/885901339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd360108180 msgr2=0x7fd360107a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:01.830 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:01.243+0000 7fd367ca5640 1 --2- 172.21.15.1:0/885901339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd360108180 0x7fd360107a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd358031000 tx=0x7fd3580326e0 comp rx=0 tx=0).stop 2024-09-19T09:29:01.830 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:01.243+0000 7fd367ca5640 1 -- 172.21.15.1:0/885901339 shutdown_connections 2024-09-19T09:29:01.830 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:01.243+0000 7fd367ca5640 1 --2- 172.21.15.1:0/885901339 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7fd348039200 0x7fd34803b6c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:01.830 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:01.243+0000 7fd367ca5640 1 --2- 172.21.15.1:0/885901339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd360108180 0x7fd360107a00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:01.830 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:01.243+0000 7fd367ca5640 1 -- 172.21.15.1:0/885901339 >> 172.21.15.1:0/885901339 conn(0x7fd360101d80 msgr2=0x7fd360102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:01.830 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:01.243+0000 7fd367ca5640 1 -- 172.21.15.1:0/885901339 shutdown_connections 2024-09-19T09:29:01.830 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:01.243+0000 7fd367ca5640 1 -- 172.21.15.1:0/885901339 wait complete. 2024-09-19T09:29:01.830 INFO:teuthology.orchestra.run.smithi001.stdout:Deploying unmanaged mon service... 2024-09-19T09:29:02.481 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:02 smithi001 ceph-mon[31225]: from='mgr.14118 172.21.15.1:0/3271285817' entity='mgr.x' 2024-09-19T09:29:02.481 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:02 smithi001 ceph-mon[31225]: Added host smithi001 2024-09-19T09:29:02.481 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:02 smithi001 ceph-mon[31225]: from='mgr.14118 172.21.15.1:0/3271285817' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:29:03.251 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-19T09:29:03.251 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.268+0000 7f890a705640 1 Processor -- start 2024-09-19T09:29:03.251 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.268+0000 7f890a705640 1 -- start start 2024-09-19T09:29:03.251 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.269+0000 7f890a705640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89041081f0 0x7f890410a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:03.251 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.269+0000 7f890a705640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f890407bdb0 con 0x7f89041081f0 2024-09-19T09:29:03.252 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.269+0000 7f8903fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89041081f0 0x7f890410a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:03.252 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.269+0000 7f8903fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89041081f0 0x7f890410a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39938/0 (socket says 172.21.15.1:39938) 2024-09-19T09:29:03.252 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.269+0000 7f8903fff640 1 -- 172.21.15.1:0/1440486169 learned_addr learned my addr 172.21.15.1:0/1440486169 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:29:03.252 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.269+0000 7f8903fff640 1 -- 172.21.15.1:0/1440486169 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f890410ab20 con 0x7f89041081f0 2024-09-19T09:29:03.252 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.270+0000 7f8903fff640 1 --2- 172.21.15.1:0/1440486169 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89041081f0 0x7f890410a5e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f88f4009820 tx=0x7f88f402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f74d3f8483d8f99b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:03.252 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.270+0000 7f8902ffd640 1 -- 172.21.15.1:0/1440486169 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f4037070 con 0x7f89041081f0 2024-09-19T09:29:03.252 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.270+0000 7f8902ffd640 1 -- 172.21.15.1:0/1440486169 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f88f4032900 con 0x7f89041081f0 2024-09-19T09:29:03.252 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.270+0000 7f8902ffd640 1 -- 172.21.15.1:0/1440486169 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f4030850 con 0x7f89041081f0 2024-09-19T09:29:03.252 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.271+0000 7f890a705640 1 -- 172.21.15.1:0/1440486169 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89041081f0 msgr2=0x7f890410a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:03.252 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.271+0000 7f890a705640 1 --2- 172.21.15.1:0/1440486169 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89041081f0 0x7f890410a5e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f88f4009820 tx=0x7f88f402a270 comp rx=0 tx=0).stop 2024-09-19T09:29:03.252 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.271+0000 7f890a705640 1 -- 172.21.15.1:0/1440486169 shutdown_connections 2024-09-19T09:29:03.252 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.271+0000 7f890a705640 1 --2- 172.21.15.1:0/1440486169 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89041081f0 0x7f890410a5e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:03.253 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.271+0000 7f890a705640 1 -- 172.21.15.1:0/1440486169 >> 172.21.15.1:0/1440486169 conn(0x7f8904101d50 msgr2=0x7f8904104170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:03.253 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.271+0000 7f890a705640 1 -- 172.21.15.1:0/1440486169 shutdown_connections 2024-09-19T09:29:03.253 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.271+0000 7f890a705640 1 -- 172.21.15.1:0/1440486169 wait complete. 2024-09-19T09:29:03.253 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.271+0000 7f890a705640 1 Processor -- start 2024-09-19T09:29:03.253 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.271+0000 7f890a705640 1 -- start start 2024-09-19T09:29:03.253 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.272+0000 7f890a705640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89041081f0 0x7f8904107a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:03.253 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.272+0000 7f890a705640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f890410baa0 con 0x7f89041081f0 2024-09-19T09:29:03.253 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.272+0000 7f8903fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89041081f0 0x7f8904107a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:03.253 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.272+0000 7f8903fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89041081f0 0x7f8904107a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39946/0 (socket says 172.21.15.1:39946) 2024-09-19T09:29:03.253 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.272+0000 7f8903fff640 1 -- 172.21.15.1:0/716236134 learned_addr learned my addr 172.21.15.1:0/716236134 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:29:03.254 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.272+0000 7f8903fff640 1 -- 172.21.15.1:0/716236134 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8904107fb0 con 0x7f89041081f0 2024-09-19T09:29:03.254 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.272+0000 7f8903fff640 1 --2- 172.21.15.1:0/716236134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89041081f0 0x7f8904107a70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f88f4031000 tx=0x7f88f40326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:03.254 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.272+0000 7f89017fa640 1 -- 172.21.15.1:0/716236134 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f4042070 con 0x7f89041081f0 2024-09-19T09:29:03.254 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.272+0000 7f89017fa640 1 -- 172.21.15.1:0/716236134 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f88f4032be0 con 0x7f89041081f0 2024-09-19T09:29:03.254 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.272+0000 7f890a705640 1 -- 172.21.15.1:0/716236134 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89041061a0 con 0x7f89041081f0 2024-09-19T09:29:03.254 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.272+0000 7f89017fa640 1 -- 172.21.15.1:0/716236134 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88f4037040 con 0x7f89041081f0 2024-09-19T09:29:03.254 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.273+0000 7f890a705640 1 -- 172.21.15.1:0/716236134 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89041066e0 con 0x7f89041081f0 2024-09-19T09:29:03.254 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.273+0000 7f89017fa640 1 -- 172.21.15.1:0/716236134 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f88f4045070 con 0x7f89041081f0 2024-09-19T09:29:03.254 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.273+0000 7f890a705640 1 -- 172.21.15.1:0/716236134 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8904108650 con 0x7f89041081f0 2024-09-19T09:29:03.254 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.274+0000 7f89017fa640 1 --2- 172.21.15.1:0/716236134 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f88ec039200 0x7f88ec03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:03.254 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.274+0000 7f89017fa640 1 -- 172.21.15.1:0/716236134 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f88f406c470 con 0x7f89041081f0 2024-09-19T09:29:03.255 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.274+0000 7f89037fe640 1 --2- 172.21.15.1:0/716236134 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f88ec039200 0x7f88ec03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:03.255 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.274+0000 7f89037fe640 1 --2- 172.21.15.1:0/716236134 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f88ec039200 0x7f88ec03b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f88f80098c0 tx=0x7f88f8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:03.255 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.278+0000 7f89017fa640 1 -- 172.21.15.1:0/716236134 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f88f403a540 con 0x7f89041081f0 2024-09-19T09:29:03.255 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.479+0000 7f890a705640 1 -- 172.21.15.1:0/716236134 --> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f8904106f30 con 0x7f88ec039200 2024-09-19T09:29:03.255 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.484+0000 7f89017fa640 1 -- 172.21.15.1:0/716236134 <== mgr.14118 v2:172.21.15.1:6800/1028873727 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f8904106f30 con 0x7f88ec039200 2024-09-19T09:29:03.255 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.486+0000 7f890a705640 1 -- 172.21.15.1:0/716236134 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f88ec039200 msgr2=0x7f88ec03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:03.256 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.486+0000 7f890a705640 1 --2- 172.21.15.1:0/716236134 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f88ec039200 0x7f88ec03b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f88f80098c0 tx=0x7f88f8006db0 comp rx=0 tx=0).stop 2024-09-19T09:29:03.256 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.486+0000 7f890a705640 1 -- 172.21.15.1:0/716236134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89041081f0 msgr2=0x7f8904107a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:03.256 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.486+0000 7f890a705640 1 --2- 172.21.15.1:0/716236134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89041081f0 0x7f8904107a70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f88f4031000 tx=0x7f88f40326e0 comp rx=0 tx=0).stop 2024-09-19T09:29:03.256 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.487+0000 7f890a705640 1 -- 172.21.15.1:0/716236134 shutdown_connections 2024-09-19T09:29:03.256 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.487+0000 7f890a705640 1 --2- 172.21.15.1:0/716236134 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f88ec039200 0x7f88ec03b6c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:03.256 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.487+0000 7f890a705640 1 --2- 172.21.15.1:0/716236134 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f89041081f0 0x7f8904107a70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:03.256 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.487+0000 7f890a705640 1 -- 172.21.15.1:0/716236134 >> 172.21.15.1:0/716236134 conn(0x7f8904101d50 msgr2=0x7f8904102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:03.256 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.487+0000 7f890a705640 1 -- 172.21.15.1:0/716236134 shutdown_connections 2024-09-19T09:29:03.256 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:02.487+0000 7f890a705640 1 -- 172.21.15.1:0/716236134 wait complete. 2024-09-19T09:29:03.256 INFO:teuthology.orchestra.run.smithi001.stdout:Deploying unmanaged mgr service... 2024-09-19T09:29:03.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:03 smithi001 ceph-mon[31225]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:29:03.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:03 smithi001 ceph-mon[31225]: Saving service mon spec with placement count:5 2024-09-19T09:29:03.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:03 smithi001 ceph-mon[31225]: from='mgr.14118 172.21.15.1:0/3271285817' entity='mgr.x' 2024-09-19T09:29:04.652 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-19T09:29:04.653 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.690+0000 7f144ee4a640 1 Processor -- start 2024-09-19T09:29:04.653 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.690+0000 7f144ee4a640 1 -- start start 2024-09-19T09:29:04.653 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.691+0000 7f144ee4a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14481080f0 0x7f144810a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:04.653 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.691+0000 7f144ee4a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f144807be90 con 0x7f14481080f0 2024-09-19T09:29:04.653 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.691+0000 7f144cbe6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14481080f0 0x7f144810a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:04.653 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.691+0000 7f144cbe6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14481080f0 0x7f144810a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39958/0 (socket says 172.21.15.1:39958) 2024-09-19T09:29:04.653 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.691+0000 7f144cbe6640 1 -- 172.21.15.1:0/2958044518 learned_addr learned my addr 172.21.15.1:0/2958044518 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:29:04.653 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.691+0000 7f144cbe6640 1 -- 172.21.15.1:0/2958044518 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f144810aa20 con 0x7f14481080f0 2024-09-19T09:29:04.653 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.692+0000 7f144cbe6640 1 --2- 172.21.15.1:0/2958044518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14481080f0 0x7f144810a4e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1440009820 tx=0x7f144002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=834b1d59e3bd9a96 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:04.653 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.692+0000 7f14477fe640 1 -- 172.21.15.1:0/2958044518 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1440037070 con 0x7f14481080f0 2024-09-19T09:29:04.653 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.692+0000 7f14477fe640 1 -- 172.21.15.1:0/2958044518 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1440032900 con 0x7f14481080f0 2024-09-19T09:29:04.654 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.692+0000 7f14477fe640 1 -- 172.21.15.1:0/2958044518 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1440030850 con 0x7f14481080f0 2024-09-19T09:29:04.654 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.693+0000 7f144ee4a640 1 -- 172.21.15.1:0/2958044518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14481080f0 msgr2=0x7f144810a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:04.654 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.693+0000 7f144ee4a640 1 --2- 172.21.15.1:0/2958044518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14481080f0 0x7f144810a4e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1440009820 tx=0x7f144002a270 comp rx=0 tx=0).stop 2024-09-19T09:29:04.654 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.693+0000 7f144ee4a640 1 -- 172.21.15.1:0/2958044518 shutdown_connections 2024-09-19T09:29:04.654 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.693+0000 7f144ee4a640 1 --2- 172.21.15.1:0/2958044518 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14481080f0 0x7f144810a4e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:04.654 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.693+0000 7f144ee4a640 1 -- 172.21.15.1:0/2958044518 >> 172.21.15.1:0/2958044518 conn(0x7f1448101d30 msgr2=0x7f1448104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:04.654 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.693+0000 7f144ee4a640 1 -- 172.21.15.1:0/2958044518 shutdown_connections 2024-09-19T09:29:04.654 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.693+0000 7f144ee4a640 1 -- 172.21.15.1:0/2958044518 wait complete. 2024-09-19T09:29:04.654 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.694+0000 7f144ee4a640 1 Processor -- start 2024-09-19T09:29:04.654 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.694+0000 7f144ee4a640 1 -- start start 2024-09-19T09:29:04.654 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.694+0000 7f144ee4a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14481080f0 0x7f1448107970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:04.654 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.694+0000 7f144ee4a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f144810bac0 con 0x7f14481080f0 2024-09-19T09:29:04.654 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.694+0000 7f144cbe6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14481080f0 0x7f1448107970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:04.655 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.694+0000 7f144cbe6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14481080f0 0x7f1448107970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39960/0 (socket says 172.21.15.1:39960) 2024-09-19T09:29:04.655 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.694+0000 7f144cbe6640 1 -- 172.21.15.1:0/1744630535 learned_addr learned my addr 172.21.15.1:0/1744630535 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:29:04.655 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.694+0000 7f144cbe6640 1 -- 172.21.15.1:0/1744630535 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1448107eb0 con 0x7f14481080f0 2024-09-19T09:29:04.655 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.694+0000 7f144cbe6640 1 --2- 172.21.15.1:0/1744630535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14481080f0 0x7f1448107970 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1440032ce0 tx=0x7f1440032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:04.655 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.695+0000 7f1445ffb640 1 -- 172.21.15.1:0/1744630535 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1440042070 con 0x7f14481080f0 2024-09-19T09:29:04.655 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.695+0000 7f1445ffb640 1 -- 172.21.15.1:0/1744630535 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f14400308c0 con 0x7f14481080f0 2024-09-19T09:29:04.655 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.695+0000 7f144ee4a640 1 -- 172.21.15.1:0/1744630535 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14481060a0 con 0x7f14481080f0 2024-09-19T09:29:04.655 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.695+0000 7f1445ffb640 1 -- 172.21.15.1:0/1744630535 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1440037040 con 0x7f14481080f0 2024-09-19T09:29:04.655 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.695+0000 7f144ee4a640 1 -- 172.21.15.1:0/1744630535 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14481065e0 con 0x7f14481080f0 2024-09-19T09:29:04.655 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.696+0000 7f1445ffb640 1 -- 172.21.15.1:0/1744630535 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f1440045070 con 0x7f14481080f0 2024-09-19T09:29:04.655 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.696+0000 7f1445ffb640 1 --2- 172.21.15.1:0/1744630535 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f14340391b0 0x7f143403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:04.655 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.696+0000 7f1445ffb640 1 -- 172.21.15.1:0/1744630535 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f144006c3e0 con 0x7f14481080f0 2024-09-19T09:29:04.655 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.696+0000 7f144ee4a640 1 -- 172.21.15.1:0/1744630535 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1448108550 con 0x7f14481080f0 2024-09-19T09:29:04.656 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.696+0000 7f1447fff640 1 --2- 172.21.15.1:0/1744630535 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f14340391b0 0x7f143403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:04.656 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.697+0000 7f1447fff640 1 --2- 172.21.15.1:0/1744630535 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f14340391b0 0x7f143403b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f143800ad30 tx=0x7f14380093f0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:04.656 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.701+0000 7f1445ffb640 1 -- 172.21.15.1:0/1744630535 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f144004b170 con 0x7f14481080f0 2024-09-19T09:29:04.656 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.904+0000 7f144ee4a640 1 -- 172.21.15.1:0/1744630535 --> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f1448106f50 con 0x7f14340391b0 2024-09-19T09:29:04.656 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.909+0000 7f1445ffb640 1 -- 172.21.15.1:0/1744630535 <== mgr.14118 v2:172.21.15.1:6800/1028873727 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f1438008f50 con 0x7f14340391b0 2024-09-19T09:29:04.656 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.911+0000 7f144ee4a640 1 -- 172.21.15.1:0/1744630535 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f14340391b0 msgr2=0x7f143403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:04.656 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.911+0000 7f144ee4a640 1 --2- 172.21.15.1:0/1744630535 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f14340391b0 0x7f143403b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f143800ad30 tx=0x7f14380093f0 comp rx=0 tx=0).stop 2024-09-19T09:29:04.656 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.911+0000 7f144ee4a640 1 -- 172.21.15.1:0/1744630535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14481080f0 msgr2=0x7f1448107970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:04.656 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.911+0000 7f144ee4a640 1 --2- 172.21.15.1:0/1744630535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14481080f0 0x7f1448107970 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1440032ce0 tx=0x7f1440032d10 comp rx=0 tx=0).stop 2024-09-19T09:29:04.656 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.911+0000 7f144ee4a640 1 -- 172.21.15.1:0/1744630535 shutdown_connections 2024-09-19T09:29:04.656 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.911+0000 7f144ee4a640 1 --2- 172.21.15.1:0/1744630535 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f14340391b0 0x7f143403b670 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:04.656 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.911+0000 7f144ee4a640 1 --2- 172.21.15.1:0/1744630535 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14481080f0 0x7f1448107970 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:04.657 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.911+0000 7f144ee4a640 1 -- 172.21.15.1:0/1744630535 >> 172.21.15.1:0/1744630535 conn(0x7f1448101d30 msgr2=0x7f1448102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:04.657 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.911+0000 7f144ee4a640 1 -- 172.21.15.1:0/1744630535 shutdown_connections 2024-09-19T09:29:04.657 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:03.911+0000 7f144ee4a640 1 -- 172.21.15.1:0/1744630535 wait complete. 2024-09-19T09:29:05.165 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:04 smithi001 ceph-mon[31225]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:29:05.165 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:04 smithi001 ceph-mon[31225]: Saving service mgr spec with placement count:2 2024-09-19T09:29:05.165 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:04 smithi001 ceph-mon[31225]: from='mgr.14118 172.21.15.1:0/3271285817' entity='mgr.x' 2024-09-19T09:29:06.363 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:06 smithi001 ceph-mon[31225]: from='mgr.14118 172.21.15.1:0/3271285817' entity='mgr.x' 2024-09-19T09:29:06.363 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:06 smithi001 ceph-mon[31225]: from='mgr.14118 172.21.15.1:0/3271285817' entity='mgr.x' 2024-09-19T09:29:06.363 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:06 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/2439843381' entity='client.admin' 2024-09-19T09:29:06.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.608+0000 7fbb923f9640 1 Processor -- start 2024-09-19T09:29:06.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.608+0000 7fbb923f9640 1 -- start start 2024-09-19T09:29:06.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.608+0000 7fbb923f9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb8c105960 0x7fbb8c105d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:06.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.608+0000 7fbb923f9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8c106330 con 0x7fbb8c105960 2024-09-19T09:29:06.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.609+0000 7fbb8bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb8c105960 0x7fbb8c105d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:06.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.609+0000 7fbb8bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb8c105960 0x7fbb8c105d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56228/0 (socket says 172.21.15.1:56228) 2024-09-19T09:29:06.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.609+0000 7fbb8bfff640 1 -- 172.21.15.1:0/648236626 learned_addr learned my addr 172.21.15.1:0/648236626 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:29:06.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.609+0000 7fbb8bfff640 1 -- 172.21.15.1:0/648236626 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb8c1066d0 con 0x7fbb8c105960 2024-09-19T09:29:06.370 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.610+0000 7fbb8bfff640 1 --2- 172.21.15.1:0/648236626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb8c105960 0x7fbb8c105d60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbb84009e80 tx=0x7fbb8402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=975449bbe01aeb1d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:06.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.610+0000 7fbb8affd640 1 -- 172.21.15.1:0/648236626 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb84036070 con 0x7fbb8c105960 2024-09-19T09:29:06.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.610+0000 7fbb8affd640 1 -- 172.21.15.1:0/648236626 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb840318e0 con 0x7fbb8c105960 2024-09-19T09:29:06.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.610+0000 7fbb8affd640 1 -- 172.21.15.1:0/648236626 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb84007a00 con 0x7fbb8c105960 2024-09-19T09:29:06.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.610+0000 7fbb923f9640 1 -- 172.21.15.1:0/648236626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb8c105960 msgr2=0x7fbb8c105d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:06.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.610+0000 7fbb923f9640 1 --2- 172.21.15.1:0/648236626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb8c105960 0x7fbb8c105d60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbb84009e80 tx=0x7fbb8402a7a0 comp rx=0 tx=0).stop 2024-09-19T09:29:06.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.610+0000 7fbb923f9640 1 -- 172.21.15.1:0/648236626 shutdown_connections 2024-09-19T09:29:06.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.610+0000 7fbb923f9640 1 --2- 172.21.15.1:0/648236626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb8c105960 0x7fbb8c105d60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:06.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.610+0000 7fbb923f9640 1 -- 172.21.15.1:0/648236626 >> 172.21.15.1:0/648236626 conn(0x7fbb8c101530 msgr2=0x7fbb8c103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:06.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.611+0000 7fbb923f9640 1 -- 172.21.15.1:0/648236626 shutdown_connections 2024-09-19T09:29:06.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.611+0000 7fbb923f9640 1 -- 172.21.15.1:0/648236626 wait complete. 2024-09-19T09:29:06.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.611+0000 7fbb923f9640 1 Processor -- start 2024-09-19T09:29:06.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.611+0000 7fbb923f9640 1 -- start start 2024-09-19T09:29:06.371 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.611+0000 7fbb923f9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb8c105960 0x7fbb8c1a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:06.372 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.611+0000 7fbb923f9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8c109920 con 0x7fbb8c105960 2024-09-19T09:29:06.372 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.612+0000 7fbb8bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb8c105960 0x7fbb8c1a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:06.372 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.612+0000 7fbb8bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb8c105960 0x7fbb8c1a1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56230/0 (socket says 172.21.15.1:56230) 2024-09-19T09:29:06.372 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.612+0000 7fbb8bfff640 1 -- 172.21.15.1:0/2439843381 learned_addr learned my addr 172.21.15.1:0/2439843381 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:29:06.372 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.612+0000 7fbb8bfff640 1 -- 172.21.15.1:0/2439843381 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb8c1a21f0 con 0x7fbb8c105960 2024-09-19T09:29:06.372 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.612+0000 7fbb8bfff640 1 --2- 172.21.15.1:0/2439843381 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb8c105960 0x7fbb8c1a1cb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbb84031cf0 tx=0x7fbb84031d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:06.372 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.612+0000 7fbb897fa640 1 -- 172.21.15.1:0/2439843381 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb84036050 con 0x7fbb8c105960 2024-09-19T09:29:06.372 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.612+0000 7fbb897fa640 1 -- 172.21.15.1:0/2439843381 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb84042070 con 0x7fbb8c105960 2024-09-19T09:29:06.372 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.612+0000 7fbb897fa640 1 -- 172.21.15.1:0/2439843381 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb8403d9b0 con 0x7fbb8c105960 2024-09-19T09:29:06.372 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.612+0000 7fbb923f9640 1 -- 172.21.15.1:0/2439843381 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb8c1a2480 con 0x7fbb8c105960 2024-09-19T09:29:06.372 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.612+0000 7fbb923f9640 1 -- 172.21.15.1:0/2439843381 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb8c1a5170 con 0x7fbb8c105960 2024-09-19T09:29:06.372 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.613+0000 7fbb897fa640 1 -- 172.21.15.1:0/2439843381 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fbb8403db50 con 0x7fbb8c105960 2024-09-19T09:29:06.373 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.613+0000 7fbb923f9640 1 -- 172.21.15.1:0/2439843381 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb8c105de0 con 0x7fbb8c105960 2024-09-19T09:29:06.373 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.613+0000 7fbb897fa640 1 --2- 172.21.15.1:0/2439843381 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7fbb74039260 0x7fbb7403b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:06.373 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.613+0000 7fbb897fa640 1 -- 172.21.15.1:0/2439843381 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fbb8406d700 con 0x7fbb8c105960 2024-09-19T09:29:06.373 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.614+0000 7fbb8b7fe640 1 --2- 172.21.15.1:0/2439843381 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7fbb74039260 0x7fbb7403b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:06.373 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.614+0000 7fbb8b7fe640 1 --2- 172.21.15.1:0/2439843381 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7fbb74039260 0x7fbb7403b720 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbb800098c0 tx=0x7fbb80006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:06.373 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.618+0000 7fbb897fa640 1 -- 172.21.15.1:0/2439843381 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbb84044310 con 0x7fbb8c105960 2024-09-19T09:29:06.373 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.797+0000 7fbb923f9640 1 -- 172.21.15.1:0/2439843381 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fbb8c02d9b0 con 0x7fbb8c105960 2024-09-19T09:29:06.373 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.800+0000 7fbb897fa640 1 -- 172.21.15.1:0/2439843381 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fbb84045520 con 0x7fbb8c105960 2024-09-19T09:29:06.373 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.803+0000 7fbb923f9640 1 -- 172.21.15.1:0/2439843381 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7fbb74039260 msgr2=0x7fbb7403b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:06.373 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.803+0000 7fbb923f9640 1 --2- 172.21.15.1:0/2439843381 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7fbb74039260 0x7fbb7403b720 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbb800098c0 tx=0x7fbb80006db0 comp rx=0 tx=0).stop 2024-09-19T09:29:06.373 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.803+0000 7fbb923f9640 1 -- 172.21.15.1:0/2439843381 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb8c105960 msgr2=0x7fbb8c1a1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:06.373 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.803+0000 7fbb923f9640 1 --2- 172.21.15.1:0/2439843381 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb8c105960 0x7fbb8c1a1cb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbb84031cf0 tx=0x7fbb84031d20 comp rx=0 tx=0).stop 2024-09-19T09:29:06.373 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.803+0000 7fbb923f9640 1 -- 172.21.15.1:0/2439843381 shutdown_connections 2024-09-19T09:29:06.374 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.803+0000 7fbb923f9640 1 --2- 172.21.15.1:0/2439843381 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7fbb74039260 0x7fbb7403b720 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:06.374 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.803+0000 7fbb923f9640 1 --2- 172.21.15.1:0/2439843381 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb8c105960 0x7fbb8c1a1cb0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:06.374 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.803+0000 7fbb923f9640 1 -- 172.21.15.1:0/2439843381 >> 172.21.15.1:0/2439843381 conn(0x7fbb8c101530 msgr2=0x7fbb8c10bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:06.374 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.803+0000 7fbb923f9640 1 -- 172.21.15.1:0/2439843381 shutdown_connections 2024-09-19T09:29:06.374 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:05.803+0000 7fbb923f9640 1 -- 172.21.15.1:0/2439843381 wait complete. 2024-09-19T09:29:07.820 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.759+0000 7f578f0b5640 1 Processor -- start 2024-09-19T09:29:07.820 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.759+0000 7f578f0b5640 1 -- start start 2024-09-19T09:29:07.820 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.759+0000 7f578f0b5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5788107710 0x7f5788107b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:07.820 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.759+0000 7f578f0b5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f57881080e0 con 0x7f5788107710 2024-09-19T09:29:07.820 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.759+0000 7f578ce51640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5788107710 0x7f5788107b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:07.820 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.759+0000 7f578ce51640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5788107710 0x7f5788107b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56236/0 (socket says 172.21.15.1:56236) 2024-09-19T09:29:07.820 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.760+0000 7f578ce51640 1 -- 172.21.15.1:0/230659323 learned_addr learned my addr 172.21.15.1:0/230659323 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:29:07.820 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.760+0000 7f578ce51640 1 -- 172.21.15.1:0/230659323 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5788108910 con 0x7f5788107710 2024-09-19T09:29:07.820 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.760+0000 7f578ce51640 1 --2- 172.21.15.1:0/230659323 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5788107710 0x7f5788107b10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f577c009820 tx=0x7f577c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14aaa902cdd1bab8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:07.820 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.761+0000 7f57877fe640 1 -- 172.21.15.1:0/230659323 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f577c037070 con 0x7f5788107710 2024-09-19T09:29:07.821 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.761+0000 7f57877fe640 1 -- 172.21.15.1:0/230659323 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f577c032920 con 0x7f5788107710 2024-09-19T09:29:07.821 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.761+0000 7f57877fe640 1 -- 172.21.15.1:0/230659323 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f577c030810 con 0x7f5788107710 2024-09-19T09:29:07.821 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.761+0000 7f578f0b5640 1 -- 172.21.15.1:0/230659323 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5788107710 msgr2=0x7f5788107b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:07.821 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.761+0000 7f578f0b5640 1 --2- 172.21.15.1:0/230659323 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5788107710 0x7f5788107b10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f577c009820 tx=0x7f577c02a270 comp rx=0 tx=0).stop 2024-09-19T09:29:07.821 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.761+0000 7f578f0b5640 1 -- 172.21.15.1:0/230659323 shutdown_connections 2024-09-19T09:29:07.821 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.761+0000 7f578f0b5640 1 --2- 172.21.15.1:0/230659323 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5788107710 0x7f5788107b10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:07.821 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.761+0000 7f578f0b5640 1 -- 172.21.15.1:0/230659323 >> 172.21.15.1:0/230659323 conn(0x7f5788102f20 msgr2=0x7f5788105340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:07.821 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.761+0000 7f578f0b5640 1 -- 172.21.15.1:0/230659323 shutdown_connections 2024-09-19T09:29:07.821 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.761+0000 7f578f0b5640 1 -- 172.21.15.1:0/230659323 wait complete. 2024-09-19T09:29:07.821 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.762+0000 7f578f0b5640 1 Processor -- start 2024-09-19T09:29:07.821 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.762+0000 7f578f0b5640 1 -- start start 2024-09-19T09:29:07.821 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.762+0000 7f578f0b5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5788107710 0x7f578819d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:07.822 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.762+0000 7f578f0b5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f578810bcc0 con 0x7f5788107710 2024-09-19T09:29:07.822 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.762+0000 7f578ce51640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5788107710 0x7f578819d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:07.822 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.762+0000 7f578ce51640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5788107710 0x7f578819d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56244/0 (socket says 172.21.15.1:56244) 2024-09-19T09:29:07.822 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.762+0000 7f578ce51640 1 -- 172.21.15.1:0/2732147536 learned_addr learned my addr 172.21.15.1:0/2732147536 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:29:07.822 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.763+0000 7f578ce51640 1 -- 172.21.15.1:0/2732147536 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f578819de10 con 0x7f5788107710 2024-09-19T09:29:07.822 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.763+0000 7f578ce51640 1 --2- 172.21.15.1:0/2732147536 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5788107710 0x7f578819d8d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f577c030560 tx=0x7f577c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:07.822 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.763+0000 7f5785ffb640 1 -- 172.21.15.1:0/2732147536 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f577c037040 con 0x7f5788107710 2024-09-19T09:29:07.822 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.763+0000 7f5785ffb640 1 -- 172.21.15.1:0/2732147536 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f577c040070 con 0x7f5788107710 2024-09-19T09:29:07.822 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.763+0000 7f578f0b5640 1 -- 172.21.15.1:0/2732147536 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f578819e0a0 con 0x7f5788107710 2024-09-19T09:29:07.822 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.763+0000 7f5785ffb640 1 -- 172.21.15.1:0/2732147536 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f577c03a740 con 0x7f5788107710 2024-09-19T09:29:07.822 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.763+0000 7f578f0b5640 1 -- 172.21.15.1:0/2732147536 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57881a0d90 con 0x7f5788107710 2024-09-19T09:29:07.822 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.764+0000 7f5785ffb640 1 -- 172.21.15.1:0/2732147536 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f577c03b420 con 0x7f5788107710 2024-09-19T09:29:07.822 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.764+0000 7f578f0b5640 1 -- 172.21.15.1:0/2732147536 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5788107b90 con 0x7f5788107710 2024-09-19T09:29:07.822 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.765+0000 7f5785ffb640 1 --2- 172.21.15.1:0/2732147536 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f5778039200 0x7f577803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:07.823 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.765+0000 7f5785ffb640 1 -- 172.21.15.1:0/2732147536 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f577c06c820 con 0x7f5788107710 2024-09-19T09:29:07.823 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.765+0000 7f5787fff640 1 --2- 172.21.15.1:0/2732147536 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f5778039200 0x7f577803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:07.823 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.765+0000 7f5787fff640 1 --2- 172.21.15.1:0/2732147536 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f5778039200 0x7f577803b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f57740098c0 tx=0x7f5774006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:07.823 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.769+0000 7f5785ffb640 1 -- 172.21.15.1:0/2732147536 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f577c04a200 con 0x7f5788107710 2024-09-19T09:29:07.823 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.965+0000 7f578f0b5640 1 -- 172.21.15.1:0/2732147536 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f57881a13f0 con 0x7f5788107710 2024-09-19T09:29:07.823 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.967+0000 7f5785ffb640 1 -- 172.21.15.1:0/2732147536 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f577c031e80 con 0x7f5788107710 2024-09-19T09:29:07.823 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.971+0000 7f578f0b5640 1 -- 172.21.15.1:0/2732147536 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f5778039200 msgr2=0x7f577803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:07.823 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.971+0000 7f578f0b5640 1 --2- 172.21.15.1:0/2732147536 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f5778039200 0x7f577803b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f57740098c0 tx=0x7f5774006db0 comp rx=0 tx=0).stop 2024-09-19T09:29:07.823 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.971+0000 7f578f0b5640 1 -- 172.21.15.1:0/2732147536 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5788107710 msgr2=0x7f578819d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:07.823 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.971+0000 7f578f0b5640 1 --2- 172.21.15.1:0/2732147536 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5788107710 0x7f578819d8d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f577c030560 tx=0x7f577c032670 comp rx=0 tx=0).stop 2024-09-19T09:29:07.823 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.971+0000 7f578f0b5640 1 -- 172.21.15.1:0/2732147536 shutdown_connections 2024-09-19T09:29:07.823 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.971+0000 7f578f0b5640 1 --2- 172.21.15.1:0/2732147536 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f5778039200 0x7f577803b6c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:07.823 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.971+0000 7f578f0b5640 1 --2- 172.21.15.1:0/2732147536 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5788107710 0x7f578819d8d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:07.823 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.971+0000 7f578f0b5640 1 -- 172.21.15.1:0/2732147536 >> 172.21.15.1:0/2732147536 conn(0x7f5788102f20 msgr2=0x7f5788103a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:07.824 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.971+0000 7f578f0b5640 1 -- 172.21.15.1:0/2732147536 shutdown_connections 2024-09-19T09:29:07.824 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:06.971+0000 7f578f0b5640 1 -- 172.21.15.1:0/2732147536 wait complete. 2024-09-19T09:29:07.824 INFO:teuthology.orchestra.run.smithi001.stdout:Enabling the dashboard module... 2024-09-19T09:29:08.205 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:07 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/2732147536' entity='client.admin' 2024-09-19T09:29:09.190 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:08 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/497132787' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-19T09:29:09.191 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:08 smithi001 ceph-mon[31225]: from='mgr.14118 172.21.15.1:0/3271285817' entity='mgr.x' 2024-09-19T09:29:09.191 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:09 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: ignoring --setuser ceph since I am not root 2024-09-19T09:29:09.191 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:09 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: ignoring --setgroup ceph since I am not root 2024-09-19T09:29:09.191 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:09 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:29:09.130+0000 7f9046847040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T09:29:09.191 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:09 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:29:09.189+0000 7f9046847040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:29:09.497 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:09 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:29:09.346+0000 7f9046847040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:29:09.497 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:09 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:29:09.415+0000 7f9046847040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:29:09.604 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.203+0000 7f37c6c84640 1 Processor -- start 2024-09-19T09:29:09.604 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.203+0000 7f37c6c84640 1 -- start start 2024-09-19T09:29:09.604 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.204+0000 7f37c6c84640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37c0107710 0x7f37c0107b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:09.604 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.204+0000 7f37c6c84640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f37c01080e0 con 0x7f37c0107710 2024-09-19T09:29:09.604 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.204+0000 7f37c4a20640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37c0107710 0x7f37c0107b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:09.605 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.204+0000 7f37c4a20640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37c0107710 0x7f37c0107b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56248/0 (socket says 172.21.15.1:56248) 2024-09-19T09:29:09.605 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.204+0000 7f37c4a20640 1 -- 172.21.15.1:0/3516599685 learned_addr learned my addr 172.21.15.1:0/3516599685 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:29:09.605 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.204+0000 7f37c4a20640 1 -- 172.21.15.1:0/3516599685 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c0108910 con 0x7f37c0107710 2024-09-19T09:29:09.605 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.205+0000 7f37c4a20640 1 --2- 172.21.15.1:0/3516599685 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37c0107710 0x7f37c0107b10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f37b4009820 tx=0x7f37b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f7e4759d90d5bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:09.605 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.205+0000 7f37bf7fe640 1 -- 172.21.15.1:0/3516599685 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b4037070 con 0x7f37c0107710 2024-09-19T09:29:09.605 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.205+0000 7f37bf7fe640 1 -- 172.21.15.1:0/3516599685 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37b4032920 con 0x7f37c0107710 2024-09-19T09:29:09.605 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.205+0000 7f37bf7fe640 1 -- 172.21.15.1:0/3516599685 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b4030810 con 0x7f37c0107710 2024-09-19T09:29:09.605 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.206+0000 7f37c6c84640 1 -- 172.21.15.1:0/3516599685 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37c0107710 msgr2=0x7f37c0107b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:09.605 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.206+0000 7f37c6c84640 1 --2- 172.21.15.1:0/3516599685 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37c0107710 0x7f37c0107b10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f37b4009820 tx=0x7f37b402a270 comp rx=0 tx=0).stop 2024-09-19T09:29:09.605 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.206+0000 7f37c6c84640 1 -- 172.21.15.1:0/3516599685 shutdown_connections 2024-09-19T09:29:09.605 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.206+0000 7f37c6c84640 1 --2- 172.21.15.1:0/3516599685 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37c0107710 0x7f37c0107b10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.605 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.206+0000 7f37c6c84640 1 -- 172.21.15.1:0/3516599685 >> 172.21.15.1:0/3516599685 conn(0x7f37c0102f20 msgr2=0x7f37c0105340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:09.605 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.206+0000 7f37c6c84640 1 -- 172.21.15.1:0/3516599685 shutdown_connections 2024-09-19T09:29:09.606 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.206+0000 7f37c6c84640 1 -- 172.21.15.1:0/3516599685 wait complete. 2024-09-19T09:29:09.606 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.206+0000 7f37c6c84640 1 Processor -- start 2024-09-19T09:29:09.606 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.206+0000 7f37c6c84640 1 -- start start 2024-09-19T09:29:09.606 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.206+0000 7f37c6c84640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37c0107710 0x7f37c019b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:09.606 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.206+0000 7f37c6c84640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f37c010bcc0 con 0x7f37c0107710 2024-09-19T09:29:09.606 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.207+0000 7f37c4a20640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37c0107710 0x7f37c019b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:09.606 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.207+0000 7f37c4a20640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37c0107710 0x7f37c019b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56264/0 (socket says 172.21.15.1:56264) 2024-09-19T09:29:09.606 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.207+0000 7f37c4a20640 1 -- 172.21.15.1:0/497132787 learned_addr learned my addr 172.21.15.1:0/497132787 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:29:09.606 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.207+0000 7f37c4a20640 1 -- 172.21.15.1:0/497132787 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c019bbe0 con 0x7f37c0107710 2024-09-19T09:29:09.606 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.207+0000 7f37c4a20640 1 --2- 172.21.15.1:0/497132787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37c0107710 0x7f37c019b6a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f37b4030560 tx=0x7f37b4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:09.606 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.207+0000 7f37bdffb640 1 -- 172.21.15.1:0/497132787 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b4037040 con 0x7f37c0107710 2024-09-19T09:29:09.606 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.207+0000 7f37bdffb640 1 -- 172.21.15.1:0/497132787 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37b4040070 con 0x7f37c0107710 2024-09-19T09:29:09.606 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.207+0000 7f37c6c84640 1 -- 172.21.15.1:0/497132787 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37c019be70 con 0x7f37c0107710 2024-09-19T09:29:09.606 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.207+0000 7f37bdffb640 1 -- 172.21.15.1:0/497132787 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37b403a740 con 0x7f37c0107710 2024-09-19T09:29:09.607 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.207+0000 7f37c6c84640 1 -- 172.21.15.1:0/497132787 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37c019eb60 con 0x7f37c0107710 2024-09-19T09:29:09.607 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.208+0000 7f37bdffb640 1 -- 172.21.15.1:0/497132787 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f37b403a9b0 con 0x7f37c0107710 2024-09-19T09:29:09.607 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.208+0000 7f37bdffb640 1 --2- 172.21.15.1:0/497132787 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f37b00391b0 0x7f37b003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:09.607 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.208+0000 7f37bdffb640 1 -- 172.21.15.1:0/497132787 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f37b406c880 con 0x7f37c0107710 2024-09-19T09:29:09.607 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.209+0000 7f37bffff640 1 --2- 172.21.15.1:0/497132787 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f37b00391b0 0x7f37b003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:09.607 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.209+0000 7f37c6c84640 1 -- 172.21.15.1:0/497132787 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37c0107b90 con 0x7f37c0107710 2024-09-19T09:29:09.607 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.209+0000 7f37bffff640 1 --2- 172.21.15.1:0/497132787 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f37b00391b0 0x7f37b003b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f37ac0098c0 tx=0x7f37ac006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:09.607 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.213+0000 7f37bdffb640 1 -- 172.21.15.1:0/497132787 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f37b4041270 con 0x7f37c0107710 2024-09-19T09:29:09.607 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.435+0000 7f37c6c84640 1 -- 172.21.15.1:0/497132787 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f37c019f020 con 0x7f37c0107710 2024-09-19T09:29:09.607 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.969+0000 7f37bdffb640 1 -- 172.21.15.1:0/497132787 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f37b40328f0 con 0x7f37c0107710 2024-09-19T09:29:09.607 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.972+0000 7f37bdffb640 1 -- 172.21.15.1:0/497132787 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f37b4045980 con 0x7f37c0107710 2024-09-19T09:29:09.607 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.972+0000 7f37c6c84640 1 -- 172.21.15.1:0/497132787 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f37b00391b0 msgr2=0x7f37b003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:09.608 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.972+0000 7f37c6c84640 1 --2- 172.21.15.1:0/497132787 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f37b00391b0 0x7f37b003b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f37ac0098c0 tx=0x7f37ac006db0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.608 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.973+0000 7f37c6c84640 1 -- 172.21.15.1:0/497132787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37c0107710 msgr2=0x7f37c019b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:09.608 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.973+0000 7f37c6c84640 1 --2- 172.21.15.1:0/497132787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37c0107710 0x7f37c019b6a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f37b4030560 tx=0x7f37b4032670 comp rx=0 tx=0).stop 2024-09-19T09:29:09.608 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.973+0000 7f37c6c84640 1 -- 172.21.15.1:0/497132787 shutdown_connections 2024-09-19T09:29:09.608 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.973+0000 7f37c6c84640 1 --2- 172.21.15.1:0/497132787 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f37b00391b0 0x7f37b003b670 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.608 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.973+0000 7f37c6c84640 1 --2- 172.21.15.1:0/497132787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37c0107710 0x7f37c019b6a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:09.608 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.973+0000 7f37c6c84640 1 -- 172.21.15.1:0/497132787 >> 172.21.15.1:0/497132787 conn(0x7f37c0102f20 msgr2=0x7f37c0103a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:09.608 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.973+0000 7f37c6c84640 1 -- 172.21.15.1:0/497132787 shutdown_connections 2024-09-19T09:29:09.608 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:08.973+0000 7f37c6c84640 1 -- 172.21.15.1:0/497132787 wait complete. 2024-09-19T09:29:09.851 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:09 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:29:09.569+0000 7f9046847040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:29:09.851 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:09 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:29:09.725+0000 7f9046847040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:29:10.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:09 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/497132787' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-19T09:29:10.126 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:09 smithi001 ceph-mon[31225]: mgrmap e9: x(active, since 18s) 2024-09-19T09:29:10.126 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:10 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:29:10.060+0000 7f9046847040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:29:10.126 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:10 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:29:10.125+0000 7f9046847040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:29:10.497 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:10 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:29:10.322+0000 7f9046847040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:29:10.879 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:29:10.879 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-19T09:29:10.879 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T09:29:10.879 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T09:29:10.879 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T09:29:10.879 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:29:10.879 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.038+0000 7ff434183640 1 Processor -- start 2024-09-19T09:29:10.879 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.039+0000 7ff434183640 1 -- start start 2024-09-19T09:29:10.880 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.039+0000 7ff434183640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff42c108110 0x7ff42c10a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:10.880 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.039+0000 7ff434183640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff42c07be90 con 0x7ff42c108110 2024-09-19T09:29:10.880 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.039+0000 7ff431f1f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff42c108110 0x7ff42c10a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:10.880 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.039+0000 7ff431f1f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff42c108110 0x7ff42c10a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56286/0 (socket says 172.21.15.1:56286) 2024-09-19T09:29:10.880 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.039+0000 7ff431f1f640 1 -- 172.21.15.1:0/1995780443 learned_addr learned my addr 172.21.15.1:0/1995780443 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:29:10.880 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.039+0000 7ff431f1f640 1 -- 172.21.15.1:0/1995780443 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff42c10aa40 con 0x7ff42c108110 2024-09-19T09:29:10.880 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.040+0000 7ff431f1f640 1 --2- 172.21.15.1:0/1995780443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff42c108110 0x7ff42c10a500 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff428009820 tx=0x7ff42802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a904f37464b4de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:10.880 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.040+0000 7ff430f1d640 1 -- 172.21.15.1:0/1995780443 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff428037070 con 0x7ff42c108110 2024-09-19T09:29:10.880 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.040+0000 7ff430f1d640 1 -- 172.21.15.1:0/1995780443 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff428032920 con 0x7ff42c108110 2024-09-19T09:29:10.880 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.040+0000 7ff430f1d640 1 -- 172.21.15.1:0/1995780443 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff428030810 con 0x7ff42c108110 2024-09-19T09:29:10.880 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.041+0000 7ff434183640 1 -- 172.21.15.1:0/1995780443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff42c108110 msgr2=0x7ff42c10a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:10.880 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.041+0000 7ff434183640 1 --2- 172.21.15.1:0/1995780443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff42c108110 0x7ff42c10a500 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff428009820 tx=0x7ff42802a270 comp rx=0 tx=0).stop 2024-09-19T09:29:10.881 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.041+0000 7ff434183640 1 -- 172.21.15.1:0/1995780443 shutdown_connections 2024-09-19T09:29:10.881 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.041+0000 7ff434183640 1 --2- 172.21.15.1:0/1995780443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff42c108110 0x7ff42c10a500 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:10.881 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.041+0000 7ff434183640 1 -- 172.21.15.1:0/1995780443 >> 172.21.15.1:0/1995780443 conn(0x7ff42c101d50 msgr2=0x7ff42c104170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:10.881 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.041+0000 7ff434183640 1 -- 172.21.15.1:0/1995780443 shutdown_connections 2024-09-19T09:29:10.881 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.041+0000 7ff434183640 1 -- 172.21.15.1:0/1995780443 wait complete. 2024-09-19T09:29:10.881 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.042+0000 7ff434183640 1 Processor -- start 2024-09-19T09:29:10.881 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.042+0000 7ff434183640 1 -- start start 2024-09-19T09:29:10.881 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.042+0000 7ff434183640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff42c108110 0x7ff42c19b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:10.881 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.042+0000 7ff434183640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff42c10bb20 con 0x7ff42c108110 2024-09-19T09:29:10.881 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.042+0000 7ff431f1f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff42c108110 0x7ff42c19b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:10.881 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.042+0000 7ff431f1f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff42c108110 0x7ff42c19b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56288/0 (socket says 172.21.15.1:56288) 2024-09-19T09:29:10.881 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.042+0000 7ff431f1f640 1 -- 172.21.15.1:0/755705087 learned_addr learned my addr 172.21.15.1:0/755705087 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:29:10.882 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.042+0000 7ff431f1f640 1 -- 172.21.15.1:0/755705087 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff42c19bc50 con 0x7ff42c108110 2024-09-19T09:29:10.882 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.042+0000 7ff431f1f640 1 --2- 172.21.15.1:0/755705087 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff42c108110 0x7ff42c19b710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff428030420 tx=0x7ff428032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:10.882 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.042+0000 7ff41effd640 1 -- 172.21.15.1:0/755705087 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff428037040 con 0x7ff42c108110 2024-09-19T09:29:10.882 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.042+0000 7ff41effd640 1 -- 172.21.15.1:0/755705087 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff428040070 con 0x7ff42c108110 2024-09-19T09:29:10.882 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.042+0000 7ff41effd640 1 -- 172.21.15.1:0/755705087 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff42803a6e0 con 0x7ff42c108110 2024-09-19T09:29:10.882 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.042+0000 7ff434183640 1 -- 172.21.15.1:0/755705087 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff42c19bee0 con 0x7ff42c108110 2024-09-19T09:29:10.882 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.043+0000 7ff434183640 1 -- 172.21.15.1:0/755705087 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff42c19ebd0 con 0x7ff42c108110 2024-09-19T09:29:10.882 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.043+0000 7ff41effd640 1 -- 172.21.15.1:0/755705087 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7ff42803a990 con 0x7ff42c108110 2024-09-19T09:29:10.882 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.044+0000 7ff41effd640 1 --2- 172.21.15.1:0/755705087 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7ff418039260 0x7ff41803b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:10.882 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.044+0000 7ff41effd640 1 -- 172.21.15.1:0/755705087 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff42806c970 con 0x7ff42c108110 2024-09-19T09:29:10.882 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.044+0000 7ff43171e640 1 -- 172.21.15.1:0/755705087 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7ff418039260 msgr2=0x7ff41803b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/1028873727 2024-09-19T09:29:10.882 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.044+0000 7ff43171e640 1 --2- 172.21.15.1:0/755705087 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7ff418039260 0x7ff41803b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:29:10.882 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.044+0000 7ff434183640 1 -- 172.21.15.1:0/755705087 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff42c108570 con 0x7ff42c108110 2024-09-19T09:29:10.883 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.049+0000 7ff41effd640 1 -- 172.21.15.1:0/755705087 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff428041270 con 0x7ff42c108110 2024-09-19T09:29:10.883 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.245+0000 7ff43171e640 1 -- 172.21.15.1:0/755705087 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7ff418039260 msgr2=0x7ff41803b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/1028873727 2024-09-19T09:29:10.883 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.245+0000 7ff43171e640 1 --2- 172.21.15.1:0/755705087 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7ff418039260 0x7ff41803b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:29:10.883 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.275+0000 7ff434183640 1 -- 172.21.15.1:0/755705087 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7ff42c19f0b0 con 0x7ff42c108110 2024-09-19T09:29:10.883 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.275+0000 7ff41effd640 1 -- 172.21.15.1:0/755705087 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7ff42806c2c0 con 0x7ff42c108110 2024-09-19T09:29:10.883 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.277+0000 7ff434183640 1 -- 172.21.15.1:0/755705087 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7ff418039260 msgr2=0x7ff41803b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:29:10.883 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.277+0000 7ff434183640 1 --2- 172.21.15.1:0/755705087 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7ff418039260 0x7ff41803b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:10.883 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.277+0000 7ff434183640 1 -- 172.21.15.1:0/755705087 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff42c108110 msgr2=0x7ff42c19b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:10.883 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.277+0000 7ff434183640 1 --2- 172.21.15.1:0/755705087 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff42c108110 0x7ff42c19b710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff428030420 tx=0x7ff428032670 comp rx=0 tx=0).stop 2024-09-19T09:29:10.883 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.277+0000 7ff434183640 1 -- 172.21.15.1:0/755705087 shutdown_connections 2024-09-19T09:29:10.883 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.278+0000 7ff434183640 1 --2- 172.21.15.1:0/755705087 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7ff418039260 0x7ff41803b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:10.883 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.278+0000 7ff434183640 1 --2- 172.21.15.1:0/755705087 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff42c108110 0x7ff42c19b710 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:10.883 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.278+0000 7ff434183640 1 -- 172.21.15.1:0/755705087 >> 172.21.15.1:0/755705087 conn(0x7ff42c101d50 msgr2=0x7ff42c1029c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:10.884 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.278+0000 7ff434183640 1 -- 172.21.15.1:0/755705087 shutdown_connections 2024-09-19T09:29:10.884 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:10.278+0000 7ff434183640 1 -- 172.21.15.1:0/755705087 wait complete. 2024-09-19T09:29:10.884 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for the mgr to restart... 2024-09-19T09:29:10.884 INFO:teuthology.orchestra.run.smithi001.stdout:Waiting for mgr epoch 9... 2024-09-19T09:29:11.145 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:10 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/755705087' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T09:29:11.497 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:11 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:29:11.261+0000 7f9046847040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:29:11.497 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:11 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:29:11.333+0000 7f9046847040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:29:12.204 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:12 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:29:12.082+0000 7f9046847040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:29:12.497 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:12 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:29:12.203+0000 7f9046847040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:29:12.497 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:12 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:29:12.352+0000 7f9046847040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:29:12.497 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:12 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:29:12.416+0000 7f9046847040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:29:12.872 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:12 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:29:12.572+0000 7f9046847040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:29:12.872 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:12 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:29:12.643+0000 7f9046847040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:29:12.872 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:12 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:29:12.705+0000 7f9046847040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:29:12.872 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:12 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:29:12.871+0000 7f9046847040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:29:13.157 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:12 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:29:12.938+0000 7f9046847040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:29:13.158 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:13 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:29:13.008+0000 7f9046847040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:29:13.158 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:13 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:29:13.094+0000 7f9046847040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:29:13.158 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:13 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:29:13.156+0000 7f9046847040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:29:13.497 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:13 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:29:13.218+0000 7f9046847040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:29:14.299 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:14 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:29:14.045+0000 7f9046847040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:29:14.299 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:14 smithi001 ceph-mon[31225]: Active manager daemon x restarted 2024-09-19T09:29:14.299 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:14 smithi001 ceph-mon[31225]: Activating manager daemon x 2024-09-19T09:29:14.299 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:14 smithi001 ceph-mon[31225]: osdmap e3: 0 total, 0 up, 0 in 2024-09-19T09:29:14.300 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:14 smithi001 ceph-mon[31225]: mgrmap e10: x(active, starting, since 0.00320861s) 2024-09-19T09:29:14.300 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:14 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:29:14.300 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:14 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T09:29:14.300 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:14 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T09:29:14.300 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:14 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T09:29:14.300 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:14 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T09:29:14.300 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:14 smithi001 ceph-mon[31225]: Manager daemon x is now available 2024-09-19T09:29:14.300 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:14 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:29:14.300 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:14 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T09:29:14.300 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:14 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T09:29:15.989 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout { 2024-09-19T09:29:15.989 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-19T09:29:15.989 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T09:29:15.989 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout } 2024-09-19T09:29:15.989 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.335+0000 7f7217973640 1 Processor -- start 2024-09-19T09:29:15.989 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.336+0000 7f7217973640 1 -- start start 2024-09-19T09:29:15.989 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.336+0000 7f7217973640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7210105fa0 0x7f72101063a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:15.989 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.336+0000 7f7217973640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f721007bdf0 con 0x7f7210105fa0 2024-09-19T09:29:15.989 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.336+0000 7f721570f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7210105fa0 0x7f72101063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:15.989 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.336+0000 7f721570f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7210105fa0 0x7f72101063a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56302/0 (socket says 172.21.15.1:56302) 2024-09-19T09:29:15.989 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.336+0000 7f721570f640 1 -- 172.21.15.1:0/182074123 learned_addr learned my addr 172.21.15.1:0/182074123 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:29:15.989 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.336+0000 7f721570f640 1 -- 172.21.15.1:0/182074123 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72101068e0 con 0x7f7210105fa0 2024-09-19T09:29:15.990 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.337+0000 7f721570f640 1 --2- 172.21.15.1:0/182074123 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7210105fa0 0x7f72101063a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f720c009820 tx=0x7f720c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47cc0e28ac3c2173 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:15.990 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.337+0000 7f7207fff640 1 -- 172.21.15.1:0/182074123 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f720c037070 con 0x7f7210105fa0 2024-09-19T09:29:15.990 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.337+0000 7f7207fff640 1 -- 172.21.15.1:0/182074123 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f720c032920 con 0x7f7210105fa0 2024-09-19T09:29:15.990 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.337+0000 7f7207fff640 1 -- 172.21.15.1:0/182074123 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f720c030810 con 0x7f7210105fa0 2024-09-19T09:29:15.990 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.338+0000 7f7217973640 1 -- 172.21.15.1:0/182074123 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7210105fa0 msgr2=0x7f72101063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:15.990 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.338+0000 7f7217973640 1 --2- 172.21.15.1:0/182074123 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7210105fa0 0x7f72101063a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f720c009820 tx=0x7f720c02a270 comp rx=0 tx=0).stop 2024-09-19T09:29:15.990 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.338+0000 7f7217973640 1 -- 172.21.15.1:0/182074123 shutdown_connections 2024-09-19T09:29:15.990 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.338+0000 7f7217973640 1 --2- 172.21.15.1:0/182074123 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7210105fa0 0x7f72101063a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.990 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.338+0000 7f7217973640 1 -- 172.21.15.1:0/182074123 >> 172.21.15.1:0/182074123 conn(0x7f7210101d90 msgr2=0x7f72101041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:15.990 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.338+0000 7f7217973640 1 -- 172.21.15.1:0/182074123 shutdown_connections 2024-09-19T09:29:15.990 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.338+0000 7f7217973640 1 -- 172.21.15.1:0/182074123 wait complete. 2024-09-19T09:29:15.990 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.339+0000 7f7217973640 1 Processor -- start 2024-09-19T09:29:15.991 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.339+0000 7f7217973640 1 -- start start 2024-09-19T09:29:15.991 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.339+0000 7f7217973640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7210105fa0 0x7f721019d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:15.991 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.339+0000 7f7217973640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7210107a20 con 0x7f7210105fa0 2024-09-19T09:29:15.991 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.339+0000 7f721570f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7210105fa0 0x7f721019d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:15.991 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.339+0000 7f721570f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7210105fa0 0x7f721019d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56314/0 (socket says 172.21.15.1:56314) 2024-09-19T09:29:15.991 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.339+0000 7f721570f640 1 -- 172.21.15.1:0/1802084907 learned_addr learned my addr 172.21.15.1:0/1802084907 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:29:15.991 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.339+0000 7f721570f640 1 -- 172.21.15.1:0/1802084907 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f721019ddb0 con 0x7f7210105fa0 2024-09-19T09:29:15.991 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.339+0000 7f721570f640 1 --2- 172.21.15.1:0/1802084907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7210105fa0 0x7f721019d870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f720c030380 tx=0x7f720c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:15.991 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.340+0000 7f72067fc640 1 -- 172.21.15.1:0/1802084907 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f720c037040 con 0x7f7210105fa0 2024-09-19T09:29:15.991 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.340+0000 7f72067fc640 1 -- 172.21.15.1:0/1802084907 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f720c040070 con 0x7f7210105fa0 2024-09-19T09:29:15.991 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.340+0000 7f7217973640 1 -- 172.21.15.1:0/1802084907 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f721019e040 con 0x7f7210105fa0 2024-09-19T09:29:15.991 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.340+0000 7f72067fc640 1 -- 172.21.15.1:0/1802084907 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f720c03a7b0 con 0x7f7210105fa0 2024-09-19T09:29:15.991 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.340+0000 7f7217973640 1 -- 172.21.15.1:0/1802084907 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72101a0d30 con 0x7f7210105fa0 2024-09-19T09:29:15.991 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.341+0000 7f72067fc640 1 -- 172.21.15.1:0/1802084907 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f720c03bc00 con 0x7f7210105fa0 2024-09-19T09:29:15.992 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.341+0000 7f72067fc640 1 --2- 172.21.15.1:0/1802084907 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f71fc039200 0x7f71fc03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:15.992 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.341+0000 7f72067fc640 1 -- 172.21.15.1:0/1802084907 --> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f71fc03bdd0 con 0x7f71fc039200 2024-09-19T09:29:15.992 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.341+0000 7f72067fc640 1 -- 172.21.15.1:0/1802084907 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f720c06c960 con 0x7f7210105fa0 2024-09-19T09:29:15.992 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.341+0000 7f7214f0e640 1 -- 172.21.15.1:0/1802084907 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f71fc039200 msgr2=0x7f71fc03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/1028873727 2024-09-19T09:29:15.992 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.341+0000 7f7214f0e640 1 --2- 172.21.15.1:0/1802084907 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f71fc039200 0x7f71fc03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:29:15.992 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.542+0000 7f7214f0e640 1 -- 172.21.15.1:0/1802084907 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f71fc039200 msgr2=0x7f71fc03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/1028873727 2024-09-19T09:29:15.992 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.542+0000 7f7214f0e640 1 --2- 172.21.15.1:0/1802084907 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f71fc039200 0x7f71fc03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T09:29:15.992 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.943+0000 7f7214f0e640 1 -- 172.21.15.1:0/1802084907 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f71fc039200 msgr2=0x7f71fc03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/1028873727 2024-09-19T09:29:15.992 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:11.943+0000 7f7214f0e640 1 --2- 172.21.15.1:0/1802084907 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f71fc039200 0x7f71fc03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T09:29:15.992 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:12.744+0000 7f7214f0e640 1 -- 172.21.15.1:0/1802084907 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f71fc039200 msgr2=0x7f71fc03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.1:6800/1028873727 2024-09-19T09:29:15.992 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:12.744+0000 7f7214f0e640 1 --2- 172.21.15.1:0/1802084907 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f71fc039200 0x7f71fc03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T09:29:15.992 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:14.048+0000 7f72067fc640 1 -- 172.21.15.1:0/1802084907 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7f720c06b410 con 0x7f7210105fa0 2024-09-19T09:29:15.992 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:14.048+0000 7f72067fc640 1 -- 172.21.15.1:0/1802084907 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f71fc039200 msgr2=0x7f71fc03b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:29:15.993 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:14.048+0000 7f72067fc640 1 --2- 172.21.15.1:0/1802084907 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f71fc039200 0x7f71fc03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.993 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:15.049+0000 7f72067fc640 1 -- 172.21.15.1:0/1802084907 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f720c0313a0 con 0x7f7210105fa0 2024-09-19T09:29:15.993 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:15.049+0000 7f72067fc640 1 --2- 172.21.15.1:0/1802084907 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f71fc03ccc0 0x7f71fc03f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:15.993 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:15.049+0000 7f72067fc640 1 -- 172.21.15.1:0/1802084907 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f720c00af30 con 0x7f71fc03ccc0 2024-09-19T09:29:15.993 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:15.050+0000 7f7214f0e640 1 --2- 172.21.15.1:0/1802084907 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f71fc03ccc0 0x7f71fc03f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:15.993 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:15.051+0000 7f7214f0e640 1 --2- 172.21.15.1:0/1802084907 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f71fc03ccc0 0x7f71fc03f0b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7200003980 tx=0x7f7200006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:15.993 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:15.051+0000 7f72067fc640 1 -- 172.21.15.1:0/1802084907 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f720c00af30 con 0x7f71fc03ccc0 2024-09-19T09:29:15.993 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:15.058+0000 7f7217973640 1 -- 172.21.15.1:0/1802084907 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f72101063a0 con 0x7f71fc03ccc0 2024-09-19T09:29:15.993 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:15.058+0000 7f72067fc640 1 -- 172.21.15.1:0/1802084907 <== mgr.14150 v2:172.21.15.1:6800/3871697789 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f72101063a0 con 0x7f71fc03ccc0 2024-09-19T09:29:15.993 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:15.059+0000 7f7217973640 1 -- 172.21.15.1:0/1802084907 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f71fc03ccc0 msgr2=0x7f71fc03f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:15.993 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:15.059+0000 7f7217973640 1 --2- 172.21.15.1:0/1802084907 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f71fc03ccc0 0x7f71fc03f0b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7200003980 tx=0x7f7200006e10 comp rx=0 tx=0).stop 2024-09-19T09:29:15.993 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:15.059+0000 7f7217973640 1 -- 172.21.15.1:0/1802084907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7210105fa0 msgr2=0x7f721019d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:15.993 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:15.059+0000 7f7217973640 1 --2- 172.21.15.1:0/1802084907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7210105fa0 0x7f721019d870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f720c030380 tx=0x7f720c032670 comp rx=0 tx=0).stop 2024-09-19T09:29:15.994 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:15.059+0000 7f7217973640 1 -- 172.21.15.1:0/1802084907 shutdown_connections 2024-09-19T09:29:15.994 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:15.059+0000 7f7217973640 1 --2- 172.21.15.1:0/1802084907 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f71fc03ccc0 0x7f71fc03f0b0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.994 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:15.059+0000 7f7217973640 1 --2- 172.21.15.1:0/1802084907 >> [v2:172.21.15.1:6800/1028873727,v1:172.21.15.1:6801/1028873727] conn(0x7f71fc039200 0x7f71fc03b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.994 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:15.059+0000 7f7217973640 1 --2- 172.21.15.1:0/1802084907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7210105fa0 0x7f721019d870 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:15.994 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:15.059+0000 7f7217973640 1 -- 172.21.15.1:0/1802084907 >> 172.21.15.1:0/1802084907 conn(0x7f7210101d90 msgr2=0x7f7210191b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:15.994 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:15.059+0000 7f7217973640 1 -- 172.21.15.1:0/1802084907 shutdown_connections 2024-09-19T09:29:15.994 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:15.059+0000 7f7217973640 1 -- 172.21.15.1:0/1802084907 wait complete. 2024-09-19T09:29:15.994 INFO:teuthology.orchestra.run.smithi001.stdout:mgr epoch 9 is available 2024-09-19T09:29:15.994 INFO:teuthology.orchestra.run.smithi001.stdout:Generating a dashboard self-signed certificate... 2024-09-19T09:29:16.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:16 smithi001 ceph-mon[31225]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T09:29:16.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:16 smithi001 ceph-mon[31225]: mgrmap e11: x(active, since 1.00573s) 2024-09-19T09:29:16.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:16 smithi001 ceph-mon[31225]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T09:29:16.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:16 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:17.269 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-19T09:29:17.269 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.457+0000 7f95b4dd3640 1 Processor -- start 2024-09-19T09:29:17.269 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.458+0000 7f95b4dd3640 1 -- start start 2024-09-19T09:29:17.269 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.458+0000 7f95b4dd3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95b0108170 0x7f95b010a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:17.269 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.458+0000 7f95b4dd3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f95b007be30 con 0x7f95b0108170 2024-09-19T09:29:17.269 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.458+0000 7f95ae59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95b0108170 0x7f95b010a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:17.269 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.458+0000 7f95ae59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95b0108170 0x7f95b010a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49340/0 (socket says 172.21.15.1:49340) 2024-09-19T09:29:17.269 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.458+0000 7f95ae59c640 1 -- 172.21.15.1:0/2656669450 learned_addr learned my addr 172.21.15.1:0/2656669450 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:29:17.269 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.458+0000 7f95ae59c640 1 -- 172.21.15.1:0/2656669450 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b010aaa0 con 0x7f95b0108170 2024-09-19T09:29:17.269 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.459+0000 7f95ae59c640 1 --2- 172.21.15.1:0/2656669450 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95b0108170 0x7f95b010a560 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f95a0009820 tx=0x7f95a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7ba582a17156be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:17.269 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.459+0000 7f95add9b640 1 -- 172.21.15.1:0/2656669450 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95a0037070 con 0x7f95b0108170 2024-09-19T09:29:17.270 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.459+0000 7f95add9b640 1 -- 172.21.15.1:0/2656669450 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95a0032920 con 0x7f95b0108170 2024-09-19T09:29:17.270 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.459+0000 7f95add9b640 1 -- 172.21.15.1:0/2656669450 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95a0030810 con 0x7f95b0108170 2024-09-19T09:29:17.270 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.460+0000 7f95b4dd3640 1 -- 172.21.15.1:0/2656669450 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95b0108170 msgr2=0x7f95b010a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:17.270 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.460+0000 7f95b4dd3640 1 --2- 172.21.15.1:0/2656669450 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95b0108170 0x7f95b010a560 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f95a0009820 tx=0x7f95a002a270 comp rx=0 tx=0).stop 2024-09-19T09:29:17.270 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.460+0000 7f95b4dd3640 1 -- 172.21.15.1:0/2656669450 shutdown_connections 2024-09-19T09:29:17.270 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.460+0000 7f95b4dd3640 1 --2- 172.21.15.1:0/2656669450 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95b0108170 0x7f95b010a560 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.270 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.460+0000 7f95b4dd3640 1 -- 172.21.15.1:0/2656669450 >> 172.21.15.1:0/2656669450 conn(0x7f95b0101d50 msgr2=0x7f95b0104170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:17.270 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.460+0000 7f95b4dd3640 1 -- 172.21.15.1:0/2656669450 shutdown_connections 2024-09-19T09:29:17.270 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.460+0000 7f95b4dd3640 1 -- 172.21.15.1:0/2656669450 wait complete. 2024-09-19T09:29:17.270 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.461+0000 7f95b4dd3640 1 Processor -- start 2024-09-19T09:29:17.270 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.461+0000 7f95b4dd3640 1 -- start start 2024-09-19T09:29:17.270 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.462+0000 7f95b4dd3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95b0108170 0x7f95b01079f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:17.270 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.462+0000 7f95b4dd3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f95b010bb20 con 0x7f95b0108170 2024-09-19T09:29:17.271 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.462+0000 7f95ae59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95b0108170 0x7f95b01079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:17.271 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.462+0000 7f95ae59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95b0108170 0x7f95b01079f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49344/0 (socket says 172.21.15.1:49344) 2024-09-19T09:29:17.271 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.462+0000 7f95ae59c640 1 -- 172.21.15.1:0/290051398 learned_addr learned my addr 172.21.15.1:0/290051398 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:29:17.271 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.462+0000 7f95ae59c640 1 -- 172.21.15.1:0/290051398 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b0107f30 con 0x7f95b0108170 2024-09-19T09:29:17.271 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.462+0000 7f95ae59c640 1 --2- 172.21.15.1:0/290051398 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95b0108170 0x7f95b01079f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f95a0030420 tx=0x7f95a0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:17.271 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.462+0000 7f95a77fe640 1 -- 172.21.15.1:0/290051398 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95a0037040 con 0x7f95b0108170 2024-09-19T09:29:17.271 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.462+0000 7f95b4dd3640 1 -- 172.21.15.1:0/290051398 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95b0106120 con 0x7f95b0108170 2024-09-19T09:29:17.271 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.462+0000 7f95a77fe640 1 -- 172.21.15.1:0/290051398 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95a0040070 con 0x7f95b0108170 2024-09-19T09:29:17.271 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.462+0000 7f95a77fe640 1 -- 172.21.15.1:0/290051398 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95a003a6e0 con 0x7f95b0108170 2024-09-19T09:29:17.271 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.463+0000 7f95b4dd3640 1 -- 172.21.15.1:0/290051398 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95b0106660 con 0x7f95b0108170 2024-09-19T09:29:17.271 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.464+0000 7f95a77fe640 1 -- 172.21.15.1:0/290051398 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f95a003a9e0 con 0x7f95b0108170 2024-09-19T09:29:17.271 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.464+0000 7f95b4dd3640 1 -- 172.21.15.1:0/290051398 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95b01085d0 con 0x7f95b0108170 2024-09-19T09:29:17.272 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.464+0000 7f95a77fe640 1 --2- 172.21.15.1:0/290051398 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f959c039200 0x7f959c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:17.272 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.464+0000 7f95a77fe640 1 -- 172.21.15.1:0/290051398 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f95a006ca30 con 0x7f95b0108170 2024-09-19T09:29:17.272 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.464+0000 7f95a7fff640 1 --2- 172.21.15.1:0/290051398 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f959c039200 0x7f959c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:17.272 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.465+0000 7f95a7fff640 1 --2- 172.21.15.1:0/290051398 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f959c039200 0x7f959c03b6c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f95980098c0 tx=0x7f9598006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:17.272 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.469+0000 7f95a77fe640 1 -- 172.21.15.1:0/290051398 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f95a0042e10 con 0x7f95b0108170 2024-09-19T09:29:17.272 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.648+0000 7f95b4dd3640 1 -- 172.21.15.1:0/290051398 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f95b0106e70 con 0x7f959c039200 2024-09-19T09:29:17.272 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.706+0000 7f95a77fe640 1 -- 172.21.15.1:0/290051398 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f95b0106e70 con 0x7f959c039200 2024-09-19T09:29:17.272 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.708+0000 7f95b4dd3640 1 -- 172.21.15.1:0/290051398 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f959c039200 msgr2=0x7f959c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:17.272 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.708+0000 7f95b4dd3640 1 --2- 172.21.15.1:0/290051398 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f959c039200 0x7f959c03b6c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f95980098c0 tx=0x7f9598006db0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.272 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.708+0000 7f95b4dd3640 1 -- 172.21.15.1:0/290051398 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95b0108170 msgr2=0x7f95b01079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:17.272 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.708+0000 7f95b4dd3640 1 --2- 172.21.15.1:0/290051398 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95b0108170 0x7f95b01079f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f95a0030420 tx=0x7f95a0032670 comp rx=0 tx=0).stop 2024-09-19T09:29:17.272 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.708+0000 7f95b4dd3640 1 -- 172.21.15.1:0/290051398 shutdown_connections 2024-09-19T09:29:17.272 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.708+0000 7f95b4dd3640 1 --2- 172.21.15.1:0/290051398 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f959c039200 0x7f959c03b6c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.273 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.708+0000 7f95b4dd3640 1 --2- 172.21.15.1:0/290051398 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f95b0108170 0x7f95b01079f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:17.273 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.708+0000 7f95b4dd3640 1 -- 172.21.15.1:0/290051398 >> 172.21.15.1:0/290051398 conn(0x7f95b0101d50 msgr2=0x7f95b01029f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:17.273 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.709+0000 7f95b4dd3640 1 -- 172.21.15.1:0/290051398 shutdown_connections 2024-09-19T09:29:17.273 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:16.709+0000 7f95b4dd3640 1 -- 172.21.15.1:0/290051398 wait complete. 2024-09-19T09:29:17.273 INFO:teuthology.orchestra.run.smithi001.stdout:Creating initial admin user... 2024-09-19T09:29:17.689 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:17 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:17.689 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:17 smithi001 ceph-mon[31225]: mgrmap e12: x(active, since 2s) 2024-09-19T09:29:17.689 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:17 smithi001 ceph-mon[31225]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:29:17.689 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:17 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:17.690 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:17 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:17.997 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:17 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:29:17.864+0000 7f8fac150640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:09:29:17] ENGINE Error in HTTPServer.serve 2024-09-19T09:29:17.998 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:17 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: Traceback (most recent call last): 2024-09-19T09:29:17.998 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:17 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:29:17.998 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:17 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: self._connections.run(self.expiration_interval) 2024-09-19T09:29:17.998 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:17 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:29:17.998 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:17 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: self._run(expiration_interval) 2024-09-19T09:29:17.998 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:17 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:29:17.998 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:17 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:29:17.998 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:17 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:29:17.998 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:17 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:29:17.998 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:17 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:29:17.998 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:17 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: s = self.context.wrap_socket( 2024-09-19T09:29:17.998 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:17 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:29:17.998 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:17 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: return self.sslsocket_class._create( 2024-09-19T09:29:17.999 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:17 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:29:17.999 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:17 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: self.do_handshake() 2024-09-19T09:29:17.999 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:17 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:29:17.999 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:17 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: self._sslobj.do_handshake() 2024-09-19T09:29:17.999 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:17 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:29:17.999 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:29:17 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:29:18.576 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:18 smithi001 ceph-mon[31225]: [19/Sep/2024:09:29:17] ENGINE Bus STARTING 2024-09-19T09:29:18.576 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:18 smithi001 ceph-mon[31225]: [19/Sep/2024:09:29:17] ENGINE Serving on http://172.21.15.1:8765 2024-09-19T09:29:18.576 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:18 smithi001 ceph-mon[31225]: [19/Sep/2024:09:29:17] ENGINE Serving on https://172.21.15.1:7150 2024-09-19T09:29:18.576 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:18 smithi001 ceph-mon[31225]: [19/Sep/2024:09:29:17] ENGINE Bus STARTED 2024-09-19T09:29:18.576 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:18 smithi001 ceph-mon[31225]: [19/Sep/2024:09:29:17] ENGINE Error in HTTPServer.serve 2024-09-19T09:29:18.576 INFO:journalctl@ceph.mon.a.smithi001.stdout: Traceback (most recent call last): 2024-09-19T09:29:18.576 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T09:29:18.576 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._connections.run(self.expiration_interval) 2024-09-19T09:29:18.576 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T09:29:18.576 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._run(expiration_interval) 2024-09-19T09:29:18.576 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T09:29:18.577 INFO:journalctl@ceph.mon.a.smithi001.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T09:29:18.577 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T09:29:18.577 INFO:journalctl@ceph.mon.a.smithi001.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T09:29:18.577 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T09:29:18.577 INFO:journalctl@ceph.mon.a.smithi001.stdout: s = self.context.wrap_socket( 2024-09-19T09:29:18.577 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T09:29:18.577 INFO:journalctl@ceph.mon.a.smithi001.stdout: return self.sslsocket_class._create( 2024-09-19T09:29:18.577 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T09:29:18.577 INFO:journalctl@ceph.mon.a.smithi001.stdout: self.do_handshake() 2024-09-19T09:29:18.577 INFO:journalctl@ceph.mon.a.smithi001.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T09:29:18.577 INFO:journalctl@ceph.mon.a.smithi001.stdout: self._sslobj.do_handshake() 2024-09-19T09:29:18.577 INFO:journalctl@ceph.mon.a.smithi001.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T09:29:19.512 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$0gceQEaaXb0OmwGd5/cY/unN.nJFoXAusoCbXq/2Jbo8zfmNXBL2W", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726738158, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-19T09:29:19.512 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.351+0000 7f6814bc9640 1 Processor -- start 2024-09-19T09:29:19.512 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.351+0000 7f6814bc9640 1 -- start start 2024-09-19T09:29:19.512 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.351+0000 7f6814bc9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6810108150 0x7f681010a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:19.512 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.351+0000 7f6814bc9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f681007be30 con 0x7f6810108150 2024-09-19T09:29:19.512 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.351+0000 7f680e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6810108150 0x7f681010a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:19.512 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.351+0000 7f680e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6810108150 0x7f681010a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49352/0 (socket says 172.21.15.1:49352) 2024-09-19T09:29:19.512 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.351+0000 7f680e59c640 1 -- 172.21.15.1:0/3759037800 learned_addr learned my addr 172.21.15.1:0/3759037800 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:29:19.513 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.352+0000 7f680e59c640 1 -- 172.21.15.1:0/3759037800 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f681010aa80 con 0x7f6810108150 2024-09-19T09:29:19.513 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.352+0000 7f680e59c640 1 --2- 172.21.15.1:0/3759037800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6810108150 0x7f681010a540 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6800009820 tx=0x7f680002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43f885e7525d3617 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:19.520 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.352+0000 7f680dd9b640 1 -- 172.21.15.1:0/3759037800 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6800037070 con 0x7f6810108150 2024-09-19T09:29:19.520 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.352+0000 7f680dd9b640 1 -- 172.21.15.1:0/3759037800 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6800032920 con 0x7f6810108150 2024-09-19T09:29:19.520 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.352+0000 7f680dd9b640 1 -- 172.21.15.1:0/3759037800 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6800030810 con 0x7f6810108150 2024-09-19T09:29:19.520 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.353+0000 7f6814bc9640 1 -- 172.21.15.1:0/3759037800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6810108150 msgr2=0x7f681010a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:19.521 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.353+0000 7f6814bc9640 1 --2- 172.21.15.1:0/3759037800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6810108150 0x7f681010a540 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6800009820 tx=0x7f680002a270 comp rx=0 tx=0).stop 2024-09-19T09:29:19.521 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.353+0000 7f6814bc9640 1 -- 172.21.15.1:0/3759037800 shutdown_connections 2024-09-19T09:29:19.521 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.353+0000 7f6814bc9640 1 --2- 172.21.15.1:0/3759037800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6810108150 0x7f681010a540 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.521 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.353+0000 7f6814bc9640 1 -- 172.21.15.1:0/3759037800 >> 172.21.15.1:0/3759037800 conn(0x7f6810101d30 msgr2=0x7f6810104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:19.521 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.353+0000 7f6814bc9640 1 -- 172.21.15.1:0/3759037800 shutdown_connections 2024-09-19T09:29:19.521 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.353+0000 7f6814bc9640 1 -- 172.21.15.1:0/3759037800 wait complete. 2024-09-19T09:29:19.521 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.354+0000 7f6814bc9640 1 Processor -- start 2024-09-19T09:29:19.521 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.354+0000 7f6814bc9640 1 -- start start 2024-09-19T09:29:19.521 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.354+0000 7f6814bc9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6810108150 0x7f681019d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:19.521 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.354+0000 7f6814bc9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f681010bb00 con 0x7f6810108150 2024-09-19T09:29:19.521 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.354+0000 7f680e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6810108150 0x7f681019d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:19.521 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.354+0000 7f680e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6810108150 0x7f681019d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49356/0 (socket says 172.21.15.1:49356) 2024-09-19T09:29:19.522 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.354+0000 7f680e59c640 1 -- 172.21.15.1:0/3603969427 learned_addr learned my addr 172.21.15.1:0/3603969427 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:29:19.522 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.355+0000 7f680e59c640 1 -- 172.21.15.1:0/3603969427 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f681019de70 con 0x7f6810108150 2024-09-19T09:29:19.522 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.355+0000 7f680e59c640 1 --2- 172.21.15.1:0/3603969427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6810108150 0x7f681019d930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6800030380 tx=0x7f6800032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:19.522 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.355+0000 7f68077fe640 1 -- 172.21.15.1:0/3603969427 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6800037040 con 0x7f6810108150 2024-09-19T09:29:19.522 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.355+0000 7f68077fe640 1 -- 172.21.15.1:0/3603969427 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6800040070 con 0x7f6810108150 2024-09-19T09:29:19.522 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.355+0000 7f6814bc9640 1 -- 172.21.15.1:0/3603969427 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f681019e100 con 0x7f6810108150 2024-09-19T09:29:19.522 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.355+0000 7f68077fe640 1 -- 172.21.15.1:0/3603969427 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f680003a7b0 con 0x7f6810108150 2024-09-19T09:29:19.522 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.355+0000 7f6814bc9640 1 -- 172.21.15.1:0/3603969427 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68101a0df0 con 0x7f6810108150 2024-09-19T09:29:19.522 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.356+0000 7f68077fe640 1 -- 172.21.15.1:0/3603969427 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f680003a9e0 con 0x7f6810108150 2024-09-19T09:29:19.522 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.356+0000 7f68077fe640 1 --2- 172.21.15.1:0/3603969427 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f67fc039260 0x7f67fc03b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:19.522 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.356+0000 7f68077fe640 1 -- 172.21.15.1:0/3603969427 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f680006ca40 con 0x7f6810108150 2024-09-19T09:29:19.522 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.356+0000 7f6807fff640 1 --2- 172.21.15.1:0/3603969427 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f67fc039260 0x7f67fc03b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:19.522 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.356+0000 7f6814bc9640 1 -- 172.21.15.1:0/3603969427 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68101085b0 con 0x7f6810108150 2024-09-19T09:29:19.522 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.357+0000 7f6807fff640 1 --2- 172.21.15.1:0/3603969427 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f67fc039260 0x7f67fc03b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f67f80098c0 tx=0x7f67f8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:19.523 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.361+0000 7f68077fe640 1 -- 172.21.15.1:0/3603969427 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6800044c70 con 0x7f6810108150 2024-09-19T09:29:19.523 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.574+0000 7f6814bc9640 1 -- 172.21.15.1:0/3603969427 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f6810102f40 con 0x7f67fc039260 2024-09-19T09:29:19.523 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.823+0000 7f68077fe640 1 -- 172.21.15.1:0/3603969427 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f6810102f40 con 0x7f67fc039260 2024-09-19T09:29:19.523 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.826+0000 7f6814bc9640 1 -- 172.21.15.1:0/3603969427 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f67fc039260 msgr2=0x7f67fc03b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:19.523 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.826+0000 7f6814bc9640 1 --2- 172.21.15.1:0/3603969427 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f67fc039260 0x7f67fc03b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f67f80098c0 tx=0x7f67f8006db0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.523 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.826+0000 7f6814bc9640 1 -- 172.21.15.1:0/3603969427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6810108150 msgr2=0x7f681019d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:19.523 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.826+0000 7f6814bc9640 1 --2- 172.21.15.1:0/3603969427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6810108150 0x7f681019d930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6800030380 tx=0x7f6800032670 comp rx=0 tx=0).stop 2024-09-19T09:29:19.523 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.826+0000 7f6814bc9640 1 -- 172.21.15.1:0/3603969427 shutdown_connections 2024-09-19T09:29:19.523 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.826+0000 7f6814bc9640 1 --2- 172.21.15.1:0/3603969427 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f67fc039260 0x7f67fc03b720 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.523 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.826+0000 7f6814bc9640 1 --2- 172.21.15.1:0/3603969427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6810108150 0x7f681019d930 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:19.523 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.826+0000 7f6814bc9640 1 -- 172.21.15.1:0/3603969427 >> 172.21.15.1:0/3603969427 conn(0x7f6810101d30 msgr2=0x7f6810102830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:19.523 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.826+0000 7f6814bc9640 1 -- 172.21.15.1:0/3603969427 shutdown_connections 2024-09-19T09:29:19.523 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:18.826+0000 7f6814bc9640 1 -- 172.21.15.1:0/3603969427 wait complete. 2024-09-19T09:29:19.524 INFO:teuthology.orchestra.run.smithi001.stdout:Fetching dashboard port number... 2024-09-19T09:29:20.097 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:19 smithi001 ceph-mon[31225]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:29:20.097 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:19 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:20.742 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stdout 8443 2024-09-19T09:29:20.744 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.909+0000 7fd8a38c1640 1 Processor -- start 2024-09-19T09:29:20.744 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.909+0000 7fd8a38c1640 1 -- start start 2024-09-19T09:29:20.744 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.909+0000 7fd8a38c1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd89c107710 0x7fd89c107b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:20.744 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.909+0000 7fd8a38c1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd89c1080e0 con 0x7fd89c107710 2024-09-19T09:29:20.744 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.909+0000 7fd8a165d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd89c107710 0x7fd89c107b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:20.744 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.910+0000 7fd8a165d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd89c107710 0x7fd89c107b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49372/0 (socket says 172.21.15.1:49372) 2024-09-19T09:29:20.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.910+0000 7fd8a165d640 1 -- 172.21.15.1:0/3034094656 learned_addr learned my addr 172.21.15.1:0/3034094656 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:29:20.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.910+0000 7fd8a165d640 1 -- 172.21.15.1:0/3034094656 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd89c108910 con 0x7fd89c107710 2024-09-19T09:29:20.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.910+0000 7fd8a165d640 1 --2- 172.21.15.1:0/3034094656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd89c107710 0x7fd89c107b10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd898009820 tx=0x7fd89802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14447f16e90c774 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:20.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.911+0000 7fd893fff640 1 -- 172.21.15.1:0/3034094656 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd898037070 con 0x7fd89c107710 2024-09-19T09:29:20.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.911+0000 7fd893fff640 1 -- 172.21.15.1:0/3034094656 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd898032920 con 0x7fd89c107710 2024-09-19T09:29:20.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.911+0000 7fd893fff640 1 -- 172.21.15.1:0/3034094656 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd898030810 con 0x7fd89c107710 2024-09-19T09:29:20.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.911+0000 7fd8a38c1640 1 -- 172.21.15.1:0/3034094656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd89c107710 msgr2=0x7fd89c107b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:20.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.911+0000 7fd8a38c1640 1 --2- 172.21.15.1:0/3034094656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd89c107710 0x7fd89c107b10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd898009820 tx=0x7fd89802a270 comp rx=0 tx=0).stop 2024-09-19T09:29:20.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.911+0000 7fd8a38c1640 1 -- 172.21.15.1:0/3034094656 shutdown_connections 2024-09-19T09:29:20.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.911+0000 7fd8a38c1640 1 --2- 172.21.15.1:0/3034094656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd89c107710 0x7fd89c107b10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:20.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.911+0000 7fd8a38c1640 1 -- 172.21.15.1:0/3034094656 >> 172.21.15.1:0/3034094656 conn(0x7fd89c102f20 msgr2=0x7fd89c105340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:20.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.911+0000 7fd8a38c1640 1 -- 172.21.15.1:0/3034094656 shutdown_connections 2024-09-19T09:29:20.745 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.912+0000 7fd8a38c1640 1 -- 172.21.15.1:0/3034094656 wait complete. 2024-09-19T09:29:20.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.912+0000 7fd8a38c1640 1 Processor -- start 2024-09-19T09:29:20.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.912+0000 7fd8a38c1640 1 -- start start 2024-09-19T09:29:20.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.912+0000 7fd8a38c1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd89c107710 0x7fd89c07db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:20.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.912+0000 7fd8a38c1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd89c10bcc0 con 0x7fd89c107710 2024-09-19T09:29:20.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.913+0000 7fd8a165d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd89c107710 0x7fd89c07db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:20.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.913+0000 7fd8a165d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd89c107710 0x7fd89c07db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49380/0 (socket says 172.21.15.1:49380) 2024-09-19T09:29:20.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.913+0000 7fd8a165d640 1 -- 172.21.15.1:0/3973472971 learned_addr learned my addr 172.21.15.1:0/3973472971 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:29:20.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.913+0000 7fd8a165d640 1 -- 172.21.15.1:0/3973472971 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd89c07e090 con 0x7fd89c107710 2024-09-19T09:29:20.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.913+0000 7fd8a165d640 1 --2- 172.21.15.1:0/3973472971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd89c107710 0x7fd89c07db50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd898030560 tx=0x7fd898032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:20.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.913+0000 7fd8927fc640 1 -- 172.21.15.1:0/3973472971 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd898037040 con 0x7fd89c107710 2024-09-19T09:29:20.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.913+0000 7fd8927fc640 1 -- 172.21.15.1:0/3973472971 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd898040070 con 0x7fd89c107710 2024-09-19T09:29:20.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.913+0000 7fd8927fc640 1 -- 172.21.15.1:0/3973472971 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd89803a740 con 0x7fd89c107710 2024-09-19T09:29:20.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.913+0000 7fd8a38c1640 1 -- 172.21.15.1:0/3973472971 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd89c07c280 con 0x7fd89c107710 2024-09-19T09:29:20.746 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.913+0000 7fd8a38c1640 1 -- 172.21.15.1:0/3973472971 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd89c07c700 con 0x7fd89c107710 2024-09-19T09:29:20.747 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.914+0000 7fd8927fc640 1 -- 172.21.15.1:0/3973472971 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fd89803b420 con 0x7fd89c107710 2024-09-19T09:29:20.747 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.914+0000 7fd8a38c1640 1 -- 172.21.15.1:0/3973472971 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd89c107b90 con 0x7fd89c107710 2024-09-19T09:29:20.747 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.915+0000 7fd8927fc640 1 --2- 172.21.15.1:0/3973472971 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd888039200 0x7fd88803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:20.747 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.915+0000 7fd8927fc640 1 -- 172.21.15.1:0/3973472971 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd89806c970 con 0x7fd89c107710 2024-09-19T09:29:20.747 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.915+0000 7fd8a0e5c640 1 --2- 172.21.15.1:0/3973472971 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd888039200 0x7fd88803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:20.747 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.915+0000 7fd8a0e5c640 1 --2- 172.21.15.1:0/3973472971 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd888039200 0x7fd88803b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd88c0098c0 tx=0x7fd88c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:20.747 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:19.920+0000 7fd8927fc640 1 -- 172.21.15.1:0/3973472971 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd89804a200 con 0x7fd89c107710 2024-09-19T09:29:20.747 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:20.095+0000 7fd8a38c1640 1 -- 172.21.15.1:0/3973472971 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fd89c07cfd0 con 0x7fd89c107710 2024-09-19T09:29:20.747 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:20.096+0000 7fd8927fc640 1 -- 172.21.15.1:0/3973472971 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fd898031e80 con 0x7fd89c107710 2024-09-19T09:29:20.747 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:20.098+0000 7fd8a38c1640 1 -- 172.21.15.1:0/3973472971 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd888039200 msgr2=0x7fd88803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:20.747 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:20.098+0000 7fd8a38c1640 1 --2- 172.21.15.1:0/3973472971 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd888039200 0x7fd88803b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd88c0098c0 tx=0x7fd88c006db0 comp rx=0 tx=0).stop 2024-09-19T09:29:20.747 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:20.098+0000 7fd8a38c1640 1 -- 172.21.15.1:0/3973472971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd89c107710 msgr2=0x7fd89c07db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:20.747 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:20.098+0000 7fd8a38c1640 1 --2- 172.21.15.1:0/3973472971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd89c107710 0x7fd89c07db50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd898030560 tx=0x7fd898032670 comp rx=0 tx=0).stop 2024-09-19T09:29:20.747 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:20.098+0000 7fd8a38c1640 1 -- 172.21.15.1:0/3973472971 shutdown_connections 2024-09-19T09:29:20.748 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:20.098+0000 7fd8a38c1640 1 --2- 172.21.15.1:0/3973472971 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd888039200 0x7fd88803b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:20.748 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:20.098+0000 7fd8a38c1640 1 --2- 172.21.15.1:0/3973472971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd89c107710 0x7fd89c07db50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:20.748 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:20.098+0000 7fd8a38c1640 1 -- 172.21.15.1:0/3973472971 >> 172.21.15.1:0/3973472971 conn(0x7fd89c102f20 msgr2=0x7fd89c103a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:20.748 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:20.098+0000 7fd8a38c1640 1 -- 172.21.15.1:0/3973472971 shutdown_connections 2024-09-19T09:29:20.748 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:20.098+0000 7fd8a38c1640 1 -- 172.21.15.1:0/3973472971 wait complete. 2024-09-19T09:29:20.749 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T09:29:20.749 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout disabled 2024-09-19T09:29:20.757 INFO:teuthology.orchestra.run.smithi001.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T09:29:20.757 INFO:teuthology.orchestra.run.smithi001.stdout:systemctl: stdout inactive 2024-09-19T09:29:20.757 INFO:teuthology.orchestra.run.smithi001.stdout:firewalld.service is not enabled 2024-09-19T09:29:20.757 INFO:teuthology.orchestra.run.smithi001.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-19T09:29:20.760 INFO:teuthology.orchestra.run.smithi001.stdout:Ceph Dashboard is now available at: 2024-09-19T09:29:20.760 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:29:20.760 INFO:teuthology.orchestra.run.smithi001.stdout: URL: https://smithi001.front.sepia.ceph.com:8443/ 2024-09-19T09:29:20.760 INFO:teuthology.orchestra.run.smithi001.stdout: User: admin 2024-09-19T09:29:20.760 INFO:teuthology.orchestra.run.smithi001.stdout: Password: gzkbe5lwh8 2024-09-19T09:29:20.760 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:29:20.761 INFO:teuthology.orchestra.run.smithi001.stdout:Saving cluster configuration to /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/config directory 2024-09-19T09:29:20.994 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:20 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/3973472971' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-19T09:29:21.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:21 smithi001 ceph-mon[31225]: mgrmap e13: x(active, since 6s) 2024-09-19T09:29:21.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:21 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/2070176408' entity='client.admin' 2024-09-19T09:29:22.025 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.190+0000 7f68a0272640 1 Processor -- start 2024-09-19T09:29:22.026 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.190+0000 7f68a0272640 1 -- start start 2024-09-19T09:29:22.026 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.191+0000 7f68a0272640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f689807dea0 0x7f689807c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:22.026 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.191+0000 7f68a0272640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f689807c8d0 con 0x7f689807dea0 2024-09-19T09:29:22.026 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.191+0000 7f689e00e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f689807dea0 0x7f689807c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:22.026 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.191+0000 7f689e00e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f689807dea0 0x7f689807c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49394/0 (socket says 172.21.15.1:49394) 2024-09-19T09:29:22.027 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.191+0000 7f689e00e640 1 -- 172.21.15.1:0/3883546399 learned_addr learned my addr 172.21.15.1:0/3883546399 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:29:22.027 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.191+0000 7f689e00e640 1 -- 172.21.15.1:0/3883546399 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f689807ca50 con 0x7f689807dea0 2024-09-19T09:29:22.027 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.192+0000 7f689e00e640 1 --2- 172.21.15.1:0/3883546399 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f689807dea0 0x7f689807c300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6894009820 tx=0x7f689402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ae1c5d8ed82f19b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:22.027 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.192+0000 7f689d00c640 1 -- 172.21.15.1:0/3883546399 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6894037070 con 0x7f689807dea0 2024-09-19T09:29:22.027 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.192+0000 7f689d00c640 1 -- 172.21.15.1:0/3883546399 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6894032920 con 0x7f689807dea0 2024-09-19T09:29:22.028 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.192+0000 7f689d00c640 1 -- 172.21.15.1:0/3883546399 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6894030810 con 0x7f689807dea0 2024-09-19T09:29:22.028 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.193+0000 7f68a0272640 1 -- 172.21.15.1:0/3883546399 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f689807dea0 msgr2=0x7f689807c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:22.028 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.193+0000 7f68a0272640 1 --2- 172.21.15.1:0/3883546399 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f689807dea0 0x7f689807c300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6894009820 tx=0x7f689402a270 comp rx=0 tx=0).stop 2024-09-19T09:29:22.028 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.193+0000 7f68a0272640 1 -- 172.21.15.1:0/3883546399 shutdown_connections 2024-09-19T09:29:22.028 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.193+0000 7f68a0272640 1 --2- 172.21.15.1:0/3883546399 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f689807dea0 0x7f689807c300 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:22.029 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.193+0000 7f68a0272640 1 -- 172.21.15.1:0/3883546399 >> 172.21.15.1:0/3883546399 conn(0x7f6898102f20 msgr2=0x7f6898105340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:22.029 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.193+0000 7f68a0272640 1 -- 172.21.15.1:0/3883546399 shutdown_connections 2024-09-19T09:29:22.029 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.193+0000 7f68a0272640 1 -- 172.21.15.1:0/3883546399 wait complete. 2024-09-19T09:29:22.029 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.193+0000 7f68a0272640 1 Processor -- start 2024-09-19T09:29:22.029 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.193+0000 7f68a0272640 1 -- start start 2024-09-19T09:29:22.029 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.194+0000 7f68a0272640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f689807dea0 0x7f689819d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:22.030 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.194+0000 7f68a0272640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f689810dd50 con 0x7f689807dea0 2024-09-19T09:29:22.031 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.194+0000 7f689e00e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f689807dea0 0x7f689819d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:22.031 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.194+0000 7f689e00e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f689807dea0 0x7f689819d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49402/0 (socket says 172.21.15.1:49402) 2024-09-19T09:29:22.031 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.194+0000 7f689e00e640 1 -- 172.21.15.1:0/2070176408 learned_addr learned my addr 172.21.15.1:0/2070176408 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:29:22.031 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.194+0000 7f689e00e640 1 -- 172.21.15.1:0/2070176408 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f689819ddd0 con 0x7f689807dea0 2024-09-19T09:29:22.031 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.194+0000 7f689e00e640 1 --2- 172.21.15.1:0/2070176408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f689807dea0 0x7f689819d890 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6894030560 tx=0x7f6894032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:22.032 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.194+0000 7f688f7fe640 1 -- 172.21.15.1:0/2070176408 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6894037040 con 0x7f689807dea0 2024-09-19T09:29:22.032 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.194+0000 7f688f7fe640 1 -- 172.21.15.1:0/2070176408 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6894040070 con 0x7f689807dea0 2024-09-19T09:29:22.032 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.194+0000 7f68a0272640 1 -- 172.21.15.1:0/2070176408 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f689819e060 con 0x7f689807dea0 2024-09-19T09:29:22.033 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.194+0000 7f688f7fe640 1 -- 172.21.15.1:0/2070176408 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f689403a740 con 0x7f689807dea0 2024-09-19T09:29:22.033 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.195+0000 7f68a0272640 1 -- 172.21.15.1:0/2070176408 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68981a0d50 con 0x7f689807dea0 2024-09-19T09:29:22.033 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.195+0000 7f688f7fe640 1 -- 172.21.15.1:0/2070176408 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f689403a8e0 con 0x7f689807dea0 2024-09-19T09:29:22.033 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.196+0000 7f688f7fe640 1 --2- 172.21.15.1:0/2070176408 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f6884039300 0x7f688403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:22.033 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.196+0000 7f688f7fe640 1 -- 172.21.15.1:0/2070176408 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f689406ca30 con 0x7f689807dea0 2024-09-19T09:29:22.033 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.196+0000 7f68a0272640 1 -- 172.21.15.1:0/2070176408 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f689807c380 con 0x7f689807dea0 2024-09-19T09:29:22.033 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.196+0000 7f689d80d640 1 --2- 172.21.15.1:0/2070176408 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f6884039300 0x7f688403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:22.033 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.196+0000 7f689d80d640 1 --2- 172.21.15.1:0/2070176408 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f6884039300 0x7f688403b7c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f68880098c0 tx=0x7f6888006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:22.033 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.201+0000 7f688f7fe640 1 -- 172.21.15.1:0/2070176408 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f68940313a0 con 0x7f689807dea0 2024-09-19T09:29:22.033 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.466+0000 7f68a0272640 1 -- 172.21.15.1:0/2070176408 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f68981a1330 con 0x7f689807dea0 2024-09-19T09:29:22.033 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.468+0000 7f688f7fe640 1 -- 172.21.15.1:0/2070176408 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) ==== 153+0+0 (secure 0 0 0) 0x7f689404a200 con 0x7f689807dea0 2024-09-19T09:29:22.034 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-19T09:29:22.034 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.471+0000 7f68a0272640 1 -- 172.21.15.1:0/2070176408 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f6884039300 msgr2=0x7f688403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:22.034 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.471+0000 7f68a0272640 1 --2- 172.21.15.1:0/2070176408 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f6884039300 0x7f688403b7c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f68880098c0 tx=0x7f6888006db0 comp rx=0 tx=0).stop 2024-09-19T09:29:22.034 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.471+0000 7f68a0272640 1 -- 172.21.15.1:0/2070176408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f689807dea0 msgr2=0x7f689819d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:22.034 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.471+0000 7f68a0272640 1 --2- 172.21.15.1:0/2070176408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f689807dea0 0x7f689819d890 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6894030560 tx=0x7f6894032670 comp rx=0 tx=0).stop 2024-09-19T09:29:22.034 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.471+0000 7f68a0272640 1 -- 172.21.15.1:0/2070176408 shutdown_connections 2024-09-19T09:29:22.034 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.471+0000 7f68a0272640 1 --2- 172.21.15.1:0/2070176408 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f6884039300 0x7f688403b7c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:22.034 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.471+0000 7f68a0272640 1 --2- 172.21.15.1:0/2070176408 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f689807dea0 0x7f689819d890 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:22.034 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.471+0000 7f68a0272640 1 -- 172.21.15.1:0/2070176408 >> 172.21.15.1:0/2070176408 conn(0x7f6898102f20 msgr2=0x7f6898103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:22.034 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.471+0000 7f68a0272640 1 -- 172.21.15.1:0/2070176408 shutdown_connections 2024-09-19T09:29:22.034 INFO:teuthology.orchestra.run.smithi001.stdout:/usr/bin/ceph: stderr 2024-09-19T09:29:21.471+0000 7f68a0272640 1 -- 172.21.15.1:0/2070176408 wait complete. 2024-09-19T09:29:22.035 INFO:teuthology.orchestra.run.smithi001.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-19T09:29:22.035 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:29:22.035 INFO:teuthology.orchestra.run.smithi001.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:29:22.035 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:29:22.035 INFO:teuthology.orchestra.run.smithi001.stdout:Or, if you are only running a single cluster on this host: 2024-09-19T09:29:22.035 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:29:22.035 INFO:teuthology.orchestra.run.smithi001.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-19T09:29:22.035 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:29:22.035 INFO:teuthology.orchestra.run.smithi001.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-19T09:29:22.035 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:29:22.035 INFO:teuthology.orchestra.run.smithi001.stdout: ceph telemetry on 2024-09-19T09:29:22.035 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:29:22.035 INFO:teuthology.orchestra.run.smithi001.stdout:For more information see: 2024-09-19T09:29:22.036 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:29:22.036 INFO:teuthology.orchestra.run.smithi001.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-19T09:29:22.036 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:29:22.036 INFO:teuthology.orchestra.run.smithi001.stdout:Bootstrap complete. 2024-09-19T09:29:22.059 INFO:tasks.cephadm:Fetching config... 2024-09-19T09:29:22.060 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T09:29:22.060 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-19T09:29:22.076 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-19T09:29:22.076 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T09:29:22.076 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-19T09:29:22.132 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-19T09:29:22.132 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T09:29:22.132 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-19T09:29:22.198 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-19T09:29:22.198 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T09:29:22.198 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-19T09:29:22.254 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-19T09:29:22.254 DEBUG:teuthology.orchestra.run.smithi001:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMjJuNkNl3QCj7szS0FqFBPQC1mOSFGgfbAgHsMDKucPuW7OgakHdNFdhxVUOpoL5HQFYjZYAqS7W9dGU2I17MXK3BvDJbxRUw7iR7ydRx26sw5aYiNQnPHrgrflQcinSLb2CrbSADTFqX/huJVp1HHssfpuSvYM/L00948a/W5rCcU8YU/vQ/XXivahiM54BEO7JXz61cmXvoG9mGcbard9ewoSBGni309hXS/ZADgKYIIep838Q5JOCnbemrg8JwlbftnafflzVzec5Hg2TcW2fTY4lGSgzhZPqRd3UCtNCk49hRes84NSeOmRYPUnDQTBobHusoarba3om83VJv2PLJJU2tXlwUf+zfpoLUXW47Fd6DX8w9JhzCbhNYZoCZ4qtN79Il4airC5330E7N/WIRgxOXkwufX5SgjXvaq/x6jrMdFHQJ7/xJIkoNwqAX6H/lpOw0yr9XxT5TDoYNs+hflwg68r2Bm9f2jPzhRunoFAG6N7kZ1YqN2Xy5pFc= ceph-57238232-7669-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T09:29:22.331 INFO:teuthology.orchestra.run.smithi001.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMjJuNkNl3QCj7szS0FqFBPQC1mOSFGgfbAgHsMDKucPuW7OgakHdNFdhxVUOpoL5HQFYjZYAqS7W9dGU2I17MXK3BvDJbxRUw7iR7ydRx26sw5aYiNQnPHrgrflQcinSLb2CrbSADTFqX/huJVp1HHssfpuSvYM/L00948a/W5rCcU8YU/vQ/XXivahiM54BEO7JXz61cmXvoG9mGcbard9ewoSBGni309hXS/ZADgKYIIep838Q5JOCnbemrg8JwlbftnafflzVzec5Hg2TcW2fTY4lGSgzhZPqRd3UCtNCk49hRes84NSeOmRYPUnDQTBobHusoarba3om83VJv2PLJJU2tXlwUf+zfpoLUXW47Fd6DX8w9JhzCbhNYZoCZ4qtN79Il4airC5330E7N/WIRgxOXkwufX5SgjXvaq/x6jrMdFHQJ7/xJIkoNwqAX6H/lpOw0yr9XxT5TDoYNs+hflwg68r2Bm9f2jPzhRunoFAG6N7kZ1YqN2Xy5pFc= ceph-57238232-7669-11ef-bceb-c7b262605968 2024-09-19T09:29:22.350 DEBUG:teuthology.orchestra.run.smithi022:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMjJuNkNl3QCj7szS0FqFBPQC1mOSFGgfbAgHsMDKucPuW7OgakHdNFdhxVUOpoL5HQFYjZYAqS7W9dGU2I17MXK3BvDJbxRUw7iR7ydRx26sw5aYiNQnPHrgrflQcinSLb2CrbSADTFqX/huJVp1HHssfpuSvYM/L00948a/W5rCcU8YU/vQ/XXivahiM54BEO7JXz61cmXvoG9mGcbard9ewoSBGni309hXS/ZADgKYIIep838Q5JOCnbemrg8JwlbftnafflzVzec5Hg2TcW2fTY4lGSgzhZPqRd3UCtNCk49hRes84NSeOmRYPUnDQTBobHusoarba3om83VJv2PLJJU2tXlwUf+zfpoLUXW47Fd6DX8w9JhzCbhNYZoCZ4qtN79Il4airC5330E7N/WIRgxOXkwufX5SgjXvaq/x6jrMdFHQJ7/xJIkoNwqAX6H/lpOw0yr9XxT5TDoYNs+hflwg68r2Bm9f2jPzhRunoFAG6N7kZ1YqN2Xy5pFc= ceph-57238232-7669-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T09:29:22.391 INFO:teuthology.orchestra.run.smithi022.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMjJuNkNl3QCj7szS0FqFBPQC1mOSFGgfbAgHsMDKucPuW7OgakHdNFdhxVUOpoL5HQFYjZYAqS7W9dGU2I17MXK3BvDJbxRUw7iR7ydRx26sw5aYiNQnPHrgrflQcinSLb2CrbSADTFqX/huJVp1HHssfpuSvYM/L00948a/W5rCcU8YU/vQ/XXivahiM54BEO7JXz61cmXvoG9mGcbard9ewoSBGni309hXS/ZADgKYIIep838Q5JOCnbemrg8JwlbftnafflzVzec5Hg2TcW2fTY4lGSgzhZPqRd3UCtNCk49hRes84NSeOmRYPUnDQTBobHusoarba3om83VJv2PLJJU2tXlwUf+zfpoLUXW47Fd6DX8w9JhzCbhNYZoCZ4qtN79Il4airC5330E7N/WIRgxOXkwufX5SgjXvaq/x6jrMdFHQJ7/xJIkoNwqAX6H/lpOw0yr9XxT5TDoYNs+hflwg68r2Bm9f2jPzhRunoFAG6N7kZ1YqN2Xy5pFc= ceph-57238232-7669-11ef-bceb-c7b262605968 2024-09-19T09:29:22.404 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMjJuNkNl3QCj7szS0FqFBPQC1mOSFGgfbAgHsMDKucPuW7OgakHdNFdhxVUOpoL5HQFYjZYAqS7W9dGU2I17MXK3BvDJbxRUw7iR7ydRx26sw5aYiNQnPHrgrflQcinSLb2CrbSADTFqX/huJVp1HHssfpuSvYM/L00948a/W5rCcU8YU/vQ/XXivahiM54BEO7JXz61cmXvoG9mGcbard9ewoSBGni309hXS/ZADgKYIIep838Q5JOCnbemrg8JwlbftnafflzVzec5Hg2TcW2fTY4lGSgzhZPqRd3UCtNCk49hRes84NSeOmRYPUnDQTBobHusoarba3om83VJv2PLJJU2tXlwUf+zfpoLUXW47Fd6DX8w9JhzCbhNYZoCZ4qtN79Il4airC5330E7N/WIRgxOXkwufX5SgjXvaq/x6jrMdFHQJ7/xJIkoNwqAX6H/lpOw0yr9XxT5TDoYNs+hflwg68r2Bm9f2jPzhRunoFAG6N7kZ1YqN2Xy5pFc= ceph-57238232-7669-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T09:29:22.444 INFO:teuthology.orchestra.run.smithi121.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMjJuNkNl3QCj7szS0FqFBPQC1mOSFGgfbAgHsMDKucPuW7OgakHdNFdhxVUOpoL5HQFYjZYAqS7W9dGU2I17MXK3BvDJbxRUw7iR7ydRx26sw5aYiNQnPHrgrflQcinSLb2CrbSADTFqX/huJVp1HHssfpuSvYM/L00948a/W5rCcU8YU/vQ/XXivahiM54BEO7JXz61cmXvoG9mGcbard9ewoSBGni309hXS/ZADgKYIIep838Q5JOCnbemrg8JwlbftnafflzVzec5Hg2TcW2fTY4lGSgzhZPqRd3UCtNCk49hRes84NSeOmRYPUnDQTBobHusoarba3om83VJv2PLJJU2tXlwUf+zfpoLUXW47Fd6DX8w9JhzCbhNYZoCZ4qtN79Il4airC5330E7N/WIRgxOXkwufX5SgjXvaq/x6jrMdFHQJ7/xJIkoNwqAX6H/lpOw0yr9XxT5TDoYNs+hflwg68r2Bm9f2jPzhRunoFAG6N7kZ1YqN2Xy5pFc= ceph-57238232-7669-11ef-bceb-c7b262605968 2024-09-19T09:29:22.457 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-19T09:29:22.713 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:29:23.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.203+0000 7efcd2f6f640 1 -- 172.21.15.1:0/3085642899 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efccc100500 msgr2=0x7efccc100900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:23.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.203+0000 7efcd2f6f640 1 --2- 172.21.15.1:0/3085642899 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efccc100500 0x7efccc100900 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efcc0009880 tx=0x7efcc002a5d0 comp rx=0 tx=0).stop 2024-09-19T09:29:23.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.203+0000 7efcd2f6f640 1 -- 172.21.15.1:0/3085642899 shutdown_connections 2024-09-19T09:29:23.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.203+0000 7efcd2f6f640 1 --2- 172.21.15.1:0/3085642899 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efccc100500 0x7efccc100900 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:23.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.203+0000 7efcd2f6f640 1 -- 172.21.15.1:0/3085642899 >> 172.21.15.1:0/3085642899 conn(0x7efccc0fbc90 msgr2=0x7efccc0fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:23.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.203+0000 7efcd2f6f640 1 -- 172.21.15.1:0/3085642899 shutdown_connections 2024-09-19T09:29:23.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.203+0000 7efcd2f6f640 1 -- 172.21.15.1:0/3085642899 wait complete. 2024-09-19T09:29:23.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.204+0000 7efcd2f6f640 1 Processor -- start 2024-09-19T09:29:23.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.204+0000 7efcd2f6f640 1 -- start start 2024-09-19T09:29:23.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.204+0000 7efcd2f6f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efccc100500 0x7efccc198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:23.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.204+0000 7efcd2f6f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efccc106610 con 0x7efccc100500 2024-09-19T09:29:23.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.204+0000 7efcd0d0b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efccc100500 0x7efccc198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:23.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.204+0000 7efcd0d0b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efccc100500 0x7efccc198f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49414/0 (socket says 172.21.15.1:49414) 2024-09-19T09:29:23.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.204+0000 7efcd0d0b640 1 -- 172.21.15.1:0/1597950459 learned_addr learned my addr 172.21.15.1:0/1597950459 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:29:23.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.204+0000 7efcd0d0b640 1 -- 172.21.15.1:0/1597950459 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efccc1994c0 con 0x7efccc100500 2024-09-19T09:29:23.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.204+0000 7efcd0d0b640 1 --2- 172.21.15.1:0/1597950459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efccc100500 0x7efccc198f80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efcc0004f60 tx=0x7efcc00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:23.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.205+0000 7efcc9ffb640 1 -- 172.21.15.1:0/1597950459 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcc003f070 con 0x7efccc100500 2024-09-19T09:29:23.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.205+0000 7efcc9ffb640 1 -- 172.21.15.1:0/1597950459 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcc0004cc0 con 0x7efccc100500 2024-09-19T09:29:23.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.205+0000 7efcd2f6f640 1 -- 172.21.15.1:0/1597950459 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efccc199750 con 0x7efccc100500 2024-09-19T09:29:23.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.205+0000 7efcc9ffb640 1 -- 172.21.15.1:0/1597950459 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcc0035030 con 0x7efccc100500 2024-09-19T09:29:23.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.205+0000 7efcd2f6f640 1 -- 172.21.15.1:0/1597950459 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efccc19c440 con 0x7efccc100500 2024-09-19T09:29:23.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.206+0000 7efcc9ffb640 1 -- 172.21.15.1:0/1597950459 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7efcc0042070 con 0x7efccc100500 2024-09-19T09:29:23.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.206+0000 7efcd2f6f640 1 -- 172.21.15.1:0/1597950459 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efccc106d90 con 0x7efccc100500 2024-09-19T09:29:23.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.206+0000 7efcc9ffb640 1 --2- 172.21.15.1:0/1597950459 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7efcbc039300 0x7efcbc03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:23.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.206+0000 7efcc9ffb640 1 -- 172.21.15.1:0/1597950459 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7efcc006d010 con 0x7efccc100500 2024-09-19T09:29:23.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.206+0000 7efccbfff640 1 --2- 172.21.15.1:0/1597950459 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7efcbc039300 0x7efcbc03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:23.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.207+0000 7efccbfff640 1 --2- 172.21.15.1:0/1597950459 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7efcbc039300 0x7efcbc03b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efcb80098c0 tx=0x7efcb8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:23.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.211+0000 7efcc9ffb640 1 -- 172.21.15.1:0/1597950459 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efcc00433b0 con 0x7efccc100500 2024-09-19T09:29:23.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.388+0000 7efcd2f6f640 1 -- 172.21.15.1:0/1597950459 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7efccc02d830 con 0x7efccc100500 2024-09-19T09:29:23.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.391+0000 7efcc9ffb640 1 -- 172.21.15.1:0/1597950459 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7efcc002f300 con 0x7efccc100500 2024-09-19T09:29:23.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.393+0000 7efcd2f6f640 1 -- 172.21.15.1:0/1597950459 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7efcbc039300 msgr2=0x7efcbc03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:23.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.393+0000 7efcd2f6f640 1 --2- 172.21.15.1:0/1597950459 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7efcbc039300 0x7efcbc03b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efcb80098c0 tx=0x7efcb8006db0 comp rx=0 tx=0).stop 2024-09-19T09:29:23.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.393+0000 7efcd2f6f640 1 -- 172.21.15.1:0/1597950459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efccc100500 msgr2=0x7efccc198f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:23.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.393+0000 7efcd2f6f640 1 --2- 172.21.15.1:0/1597950459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efccc100500 0x7efccc198f80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efcc0004f60 tx=0x7efcc00048f0 comp rx=0 tx=0).stop 2024-09-19T09:29:23.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.393+0000 7efcd2f6f640 1 -- 172.21.15.1:0/1597950459 shutdown_connections 2024-09-19T09:29:23.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.393+0000 7efcd2f6f640 1 --2- 172.21.15.1:0/1597950459 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7efcbc039300 0x7efcbc03b7c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:23.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.393+0000 7efcd2f6f640 1 --2- 172.21.15.1:0/1597950459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efccc100500 0x7efccc198f80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:23.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.393+0000 7efcd2f6f640 1 -- 172.21.15.1:0/1597950459 >> 172.21.15.1:0/1597950459 conn(0x7efccc0fbc90 msgr2=0x7efccc06a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:23.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.393+0000 7efcd2f6f640 1 -- 172.21.15.1:0/1597950459 shutdown_connections 2024-09-19T09:29:23.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:23.393+0000 7efcd2f6f640 1 -- 172.21.15.1:0/1597950459 wait complete. 2024-09-19T09:29:24.448 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-19T09:29:24.448 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-19T09:29:24.475 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:24 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1597950459' entity='client.admin' 2024-09-19T09:29:24.475 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:24 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:24.475 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:24 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:24.475 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:24 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi001", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:29:24.475 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:24 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:24.475 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:24 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:29:24.475 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:24 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:24.697 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:29:25.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.283+0000 7f6de4132640 1 -- 172.21.15.1:0/651940140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ddc076220 msgr2=0x7f6ddc074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:25.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.283+0000 7f6de4132640 1 --2- 172.21.15.1:0/651940140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ddc076220 0x7f6ddc074680 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8009880 tx=0x7f6dd802a5d0 comp rx=0 tx=0).stop 2024-09-19T09:29:25.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.283+0000 7f6de4132640 1 -- 172.21.15.1:0/651940140 shutdown_connections 2024-09-19T09:29:25.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.283+0000 7f6de4132640 1 --2- 172.21.15.1:0/651940140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ddc076220 0x7f6ddc074680 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:25.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.283+0000 7f6de4132640 1 -- 172.21.15.1:0/651940140 >> 172.21.15.1:0/651940140 conn(0x7f6ddc0fcdb0 msgr2=0x7f6ddc0ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:25.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.283+0000 7f6de4132640 1 -- 172.21.15.1:0/651940140 shutdown_connections 2024-09-19T09:29:25.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.283+0000 7f6de4132640 1 -- 172.21.15.1:0/651940140 wait complete. 2024-09-19T09:29:25.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.284+0000 7f6de4132640 1 Processor -- start 2024-09-19T09:29:25.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.284+0000 7f6de4132640 1 -- start start 2024-09-19T09:29:25.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.284+0000 7f6de4132640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ddc076220 0x7f6ddc198f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:25.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.284+0000 7f6de4132640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6ddc109920 con 0x7f6ddc076220 2024-09-19T09:29:25.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.284+0000 7f6de1ece640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ddc076220 0x7f6ddc198f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:25.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.284+0000 7f6de1ece640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ddc076220 0x7f6ddc198f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49424/0 (socket says 172.21.15.1:49424) 2024-09-19T09:29:25.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.284+0000 7f6de1ece640 1 -- 172.21.15.1:0/54469691 learned_addr learned my addr 172.21.15.1:0/54469691 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:29:25.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.285+0000 7f6de1ece640 1 -- 172.21.15.1:0/54469691 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ddc1994d0 con 0x7f6ddc076220 2024-09-19T09:29:25.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.285+0000 7f6de1ece640 1 --2- 172.21.15.1:0/54469691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ddc076220 0x7f6ddc198f90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8004f60 tx=0x7f6dd80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:25.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.285+0000 7f6dd2ffd640 1 -- 172.21.15.1:0/54469691 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dd803f070 con 0x7f6ddc076220 2024-09-19T09:29:25.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.285+0000 7f6de4132640 1 -- 172.21.15.1:0/54469691 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ddc199760 con 0x7f6ddc076220 2024-09-19T09:29:25.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.285+0000 7f6dd2ffd640 1 -- 172.21.15.1:0/54469691 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6dd8004cc0 con 0x7f6ddc076220 2024-09-19T09:29:25.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.285+0000 7f6dd2ffd640 1 -- 172.21.15.1:0/54469691 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dd8035030 con 0x7f6ddc076220 2024-09-19T09:29:25.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.285+0000 7f6de4132640 1 -- 172.21.15.1:0/54469691 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ddc19c450 con 0x7f6ddc076220 2024-09-19T09:29:25.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.286+0000 7f6dd2ffd640 1 -- 172.21.15.1:0/54469691 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f6dd8042070 con 0x7f6ddc076220 2024-09-19T09:29:25.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.286+0000 7f6de4132640 1 -- 172.21.15.1:0/54469691 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ddc10a0a0 con 0x7f6ddc076220 2024-09-19T09:29:25.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.286+0000 7f6dd2ffd640 1 --2- 172.21.15.1:0/54469691 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f6dc8039300 0x7f6dc803b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:25.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.286+0000 7f6dd2ffd640 1 -- 172.21.15.1:0/54469691 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6dd806d130 con 0x7f6ddc076220 2024-09-19T09:29:25.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.286+0000 7f6de16cd640 1 --2- 172.21.15.1:0/54469691 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f6dc8039300 0x7f6dc803b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:25.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.287+0000 7f6de16cd640 1 --2- 172.21.15.1:0/54469691 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f6dc8039300 0x7f6dc803b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc0098c0 tx=0x7f6dcc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:25.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.291+0000 7f6dd2ffd640 1 -- 172.21.15.1:0/54469691 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6dd8003dd0 con 0x7f6ddc076220 2024-09-19T09:29:25.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.469+0000 7f6de4132640 1 -- 172.21.15.1:0/54469691 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f6ddc02d830 con 0x7f6dc8039300 2024-09-19T09:29:25.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.473+0000 7f6dd2ffd640 1 -- 172.21.15.1:0/54469691 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6ddc02d830 con 0x7f6dc8039300 2024-09-19T09:29:25.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.475+0000 7f6de4132640 1 -- 172.21.15.1:0/54469691 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f6dc8039300 msgr2=0x7f6dc803b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:25.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.475+0000 7f6de4132640 1 --2- 172.21.15.1:0/54469691 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f6dc8039300 0x7f6dc803b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc0098c0 tx=0x7f6dcc006db0 comp rx=0 tx=0).stop 2024-09-19T09:29:25.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.475+0000 7f6de4132640 1 -- 172.21.15.1:0/54469691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ddc076220 msgr2=0x7f6ddc198f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:25.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.475+0000 7f6de4132640 1 --2- 172.21.15.1:0/54469691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ddc076220 0x7f6ddc198f90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8004f60 tx=0x7f6dd80048f0 comp rx=0 tx=0).stop 2024-09-19T09:29:25.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.475+0000 7f6de4132640 1 -- 172.21.15.1:0/54469691 shutdown_connections 2024-09-19T09:29:25.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.475+0000 7f6de4132640 1 --2- 172.21.15.1:0/54469691 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f6dc8039300 0x7f6dc803b7c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:25.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.475+0000 7f6de4132640 1 --2- 172.21.15.1:0/54469691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6ddc076220 0x7f6ddc198f90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:25.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.475+0000 7f6de4132640 1 -- 172.21.15.1:0/54469691 >> 172.21.15.1:0/54469691 conn(0x7f6ddc0fcdb0 msgr2=0x7f6ddc0fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:25.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.475+0000 7f6de4132640 1 -- 172.21.15.1:0/54469691 shutdown_connections 2024-09-19T09:29:25.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:25.475+0000 7f6de4132640 1 -- 172.21.15.1:0/54469691 wait complete. 2024-09-19T09:29:26.226 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi022 2024-09-19T09:29:26.227 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-19T09:29:26.227 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/etc/ceph/ceph.conf 2024-09-19T09:29:26.246 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-19T09:29:26.246 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:29:26.305 INFO:tasks.cephadm:Adding host smithi022 to orchestrator... 2024-09-19T09:29:26.305 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph orch host add smithi022 2024-09-19T09:29:26.557 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:29:26.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:26 smithi001 ceph-mon[31225]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:29:26.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:26 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:26.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:26 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:29:26.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:26 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:26.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:26 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:29:26.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:26 smithi001 ceph-mon[31225]: Updating smithi001:/etc/ceph/ceph.conf 2024-09-19T09:29:26.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:26 smithi001 ceph-mon[31225]: Updating smithi001:/var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:29:26.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:26 smithi001 ceph-mon[31225]: Updating smithi001:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:29:26.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:26 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:26.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:26 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:26.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:26 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:27.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:27.030+0000 7fc78e450640 1 -- 172.21.15.1:0/3296137185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc788102750 msgr2=0x7fc788102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:27.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:27.030+0000 7fc78e450640 1 --2- 172.21.15.1:0/3296137185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc788102750 0x7fc788102b30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc778009880 tx=0x7fc77802a670 comp rx=0 tx=0).stop 2024-09-19T09:29:27.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:27.030+0000 7fc78e450640 1 -- 172.21.15.1:0/3296137185 shutdown_connections 2024-09-19T09:29:27.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:27.030+0000 7fc78e450640 1 --2- 172.21.15.1:0/3296137185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc788102750 0x7fc788102b30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:27.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:27.030+0000 7fc78e450640 1 -- 172.21.15.1:0/3296137185 >> 172.21.15.1:0/3296137185 conn(0x7fc7880fc1b0 msgr2=0x7fc7880fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:27.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:27.030+0000 7fc78e450640 1 -- 172.21.15.1:0/3296137185 shutdown_connections 2024-09-19T09:29:27.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:27.030+0000 7fc78e450640 1 -- 172.21.15.1:0/3296137185 wait complete. 2024-09-19T09:29:27.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:27.031+0000 7fc78e450640 1 Processor -- start 2024-09-19T09:29:27.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:27.031+0000 7fc78e450640 1 -- start start 2024-09-19T09:29:27.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:27.031+0000 7fc78e450640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc788102750 0x7fc7881003b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:27.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:27.031+0000 7fc78e450640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc78810bcc0 con 0x7fc788102750 2024-09-19T09:29:27.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:27.031+0000 7fc787fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc788102750 0x7fc7881003b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:27.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:27.031+0000 7fc787fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc788102750 0x7fc7881003b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49832/0 (socket says 172.21.15.1:49832) 2024-09-19T09:29:27.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:27.031+0000 7fc787fff640 1 -- 172.21.15.1:0/3395750811 learned_addr learned my addr 172.21.15.1:0/3395750811 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:29:27.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:27.032+0000 7fc787fff640 1 -- 172.21.15.1:0/3395750811 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7881022a0 con 0x7fc788102750 2024-09-19T09:29:27.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:27.032+0000 7fc787fff640 1 --2- 172.21.15.1:0/3395750811 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc788102750 0x7fc7881003b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc778009230 tx=0x7fc778003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:27.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:27.032+0000 7fc7857fa640 1 -- 172.21.15.1:0/3395750811 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc77803f070 con 0x7fc788102750 2024-09-19T09:29:27.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:27.032+0000 7fc7857fa640 1 -- 172.21.15.1:0/3395750811 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc77803bc80 con 0x7fc788102750 2024-09-19T09:29:27.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:27.032+0000 7fc78e450640 1 -- 172.21.15.1:0/3395750811 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7881008f0 con 0x7fc788102750 2024-09-19T09:29:27.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:27.032+0000 7fc7857fa640 1 -- 172.21.15.1:0/3395750811 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc778035030 con 0x7fc788102750 2024-09-19T09:29:27.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:27.032+0000 7fc78e450640 1 -- 172.21.15.1:0/3395750811 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc788100db0 con 0x7fc788102750 2024-09-19T09:29:27.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:27.033+0000 7fc7857fa640 1 -- 172.21.15.1:0/3395750811 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fc778042070 con 0x7fc788102750 2024-09-19T09:29:27.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:27.033+0000 7fc7857fa640 1 --2- 172.21.15.1:0/3395750811 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc770039300 0x7fc77003b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:27.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:27.033+0000 7fc7857fa640 1 -- 172.21.15.1:0/3395750811 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc77806d2b0 con 0x7fc788102750 2024-09-19T09:29:27.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:27.033+0000 7fc7877fe640 1 --2- 172.21.15.1:0/3395750811 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc770039300 0x7fc77003b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:27.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:27.033+0000 7fc78e450640 1 -- 172.21.15.1:0/3395750811 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc78806a7b0 con 0x7fc788102750 2024-09-19T09:29:27.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:27.034+0000 7fc7877fe640 1 --2- 172.21.15.1:0/3395750811 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc770039300 0x7fc77003b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc77c0098c0 tx=0x7fc77c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:27.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:27.038+0000 7fc7857fa640 1 -- 172.21.15.1:0/3395750811 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc778031dd0 con 0x7fc788102750 2024-09-19T09:29:27.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:27.216+0000 7fc78e450640 1 -- 172.21.15.1:0/3395750811 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi022", "target": ["mon-mgr", ""]}) -- 0x7fc7881010a0 con 0x7fc770039300 2024-09-19T09:29:27.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:27 smithi001 ceph-mon[31225]: Updating smithi001:/var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:29:28.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:28 smithi001 ceph-mon[31225]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi022", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:29:29.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:29 smithi001 ceph-mon[31225]: Deploying cephadm binary to smithi022 2024-09-19T09:29:31.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:31.125+0000 7fc7857fa640 1 -- 172.21.15.1:0/3395750811 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fc7881010a0 con 0x7fc770039300 2024-09-19T09:29:31.128 INFO:teuthology.orchestra.run.smithi001.stdout:Added host 'smithi022' with addr '172.21.15.22' 2024-09-19T09:29:31.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:31.128+0000 7fc78e450640 1 -- 172.21.15.1:0/3395750811 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc770039300 msgr2=0x7fc77003b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:31.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:31.128+0000 7fc78e450640 1 --2- 172.21.15.1:0/3395750811 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc770039300 0x7fc77003b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc77c0098c0 tx=0x7fc77c006db0 comp rx=0 tx=0).stop 2024-09-19T09:29:31.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:31.128+0000 7fc78e450640 1 -- 172.21.15.1:0/3395750811 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc788102750 msgr2=0x7fc7881003b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:31.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:31.128+0000 7fc78e450640 1 --2- 172.21.15.1:0/3395750811 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc788102750 0x7fc7881003b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc778009230 tx=0x7fc778003d40 comp rx=0 tx=0).stop 2024-09-19T09:29:31.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:31.128+0000 7fc78e450640 1 -- 172.21.15.1:0/3395750811 shutdown_connections 2024-09-19T09:29:31.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:31.128+0000 7fc78e450640 1 --2- 172.21.15.1:0/3395750811 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc770039300 0x7fc77003b7c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:31.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:31.128+0000 7fc78e450640 1 --2- 172.21.15.1:0/3395750811 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc788102750 0x7fc7881003b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:31.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:31.128+0000 7fc78e450640 1 -- 172.21.15.1:0/3395750811 >> 172.21.15.1:0/3395750811 conn(0x7fc7880fc1b0 msgr2=0x7fc788105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:31.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:31.128+0000 7fc78e450640 1 -- 172.21.15.1:0/3395750811 shutdown_connections 2024-09-19T09:29:31.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:31.128+0000 7fc78e450640 1 -- 172.21.15.1:0/3395750811 wait complete. 2024-09-19T09:29:31.734 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T09:29:31.982 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:29:32.362 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:32 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:32.363 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:32 smithi001 ceph-mon[31225]: Added host smithi022 2024-09-19T09:29:32.363 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:32 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:29:32.363 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:32 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:32.363 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:32 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:32.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.444+0000 7f5887da1640 1 -- 172.21.15.1:0/3716560830 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5880107660 msgr2=0x7f5880107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:32.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.444+0000 7f5887da1640 1 --2- 172.21.15.1:0/3716560830 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5880107660 0x7f5880107a40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f587c009880 tx=0x7f587c02a5d0 comp rx=0 tx=0).stop 2024-09-19T09:29:32.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.444+0000 7f5887da1640 1 -- 172.21.15.1:0/3716560830 shutdown_connections 2024-09-19T09:29:32.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.444+0000 7f5887da1640 1 --2- 172.21.15.1:0/3716560830 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5880107660 0x7f5880107a40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:32.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.444+0000 7f5887da1640 1 -- 172.21.15.1:0/3716560830 >> 172.21.15.1:0/3716560830 conn(0x7f58800fd270 msgr2=0x7f58800ff690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:32.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.444+0000 7f5887da1640 1 -- 172.21.15.1:0/3716560830 shutdown_connections 2024-09-19T09:29:32.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.444+0000 7f5887da1640 1 -- 172.21.15.1:0/3716560830 wait complete. 2024-09-19T09:29:32.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.444+0000 7f5887da1640 1 Processor -- start 2024-09-19T09:29:32.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.444+0000 7f5887da1640 1 -- start start 2024-09-19T09:29:32.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.444+0000 7f5887da1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5880107660 0x7f58800744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:32.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.444+0000 7f5887da1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f588010bc90 con 0x7f5880107660 2024-09-19T09:29:32.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.445+0000 7f5885b3d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5880107660 0x7f58800744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:32.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.445+0000 7f5885b3d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5880107660 0x7f58800744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49840/0 (socket says 172.21.15.1:49840) 2024-09-19T09:29:32.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.445+0000 7f5885b3d640 1 -- 172.21.15.1:0/1020220052 learned_addr learned my addr 172.21.15.1:0/1020220052 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:29:32.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.445+0000 7f5885b3d640 1 -- 172.21.15.1:0/1020220052 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58800763e0 con 0x7f5880107660 2024-09-19T09:29:32.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.445+0000 7f5885b3d640 1 --2- 172.21.15.1:0/1020220052 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5880107660 0x7f58800744f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f587c009230 tx=0x7f587c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:32.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.445+0000 7f5876ffd640 1 -- 172.21.15.1:0/1020220052 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f587c03f070 con 0x7f5880107660 2024-09-19T09:29:32.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.445+0000 7f5876ffd640 1 -- 172.21.15.1:0/1020220052 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f587c03bc80 con 0x7f5880107660 2024-09-19T09:29:32.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.445+0000 7f5887da1640 1 -- 172.21.15.1:0/1020220052 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5880074a30 con 0x7f5880107660 2024-09-19T09:29:32.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.445+0000 7f5876ffd640 1 -- 172.21.15.1:0/1020220052 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f587c035030 con 0x7f5880107660 2024-09-19T09:29:32.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.445+0000 7f5887da1640 1 -- 172.21.15.1:0/1020220052 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5880074ef0 con 0x7f5880107660 2024-09-19T09:29:32.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.446+0000 7f5876ffd640 1 -- 172.21.15.1:0/1020220052 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f587c042070 con 0x7f5880107660 2024-09-19T09:29:32.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.446+0000 7f5887da1640 1 -- 172.21.15.1:0/1020220052 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5880102cd0 con 0x7f5880107660 2024-09-19T09:29:32.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.447+0000 7f5876ffd640 1 --2- 172.21.15.1:0/1020220052 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f586c039300 0x7f586c03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:32.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.447+0000 7f5876ffd640 1 -- 172.21.15.1:0/1020220052 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f587c06cbb0 con 0x7f5880107660 2024-09-19T09:29:32.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.447+0000 7f588533c640 1 --2- 172.21.15.1:0/1020220052 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f586c039300 0x7f586c03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:32.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.447+0000 7f588533c640 1 --2- 172.21.15.1:0/1020220052 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f586c039300 0x7f586c03b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f58700098c0 tx=0x7f5870006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:32.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.451+0000 7f5876ffd640 1 -- 172.21.15.1:0/1020220052 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f587c042360 con 0x7f5880107660 2024-09-19T09:29:32.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.633+0000 7f5887da1640 1 -- 172.21.15.1:0/1020220052 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5880075a90 con 0x7f586c039300 2024-09-19T09:29:32.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.634+0000 7f5876ffd640 1 -- 172.21.15.1:0/1020220052 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+158 (secure 0 0 0) 0x7f5880075a90 con 0x7f586c039300 2024-09-19T09:29:32.635 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:29:32.635 INFO:teuthology.orchestra.run.smithi001.stdout:[{"addr": "172.21.15.1", "hostname": "smithi001", "labels": [], "status": ""}, {"addr": "172.21.15.22", "hostname": "smithi022", "labels": [], "status": ""}] 2024-09-19T09:29:32.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.636+0000 7f5887da1640 1 -- 172.21.15.1:0/1020220052 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f586c039300 msgr2=0x7f586c03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:32.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.636+0000 7f5887da1640 1 --2- 172.21.15.1:0/1020220052 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f586c039300 0x7f586c03b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f58700098c0 tx=0x7f5870006db0 comp rx=0 tx=0).stop 2024-09-19T09:29:32.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.636+0000 7f5887da1640 1 -- 172.21.15.1:0/1020220052 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5880107660 msgr2=0x7f58800744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:32.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.636+0000 7f5887da1640 1 --2- 172.21.15.1:0/1020220052 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5880107660 0x7f58800744f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f587c009230 tx=0x7f587c003d40 comp rx=0 tx=0).stop 2024-09-19T09:29:32.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.636+0000 7f5887da1640 1 -- 172.21.15.1:0/1020220052 shutdown_connections 2024-09-19T09:29:32.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.636+0000 7f5887da1640 1 --2- 172.21.15.1:0/1020220052 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f586c039300 0x7f586c03b7c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:32.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.636+0000 7f5887da1640 1 --2- 172.21.15.1:0/1020220052 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5880107660 0x7f58800744f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:32.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.636+0000 7f5887da1640 1 -- 172.21.15.1:0/1020220052 >> 172.21.15.1:0/1020220052 conn(0x7f58800fd270 msgr2=0x7f58800fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:32.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.636+0000 7f5887da1640 1 -- 172.21.15.1:0/1020220052 shutdown_connections 2024-09-19T09:29:32.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:32.636+0000 7f5887da1640 1 -- 172.21.15.1:0/1020220052 wait complete. 2024-09-19T09:29:33.277 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi121 2024-09-19T09:29:33.277 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-19T09:29:33.277 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/etc/ceph/ceph.conf 2024-09-19T09:29:33.297 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-19T09:29:33.297 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:29:33.355 INFO:tasks.cephadm:Adding host smithi121 to orchestrator... 2024-09-19T09:29:33.355 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph orch host add smithi121 2024-09-19T09:29:33.604 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:29:33.717 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:33 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:33.717 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:33 smithi001 ceph-mon[31225]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:29:34.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:34.017+0000 7f4fa1e1b640 1 -- 172.21.15.1:0/886357180 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f9c106560 msgr2=0x7f4f9c106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:34.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:34.017+0000 7f4fa1e1b640 1 --2- 172.21.15.1:0/886357180 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f9c106560 0x7f4f9c106940 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009880 tx=0x7f4f8c02a5d0 comp rx=0 tx=0).stop 2024-09-19T09:29:34.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:34.017+0000 7f4fa1e1b640 1 -- 172.21.15.1:0/886357180 shutdown_connections 2024-09-19T09:29:34.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:34.017+0000 7f4fa1e1b640 1 --2- 172.21.15.1:0/886357180 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f9c106560 0x7f4f9c106940 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:34.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:34.017+0000 7f4fa1e1b640 1 -- 172.21.15.1:0/886357180 >> 172.21.15.1:0/886357180 conn(0x7f4f9c0fc1b0 msgr2=0x7f4f9c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:34.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:34.017+0000 7f4fa1e1b640 1 -- 172.21.15.1:0/886357180 shutdown_connections 2024-09-19T09:29:34.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:34.017+0000 7f4fa1e1b640 1 -- 172.21.15.1:0/886357180 wait complete. 2024-09-19T09:29:34.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:34.018+0000 7f4fa1e1b640 1 Processor -- start 2024-09-19T09:29:34.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:34.018+0000 7f4fa1e1b640 1 -- start start 2024-09-19T09:29:34.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:34.018+0000 7f4fa1e1b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f9c106560 0x7f4f9c0fc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:34.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:34.018+0000 7f4fa1e1b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c10ab90 con 0x7f4f9c106560 2024-09-19T09:29:34.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:34.019+0000 7f4f9b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f9c106560 0x7f4f9c0fc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:34.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:34.019+0000 7f4f9b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f9c106560 0x7f4f9c0fc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49866/0 (socket says 172.21.15.1:49866) 2024-09-19T09:29:34.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:34.019+0000 7f4f9b7fe640 1 -- 172.21.15.1:0/2907984226 learned_addr learned my addr 172.21.15.1:0/2907984226 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:29:34.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:34.019+0000 7f4f9b7fe640 1 -- 172.21.15.1:0/2907984226 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9c0fe550 con 0x7f4f9c106560 2024-09-19T09:29:34.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:34.019+0000 7f4f9b7fe640 1 --2- 172.21.15.1:0/2907984226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f9c106560 0x7f4f9c0fc660 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009230 tx=0x7f4f8c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:34.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:34.019+0000 7f4f98ff9640 1 -- 172.21.15.1:0/2907984226 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f8c03f070 con 0x7f4f9c106560 2024-09-19T09:29:34.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:34.019+0000 7f4f98ff9640 1 -- 172.21.15.1:0/2907984226 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f8c03bc80 con 0x7f4f9c106560 2024-09-19T09:29:34.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:34.019+0000 7f4fa1e1b640 1 -- 172.21.15.1:0/2907984226 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f9c0fcba0 con 0x7f4f9c106560 2024-09-19T09:29:34.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:34.019+0000 7f4f98ff9640 1 -- 172.21.15.1:0/2907984226 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f8c035030 con 0x7f4f9c106560 2024-09-19T09:29:34.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:34.019+0000 7f4fa1e1b640 1 -- 172.21.15.1:0/2907984226 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f9c0fd060 con 0x7f4f9c106560 2024-09-19T09:29:34.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:34.020+0000 7f4f98ff9640 1 -- 172.21.15.1:0/2907984226 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f4f8c042070 con 0x7f4f9c106560 2024-09-19T09:29:34.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:34.020+0000 7f4f98ff9640 1 --2- 172.21.15.1:0/2907984226 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4f840392a0 0x7f4f8403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:34.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:34.020+0000 7f4fa1e1b640 1 -- 172.21.15.1:0/2907984226 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f9c101bd0 con 0x7f4f9c106560 2024-09-19T09:29:34.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:34.020+0000 7f4f98ff9640 1 -- 172.21.15.1:0/2907984226 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f4f8c06d130 con 0x7f4f9c106560 2024-09-19T09:29:34.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:34.021+0000 7f4f9affd640 1 --2- 172.21.15.1:0/2907984226 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4f840392a0 0x7f4f8403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:34.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:34.021+0000 7f4f9affd640 1 --2- 172.21.15.1:0/2907984226 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4f840392a0 0x7f4f8403b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4f900098c0 tx=0x7f4f90006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:34.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:34.025+0000 7f4f98ff9640 1 -- 172.21.15.1:0/2907984226 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4f8c042c10 con 0x7f4f9c106560 2024-09-19T09:29:34.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:34.204+0000 7f4fa1e1b640 1 -- 172.21.15.1:0/2907984226 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi121", "target": ["mon-mgr", ""]}) -- 0x7f4f9c0fdb90 con 0x7f4f840392a0 2024-09-19T09:29:35.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:35 smithi001 ceph-mon[31225]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:29:35.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:35 smithi001 ceph-mon[31225]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi121", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:29:36.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:36 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:36.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:36 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:36.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:36 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:36.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:36 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:36.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:36 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi022", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:29:36.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:36 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:36.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:36 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:29:36.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:36 smithi001 ceph-mon[31225]: Updating smithi022:/etc/ceph/ceph.conf 2024-09-19T09:29:36.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:36 smithi001 ceph-mon[31225]: Updating smithi022:/var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:29:36.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:36 smithi001 ceph-mon[31225]: Deploying cephadm binary to smithi121 2024-09-19T09:29:36.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:36 smithi001 ceph-mon[31225]: Updating smithi022:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:29:36.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:36 smithi001 ceph-mon[31225]: Updating smithi022:/var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:29:36.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:36 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:36.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:36 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:36.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:36 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:38.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:38.053+0000 7f4f98ff9640 1 -- 172.21.15.1:0/2907984226 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f4f9c0fdb90 con 0x7f4f840392a0 2024-09-19T09:29:38.054 INFO:teuthology.orchestra.run.smithi001.stdout:Added host 'smithi121' with addr '172.21.15.121' 2024-09-19T09:29:38.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:38.055+0000 7f4fa1e1b640 1 -- 172.21.15.1:0/2907984226 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4f840392a0 msgr2=0x7f4f8403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:38.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:38.055+0000 7f4fa1e1b640 1 --2- 172.21.15.1:0/2907984226 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4f840392a0 0x7f4f8403b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4f900098c0 tx=0x7f4f90006db0 comp rx=0 tx=0).stop 2024-09-19T09:29:38.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:38.055+0000 7f4fa1e1b640 1 -- 172.21.15.1:0/2907984226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f9c106560 msgr2=0x7f4f9c0fc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:38.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:38.055+0000 7f4fa1e1b640 1 --2- 172.21.15.1:0/2907984226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f9c106560 0x7f4f9c0fc660 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009230 tx=0x7f4f8c003d40 comp rx=0 tx=0).stop 2024-09-19T09:29:38.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:38.055+0000 7f4fa1e1b640 1 -- 172.21.15.1:0/2907984226 shutdown_connections 2024-09-19T09:29:38.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:38.055+0000 7f4fa1e1b640 1 --2- 172.21.15.1:0/2907984226 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4f840392a0 0x7f4f8403b760 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:38.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:38.055+0000 7f4fa1e1b640 1 --2- 172.21.15.1:0/2907984226 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f9c106560 0x7f4f9c0fc660 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:38.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:38.055+0000 7f4fa1e1b640 1 -- 172.21.15.1:0/2907984226 >> 172.21.15.1:0/2907984226 conn(0x7f4f9c0fc1b0 msgr2=0x7f4f9c069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:38.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:38.055+0000 7f4fa1e1b640 1 -- 172.21.15.1:0/2907984226 shutdown_connections 2024-09-19T09:29:38.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:38.055+0000 7f4fa1e1b640 1 -- 172.21.15.1:0/2907984226 wait complete. 2024-09-19T09:29:38.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:37 smithi001 ceph-mon[31225]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:29:38.699 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T09:29:38.945 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:29:39.368 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:39 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:39.368 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:39 smithi001 ceph-mon[31225]: Added host smithi121 2024-09-19T09:29:39.368 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:39 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:29:39.368 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:39 smithi001 ceph-mon[31225]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:29:39.368 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:39 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:39.368 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:39 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:39.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.373+0000 7ff5a9d39640 1 -- 172.21.15.1:0/624252286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5a4102730 msgr2=0x7ff5a4102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:39.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.373+0000 7ff5a9d39640 1 --2- 172.21.15.1:0/624252286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5a4102730 0x7ff5a4102b10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff594009810 tx=0x7ff59402a540 comp rx=0 tx=0).stop 2024-09-19T09:29:39.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.373+0000 7ff5a9d39640 1 -- 172.21.15.1:0/624252286 shutdown_connections 2024-09-19T09:29:39.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.373+0000 7ff5a9d39640 1 --2- 172.21.15.1:0/624252286 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5a4102730 0x7ff5a4102b10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:39.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.373+0000 7ff5a9d39640 1 -- 172.21.15.1:0/624252286 >> 172.21.15.1:0/624252286 conn(0x7ff5a4077310 msgr2=0x7ff5a40fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:39.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.373+0000 7ff5a9d39640 1 -- 172.21.15.1:0/624252286 shutdown_connections 2024-09-19T09:29:39.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.373+0000 7ff5a9d39640 1 -- 172.21.15.1:0/624252286 wait complete. 2024-09-19T09:29:39.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.373+0000 7ff5a9d39640 1 Processor -- start 2024-09-19T09:29:39.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.374+0000 7ff5a9d39640 1 -- start start 2024-09-19T09:29:39.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.374+0000 7ff5a9d39640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5a4102730 0x7ff5a41971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:39.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.374+0000 7ff5a9d39640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a410bc80 con 0x7ff5a4102730 2024-09-19T09:29:39.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.374+0000 7ff5a37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5a4102730 0x7ff5a41971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:39.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.374+0000 7ff5a37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5a4102730 0x7ff5a41971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50104/0 (socket says 172.21.15.1:50104) 2024-09-19T09:29:39.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.374+0000 7ff5a37fe640 1 -- 172.21.15.1:0/2395607177 learned_addr learned my addr 172.21.15.1:0/2395607177 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:29:39.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.374+0000 7ff5a37fe640 1 -- 172.21.15.1:0/2395607177 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a41976f0 con 0x7ff5a4102730 2024-09-19T09:29:39.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.375+0000 7ff5a37fe640 1 --2- 172.21.15.1:0/2395607177 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5a4102730 0x7ff5a41971b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff5940045e0 tx=0x7ff594004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:39.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.375+0000 7ff5a0ff9640 1 -- 172.21.15.1:0/2395607177 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff594030e70 con 0x7ff5a4102730 2024-09-19T09:29:39.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.375+0000 7ff5a0ff9640 1 -- 172.21.15.1:0/2395607177 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff5940318e0 con 0x7ff5a4102730 2024-09-19T09:29:39.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.375+0000 7ff5a9d39640 1 -- 172.21.15.1:0/2395607177 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5a4197980 con 0x7ff5a4102730 2024-09-19T09:29:39.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.375+0000 7ff5a0ff9640 1 -- 172.21.15.1:0/2395607177 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5940049c0 con 0x7ff5a4102730 2024-09-19T09:29:39.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.375+0000 7ff5a9d39640 1 -- 172.21.15.1:0/2395607177 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5a4197de0 con 0x7ff5a4102730 2024-09-19T09:29:39.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.376+0000 7ff5a0ff9640 1 -- 172.21.15.1:0/2395607177 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7ff594039040 con 0x7ff5a4102730 2024-09-19T09:29:39.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.376+0000 7ff5a9d39640 1 -- 172.21.15.1:0/2395607177 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5a4069f90 con 0x7ff5a4102730 2024-09-19T09:29:39.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.376+0000 7ff5a0ff9640 1 --2- 172.21.15.1:0/2395607177 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff58c0392a0 0x7ff58c03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:39.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.376+0000 7ff5a0ff9640 1 -- 172.21.15.1:0/2395607177 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff59406d5d0 con 0x7ff5a4102730 2024-09-19T09:29:39.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.376+0000 7ff5a2ffd640 1 --2- 172.21.15.1:0/2395607177 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff58c0392a0 0x7ff58c03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:39.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.377+0000 7ff5a2ffd640 1 --2- 172.21.15.1:0/2395607177 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff58c0392a0 0x7ff58c03b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff5980098c0 tx=0x7ff598006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:39.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.381+0000 7ff5a0ff9640 1 -- 172.21.15.1:0/2395607177 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff594040030 con 0x7ff5a4102730 2024-09-19T09:29:39.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.562+0000 7ff5a9d39640 1 -- 172.21.15.1:0/2395607177 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff5a4198570 con 0x7ff58c0392a0 2024-09-19T09:29:39.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.563+0000 7ff5a0ff9640 1 -- 172.21.15.1:0/2395607177 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+238 (secure 0 0 0) 0x7ff5a4198570 con 0x7ff58c0392a0 2024-09-19T09:29:39.565 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:29:39.565 INFO:teuthology.orchestra.run.smithi001.stdout:[{"addr": "172.21.15.1", "hostname": "smithi001", "labels": [], "status": ""}, {"addr": "172.21.15.22", "hostname": "smithi022", "labels": [], "status": ""}, {"addr": "172.21.15.121", "hostname": "smithi121", "labels": [], "status": ""}] 2024-09-19T09:29:39.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.565+0000 7ff5a9d39640 1 -- 172.21.15.1:0/2395607177 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff58c0392a0 msgr2=0x7ff58c03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:39.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.565+0000 7ff5a9d39640 1 --2- 172.21.15.1:0/2395607177 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff58c0392a0 0x7ff58c03b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff5980098c0 tx=0x7ff598006db0 comp rx=0 tx=0).stop 2024-09-19T09:29:39.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.565+0000 7ff5a9d39640 1 -- 172.21.15.1:0/2395607177 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5a4102730 msgr2=0x7ff5a41971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:39.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.565+0000 7ff5a9d39640 1 --2- 172.21.15.1:0/2395607177 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5a4102730 0x7ff5a41971b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff5940045e0 tx=0x7ff594004610 comp rx=0 tx=0).stop 2024-09-19T09:29:39.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.565+0000 7ff5a9d39640 1 -- 172.21.15.1:0/2395607177 shutdown_connections 2024-09-19T09:29:39.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.565+0000 7ff5a9d39640 1 --2- 172.21.15.1:0/2395607177 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff58c0392a0 0x7ff58c03b760 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:39.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.565+0000 7ff5a9d39640 1 --2- 172.21.15.1:0/2395607177 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff5a4102730 0x7ff5a41971b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:39.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.565+0000 7ff5a9d39640 1 -- 172.21.15.1:0/2395607177 >> 172.21.15.1:0/2395607177 conn(0x7ff5a4077310 msgr2=0x7ff5a41034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:39.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.565+0000 7ff5a9d39640 1 -- 172.21.15.1:0/2395607177 shutdown_connections 2024-09-19T09:29:39.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:39.566+0000 7ff5a9d39640 1 -- 172.21.15.1:0/2395607177 wait complete. 2024-09-19T09:29:40.125 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-19T09:29:40.126 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-19T09:29:40.373 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:29:40.733 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:40 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:40.733 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:40 smithi001 ceph-mon[31225]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:29:40.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:40.816+0000 7fbb694b8640 1 -- 172.21.15.1:0/1199746083 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb64106560 msgr2=0x7fbb64106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:40.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:40.816+0000 7fbb694b8640 1 --2- 172.21.15.1:0/1199746083 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb64106560 0x7fbb64106940 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbb54009880 tx=0x7fbb5402a5d0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:40.816+0000 7fbb694b8640 1 -- 172.21.15.1:0/1199746083 shutdown_connections 2024-09-19T09:29:40.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:40.816+0000 7fbb694b8640 1 --2- 172.21.15.1:0/1199746083 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb64106560 0x7fbb64106940 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:40.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:40.816+0000 7fbb694b8640 1 -- 172.21.15.1:0/1199746083 >> 172.21.15.1:0/1199746083 conn(0x7fbb640fc1b0 msgr2=0x7fbb640fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:40.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:40.816+0000 7fbb694b8640 1 -- 172.21.15.1:0/1199746083 shutdown_connections 2024-09-19T09:29:40.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:40.816+0000 7fbb694b8640 1 -- 172.21.15.1:0/1199746083 wait complete. 2024-09-19T09:29:40.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:40.816+0000 7fbb694b8640 1 Processor -- start 2024-09-19T09:29:40.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:40.817+0000 7fbb694b8640 1 -- start start 2024-09-19T09:29:40.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:40.817+0000 7fbb694b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb64106560 0x7fbb64197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:40.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:40.817+0000 7fbb694b8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6410ab90 con 0x7fbb64106560 2024-09-19T09:29:40.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:40.817+0000 7fbb62ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb64106560 0x7fbb64197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:40.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:40.817+0000 7fbb62ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb64106560 0x7fbb64197120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50134/0 (socket says 172.21.15.1:50134) 2024-09-19T09:29:40.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:40.817+0000 7fbb62ffd640 1 -- 172.21.15.1:0/565570412 learned_addr learned my addr 172.21.15.1:0/565570412 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:29:40.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:40.817+0000 7fbb62ffd640 1 -- 172.21.15.1:0/565570412 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb64197660 con 0x7fbb64106560 2024-09-19T09:29:40.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:40.817+0000 7fbb62ffd640 1 --2- 172.21.15.1:0/565570412 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb64106560 0x7fbb64197120 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbb54009230 tx=0x7fbb54003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:40.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:40.818+0000 7fbb4bfff640 1 -- 172.21.15.1:0/565570412 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb5403f070 con 0x7fbb64106560 2024-09-19T09:29:40.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:40.818+0000 7fbb4bfff640 1 -- 172.21.15.1:0/565570412 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb5403bc80 con 0x7fbb64106560 2024-09-19T09:29:40.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:40.818+0000 7fbb694b8640 1 -- 172.21.15.1:0/565570412 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb641978f0 con 0x7fbb64106560 2024-09-19T09:29:40.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:40.818+0000 7fbb4bfff640 1 -- 172.21.15.1:0/565570412 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb54035030 con 0x7fbb64106560 2024-09-19T09:29:40.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:40.818+0000 7fbb694b8640 1 -- 172.21.15.1:0/565570412 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb6419b9f0 con 0x7fbb64106560 2024-09-19T09:29:40.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:40.819+0000 7fbb4bfff640 1 -- 172.21.15.1:0/565570412 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fbb54042070 con 0x7fbb64106560 2024-09-19T09:29:40.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:40.819+0000 7fbb694b8640 1 -- 172.21.15.1:0/565570412 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb64101bd0 con 0x7fbb64106560 2024-09-19T09:29:40.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:40.819+0000 7fbb4bfff640 1 --2- 172.21.15.1:0/565570412 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbb4c0392a0 0x7fbb4c03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:40.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:40.819+0000 7fbb4bfff640 1 -- 172.21.15.1:0/565570412 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbb5406cfd0 con 0x7fbb64106560 2024-09-19T09:29:40.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:40.819+0000 7fbb627fc640 1 --2- 172.21.15.1:0/565570412 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbb4c0392a0 0x7fbb4c03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:40.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:40.819+0000 7fbb627fc640 1 --2- 172.21.15.1:0/565570412 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbb4c0392a0 0x7fbb4c03b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbb580098c0 tx=0x7fbb58006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:40.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:40.824+0000 7fbb4bfff640 1 -- 172.21.15.1:0/565570412 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbb54031e20 con 0x7fbb64106560 2024-09-19T09:29:41.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:41.004+0000 7fbb694b8640 1 -- 172.21.15.1:0/565570412 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fbb64198480 con 0x7fbb64106560 2024-09-19T09:29:41.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:41.404+0000 7fbb4bfff640 1 -- 172.21.15.1:0/565570412 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7fbb540372d0 con 0x7fbb64106560 2024-09-19T09:29:41.405 INFO:teuthology.orchestra.run.smithi001.stderr:adjusted tunables profile to default 2024-09-19T09:29:41.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:41.406+0000 7fbb694b8640 1 -- 172.21.15.1:0/565570412 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbb4c0392a0 msgr2=0x7fbb4c03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:41.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:41.406+0000 7fbb694b8640 1 --2- 172.21.15.1:0/565570412 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbb4c0392a0 0x7fbb4c03b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbb580098c0 tx=0x7fbb58006db0 comp rx=0 tx=0).stop 2024-09-19T09:29:41.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:41.406+0000 7fbb694b8640 1 -- 172.21.15.1:0/565570412 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb64106560 msgr2=0x7fbb64197120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:41.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:41.406+0000 7fbb694b8640 1 --2- 172.21.15.1:0/565570412 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb64106560 0x7fbb64197120 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbb54009230 tx=0x7fbb54003d40 comp rx=0 tx=0).stop 2024-09-19T09:29:41.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:41.406+0000 7fbb694b8640 1 -- 172.21.15.1:0/565570412 shutdown_connections 2024-09-19T09:29:41.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:41.406+0000 7fbb694b8640 1 --2- 172.21.15.1:0/565570412 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbb4c0392a0 0x7fbb4c03b760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:41.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:41.406+0000 7fbb694b8640 1 --2- 172.21.15.1:0/565570412 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb64106560 0x7fbb64197120 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:41.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:41.406+0000 7fbb694b8640 1 -- 172.21.15.1:0/565570412 >> 172.21.15.1:0/565570412 conn(0x7fbb640fc1b0 msgr2=0x7fbb64069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:41.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:41.407+0000 7fbb694b8640 1 -- 172.21.15.1:0/565570412 shutdown_connections 2024-09-19T09:29:41.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:29:41.407+0000 7fbb694b8640 1 -- 172.21.15.1:0/565570412 wait complete. 2024-09-19T09:29:41.709 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:41 smithi001 ceph-mon[31225]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:29:41.710 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:41 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/565570412' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T09:29:42.027 INFO:tasks.cephadm:Adding mon.a on smithi001 2024-09-19T09:29:42.028 INFO:tasks.cephadm:Adding mon.b on smithi022 2024-09-19T09:29:42.028 INFO:tasks.cephadm:Adding mon.c on smithi121 2024-09-19T09:29:42.028 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi001:172.21.15.1=a;smithi022:172.21.15.22=b;smithi121:172.21.15.121=c' 2024-09-19T09:29:42.272 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T09:29:42.322 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T09:29:42.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:42 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/565570412' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T09:29:42.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:42 smithi001 ceph-mon[31225]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:29:42.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:42 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:42.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:42 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:42.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:42 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:42.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:42 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:42.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:42 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi121", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:29:42.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:42 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:42.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:42 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:29:42.838 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:42.795+0000 7f2b306ab640 1 -- 172.21.15.121:0/2325659073 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b28100500 msgr2=0x7f2b28100900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:42.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:42.795+0000 7f2b306ab640 1 --2- 172.21.15.121:0/2325659073 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b28100500 0x7f2b28100900 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2b20009880 tx=0x7f2b2002a5d0 comp rx=0 tx=0).stop 2024-09-19T09:29:42.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:42.795+0000 7f2b306ab640 1 -- 172.21.15.121:0/2325659073 shutdown_connections 2024-09-19T09:29:42.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:42.795+0000 7f2b306ab640 1 --2- 172.21.15.121:0/2325659073 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b28100500 0x7f2b28100900 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:42.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:42.795+0000 7f2b306ab640 1 -- 172.21.15.121:0/2325659073 >> 172.21.15.121:0/2325659073 conn(0x7f2b280fbc90 msgr2=0x7f2b280fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:42.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:42.795+0000 7f2b306ab640 1 -- 172.21.15.121:0/2325659073 shutdown_connections 2024-09-19T09:29:42.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:42.795+0000 7f2b306ab640 1 -- 172.21.15.121:0/2325659073 wait complete. 2024-09-19T09:29:42.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:42.796+0000 7f2b306ab640 1 Processor -- start 2024-09-19T09:29:42.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:42.796+0000 7f2b306ab640 1 -- start start 2024-09-19T09:29:42.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:42.796+0000 7f2b306ab640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b28100500 0x7f2b28196de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:42.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:42.796+0000 7f2b306ab640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2b28106610 con 0x7f2b28100500 2024-09-19T09:29:42.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:42.796+0000 7f2b2e447640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b28100500 0x7f2b28196de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:42.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:42.796+0000 7f2b2e447640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b28100500 0x7f2b28196de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.121:55644/0 (socket says 172.21.15.121:55644) 2024-09-19T09:29:42.839 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:42.796+0000 7f2b2e447640 1 -- 172.21.15.121:0/1891353382 learned_addr learned my addr 172.21.15.121:0/1891353382 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-19T09:29:42.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:42.797+0000 7f2b2e447640 1 -- 172.21.15.121:0/1891353382 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b28197320 con 0x7f2b28100500 2024-09-19T09:29:42.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:42.797+0000 7f2b2e447640 1 --2- 172.21.15.121:0/1891353382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b28100500 0x7f2b28196de0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2b20004f60 tx=0x7f2b200048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:42.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:42.797+0000 7f2b277fe640 1 -- 172.21.15.121:0/1891353382 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b2003f070 con 0x7f2b28100500 2024-09-19T09:29:42.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:42.797+0000 7f2b306ab640 1 -- 172.21.15.121:0/1891353382 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b281975b0 con 0x7f2b28100500 2024-09-19T09:29:42.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:42.797+0000 7f2b277fe640 1 -- 172.21.15.121:0/1891353382 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b20004d40 con 0x7f2b28100500 2024-09-19T09:29:42.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:42.797+0000 7f2b277fe640 1 -- 172.21.15.121:0/1891353382 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2b20035030 con 0x7f2b28100500 2024-09-19T09:29:42.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:42.797+0000 7f2b306ab640 1 -- 172.21.15.121:0/1891353382 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b2819a2a0 con 0x7f2b28100500 2024-09-19T09:29:42.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:42.798+0000 7f2b306ab640 1 -- 172.21.15.121:0/1891353382 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b28106d90 con 0x7f2b28100500 2024-09-19T09:29:42.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:42.798+0000 7f2b277fe640 1 -- 172.21.15.121:0/1891353382 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f2b20042070 con 0x7f2b28100500 2024-09-19T09:29:42.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:42.798+0000 7f2b277fe640 1 --2- 172.21.15.121:0/1891353382 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f2b100392a0 0x7f2b1003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:42.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:42.798+0000 7f2b277fe640 1 -- 172.21.15.121:0/1891353382 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2b2006d0c0 con 0x7f2b28100500 2024-09-19T09:29:42.840 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:42.799+0000 7f2b2dc46640 1 --2- 172.21.15.121:0/1891353382 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f2b100392a0 0x7f2b1003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:42.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:42.799+0000 7f2b2dc46640 1 --2- 172.21.15.121:0/1891353382 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f2b100392a0 0x7f2b1003b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c00ad30 tx=0x7f2b1c0093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:42.841 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:42.803+0000 7f2b277fe640 1 -- 172.21.15.121:0/1891353382 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2b2004a260 con 0x7f2b28100500 2024-09-19T09:29:43.000 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:42.998+0000 7f2b306ab640 1 -- 172.21.15.121:0/1891353382 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi001:172.21.15.1=a;smithi022:172.21.15.22=b;smithi121:172.21.15.121=c", "target": ["mon-mgr", ""]}) -- 0x7f2b28062630 con 0x7f2b100392a0 2024-09-19T09:29:43.005 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:43.003+0000 7f2b277fe640 1 -- 172.21.15.121:0/1891353382 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f2b28062630 con 0x7f2b100392a0 2024-09-19T09:29:43.006 INFO:teuthology.orchestra.run.smithi121.stdout:Scheduled mon update... 2024-09-19T09:29:43.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:43.006+0000 7f2b306ab640 1 -- 172.21.15.121:0/1891353382 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f2b100392a0 msgr2=0x7f2b1003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:43.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:43.006+0000 7f2b306ab640 1 --2- 172.21.15.121:0/1891353382 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f2b100392a0 0x7f2b1003b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c00ad30 tx=0x7f2b1c0093f0 comp rx=0 tx=0).stop 2024-09-19T09:29:43.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:43.006+0000 7f2b306ab640 1 -- 172.21.15.121:0/1891353382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b28100500 msgr2=0x7f2b28196de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:43.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:43.006+0000 7f2b306ab640 1 --2- 172.21.15.121:0/1891353382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b28100500 0x7f2b28196de0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2b20004f60 tx=0x7f2b200048f0 comp rx=0 tx=0).stop 2024-09-19T09:29:43.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:43.006+0000 7f2b306ab640 1 -- 172.21.15.121:0/1891353382 shutdown_connections 2024-09-19T09:29:43.008 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:43.006+0000 7f2b306ab640 1 --2- 172.21.15.121:0/1891353382 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f2b100392a0 0x7f2b1003b760 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:43.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:43.006+0000 7f2b306ab640 1 --2- 172.21.15.121:0/1891353382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2b28100500 0x7f2b28196de0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:43.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:43.006+0000 7f2b306ab640 1 -- 172.21.15.121:0/1891353382 >> 172.21.15.121:0/1891353382 conn(0x7f2b280fbc90 msgr2=0x7f2b2806a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:43.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:43.006+0000 7f2b306ab640 1 -- 172.21.15.121:0/1891353382 shutdown_connections 2024-09-19T09:29:43.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:43.006+0000 7f2b306ab640 1 -- 172.21.15.121:0/1891353382 wait complete. 2024-09-19T09:29:43.645 DEBUG:teuthology.orchestra.run.smithi022:mon.b> sudo journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mon.b.service 2024-09-19T09:29:43.649 DEBUG:teuthology.orchestra.run.smithi121:mon.c> sudo journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mon.c.service 2024-09-19T09:29:43.651 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T09:29:43.651 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:29:44.387 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:29:44.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:44 smithi001 ceph-mon[31225]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:29:44.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:44 smithi001 ceph-mon[31225]: Updating smithi121:/etc/ceph/ceph.conf 2024-09-19T09:29:44.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:44 smithi001 ceph-mon[31225]: Updating smithi121:/var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:29:44.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:44 smithi001 ceph-mon[31225]: Updating smithi121:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:29:44.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:44 smithi001 ceph-mon[31225]: Updating smithi121:/var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:29:44.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:44 smithi001 ceph-mon[31225]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi001:172.21.15.1=a;smithi022:172.21.15.22=b;smithi121:172.21.15.121=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:29:44.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:44 smithi001 ceph-mon[31225]: Saving service mon spec with placement smithi001:172.21.15.1=a;smithi022:172.21.15.22=b;smithi121:172.21.15.121=c;count:3 2024-09-19T09:29:44.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:44 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:44.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:44 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:44.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:44 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:44.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:44 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:44.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:44 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:29:44.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:44 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:44.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:44.784+0000 7f852c4c7640 1 -- 172.21.15.121:0/2590791593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8524106560 msgr2=0x7f8524106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:44.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:44.784+0000 7f852c4c7640 1 --2- 172.21.15.121:0/2590791593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8524106560 0x7f8524106940 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8520009880 tx=0x7f852002a5d0 comp rx=0 tx=0).stop 2024-09-19T09:29:44.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:44.784+0000 7f852c4c7640 1 -- 172.21.15.121:0/2590791593 shutdown_connections 2024-09-19T09:29:44.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:44.784+0000 7f852c4c7640 1 --2- 172.21.15.121:0/2590791593 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8524106560 0x7f8524106940 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:44.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:44.784+0000 7f852c4c7640 1 -- 172.21.15.121:0/2590791593 >> 172.21.15.121:0/2590791593 conn(0x7f85240fc1b0 msgr2=0x7f85240fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:44.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:44.784+0000 7f852c4c7640 1 -- 172.21.15.121:0/2590791593 shutdown_connections 2024-09-19T09:29:44.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:44.784+0000 7f852c4c7640 1 -- 172.21.15.121:0/2590791593 wait complete. 2024-09-19T09:29:44.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:44.785+0000 7f852c4c7640 1 Processor -- start 2024-09-19T09:29:44.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:44.785+0000 7f852c4c7640 1 -- start start 2024-09-19T09:29:44.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:44.785+0000 7f852c4c7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8524106560 0x7f8524197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:44.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:44.785+0000 7f852c4c7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f852410ab90 con 0x7f8524106560 2024-09-19T09:29:44.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:44.786+0000 7f852a263640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8524106560 0x7f8524197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:44.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:44.786+0000 7f852a263640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8524106560 0x7f8524197f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.121:55656/0 (socket says 172.21.15.121:55656) 2024-09-19T09:29:44.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:44.786+0000 7f852a263640 1 -- 172.21.15.121:0/74879673 learned_addr learned my addr 172.21.15.121:0/74879673 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-19T09:29:44.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:44.786+0000 7f852a263640 1 -- 172.21.15.121:0/74879673 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85241984c0 con 0x7f8524106560 2024-09-19T09:29:44.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:44.786+0000 7f852a263640 1 --2- 172.21.15.121:0/74879673 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8524106560 0x7f8524197f80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8520009230 tx=0x7f8520003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:44.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:44.786+0000 7f851b7fe640 1 -- 172.21.15.121:0/74879673 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f852003f070 con 0x7f8524106560 2024-09-19T09:29:44.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:44.786+0000 7f852c4c7640 1 -- 172.21.15.121:0/74879673 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8524198750 con 0x7f8524106560 2024-09-19T09:29:44.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:44.786+0000 7f851b7fe640 1 -- 172.21.15.121:0/74879673 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f852003bc80 con 0x7f8524106560 2024-09-19T09:29:44.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:44.786+0000 7f852c4c7640 1 -- 172.21.15.121:0/74879673 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8524198bb0 con 0x7f8524106560 2024-09-19T09:29:44.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:44.786+0000 7f851b7fe640 1 -- 172.21.15.121:0/74879673 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8520049060 con 0x7f8524106560 2024-09-19T09:29:44.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:44.787+0000 7f852c4c7640 1 -- 172.21.15.121:0/74879673 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8524101bd0 con 0x7f8524106560 2024-09-19T09:29:44.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:44.787+0000 7f851b7fe640 1 -- 172.21.15.121:0/74879673 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f8520042070 con 0x7f8524106560 2024-09-19T09:29:44.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:44.787+0000 7f851b7fe640 1 --2- 172.21.15.121:0/74879673 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f85100392a0 0x7f851003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:44.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:44.788+0000 7f851b7fe640 1 -- 172.21.15.121:0/74879673 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f852006d400 con 0x7f8524106560 2024-09-19T09:29:44.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:44.788+0000 7f8529a62640 1 --2- 172.21.15.121:0/74879673 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f85100392a0 0x7f851003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:44.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:44.788+0000 7f8529a62640 1 --2- 172.21.15.121:0/74879673 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f85100392a0 0x7f851003b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f85140098c0 tx=0x7f8514006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:44.795 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:44.792+0000 7f851b7fe640 1 -- 172.21.15.121:0/74879673 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8520031d60 con 0x7f8524106560 2024-09-19T09:29:45.027 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:45.025+0000 7f852c4c7640 1 -- 172.21.15.121:0/74879673 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f85241069c0 con 0x7f8524106560 2024-09-19T09:29:45.028 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:45.026+0000 7f851b7fe640 1 -- 172.21.15.121:0/74879673 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+741 (secure 0 0 0) 0x7f85200314c0 con 0x7f8524106560 2024-09-19T09:29:45.028 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-19T09:29:45.029 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":1,"fsid":"57238232-7669-11ef-bceb-c7b262605968","modified":"2024-09-19T09:28:24.634348Z","created":"2024-09-19T09:28:24.634348Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T09:29:45.029 INFO:teuthology.orchestra.run.smithi121.stderr:dumped monmap epoch 1 2024-09-19T09:29:45.030 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:45.028+0000 7f852c4c7640 1 -- 172.21.15.121:0/74879673 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f85100392a0 msgr2=0x7f851003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:45.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:45.028+0000 7f852c4c7640 1 --2- 172.21.15.121:0/74879673 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f85100392a0 0x7f851003b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f85140098c0 tx=0x7f8514006db0 comp rx=0 tx=0).stop 2024-09-19T09:29:45.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:45.028+0000 7f852c4c7640 1 -- 172.21.15.121:0/74879673 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8524106560 msgr2=0x7f8524197f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:45.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:45.028+0000 7f852c4c7640 1 --2- 172.21.15.121:0/74879673 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8524106560 0x7f8524197f80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8520009230 tx=0x7f8520003d40 comp rx=0 tx=0).stop 2024-09-19T09:29:45.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:45.028+0000 7f852c4c7640 1 -- 172.21.15.121:0/74879673 shutdown_connections 2024-09-19T09:29:45.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:45.028+0000 7f852c4c7640 1 --2- 172.21.15.121:0/74879673 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f85100392a0 0x7f851003b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:45.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:45.028+0000 7f852c4c7640 1 --2- 172.21.15.121:0/74879673 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8524106560 0x7f8524197f80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:45.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:45.028+0000 7f852c4c7640 1 -- 172.21.15.121:0/74879673 >> 172.21.15.121:0/74879673 conn(0x7f85240fc1b0 msgr2=0x7f85240fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:45.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:45.028+0000 7f852c4c7640 1 -- 172.21.15.121:0/74879673 shutdown_connections 2024-09-19T09:29:45.031 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:45.028+0000 7f852c4c7640 1 -- 172.21.15.121:0/74879673 wait complete. 2024-09-19T09:29:45.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:45 smithi001 ceph-mon[31225]: Deploying daemon mon.c on smithi121 2024-09-19T09:29:46.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:46 smithi001 ceph-mon[31225]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:29:46.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:46 smithi001 ceph-mon[31225]: from='client.? 172.21.15.121:0/74879673' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:29:46.610 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T09:29:46.611 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:29:46.857 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:29:47.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.380+0000 7f32cd9f9640 1 -- 172.21.15.121:0/4065942446 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32c8107660 msgr2=0x7f32c8107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:47.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.380+0000 7f32cd9f9640 1 --2- 172.21.15.121:0/4065942446 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32c8107660 0x7f32c8107a40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f32b8009880 tx=0x7f32b802a5d0 comp rx=0 tx=0).stop 2024-09-19T09:29:47.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.380+0000 7f32cd9f9640 1 -- 172.21.15.121:0/4065942446 shutdown_connections 2024-09-19T09:29:47.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.380+0000 7f32cd9f9640 1 --2- 172.21.15.121:0/4065942446 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32c8107660 0x7f32c8107a40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:47.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.380+0000 7f32cd9f9640 1 -- 172.21.15.121:0/4065942446 >> 172.21.15.121:0/4065942446 conn(0x7f32c80fd320 msgr2=0x7f32c80ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:47.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.380+0000 7f32cd9f9640 1 -- 172.21.15.121:0/4065942446 shutdown_connections 2024-09-19T09:29:47.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.380+0000 7f32cd9f9640 1 -- 172.21.15.121:0/4065942446 wait complete. 2024-09-19T09:29:47.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.380+0000 7f32cd9f9640 1 Processor -- start 2024-09-19T09:29:47.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.380+0000 7f32cd9f9640 1 -- start start 2024-09-19T09:29:47.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.380+0000 7f32cd9f9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32c8107660 0x7f32c80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:47.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.380+0000 7f32cd9f9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f32c810bd20 con 0x7f32c8107660 2024-09-19T09:29:47.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.380+0000 7f32c6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32c8107660 0x7f32c80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:47.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.380+0000 7f32c6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32c8107660 0x7f32c80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.121:55666/0 (socket says 172.21.15.121:55666) 2024-09-19T09:29:47.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.380+0000 7f32c6ffd640 1 -- 172.21.15.121:0/4061855609 learned_addr learned my addr 172.21.15.121:0/4061855609 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-19T09:29:47.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.381+0000 7f32c6ffd640 1 -- 172.21.15.121:0/4061855609 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c80763e0 con 0x7f32c8107660 2024-09-19T09:29:47.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.381+0000 7f32c6ffd640 1 --2- 172.21.15.121:0/4061855609 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32c8107660 0x7f32c80744f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f32b8009230 tx=0x7f32b8003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:47.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.381+0000 7f32cc9f7640 1 -- 172.21.15.121:0/4061855609 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32b803f070 con 0x7f32c8107660 2024-09-19T09:29:47.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.381+0000 7f32cd9f9640 1 -- 172.21.15.121:0/4061855609 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32c8074a90 con 0x7f32c8107660 2024-09-19T09:29:47.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.381+0000 7f32cc9f7640 1 -- 172.21.15.121:0/4061855609 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32b803bc80 con 0x7f32c8107660 2024-09-19T09:29:47.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.381+0000 7f32cc9f7640 1 -- 172.21.15.121:0/4061855609 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32b8035030 con 0x7f32c8107660 2024-09-19T09:29:47.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.381+0000 7f32cd9f9640 1 -- 172.21.15.121:0/4061855609 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32c8074f50 con 0x7f32c8107660 2024-09-19T09:29:47.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.382+0000 7f32cc9f7640 1 -- 172.21.15.121:0/4061855609 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f32b8042070 con 0x7f32c8107660 2024-09-19T09:29:47.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.382+0000 7f32cd9f9640 1 -- 172.21.15.121:0/4061855609 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32c8102da0 con 0x7f32c8107660 2024-09-19T09:29:47.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.382+0000 7f32cc9f7640 1 --2- 172.21.15.121:0/4061855609 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f32b40392a0 0x7f32b403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:47.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.382+0000 7f32cc9f7640 1 -- 172.21.15.121:0/4061855609 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f32b806d070 con 0x7f32c8107660 2024-09-19T09:29:47.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.383+0000 7f32c67fc640 1 --2- 172.21.15.121:0/4061855609 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f32b40392a0 0x7f32b403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:47.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.383+0000 7f32c67fc640 1 --2- 172.21.15.121:0/4061855609 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f32b40392a0 0x7f32b403b760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f32b00098c0 tx=0x7f32b0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:47.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.388+0000 7f32cc9f7640 1 -- 172.21.15.121:0/4061855609 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f32b8031570 con 0x7f32c8107660 2024-09-19T09:29:47.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.632+0000 7f32cd9f9640 1 -- 172.21.15.121:0/4061855609 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f32c8075a20 con 0x7f32c8107660 2024-09-19T09:29:47.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.632+0000 7f32cc9f7640 1 -- 172.21.15.121:0/4061855609 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+741 (secure 0 0 0) 0x7f32b80303a0 con 0x7f32c8107660 2024-09-19T09:29:47.635 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-19T09:29:47.635 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":1,"fsid":"57238232-7669-11ef-bceb-c7b262605968","modified":"2024-09-19T09:28:24.634348Z","created":"2024-09-19T09:28:24.634348Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T09:29:47.635 INFO:teuthology.orchestra.run.smithi121.stderr:dumped monmap epoch 1 2024-09-19T09:29:47.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.635+0000 7f32cd9f9640 1 -- 172.21.15.121:0/4061855609 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f32b40392a0 msgr2=0x7f32b403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:47.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.635+0000 7f32cd9f9640 1 --2- 172.21.15.121:0/4061855609 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f32b40392a0 0x7f32b403b760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f32b00098c0 tx=0x7f32b0006db0 comp rx=0 tx=0).stop 2024-09-19T09:29:47.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.635+0000 7f32cd9f9640 1 -- 172.21.15.121:0/4061855609 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32c8107660 msgr2=0x7f32c80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:47.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.635+0000 7f32cd9f9640 1 --2- 172.21.15.121:0/4061855609 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32c8107660 0x7f32c80744f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f32b8009230 tx=0x7f32b8003d40 comp rx=0 tx=0).stop 2024-09-19T09:29:47.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.635+0000 7f32cd9f9640 1 -- 172.21.15.121:0/4061855609 shutdown_connections 2024-09-19T09:29:47.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.635+0000 7f32cd9f9640 1 --2- 172.21.15.121:0/4061855609 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f32b40392a0 0x7f32b403b760 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:47.637 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.635+0000 7f32cd9f9640 1 --2- 172.21.15.121:0/4061855609 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32c8107660 0x7f32c80744f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:47.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.635+0000 7f32cd9f9640 1 -- 172.21.15.121:0/4061855609 >> 172.21.15.121:0/4061855609 conn(0x7f32c80fd320 msgr2=0x7f32c8105170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:47.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.635+0000 7f32cd9f9640 1 -- 172.21.15.121:0/4061855609 shutdown_connections 2024-09-19T09:29:47.638 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:47.635+0000 7f32cd9f9640 1 -- 172.21.15.121:0/4061855609 wait complete. 2024-09-19T09:29:47.920 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:47 smithi121 systemd[1]: Starting Ceph mon.c for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:29:48.299 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:48 smithi001 ceph-mon[31225]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:29:48.299 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:48 smithi001 ceph-mon[31225]: from='client.? 172.21.15.121:0/4061855609' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:29:48.497 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 podman[35558]: 2024-09-19 09:29:48.288142221 +0000 UTC m=+0.015635876 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:29:48.497 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 podman[35558]: 2024-09-19 09:29:48.395460312 +0000 UTC m=+0.122953952 container create 30f334dd4683a731baa006f076cce1cae5a321086b865e7dabbf7858a39a29f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mon-c, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4) 2024-09-19T09:29:48.758 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 podman[35558]: 2024-09-19 09:29:48.706371275 +0000 UTC m=+0.433864916 container init 30f334dd4683a731baa006f076cce1cae5a321086b865e7dabbf7858a39a29f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-19T09:29:48.758 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 podman[35558]: 2024-09-19 09:29:48.709584283 +0000 UTC m=+0.437077925 container start 30f334dd4683a731baa006f076cce1cae5a321086b865e7dabbf7858a39a29f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mon-c, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T09:29:48.758 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T09:29:48.758 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T09:29:48.758 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: pidfile_write: ignore empty --pid-file 2024-09-19T09:29:48.758 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: load: jerasure load: lrc 2024-09-19T09:29:48.758 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: RocksDB version: 7.9.2 2024-09-19T09:29:48.758 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Git sha 0 2024-09-19T09:29:48.758 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T09:29:48.758 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: DB SUMMARY 2024-09-19T09:29:48.758 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: DB Session ID: 1ENKFHIPEOGZ1YN0NGG3 2024-09-19T09:29:48.759 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: CURRENT file: CURRENT 2024-09-19T09:29:48.759 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T09:29:48.759 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-19T09:29:48.759 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-19T09:29:48.759 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-19T09:29:48.759 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.error_if_exists: 0 2024-09-19T09:29:48.759 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.create_if_missing: 0 2024-09-19T09:29:48.759 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.paranoid_checks: 1 2024-09-19T09:29:48.759 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T09:29:48.759 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T09:29:48.759 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T09:29:48.759 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.env: 0x55c2becec940 2024-09-19T09:29:48.759 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T09:29:48.759 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.info_log: 0x55c2c09036e0 2024-09-19T09:29:48.760 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T09:29:48.760 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.statistics: (nil) 2024-09-19T09:29:48.760 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.use_fsync: 0 2024-09-19T09:29:48.760 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.max_log_file_size: 0 2024-09-19T09:29:48.760 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T09:29:48.760 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T09:29:48.760 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T09:29:48.760 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T09:29:48.760 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.allow_fallocate: 1 2024-09-19T09:29:48.760 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T09:29:48.760 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T09:29:48.760 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.use_direct_reads: 0 2024-09-19T09:29:48.760 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T09:29:48.761 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T09:29:48.761 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.db_log_dir: 2024-09-19T09:29:48.761 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.wal_dir: 2024-09-19T09:29:48.761 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T09:29:48.761 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T09:29:48.761 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T09:29:48.761 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T09:29:48.761 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T09:29:48.761 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T09:29:48.761 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T09:29:48.761 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T09:29:48.761 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.write_buffer_manager: 0x55c2c0912dc0 2024-09-19T09:29:48.761 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T09:29:48.761 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T09:29:48.762 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T09:29:48.762 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T09:29:48.762 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T09:29:48.762 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T09:29:48.762 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T09:29:48.762 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T09:29:48.762 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.unordered_write: 0 2024-09-19T09:29:48.762 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T09:29:48.762 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T09:29:48.762 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T09:29:48.762 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T09:29:48.762 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.row_cache: None 2024-09-19T09:29:48.762 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.wal_filter: None 2024-09-19T09:29:48.764 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T09:29:48.764 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T09:29:48.764 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.two_write_queues: 0 2024-09-19T09:29:48.764 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T09:29:48.764 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.wal_compression: 0 2024-09-19T09:29:48.764 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.atomic_flush: 0 2024-09-19T09:29:48.764 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T09:29:48.764 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T09:29:48.764 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T09:29:48.764 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.log_readahead_size: 0 2024-09-19T09:29:48.765 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T09:29:48.765 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T09:29:48.765 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T09:29:48.765 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T09:29:48.765 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T09:29:48.765 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T09:29:48.765 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T09:29:48.765 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.max_background_jobs: 2 2024-09-19T09:29:48.765 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.max_background_compactions: -1 2024-09-19T09:29:48.765 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.max_subcompactions: 1 2024-09-19T09:29:48.765 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T09:29:48.765 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T09:29:48.765 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T09:29:48.766 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T09:29:48.766 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T09:29:48.766 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T09:29:48.766 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T09:29:48.766 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T09:29:48.766 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.max_open_files: -1 2024-09-19T09:29:48.766 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T09:29:48.766 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T09:29:48.766 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T09:29:48.766 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T09:29:48.766 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.max_background_flushes: -1 2024-09-19T09:29:48.766 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Compression algorithms supported: 2024-09-19T09:29:48.766 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: kZSTD supported: 0 2024-09-19T09:29:48.766 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: kXpressCompression supported: 0 2024-09-19T09:29:48.767 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: kBZip2Compression supported: 0 2024-09-19T09:29:48.767 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T09:29:48.767 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: kLZ4Compression supported: 1 2024-09-19T09:29:48.767 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: kZlibCompression supported: 1 2024-09-19T09:29:48.767 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T09:29:48.767 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: kSnappyCompression supported: 1 2024-09-19T09:29:48.767 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T09:29:48.767 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T09:29:48.767 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-19T09:29:48.767 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T09:29:48.767 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T09:29:48.767 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.merge_operator: 2024-09-19T09:29:48.767 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.compaction_filter: None 2024-09-19T09:29:48.767 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T09:29:48.768 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T09:29:48.768 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T09:29:48.768 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T09:29:48.768 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c2c0903320) 2024-09-19T09:29:48.768 INFO:journalctl@ceph.mon.c.smithi121.stdout: cache_index_and_filter_blocks: 1 2024-09-19T09:29:48.768 INFO:journalctl@ceph.mon.c.smithi121.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T09:29:48.768 INFO:journalctl@ceph.mon.c.smithi121.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T09:29:48.768 INFO:journalctl@ceph.mon.c.smithi121.stdout: pin_top_level_index_and_filter: 1 2024-09-19T09:29:48.768 INFO:journalctl@ceph.mon.c.smithi121.stdout: index_type: 0 2024-09-19T09:29:48.768 INFO:journalctl@ceph.mon.c.smithi121.stdout: data_block_index_type: 0 2024-09-19T09:29:48.769 INFO:journalctl@ceph.mon.c.smithi121.stdout: index_shortening: 1 2024-09-19T09:29:48.769 INFO:journalctl@ceph.mon.c.smithi121.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T09:29:48.769 INFO:journalctl@ceph.mon.c.smithi121.stdout: checksum: 4 2024-09-19T09:29:48.769 INFO:journalctl@ceph.mon.c.smithi121.stdout: no_block_cache: 0 2024-09-19T09:29:48.769 INFO:journalctl@ceph.mon.c.smithi121.stdout: block_cache: 0x55c2c08f71f0 2024-09-19T09:29:48.769 INFO:journalctl@ceph.mon.c.smithi121.stdout: block_cache_name: BinnedLRUCache 2024-09-19T09:29:48.769 INFO:journalctl@ceph.mon.c.smithi121.stdout: block_cache_options: 2024-09-19T09:29:48.769 INFO:journalctl@ceph.mon.c.smithi121.stdout: capacity : 536870912 2024-09-19T09:29:48.769 INFO:journalctl@ceph.mon.c.smithi121.stdout: num_shard_bits : 4 2024-09-19T09:29:48.769 INFO:journalctl@ceph.mon.c.smithi121.stdout: strict_capacity_limit : 0 2024-09-19T09:29:48.769 INFO:journalctl@ceph.mon.c.smithi121.stdout: high_pri_pool_ratio: 0.000 2024-09-19T09:29:48.770 INFO:journalctl@ceph.mon.c.smithi121.stdout: block_cache_compressed: (nil) 2024-09-19T09:29:48.770 INFO:journalctl@ceph.mon.c.smithi121.stdout: persistent_cache: (nil) 2024-09-19T09:29:48.770 INFO:journalctl@ceph.mon.c.smithi121.stdout: block_size: 4096 2024-09-19T09:29:48.770 INFO:journalctl@ceph.mon.c.smithi121.stdout: block_size_deviation: 10 2024-09-19T09:29:48.770 INFO:journalctl@ceph.mon.c.smithi121.stdout: block_restart_interval: 16 2024-09-19T09:29:48.770 INFO:journalctl@ceph.mon.c.smithi121.stdout: index_block_restart_interval: 1 2024-09-19T09:29:48.770 INFO:journalctl@ceph.mon.c.smithi121.stdout: metadata_block_size: 4096 2024-09-19T09:29:48.770 INFO:journalctl@ceph.mon.c.smithi121.stdout: partition_filters: 0 2024-09-19T09:29:48.770 INFO:journalctl@ceph.mon.c.smithi121.stdout: use_delta_encoding: 1 2024-09-19T09:29:48.770 INFO:journalctl@ceph.mon.c.smithi121.stdout: filter_policy: bloomfilter 2024-09-19T09:29:48.770 INFO:journalctl@ceph.mon.c.smithi121.stdout: whole_key_filtering: 1 2024-09-19T09:29:48.770 INFO:journalctl@ceph.mon.c.smithi121.stdout: verify_compression: 0 2024-09-19T09:29:48.770 INFO:journalctl@ceph.mon.c.smithi121.stdout: read_amp_bytes_per_bit: 0 2024-09-19T09:29:48.771 INFO:journalctl@ceph.mon.c.smithi121.stdout: format_version: 5 2024-09-19T09:29:48.771 INFO:journalctl@ceph.mon.c.smithi121.stdout: enable_index_compression: 1 2024-09-19T09:29:48.771 INFO:journalctl@ceph.mon.c.smithi121.stdout: block_align: 0 2024-09-19T09:29:48.771 INFO:journalctl@ceph.mon.c.smithi121.stdout: max_auto_readahead_size: 262144 2024-09-19T09:29:48.771 INFO:journalctl@ceph.mon.c.smithi121.stdout: prepopulate_block_cache: 0 2024-09-19T09:29:48.771 INFO:journalctl@ceph.mon.c.smithi121.stdout: initial_auto_readahead_size: 8192 2024-09-19T09:29:48.771 INFO:journalctl@ceph.mon.c.smithi121.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T09:29:48.771 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T09:29:48.771 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T09:29:48.771 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.compression: NoCompression 2024-09-19T09:29:48.771 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T09:29:48.771 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T09:29:48.771 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T09:29:48.771 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.num_levels: 7 2024-09-19T09:29:48.772 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T09:29:48.772 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T09:29:48.772 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T09:29:48.772 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T09:29:48.772 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T09:29:48.772 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T09:29:48.772 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T09:29:48.772 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T09:29:48.772 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T09:29:48.772 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T09:29:48.772 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T09:29:48.772 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T09:29:48.772 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T09:29:48.772 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T09:29:48.773 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T09:29:48.773 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T09:29:48.773 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T09:29:48.773 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T09:29:48.773 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T09:29:48.773 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T09:29:48.773 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T09:29:48.773 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T09:29:48.773 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T09:29:48.773 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T09:29:48.774 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T09:29:48.774 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T09:29:48.774 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T09:29:48.774 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T09:29:48.774 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T09:29:48.774 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T09:29:48.774 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T09:29:48.774 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T09:29:48.774 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T09:29:48.774 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T09:29:48.774 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T09:29:48.774 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T09:29:48.774 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T09:29:48.774 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T09:29:48.775 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T09:29:48.775 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T09:29:48.775 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T09:29:48.775 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T09:29:48.775 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T09:29:48.775 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T09:29:48.775 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T09:29:48.775 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T09:29:48.775 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T09:29:48.775 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T09:29:48.775 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T09:29:48.775 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T09:29:48.775 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T09:29:48.776 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T09:29:48.776 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T09:29:48.776 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T09:29:48.776 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.inplace_update_support: 0 2024-09-19T09:29:48.776 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T09:29:48.776 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T09:29:48.776 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T09:29:48.776 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T09:29:48.776 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.bloom_locality: 0 2024-09-19T09:29:48.776 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.max_successive_merges: 0 2024-09-19T09:29:48.776 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T09:29:48.776 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T09:29:48.776 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T09:29:48.776 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T09:29:48.776 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.ttl: 2592000 2024-09-19T09:29:48.777 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T09:29:48.777 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T09:29:48.777 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T09:29:48.777 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.enable_blob_files: false 2024-09-19T09:29:48.777 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.min_blob_size: 0 2024-09-19T09:29:48.777 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T09:29:48.777 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T09:29:48.777 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T09:29:48.777 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T09:29:48.777 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T09:29:48.778 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T09:29:48.778 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T09:29:48.778 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T09:29:48.778 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T09:29:48.778 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-19T09:29:48.778 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a8f49cd2-9364-449a-a82a-456b13dd57a5 2024-09-19T09:29:48.778 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726738188737844, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-19T09:29:48.778 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-19T09:29:48.779 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726738188738264, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726738188, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a8f49cd2-9364-449a-a82a-456b13dd57a5", "db_session_id": "1ENKFHIPEOGZ1YN0NGG3", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-19T09:29:48.779 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726738188738356, "job": 1, "event": "recovery_finished"} 2024-09-19T09:29:48.779 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-19T09:29:48.779 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T09:29:48.779 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c2c0924e00 2024-09-19T09:29:48.779 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: DB pointer 0x55c2c0a20000 2024-09-19T09:29:48.779 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T09:29:48.779 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T09:29:48.779 INFO:journalctl@ceph.mon.c.smithi121.stdout: ** DB Stats ** 2024-09-19T09:29:48.779 INFO:journalctl@ceph.mon.c.smithi121.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T09:29:48.779 INFO:journalctl@ceph.mon.c.smithi121.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T09:29:48.779 INFO:journalctl@ceph.mon.c.smithi121.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T09:29:48.780 INFO:journalctl@ceph.mon.c.smithi121.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T09:29:48.780 INFO:journalctl@ceph.mon.c.smithi121.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T09:29:48.780 INFO:journalctl@ceph.mon.c.smithi121.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T09:29:48.780 INFO:journalctl@ceph.mon.c.smithi121.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T09:29:48.780 INFO:journalctl@ceph.mon.c.smithi121.stdout: 2024-09-19T09:29:48.780 INFO:journalctl@ceph.mon.c.smithi121.stdout: ** Compaction Stats [default] ** 2024-09-19T09:29:48.780 INFO:journalctl@ceph.mon.c.smithi121.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T09:29:48.780 INFO:journalctl@ceph.mon.c.smithi121.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T09:29:48.780 INFO:journalctl@ceph.mon.c.smithi121.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T09:29:48.781 INFO:journalctl@ceph.mon.c.smithi121.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T09:29:48.781 INFO:journalctl@ceph.mon.c.smithi121.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T09:29:48.781 INFO:journalctl@ceph.mon.c.smithi121.stdout: 2024-09-19T09:29:48.781 INFO:journalctl@ceph.mon.c.smithi121.stdout: ** Compaction Stats [default] ** 2024-09-19T09:29:48.781 INFO:journalctl@ceph.mon.c.smithi121.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T09:29:48.781 INFO:journalctl@ceph.mon.c.smithi121.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T09:29:48.781 INFO:journalctl@ceph.mon.c.smithi121.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T09:29:48.781 INFO:journalctl@ceph.mon.c.smithi121.stdout: 2024-09-19T09:29:48.781 INFO:journalctl@ceph.mon.c.smithi121.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T09:29:48.781 INFO:journalctl@ceph.mon.c.smithi121.stdout: 2024-09-19T09:29:48.781 INFO:journalctl@ceph.mon.c.smithi121.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T09:29:48.781 INFO:journalctl@ceph.mon.c.smithi121.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T09:29:48.781 INFO:journalctl@ceph.mon.c.smithi121.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T09:29:48.781 INFO:journalctl@ceph.mon.c.smithi121.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T09:29:48.782 INFO:journalctl@ceph.mon.c.smithi121.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T09:29:48.782 INFO:journalctl@ceph.mon.c.smithi121.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T09:29:48.782 INFO:journalctl@ceph.mon.c.smithi121.stdout: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T09:29:48.782 INFO:journalctl@ceph.mon.c.smithi121.stdout: Interval compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T09:29:48.782 INFO:journalctl@ceph.mon.c.smithi121.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T09:29:48.782 INFO:journalctl@ceph.mon.c.smithi121.stdout: Block cache BinnedLRUCache@0x55c2c08f71f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-19T09:29:48.782 INFO:journalctl@ceph.mon.c.smithi121.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-19T09:29:48.782 INFO:journalctl@ceph.mon.c.smithi121.stdout: 2024-09-19T09:29:48.782 INFO:journalctl@ceph.mon.c.smithi121.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T09:29:48.782 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-19T09:29:48.782 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: using public_addr v2:172.21.15.121:0/0 -> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-19T09:29:48.782 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: starting mon.c rank -1 at public addrs [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] at bind addrs [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 57238232-7669-11ef-bceb-c7b262605968 2024-09-19T09:29:48.782 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: mon.c@-1(???) e0 preinit fsid 57238232-7669-11ef-bceb-c7b262605968 2024-09-19T09:29:48.783 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: mon.c@-1(synchronizing).mds e1 new map 2024-09-19T09:29:48.783 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-19T09:29:48.783 INFO:journalctl@ceph.mon.c.smithi121.stdout: e1 2024-09-19T09:29:48.783 INFO:journalctl@ceph.mon.c.smithi121.stdout: btime 2024-09-19T09:28:28:406821+0000 2024-09-19T09:29:48.783 INFO:journalctl@ceph.mon.c.smithi121.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:29:48.783 INFO:journalctl@ceph.mon.c.smithi121.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T09:29:48.783 INFO:journalctl@ceph.mon.c.smithi121.stdout: legacy client fscid: -1 2024-09-19T09:29:48.783 INFO:journalctl@ceph.mon.c.smithi121.stdout: 2024-09-19T09:29:48.783 INFO:journalctl@ceph.mon.c.smithi121.stdout: No filesystems configured 2024-09-19T09:29:48.783 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T09:29:48.783 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T09:29:48.783 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T09:29:48.783 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T09:29:48.784 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T09:29:48.784 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T09:29:48.784 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T09:29:48.784 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T09:29:48.784 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T09:29:48.784 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T09:29:48.784 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/565570412' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T09:29:48.784 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:29:48.784 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:48.784 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:48.784 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:48.784 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:48.784 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi121", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:29:48.785 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:48.785 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:29:48.785 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:29:48.785 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: Updating smithi121:/etc/ceph/ceph.conf 2024-09-19T09:29:48.785 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: Updating smithi121:/var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:29:48.785 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: Updating smithi121:/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:29:48.785 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: Updating smithi121:/var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T09:29:48.785 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi001:172.21.15.1=a;smithi022:172.21.15.22=b;smithi121:172.21.15.121=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:29:48.785 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: Saving service mon spec with placement smithi001:172.21.15.1=a;smithi022:172.21.15.22=b;smithi121:172.21.15.121=c;count:3 2024-09-19T09:29:48.785 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:48.785 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:48.785 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:48.785 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:48.785 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:29:48.786 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:48.786 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: Deploying daemon mon.c on smithi121 2024-09-19T09:29:48.786 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:29:48.786 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: from='client.? 172.21.15.121:0/74879673' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:29:48.786 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:29:48.786 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: from='client.? 172.21.15.121:0/4061855609' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:29:48.786 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 ceph-mon[35577]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T09:29:49.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 bash[35558]: 30f334dd4683a731baa006f076cce1cae5a321086b865e7dabbf7858a39a29f9 2024-09-19T09:29:49.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:48 smithi121 systemd[1]: Started Ceph mon.c for 57238232-7669-11ef-bceb-c7b262605968. 2024-09-19T09:29:49.223 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T09:29:49.223 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:29:49.474 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:29:54.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:53 smithi121 ceph-mon[35577]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:29:54.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:53 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:29:54.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:53 smithi121 ceph-mon[35577]: mon.a calling monitor election 2024-09-19T09:29:54.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:53 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:29:54.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:53 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:29:54.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:53 smithi121 ceph-mon[35577]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:29:54.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:53 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:29:54.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:53 smithi121 ceph-mon[35577]: mon.c calling monitor election 2024-09-19T09:29:54.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:53 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:29:54.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:53 smithi121 ceph-mon[35577]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:29:54.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:53 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:29:54.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:53 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:29:54.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:53 smithi121 ceph-mon[35577]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T09:29:54.119 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:53 smithi121 ceph-mon[35577]: monmap epoch 2 2024-09-19T09:29:54.119 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:53 smithi121 ceph-mon[35577]: fsid 57238232-7669-11ef-bceb-c7b262605968 2024-09-19T09:29:54.119 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:53 smithi121 ceph-mon[35577]: last_changed 2024-09-19T09:29:48.762175+0000 2024-09-19T09:29:54.119 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:53 smithi121 ceph-mon[35577]: created 2024-09-19T09:28:24.634348+0000 2024-09-19T09:29:54.119 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:53 smithi121 ceph-mon[35577]: min_mon_release 19 (squid) 2024-09-19T09:29:54.119 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:53 smithi121 ceph-mon[35577]: election_strategy: 1 2024-09-19T09:29:54.119 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:53 smithi121 ceph-mon[35577]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-19T09:29:54.119 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:53 smithi121 ceph-mon[35577]: 1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.c 2024-09-19T09:29:54.119 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:53 smithi121 ceph-mon[35577]: fsmap 2024-09-19T09:29:54.119 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:53 smithi121 ceph-mon[35577]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:29:54.119 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:53 smithi121 ceph-mon[35577]: mgrmap e13: x(active, since 39s) 2024-09-19T09:29:54.120 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:53 smithi121 ceph-mon[35577]: overall HEALTH_OK 2024-09-19T09:29:54.120 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:53 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:54.120 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:53 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:54.120 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:53 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:54.120 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:53 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:29:54.120 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:53 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:54.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:53 smithi001 ceph-mon[31225]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:29:54.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:53 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:29:54.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:53 smithi001 ceph-mon[31225]: mon.a calling monitor election 2024-09-19T09:29:54.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:53 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:29:54.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:53 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:29:54.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:53 smithi001 ceph-mon[31225]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:29:54.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:53 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:29:54.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:53 smithi001 ceph-mon[31225]: mon.c calling monitor election 2024-09-19T09:29:54.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:53 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:29:54.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:53 smithi001 ceph-mon[31225]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:29:54.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:53 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:29:54.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:53 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:29:54.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:53 smithi001 ceph-mon[31225]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T09:29:54.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:53 smithi001 ceph-mon[31225]: monmap epoch 2 2024-09-19T09:29:54.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:53 smithi001 ceph-mon[31225]: fsid 57238232-7669-11ef-bceb-c7b262605968 2024-09-19T09:29:54.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:53 smithi001 ceph-mon[31225]: last_changed 2024-09-19T09:29:48.762175+0000 2024-09-19T09:29:54.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:53 smithi001 ceph-mon[31225]: created 2024-09-19T09:28:24.634348+0000 2024-09-19T09:29:54.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:53 smithi001 ceph-mon[31225]: min_mon_release 19 (squid) 2024-09-19T09:29:54.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:53 smithi001 ceph-mon[31225]: election_strategy: 1 2024-09-19T09:29:54.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:53 smithi001 ceph-mon[31225]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-19T09:29:54.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:53 smithi001 ceph-mon[31225]: 1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.c 2024-09-19T09:29:54.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:53 smithi001 ceph-mon[31225]: fsmap 2024-09-19T09:29:54.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:53 smithi001 ceph-mon[31225]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:29:54.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:53 smithi001 ceph-mon[31225]: mgrmap e13: x(active, since 39s) 2024-09-19T09:29:54.250 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:53 smithi001 ceph-mon[31225]: overall HEALTH_OK 2024-09-19T09:29:54.250 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:53 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:54.250 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:53 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:54.250 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:53 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:29:54.250 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:53 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:29:54.250 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:53 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:29:54.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.310+0000 7f5d11e37640 1 -- 172.21.15.121:0/1225973826 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d0c106630 msgr2=0x7f5cf8005580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:54.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.310+0000 7f5d11e37640 1 --2- 172.21.15.121:0/1225973826 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d0c106630 0x7f5cf8005580 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc012c60 tx=0x7f5cfc02c620 comp rx=0 tx=0).stop 2024-09-19T09:29:54.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.310+0000 7f5d11e37640 1 -- 172.21.15.121:0/1225973826 shutdown_connections 2024-09-19T09:29:54.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.310+0000 7f5d11e37640 1 --2- 172.21.15.121:0/1225973826 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d0c106630 0x7f5cf8005580 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:54.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.310+0000 7f5d11e37640 1 -- 172.21.15.121:0/1225973826 >> 172.21.15.121:0/1225973826 conn(0x7f5d0c0fc220 msgr2=0x7f5d0c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:54.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.310+0000 7f5d11e37640 1 -- 172.21.15.121:0/1225973826 shutdown_connections 2024-09-19T09:29:54.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.310+0000 7f5d11e37640 1 -- 172.21.15.121:0/1225973826 wait complete. 2024-09-19T09:29:54.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.311+0000 7f5d11e37640 1 Processor -- start 2024-09-19T09:29:54.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.312+0000 7f5d11e37640 1 -- start start 2024-09-19T09:29:54.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.312+0000 7f5d11e37640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d0c106630 0x7f5d0c109a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:54.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.312+0000 7f5d11e37640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d0c109fc0 0x7f5d0c10a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:54.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.312+0000 7f5d11e37640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5d0c108670 con 0x7f5d0c106630 2024-09-19T09:29:54.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.312+0000 7f5d11e37640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5d0c1084f0 con 0x7f5d0c109fc0 2024-09-19T09:29:54.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.312+0000 7f5d0affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d0c109fc0 0x7f5d0c10a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:54.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.312+0000 7f5d0affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d0c109fc0 0x7f5d0c10a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:56204/0 (socket says 172.21.15.121:56204) 2024-09-19T09:29:54.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.312+0000 7f5d0affd640 1 -- 172.21.15.121:0/2189104018 learned_addr learned my addr 172.21.15.121:0/2189104018 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-19T09:29:54.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.312+0000 7f5d0b7fe640 1 --2- 172.21.15.121:0/2189104018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d0c106630 0x7f5d0c109a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:54.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.312+0000 7f5d0affd640 1 -- 172.21.15.121:0/2189104018 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d0c109fc0 msgr2=0x7f5d0c10a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T09:29:54.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.312+0000 7f5d0affd640 1 -- 172.21.15.121:0/2189104018 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d0c109fc0 msgr2=0x7f5d0c10a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:29:54.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.312+0000 7f5d0affd640 1 --2- 172.21.15.121:0/2189104018 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d0c109fc0 0x7f5d0c10a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:29:54.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.312+0000 7f5d0affd640 1 --2- 172.21.15.121:0/2189104018 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d0c109fc0 0x7f5d0c10a420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:29:54.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.313+0000 7f5d0b7fe640 1 -- 172.21.15.121:0/2189104018 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d0c109fc0 msgr2=0x7f5d0c10a420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:29:54.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.313+0000 7f5d0b7fe640 1 --2- 172.21.15.121:0/2189104018 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d0c109fc0 0x7f5d0c10a420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:54.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.313+0000 7f5d0b7fe640 1 -- 172.21.15.121:0/2189104018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d0c10b970 con 0x7f5d0c106630 2024-09-19T09:29:54.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.313+0000 7f5d0b7fe640 1 --2- 172.21.15.121:0/2189104018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d0c106630 0x7f5d0c109a80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc034000 tx=0x7f5cfc033cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:54.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.313+0000 7f5d08ff9640 1 -- 172.21.15.121:0/2189104018 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f5cfc033e50 con 0x7f5d0c106630 2024-09-19T09:29:54.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.313+0000 7f5d08ff9640 1 -- 172.21.15.121:0/2189104018 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5cfc004d70 con 0x7f5d0c106630 2024-09-19T09:29:54.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.313+0000 7f5d11e37640 1 -- 172.21.15.121:0/2189104018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d0c1a3430 con 0x7f5d0c106630 2024-09-19T09:29:54.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.313+0000 7f5d08ff9640 1 -- 172.21.15.121:0/2189104018 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f5cfc03d980 con 0x7f5d0c106630 2024-09-19T09:29:54.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.313+0000 7f5d11e37640 1 -- 172.21.15.121:0/2189104018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d0c1a39c0 con 0x7f5d0c106630 2024-09-19T09:29:54.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.314+0000 7f5d08ff9640 1 -- 172.21.15.121:0/2189104018 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f5cfc044020 con 0x7f5d0c106630 2024-09-19T09:29:54.317 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.315+0000 7f5d08ff9640 1 --2- 172.21.15.121:0/2189104018 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f5cec0391e0 0x7f5cec03b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:54.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.315+0000 7f5d11e37640 1 -- 172.21.15.121:0/2189104018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d0c101ca0 con 0x7f5d0c106630 2024-09-19T09:29:54.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.315+0000 7f5d08ff9640 1 -- 172.21.15.121:0/2189104018 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5cfc06eea0 con 0x7f5d0c106630 2024-09-19T09:29:54.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.315+0000 7f5d0affd640 1 --2- 172.21.15.121:0/2189104018 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f5cec0391e0 0x7f5cec03b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:54.318 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.316+0000 7f5d0affd640 1 --2- 172.21.15.121:0/2189104018 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f5cec0391e0 0x7f5cec03b6a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4009100 tx=0x7f5cf4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:54.321 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.320+0000 7f5d08ff9640 1 -- 172.21.15.121:0/2189104018 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5cfc04b020 con 0x7f5d0c106630 2024-09-19T09:29:54.552 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.551+0000 7f5d11e37640 1 -- 172.21.15.121:0/2189104018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f5d0c1a3c70 con 0x7f5d0c106630 2024-09-19T09:29:54.553 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.552+0000 7f5d08ff9640 1 -- 172.21.15.121:0/2189104018 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7f5cfc04b200 con 0x7f5d0c106630 2024-09-19T09:29:54.553 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-19T09:29:54.553 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":2,"fsid":"57238232-7669-11ef-bceb-c7b262605968","modified":"2024-09-19T09:29:48.762175Z","created":"2024-09-19T09:28:24.634348Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:3300","nonce":0},{"type":"v1","addr":"172.21.15.121:6789","nonce":0}]},"addr":"172.21.15.121:6789/0","public_addr":"172.21.15.121:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T09:29:54.554 INFO:teuthology.orchestra.run.smithi121.stderr:dumped monmap epoch 2 2024-09-19T09:29:54.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.554+0000 7f5d11e37640 1 -- 172.21.15.121:0/2189104018 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f5cec0391e0 msgr2=0x7f5cec03b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:54.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.554+0000 7f5d11e37640 1 --2- 172.21.15.121:0/2189104018 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f5cec0391e0 0x7f5cec03b6a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4009100 tx=0x7f5cf4008040 comp rx=0 tx=0).stop 2024-09-19T09:29:54.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.554+0000 7f5d11e37640 1 -- 172.21.15.121:0/2189104018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d0c106630 msgr2=0x7f5d0c109a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:54.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.554+0000 7f5d11e37640 1 --2- 172.21.15.121:0/2189104018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d0c106630 0x7f5d0c109a80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc034000 tx=0x7f5cfc033cb0 comp rx=0 tx=0).stop 2024-09-19T09:29:54.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.554+0000 7f5d11e37640 1 -- 172.21.15.121:0/2189104018 shutdown_connections 2024-09-19T09:29:54.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.554+0000 7f5d11e37640 1 --2- 172.21.15.121:0/2189104018 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f5cec0391e0 0x7f5cec03b6a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:54.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.554+0000 7f5d11e37640 1 --2- 172.21.15.121:0/2189104018 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d0c109fc0 0x7f5d0c10a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:54.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.554+0000 7f5d11e37640 1 --2- 172.21.15.121:0/2189104018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5d0c106630 0x7f5d0c109a80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:54.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.554+0000 7f5d11e37640 1 -- 172.21.15.121:0/2189104018 >> 172.21.15.121:0/2189104018 conn(0x7f5d0c0fc220 msgr2=0x7f5d0c0fd260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:54.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.554+0000 7f5d11e37640 1 -- 172.21.15.121:0/2189104018 shutdown_connections 2024-09-19T09:29:54.556 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:54.554+0000 7f5d11e37640 1 -- 172.21.15.121:0/2189104018 wait complete. 2024-09-19T09:29:55.113 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:54 smithi121 ceph-mon[35577]: Deploying daemon mon.b on smithi022 2024-09-19T09:29:55.113 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:54 smithi121 ceph-mon[35577]: from='client.? 172.21.15.121:0/2189104018' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:29:55.113 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:54 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:29:55.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:54 smithi001 ceph-mon[31225]: Deploying daemon mon.b on smithi022 2024-09-19T09:29:55.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:54 smithi001 ceph-mon[31225]: from='client.? 172.21.15.121:0/2189104018' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:29:55.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:54 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:29:56.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:29:55 smithi121 ceph-mon[35577]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:29:56.141 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T09:29:56.141 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:29:56.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:29:55 smithi001 ceph-mon[31225]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:29:56.391 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:29:56.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.803+0000 7f81ffc15640 1 -- 172.21.15.121:0/2085849862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81f8107670 msgr2=0x7f81f8107a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:56.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.803+0000 7f81ffc15640 1 --2- 172.21.15.121:0/2085849862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81f8107670 0x7f81f8107a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f81e8009880 tx=0x7f81e802a5d0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.803+0000 7f81ffc15640 1 -- 172.21.15.121:0/2085849862 shutdown_connections 2024-09-19T09:29:56.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.803+0000 7f81ffc15640 1 --2- 172.21.15.121:0/2085849862 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81f8107670 0x7f81f8107a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.806 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.803+0000 7f81ffc15640 1 -- 172.21.15.121:0/2085849862 >> 172.21.15.121:0/2085849862 conn(0x7f81f80fd330 msgr2=0x7f81f80ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:56.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.803+0000 7f81ffc15640 1 -- 172.21.15.121:0/2085849862 shutdown_connections 2024-09-19T09:29:56.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.803+0000 7f81ffc15640 1 -- 172.21.15.121:0/2085849862 wait complete. 2024-09-19T09:29:56.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.804+0000 7f81ffc15640 1 Processor -- start 2024-09-19T09:29:56.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.804+0000 7f81ffc15640 1 -- start start 2024-09-19T09:29:56.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.804+0000 7f81ffc15640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81f8107670 0x7f81f8197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:56.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.804+0000 7f81ffc15640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81f81979a0 0x7f81f819bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:56.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.804+0000 7f81ffc15640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f81f810bd30 con 0x7f81f8107670 2024-09-19T09:29:56.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.804+0000 7f81ffc15640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f81f810bbb0 con 0x7f81f81979a0 2024-09-19T09:29:56.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.804+0000 7f81fd1b0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81f81979a0 0x7f81f819bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:56.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.804+0000 7f81fd1b0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81f81979a0 0x7f81f819bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:56218/0 (socket says 172.21.15.121:56218) 2024-09-19T09:29:56.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.804+0000 7f81fd1b0640 1 -- 172.21.15.121:0/3703168314 learned_addr learned my addr 172.21.15.121:0/3703168314 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-19T09:29:56.807 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.805+0000 7f81fd9b1640 1 --2- 172.21.15.121:0/3703168314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81f8107670 0x7f81f8197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:56.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.805+0000 7f81fd1b0640 1 -- 172.21.15.121:0/3703168314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81f81979a0 msgr2=0x7f81f819bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T09:29:56.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.805+0000 7f81fd1b0640 1 -- 172.21.15.121:0/3703168314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81f81979a0 msgr2=0x7f81f819bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:29:56.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.805+0000 7f81fd1b0640 1 --2- 172.21.15.121:0/3703168314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81f81979a0 0x7f81f819bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:29:56.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.805+0000 7f81fd1b0640 1 --2- 172.21.15.121:0/3703168314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81f81979a0 0x7f81f819bd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:29:56.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.805+0000 7f81fd9b1640 1 -- 172.21.15.121:0/3703168314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81f81979a0 msgr2=0x7f81f819bd30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:29:56.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.805+0000 7f81fd9b1640 1 --2- 172.21.15.121:0/3703168314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81f81979a0 0x7f81f819bd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:56.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.805+0000 7f81fd9b1640 1 -- 172.21.15.121:0/3703168314 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f8197fc0 con 0x7f81f8107670 2024-09-19T09:29:56.808 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.805+0000 7f81fd9b1640 1 --2- 172.21.15.121:0/3703168314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81f8107670 0x7f81f8197460 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f81e8005ab0 tx=0x7f81e8032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:56.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.805+0000 7f81eeffd640 1 -- 172.21.15.121:0/3703168314 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f81e8035070 con 0x7f81f8107670 2024-09-19T09:29:56.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.805+0000 7f81ffc15640 1 -- 172.21.15.121:0/3703168314 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81f819c270 con 0x7f81f8107670 2024-09-19T09:29:56.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.805+0000 7f81eeffd640 1 -- 172.21.15.121:0/3703168314 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81e8032e40 con 0x7f81f8107670 2024-09-19T09:29:56.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.805+0000 7f81eeffd640 1 -- 172.21.15.121:0/3703168314 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f81e803bc10 con 0x7f81f8107670 2024-09-19T09:29:56.809 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.805+0000 7f81ffc15640 1 -- 172.21.15.121:0/3703168314 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81f819c7b0 con 0x7f81f8107670 2024-09-19T09:29:56.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.806+0000 7f81eeffd640 1 -- 172.21.15.121:0/3703168314 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7f81e8042030 con 0x7f81f8107670 2024-09-19T09:29:56.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.806+0000 7f81ffc15640 1 -- 172.21.15.121:0/3703168314 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81f8102db0 con 0x7f81f8107670 2024-09-19T09:29:56.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.806+0000 7f81eeffd640 1 --2- 172.21.15.121:0/3703168314 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f81e4039040 0x7f81e403b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:29:56.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.806+0000 7f81eeffd640 1 -- 172.21.15.121:0/3703168314 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f81e8040070 con 0x7f81f8107670 2024-09-19T09:29:56.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.807+0000 7f81fd1b0640 1 --2- 172.21.15.121:0/3703168314 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f81e4039040 0x7f81e403b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:29:56.810 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.807+0000 7f81fd1b0640 1 --2- 172.21.15.121:0/3703168314 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f81e4039040 0x7f81e403b500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f81f4009100 tx=0x7f81f4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:29:56.813 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:56.812+0000 7f81eeffd640 1 -- 172.21.15.121:0/3703168314 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f81e803b510 con 0x7f81f8107670 2024-09-19T09:29:57.041 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:57.040+0000 7f81ffc15640 1 -- 172.21.15.121:0/3703168314 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f81f819cb20 con 0x7f81f8107670 2024-09-19T09:29:57.042 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:57.041+0000 7f81eeffd640 1 -- 172.21.15.121:0/3703168314 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1011 (secure 0 0 0) 0x7f81e80433c0 con 0x7f81f8107670 2024-09-19T09:29:57.042 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-19T09:29:57.042 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":2,"fsid":"57238232-7669-11ef-bceb-c7b262605968","modified":"2024-09-19T09:29:48.762175Z","created":"2024-09-19T09:28:24.634348Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:3300","nonce":0},{"type":"v1","addr":"172.21.15.121:6789","nonce":0}]},"addr":"172.21.15.121:6789/0","public_addr":"172.21.15.121:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T09:29:57.042 INFO:teuthology.orchestra.run.smithi121.stderr:dumped monmap epoch 2 2024-09-19T09:29:57.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:57.043+0000 7f81ffc15640 1 -- 172.21.15.121:0/3703168314 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f81e4039040 msgr2=0x7f81e403b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:57.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:57.043+0000 7f81ffc15640 1 --2- 172.21.15.121:0/3703168314 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f81e4039040 0x7f81e403b500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f81f4009100 tx=0x7f81f4008040 comp rx=0 tx=0).stop 2024-09-19T09:29:57.044 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:57.043+0000 7f81ffc15640 1 -- 172.21.15.121:0/3703168314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81f8107670 msgr2=0x7f81f8197460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:29:57.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:57.043+0000 7f81ffc15640 1 --2- 172.21.15.121:0/3703168314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81f8107670 0x7f81f8197460 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f81e8005ab0 tx=0x7f81e8032c50 comp rx=0 tx=0).stop 2024-09-19T09:29:57.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:57.043+0000 7f81ffc15640 1 -- 172.21.15.121:0/3703168314 shutdown_connections 2024-09-19T09:29:57.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:57.043+0000 7f81ffc15640 1 --2- 172.21.15.121:0/3703168314 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f81e4039040 0x7f81e403b500 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:57.043+0000 7f81ffc15640 1 --2- 172.21.15.121:0/3703168314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81f81979a0 0x7f81f819bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:57.043+0000 7f81ffc15640 1 --2- 172.21.15.121:0/3703168314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81f8107670 0x7f81f8197460 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:29:57.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:57.043+0000 7f81ffc15640 1 -- 172.21.15.121:0/3703168314 >> 172.21.15.121:0/3703168314 conn(0x7f81f80fd330 msgr2=0x7f81f80fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:29:57.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:57.043+0000 7f81ffc15640 1 -- 172.21.15.121:0/3703168314 shutdown_connections 2024-09-19T09:29:57.045 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:29:57.043+0000 7f81ffc15640 1 -- 172.21.15.121:0/3703168314 wait complete. 2024-09-19T09:29:57.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:29:57 smithi022 systemd[1]: Started Ceph mon.b for 57238232-7669-11ef-bceb-c7b262605968. 2024-09-19T09:29:58.607 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T09:29:58.608 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T09:29:58.857 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:30:02.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.460+0000 7fb573a2f640 1 -- 172.21.15.121:0/3899420469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb558003530 msgr2=0x7fb5580059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:02.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.460+0000 7fb573a2f640 1 --2- 172.21.15.121:0/3899420469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb558003530 0x7fb5580059c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb56c1016a0 tx=0x7fb56802c150 comp rx=0 tx=0).stop 2024-09-19T09:30:02.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.460+0000 7fb573a2f640 1 -- 172.21.15.121:0/3899420469 shutdown_connections 2024-09-19T09:30:02.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.460+0000 7fb573a2f640 1 --2- 172.21.15.121:0/3899420469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb558003530 0x7fb5580059c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:02.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.460+0000 7fb573a2f640 1 -- 172.21.15.121:0/3899420469 >> 172.21.15.121:0/3899420469 conn(0x7fb56c0fc220 msgr2=0x7fb56c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:02.463 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.461+0000 7fb573a2f640 1 -- 172.21.15.121:0/3899420469 shutdown_connections 2024-09-19T09:30:02.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.461+0000 7fb573a2f640 1 -- 172.21.15.121:0/3899420469 wait complete. 2024-09-19T09:30:02.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.462+0000 7fb573a2f640 1 Processor -- start 2024-09-19T09:30:02.464 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.462+0000 7fb573a2f640 1 -- start start 2024-09-19T09:30:02.466 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.462+0000 7fb573a2f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb558003530 0x7fb56c1021f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:02.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.462+0000 7fb573a2f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb56c102730 0x7fb56c102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:02.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.462+0000 7fb573a2f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb56c1a3530 0x7fb56c1a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:02.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.462+0000 7fb573a2f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb56c108660 con 0x7fb558003530 2024-09-19T09:30:02.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.462+0000 7fb573a2f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb56c1084e0 con 0x7fb56c1a3530 2024-09-19T09:30:02.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.462+0000 7fb573a2f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb56c1087e0 con 0x7fb56c102730 2024-09-19T09:30:02.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.462+0000 7fb570fca640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb56c102730 0x7fb56c102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:02.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.462+0000 7fb570fca640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb56c102730 0x7fb56c102b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41184/0 (socket says 172.21.15.121:41184) 2024-09-19T09:30:02.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.462+0000 7fb570fca640 1 -- 172.21.15.121:0/1686609418 learned_addr learned my addr 172.21.15.121:0/1686609418 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-19T09:30:02.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.462+0000 7fb5717cb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb558003530 0x7fb56c1021f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:02.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.462+0000 7fb571fcc640 1 --2- 172.21.15.121:0/1686609418 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb56c1a3530 0x7fb56c1a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:02.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.462+0000 7fb570fca640 1 -- 172.21.15.121:0/1686609418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb56c102730 msgr2=0x7fb56c102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T09:30:02.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.462+0000 7fb570fca640 1 -- 172.21.15.121:0/1686609418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb56c102730 msgr2=0x7fb56c102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:30:02.467 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.462+0000 7fb570fca640 1 --2- 172.21.15.121:0/1686609418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb56c102730 0x7fb56c102b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:30:02.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.463+0000 7fb570fca640 1 --2- 172.21.15.121:0/1686609418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb56c102730 0x7fb56c102b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:30:02.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.463+0000 7fb571fcc640 1 -- 172.21.15.121:0/1686609418 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb56c1a3530 msgr2=0x7fb56c1a5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-19T09:30:02.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.463+0000 7fb571fcc640 1 -- 172.21.15.121:0/1686609418 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb56c1a3530 msgr2=0x7fb56c1a5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T09:30:02.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.463+0000 7fb571fcc640 1 --2- 172.21.15.121:0/1686609418 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb56c1a3530 0x7fb56c1a5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:30:02.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.463+0000 7fb571fcc640 1 --2- 172.21.15.121:0/1686609418 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb56c1a3530 0x7fb56c1a5920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:30:02.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.463+0000 7fb5717cb640 1 -- 172.21.15.121:0/1686609418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb56c102730 msgr2=0x7fb56c102b90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:30:02.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.463+0000 7fb5717cb640 1 --2- 172.21.15.121:0/1686609418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb56c102730 0x7fb56c102b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:02.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.463+0000 7fb5717cb640 1 -- 172.21.15.121:0/1686609418 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb56c1a3530 msgr2=0x7fb56c1a5920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:30:02.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.463+0000 7fb5717cb640 1 --2- 172.21.15.121:0/1686609418 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb56c1a3530 0x7fb56c1a5920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:02.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.463+0000 7fb5717cb640 1 -- 172.21.15.121:0/1686609418 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb56c1a5ff0 con 0x7fb558003530 2024-09-19T09:30:02.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.463+0000 7fb5717cb640 1 --2- 172.21.15.121:0/1686609418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb558003530 0x7fb56c1021f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb568036000 tx=0x7fb56802cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:02.468 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.463+0000 7fb5627fc640 1 -- 172.21.15.121:0/1686609418 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb568032040 con 0x7fb558003530 2024-09-19T09:30:02.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.463+0000 7fb5627fc640 1 -- 172.21.15.121:0/1686609418 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb568043070 con 0x7fb558003530 2024-09-19T09:30:02.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.463+0000 7fb5627fc640 1 -- 172.21.15.121:0/1686609418 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56803e420 con 0x7fb558003530 2024-09-19T09:30:02.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.463+0000 7fb573a2f640 1 -- 172.21.15.121:0/1686609418 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb56c1a6280 con 0x7fb558003530 2024-09-19T09:30:02.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.464+0000 7fb573a2f640 1 -- 172.21.15.121:0/1686609418 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb56c1a6770 con 0x7fb558003530 2024-09-19T09:30:02.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.465+0000 7fb5627fc640 1 -- 172.21.15.121:0/1686609418 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fb5680359b0 con 0x7fb558003530 2024-09-19T09:30:02.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.465+0000 7fb573a2f640 1 -- 172.21.15.121:0/1686609418 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb56c109750 con 0x7fb558003530 2024-09-19T09:30:02.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.465+0000 7fb5627fc640 1 --2- 172.21.15.121:0/1686609418 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb550039730 0x7fb55003bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:02.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.465+0000 7fb5627fc640 1 -- 172.21.15.121:0/1686609418 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb56806e020 con 0x7fb558003530 2024-09-19T09:30:02.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.465+0000 7fb570fca640 1 --2- 172.21.15.121:0/1686609418 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb550039730 0x7fb55003bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:02.469 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.466+0000 7fb570fca640 1 --2- 172.21.15.121:0/1686609418 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb550039730 0x7fb55003bbf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb55c009100 tx=0x7fb55c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:02.472 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.470+0000 7fb5627fc640 1 -- 172.21.15.121:0/1686609418 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb56804d200 con 0x7fb558003530 2024-09-19T09:30:02.724 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.723+0000 7fb573a2f640 1 -- 172.21.15.121:0/1686609418 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fb56c1a6a00 con 0x7fb558003530 2024-09-19T09:30:02.725 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:02 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:30:02.725 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:02 smithi121 ceph-mon[35577]: mon.a calling monitor election 2024-09-19T09:30:02.725 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:02 smithi121 ceph-mon[35577]: mon.c calling monitor election 2024-09-19T09:30:02.725 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:02 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:30:02.725 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:02 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:30:02.725 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:02 smithi121 ceph-mon[35577]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:02.725 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:02 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:30:02.725 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:02 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:30:02.725 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:02 smithi121 ceph-mon[35577]: mon.b calling monitor election 2024-09-19T09:30:02.726 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:02 smithi121 ceph-mon[35577]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:02.726 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:02 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:30:02.726 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:02 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:30:02.726 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:02 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:30:02.726 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:02 smithi121 ceph-mon[35577]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T09:30:02.726 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:02 smithi121 ceph-mon[35577]: monmap epoch 3 2024-09-19T09:30:02.726 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:02 smithi121 ceph-mon[35577]: fsid 57238232-7669-11ef-bceb-c7b262605968 2024-09-19T09:30:02.726 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:02 smithi121 ceph-mon[35577]: last_changed 2024-09-19T09:29:57.435643+0000 2024-09-19T09:30:02.726 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:02 smithi121 ceph-mon[35577]: created 2024-09-19T09:28:24.634348+0000 2024-09-19T09:30:02.726 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:02 smithi121 ceph-mon[35577]: min_mon_release 19 (squid) 2024-09-19T09:30:02.726 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:02 smithi121 ceph-mon[35577]: election_strategy: 1 2024-09-19T09:30:02.726 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:02 smithi121 ceph-mon[35577]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-19T09:30:02.727 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:02 smithi121 ceph-mon[35577]: 1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.c 2024-09-19T09:30:02.727 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:02 smithi121 ceph-mon[35577]: 2: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.b 2024-09-19T09:30:02.727 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:02 smithi121 ceph-mon[35577]: fsmap 2024-09-19T09:30:02.727 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:02 smithi121 ceph-mon[35577]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:30:02.727 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:02 smithi121 ceph-mon[35577]: mgrmap e13: x(active, since 48s) 2024-09-19T09:30:02.727 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:02 smithi121 ceph-mon[35577]: overall HEALTH_OK 2024-09-19T09:30:02.727 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:02 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:02.727 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:02 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:02.727 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:02 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:02.727 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:02 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:02.728 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.724+0000 7fb5627fc640 1 -- 172.21.15.121:0/1686609418 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1277 (secure 0 0 0) 0x7fb568004ba0 con 0x7fb558003530 2024-09-19T09:30:02.728 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-19T09:30:02.728 INFO:teuthology.orchestra.run.smithi121.stdout:{"epoch":3,"fsid":"57238232-7669-11ef-bceb-c7b262605968","modified":"2024-09-19T09:29:57.435643Z","created":"2024-09-19T09:28:24.634348Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:3300","nonce":0},{"type":"v1","addr":"172.21.15.1:6789","nonce":0}]},"addr":"172.21.15.1:6789/0","public_addr":"172.21.15.1:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:3300","nonce":0},{"type":"v1","addr":"172.21.15.121:6789","nonce":0}]},"addr":"172.21.15.121:6789/0","public_addr":"172.21.15.121:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:3300","nonce":0},{"type":"v1","addr":"172.21.15.22:6789","nonce":0}]},"addr":"172.21.15.22:6789/0","public_addr":"172.21.15.22:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-19T09:30:02.729 INFO:teuthology.orchestra.run.smithi121.stderr:dumped monmap epoch 3 2024-09-19T09:30:02.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.726+0000 7fb573a2f640 1 -- 172.21.15.121:0/1686609418 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb550039730 msgr2=0x7fb55003bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:02.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.726+0000 7fb573a2f640 1 --2- 172.21.15.121:0/1686609418 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb550039730 0x7fb55003bbf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb55c009100 tx=0x7fb55c008040 comp rx=0 tx=0).stop 2024-09-19T09:30:02.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.726+0000 7fb573a2f640 1 -- 172.21.15.121:0/1686609418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb558003530 msgr2=0x7fb56c1021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:02.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.726+0000 7fb573a2f640 1 --2- 172.21.15.121:0/1686609418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb558003530 0x7fb56c1021f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb568036000 tx=0x7fb56802cef0 comp rx=0 tx=0).stop 2024-09-19T09:30:02.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.726+0000 7fb573a2f640 1 -- 172.21.15.121:0/1686609418 shutdown_connections 2024-09-19T09:30:02.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.726+0000 7fb573a2f640 1 --2- 172.21.15.121:0/1686609418 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb550039730 0x7fb55003bbf0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:02.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.726+0000 7fb573a2f640 1 --2- 172.21.15.121:0/1686609418 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb56c1a3530 0x7fb56c1a5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:02.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.726+0000 7fb573a2f640 1 --2- 172.21.15.121:0/1686609418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb56c102730 0x7fb56c102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:02.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.726+0000 7fb573a2f640 1 --2- 172.21.15.121:0/1686609418 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb558003530 0x7fb56c1021f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:02.729 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.726+0000 7fb573a2f640 1 -- 172.21.15.121:0/1686609418 >> 172.21.15.121:0/1686609418 conn(0x7fb56c0fc220 msgr2=0x7fb56c1058f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:02.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.726+0000 7fb573a2f640 1 -- 172.21.15.121:0/1686609418 shutdown_connections 2024-09-19T09:30:02.730 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:02.726+0000 7fb573a2f640 1 -- 172.21.15.121:0/1686609418 wait complete. 2024-09-19T09:30:02.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:02 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:30:02.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:02 smithi022 ceph-mon[35583]: mon.a calling monitor election 2024-09-19T09:30:02.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:02 smithi022 ceph-mon[35583]: mon.c calling monitor election 2024-09-19T09:30:02.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:02 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:30:02.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:02 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:30:02.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:02 smithi022 ceph-mon[35583]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:02.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:02 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:30:02.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:02 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:30:02.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:02 smithi022 ceph-mon[35583]: mon.b calling monitor election 2024-09-19T09:30:02.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:02 smithi022 ceph-mon[35583]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:02.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:02 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:30:02.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:02 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:30:02.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:02 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:30:02.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:02 smithi022 ceph-mon[35583]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T09:30:02.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:02 smithi022 ceph-mon[35583]: monmap epoch 3 2024-09-19T09:30:02.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:02 smithi022 ceph-mon[35583]: fsid 57238232-7669-11ef-bceb-c7b262605968 2024-09-19T09:30:02.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:02 smithi022 ceph-mon[35583]: last_changed 2024-09-19T09:29:57.435643+0000 2024-09-19T09:30:02.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:02 smithi022 ceph-mon[35583]: created 2024-09-19T09:28:24.634348+0000 2024-09-19T09:30:02.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:02 smithi022 ceph-mon[35583]: min_mon_release 19 (squid) 2024-09-19T09:30:02.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:02 smithi022 ceph-mon[35583]: election_strategy: 1 2024-09-19T09:30:02.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:02 smithi022 ceph-mon[35583]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-19T09:30:02.866 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:02 smithi022 ceph-mon[35583]: 1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.c 2024-09-19T09:30:02.866 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:02 smithi022 ceph-mon[35583]: 2: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.b 2024-09-19T09:30:02.866 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:02 smithi022 ceph-mon[35583]: fsmap 2024-09-19T09:30:02.866 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:02 smithi022 ceph-mon[35583]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:30:02.866 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:02 smithi022 ceph-mon[35583]: mgrmap e13: x(active, since 48s) 2024-09-19T09:30:02.866 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:02 smithi022 ceph-mon[35583]: overall HEALTH_OK 2024-09-19T09:30:02.866 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:02 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:02.866 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:02 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:02.866 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:02 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:02.866 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:02 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:02.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:02 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:30:02.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:02 smithi001 ceph-mon[31225]: mon.a calling monitor election 2024-09-19T09:30:02.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:02 smithi001 ceph-mon[31225]: mon.c calling monitor election 2024-09-19T09:30:02.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:02 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:30:02.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:02 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:30:02.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:02 smithi001 ceph-mon[31225]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:02.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:02 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:30:02.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:02 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:30:02.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:02 smithi001 ceph-mon[31225]: mon.b calling monitor election 2024-09-19T09:30:02.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:02 smithi001 ceph-mon[31225]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:02.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:02 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:30:02.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:02 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:30:02.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:02 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:30:02.999 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:02 smithi001 ceph-mon[31225]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T09:30:02.999 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:02 smithi001 ceph-mon[31225]: monmap epoch 3 2024-09-19T09:30:02.999 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:02 smithi001 ceph-mon[31225]: fsid 57238232-7669-11ef-bceb-c7b262605968 2024-09-19T09:30:02.999 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:02 smithi001 ceph-mon[31225]: last_changed 2024-09-19T09:29:57.435643+0000 2024-09-19T09:30:02.999 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:02 smithi001 ceph-mon[31225]: created 2024-09-19T09:28:24.634348+0000 2024-09-19T09:30:02.999 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:02 smithi001 ceph-mon[31225]: min_mon_release 19 (squid) 2024-09-19T09:30:02.999 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:02 smithi001 ceph-mon[31225]: election_strategy: 1 2024-09-19T09:30:02.999 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:02 smithi001 ceph-mon[31225]: 0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-09-19T09:30:02.999 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:02 smithi001 ceph-mon[31225]: 1: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.c 2024-09-19T09:30:02.999 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:02 smithi001 ceph-mon[31225]: 2: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.b 2024-09-19T09:30:02.999 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:02 smithi001 ceph-mon[31225]: fsmap 2024-09-19T09:30:02.999 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:02 smithi001 ceph-mon[31225]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T09:30:02.999 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:02 smithi001 ceph-mon[31225]: mgrmap e13: x(active, since 48s) 2024-09-19T09:30:02.999 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:02 smithi001 ceph-mon[31225]: overall HEALTH_OK 2024-09-19T09:30:03.000 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:02 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:03.000 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:02 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:03.000 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:02 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:03.000 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:02 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:03.276 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-19T09:30:03.277 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-19T09:30:03.543 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:30:03.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:03 smithi022 ceph-mon[35583]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:03.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:03 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:03.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:03 smithi022 ceph-mon[35583]: from='client.? 172.21.15.121:0/1686609418' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:30:03.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:03 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:30:03.664 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:03 smithi001 ceph-mon[31225]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:03.664 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:03 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:03.665 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:03 smithi001 ceph-mon[31225]: from='client.? 172.21.15.121:0/1686609418' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:30:03.665 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:03 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:30:03.760 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:03 smithi121 ceph-mon[35577]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:03.760 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:03 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:03.760 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:03 smithi121 ceph-mon[35577]: from='client.? 172.21.15.121:0/1686609418' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T09:30:03.760 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:03 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:30:03.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.987+0000 7fbcd0493640 1 -- 172.21.15.1:0/891738648 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbcc8102790 msgr2=0x7fbcc8102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:03.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.987+0000 7fbcd0493640 1 --2- 172.21.15.1:0/891738648 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbcc8102790 0x7fbcc8102b70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4009810 tx=0x7fbcc402a540 comp rx=0 tx=0).stop 2024-09-19T09:30:03.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.988+0000 7fbcd0493640 1 -- 172.21.15.1:0/891738648 shutdown_connections 2024-09-19T09:30:03.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.988+0000 7fbcd0493640 1 --2- 172.21.15.1:0/891738648 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbcc8102790 0x7fbcc8102b70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.988+0000 7fbcd0493640 1 -- 172.21.15.1:0/891738648 >> 172.21.15.1:0/891738648 conn(0x7fbcc8077310 msgr2=0x7fbcc80fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:03.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.988+0000 7fbcd0493640 1 -- 172.21.15.1:0/891738648 shutdown_connections 2024-09-19T09:30:03.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.988+0000 7fbcd0493640 1 -- 172.21.15.1:0/891738648 wait complete. 2024-09-19T09:30:03.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.988+0000 7fbcd0493640 1 Processor -- start 2024-09-19T09:30:03.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.988+0000 7fbcd0493640 1 -- start start 2024-09-19T09:30:03.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.989+0000 7fbcd0493640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcc8102790 0x7fbcc81003f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:03.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.989+0000 7fbcd0493640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc8100930 0x7fbcc8100d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:03.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.989+0000 7fbcd0493640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbcc81a3540 0x7fbcc81a5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:03.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.989+0000 7fbcd0493640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc810bc30 con 0x7fbcc81a3540 2024-09-19T09:30:03.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.989+0000 7fbcd0493640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc810bab0 con 0x7fbcc8102790 2024-09-19T09:30:03.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.989+0000 7fbcd0493640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbcc810bdb0 con 0x7fbcc8100930 2024-09-19T09:30:03.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.989+0000 7fbccea30640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbcc81a3540 0x7fbcc81a5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:03.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.989+0000 7fbccea30640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbcc81a3540 0x7fbcc81a5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46876/0 (socket says 172.21.15.1:46876) 2024-09-19T09:30:03.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.989+0000 7fbccea30640 1 -- 172.21.15.1:0/4129800744 learned_addr learned my addr 172.21.15.1:0/4129800744 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:30:03.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.989+0000 7fbcce22f640 1 --2- 172.21.15.1:0/4129800744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcc8102790 0x7fbcc81003f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:03.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.989+0000 7fbccda2e640 1 --2- 172.21.15.1:0/4129800744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc8100930 0x7fbcc8100d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:03.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.989+0000 7fbccea30640 1 -- 172.21.15.1:0/4129800744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc8100930 msgr2=0x7fbcc8100d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:03.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.989+0000 7fbccea30640 1 --2- 172.21.15.1:0/4129800744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc8100930 0x7fbcc8100d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.989+0000 7fbccea30640 1 -- 172.21.15.1:0/4129800744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcc8102790 msgr2=0x7fbcc81003f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:03.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.989+0000 7fbccea30640 1 --2- 172.21.15.1:0/4129800744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcc8102790 0x7fbcc81003f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:03.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.989+0000 7fbccea30640 1 -- 172.21.15.1:0/4129800744 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc81a6000 con 0x7fbcc81a3540 2024-09-19T09:30:03.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.990+0000 7fbccea30640 1 --2- 172.21.15.1:0/4129800744 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbcc81a3540 0x7fbcc81a5930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbcc000ba50 tx=0x7fbcc000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:03.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.990+0000 7fbcbb7fe640 1 -- 172.21.15.1:0/4129800744 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc0019070 con 0x7fbcc81a3540 2024-09-19T09:30:03.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.990+0000 7fbcbb7fe640 1 -- 172.21.15.1:0/4129800744 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbcc000cbe0 con 0x7fbcc81a3540 2024-09-19T09:30:03.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.990+0000 7fbcd0493640 1 -- 172.21.15.1:0/4129800744 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc81a62f0 con 0x7fbcc81a3540 2024-09-19T09:30:03.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.990+0000 7fbcbb7fe640 1 -- 172.21.15.1:0/4129800744 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc00076a0 con 0x7fbcc81a3540 2024-09-19T09:30:03.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.990+0000 7fbcd0493640 1 -- 172.21.15.1:0/4129800744 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcc81a6830 con 0x7fbcc81a3540 2024-09-19T09:30:03.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.991+0000 7fbcbb7fe640 1 -- 172.21.15.1:0/4129800744 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fbcc001c070 con 0x7fbcc81a3540 2024-09-19T09:30:03.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.991+0000 7fbcbb7fe640 1 --2- 172.21.15.1:0/4129800744 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbcb4039730 0x7fbcb403bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:03.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.991+0000 7fbcbb7fe640 1 -- 172.21.15.1:0/4129800744 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbcc004bd40 con 0x7fbcc81a3540 2024-09-19T09:30:03.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.991+0000 7fbcce22f640 1 --2- 172.21.15.1:0/4129800744 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbcb4039730 0x7fbcb403bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:03.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.991+0000 7fbcd0493640 1 -- 172.21.15.1:0/4129800744 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcc8069f30 con 0x7fbcc81a3540 2024-09-19T09:30:03.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.992+0000 7fbcce22f640 1 --2- 172.21.15.1:0/4129800744 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbcb4039730 0x7fbcb403bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40097e0 tx=0x7fbcc4005870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:03.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:03.996+0000 7fbcbb7fe640 1 -- 172.21.15.1:0/4129800744 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbcc000e0a0 con 0x7fbcc81a3540 2024-09-19T09:30:04.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:04.177+0000 7fbcd0493640 1 -- 172.21.15.1:0/4129800744 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fbcc81a6af0 con 0x7fbcc81a3540 2024-09-19T09:30:04.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:04.178+0000 7fbcbb7fe640 1 -- 172.21.15.1:0/4129800744 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+271 (secure 0 0 0) 0x7fbcc00112a0 con 0x7fbcc81a3540 2024-09-19T09:30:04.179 INFO:teuthology.orchestra.run.smithi001.stdout:# minimal ceph.conf for 57238232-7669-11ef-bceb-c7b262605968 2024-09-19T09:30:04.179 INFO:teuthology.orchestra.run.smithi001.stdout:[global] 2024-09-19T09:30:04.179 INFO:teuthology.orchestra.run.smithi001.stdout: fsid = 57238232-7669-11ef-bceb-c7b262605968 2024-09-19T09:30:04.179 INFO:teuthology.orchestra.run.smithi001.stdout: mon_host = [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] 2024-09-19T09:30:04.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:04.180+0000 7fbcd0493640 1 -- 172.21.15.1:0/4129800744 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbcb4039730 msgr2=0x7fbcb403bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:04.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:04.180+0000 7fbcd0493640 1 --2- 172.21.15.1:0/4129800744 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbcb4039730 0x7fbcb403bbf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40097e0 tx=0x7fbcc4005870 comp rx=0 tx=0).stop 2024-09-19T09:30:04.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:04.180+0000 7fbcd0493640 1 -- 172.21.15.1:0/4129800744 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbcc81a3540 msgr2=0x7fbcc81a5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:04.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:04.180+0000 7fbcd0493640 1 --2- 172.21.15.1:0/4129800744 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbcc81a3540 0x7fbcc81a5930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbcc000ba50 tx=0x7fbcc000bf10 comp rx=0 tx=0).stop 2024-09-19T09:30:04.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:04.180+0000 7fbcd0493640 1 -- 172.21.15.1:0/4129800744 shutdown_connections 2024-09-19T09:30:04.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:04.180+0000 7fbcd0493640 1 --2- 172.21.15.1:0/4129800744 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbcc81a3540 0x7fbcc81a5930 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:04.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:04.180+0000 7fbcd0493640 1 --2- 172.21.15.1:0/4129800744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcc8100930 0x7fbcc8100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:04.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:04.180+0000 7fbcd0493640 1 --2- 172.21.15.1:0/4129800744 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbcb4039730 0x7fbcb403bbf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:04.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:04.180+0000 7fbcd0493640 1 --2- 172.21.15.1:0/4129800744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbcc8102790 0x7fbcc81003f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:04.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:04.180+0000 7fbcd0493640 1 -- 172.21.15.1:0/4129800744 >> 172.21.15.1:0/4129800744 conn(0x7fbcc8077310 msgr2=0x7fbcc8103650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:04.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:04.180+0000 7fbcd0493640 1 -- 172.21.15.1:0/4129800744 shutdown_connections 2024-09-19T09:30:04.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:04.180+0000 7fbcd0493640 1 -- 172.21.15.1:0/4129800744 wait complete. 2024-09-19T09:30:04.945 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:04 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:04.945 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:04 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:04.945 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:04 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:04.945 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:04 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:04.945 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:04 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:04.945 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:04 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:04.946 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:04 smithi001 ceph-mon[31225]: Updating smithi001:/etc/ceph/ceph.conf 2024-09-19T09:30:04.946 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:04 smithi001 ceph-mon[31225]: Updating smithi022:/etc/ceph/ceph.conf 2024-09-19T09:30:04.946 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:04 smithi001 ceph-mon[31225]: Updating smithi121:/etc/ceph/ceph.conf 2024-09-19T09:30:04.946 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:04 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:04.946 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:04 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/4129800744' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:04.946 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:04 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:04.946 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:04 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:04.946 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:04 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:04.946 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:04 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:04.946 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:04 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:04.946 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:04 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:04.946 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:04 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:04.946 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:04 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:04.946 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:04 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:04.946 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:04 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:04.947 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:04 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:04.947 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:04 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:30:04.947 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:04 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:30:04.947 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:04 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:04.980 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-19T09:30:04.981 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T09:30:04.981 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T09:30:05.014 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T09:30:05.014 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:30:05.080 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-19T09:30:05.080 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T09:30:05.104 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:04 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.104 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:04 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.104 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:04 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.105 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:04 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.105 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:04 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:05.105 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:04 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:05.105 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:04 smithi022 ceph-mon[35583]: Updating smithi001:/etc/ceph/ceph.conf 2024-09-19T09:30:05.105 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:04 smithi022 ceph-mon[35583]: Updating smithi022:/etc/ceph/ceph.conf 2024-09-19T09:30:05.105 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:04 smithi022 ceph-mon[35583]: Updating smithi121:/etc/ceph/ceph.conf 2024-09-19T09:30:05.105 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:04 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.105 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:04 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/4129800744' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:05.105 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:04 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.105 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:04 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.105 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:04 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.105 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:04 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.105 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:04 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.105 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:04 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.105 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:04 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.106 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:04 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.106 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:04 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.106 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:04 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.106 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:04 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.106 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:04 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:30:05.106 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:04 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:30:05.106 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:04 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:05.108 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-19T09:30:05.109 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:30:05.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:04 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:04 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:04 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:04 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:04 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:05.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:04 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:05.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:04 smithi121 ceph-mon[35577]: Updating smithi001:/etc/ceph/ceph.conf 2024-09-19T09:30:05.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:04 smithi121 ceph-mon[35577]: Updating smithi022:/etc/ceph/ceph.conf 2024-09-19T09:30:05.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:04 smithi121 ceph-mon[35577]: Updating smithi121:/etc/ceph/ceph.conf 2024-09-19T09:30:05.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:04 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:04 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/4129800744' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:05.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:04 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:04 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:04 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:04 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:04 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:04 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:04 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:04 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.119 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:04 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.119 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:04 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.119 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:04 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:05.119 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:04 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:30:05.119 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:04 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:30:05.119 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:04 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:05.174 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-19T09:30:05.174 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T09:30:05.203 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-19T09:30:05.203 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T09:30:05.269 INFO:tasks.cephadm:Adding mgr.x on smithi001 2024-09-19T09:30:05.269 INFO:tasks.cephadm:Adding mgr.y on smithi022 2024-09-19T09:30:05.270 INFO:tasks.cephadm:Adding mgr.z on smithi121 2024-09-19T09:30:05.270 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi001=x;smithi022=y;smithi121=z' 2024-09-19T09:30:05.543 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:30:05.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.970+0000 7fac11c52640 1 -- 172.21.15.121:0/3248127651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac0c1016e0 msgr2=0x7fac0c101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:05.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.970+0000 7fac11c52640 1 --2- 172.21.15.121:0/3248127651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac0c1016e0 0x7fac0c101ae0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fabfc009880 tx=0x7fabfc02a5d0 comp rx=0 tx=0).stop 2024-09-19T09:30:05.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.970+0000 7fac11c52640 1 -- 172.21.15.121:0/3248127651 shutdown_connections 2024-09-19T09:30:05.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.970+0000 7fac11c52640 1 --2- 172.21.15.121:0/3248127651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac0c1016e0 0x7fac0c101ae0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:05.973 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.970+0000 7fac11c52640 1 -- 172.21.15.121:0/3248127651 >> 172.21.15.121:0/3248127651 conn(0x7fac0c0fce90 msgr2=0x7fac0c0ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:05.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.970+0000 7fac11c52640 1 -- 172.21.15.121:0/3248127651 shutdown_connections 2024-09-19T09:30:05.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.970+0000 7fac11c52640 1 -- 172.21.15.121:0/3248127651 wait complete. 2024-09-19T09:30:05.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.970+0000 7fac11c52640 1 Processor -- start 2024-09-19T09:30:05.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.970+0000 7fac11c52640 1 -- start start 2024-09-19T09:30:05.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.971+0000 7fac11c52640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac0c1016e0 0x7fac0c196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:05.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.971+0000 7fac11c52640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac0c197500 0x7fac0c19c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:05.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.971+0000 7fac11c52640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac0c197980 0x7fac0c19eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:05.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.971+0000 7fac11c52640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fac0c1077d0 con 0x7fac0c197980 2024-09-19T09:30:05.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.971+0000 7fac11c52640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fac0c107650 con 0x7fac0c197500 2024-09-19T09:30:05.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.971+0000 7fac11c52640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fac0c107950 con 0x7fac0c1016e0 2024-09-19T09:30:05.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.971+0000 7fac0b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac0c1016e0 0x7fac0c196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:05.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.971+0000 7fac0b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac0c1016e0 0x7fac0c196fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:41200/0 (socket says 172.21.15.121:41200) 2024-09-19T09:30:05.974 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.971+0000 7fac0b7fe640 1 -- 172.21.15.121:0/1521273604 learned_addr learned my addr 172.21.15.121:0/1521273604 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-19T09:30:05.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.971+0000 7fac0bfff640 1 --2- 172.21.15.121:0/1521273604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac0c197980 0x7fac0c19eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:05.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.971+0000 7fac0affd640 1 --2- 172.21.15.121:0/1521273604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac0c197500 0x7fac0c19c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:05.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.971+0000 7fac0b7fe640 1 -- 172.21.15.121:0/1521273604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac0c197500 msgr2=0x7fac0c19c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:05.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.971+0000 7fac0b7fe640 1 --2- 172.21.15.121:0/1521273604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac0c197500 0x7fac0c19c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:05.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.971+0000 7fac0b7fe640 1 -- 172.21.15.121:0/1521273604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac0c197980 msgr2=0x7fac0c19eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:05.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.971+0000 7fac0b7fe640 1 --2- 172.21.15.121:0/1521273604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac0c197980 0x7fac0c19eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:05.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.971+0000 7fac0b7fe640 1 -- 172.21.15.121:0/1521273604 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac0c19f3c0 con 0x7fac0c1016e0 2024-09-19T09:30:05.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.971+0000 7fac0bfff640 1 --2- 172.21.15.121:0/1521273604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac0c197980 0x7fac0c19eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:30:05.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.971+0000 7fac0b7fe640 1 --2- 172.21.15.121:0/1521273604 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac0c1016e0 0x7fac0c196fc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fabfc031610 tx=0x7fabfc0043c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:05.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.972+0000 7fac08ff9640 1 -- 172.21.15.121:0/1521273604 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabfc03f030 con 0x7fac0c1016e0 2024-09-19T09:30:05.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.972+0000 7fac08ff9640 1 -- 172.21.15.121:0/1521273604 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabfc003ce0 con 0x7fac0c1016e0 2024-09-19T09:30:05.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.972+0000 7fac11c52640 1 -- 172.21.15.121:0/1521273604 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac0c19f650 con 0x7fac0c1016e0 2024-09-19T09:30:05.975 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.972+0000 7fac08ff9640 1 -- 172.21.15.121:0/1521273604 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabfc035070 con 0x7fac0c1016e0 2024-09-19T09:30:05.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.972+0000 7fac11c52640 1 -- 172.21.15.121:0/1521273604 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac0c19fbb0 con 0x7fac0c1016e0 2024-09-19T09:30:05.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.973+0000 7fac08ff9640 1 -- 172.21.15.121:0/1521273604 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fabfc042030 con 0x7fac0c1016e0 2024-09-19T09:30:05.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.973+0000 7fac11c52640 1 -- 172.21.15.121:0/1521273604 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac0c190590 con 0x7fac0c1016e0 2024-09-19T09:30:05.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.973+0000 7fac08ff9640 1 --2- 172.21.15.121:0/1521273604 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fabf4039730 0x7fabf403bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:05.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.973+0000 7fac08ff9640 1 -- 172.21.15.121:0/1521273604 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fabfc06cf20 con 0x7fac0c1016e0 2024-09-19T09:30:05.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.973+0000 7fac0affd640 1 --2- 172.21.15.121:0/1521273604 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fabf4039730 0x7fabf403bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:05.977 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.974+0000 7fac0affd640 1 --2- 172.21.15.121:0/1521273604 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fabf4039730 0x7fabf403bbf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fac0c1984e0 tx=0x7fac00008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:05.979 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:05.978+0000 7fac08ff9640 1 -- 172.21.15.121:0/1521273604 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fabfc03bde0 con 0x7fac0c1016e0 2024-09-19T09:30:06.158 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:06.157+0000 7fac11c52640 1 -- 172.21.15.121:0/1521273604 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi001=x;smithi022=y;smithi121=z", "target": ["mon-mgr", ""]}) -- 0x7fac0c0626c0 con 0x7fabf4039730 2024-09-19T09:30:06.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:06.162+0000 7fac08ff9640 1 -- 172.21.15.121:0/1521273604 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fac0c0626c0 con 0x7fabf4039730 2024-09-19T09:30:06.164 INFO:teuthology.orchestra.run.smithi121.stdout:Scheduled mgr update... 2024-09-19T09:30:06.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:06.165+0000 7fac11c52640 1 -- 172.21.15.121:0/1521273604 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fabf4039730 msgr2=0x7fabf403bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:06.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:06.165+0000 7fac11c52640 1 --2- 172.21.15.121:0/1521273604 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fabf4039730 0x7fabf403bbf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fac0c1984e0 tx=0x7fac00008040 comp rx=0 tx=0).stop 2024-09-19T09:30:06.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:06.165+0000 7fac11c52640 1 -- 172.21.15.121:0/1521273604 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac0c1016e0 msgr2=0x7fac0c196fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:06.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:06.165+0000 7fac11c52640 1 --2- 172.21.15.121:0/1521273604 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac0c1016e0 0x7fac0c196fc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fabfc031610 tx=0x7fabfc0043c0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:06.165+0000 7fac11c52640 1 -- 172.21.15.121:0/1521273604 shutdown_connections 2024-09-19T09:30:06.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:06.165+0000 7fac11c52640 1 --2- 172.21.15.121:0/1521273604 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac0c197980 0x7fac0c19eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:06.165+0000 7fac11c52640 1 --2- 172.21.15.121:0/1521273604 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fabf4039730 0x7fabf403bbf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:06.165+0000 7fac11c52640 1 --2- 172.21.15.121:0/1521273604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac0c197500 0x7fac0c19c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:06.165+0000 7fac11c52640 1 --2- 172.21.15.121:0/1521273604 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac0c1016e0 0x7fac0c196fc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:06.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:06.165+0000 7fac11c52640 1 -- 172.21.15.121:0/1521273604 >> 172.21.15.121:0/1521273604 conn(0x7fac0c0fce90 msgr2=0x7fac0c0fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:06.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:06.165+0000 7fac11c52640 1 -- 172.21.15.121:0/1521273604 shutdown_connections 2024-09-19T09:30:06.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:30:06.165+0000 7fac11c52640 1 -- 172.21.15.121:0/1521273604 wait complete. 2024-09-19T09:30:06.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:06 smithi022 ceph-mon[35583]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:06.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:06 smithi022 ceph-mon[35583]: Updating smithi022:/var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:30:06.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:06 smithi022 ceph-mon[35583]: Updating smithi121:/var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:30:06.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:06 smithi022 ceph-mon[35583]: Updating smithi001:/var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:30:06.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:06 smithi022 ceph-mon[35583]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T09:30:06.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:06 smithi022 ceph-mon[35583]: Reconfiguring daemon mon.a on smithi001 2024-09-19T09:30:06.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:06 smithi121 ceph-mon[35577]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:06.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:06 smithi121 ceph-mon[35577]: Updating smithi022:/var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:30:06.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:06 smithi121 ceph-mon[35577]: Updating smithi121:/var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:30:06.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:06 smithi121 ceph-mon[35577]: Updating smithi001:/var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:30:06.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:06 smithi121 ceph-mon[35577]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T09:30:06.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:06 smithi121 ceph-mon[35577]: Reconfiguring daemon mon.a on smithi001 2024-09-19T09:30:06.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:06 smithi001 ceph-mon[31225]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:06.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:06 smithi001 ceph-mon[31225]: Updating smithi022:/var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:30:06.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:06 smithi001 ceph-mon[31225]: Updating smithi121:/var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:30:06.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:06 smithi001 ceph-mon[31225]: Updating smithi001:/var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T09:30:06.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:06 smithi001 ceph-mon[31225]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T09:30:06.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:06 smithi001 ceph-mon[31225]: Reconfiguring daemon mon.a on smithi001 2024-09-19T09:30:06.804 DEBUG:teuthology.orchestra.run.smithi022:mgr.y> sudo journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mgr.y.service 2024-09-19T09:30:06.806 DEBUG:teuthology.orchestra.run.smithi121:mgr.z> sudo journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mgr.z.service 2024-09-19T09:30:06.809 INFO:tasks.cephadm:Deploying OSDs... 2024-09-19T09:30:06.809 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T09:30:06.809 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T09:30:06.829 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T09:30:06.829 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_1 2024-09-19T09:30:06.889 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T09:30:06.889 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:30:06.889 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-19T09:30:06.890 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:30:06.890 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:30:06.890 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-19 09:29:22.884284585 +0000 2024-09-19T09:30:06.890 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-19 09:24:36.140662345 +0000 2024-09-19T09:30:06.890 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-19 09:24:36.140662345 +0000 2024-09-19T09:30:06.890 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-09-19 09:24:36.140662345 +0000 2024-09-19T09:30:06.890 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T09:30:06.960 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-09-19T09:30:06.960 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-09-19T09:30:06.960 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000134037 s, 3.8 MB/s 2024-09-19T09:30:06.962 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T09:30:07.022 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_2 2024-09-19T09:30:07.081 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T09:30:07.082 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:30:07.082 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-19T09:30:07.082 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:30:07.082 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:30:07.082 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-19 09:29:22.912284230 +0000 2024-09-19T09:30:07.082 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-19 09:24:36.471658218 +0000 2024-09-19T09:30:07.082 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-19 09:24:36.471658218 +0000 2024-09-19T09:30:07.082 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-09-19 09:24:36.471658218 +0000 2024-09-19T09:30:07.083 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T09:30:07.149 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-09-19T09:30:07.150 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-09-19T09:30:07.150 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000122883 s, 4.2 MB/s 2024-09-19T09:30:07.151 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T09:30:07.210 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_3 2024-09-19T09:30:07.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:07 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:07.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:07 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:07.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:07 smithi001 ceph-mon[31225]: Reconfiguring mon.b (monmap changed)... 2024-09-19T09:30:07.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:07 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:30:07.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:07 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:30:07.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:07 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:07.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:07 smithi001 ceph-mon[31225]: Reconfiguring daemon mon.b on smithi022 2024-09-19T09:30:07.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:07 smithi001 ceph-mon[31225]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:07.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:07 smithi001 ceph-mon[31225]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi001=x;smithi022=y;smithi121=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:30:07.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:07 smithi001 ceph-mon[31225]: Saving service mgr spec with placement smithi001=x;smithi022=y;smithi121=z;count:3 2024-09-19T09:30:07.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:07 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:07.265 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T09:30:07.265 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:30:07.265 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T09:30:07.265 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:30:07.265 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:30:07.265 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-19 09:29:22.939283888 +0000 2024-09-19T09:30:07.265 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-19 09:24:36.792654216 +0000 2024-09-19T09:30:07.266 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-19 09:24:36.792654216 +0000 2024-09-19T09:30:07.266 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-09-19 09:24:36.792654216 +0000 2024-09-19T09:30:07.266 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T09:30:07.304 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:07 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:07.304 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:07 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:07.305 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:07 smithi022 ceph-mon[35583]: Reconfiguring mon.b (monmap changed)... 2024-09-19T09:30:07.305 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:07 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:30:07.305 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:07 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:30:07.305 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:07 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:07.305 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:07 smithi022 ceph-mon[35583]: Reconfiguring daemon mon.b on smithi022 2024-09-19T09:30:07.305 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:07 smithi022 ceph-mon[35583]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:07.305 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:07 smithi022 ceph-mon[35583]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi001=x;smithi022=y;smithi121=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:30:07.305 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:07 smithi022 ceph-mon[35583]: Saving service mgr spec with placement smithi001=x;smithi022=y;smithi121=z;count:3 2024-09-19T09:30:07.305 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:07 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:07.331 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-09-19T09:30:07.331 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-09-19T09:30:07.331 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000103252 s, 5.0 MB/s 2024-09-19T09:30:07.332 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T09:30:07.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:07 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:07.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:07 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:07.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:07 smithi121 ceph-mon[35577]: Reconfiguring mon.b (monmap changed)... 2024-09-19T09:30:07.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:07 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:30:07.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:07 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:30:07.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:07 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:07.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:07 smithi121 ceph-mon[35577]: Reconfiguring daemon mon.b on smithi022 2024-09-19T09:30:07.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:07 smithi121 ceph-mon[35577]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:07.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:07 smithi121 ceph-mon[35577]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi001=x;smithi022=y;smithi121=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:30:07.369 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:07 smithi121 ceph-mon[35577]: Saving service mgr spec with placement smithi001=x;smithi022=y;smithi121=z;count:3 2024-09-19T09:30:07.369 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:07 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:07.391 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_4 2024-09-19T09:30:07.448 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T09:30:07.448 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:30:07.448 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-19T09:30:07.448 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:30:07.448 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:30:07.448 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-19 09:29:22.967283533 +0000 2024-09-19T09:30:07.448 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-19 09:24:37.103650338 +0000 2024-09-19T09:30:07.448 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-19 09:24:37.103650338 +0000 2024-09-19T09:30:07.448 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-09-19 09:24:37.103650338 +0000 2024-09-19T09:30:07.449 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T09:30:07.513 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-09-19T09:30:07.513 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-09-19T09:30:07.513 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.0001162 s, 4.4 MB/s 2024-09-19T09:30:07.514 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T09:30:07.572 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-19T09:30:07.572 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T09:30:07.589 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T09:30:07.589 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_1 2024-09-19T09:30:07.646 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T09:30:07.646 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:30:07.646 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-19T09:30:07.646 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:30:07.646 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:30:07.646 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-09-19 09:29:56.793596573 +0000 2024-09-19T09:30:07.646 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-09-19 09:24:55.892744221 +0000 2024-09-19T09:30:07.646 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-09-19 09:24:55.892744221 +0000 2024-09-19T09:30:07.647 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-09-19 09:24:55.892744221 +0000 2024-09-19T09:30:07.647 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T09:30:07.712 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-09-19T09:30:07.712 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-09-19T09:30:07.712 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000114599 s, 4.5 MB/s 2024-09-19T09:30:07.713 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T09:30:07.771 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_2 2024-09-19T09:30:07.826 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T09:30:07.827 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:30:07.827 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-19T09:30:07.827 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:30:07.827 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:30:07.827 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-09-19 09:29:56.793596573 +0000 2024-09-19T09:30:07.827 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-09-19 09:24:56.220740197 +0000 2024-09-19T09:30:07.827 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-09-19 09:24:56.220740197 +0000 2024-09-19T09:30:07.827 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-09-19 09:24:56.220740197 +0000 2024-09-19T09:30:07.827 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T09:30:07.891 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-09-19T09:30:07.891 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-09-19T09:30:07.891 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000110089 s, 4.7 MB/s 2024-09-19T09:30:07.892 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T09:30:07.949 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_3 2024-09-19T09:30:08.005 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T09:30:08.005 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:30:08.005 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-19T09:30:08.006 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:30:08.006 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:30:08.006 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-09-19 09:29:56.793596573 +0000 2024-09-19T09:30:08.006 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-09-19 09:24:56.548736173 +0000 2024-09-19T09:30:08.006 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-09-19 09:24:56.548736173 +0000 2024-09-19T09:30:08.006 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-09-19 09:24:56.548736173 +0000 2024-09-19T09:30:08.006 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T09:30:08.069 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-09-19T09:30:08.070 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-09-19T09:30:08.070 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 9.1298e-05 s, 5.6 MB/s 2024-09-19T09:30:08.071 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T09:30:08.128 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_4 2024-09-19T09:30:08.185 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T09:30:08.185 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:30:08.185 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-19T09:30:08.185 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:30:08.185 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:30:08.185 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-09-19 09:29:56.794596560 +0000 2024-09-19T09:30:08.185 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-09-19 09:24:56.864732296 +0000 2024-09-19T09:30:08.185 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-09-19 09:24:56.864732296 +0000 2024-09-19T09:30:08.186 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-09-19 09:24:56.864732296 +0000 2024-09-19T09:30:08.186 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T09:30:08.249 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-09-19T09:30:08.249 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-09-19T09:30:08.249 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000107953 s, 4.7 MB/s 2024-09-19T09:30:08.250 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T09:30:08.306 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-19T09:30:08.306 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T09:30:08.323 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T09:30:08.323 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_1 2024-09-19T09:30:08.379 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T09:30:08.379 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:30:08.379 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-19T09:30:08.379 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:30:08.379 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:30:08.379 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-19 09:29:47.758886649 +0000 2024-09-19T09:30:08.379 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-19 09:24:56.845999173 +0000 2024-09-19T09:30:08.379 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-19 09:24:56.845999173 +0000 2024-09-19T09:30:08.380 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-09-19 09:24:56.845999173 +0000 2024-09-19T09:30:08.380 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T09:30:08.445 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-19T09:30:08.445 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-19T09:30:08.445 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000245666 s, 2.1 MB/s 2024-09-19T09:30:08.446 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T09:30:08.503 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_2 2024-09-19T09:30:08.559 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T09:30:08.559 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:30:08.559 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-19T09:30:08.559 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:30:08.559 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:30:08.559 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-19 09:29:47.759886635 +0000 2024-09-19T09:30:08.559 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-19 09:24:57.184994389 +0000 2024-09-19T09:30:08.559 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-19 09:24:57.184994389 +0000 2024-09-19T09:30:08.559 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-09-19 09:24:57.184994389 +0000 2024-09-19T09:30:08.560 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T09:30:08.613 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:08 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:08.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:08 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:08.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:08 smithi022 ceph-mon[35583]: Reconfiguring mon.c (monmap changed)... 2024-09-19T09:30:08.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:08 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:30:08.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:08 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:30:08.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:08 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:08.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:08 smithi022 ceph-mon[35583]: Reconfiguring daemon mon.c on smithi121 2024-09-19T09:30:08.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:08 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:08.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:08 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:08.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:08 smithi121 ceph-mon[35577]: Reconfiguring mon.c (monmap changed)... 2024-09-19T09:30:08.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:08 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:30:08.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:08 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:30:08.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:08 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:08.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:08 smithi121 ceph-mon[35577]: Reconfiguring daemon mon.c on smithi121 2024-09-19T09:30:08.622 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-19T09:30:08.622 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-19T09:30:08.622 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000200061 s, 2.6 MB/s 2024-09-19T09:30:08.624 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T09:30:08.681 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_3 2024-09-19T09:30:08.737 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T09:30:08.737 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:30:08.737 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T09:30:08.737 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:30:08.737 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:30:08.737 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-19 09:29:47.759886635 +0000 2024-09-19T09:30:08.737 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-19 09:24:57.502989900 +0000 2024-09-19T09:30:08.737 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-19 09:24:57.502989900 +0000 2024-09-19T09:30:08.737 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-09-19 09:24:57.502989900 +0000 2024-09-19T09:30:08.738 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T09:30:08.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:08 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:08.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:08 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:08.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:08 smithi001 ceph-mon[31225]: Reconfiguring mon.c (monmap changed)... 2024-09-19T09:30:08.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:08 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T09:30:08.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:08 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T09:30:08.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:08 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:08.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:08 smithi001 ceph-mon[31225]: Reconfiguring daemon mon.c on smithi121 2024-09-19T09:30:08.801 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-19T09:30:08.801 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-19T09:30:08.801 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000215684 s, 2.4 MB/s 2024-09-19T09:30:08.802 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T09:30:08.858 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_4 2024-09-19T09:30:08.913 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T09:30:08.914 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:30:08.914 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-19T09:30:08.914 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:30:08.914 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:30:08.914 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-19 09:29:47.759886635 +0000 2024-09-19T09:30:08.914 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-19 09:24:57.820985412 +0000 2024-09-19T09:30:08.914 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-19 09:24:57.820985412 +0000 2024-09-19T09:30:08.914 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-09-19 09:24:57.820985412 +0000 2024-09-19T09:30:08.914 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T09:30:08.979 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-19T09:30:08.979 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-19T09:30:08.979 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000197773 s, 2.6 MB/s 2024-09-19T09:30:08.981 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T09:30:09.038 INFO:tasks.cephadm:Deploying osd.0 on smithi001 with /dev/vg_nvme/lv_4... 2024-09-19T09:30:09.038 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T09:30:09.300 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:30:09.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:09 smithi001 ceph-mon[31225]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:09.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:09 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:09.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:09 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:09.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:09 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:09.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:09 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:09.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:09 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:09.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:09 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:09.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:09 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:30:09.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:09 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T09:30:09.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:09 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:30:09.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:09 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:09.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:09 smithi001 ceph-mon[31225]: Deploying daemon mgr.z on smithi121 2024-09-19T09:30:10.064 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:09 smithi121 ceph-mon[35577]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:10.065 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:09 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:10.065 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:09 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:10.065 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:09 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:10.065 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:09 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:10.065 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:09 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:10.065 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:09 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:10.065 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:09 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:30:10.065 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:09 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T09:30:10.065 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:09 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:30:10.065 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:09 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:10.065 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:09 smithi121 ceph-mon[35577]: Deploying daemon mgr.z on smithi121 2024-09-19T09:30:10.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:09 smithi022 ceph-mon[35583]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:10.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:09 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:10.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:09 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:10.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:09 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:10.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:09 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:10.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:09 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:10.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:09 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:10.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:09 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:30:10.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:09 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T09:30:10.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:09 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:30:10.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:09 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:10.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:09 smithi022 ceph-mon[35583]: Deploying daemon mgr.z on smithi121 2024-09-19T09:30:10.617 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:10 smithi121 systemd[1]: Starting Ceph mgr.z for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:30:10.969 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:10 smithi121 podman[37374]: 2024-09-19 09:30:10.595670663 +0000 UTC m=+0.015530258 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:30:10.970 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:10 smithi121 podman[37374]: 2024-09-19 09:30:10.740994083 +0000 UTC m=+0.160853667 container create 6c24a9ea2d7629e89bc9ee78bf317b8ad43f62b38a56e3b78057e158c9aab8f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:30:10.970 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:10 smithi121 podman[37374]: 2024-09-19 09:30:10.968344172 +0000 UTC m=+0.388203765 container init 6c24a9ea2d7629e89bc9ee78bf317b8ad43f62b38a56e3b78057e158c9aab8f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-z, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4) 2024-09-19T09:30:11.300 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:10 smithi121 podman[37374]: 2024-09-19 09:30:10.971228226 +0000 UTC m=+0.391087822 container start 6c24a9ea2d7629e89bc9ee78bf317b8ad43f62b38a56e3b78057e158c9aab8f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-z, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True) 2024-09-19T09:30:11.301 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:10 smithi121 ceph-mgr[37393]: -- 172.21.15.121:0/678874956 <== mon.1 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ed79d530e0 con 0x55ed79d31000 2024-09-19T09:30:11.301 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:11 smithi121 bash[37374]: 6c24a9ea2d7629e89bc9ee78bf317b8ad43f62b38a56e3b78057e158c9aab8f3 2024-09-19T09:30:11.301 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:11 smithi121 systemd[1]: Started Ceph mgr.z for 57238232-7669-11ef-bceb-c7b262605968. 2024-09-19T09:30:11.301 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:11 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-z[37389]: 2024-09-19T09:30:11.090+0000 7f15ab704040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T09:30:11.301 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:11 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-z[37389]: 2024-09-19T09:30:11.151+0000 7f15ab704040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:30:11.301 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:11 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-z[37389]: 2024-09-19T09:30:11.299+0000 7f15ab704040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:30:11.616 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:11 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-z[37389]: 2024-09-19T09:30:11.365+0000 7f15ab704040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:30:11.617 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:11 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-z[37389]: 2024-09-19T09:30:11.509+0000 7f15ab704040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:30:11.700 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:30:11.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:11 smithi001 ceph-mon[31225]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:11.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:11 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:11.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:11 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:11.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:11 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:11.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:11 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:30:11.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:11 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T09:30:11.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:11 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:30:11.728 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:11 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:11.729 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi001:vg_nvme/lv_4 2024-09-19T09:30:11.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:11 smithi022 ceph-mon[35583]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:11.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:11 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:11.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:11 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:11.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:11 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:11.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:11 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:30:11.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:11 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T09:30:11.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:11 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:30:11.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:11 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:11.959 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:11 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-z[37389]: 2024-09-19T09:30:11.647+0000 7f15ab704040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:30:11.960 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:11 smithi121 ceph-mon[35577]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:11.960 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:11 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:11.960 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:11 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:11.960 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:11 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:11.960 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:11 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:30:11.960 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:11 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T09:30:11.960 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:11 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:30:11.960 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:11 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:11.990 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:30:12.366 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:11 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-z[37389]: 2024-09-19T09:30:11.958+0000 7f15ab704040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:30:12.366 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:12 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-z[37389]: 2024-09-19T09:30:12.018+0000 7f15ab704040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:30:12.367 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:12 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-z[37389]: 2024-09-19T09:30:12.201+0000 7f15ab704040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:30:12.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.427+0000 7fcdacb9a640 1 -- 172.21.15.1:0/280250420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcda81037c0 msgr2=0x7fcda810a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:12.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.427+0000 7fcdacb9a640 1 --2- 172.21.15.1:0/280250420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcda81037c0 0x7fcda810a050 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009ca0 tx=0x7fcda002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:30:12.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.427+0000 7fcdacb9a640 1 -- 172.21.15.1:0/280250420 shutdown_connections 2024-09-19T09:30:12.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.427+0000 7fcdacb9a640 1 --2- 172.21.15.1:0/280250420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcda81037c0 0x7fcda810a050 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:12.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.427+0000 7fcdacb9a640 1 --2- 172.21.15.1:0/280250420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcda8102e00 0x7fcda8103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:12.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.427+0000 7fcdacb9a640 1 --2- 172.21.15.1:0/280250420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcda8101c00 0x7fcda8102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:12.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.427+0000 7fcdacb9a640 1 -- 172.21.15.1:0/280250420 >> 172.21.15.1:0/280250420 conn(0x7fcda80fd390 msgr2=0x7fcda80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:12.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.427+0000 7fcdacb9a640 1 -- 172.21.15.1:0/280250420 shutdown_connections 2024-09-19T09:30:12.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.427+0000 7fcdacb9a640 1 -- 172.21.15.1:0/280250420 wait complete. 2024-09-19T09:30:12.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.428+0000 7fcdacb9a640 1 Processor -- start 2024-09-19T09:30:12.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.428+0000 7fcdacb9a640 1 -- start start 2024-09-19T09:30:12.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.428+0000 7fcdacb9a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcda8101c00 0x7fcda8197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:12.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.428+0000 7fcdacb9a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcda8102e00 0x7fcda81983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:12.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.428+0000 7fcdacb9a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcda81037c0 0x7fcda819f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:12.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.428+0000 7fcdacb9a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcda810d880 con 0x7fcda8101c00 2024-09-19T09:30:12.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.428+0000 7fcdacb9a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcda810d700 con 0x7fcda81037c0 2024-09-19T09:30:12.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.428+0000 7fcdacb9a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcda810da00 con 0x7fcda8102e00 2024-09-19T09:30:12.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.428+0000 7fcda659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcda8101c00 0x7fcda8197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:12.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.428+0000 7fcda659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcda8101c00 0x7fcda8197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37666/0 (socket says 172.21.15.1:37666) 2024-09-19T09:30:12.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.428+0000 7fcda659c640 1 -- 172.21.15.1:0/212483818 learned_addr learned my addr 172.21.15.1:0/212483818 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:30:12.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.428+0000 7fcda6d9d640 1 --2- 172.21.15.1:0/212483818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcda81037c0 0x7fcda819f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:12.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.428+0000 7fcda5d9b640 1 --2- 172.21.15.1:0/212483818 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcda8102e00 0x7fcda81983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:12.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.428+0000 7fcda659c640 1 -- 172.21.15.1:0/212483818 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcda8102e00 msgr2=0x7fcda81983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:12.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.428+0000 7fcda659c640 1 --2- 172.21.15.1:0/212483818 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcda8102e00 0x7fcda81983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:12.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.428+0000 7fcda659c640 1 -- 172.21.15.1:0/212483818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcda81037c0 msgr2=0x7fcda819f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:12.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.428+0000 7fcda659c640 1 --2- 172.21.15.1:0/212483818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcda81037c0 0x7fcda819f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:12.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.428+0000 7fcda659c640 1 -- 172.21.15.1:0/212483818 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcda819fad0 con 0x7fcda8101c00 2024-09-19T09:30:12.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.429+0000 7fcda659c640 1 --2- 172.21.15.1:0/212483818 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcda8101c00 0x7fcda8197ea0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800d770 tx=0x7fcd9800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:12.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.429+0000 7fcd977fe640 1 -- 172.21.15.1:0/212483818 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd98017070 con 0x7fcda8101c00 2024-09-19T09:30:12.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.429+0000 7fcd977fe640 1 -- 172.21.15.1:0/212483818 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd98009c30 con 0x7fcda8101c00 2024-09-19T09:30:12.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.429+0000 7fcdacb9a640 1 -- 172.21.15.1:0/212483818 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcda819fdc0 con 0x7fcda8101c00 2024-09-19T09:30:12.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.429+0000 7fcd977fe640 1 -- 172.21.15.1:0/212483818 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd98003dd0 con 0x7fcda8101c00 2024-09-19T09:30:12.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.429+0000 7fcdacb9a640 1 -- 172.21.15.1:0/212483818 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcda81a0270 con 0x7fcda8101c00 2024-09-19T09:30:12.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.430+0000 7fcd977fe640 1 -- 172.21.15.1:0/212483818 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 13) ==== 46516+0+0 (secure 0 0 0) 0x7fcd98004020 con 0x7fcda8101c00 2024-09-19T09:30:12.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.430+0000 7fcd977fe640 1 --2- 172.21.15.1:0/212483818 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fcd90039500 0x7fcd9003b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:12.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.430+0000 7fcd977fe640 1 -- 172.21.15.1:0/212483818 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fcd9804bfa0 con 0x7fcda8101c00 2024-09-19T09:30:12.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.430+0000 7fcdacb9a640 1 -- 172.21.15.1:0/212483818 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcda8108f80 con 0x7fcda8101c00 2024-09-19T09:30:12.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.430+0000 7fcda5d9b640 1 --2- 172.21.15.1:0/212483818 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fcd90039500 0x7fcd9003b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:12.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.430+0000 7fcda5d9b640 1 --2- 172.21.15.1:0/212483818 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fcd90039500 0x7fcd9003b9c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcda81993c0 tx=0x7fcd9c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:12.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.435+0000 7fcd977fe640 1 -- 172.21.15.1:0/212483818 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcd98004310 con 0x7fcda8101c00 2024-09-19T09:30:12.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:12.619+0000 7fcdacb9a640 1 -- 172.21.15.1:0/212483818 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fcda8062630 con 0x7fcd90039500 2024-09-19T09:30:12.995 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:12 smithi022 ceph-mon[35583]: Deploying daemon mgr.y on smithi022 2024-09-19T09:30:12.995 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:12 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:30:12.996 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:12 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:30:12.996 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:12 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:12.996 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:12 smithi022 systemd[1]: Starting Ceph mgr.y for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:30:12.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:12 smithi001 ceph-mon[31225]: Deploying daemon mgr.y on smithi022 2024-09-19T09:30:12.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:12 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:30:12.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:12 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:30:12.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:12 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:13.076 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:12 smithi121 ceph-mon[35577]: Deploying daemon mgr.y on smithi022 2024-09-19T09:30:13.076 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:12 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:30:13.076 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:12 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:30:13.077 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:12 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:13.250 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:12 smithi022 podman[36935]: 2024-09-19 09:30:12.897167231 +0000 UTC m=+0.015699584 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:30:13.250 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:13 smithi022 podman[36935]: 2024-09-19 09:30:13.002673889 +0000 UTC m=+0.121206227 container create 370f98ebcb09405f0cbae26511b0dd65a1395b993798434d174b20479a8ce759 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:30:13.250 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:13 smithi022 podman[36935]: 2024-09-19 09:30:13.221604239 +0000 UTC m=+0.340136580 container init 370f98ebcb09405f0cbae26511b0dd65a1395b993798434d174b20479a8ce759 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:30:13.251 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:13 smithi022 podman[36935]: 2024-09-19 09:30:13.225131202 +0000 UTC m=+0.343663540 container start 370f98ebcb09405f0cbae26511b0dd65a1395b993798434d174b20479a8ce759 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-19T09:30:13.366 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:13 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-z[37389]: 2024-09-19T09:30:13.075+0000 7f15ab704040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:30:13.367 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:13 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-z[37389]: 2024-09-19T09:30:13.141+0000 7f15ab704040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:30:13.567 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:13 smithi022 ceph-mgr[36954]: -- 172.21.15.22:0/3628619879 <== mon.2 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563fabf3f0e0 con 0x563fabf1d000 2024-09-19T09:30:13.568 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:13 smithi022 bash[36935]: 370f98ebcb09405f0cbae26511b0dd65a1395b993798434d174b20479a8ce759 2024-09-19T09:30:13.568 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:13 smithi022 systemd[1]: Started Ceph mgr.y for 57238232-7669-11ef-bceb-c7b262605968. 2024-09-19T09:30:13.568 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:13 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y[36950]: 2024-09-19T09:30:13.349+0000 7f2d2a972040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T09:30:13.568 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:13 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y[36950]: 2024-09-19T09:30:13.409+0000 7f2d2a972040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:30:13.568 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:13 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y[36950]: 2024-09-19T09:30:13.566+0000 7f2d2a972040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:30:13.864 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:13 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y[36950]: 2024-09-19T09:30:13.636+0000 7f2d2a972040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:30:13.864 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:13 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y[36950]: 2024-09-19T09:30:13.797+0000 7f2d2a972040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:30:13.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:13 smithi022 ceph-mon[35583]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:13.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:13 smithi022 ceph-mon[35583]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:30:13.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:13 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:13.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:13 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:13.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:13 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:13.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:13 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:13.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:13 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:13.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:13 smithi001 ceph-mon[31225]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:13.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:13 smithi001 ceph-mon[31225]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:30:13.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:13 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:13.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:13 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:13.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:13 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:13.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:13 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:13.960 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:13 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:14.014 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:13 smithi121 ceph-mon[35577]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:14.014 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:13 smithi121 ceph-mon[35577]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:30:14.014 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:13 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:14.014 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:13 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:14.014 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:13 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:14.014 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:13 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:14.014 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:13 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:14.015 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:13 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-z[37389]: 2024-09-19T09:30:13.897+0000 7f15ab704040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:30:14.015 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:14 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-z[37389]: 2024-09-19T09:30:14.012+0000 7f15ab704040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:30:14.272 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:14 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-z[37389]: 2024-09-19T09:30:14.164+0000 7f15ab704040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:30:14.272 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:14 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-z[37389]: 2024-09-19T09:30:14.228+0000 7f15ab704040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:30:14.292 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:13 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y[36950]: 2024-09-19T09:30:13.954+0000 7f2d2a972040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:30:14.292 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:14 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y[36950]: 2024-09-19T09:30:14.291+0000 7f2d2a972040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:30:14.553 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:14 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y[36950]: 2024-09-19T09:30:14.354+0000 7f2d2a972040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:30:14.554 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:14 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y[36950]: 2024-09-19T09:30:14.552+0000 7f2d2a972040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:30:14.616 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:14 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-z[37389]: 2024-09-19T09:30:14.378+0000 7f15ab704040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:30:14.617 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:14 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-z[37389]: 2024-09-19T09:30:14.446+0000 7f15ab704040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:30:14.617 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:14 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-z[37389]: 2024-09-19T09:30:14.510+0000 7f15ab704040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:30:14.960 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:14 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-z[37389]: 2024-09-19T09:30:14.689+0000 7f15ab704040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:30:14.960 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:14 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-z[37389]: 2024-09-19T09:30:14.754+0000 7f15ab704040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:30:14.960 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:14 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-z[37389]: 2024-09-19T09:30:14.819+0000 7f15ab704040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:30:14.961 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:14 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-z[37389]: 2024-09-19T09:30:14.900+0000 7f15ab704040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:30:14.961 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:14 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-z[37389]: 2024-09-19T09:30:14.958+0000 7f15ab704040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:30:15.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:15 smithi001 ceph-mon[31225]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:15.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:15 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:15.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:15 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:15.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:15 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:15.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:15 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:15.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:15 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:15.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:15 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:15.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:15 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:15.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:15 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:15.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:15 smithi001 ceph-mon[31225]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T09:30:15.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:15 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:30:15.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:15 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:30:15.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:15 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:15.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:15 smithi001 ceph-mon[31225]: Reconfiguring daemon mgr.x on smithi001 2024-09-19T09:30:15.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:15 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/3517384862' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c165571d-43f1-4c43-ba1e-35872d914f11"}]: dispatch 2024-09-19T09:30:15.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:15 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/3517384862' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c165571d-43f1-4c43-ba1e-35872d914f11"}]': finished 2024-09-19T09:30:15.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:15 smithi001 ceph-mon[31225]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T09:30:15.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:15 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:30:15.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:15 smithi022 ceph-mon[35583]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:15.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:15 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:15.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:15 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:15.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:15 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:15.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:15 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:15.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:15 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:15.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:15 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:15.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:15 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:15.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:15 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:15.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:15 smithi022 ceph-mon[35583]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T09:30:15.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:15 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:30:15.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:15 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:30:15.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:15 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:15.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:15 smithi022 ceph-mon[35583]: Reconfiguring daemon mgr.x on smithi001 2024-09-19T09:30:15.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:15 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/3517384862' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c165571d-43f1-4c43-ba1e-35872d914f11"}]: dispatch 2024-09-19T09:30:15.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:15 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/3517384862' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c165571d-43f1-4c43-ba1e-35872d914f11"}]': finished 2024-09-19T09:30:15.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:15 smithi022 ceph-mon[35583]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T09:30:15.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:15 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:30:15.366 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:15 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-z[37389]: 2024-09-19T09:30:15.019+0000 7f15ab704040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:30:15.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:15 smithi121 ceph-mon[35577]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:15.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:15 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:15.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:15 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:15.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:15 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:15.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:15 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:15.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:15 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:15.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:15 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:15.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:15 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:15.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:15 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:15.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:15 smithi121 ceph-mon[35577]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T09:30:15.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:15 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T09:30:15.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:15 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T09:30:15.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:15 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:15.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:15 smithi121 ceph-mon[35577]: Reconfiguring daemon mgr.x on smithi001 2024-09-19T09:30:15.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:15 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/3517384862' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c165571d-43f1-4c43-ba1e-35872d914f11"}]: dispatch 2024-09-19T09:30:15.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:15 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/3517384862' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c165571d-43f1-4c43-ba1e-35872d914f11"}]': finished 2024-09-19T09:30:15.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:15 smithi121 ceph-mon[35577]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T09:30:15.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:15 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:30:15.864 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:15 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y[36950]: 2024-09-19T09:30:15.476+0000 7f2d2a972040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:30:15.864 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:15 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y[36950]: 2024-09-19T09:30:15.546+0000 7f2d2a972040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:30:16.097 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:30:15 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-z[37389]: 2024-09-19T09:30:15.804+0000 7f15ab704040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:30:16.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:16.099+0000 7fcd977fe640 1 -- 172.21.15.1:0/212483818 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 14) ==== 92407+0+0 (secure 0 0 0) 0x7fcd980107e0 con 0x7fcda8101c00 2024-09-19T09:30:16.363 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:16 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y[36950]: 2024-09-19T09:30:16.293+0000 7f2d2a972040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:30:16.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:16 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/528372007' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:30:16.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:16 smithi022 ceph-mon[35583]: Standby manager daemon z started 2024-09-19T09:30:16.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:16 smithi022 ceph-mon[35583]: from='mgr.? 172.21.15.121:0/2845173328' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T09:30:16.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:16 smithi022 ceph-mon[35583]: from='mgr.? 172.21.15.121:0/2845173328' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:30:16.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:16 smithi022 ceph-mon[35583]: from='mgr.? 172.21.15.121:0/2845173328' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T09:30:16.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:16 smithi022 ceph-mon[35583]: from='mgr.? 172.21.15.121:0/2845173328' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:30:16.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:16 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/528372007' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:30:16.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:16 smithi121 ceph-mon[35577]: Standby manager daemon z started 2024-09-19T09:30:16.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:16 smithi121 ceph-mon[35577]: from='mgr.? 172.21.15.121:0/2845173328' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T09:30:16.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:16 smithi121 ceph-mon[35577]: from='mgr.? 172.21.15.121:0/2845173328' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:30:16.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:16 smithi121 ceph-mon[35577]: from='mgr.? 172.21.15.121:0/2845173328' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T09:30:16.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:16 smithi121 ceph-mon[35577]: from='mgr.? 172.21.15.121:0/2845173328' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:30:16.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:16 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/528372007' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:30:16.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:16 smithi001 ceph-mon[31225]: Standby manager daemon z started 2024-09-19T09:30:16.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:16 smithi001 ceph-mon[31225]: from='mgr.? 172.21.15.121:0/2845173328' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T09:30:16.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:16 smithi001 ceph-mon[31225]: from='mgr.? 172.21.15.121:0/2845173328' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:30:16.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:16 smithi001 ceph-mon[31225]: from='mgr.? 172.21.15.121:0/2845173328' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T09:30:16.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:16 smithi001 ceph-mon[31225]: from='mgr.? 172.21.15.121:0/2845173328' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:30:16.779 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:16 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y[36950]: 2024-09-19T09:30:16.412+0000 7f2d2a972040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:30:16.779 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:16 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y[36950]: 2024-09-19T09:30:16.560+0000 7f2d2a972040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:30:16.779 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:16 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y[36950]: 2024-09-19T09:30:16.623+0000 7f2d2a972040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:30:16.779 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:16 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y[36950]: 2024-09-19T09:30:16.778+0000 7f2d2a972040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:30:17.075 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:16 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y[36950]: 2024-09-19T09:30:16.848+0000 7f2d2a972040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:30:17.076 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:16 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y[36950]: 2024-09-19T09:30:16.910+0000 7f2d2a972040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:30:17.076 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:17 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y[36950]: 2024-09-19T09:30:17.074+0000 7f2d2a972040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:30:17.360 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:17 smithi022 ceph-mon[35583]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:17.360 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:17 smithi022 ceph-mon[35583]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-19T09:30:17.360 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:17 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T09:30:17.360 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:17 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y[36950]: 2024-09-19T09:30:17.143+0000 7f2d2a972040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:30:17.360 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:17 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y[36950]: 2024-09-19T09:30:17.211+0000 7f2d2a972040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:30:17.360 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:17 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y[36950]: 2024-09-19T09:30:17.297+0000 7f2d2a972040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:30:17.361 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:17 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y[36950]: 2024-09-19T09:30:17.359+0000 7f2d2a972040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:30:17.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:17 smithi121 ceph-mon[35577]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:17.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:17 smithi121 ceph-mon[35577]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-19T09:30:17.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:17 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T09:30:17.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:17 smithi001 ceph-mon[31225]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:17.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:17 smithi001 ceph-mon[31225]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-19T09:30:17.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:17 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T09:30:17.613 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:17 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y[36950]: 2024-09-19T09:30:17.420+0000 7f2d2a972040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:30:18.614 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:30:18 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y[36950]: 2024-09-19T09:30:18.243+0000 7f2d2a972040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:30:19.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:19.111+0000 7fcd977fe640 1 -- 172.21.15.1:0/212483818 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7fcd98020cc0 con 0x7fcda8101c00 2024-09-19T09:30:19.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:19 smithi022 ceph-mon[35583]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:19.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:19 smithi022 ceph-mon[35583]: Standby manager daemon y started 2024-09-19T09:30:19.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:19 smithi022 ceph-mon[35583]: from='mgr.? 172.21.15.22:0/1086326576' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T09:30:19.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:19 smithi022 ceph-mon[35583]: from='mgr.? 172.21.15.22:0/1086326576' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:30:19.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:19 smithi022 ceph-mon[35583]: from='mgr.? 172.21.15.22:0/1086326576' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T09:30:19.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:19 smithi022 ceph-mon[35583]: from='mgr.? 172.21.15.22:0/1086326576' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:30:19.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:19 smithi121 ceph-mon[35577]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:19.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:19 smithi121 ceph-mon[35577]: Standby manager daemon y started 2024-09-19T09:30:19.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:19 smithi121 ceph-mon[35577]: from='mgr.? 172.21.15.22:0/1086326576' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T09:30:19.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:19 smithi121 ceph-mon[35577]: from='mgr.? 172.21.15.22:0/1086326576' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:30:19.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:19 smithi121 ceph-mon[35577]: from='mgr.? 172.21.15.22:0/1086326576' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T09:30:19.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:19 smithi121 ceph-mon[35577]: from='mgr.? 172.21.15.22:0/1086326576' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:30:19.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:19 smithi001 ceph-mon[31225]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:19.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:19 smithi001 ceph-mon[31225]: Standby manager daemon y started 2024-09-19T09:30:19.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:19 smithi001 ceph-mon[31225]: from='mgr.? 172.21.15.22:0/1086326576' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T09:30:19.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:19 smithi001 ceph-mon[31225]: from='mgr.? 172.21.15.22:0/1086326576' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T09:30:19.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:19 smithi001 ceph-mon[31225]: from='mgr.? 172.21.15.22:0/1086326576' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T09:30:19.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:19 smithi001 ceph-mon[31225]: from='mgr.? 172.21.15.22:0/1086326576' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T09:30:20.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:20 smithi001 ceph-mon[31225]: mgrmap e15: x(active, since 65s), standbys: z, y 2024-09-19T09:30:20.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:20 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T09:30:20.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:20 smithi022 ceph-mon[35583]: mgrmap e15: x(active, since 65s), standbys: z, y 2024-09-19T09:30:20.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:20 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T09:30:20.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:20 smithi121 ceph-mon[35577]: mgrmap e15: x(active, since 65s), standbys: z, y 2024-09-19T09:30:20.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:20 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T09:30:21.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:21 smithi001 ceph-mon[31225]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:21.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:21 smithi022 ceph-mon[35583]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:21.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:21 smithi121 ceph-mon[35577]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:22.787 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:22 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:22.787 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:22 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:22.787 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:22 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:22.787 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:22 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:22.787 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:22 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:22.787 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:22 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:23.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:22 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:23.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:22 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:23.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:22 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:23.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:22 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:23.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:22 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:23.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:22 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:23.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:22 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:23.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:22 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:23.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:22 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:23.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:22 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:23.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:22 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:23.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:22 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:23.951 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:23 smithi001 ceph-mon[31225]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:24.016 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:23 smithi022 ceph-mon[35583]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:24.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:23 smithi121 ceph-mon[35577]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:24.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:24 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T09:30:24.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:24 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:24.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:24 smithi001 ceph-mon[31225]: Deploying daemon osd.0 on smithi001 2024-09-19T09:30:25.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:24 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T09:30:25.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:24 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:25.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:24 smithi022 ceph-mon[35583]: Deploying daemon osd.0 on smithi001 2024-09-19T09:30:25.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:24 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T09:30:25.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:24 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:25.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:24 smithi121 ceph-mon[35577]: Deploying daemon osd.0 on smithi001 2024-09-19T09:30:25.917 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:25 smithi001 ceph-mon[31225]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:26.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:25 smithi022 ceph-mon[35583]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:26.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:25 smithi121 ceph-mon[35577]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:28.001 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:27 smithi001 ceph-mon[31225]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:28.113 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:27 smithi022 ceph-mon[35583]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:28.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:27 smithi121 ceph-mon[35577]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:29.872 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:29 smithi001 ceph-mon[31225]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:30.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:29 smithi022 ceph-mon[35583]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:30.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:29 smithi121 ceph-mon[35577]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:30.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:30 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:30.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:30 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:30.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:30 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:31.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:30 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:31.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:30 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:31.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:30 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:31.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:30 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:31.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:30 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:31.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:30 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:31.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:31 smithi001 ceph-mon[31225]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:32.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:31 smithi022 ceph-mon[35583]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:32.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:31 smithi121 ceph-mon[35577]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:34.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:33 smithi022 ceph-mon[35583]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:34.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:33 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:34.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:33 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:34.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:33 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:34.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:33 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:34.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:33 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:34.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:33 smithi121 ceph-mon[35577]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:34.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:33 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:34.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:33 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:34.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:33 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:34.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:33 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:34.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:33 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:34.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:33 smithi001 ceph-mon[31225]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:34.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:33 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:34.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:33 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:34.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:33 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:34.127 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:33 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:34.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:33 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:34.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:34.786+0000 7fcd977fe640 1 -- 172.21.15.1:0/212483818 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcda8062630 con 0x7fcd90039500 2024-09-19T09:30:34.789 INFO:teuthology.orchestra.run.smithi001.stdout:Created osd(s) 0 on host 'smithi001' 2024-09-19T09:30:34.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:34.789+0000 7fcdacb9a640 1 -- 172.21.15.1:0/212483818 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fcd90039500 msgr2=0x7fcd9003b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:34.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:34.789+0000 7fcdacb9a640 1 --2- 172.21.15.1:0/212483818 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fcd90039500 0x7fcd9003b9c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcda81993c0 tx=0x7fcd9c005f90 comp rx=0 tx=0).stop 2024-09-19T09:30:34.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:34.789+0000 7fcdacb9a640 1 -- 172.21.15.1:0/212483818 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcda8101c00 msgr2=0x7fcda8197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:34.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:34.789+0000 7fcdacb9a640 1 --2- 172.21.15.1:0/212483818 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcda8101c00 0x7fcda8197ea0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800d770 tx=0x7fcd9800dc30 comp rx=0 tx=0).stop 2024-09-19T09:30:34.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:34.789+0000 7fcdacb9a640 1 -- 172.21.15.1:0/212483818 shutdown_connections 2024-09-19T09:30:34.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:34.789+0000 7fcdacb9a640 1 --2- 172.21.15.1:0/212483818 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fcd90039500 0x7fcd9003b9c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:34.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:34.789+0000 7fcdacb9a640 1 --2- 172.21.15.1:0/212483818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcda81037c0 0x7fcda819f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:34.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:34.789+0000 7fcdacb9a640 1 --2- 172.21.15.1:0/212483818 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcda8102e00 0x7fcda81983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:34.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:34.789+0000 7fcdacb9a640 1 --2- 172.21.15.1:0/212483818 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcda8101c00 0x7fcda8197ea0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:34.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:34.789+0000 7fcdacb9a640 1 -- 172.21.15.1:0/212483818 >> 172.21.15.1:0/212483818 conn(0x7fcda80fd390 msgr2=0x7fcda8106150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:34.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:34.789+0000 7fcdacb9a640 1 -- 172.21.15.1:0/212483818 shutdown_connections 2024-09-19T09:30:34.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:30:34.789+0000 7fcdacb9a640 1 -- 172.21.15.1:0/212483818 wait complete. 2024-09-19T09:30:35.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:34 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:35.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:34 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:35.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:34 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:35.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:34 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:35.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:34 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:35.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:34 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:35.146 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:34 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:35.146 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:34 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:35.146 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:34 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:35.423 DEBUG:teuthology.orchestra.run.smithi001:osd.0> sudo journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@osd.0.service 2024-09-19T09:30:35.425 INFO:tasks.cephadm:Deploying osd.1 on smithi022 with /dev/vg_nvme/lv_4... 2024-09-19T09:30:35.425 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T09:30:35.670 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:30:35.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:35 smithi001 ceph-mon[31225]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:36.077 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:35 smithi022 ceph-mon[35583]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:36.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:35 smithi121 ceph-mon[35577]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:36.730 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:30:36 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-0[42367]: 2024-09-19T09:30:36.551+0000 7ff231065640 -1 osd.0 0 log_to_monitors true 2024-09-19T09:30:36.984 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:36 smithi022 ceph-mon[35583]: from='osd.0 [v2:172.21.15.1:6802/502676986,v1:172.21.15.1:6803/502676986]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T09:30:36.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:36 smithi001 ceph-mon[31225]: from='osd.0 [v2:172.21.15.1:6802/502676986,v1:172.21.15.1:6803/502676986]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T09:30:37.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:36 smithi121 ceph-mon[35577]: from='osd.0 [v2:172.21.15.1:6802/502676986,v1:172.21.15.1:6803/502676986]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T09:30:37.990 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T09:30:38.015 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi022:vg_nvme/lv_4 2024-09-19T09:30:38.120 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:37 smithi001 ceph-mon[31225]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:38.120 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:37 smithi001 ceph-mon[31225]: from='osd.0 [v2:172.21.15.1:6802/502676986,v1:172.21.15.1:6803/502676986]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T09:30:38.120 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:37 smithi001 ceph-mon[31225]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T09:30:38.120 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:37 smithi001 ceph-mon[31225]: from='osd.0 [v2:172.21.15.1:6802/502676986,v1:172.21.15.1:6803/502676986]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T09:30:38.121 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:37 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:30:38.268 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:30:38.298 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:37 smithi022 ceph-mon[35583]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:38.298 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:37 smithi022 ceph-mon[35583]: from='osd.0 [v2:172.21.15.1:6802/502676986,v1:172.21.15.1:6803/502676986]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T09:30:38.298 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:37 smithi022 ceph-mon[35583]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T09:30:38.298 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:37 smithi022 ceph-mon[35583]: from='osd.0 [v2:172.21.15.1:6802/502676986,v1:172.21.15.1:6803/502676986]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T09:30:38.298 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:37 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:30:38.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:37 smithi121 ceph-mon[35577]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:38.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:37 smithi121 ceph-mon[35577]: from='osd.0 [v2:172.21.15.1:6802/502676986,v1:172.21.15.1:6803/502676986]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T09:30:38.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:37 smithi121 ceph-mon[35577]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T09:30:38.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:37 smithi121 ceph-mon[35577]: from='osd.0 [v2:172.21.15.1:6802/502676986,v1:172.21.15.1:6803/502676986]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T09:30:38.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:37 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:30:38.497 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:30:38 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-0[42367]: 2024-09-19T09:30:38.283+0000 7ff22cfe8640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T09:30:38.497 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:30:38 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-0[42367]: 2024-09-19T09:30:38.286+0000 7ff224e08640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:30:38.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.708+0000 7fe228e9f640 1 -- 172.21.15.22:0/631160717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2241004b0 msgr2=0x7fe2241008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:38.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.708+0000 7fe228e9f640 1 --2- 172.21.15.22:0/631160717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2241004b0 0x7fe2241008b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009900 tx=0x7fe21c02a410 comp rx=0 tx=0).stop 2024-09-19T09:30:38.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.708+0000 7fe228e9f640 1 -- 172.21.15.22:0/631160717 shutdown_connections 2024-09-19T09:30:38.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.708+0000 7fe228e9f640 1 --2- 172.21.15.22:0/631160717 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe224101790 0x7fe224101c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:38.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.708+0000 7fe228e9f640 1 --2- 172.21.15.22:0/631160717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe224100df0 0x7fe224101250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:38.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.708+0000 7fe228e9f640 1 --2- 172.21.15.22:0/631160717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2241004b0 0x7fe2241008b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:38.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.708+0000 7fe228e9f640 1 -- 172.21.15.22:0/631160717 >> 172.21.15.22:0/631160717 conn(0x7fe2240fc280 msgr2=0x7fe2240fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:38.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.709+0000 7fe228e9f640 1 -- 172.21.15.22:0/631160717 shutdown_connections 2024-09-19T09:30:38.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.709+0000 7fe228e9f640 1 -- 172.21.15.22:0/631160717 wait complete. 2024-09-19T09:30:38.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.709+0000 7fe228e9f640 1 Processor -- start 2024-09-19T09:30:38.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.709+0000 7fe228e9f640 1 -- start start 2024-09-19T09:30:38.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.709+0000 7fe228e9f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2241004b0 0x7fe22419a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:38.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.709+0000 7fe228e9f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe224100df0 0x7fe22419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:38.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.709+0000 7fe228e9f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe224101790 0x7fe2241a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:38.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.710+0000 7fe228e9f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe22410fa20 con 0x7fe224101790 2024-09-19T09:30:38.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.710+0000 7fe228e9f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe22410f8a0 con 0x7fe2241004b0 2024-09-19T09:30:38.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.710+0000 7fe228e9f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe22410fba0 con 0x7fe224100df0 2024-09-19T09:30:38.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.710+0000 7fe22259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2241004b0 0x7fe22419a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:38.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.710+0000 7fe22259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2241004b0 0x7fe22419a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:45502/0 (socket says 172.21.15.22:45502) 2024-09-19T09:30:38.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.710+0000 7fe22259c640 1 -- 172.21.15.22:0/889965640 learned_addr learned my addr 172.21.15.22:0/889965640 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-19T09:30:38.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.710+0000 7fe221d9b640 1 --2- 172.21.15.22:0/889965640 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe224100df0 0x7fe22419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:38.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.710+0000 7fe22259c640 1 -- 172.21.15.22:0/889965640 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe224100df0 msgr2=0x7fe22419a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:38.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.710+0000 7fe222d9d640 1 --2- 172.21.15.22:0/889965640 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe224101790 0x7fe2241a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:38.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.710+0000 7fe22259c640 1 --2- 172.21.15.22:0/889965640 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe224100df0 0x7fe22419a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:38.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.710+0000 7fe22259c640 1 -- 172.21.15.22:0/889965640 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe224101790 msgr2=0x7fe2241a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:38.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.710+0000 7fe22259c640 1 --2- 172.21.15.22:0/889965640 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe224101790 0x7fe2241a1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:38.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.710+0000 7fe22259c640 1 -- 172.21.15.22:0/889965640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2241a1c80 con 0x7fe2241004b0 2024-09-19T09:30:38.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.710+0000 7fe221d9b640 1 --2- 172.21.15.22:0/889965640 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe224100df0 0x7fe22419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:30:38.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.710+0000 7fe22259c640 1 --2- 172.21.15.22:0/889965640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2241004b0 0x7fe22419a050 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009230 tx=0x7fe21c004360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:38.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.710+0000 7fe2137fe640 1 -- 172.21.15.22:0/889965640 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c03f030 con 0x7fe2241004b0 2024-09-19T09:30:38.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.710+0000 7fe2137fe640 1 -- 172.21.15.22:0/889965640 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe21c003ce0 con 0x7fe2241004b0 2024-09-19T09:30:38.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.710+0000 7fe228e9f640 1 -- 172.21.15.22:0/889965640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2241a1f10 con 0x7fe2241004b0 2024-09-19T09:30:38.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.710+0000 7fe2137fe640 1 -- 172.21.15.22:0/889965640 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c035070 con 0x7fe2241004b0 2024-09-19T09:30:38.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.710+0000 7fe228e9f640 1 -- 172.21.15.22:0/889965640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2241a2310 con 0x7fe2241004b0 2024-09-19T09:30:38.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.712+0000 7fe228e9f640 1 -- 172.21.15.22:0/889965640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe22410b200 con 0x7fe2241004b0 2024-09-19T09:30:38.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.713+0000 7fe2137fe640 1 -- 172.21.15.22:0/889965640 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7fe21c042030 con 0x7fe2241004b0 2024-09-19T09:30:38.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.713+0000 7fe2137fe640 1 --2- 172.21.15.22:0/889965640 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe20c0a31e0 0x7fe20c0a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:30:38.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.714+0000 7fe2137fe640 1 -- 172.21.15.22:0/889965640 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7fe21c0ee0e0 con 0x7fe2241004b0 2024-09-19T09:30:38.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.714+0000 7fe221d9b640 1 --2- 172.21.15.22:0/889965640 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe20c0a31e0 0x7fe20c0a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:30:38.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.714+0000 7fe221d9b640 1 --2- 172.21.15.22:0/889965640 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe20c0a31e0 0x7fe20c0a56a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe22419b570 tx=0x7fe214008350 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:30:38.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.718+0000 7fe2137fe640 1 -- 172.21.15.22:0/889965640 <== mon.2 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe21c0bc990 con 0x7fe2241004b0 2024-09-19T09:30:38.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:38.905+0000 7fe228e9f640 1 -- 172.21.15.22:0/889965640 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fe224062630 con 0x7fe20c0a31e0 2024-09-19T09:30:39.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:38 smithi001 ceph-mon[31225]: from='osd.0 [v2:172.21.15.1:6802/502676986,v1:172.21.15.1:6803/502676986]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T09:30:39.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:38 smithi001 ceph-mon[31225]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T09:30:39.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:38 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:30:39.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:38 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:30:39.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:38 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:39.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:38 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:39.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:38 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:30:39.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:38 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:39.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:38 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:39.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:38 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:39.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:38 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:39.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:38 smithi001 ceph-mon[31225]: from='osd.0 [v2:172.21.15.1:6802/502676986,v1:172.21.15.1:6803/502676986]' entity='osd.0' 2024-09-19T09:30:39.284 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:38 smithi022 ceph-mon[35583]: from='osd.0 [v2:172.21.15.1:6802/502676986,v1:172.21.15.1:6803/502676986]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T09:30:39.284 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:38 smithi022 ceph-mon[35583]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T09:30:39.284 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:38 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:30:39.284 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:38 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:30:39.284 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:38 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:39.284 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:38 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:39.284 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:38 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:30:39.284 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:38 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:39.284 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:38 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:39.284 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:38 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:39.284 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:38 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:39.285 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:38 smithi022 ceph-mon[35583]: from='osd.0 [v2:172.21.15.1:6802/502676986,v1:172.21.15.1:6803/502676986]' entity='osd.0' 2024-09-19T09:30:39.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:38 smithi121 ceph-mon[35577]: from='osd.0 [v2:172.21.15.1:6802/502676986,v1:172.21.15.1:6803/502676986]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T09:30:39.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:38 smithi121 ceph-mon[35577]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T09:30:39.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:38 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:30:39.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:38 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:30:39.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:38 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:39.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:38 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:39.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:38 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:30:39.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:38 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:39.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:38 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:39.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:38 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:39.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:38 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:39.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:38 smithi121 ceph-mon[35577]: from='osd.0 [v2:172.21.15.1:6802/502676986,v1:172.21.15.1:6803/502676986]' entity='osd.0' 2024-09-19T09:30:40.146 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:39 smithi022 ceph-mon[35583]: purged_snaps scrub starts 2024-09-19T09:30:40.146 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:39 smithi022 ceph-mon[35583]: purged_snaps scrub ok 2024-09-19T09:30:40.146 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:39 smithi022 ceph-mon[35583]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:40.147 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:39 smithi022 ceph-mon[35583]: Detected new or changed devices on smithi001 2024-09-19T09:30:40.147 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:39 smithi022 ceph-mon[35583]: Adjusting osd_memory_target on smithi001 to 17092M 2024-09-19T09:30:40.147 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:39 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:30:40.147 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:39 smithi022 ceph-mon[35583]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:30:40.147 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:39 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:30:40.147 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:39 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:30:40.147 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:39 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:40.147 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:39 smithi022 ceph-mon[35583]: osd.0 [v2:172.21.15.1:6802/502676986,v1:172.21.15.1:6803/502676986] boot 2024-09-19T09:30:40.147 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:39 smithi022 ceph-mon[35583]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T09:30:40.147 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:39 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:30:40.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:39 smithi001 ceph-mon[31225]: purged_snaps scrub starts 2024-09-19T09:30:40.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:39 smithi001 ceph-mon[31225]: purged_snaps scrub ok 2024-09-19T09:30:40.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:39 smithi001 ceph-mon[31225]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:40.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:39 smithi001 ceph-mon[31225]: Detected new or changed devices on smithi001 2024-09-19T09:30:40.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:39 smithi001 ceph-mon[31225]: Adjusting osd_memory_target on smithi001 to 17092M 2024-09-19T09:30:40.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:39 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:30:40.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:39 smithi001 ceph-mon[31225]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:30:40.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:39 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:30:40.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:39 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:30:40.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:39 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:40.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:39 smithi001 ceph-mon[31225]: osd.0 [v2:172.21.15.1:6802/502676986,v1:172.21.15.1:6803/502676986] boot 2024-09-19T09:30:40.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:39 smithi001 ceph-mon[31225]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T09:30:40.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:39 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:30:40.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:39 smithi121 ceph-mon[35577]: purged_snaps scrub starts 2024-09-19T09:30:40.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:39 smithi121 ceph-mon[35577]: purged_snaps scrub ok 2024-09-19T09:30:40.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:39 smithi121 ceph-mon[35577]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T09:30:40.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:39 smithi121 ceph-mon[35577]: Detected new or changed devices on smithi001 2024-09-19T09:30:40.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:39 smithi121 ceph-mon[35577]: Adjusting osd_memory_target on smithi001 to 17092M 2024-09-19T09:30:40.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:39 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:30:40.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:39 smithi121 ceph-mon[35577]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:30:40.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:39 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:30:40.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:39 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:30:40.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:39 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:40.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:39 smithi121 ceph-mon[35577]: osd.0 [v2:172.21.15.1:6802/502676986,v1:172.21.15.1:6803/502676986] boot 2024-09-19T09:30:40.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:39 smithi121 ceph-mon[35577]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T09:30:40.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:39 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T09:30:41.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:41 smithi022 ceph-mon[35583]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:30:41.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:41 smithi022 ceph-mon[35583]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T09:30:41.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:41 smithi022 ceph-mon[35583]: from='client.? 172.21.15.22:0/839812182' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "baf120f8-8ba3-4aa5-a12a-41cdc97ff11b"}]: dispatch 2024-09-19T09:30:41.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:41 smithi022 ceph-mon[35583]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "baf120f8-8ba3-4aa5-a12a-41cdc97ff11b"}]: dispatch 2024-09-19T09:30:41.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:41 smithi022 ceph-mon[35583]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "baf120f8-8ba3-4aa5-a12a-41cdc97ff11b"}]': finished 2024-09-19T09:30:41.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:41 smithi022 ceph-mon[35583]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T09:30:41.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:41 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:30:41.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:41 smithi121 ceph-mon[35577]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:30:41.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:41 smithi121 ceph-mon[35577]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T09:30:41.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:41 smithi121 ceph-mon[35577]: from='client.? 172.21.15.22:0/839812182' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "baf120f8-8ba3-4aa5-a12a-41cdc97ff11b"}]: dispatch 2024-09-19T09:30:41.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:41 smithi121 ceph-mon[35577]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "baf120f8-8ba3-4aa5-a12a-41cdc97ff11b"}]: dispatch 2024-09-19T09:30:41.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:41 smithi121 ceph-mon[35577]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "baf120f8-8ba3-4aa5-a12a-41cdc97ff11b"}]': finished 2024-09-19T09:30:41.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:41 smithi121 ceph-mon[35577]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T09:30:41.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:41 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:30:41.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:41 smithi001 ceph-mon[31225]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:30:41.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:41 smithi001 ceph-mon[31225]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T09:30:41.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:41 smithi001 ceph-mon[31225]: from='client.? 172.21.15.22:0/839812182' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "baf120f8-8ba3-4aa5-a12a-41cdc97ff11b"}]: dispatch 2024-09-19T09:30:41.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:41 smithi001 ceph-mon[31225]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "baf120f8-8ba3-4aa5-a12a-41cdc97ff11b"}]: dispatch 2024-09-19T09:30:41.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:41 smithi001 ceph-mon[31225]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "baf120f8-8ba3-4aa5-a12a-41cdc97ff11b"}]': finished 2024-09-19T09:30:41.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:41 smithi001 ceph-mon[31225]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T09:30:41.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:41 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:30:42.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:42 smithi022 ceph-mon[35583]: from='client.? 172.21.15.22:0/3628665112' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:30:42.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:42 smithi121 ceph-mon[35577]: from='client.? 172.21.15.22:0/3628665112' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:30:42.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:42 smithi001 ceph-mon[31225]: from='client.? 172.21.15.22:0/3628665112' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:30:43.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:43 smithi022 ceph-mon[35583]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:30:43.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:43 smithi121 ceph-mon[35577]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:30:43.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:43 smithi001 ceph-mon[31225]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:30:45.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:45 smithi022 ceph-mon[35583]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:30:45.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:45 smithi121 ceph-mon[35577]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:30:45.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:45 smithi001 ceph-mon[31225]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:30:47.490 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:47 smithi022 ceph-mon[35583]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:30:47.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:47 smithi121 ceph-mon[35577]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:30:47.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:47 smithi001 ceph-mon[31225]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:30:49.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:49 smithi022 ceph-mon[35583]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:30:49.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:49 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T09:30:49.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:49 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:49.570 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:49 smithi001 ceph-mon[31225]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:30:49.570 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:49 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T09:30:49.570 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:49 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:49.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:49 smithi121 ceph-mon[35577]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:30:49.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:49 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T09:30:49.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:49 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:50.549 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:50 smithi022 ceph-mon[35583]: Deploying daemon osd.1 on smithi022 2024-09-19T09:30:50.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:50 smithi121 ceph-mon[35577]: Deploying daemon osd.1 on smithi022 2024-09-19T09:30:50.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:50 smithi001 ceph-mon[31225]: Deploying daemon osd.1 on smithi022 2024-09-19T09:30:51.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:51 smithi022 ceph-mon[35583]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:30:51.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:51 smithi121 ceph-mon[35577]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:30:51.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:51 smithi001 ceph-mon[31225]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:30:53.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:53 smithi022 ceph-mon[35583]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:30:53.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:53 smithi121 ceph-mon[35577]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:30:53.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:53 smithi001 ceph-mon[31225]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:30:55.480 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:55 smithi022 ceph-mon[35583]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:30:55.480 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:55 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:55.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:55 smithi121 ceph-mon[35577]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:30:55.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:55 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:55.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:55 smithi001 ceph-mon[31225]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:30:55.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:55 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:56.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:56 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:56.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:56 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:56.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:56 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:56.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:56 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:56.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:56 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:56.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:56 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:57.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:57 smithi022 ceph-mon[35583]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:30:57.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:57 smithi121 ceph-mon[35577]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:30:57.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:57 smithi001 ceph-mon[31225]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:30:58.953 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:58 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:58.953 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:58 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:58.953 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:58 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:58.953 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:58 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:58.953 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:58 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:58.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:58 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:58.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:58 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:58.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:58 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:58.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:58 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:58.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:58 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:59.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:58 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:59.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:58 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:59.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:58 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:30:59.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:58 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:30:59.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:58 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:59.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:59.258+0000 7fe2137fe640 1 -- 172.21.15.22:0/889965640 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe224062630 con 0x7fe20c0a31e0 2024-09-19T09:30:59.260 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 1 on host 'smithi022' 2024-09-19T09:30:59.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:59.260+0000 7fe228e9f640 1 -- 172.21.15.22:0/889965640 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe20c0a31e0 msgr2=0x7fe20c0a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:59.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:59.260+0000 7fe228e9f640 1 --2- 172.21.15.22:0/889965640 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe20c0a31e0 0x7fe20c0a56a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe22419b570 tx=0x7fe214008350 comp rx=0 tx=0).stop 2024-09-19T09:30:59.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:59.261+0000 7fe228e9f640 1 -- 172.21.15.22:0/889965640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2241004b0 msgr2=0x7fe22419a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:30:59.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:59.261+0000 7fe228e9f640 1 --2- 172.21.15.22:0/889965640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2241004b0 0x7fe22419a050 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009230 tx=0x7fe21c004360 comp rx=0 tx=0).stop 2024-09-19T09:30:59.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:59.261+0000 7fe228e9f640 1 -- 172.21.15.22:0/889965640 shutdown_connections 2024-09-19T09:30:59.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:59.261+0000 7fe228e9f640 1 --2- 172.21.15.22:0/889965640 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe224101790 0x7fe2241a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:59.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:59.261+0000 7fe228e9f640 1 --2- 172.21.15.22:0/889965640 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe224100df0 0x7fe22419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:59.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:59.261+0000 7fe228e9f640 1 --2- 172.21.15.22:0/889965640 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe20c0a31e0 0x7fe20c0a56a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:59.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:59.261+0000 7fe228e9f640 1 --2- 172.21.15.22:0/889965640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2241004b0 0x7fe22419a050 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:30:59.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:59.261+0000 7fe228e9f640 1 -- 172.21.15.22:0/889965640 >> 172.21.15.22:0/889965640 conn(0x7fe2240fc280 msgr2=0x7fe2240fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:30:59.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:59.261+0000 7fe228e9f640 1 -- 172.21.15.22:0/889965640 shutdown_connections 2024-09-19T09:30:59.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:30:59.261+0000 7fe228e9f640 1 -- 172.21.15.22:0/889965640 wait complete. 2024-09-19T09:30:59.859 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:59 smithi022 ceph-mon[35583]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:30:59.859 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:59 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:59.859 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:59 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:59.859 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:30:59 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:59.885 DEBUG:teuthology.orchestra.run.smithi022:osd.1> sudo journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@osd.1.service 2024-09-19T09:30:59.887 INFO:tasks.cephadm:Deploying osd.2 on smithi121 with /dev/vg_nvme/lv_4... 2024-09-19T09:30:59.888 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T09:30:59.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:59 smithi001 ceph-mon[31225]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:30:59.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:59 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:30:59.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:59 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:30:59.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:30:59 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:00.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:59 smithi121 ceph-mon[35577]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:31:00.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:59 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:00.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:59 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:00.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:30:59 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:00.138 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:31:01.176 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:31:00 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-1[40053]: 2024-09-19T09:31:00.911+0000 7f83ee36e640 -1 osd.1 0 log_to_monitors true 2024-09-19T09:31:01.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:01 smithi001 ceph-mon[31225]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:31:01.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:01 smithi001 ceph-mon[31225]: from='osd.1 [v2:172.21.15.22:6800/3735826323,v1:172.21.15.22:6801/3735826323]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:31:01.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:01 smithi001 ceph-mon[31225]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:31:02.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:01 smithi022 ceph-mon[35583]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:31:02.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:01 smithi022 ceph-mon[35583]: from='osd.1 [v2:172.21.15.22:6800/3735826323,v1:172.21.15.22:6801/3735826323]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:31:02.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:01 smithi022 ceph-mon[35583]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:31:02.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:01 smithi121 ceph-mon[35577]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:31:02.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:01 smithi121 ceph-mon[35577]: from='osd.1 [v2:172.21.15.22:6800/3735826323,v1:172.21.15.22:6801/3735826323]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:31:02.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:01 smithi121 ceph-mon[35577]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T09:31:02.432 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-19T09:31:02.457 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi121:vg_nvme/lv_4 2024-09-19T09:31:02.706 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:31:02.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:02 smithi022 ceph-mon[35583]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T09:31:02.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:02 smithi022 ceph-mon[35583]: from='osd.1 [v2:172.21.15.22:6800/3735826323,v1:172.21.15.22:6801/3735826323]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T09:31:02.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:02 smithi022 ceph-mon[35583]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T09:31:02.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:02 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:31:02.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:02 smithi022 ceph-mon[35583]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T09:31:02.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:02 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:02.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:02 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:02.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:02 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:31:02.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:02 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:02.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:02 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:02.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:02 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:02.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:02 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:03.067 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:02 smithi121 ceph-mon[35577]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T09:31:03.067 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:02 smithi121 ceph-mon[35577]: from='osd.1 [v2:172.21.15.22:6800/3735826323,v1:172.21.15.22:6801/3735826323]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T09:31:03.067 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:02 smithi121 ceph-mon[35577]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T09:31:03.067 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:02 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:31:03.067 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:02 smithi121 ceph-mon[35577]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T09:31:03.067 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:02 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:03.067 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:02 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:03.067 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:02 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:31:03.067 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:02 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:03.067 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:02 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:03.067 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:02 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:03.068 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:02 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:03.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.150+0000 7fb49f027640 1 -- 172.21.15.121:0/3170995076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb498102eb0 msgr2=0x7fb498103330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:03.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.150+0000 7fb49f027640 1 --2- 172.21.15.121:0/3170995076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb498102eb0 0x7fb498103330 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb484009930 tx=0x7fb48402a420 comp rx=0 tx=0).stop 2024-09-19T09:31:03.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.150+0000 7fb49f027640 1 -- 172.21.15.121:0/3170995076 shutdown_connections 2024-09-19T09:31:03.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.150+0000 7fb49f027640 1 --2- 172.21.15.121:0/3170995076 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb498103870 0x7fb49810a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:03.166 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.150+0000 7fb49f027640 1 --2- 172.21.15.121:0/3170995076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb498102eb0 0x7fb498103330 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:03.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.150+0000 7fb49f027640 1 --2- 172.21.15.121:0/3170995076 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4980ffed0 0x7fb4981002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:03.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.150+0000 7fb49f027640 1 -- 172.21.15.121:0/3170995076 >> 172.21.15.121:0/3170995076 conn(0x7fb4980fba40 msgr2=0x7fb4980fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:03.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.150+0000 7fb49f027640 1 -- 172.21.15.121:0/3170995076 shutdown_connections 2024-09-19T09:31:03.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.150+0000 7fb49f027640 1 -- 172.21.15.121:0/3170995076 wait complete. 2024-09-19T09:31:03.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.150+0000 7fb49f027640 1 Processor -- start 2024-09-19T09:31:03.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.151+0000 7fb49f027640 1 -- start start 2024-09-19T09:31:03.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.151+0000 7fb49f027640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4980ffed0 0x7fb498102810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:03.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.151+0000 7fb49f027640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb498102eb0 0x7fb498100e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:03.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.151+0000 7fb49f027640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb498103870 0x7fb4981013a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:03.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.151+0000 7fb49f027640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb49810d8b0 con 0x7fb498103870 2024-09-19T09:31:03.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.151+0000 7fb49f027640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb49810d730 con 0x7fb498102eb0 2024-09-19T09:31:03.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.151+0000 7fb49f027640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb49810da30 con 0x7fb4980ffed0 2024-09-19T09:31:03.167 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.151+0000 7fb49cdc3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4980ffed0 0x7fb498102810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:03.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.151+0000 7fb49cdc3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4980ffed0 0x7fb498102810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:34126/0 (socket says 172.21.15.121:34126) 2024-09-19T09:31:03.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.151+0000 7fb49cdc3640 1 -- 172.21.15.121:0/3213930514 learned_addr learned my addr 172.21.15.121:0/3213930514 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-19T09:31:03.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.151+0000 7fb497fff640 1 --2- 172.21.15.121:0/3213930514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb498102eb0 0x7fb498100e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:03.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.151+0000 7fb49d5c4640 1 --2- 172.21.15.121:0/3213930514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb498103870 0x7fb4981013a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:03.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.151+0000 7fb49cdc3640 1 -- 172.21.15.121:0/3213930514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb498102eb0 msgr2=0x7fb498100e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:03.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.151+0000 7fb49cdc3640 1 --2- 172.21.15.121:0/3213930514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb498102eb0 0x7fb498100e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:03.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.151+0000 7fb49cdc3640 1 -- 172.21.15.121:0/3213930514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb498103870 msgr2=0x7fb4981013a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:03.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.151+0000 7fb49cdc3640 1 --2- 172.21.15.121:0/3213930514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb498103870 0x7fb4981013a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:03.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.151+0000 7fb49cdc3640 1 -- 172.21.15.121:0/3213930514 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb498101c60 con 0x7fb4980ffed0 2024-09-19T09:31:03.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.151+0000 7fb49cdc3640 1 --2- 172.21.15.121:0/3213930514 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4980ffed0 0x7fb498102810 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb48c00e9c0 tx=0x7fb48c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:03.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.151+0000 7fb495ffb640 1 -- 172.21.15.121:0/3213930514 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb48c00cd80 con 0x7fb4980ffed0 2024-09-19T09:31:03.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.152+0000 7fb495ffb640 1 -- 172.21.15.121:0/3213930514 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb48c0035f0 con 0x7fb4980ffed0 2024-09-19T09:31:03.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.152+0000 7fb49f027640 1 -- 172.21.15.121:0/3213930514 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4981a2130 con 0x7fb4980ffed0 2024-09-19T09:31:03.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.152+0000 7fb495ffb640 1 -- 172.21.15.121:0/3213930514 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb48c010690 con 0x7fb4980ffed0 2024-09-19T09:31:03.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.152+0000 7fb49f027640 1 -- 172.21.15.121:0/3213930514 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4981a2640 con 0x7fb4980ffed0 2024-09-19T09:31:03.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.153+0000 7fb49f027640 1 -- 172.21.15.121:0/3213930514 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4981091a0 con 0x7fb4980ffed0 2024-09-19T09:31:03.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.154+0000 7fb495ffb640 1 -- 172.21.15.121:0/3213930514 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7fb48c0037a0 con 0x7fb4980ffed0 2024-09-19T09:31:03.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.154+0000 7fb495ffb640 1 --2- 172.21.15.121:0/3213930514 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb4880a3230 0x7fb4880a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:03.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.154+0000 7fb495ffb640 1 -- 172.21.15.121:0/3213930514 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7fb48c0ce2f0 con 0x7fb4980ffed0 2024-09-19T09:31:03.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.155+0000 7fb497fff640 1 --2- 172.21.15.121:0/3213930514 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb4880a3230 0x7fb4880a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:03.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.155+0000 7fb497fff640 1 --2- 172.21.15.121:0/3213930514 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb4880a3230 0x7fb4880a56f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb484006010 tx=0x7fb4840315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:03.169 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.159+0000 7fb495ffb640 1 -- 172.21.15.121:0/3213930514 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb48c09c980 con 0x7fb4980ffed0 2024-09-19T09:31:03.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:02 smithi001 ceph-mon[31225]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T09:31:03.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:02 smithi001 ceph-mon[31225]: from='osd.1 [v2:172.21.15.22:6800/3735826323,v1:172.21.15.22:6801/3735826323]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T09:31:03.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:02 smithi001 ceph-mon[31225]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T09:31:03.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:02 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:31:03.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:02 smithi001 ceph-mon[31225]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T09:31:03.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:02 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:03.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:02 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:03.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:02 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:31:03.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:02 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:03.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:02 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:03.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:02 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:03.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:02 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:03.365 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:03.364+0000 7fb49f027640 1 -- 172.21.15.121:0/3213930514 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fb498062630 con 0x7fb4880a3230 2024-09-19T09:31:03.614 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:31:03 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-1[40053]: 2024-09-19T09:31:03.171+0000 7f83ea2f1640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T09:31:03.614 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:31:03 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-1[40053]: 2024-09-19T09:31:03.174+0000 7f83e2111640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:31:04.061 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:03 smithi121 ceph-mon[35577]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:31:04.061 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:03 smithi121 ceph-mon[35577]: Detected new or changed devices on smithi022 2024-09-19T09:31:04.061 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:03 smithi121 ceph-mon[35577]: Adjusting osd_memory_target on smithi022 to 17092M 2024-09-19T09:31:04.061 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:03 smithi121 ceph-mon[35577]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-19T09:31:04.061 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:03 smithi121 ceph-mon[35577]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T09:31:04.062 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:03 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:31:04.062 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:03 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:31:04.062 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:03 smithi121 ceph-mon[35577]: from='osd.1 ' entity='osd.1' 2024-09-19T09:31:04.062 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:03 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:31:04.062 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:03 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:31:04.062 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:03 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:04.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:03 smithi022 ceph-mon[35583]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:31:04.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:03 smithi022 ceph-mon[35583]: Detected new or changed devices on smithi022 2024-09-19T09:31:04.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:03 smithi022 ceph-mon[35583]: Adjusting osd_memory_target on smithi022 to 17092M 2024-09-19T09:31:04.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:03 smithi022 ceph-mon[35583]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-19T09:31:04.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:03 smithi022 ceph-mon[35583]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T09:31:04.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:03 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:31:04.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:03 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:31:04.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:03 smithi022 ceph-mon[35583]: from='osd.1 ' entity='osd.1' 2024-09-19T09:31:04.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:03 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:31:04.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:03 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:31:04.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:03 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:04.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:03 smithi001 ceph-mon[31225]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:31:04.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:03 smithi001 ceph-mon[31225]: Detected new or changed devices on smithi022 2024-09-19T09:31:04.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:03 smithi001 ceph-mon[31225]: Adjusting osd_memory_target on smithi022 to 17092M 2024-09-19T09:31:04.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:03 smithi001 ceph-mon[31225]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-19T09:31:04.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:03 smithi001 ceph-mon[31225]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T09:31:04.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:03 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:31:04.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:03 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:31:04.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:03 smithi001 ceph-mon[31225]: from='osd.1 ' entity='osd.1' 2024-09-19T09:31:04.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:03 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:31:04.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:03 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:31:04.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:03 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:04.913 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:04 smithi121 ceph-mon[35577]: purged_snaps scrub starts 2024-09-19T09:31:04.914 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:04 smithi121 ceph-mon[35577]: purged_snaps scrub ok 2024-09-19T09:31:04.914 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:04 smithi121 ceph-mon[35577]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:31:04.914 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:04 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:31:04.914 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:04 smithi121 ceph-mon[35577]: osd.1 [v2:172.21.15.22:6800/3735826323,v1:172.21.15.22:6801/3735826323] boot 2024-09-19T09:31:04.914 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:04 smithi121 ceph-mon[35577]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T09:31:04.914 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:04 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:31:05.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:04 smithi022 ceph-mon[35583]: purged_snaps scrub starts 2024-09-19T09:31:05.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:04 smithi022 ceph-mon[35583]: purged_snaps scrub ok 2024-09-19T09:31:05.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:04 smithi022 ceph-mon[35583]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:31:05.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:04 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:31:05.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:04 smithi022 ceph-mon[35583]: osd.1 [v2:172.21.15.22:6800/3735826323,v1:172.21.15.22:6801/3735826323] boot 2024-09-19T09:31:05.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:04 smithi022 ceph-mon[35583]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T09:31:05.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:04 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:31:05.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:04 smithi001 ceph-mon[31225]: purged_snaps scrub starts 2024-09-19T09:31:05.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:04 smithi001 ceph-mon[31225]: purged_snaps scrub ok 2024-09-19T09:31:05.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:04 smithi001 ceph-mon[31225]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:31:05.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:04 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:31:05.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:04 smithi001 ceph-mon[31225]: osd.1 [v2:172.21.15.22:6800/3735826323,v1:172.21.15.22:6801/3735826323] boot 2024-09-19T09:31:05.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:04 smithi001 ceph-mon[31225]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T09:31:05.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:04 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T09:31:05.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:05 smithi022 ceph-mon[35583]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:31:05.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:05 smithi022 ceph-mon[35583]: from='client.? 172.21.15.121:0/3833280956' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72c520bf-c5cc-44ee-a38c-c9bac0a6280b"}]: dispatch 2024-09-19T09:31:05.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:05 smithi022 ceph-mon[35583]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72c520bf-c5cc-44ee-a38c-c9bac0a6280b"}]: dispatch 2024-09-19T09:31:05.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:05 smithi022 ceph-mon[35583]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72c520bf-c5cc-44ee-a38c-c9bac0a6280b"}]': finished 2024-09-19T09:31:05.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:05 smithi022 ceph-mon[35583]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T09:31:05.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:05 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:31:06.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:05 smithi121 ceph-mon[35577]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:31:06.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:05 smithi121 ceph-mon[35577]: from='client.? 172.21.15.121:0/3833280956' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72c520bf-c5cc-44ee-a38c-c9bac0a6280b"}]: dispatch 2024-09-19T09:31:06.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:05 smithi121 ceph-mon[35577]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72c520bf-c5cc-44ee-a38c-c9bac0a6280b"}]: dispatch 2024-09-19T09:31:06.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:05 smithi121 ceph-mon[35577]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72c520bf-c5cc-44ee-a38c-c9bac0a6280b"}]': finished 2024-09-19T09:31:06.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:05 smithi121 ceph-mon[35577]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T09:31:06.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:05 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:31:06.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:05 smithi001 ceph-mon[31225]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T09:31:06.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:05 smithi001 ceph-mon[31225]: from='client.? 172.21.15.121:0/3833280956' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72c520bf-c5cc-44ee-a38c-c9bac0a6280b"}]: dispatch 2024-09-19T09:31:06.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:05 smithi001 ceph-mon[31225]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72c520bf-c5cc-44ee-a38c-c9bac0a6280b"}]: dispatch 2024-09-19T09:31:06.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:05 smithi001 ceph-mon[31225]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72c520bf-c5cc-44ee-a38c-c9bac0a6280b"}]': finished 2024-09-19T09:31:06.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:05 smithi001 ceph-mon[31225]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T09:31:06.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:05 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:31:07.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:06 smithi022 ceph-mon[35583]: from='client.? 172.21.15.121:0/1237495745' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:31:07.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:06 smithi121 ceph-mon[35577]: from='client.? 172.21.15.121:0/1237495745' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:31:07.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:06 smithi001 ceph-mon[31225]: from='client.? 172.21.15.121:0/1237495745' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:31:08.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:07 smithi022 ceph-mon[35583]: pgmap v60: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:08.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:07 smithi121 ceph-mon[35577]: pgmap v60: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:08.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:07 smithi001 ceph-mon[31225]: pgmap v60: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:10.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:09 smithi022 ceph-mon[35583]: pgmap v61: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:10.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:09 smithi121 ceph-mon[35577]: pgmap v61: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:10.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:09 smithi001 ceph-mon[31225]: pgmap v61: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:12.013 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:11 smithi121 ceph-mon[35577]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:12.113 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:11 smithi022 ceph-mon[35583]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:12.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:11 smithi001 ceph-mon[31225]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:13.866 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:13 smithi121 ceph-mon[35577]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:14.113 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:13 smithi022 ceph-mon[35583]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:14.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:13 smithi001 ceph-mon[31225]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:14.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:14 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T09:31:14.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:14 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:14.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:14 smithi121 ceph-mon[35577]: Deploying daemon osd.2 on smithi121 2024-09-19T09:31:15.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:14 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T09:31:15.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:14 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:15.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:14 smithi022 ceph-mon[35583]: Deploying daemon osd.2 on smithi121 2024-09-19T09:31:15.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:14 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T09:31:15.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:14 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:15.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:14 smithi001 ceph-mon[31225]: Deploying daemon osd.2 on smithi121 2024-09-19T09:31:16.113 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:15 smithi022 ceph-mon[35583]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:16.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:15 smithi121 ceph-mon[35577]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:16.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:15 smithi001 ceph-mon[31225]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:18.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:17 smithi022 ceph-mon[35583]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:18.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:17 smithi121 ceph-mon[35577]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:18.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:17 smithi001 ceph-mon[31225]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:20.049 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:19 smithi001 ceph-mon[31225]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:20.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:19 smithi022 ceph-mon[35583]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:20.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:19 smithi121 ceph-mon[35577]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:21.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:20 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:21.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:20 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:21.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:20 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:21.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:20 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:21.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:20 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:21.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:20 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:21.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:20 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:21.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:20 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:21.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:20 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:22.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:22 smithi121 ceph-mon[35577]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:22.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:22 smithi022 ceph-mon[35583]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:22.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:22 smithi001 ceph-mon[31225]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:23.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:23 smithi001 ceph-mon[31225]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:23.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:23 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:23.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:23 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:23.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:23 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:23.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:23 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:23.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:23 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:23.767 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:23 smithi121 ceph-mon[35577]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:23.767 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:23 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:23.768 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:23 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:23.768 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:23 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:23.768 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:23 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:23.768 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:23 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:23.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:23 smithi022 ceph-mon[35583]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:23.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:23 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:23.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:23 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:23.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:23 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:23.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:23 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:23.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:23 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:24.187 INFO:teuthology.orchestra.run.smithi121.stdout:Created osd(s) 2 on host 'smithi121' 2024-09-19T09:31:24.187 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:24.185+0000 7fb495ffb640 1 -- 172.21.15.121:0/3213930514 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb498062630 con 0x7fb4880a3230 2024-09-19T09:31:24.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:24.187+0000 7fb49f027640 1 -- 172.21.15.121:0/3213930514 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb4880a3230 msgr2=0x7fb4880a56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:24.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:24.187+0000 7fb49f027640 1 --2- 172.21.15.121:0/3213930514 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb4880a3230 0x7fb4880a56f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb484006010 tx=0x7fb4840315b0 comp rx=0 tx=0).stop 2024-09-19T09:31:24.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:24.187+0000 7fb49f027640 1 -- 172.21.15.121:0/3213930514 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4980ffed0 msgr2=0x7fb498102810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:24.189 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:24.187+0000 7fb49f027640 1 --2- 172.21.15.121:0/3213930514 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4980ffed0 0x7fb498102810 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb48c00e9c0 tx=0x7fb48c00ee80 comp rx=0 tx=0).stop 2024-09-19T09:31:24.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:24.187+0000 7fb49f027640 1 -- 172.21.15.121:0/3213930514 shutdown_connections 2024-09-19T09:31:24.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:24.187+0000 7fb49f027640 1 --2- 172.21.15.121:0/3213930514 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb498103870 0x7fb4981013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:24.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:24.187+0000 7fb49f027640 1 --2- 172.21.15.121:0/3213930514 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb4880a3230 0x7fb4880a56f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:24.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:24.187+0000 7fb49f027640 1 --2- 172.21.15.121:0/3213930514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb498102eb0 0x7fb498100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:24.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:24.187+0000 7fb49f027640 1 --2- 172.21.15.121:0/3213930514 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4980ffed0 0x7fb498102810 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:24.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:24.187+0000 7fb49f027640 1 -- 172.21.15.121:0/3213930514 >> 172.21.15.121:0/3213930514 conn(0x7fb4980fba40 msgr2=0x7fb498106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:24.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:24.188+0000 7fb49f027640 1 -- 172.21.15.121:0/3213930514 shutdown_connections 2024-09-19T09:31:24.190 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:31:24.188+0000 7fb49f027640 1 -- 172.21.15.121:0/3213930514 wait complete. 2024-09-19T09:31:24.746 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:24 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:24.746 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:24 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:24.746 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:24 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:24.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:24 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:24.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:24 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:24.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:24 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:24.765 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:24 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:24.765 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:24 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:24.765 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:24 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:24.778 DEBUG:teuthology.orchestra.run.smithi121:osd.2> sudo journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@osd.2.service 2024-09-19T09:31:24.780 INFO:tasks.cephadm:Deploying osd.3 on smithi001 with /dev/vg_nvme/lv_3... 2024-09-19T09:31:24.780 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T09:31:25.031 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:31:25.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:25 smithi121 ceph-mon[35577]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:25.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:25 smithi001 ceph-mon[31225]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:25.778 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:25 smithi022 ceph-mon[35583]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:26.117 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 19 09:31:25 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-2[40547]: 2024-09-19T09:31:25.828+0000 7fdd184ae640 -1 osd.2 0 log_to_monitors true 2024-09-19T09:31:26.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:26 smithi001 ceph-mon[31225]: from='osd.2 [v2:172.21.15.121:6800/1924970833,v1:172.21.15.121:6801/1924970833]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:31:26.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:26 smithi001 ceph-mon[31225]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:31:26.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:26 smithi022 ceph-mon[35583]: from='osd.2 [v2:172.21.15.121:6800/1924970833,v1:172.21.15.121:6801/1924970833]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:31:26.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:26 smithi022 ceph-mon[35583]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:31:26.866 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:26 smithi121 ceph-mon[35577]: from='osd.2 [v2:172.21.15.121:6800/1924970833,v1:172.21.15.121:6801/1924970833]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:31:26.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:26 smithi121 ceph-mon[35577]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T09:31:27.559 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:27 smithi121 ceph-mon[35577]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:27.559 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:27 smithi121 ceph-mon[35577]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T09:31:27.559 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:27 smithi121 ceph-mon[35577]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T09:31:27.559 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:27 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:31:27.559 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:27 smithi121 ceph-mon[35577]: from='osd.2 [v2:172.21.15.121:6800/1924970833,v1:172.21.15.121:6801/1924970833]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-19T09:31:27.559 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:27 smithi121 ceph-mon[35577]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-19T09:31:27.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:27 smithi001 ceph-mon[31225]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:27.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:27 smithi001 ceph-mon[31225]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T09:31:27.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:27 smithi001 ceph-mon[31225]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T09:31:27.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:27 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:31:27.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:27 smithi001 ceph-mon[31225]: from='osd.2 [v2:172.21.15.121:6800/1924970833,v1:172.21.15.121:6801/1924970833]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-19T09:31:27.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:27 smithi001 ceph-mon[31225]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-19T09:31:27.836 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:31:27.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:27 smithi022 ceph-mon[35583]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:27.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:27 smithi022 ceph-mon[35583]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T09:31:27.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:27 smithi022 ceph-mon[35583]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T09:31:27.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:27 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:31:27.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:27 smithi022 ceph-mon[35583]: from='osd.2 [v2:172.21.15.121:6800/1924970833,v1:172.21.15.121:6801/1924970833]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-19T09:31:27.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:27 smithi022 ceph-mon[35583]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-19T09:31:27.865 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi001:vg_nvme/lv_3 2024-09-19T09:31:28.121 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:31:28.366 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 19 09:31:27 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-2[40547]: 2024-09-19T09:31:27.873+0000 7fdd14c45640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T09:31:28.367 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 19 09:31:27 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-2[40547]: 2024-09-19T09:31:27.879+0000 7fdd0c251640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:31:28.494 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:28 smithi001 ceph-mon[31225]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-19T09:31:28.494 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:28 smithi001 ceph-mon[31225]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T09:31:28.494 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:28 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:31:28.495 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:28 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:31:28.495 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:28 smithi001 ceph-mon[31225]: Detected new or changed devices on smithi121 2024-09-19T09:31:28.495 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:28 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:28.495 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:28 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:28.495 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:28 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:31:28.495 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:28 smithi001 ceph-mon[31225]: Adjusting osd_memory_target on smithi121 to 17087M 2024-09-19T09:31:28.495 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:28 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:28.495 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:28 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:28.495 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:28 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:28.495 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:28 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:28.495 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:28 smithi001 ceph-mon[31225]: from='osd.2 ' entity='osd.2' 2024-09-19T09:31:28.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.579+0000 7f72f789a640 1 -- 172.21.15.1:0/1150283293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f72f0102e00 msgr2=0x7f72f0103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:28.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.579+0000 7f72f789a640 1 --2- 172.21.15.1:0/1150283293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f72f0102e00 0x7f72f0103280 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f72e0009900 tx=0x7f72e002a410 comp rx=0 tx=0).stop 2024-09-19T09:31:28.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.579+0000 7f72f789a640 1 -- 172.21.15.1:0/1150283293 shutdown_connections 2024-09-19T09:31:28.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.579+0000 7f72f789a640 1 --2- 172.21.15.1:0/1150283293 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72f01037c0 0x7f72f010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.579+0000 7f72f789a640 1 --2- 172.21.15.1:0/1150283293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f72f0102e00 0x7f72f0103280 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.579+0000 7f72f789a640 1 --2- 172.21.15.1:0/1150283293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72f0101c00 0x7f72f0102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.579+0000 7f72f789a640 1 -- 172.21.15.1:0/1150283293 >> 172.21.15.1:0/1150283293 conn(0x7f72f00fd390 msgr2=0x7f72f00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:28.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.579+0000 7f72f789a640 1 -- 172.21.15.1:0/1150283293 shutdown_connections 2024-09-19T09:31:28.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.579+0000 7f72f789a640 1 -- 172.21.15.1:0/1150283293 wait complete. 2024-09-19T09:31:28.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.579+0000 7f72f789a640 1 Processor -- start 2024-09-19T09:31:28.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.580+0000 7f72f789a640 1 -- start start 2024-09-19T09:31:28.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.580+0000 7f72f789a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72f0101c00 0x7f72f0197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:28.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.580+0000 7f72f789a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72f0102e00 0x7f72f0198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:28.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.580+0000 7f72f789a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f72f01037c0 0x7f72f019f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:28.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.580+0000 7f72f789a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f72f010d880 con 0x7f72f01037c0 2024-09-19T09:31:28.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.580+0000 7f72f789a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f72f010d700 con 0x7f72f0101c00 2024-09-19T09:31:28.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.580+0000 7f72f789a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f72f010da00 con 0x7f72f0102e00 2024-09-19T09:31:28.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.580+0000 7f72f5e37640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f72f01037c0 0x7f72f019f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:28.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.580+0000 7f72f5e37640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f72f01037c0 0x7f72f019f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55128/0 (socket says 172.21.15.1:55128) 2024-09-19T09:31:28.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.580+0000 7f72f5e37640 1 -- 172.21.15.1:0/955205460 learned_addr learned my addr 172.21.15.1:0/955205460 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:31:28.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.580+0000 7f72f4e35640 1 --2- 172.21.15.1:0/955205460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72f0102e00 0x7f72f0198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:28.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.580+0000 7f72f5636640 1 --2- 172.21.15.1:0/955205460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72f0101c00 0x7f72f0197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:28.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.580+0000 7f72f5e37640 1 -- 172.21.15.1:0/955205460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72f0102e00 msgr2=0x7f72f0198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:28.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.580+0000 7f72f5e37640 1 --2- 172.21.15.1:0/955205460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72f0102e00 0x7f72f0198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.580+0000 7f72f5e37640 1 -- 172.21.15.1:0/955205460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72f0101c00 msgr2=0x7f72f0197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:28.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.580+0000 7f72f5e37640 1 --2- 172.21.15.1:0/955205460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72f0101c00 0x7f72f0197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:28.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.580+0000 7f72f5e37640 1 -- 172.21.15.1:0/955205460 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f019fb00 con 0x7f72f01037c0 2024-09-19T09:31:28.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.580+0000 7f72f5e37640 1 --2- 172.21.15.1:0/955205460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f72f01037c0 0x7f72f019f490 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f72e800eaa0 tx=0x7f72e800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:28.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.581+0000 7f72e67fc640 1 -- 172.21.15.1:0/955205460 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e800cdb0 con 0x7f72f01037c0 2024-09-19T09:31:28.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.581+0000 7f72e67fc640 1 -- 172.21.15.1:0/955205460 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72e8005020 con 0x7f72f01037c0 2024-09-19T09:31:28.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.581+0000 7f72f789a640 1 -- 172.21.15.1:0/955205460 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f019fdf0 con 0x7f72f01037c0 2024-09-19T09:31:28.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.581+0000 7f72e67fc640 1 -- 172.21.15.1:0/955205460 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e80116b0 con 0x7f72f01037c0 2024-09-19T09:31:28.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.581+0000 7f72f789a640 1 -- 172.21.15.1:0/955205460 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f01a02a0 con 0x7f72f01037c0 2024-09-19T09:31:28.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.582+0000 7f72f789a640 1 -- 172.21.15.1:0/955205460 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72f0108fd0 con 0x7f72f01037c0 2024-09-19T09:31:28.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.583+0000 7f72e67fc640 1 -- 172.21.15.1:0/955205460 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 15) ==== 138298+0+0 (secure 0 0 0) 0x7f72e8005560 con 0x7f72f01037c0 2024-09-19T09:31:28.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.584+0000 7f72e67fc640 1 --2- 172.21.15.1:0/955205460 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f72dc0a31e0 0x7f72dc0a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:28.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.584+0000 7f72f5636640 1 --2- 172.21.15.1:0/955205460 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f72dc0a31e0 0x7f72dc0a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:28.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.584+0000 7f72e67fc640 1 -- 172.21.15.1:0/955205460 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2571+0+0 (secure 0 0 0) 0x7f72e80ce2d0 con 0x7f72f01037c0 2024-09-19T09:31:28.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.584+0000 7f72f5636640 1 --2- 172.21.15.1:0/955205460 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f72dc0a31e0 0x7f72dc0a56a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f72f0102c60 tx=0x7f72ec00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:28.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.588+0000 7f72e67fc640 1 -- 172.21.15.1:0/955205460 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f72e8016030 con 0x7f72f01037c0 2024-09-19T09:31:28.774 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:28.772+0000 7f72f789a640 1 -- 172.21.15.1:0/955205460 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f72f0062630 con 0x7f72dc0a31e0 2024-09-19T09:31:28.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:28 smithi022 ceph-mon[35583]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-19T09:31:28.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:28 smithi022 ceph-mon[35583]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T09:31:28.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:28 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:31:28.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:28 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:31:28.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:28 smithi022 ceph-mon[35583]: Detected new or changed devices on smithi121 2024-09-19T09:31:28.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:28 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:28.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:28 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:28.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:28 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:31:28.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:28 smithi022 ceph-mon[35583]: Adjusting osd_memory_target on smithi121 to 17087M 2024-09-19T09:31:28.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:28 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:28.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:28 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:28.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:28 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:28.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:28 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:28.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:28 smithi022 ceph-mon[35583]: from='osd.2 ' entity='osd.2' 2024-09-19T09:31:28.866 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:28 smithi121 ceph-mon[35577]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-19T09:31:28.866 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:28 smithi121 ceph-mon[35577]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T09:31:28.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:28 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:31:28.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:28 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:31:28.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:28 smithi121 ceph-mon[35577]: Detected new or changed devices on smithi121 2024-09-19T09:31:28.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:28 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:28.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:28 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:28.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:28 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:31:28.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:28 smithi121 ceph-mon[35577]: Adjusting osd_memory_target on smithi121 to 17087M 2024-09-19T09:31:28.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:28 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:28.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:28 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:28.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:28 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:28.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:28 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:28.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:28 smithi121 ceph-mon[35577]: from='osd.2 ' entity='osd.2' 2024-09-19T09:31:29.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:29 smithi001 ceph-mon[31225]: purged_snaps scrub starts 2024-09-19T09:31:29.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:29 smithi001 ceph-mon[31225]: purged_snaps scrub ok 2024-09-19T09:31:29.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:29 smithi001 ceph-mon[31225]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:29.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:29 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:31:29.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:29 smithi001 ceph-mon[31225]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:31:29.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:29 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:31:29.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:29 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:31:29.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:29 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:29.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:29 smithi001 ceph-mon[31225]: osd.2 [v2:172.21.15.121:6800/1924970833,v1:172.21.15.121:6801/1924970833] boot 2024-09-19T09:31:29.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:29 smithi001 ceph-mon[31225]: osdmap e17: 3 total, 3 up, 3 in 2024-09-19T09:31:29.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:29 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:31:29.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:29 smithi022 ceph-mon[35583]: purged_snaps scrub starts 2024-09-19T09:31:29.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:29 smithi022 ceph-mon[35583]: purged_snaps scrub ok 2024-09-19T09:31:29.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:29 smithi022 ceph-mon[35583]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:29.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:29 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:31:29.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:29 smithi022 ceph-mon[35583]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:31:29.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:29 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:31:29.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:29 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:31:29.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:29 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:29.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:29 smithi022 ceph-mon[35583]: osd.2 [v2:172.21.15.121:6800/1924970833,v1:172.21.15.121:6801/1924970833] boot 2024-09-19T09:31:29.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:29 smithi022 ceph-mon[35583]: osdmap e17: 3 total, 3 up, 3 in 2024-09-19T09:31:29.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:29 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:31:29.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:29 smithi121 ceph-mon[35577]: purged_snaps scrub starts 2024-09-19T09:31:29.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:29 smithi121 ceph-mon[35577]: purged_snaps scrub ok 2024-09-19T09:31:29.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:29 smithi121 ceph-mon[35577]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-19T09:31:29.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:29 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:31:29.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:29 smithi121 ceph-mon[35577]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:31:29.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:29 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:31:29.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:29 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:31:29.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:29 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:29.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:29 smithi121 ceph-mon[35577]: osd.2 [v2:172.21.15.121:6800/1924970833,v1:172.21.15.121:6801/1924970833] boot 2024-09-19T09:31:29.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:29 smithi121 ceph-mon[35577]: osdmap e17: 3 total, 3 up, 3 in 2024-09-19T09:31:29.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:29 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T09:31:30.789 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:30 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:31:30.789 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:30 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T09:31:30.789 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:30 smithi001 ceph-mon[31225]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T09:31:30.789 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:30 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:31:31.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:30 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:31:31.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:30 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T09:31:31.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:30 smithi022 ceph-mon[35583]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T09:31:31.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:30 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:31:31.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:30 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:31:31.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:30 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T09:31:31.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:30 smithi121 ceph-mon[35577]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T09:31:31.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:30 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:31:31.807 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:31 smithi001 ceph-mon[31225]: pgmap v75: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:31:31.807 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:31 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1395736919' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "adad6d17-16d9-4c43-b581-35ac1bb9d807"}]: dispatch 2024-09-19T09:31:31.808 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:31 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:31:31.808 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:31 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1395736919' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "adad6d17-16d9-4c43-b581-35ac1bb9d807"}]': finished 2024-09-19T09:31:31.808 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:31 smithi001 ceph-mon[31225]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T09:31:31.808 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:31 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:31:32.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:31 smithi022 ceph-mon[35583]: pgmap v75: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:31:32.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:31 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1395736919' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "adad6d17-16d9-4c43-b581-35ac1bb9d807"}]: dispatch 2024-09-19T09:31:32.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:31 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:31:32.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:31 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1395736919' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "adad6d17-16d9-4c43-b581-35ac1bb9d807"}]': finished 2024-09-19T09:31:32.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:31 smithi022 ceph-mon[35583]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T09:31:32.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:31 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:31:32.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:31 smithi121 ceph-mon[35577]: pgmap v75: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:31:32.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:31 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1395736919' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "adad6d17-16d9-4c43-b581-35ac1bb9d807"}]: dispatch 2024-09-19T09:31:32.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:31 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:31:32.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:31 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1395736919' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "adad6d17-16d9-4c43-b581-35ac1bb9d807"}]': finished 2024-09-19T09:31:32.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:31 smithi121 ceph-mon[35577]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T09:31:32.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:31 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:31:32.247 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:31:31 smithi001 sudo[46802]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:31:32.247 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:31:31 smithi001 sudo[46802]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:31:32.247 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:31:31 smithi001 sudo[46802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:31:32.247 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:31:31 smithi001 sudo[46802]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:31:32.625 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:31:32 smithi001 sudo[46851]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:31:32.626 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:31:32 smithi001 sudo[46851]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:31:32.626 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:31:32 smithi001 sudo[46851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:31:32.626 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:31:32 smithi001 sudo[46851]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:31:32.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:32.630+0000 7f72e67fc640 1 -- 172.21.15.1:0/955205460 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f72e8098760 con 0x7f72f01037c0 2024-09-19T09:31:32.820 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:31:32 smithi022 sudo[44028]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:31:32.820 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:31:32 smithi022 sudo[44028]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:31:32.820 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:31:32 smithi022 sudo[44028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:31:32.820 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:31:32 smithi022 sudo[44028]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:31:32.820 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:32 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1945115245' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:31:32.821 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:32 smithi022 ceph-mon[35583]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T09:31:32.821 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:32 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:31:32.821 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:32 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:32.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:32 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1945115245' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:31:32.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:32 smithi001 ceph-mon[31225]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T09:31:32.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:32 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:31:32.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:32 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:33.086 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:32 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1945115245' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:31:33.086 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:32 smithi121 ceph-mon[35577]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T09:31:33.086 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:32 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:31:33.086 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:32 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:33.113 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:31:32 smithi022 sudo[44031]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:31:33.114 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:31:32 smithi022 sudo[44031]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:31:33.114 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:31:32 smithi022 sudo[44031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:31:33.114 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:31:32 smithi022 sudo[44031]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:31:33.343 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 19 09:31:33 smithi121 sudo[44185]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:31:33.384 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 19 09:31:33 smithi121 sudo[44185]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:31:33.384 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 19 09:31:33 smithi121 sudo[44185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:31:33.384 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 19 09:31:33 smithi121 sudo[44185]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:31:33.617 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 19 09:31:33 smithi121 sudo[44188]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:31:33.617 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 19 09:31:33 smithi121 sudo[44188]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:31:33.617 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 19 09:31:33 smithi121 sudo[44188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:31:33.617 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 19 09:31:33 smithi121 sudo[44188]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:31:34.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:33 smithi001 sudo[47228]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:31:34.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:33 smithi001 sudo[47228]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:31:34.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:33 smithi001 sudo[47228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:31:34.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:33 smithi001 sudo[47228]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:31:34.529 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:34 smithi121 ceph-mon[35577]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:31:34.529 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:34 smithi121 ceph-mon[35577]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T09:31:34.529 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:34 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:34.529 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:34 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:34.529 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:34 smithi121 ceph-mon[35577]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:31:34.530 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:34 smithi121 sudo[44191]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:31:34.530 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:34 smithi121 sudo[44191]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:31:34.530 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:34 smithi121 sudo[44191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:31:34.530 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:34 smithi121 sudo[44191]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:31:34.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:34 smithi022 ceph-mon[35583]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:31:34.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:34 smithi022 ceph-mon[35583]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T09:31:34.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:34 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:34.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:34 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:34.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:34 smithi022 ceph-mon[35583]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:31:34.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:34 smithi001 sudo[47236]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:31:34.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:34 smithi001 sudo[47236]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:31:34.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:34 smithi001 sudo[47236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:31:34.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:34 smithi001 sudo[47236]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:31:34.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:34 smithi001 ceph-mon[31225]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:31:34.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:34 smithi001 ceph-mon[31225]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T09:31:34.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:34 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:34.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:34 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:34.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:34 smithi001 ceph-mon[31225]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:31:34.866 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:34 smithi121 sudo[44194]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:31:34.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:34 smithi121 sudo[44194]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:31:34.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:34 smithi121 sudo[44194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:31:34.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:34 smithi121 sudo[44194]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:31:35.291 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:35 smithi022 sudo[44034]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T09:31:35.291 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:35 smithi022 sudo[44034]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:31:35.291 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:35 smithi022 sudo[44034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:31:35.291 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:35 smithi022 sudo[44034]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:31:35.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:35 smithi022 sudo[44037]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T09:31:35.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:35 smithi022 sudo[44037]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T09:31:35.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:35 smithi022 sudo[44037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T09:31:35.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:35 smithi022 sudo[44037]: pam_unix(sudo:session): session closed for user root 2024-09-19T09:31:35.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:35 smithi022 ceph-mon[35583]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:31:35.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:35 smithi022 ceph-mon[35583]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:31:35.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:35 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:31:35.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:35 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:31:35.616 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:35 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:31:35.616 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:35 smithi022 ceph-mon[35583]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:31:35.616 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:35 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:31:35.616 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:35 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:31:35.616 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:35 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:31:35.616 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:35 smithi022 ceph-mon[35583]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:31:35.617 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:35 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:31:35.617 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:35 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:31:35.617 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:35 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:31:35.618 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:35 smithi121 ceph-mon[35577]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:31:35.618 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:35 smithi121 ceph-mon[35577]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:31:35.618 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:35 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:31:35.618 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:35 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:31:35.618 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:35 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:31:35.618 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:35 smithi121 ceph-mon[35577]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:31:35.618 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:35 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:31:35.618 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:35 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:31:35.619 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:35 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:31:35.619 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:35 smithi121 ceph-mon[35577]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:31:35.619 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:35 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:31:35.619 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:35 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:31:35.619 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:35 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:31:35.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:35 smithi001 ceph-mon[31225]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:31:35.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:35 smithi001 ceph-mon[31225]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:31:35.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:35 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:31:35.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:35 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:31:35.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:35 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:31:35.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:35 smithi001 ceph-mon[31225]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:31:35.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:35 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:31:35.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:35 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:31:35.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:35 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:31:35.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:35 smithi001 ceph-mon[31225]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:31:35.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:35 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T09:31:35.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:35 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T09:31:35.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:35 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T09:31:36.433 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:36 smithi001 ceph-mon[31225]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:31:36.433 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:36 smithi001 ceph-mon[31225]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:31:36.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:36 smithi022 ceph-mon[35583]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:31:36.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:36 smithi022 ceph-mon[35583]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:31:36.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:36 smithi121 ceph-mon[35577]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T09:31:36.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:36 smithi121 ceph-mon[35577]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T09:31:37.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:37 smithi022 ceph-mon[35583]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:31:37.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:37 smithi001 ceph-mon[31225]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:31:37.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:37 smithi121 ceph-mon[35577]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:31:39.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:39 smithi001 ceph-mon[31225]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:31:39.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:39 smithi022 ceph-mon[35583]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:31:39.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:39 smithi121 ceph-mon[35577]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:31:40.565 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:40 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T09:31:40.565 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:40 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:40.565 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:40 smithi001 ceph-mon[31225]: Deploying daemon osd.3 on smithi001 2024-09-19T09:31:40.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:40 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T09:31:40.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:40 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:40.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:40 smithi022 ceph-mon[35583]: Deploying daemon osd.3 on smithi001 2024-09-19T09:31:40.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:40 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T09:31:40.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:40 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:40.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:40 smithi121 ceph-mon[35577]: Deploying daemon osd.3 on smithi001 2024-09-19T09:31:41.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:41 smithi022 ceph-mon[35583]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-09-19T09:31:41.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:41 smithi121 ceph-mon[35577]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-09-19T09:31:41.650 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:41 smithi001 ceph-mon[31225]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2024-09-19T09:31:43.585 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:43 smithi001 ceph-mon[31225]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-19T09:31:43.613 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:43 smithi022 ceph-mon[35583]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-19T09:31:43.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:43 smithi121 ceph-mon[35577]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2024-09-19T09:31:45.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:45 smithi022 ceph-mon[35583]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-19T09:31:45.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:45 smithi121 ceph-mon[35577]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-19T09:31:45.664 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:45 smithi001 ceph-mon[31225]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2024-09-19T09:31:46.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:46 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:46.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:46 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:46.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:46 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:46.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:46 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:46.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:46 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:46.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:46 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:46.738 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:46 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:46.739 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:46 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:46.739 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:46 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:47.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:47 smithi022 ceph-mon[35583]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T09:31:47.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:47 smithi121 ceph-mon[35577]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T09:31:47.724 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:47 smithi001 ceph-mon[31225]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T09:31:49.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:49 smithi001 ceph-mon[31225]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T09:31:49.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:49 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:49.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:49 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:49.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:49 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:49.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:49 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:49.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:49 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:50.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:49 smithi022 ceph-mon[35583]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T09:31:50.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:49 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:50.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:49 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:50.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:49 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:50.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:49 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:50.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:49 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:50.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:49 smithi121 ceph-mon[35577]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T09:31:50.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:49 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:50.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:49 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:50.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:49 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:50.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:49 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:50.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:49 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:50.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:50.468+0000 7f72e67fc640 1 -- 172.21.15.1:0/955205460 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f72f0062630 con 0x7f72dc0a31e0 2024-09-19T09:31:50.470 INFO:teuthology.orchestra.run.smithi001.stdout:Created osd(s) 3 on host 'smithi001' 2024-09-19T09:31:50.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:50.470+0000 7f72f789a640 1 -- 172.21.15.1:0/955205460 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f72dc0a31e0 msgr2=0x7f72dc0a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:50.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:50.470+0000 7f72f789a640 1 --2- 172.21.15.1:0/955205460 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f72dc0a31e0 0x7f72dc0a56a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f72f0102c60 tx=0x7f72ec00b390 comp rx=0 tx=0).stop 2024-09-19T09:31:50.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:50.470+0000 7f72f789a640 1 -- 172.21.15.1:0/955205460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f72f01037c0 msgr2=0x7f72f019f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:50.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:50.470+0000 7f72f789a640 1 --2- 172.21.15.1:0/955205460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f72f01037c0 0x7f72f019f490 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f72e800eaa0 tx=0x7f72e800ef60 comp rx=0 tx=0).stop 2024-09-19T09:31:50.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:50.470+0000 7f72f789a640 1 -- 172.21.15.1:0/955205460 shutdown_connections 2024-09-19T09:31:50.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:50.470+0000 7f72f789a640 1 --2- 172.21.15.1:0/955205460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f72f01037c0 0x7f72f019f490 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:50.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:50.470+0000 7f72f789a640 1 --2- 172.21.15.1:0/955205460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72f0102e00 0x7f72f0198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:50.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:50.470+0000 7f72f789a640 1 --2- 172.21.15.1:0/955205460 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f72dc0a31e0 0x7f72dc0a56a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:50.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:50.470+0000 7f72f789a640 1 --2- 172.21.15.1:0/955205460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72f0101c00 0x7f72f0197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:50.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:50.470+0000 7f72f789a640 1 -- 172.21.15.1:0/955205460 >> 172.21.15.1:0/955205460 conn(0x7f72f00fd390 msgr2=0x7f72f01061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:50.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:50.470+0000 7f72f789a640 1 -- 172.21.15.1:0/955205460 shutdown_connections 2024-09-19T09:31:50.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:31:50.470+0000 7f72f789a640 1 -- 172.21.15.1:0/955205460 wait complete. 2024-09-19T09:31:51.089 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:50 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:51.089 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:50 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:51.089 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:50 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:51.113 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:50 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:51.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:50 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:51.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:50 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:51.117 DEBUG:teuthology.orchestra.run.smithi001:osd.3> sudo journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@osd.3.service 2024-09-19T09:31:51.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:50 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:31:51.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:50 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:51.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:50 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:51.120 INFO:tasks.cephadm:Deploying osd.4 on smithi022 with /dev/vg_nvme/lv_3... 2024-09-19T09:31:51.120 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T09:31:51.381 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:31:51.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:51 smithi001 ceph-mon[31225]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T09:31:52.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:51 smithi022 ceph-mon[35583]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T09:31:52.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:51 smithi121 ceph-mon[35577]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2024-09-19T09:31:52.658 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 09:31:52 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-3[48813]: 2024-09-19T09:31:52.408+0000 7f5962b33640 -1 osd.3 0 log_to_monitors true 2024-09-19T09:31:52.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:52 smithi001 ceph-mon[31225]: from='osd.3 [v2:172.21.15.1:6810/1515009793,v1:172.21.15.1:6811/1515009793]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T09:31:53.113 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:52 smithi022 ceph-mon[35583]: from='osd.3 [v2:172.21.15.1:6810/1515009793,v1:172.21.15.1:6811/1515009793]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T09:31:53.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:52 smithi121 ceph-mon[35577]: from='osd.3 [v2:172.21.15.1:6810/1515009793,v1:172.21.15.1:6811/1515009793]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T09:31:53.942 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:53 smithi022 ceph-mon[35583]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:31:53.942 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:53 smithi022 ceph-mon[35583]: from='osd.3 [v2:172.21.15.1:6810/1515009793,v1:172.21.15.1:6811/1515009793]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T09:31:53.942 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:53 smithi022 ceph-mon[35583]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T09:31:53.942 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:53 smithi022 ceph-mon[35583]: from='osd.3 [v2:172.21.15.1:6810/1515009793,v1:172.21.15.1:6811/1515009793]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T09:31:53.942 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:53 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:31:53.945 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T09:31:53.970 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi022:vg_nvme/lv_3 2024-09-19T09:31:53.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:53 smithi001 ceph-mon[31225]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:31:53.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:53 smithi001 ceph-mon[31225]: from='osd.3 [v2:172.21.15.1:6810/1515009793,v1:172.21.15.1:6811/1515009793]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T09:31:53.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:53 smithi001 ceph-mon[31225]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T09:31:53.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:53 smithi001 ceph-mon[31225]: from='osd.3 [v2:172.21.15.1:6810/1515009793,v1:172.21.15.1:6811/1515009793]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T09:31:53.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:53 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:31:54.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:53 smithi121 ceph-mon[35577]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:31:54.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:53 smithi121 ceph-mon[35577]: from='osd.3 [v2:172.21.15.1:6810/1515009793,v1:172.21.15.1:6811/1515009793]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T09:31:54.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:53 smithi121 ceph-mon[35577]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T09:31:54.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:53 smithi121 ceph-mon[35577]: from='osd.3 [v2:172.21.15.1:6810/1515009793,v1:172.21.15.1:6811/1515009793]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T09:31:54.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:53 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:31:54.221 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:31:54.497 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 09:31:54 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-3[48813]: 2024-09-19T09:31:54.283+0000 7f595eab6640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T09:31:54.497 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 09:31:54 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-3[48813]: 2024-09-19T09:31:54.289+0000 7f59568d6640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:31:54.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.678+0000 7fcabbf82640 1 -- 172.21.15.22:0/3367247166 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcab4109a80 msgr2=0x7fcab410bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:54.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.678+0000 7fcabbf82640 1 --2- 172.21.15.22:0/3367247166 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcab4109a80 0x7fcab410bf40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fcaac009ca0 tx=0x7fcaac02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.678+0000 7fcabbf82640 1 -- 172.21.15.22:0/3367247166 shutdown_connections 2024-09-19T09:31:54.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.678+0000 7fcabbf82640 1 --2- 172.21.15.22:0/3367247166 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcab4109a80 0x7fcab410bf40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.678+0000 7fcabbf82640 1 --2- 172.21.15.22:0/3367247166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcab4074c50 0x7fcab40750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.678+0000 7fcabbf82640 1 --2- 172.21.15.22:0/3367247166 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcab4076220 0x7fcab4074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.678+0000 7fcabbf82640 1 -- 172.21.15.22:0/3367247166 >> 172.21.15.22:0/3367247166 conn(0x7fcab40fd390 msgr2=0x7fcab40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:31:54.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.679+0000 7fcabbf82640 1 -- 172.21.15.22:0/3367247166 shutdown_connections 2024-09-19T09:31:54.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.679+0000 7fcabbf82640 1 -- 172.21.15.22:0/3367247166 wait complete. 2024-09-19T09:31:54.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.679+0000 7fcabbf82640 1 Processor -- start 2024-09-19T09:31:54.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.679+0000 7fcabbf82640 1 -- start start 2024-09-19T09:31:54.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.679+0000 7fcabbf82640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcab4074c50 0x7fcab419a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:54.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.679+0000 7fcabbf82640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcab4076220 0x7fcab419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:54.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.679+0000 7fcabbf82640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcab4109a80 0x7fcab41a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:54.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.679+0000 7fcabbf82640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcab410fa80 con 0x7fcab4074c50 2024-09-19T09:31:54.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.679+0000 7fcabbf82640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcab410f900 con 0x7fcab4109a80 2024-09-19T09:31:54.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.679+0000 7fcabbf82640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcab410fc00 con 0x7fcab4076220 2024-09-19T09:31:54.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.680+0000 7fcaba51f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcab4109a80 0x7fcab41a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:54.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.680+0000 7fcaba51f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcab4109a80 0x7fcab41a1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48104/0 (socket says 172.21.15.22:48104) 2024-09-19T09:31:54.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.680+0000 7fcaba51f640 1 -- 172.21.15.22:0/3192245791 learned_addr learned my addr 172.21.15.22:0/3192245791 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-19T09:31:54.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.680+0000 7fcab951d640 1 --2- 172.21.15.22:0/3192245791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcab4076220 0x7fcab419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:54.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.680+0000 7fcab9d1e640 1 --2- 172.21.15.22:0/3192245791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcab4074c50 0x7fcab419a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:54.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.680+0000 7fcaba51f640 1 -- 172.21.15.22:0/3192245791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcab4076220 msgr2=0x7fcab419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:54.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.680+0000 7fcaba51f640 1 --2- 172.21.15.22:0/3192245791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcab4076220 0x7fcab419a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.680+0000 7fcaba51f640 1 -- 172.21.15.22:0/3192245791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcab4074c50 msgr2=0x7fcab419a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:31:54.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.680+0000 7fcaba51f640 1 --2- 172.21.15.22:0/3192245791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcab4074c50 0x7fcab419a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:31:54.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.680+0000 7fcaba51f640 1 -- 172.21.15.22:0/3192245791 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcab41a1cb0 con 0x7fcab4109a80 2024-09-19T09:31:54.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.680+0000 7fcaba51f640 1 --2- 172.21.15.22:0/3192245791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcab4109a80 0x7fcab41a1640 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcaac005e30 tx=0x7fcaac031ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:54.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.680+0000 7fcaaaffd640 1 -- 172.21.15.22:0/3192245791 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaac003c30 con 0x7fcab4109a80 2024-09-19T09:31:54.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.680+0000 7fcaaaffd640 1 -- 172.21.15.22:0/3192245791 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcaac003dd0 con 0x7fcab4109a80 2024-09-19T09:31:54.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.680+0000 7fcabbf82640 1 -- 172.21.15.22:0/3192245791 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcab41a1f40 con 0x7fcab4109a80 2024-09-19T09:31:54.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.680+0000 7fcaaaffd640 1 -- 172.21.15.22:0/3192245791 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaac02fde0 con 0x7fcab4109a80 2024-09-19T09:31:54.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.680+0000 7fcabbf82640 1 -- 172.21.15.22:0/3192245791 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcab41a23f0 con 0x7fcab4109a80 2024-09-19T09:31:54.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.681+0000 7fcabbf82640 1 -- 172.21.15.22:0/3192245791 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcab4108800 con 0x7fcab4109a80 2024-09-19T09:31:54.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.683+0000 7fcaaaffd640 1 -- 172.21.15.22:0/3192245791 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fcaac004050 con 0x7fcab4109a80 2024-09-19T09:31:54.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.683+0000 7fcaaaffd640 1 --2- 172.21.15.22:0/3192245791 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fcaa00a3270 0x7fcaa00a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:31:54.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.683+0000 7fcaaaffd640 1 -- 172.21.15.22:0/3192245791 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3422+0+0 (secure 0 0 0) 0x7fcaac0ef9e0 con 0x7fcab4109a80 2024-09-19T09:31:54.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.684+0000 7fcab9d1e640 1 --2- 172.21.15.22:0/3192245791 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fcaa00a3270 0x7fcaa00a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:31:54.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.684+0000 7fcab9d1e640 1 --2- 172.21.15.22:0/3192245791 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fcaa00a3270 0x7fcaa00a5730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcab4076600 tx=0x7fcaa400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:31:54.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.687+0000 7fcaaaffd640 1 -- 172.21.15.22:0/3192245791 <== mon.2 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcaac0bda20 con 0x7fcab4109a80 2024-09-19T09:31:54.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:31:54.872+0000 7fcabbf82640 1 -- 172.21.15.22:0/3192245791 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fcab4062630 con 0x7fcaa00a3270 2024-09-19T09:31:55.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:54 smithi022 ceph-mon[35583]: from='osd.3 [v2:172.21.15.1:6810/1515009793,v1:172.21.15.1:6811/1515009793]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T09:31:55.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:54 smithi022 ceph-mon[35583]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T09:31:55.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:54 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:31:55.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:54 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:31:55.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:54 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:55.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:54 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:55.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:54 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:31:55.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:54 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:31:55.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:54 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:55.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:54 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:55.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:54 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:55.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:54 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:55.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:54 smithi022 ceph-mon[35583]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T09:31:55.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:54 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:31:55.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:54 smithi022 ceph-mon[35583]: from='osd.3 [v2:172.21.15.1:6810/1515009793,v1:172.21.15.1:6811/1515009793]' entity='osd.3' 2024-09-19T09:31:55.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:54 smithi121 ceph-mon[35577]: from='osd.3 [v2:172.21.15.1:6810/1515009793,v1:172.21.15.1:6811/1515009793]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T09:31:55.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:54 smithi121 ceph-mon[35577]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T09:31:55.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:54 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:31:55.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:54 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:31:55.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:54 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:55.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:54 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:55.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:54 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:31:55.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:54 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:31:55.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:54 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:55.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:54 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:55.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:54 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:55.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:54 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:55.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:54 smithi121 ceph-mon[35577]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T09:31:55.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:54 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:31:55.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:54 smithi121 ceph-mon[35577]: from='osd.3 [v2:172.21.15.1:6810/1515009793,v1:172.21.15.1:6811/1515009793]' entity='osd.3' 2024-09-19T09:31:55.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:54 smithi001 ceph-mon[31225]: from='osd.3 [v2:172.21.15.1:6810/1515009793,v1:172.21.15.1:6811/1515009793]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T09:31:55.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:54 smithi001 ceph-mon[31225]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T09:31:55.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:54 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:31:55.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:54 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:31:55.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:54 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:55.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:54 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:55.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:54 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:31:55.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:54 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:31:55.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:54 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:55.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:54 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:55.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:54 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:31:55.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:54 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:31:55.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:54 smithi001 ceph-mon[31225]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T09:31:55.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:54 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:31:55.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:54 smithi001 ceph-mon[31225]: from='osd.3 [v2:172.21.15.1:6810/1515009793,v1:172.21.15.1:6811/1515009793]' entity='osd.3' 2024-09-19T09:31:56.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:55 smithi022 ceph-mon[35583]: purged_snaps scrub starts 2024-09-19T09:31:56.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:55 smithi022 ceph-mon[35583]: purged_snaps scrub ok 2024-09-19T09:31:56.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:55 smithi022 ceph-mon[35583]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:31:56.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:55 smithi022 ceph-mon[35583]: Detected new or changed devices on smithi001 2024-09-19T09:31:56.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:55 smithi022 ceph-mon[35583]: Adjusting osd_memory_target on smithi001 to 8546M 2024-09-19T09:31:56.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:55 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:31:56.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:55 smithi022 ceph-mon[35583]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:31:56.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:55 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:31:56.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:55 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:31:56.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:55 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:56.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:55 smithi022 ceph-mon[35583]: osd.3 [v2:172.21.15.1:6810/1515009793,v1:172.21.15.1:6811/1515009793] boot 2024-09-19T09:31:56.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:55 smithi022 ceph-mon[35583]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T09:31:56.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:55 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:31:56.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:55 smithi121 ceph-mon[35577]: purged_snaps scrub starts 2024-09-19T09:31:56.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:55 smithi121 ceph-mon[35577]: purged_snaps scrub ok 2024-09-19T09:31:56.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:55 smithi121 ceph-mon[35577]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:31:56.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:55 smithi121 ceph-mon[35577]: Detected new or changed devices on smithi001 2024-09-19T09:31:56.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:55 smithi121 ceph-mon[35577]: Adjusting osd_memory_target on smithi001 to 8546M 2024-09-19T09:31:56.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:55 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:31:56.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:55 smithi121 ceph-mon[35577]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:31:56.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:55 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:31:56.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:55 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:31:56.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:55 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:56.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:55 smithi121 ceph-mon[35577]: osd.3 [v2:172.21.15.1:6810/1515009793,v1:172.21.15.1:6811/1515009793] boot 2024-09-19T09:31:56.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:55 smithi121 ceph-mon[35577]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T09:31:56.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:55 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:31:56.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:55 smithi001 ceph-mon[31225]: purged_snaps scrub starts 2024-09-19T09:31:56.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:55 smithi001 ceph-mon[31225]: purged_snaps scrub ok 2024-09-19T09:31:56.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:55 smithi001 ceph-mon[31225]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-19T09:31:56.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:55 smithi001 ceph-mon[31225]: Detected new or changed devices on smithi001 2024-09-19T09:31:56.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:55 smithi001 ceph-mon[31225]: Adjusting osd_memory_target on smithi001 to 8546M 2024-09-19T09:31:56.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:55 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:31:56.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:55 smithi001 ceph-mon[31225]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:31:56.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:55 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:31:56.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:55 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:31:56.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:55 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:31:56.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:55 smithi001 ceph-mon[31225]: osd.3 [v2:172.21.15.1:6810/1515009793,v1:172.21.15.1:6811/1515009793] boot 2024-09-19T09:31:56.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:55 smithi001 ceph-mon[31225]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T09:31:56.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:55 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T09:31:57.554 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:57 smithi022 ceph-mon[35583]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:31:57.554 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:57 smithi022 ceph-mon[35583]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T09:31:57.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:57 smithi121 ceph-mon[35577]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:31:57.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:57 smithi121 ceph-mon[35577]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T09:31:57.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:57 smithi001 ceph-mon[31225]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:31:57.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:57 smithi001 ceph-mon[31225]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T09:31:58.546 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:58 smithi001 ceph-mon[31225]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T09:31:58.546 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:58 smithi001 ceph-mon[31225]: from='client.? 172.21.15.22:0/338571317' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8fb06efe-c3a0-48a3-9730-3e8f3e60922d"}]: dispatch 2024-09-19T09:31:58.546 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:58 smithi001 ceph-mon[31225]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8fb06efe-c3a0-48a3-9730-3e8f3e60922d"}]: dispatch 2024-09-19T09:31:58.546 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:58 smithi001 ceph-mon[31225]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8fb06efe-c3a0-48a3-9730-3e8f3e60922d"}]': finished 2024-09-19T09:31:58.547 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:58 smithi001 ceph-mon[31225]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T09:31:58.547 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:58 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:31:58.547 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:58 smithi001 ceph-mon[31225]: from='client.? 172.21.15.22:0/697613624' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:31:58.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:58 smithi022 ceph-mon[35583]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T09:31:58.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:58 smithi022 ceph-mon[35583]: from='client.? 172.21.15.22:0/338571317' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8fb06efe-c3a0-48a3-9730-3e8f3e60922d"}]: dispatch 2024-09-19T09:31:58.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:58 smithi022 ceph-mon[35583]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8fb06efe-c3a0-48a3-9730-3e8f3e60922d"}]: dispatch 2024-09-19T09:31:58.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:58 smithi022 ceph-mon[35583]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8fb06efe-c3a0-48a3-9730-3e8f3e60922d"}]': finished 2024-09-19T09:31:58.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:58 smithi022 ceph-mon[35583]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T09:31:58.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:58 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:31:58.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:58 smithi022 ceph-mon[35583]: from='client.? 172.21.15.22:0/697613624' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:31:58.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:58 smithi121 ceph-mon[35577]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T09:31:58.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:58 smithi121 ceph-mon[35577]: from='client.? 172.21.15.22:0/338571317' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8fb06efe-c3a0-48a3-9730-3e8f3e60922d"}]: dispatch 2024-09-19T09:31:58.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:58 smithi121 ceph-mon[35577]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8fb06efe-c3a0-48a3-9730-3e8f3e60922d"}]: dispatch 2024-09-19T09:31:58.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:58 smithi121 ceph-mon[35577]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8fb06efe-c3a0-48a3-9730-3e8f3e60922d"}]': finished 2024-09-19T09:31:58.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:58 smithi121 ceph-mon[35577]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T09:31:58.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:58 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:31:58.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:58 smithi121 ceph-mon[35577]: from='client.? 172.21.15.22:0/697613624' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:31:59.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:59 smithi022 ceph-mon[35583]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:31:59.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:59 smithi022 ceph-mon[35583]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T09:31:59.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:31:59 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:31:59.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:59 smithi121 ceph-mon[35577]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:31:59.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:59 smithi121 ceph-mon[35577]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T09:31:59.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:31:59 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:31:59.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:59 smithi001 ceph-mon[31225]: pgmap v99: 1 pgs: 1 remapped+peering; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:31:59.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:59 smithi001 ceph-mon[31225]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T09:31:59.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:31:59 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:32:00.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:00 smithi022 ceph-mon[35583]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T09:32:00.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:00 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:32:00.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:00 smithi121 ceph-mon[35577]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T09:32:00.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:00 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:32:00.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:00 smithi001 ceph-mon[31225]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T09:32:00.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:00 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:32:01.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:01 smithi022 ceph-mon[35583]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 152 KiB/s, 0 objects/s recovering 2024-09-19T09:32:01.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:01 smithi121 ceph-mon[35577]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 152 KiB/s, 0 objects/s recovering 2024-09-19T09:32:01.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:01 smithi001 ceph-mon[31225]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 152 KiB/s, 0 objects/s recovering 2024-09-19T09:32:03.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:03 smithi022 ceph-mon[35583]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-09-19T09:32:03.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:03 smithi121 ceph-mon[35577]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-09-19T09:32:03.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:03 smithi001 ceph-mon[31225]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-09-19T09:32:05.477 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:05 smithi022 ceph-mon[35583]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-19T09:32:05.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:05 smithi121 ceph-mon[35577]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-19T09:32:05.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:05 smithi001 ceph-mon[31225]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-19T09:32:06.511 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:06 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T09:32:06.511 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:06 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:06.511 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:06 smithi022 ceph-mon[35583]: Deploying daemon osd.4 on smithi022 2024-09-19T09:32:06.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:06 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T09:32:06.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:06 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:06.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:06 smithi121 ceph-mon[35577]: Deploying daemon osd.4 on smithi022 2024-09-19T09:32:06.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:06 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T09:32:06.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:06 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:06.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:06 smithi001 ceph-mon[31225]: Deploying daemon osd.4 on smithi022 2024-09-19T09:32:07.484 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:07 smithi022 ceph-mon[35583]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:32:07.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:07 smithi121 ceph-mon[35577]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:32:07.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:07 smithi001 ceph-mon[31225]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:32:09.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:09 smithi022 ceph-mon[35583]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-19T09:32:09.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:09 smithi121 ceph-mon[35577]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-19T09:32:09.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:09 smithi001 ceph-mon[31225]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-19T09:32:11.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:11 smithi022 ceph-mon[35583]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-19T09:32:11.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:11 smithi121 ceph-mon[35577]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-19T09:32:11.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:11 smithi001 ceph-mon[31225]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-19T09:32:12.608 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:12 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:12.608 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:12 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:12.608 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:12 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:12.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:12 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:12.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:12 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:12.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:12 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:12.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:12 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:12.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:12 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:12.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:12 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:13.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:13 smithi022 ceph-mon[35583]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:32:13.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:13 smithi121 ceph-mon[35577]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:32:13.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:13 smithi001 ceph-mon[31225]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:32:15.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:15 smithi022 ceph-mon[35583]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:32:15.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:15 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:15.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:15 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:15.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:15 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:15.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:15 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:15.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:15 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:15.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:15 smithi001 ceph-mon[31225]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:32:15.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:15 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:15.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:15 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:15.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:15 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:15.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:15 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:15.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:15 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:15.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:15 smithi121 ceph-mon[35577]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:32:15.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:15 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:15.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:15 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:15.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:15 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:15.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:15 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:15.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:15 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:16.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:32:16.101+0000 7fcaaaffd640 1 -- 172.21.15.22:0/3192245791 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcab4062630 con 0x7fcaa00a3270 2024-09-19T09:32:16.103 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 4 on host 'smithi022' 2024-09-19T09:32:16.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:32:16.103+0000 7fcabbf82640 1 -- 172.21.15.22:0/3192245791 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fcaa00a3270 msgr2=0x7fcaa00a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:16.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:32:16.103+0000 7fcabbf82640 1 --2- 172.21.15.22:0/3192245791 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fcaa00a3270 0x7fcaa00a5730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcab4076600 tx=0x7fcaa400b390 comp rx=0 tx=0).stop 2024-09-19T09:32:16.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:32:16.103+0000 7fcabbf82640 1 -- 172.21.15.22:0/3192245791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcab4109a80 msgr2=0x7fcab41a1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:16.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:32:16.103+0000 7fcabbf82640 1 --2- 172.21.15.22:0/3192245791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcab4109a80 0x7fcab41a1640 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcaac005e30 tx=0x7fcaac031ee0 comp rx=0 tx=0).stop 2024-09-19T09:32:16.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:32:16.103+0000 7fcabbf82640 1 -- 172.21.15.22:0/3192245791 shutdown_connections 2024-09-19T09:32:16.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:32:16.103+0000 7fcabbf82640 1 --2- 172.21.15.22:0/3192245791 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fcaa00a3270 0x7fcaa00a5730 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:16.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:32:16.103+0000 7fcabbf82640 1 --2- 172.21.15.22:0/3192245791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcab4109a80 0x7fcab41a1640 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:16.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:32:16.103+0000 7fcabbf82640 1 --2- 172.21.15.22:0/3192245791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcab4076220 0x7fcab419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:16.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:32:16.103+0000 7fcabbf82640 1 --2- 172.21.15.22:0/3192245791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcab4074c50 0x7fcab419a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:16.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:32:16.103+0000 7fcabbf82640 1 -- 172.21.15.22:0/3192245791 >> 172.21.15.22:0/3192245791 conn(0x7fcab40fd390 msgr2=0x7fcab41059d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:16.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:32:16.104+0000 7fcabbf82640 1 -- 172.21.15.22:0/3192245791 shutdown_connections 2024-09-19T09:32:16.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:32:16.104+0000 7fcabbf82640 1 -- 172.21.15.22:0/3192245791 wait complete. 2024-09-19T09:32:16.704 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:16 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:16.704 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:16 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:16.705 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:16 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:16.731 DEBUG:teuthology.orchestra.run.smithi022:osd.4> sudo journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@osd.4.service 2024-09-19T09:32:16.734 INFO:tasks.cephadm:Deploying osd.5 on smithi121 with /dev/vg_nvme/lv_3... 2024-09-19T09:32:16.734 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T09:32:16.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:16 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:16.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:16 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:16.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:16 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:16.762 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:16 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:16.762 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:16 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:16.762 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:16 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:16.990 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:32:17.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:17 smithi022 ceph-mon[35583]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:32:17.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:17 smithi001 ceph-mon[31225]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:32:17.785 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:17 smithi121 ceph-mon[35577]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:32:18.614 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:32:18 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-4[46791]: 2024-09-19T09:32:18.404+0000 7f2971531640 -1 osd.4 0 log_to_monitors true 2024-09-19T09:32:19.427 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:19 smithi022 ceph-mon[35583]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:32:19.504 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:19 smithi022 ceph-mon[35583]: from='osd.4 [v2:172.21.15.22:6808/923697266,v1:172.21.15.22:6809/923697266]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:32:19.504 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:19 smithi022 ceph-mon[35583]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:32:19.505 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:19 smithi121 ceph-mon[35577]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:32:19.505 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:19 smithi121 ceph-mon[35577]: from='osd.4 [v2:172.21.15.22:6808/923697266,v1:172.21.15.22:6809/923697266]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:32:19.505 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:19 smithi121 ceph-mon[35577]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:32:19.506 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-19T09:32:19.506 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi121:vg_nvme/lv_3 2024-09-19T09:32:19.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:19 smithi001 ceph-mon[31225]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:32:19.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:19 smithi001 ceph-mon[31225]: from='osd.4 [v2:172.21.15.22:6808/923697266,v1:172.21.15.22:6809/923697266]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:32:19.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:19 smithi001 ceph-mon[31225]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T09:32:19.794 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:32:20.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.287+0000 7f1dad994640 1 -- 172.21.15.121:0/3836682261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1da8100b10 msgr2=0x7f1da8100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:20.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.287+0000 7f1dad994640 1 --2- 172.21.15.121:0/3836682261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1da8100b10 0x7f1da8100f10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1d98009900 tx=0x7f1d9802a410 comp rx=0 tx=0).stop 2024-09-19T09:32:20.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.287+0000 7f1dad994640 1 -- 172.21.15.121:0/3836682261 shutdown_connections 2024-09-19T09:32:20.312 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.287+0000 7f1dad994640 1 --2- 172.21.15.121:0/3836682261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1da81026d0 0x7f1da8108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:20.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.287+0000 7f1dad994640 1 --2- 172.21.15.121:0/3836682261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1da8101d10 0x7f1da8102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:20.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.287+0000 7f1dad994640 1 --2- 172.21.15.121:0/3836682261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1da8100b10 0x7f1da8100f10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:20.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.287+0000 7f1dad994640 1 -- 172.21.15.121:0/3836682261 >> 172.21.15.121:0/3836682261 conn(0x7f1da80fc2a0 msgr2=0x7f1da80fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:20.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.287+0000 7f1dad994640 1 -- 172.21.15.121:0/3836682261 shutdown_connections 2024-09-19T09:32:20.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.287+0000 7f1dad994640 1 -- 172.21.15.121:0/3836682261 wait complete. 2024-09-19T09:32:20.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.288+0000 7f1dad994640 1 Processor -- start 2024-09-19T09:32:20.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.288+0000 7f1dad994640 1 -- start start 2024-09-19T09:32:20.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.288+0000 7f1dad994640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1da8100b10 0x7f1da806b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:20.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.288+0000 7f1dad994640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1da8101d10 0x7f1da819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:20.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.288+0000 7f1dad994640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1da81026d0 0x7f1da819f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:20.313 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.288+0000 7f1dad994640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1da810c7f0 con 0x7f1da8100b10 2024-09-19T09:32:20.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.288+0000 7f1dad994640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1da810c670 con 0x7f1da81026d0 2024-09-19T09:32:20.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.288+0000 7f1dad994640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1da810c970 con 0x7f1da8101d10 2024-09-19T09:32:20.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.288+0000 7f1da67fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1da8101d10 0x7f1da819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:20.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.288+0000 7f1da67fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1da8101d10 0x7f1da819cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:54260/0 (socket says 172.21.15.121:54260) 2024-09-19T09:32:20.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.288+0000 7f1da67fc640 1 -- 172.21.15.121:0/1441423288 learned_addr learned my addr 172.21.15.121:0/1441423288 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-19T09:32:20.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.288+0000 7f1da6ffd640 1 --2- 172.21.15.121:0/1441423288 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1da8100b10 0x7f1da806b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:20.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.288+0000 7f1da77fe640 1 --2- 172.21.15.121:0/1441423288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1da81026d0 0x7f1da819f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:20.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.288+0000 7f1da67fc640 1 -- 172.21.15.121:0/1441423288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1da81026d0 msgr2=0x7f1da819f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:20.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.288+0000 7f1da67fc640 1 --2- 172.21.15.121:0/1441423288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1da81026d0 0x7f1da819f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:20.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.288+0000 7f1da67fc640 1 -- 172.21.15.121:0/1441423288 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1da8100b10 msgr2=0x7f1da806b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:20.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.288+0000 7f1da67fc640 1 --2- 172.21.15.121:0/1441423288 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1da8100b10 0x7f1da806b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:20.314 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.288+0000 7f1da67fc640 1 -- 172.21.15.121:0/1441423288 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da819fc10 con 0x7f1da8101d10 2024-09-19T09:32:20.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.288+0000 7f1da6ffd640 1 --2- 172.21.15.121:0/1441423288 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1da8100b10 0x7f1da806b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:32:20.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.289+0000 7f1da67fc640 1 --2- 172.21.15.121:0/1441423288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1da8101d10 0x7f1da819cce0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c00d950 tx=0x7f1d9c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:20.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.289+0000 7f1dac992640 1 -- 172.21.15.121:0/1441423288 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c017030 con 0x7f1da8101d10 2024-09-19T09:32:20.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.289+0000 7f1dac992640 1 -- 172.21.15.121:0/1441423288 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d9c004020 con 0x7f1da8101d10 2024-09-19T09:32:20.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.289+0000 7f1dad994640 1 -- 172.21.15.121:0/1441423288 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1da819fea0 con 0x7f1da8101d10 2024-09-19T09:32:20.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.289+0000 7f1dac992640 1 -- 172.21.15.121:0/1441423288 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c0047a0 con 0x7f1da8101d10 2024-09-19T09:32:20.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.289+0000 7f1dad994640 1 -- 172.21.15.121:0/1441423288 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1da81a0350 con 0x7f1da8101d10 2024-09-19T09:32:20.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.290+0000 7f1dad994640 1 -- 172.21.15.121:0/1441423288 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1da8107f80 con 0x7f1da8101d10 2024-09-19T09:32:20.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.292+0000 7f1dac992640 1 -- 172.21.15.121:0/1441423288 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f1d9c0041d0 con 0x7f1da8101d10 2024-09-19T09:32:20.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.292+0000 7f1dac992640 1 --2- 172.21.15.121:0/1441423288 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f1d900a3240 0x7f1d900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:20.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.292+0000 7f1dac992640 1 -- 172.21.15.121:0/1441423288 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3805+0+0 (secure 0 0 0) 0x7f1d9c0ce8b0 con 0x7f1da8101d10 2024-09-19T09:32:20.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.292+0000 7f1da6ffd640 1 --2- 172.21.15.121:0/1441423288 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f1d900a3240 0x7f1d900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:20.315 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.293+0000 7f1da6ffd640 1 --2- 172.21.15.121:0/1441423288 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f1d900a3240 0x7f1d900a5700 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1d98006010 tx=0x7f1d98032dd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:20.316 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.295+0000 7f1dac992640 1 -- 172.21.15.121:0/1441423288 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1d9c09c770 con 0x7f1da8101d10 2024-09-19T09:32:20.488 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:20.486+0000 7f1dad994640 1 -- 172.21.15.121:0/1441423288 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f1da8062630 con 0x7f1d900a3240 2024-09-19T09:32:20.649 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:20 smithi001 ceph-mon[31225]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T09:32:20.649 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:20 smithi001 ceph-mon[31225]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T09:32:20.649 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:20 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:32:20.649 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:20 smithi001 ceph-mon[31225]: from='osd.4 [v2:172.21.15.22:6808/923697266,v1:172.21.15.22:6809/923697266]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T09:32:20.649 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:20 smithi001 ceph-mon[31225]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T09:32:20.649 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:20 smithi001 ceph-mon[31225]: Detected new or changed devices on smithi022 2024-09-19T09:32:20.649 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:20 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:20.650 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:20 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:20.650 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:20 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:32:20.650 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:20 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:32:20.650 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:20 smithi001 ceph-mon[31225]: Adjusting osd_memory_target on smithi022 to 8546M 2024-09-19T09:32:20.650 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:20 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:20.650 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:20 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:20.650 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:20 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:20.650 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:20 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:20.746 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:20 smithi121 ceph-mon[35577]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T09:32:20.747 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:20 smithi121 ceph-mon[35577]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T09:32:20.747 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:20 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:32:20.747 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:20 smithi121 ceph-mon[35577]: from='osd.4 [v2:172.21.15.22:6808/923697266,v1:172.21.15.22:6809/923697266]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T09:32:20.747 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:20 smithi121 ceph-mon[35577]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T09:32:20.747 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:20 smithi121 ceph-mon[35577]: Detected new or changed devices on smithi022 2024-09-19T09:32:20.747 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:20 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:20.747 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:20 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:20.747 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:20 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:32:20.747 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:20 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:32:20.747 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:20 smithi121 ceph-mon[35577]: Adjusting osd_memory_target on smithi022 to 8546M 2024-09-19T09:32:20.747 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:20 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:20.747 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:20 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:20.747 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:20 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:20.748 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:20 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:20.821 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:20 smithi022 ceph-mon[35583]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T09:32:20.821 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:20 smithi022 ceph-mon[35583]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T09:32:20.821 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:20 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:32:20.821 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:20 smithi022 ceph-mon[35583]: from='osd.4 [v2:172.21.15.22:6808/923697266,v1:172.21.15.22:6809/923697266]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T09:32:20.822 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:20 smithi022 ceph-mon[35583]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T09:32:20.822 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:20 smithi022 ceph-mon[35583]: Detected new or changed devices on smithi022 2024-09-19T09:32:20.822 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:20 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:20.822 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:20 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:20.822 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:20 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:32:20.822 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:20 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:32:20.822 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:20 smithi022 ceph-mon[35583]: Adjusting osd_memory_target on smithi022 to 8546M 2024-09-19T09:32:20.822 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:20 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:20.822 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:20 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:20.822 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:20 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:20.822 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:20 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:21.114 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:32:20 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-4[46791]: 2024-09-19T09:32:20.819+0000 7f296d4b4640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T09:32:21.114 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:32:20 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-4[46791]: 2024-09-19T09:32:20.826+0000 7f29652d4640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:32:21.664 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:21 smithi001 ceph-mon[31225]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:32:21.665 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:21 smithi001 ceph-mon[31225]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-19T09:32:21.665 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:21 smithi001 ceph-mon[31225]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T09:32:21.665 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:21 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:32:21.665 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:21 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:32:21.665 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:21 smithi001 ceph-mon[31225]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:32:21.665 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:21 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:32:21.665 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:21 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:32:21.665 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:21 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:21.665 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:21 smithi001 ceph-mon[31225]: from='osd.4 ' entity='osd.4' 2024-09-19T09:32:21.860 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:21 smithi121 ceph-mon[35577]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:32:21.860 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:21 smithi121 ceph-mon[35577]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-19T09:32:21.860 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:21 smithi121 ceph-mon[35577]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T09:32:21.860 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:21 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:32:21.861 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:21 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:32:21.861 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:21 smithi121 ceph-mon[35577]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:32:21.861 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:21 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:32:21.861 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:21 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:32:21.861 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:21 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:21.861 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:21 smithi121 ceph-mon[35577]: from='osd.4 ' entity='osd.4' 2024-09-19T09:32:21.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:21 smithi022 ceph-mon[35583]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:32:21.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:21 smithi022 ceph-mon[35583]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-19T09:32:21.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:21 smithi022 ceph-mon[35583]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T09:32:21.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:21 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:32:21.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:21 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:32:21.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:21 smithi022 ceph-mon[35583]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:32:21.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:21 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:32:21.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:21 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:32:21.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:21 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:21.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:21 smithi022 ceph-mon[35583]: from='osd.4 ' entity='osd.4' 2024-09-19T09:32:22.521 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:22 smithi121 ceph-mon[35577]: purged_snaps scrub starts 2024-09-19T09:32:22.522 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:22 smithi121 ceph-mon[35577]: purged_snaps scrub ok 2024-09-19T09:32:22.522 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:22 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:32:22.522 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:22 smithi121 ceph-mon[35577]: osd.4 [v2:172.21.15.22:6808/923697266,v1:172.21.15.22:6809/923697266] boot 2024-09-19T09:32:22.522 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:22 smithi121 ceph-mon[35577]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T09:32:22.522 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:22 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:32:22.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:22 smithi001 ceph-mon[31225]: purged_snaps scrub starts 2024-09-19T09:32:22.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:22 smithi001 ceph-mon[31225]: purged_snaps scrub ok 2024-09-19T09:32:22.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:22 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:32:22.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:22 smithi001 ceph-mon[31225]: osd.4 [v2:172.21.15.22:6808/923697266,v1:172.21.15.22:6809/923697266] boot 2024-09-19T09:32:22.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:22 smithi001 ceph-mon[31225]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T09:32:22.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:22 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:32:22.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:22 smithi022 ceph-mon[35583]: purged_snaps scrub starts 2024-09-19T09:32:22.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:22 smithi022 ceph-mon[35583]: purged_snaps scrub ok 2024-09-19T09:32:22.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:22 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:32:22.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:22 smithi022 ceph-mon[35583]: osd.4 [v2:172.21.15.22:6808/923697266,v1:172.21.15.22:6809/923697266] boot 2024-09-19T09:32:22.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:22 smithi022 ceph-mon[35583]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T09:32:22.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:22 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T09:32:24.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:23 smithi022 ceph-mon[35583]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:32:24.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:23 smithi022 ceph-mon[35583]: from='client.? 172.21.15.121:0/141981768' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3b2f428c-8a5a-49be-9f43-a9f379a1c7e9"}]: dispatch 2024-09-19T09:32:24.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:23 smithi022 ceph-mon[35583]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3b2f428c-8a5a-49be-9f43-a9f379a1c7e9"}]: dispatch 2024-09-19T09:32:24.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:23 smithi022 ceph-mon[35583]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3b2f428c-8a5a-49be-9f43-a9f379a1c7e9"}]': finished 2024-09-19T09:32:24.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:23 smithi022 ceph-mon[35583]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T09:32:24.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:23 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:32:24.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:23 smithi022 ceph-mon[35583]: from='client.? 172.21.15.121:0/2502528695' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:32:24.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:23 smithi121 ceph-mon[35577]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:32:24.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:23 smithi121 ceph-mon[35577]: from='client.? 172.21.15.121:0/141981768' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3b2f428c-8a5a-49be-9f43-a9f379a1c7e9"}]: dispatch 2024-09-19T09:32:24.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:23 smithi121 ceph-mon[35577]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3b2f428c-8a5a-49be-9f43-a9f379a1c7e9"}]: dispatch 2024-09-19T09:32:24.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:23 smithi121 ceph-mon[35577]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3b2f428c-8a5a-49be-9f43-a9f379a1c7e9"}]': finished 2024-09-19T09:32:24.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:23 smithi121 ceph-mon[35577]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T09:32:24.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:23 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:32:24.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:23 smithi121 ceph-mon[35577]: from='client.? 172.21.15.121:0/2502528695' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:32:24.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:23 smithi001 ceph-mon[31225]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-19T09:32:24.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:23 smithi001 ceph-mon[31225]: from='client.? 172.21.15.121:0/141981768' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3b2f428c-8a5a-49be-9f43-a9f379a1c7e9"}]: dispatch 2024-09-19T09:32:24.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:23 smithi001 ceph-mon[31225]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3b2f428c-8a5a-49be-9f43-a9f379a1c7e9"}]: dispatch 2024-09-19T09:32:24.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:23 smithi001 ceph-mon[31225]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3b2f428c-8a5a-49be-9f43-a9f379a1c7e9"}]': finished 2024-09-19T09:32:24.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:23 smithi001 ceph-mon[31225]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T09:32:24.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:23 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:32:24.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:23 smithi001 ceph-mon[31225]: from='client.? 172.21.15.121:0/2502528695' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:32:26.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:25 smithi022 ceph-mon[35583]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:26.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:25 smithi121 ceph-mon[35577]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:26.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:25 smithi001 ceph-mon[31225]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:27.972 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:27 smithi121 ceph-mon[35577]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:28.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:27 smithi022 ceph-mon[35583]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:28.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:27 smithi001 ceph-mon[31225]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:30.041 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:29 smithi121 ceph-mon[35577]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:30.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:29 smithi022 ceph-mon[35583]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:30.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:29 smithi001 ceph-mon[31225]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:32.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:31 smithi022 ceph-mon[35583]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:32.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:31 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T09:32:32.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:31 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:32.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:31 smithi121 ceph-mon[35577]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:32.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:31 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T09:32:32.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:31 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:32.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:31 smithi001 ceph-mon[31225]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:32.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:31 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T09:32:32.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:31 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:33.112 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:32 smithi121 ceph-mon[35577]: Deploying daemon osd.5 on smithi121 2024-09-19T09:32:33.113 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:32 smithi022 ceph-mon[35583]: Deploying daemon osd.5 on smithi121 2024-09-19T09:32:33.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:32 smithi001 ceph-mon[31225]: Deploying daemon osd.5 on smithi121 2024-09-19T09:32:34.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:33 smithi022 ceph-mon[35583]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:34.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:33 smithi121 ceph-mon[35577]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:34.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:33 smithi001 ceph-mon[31225]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:36.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:35 smithi022 ceph-mon[35583]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:36.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:35 smithi121 ceph-mon[35577]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:36.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:35 smithi001 ceph-mon[31225]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:38.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:37 smithi022 ceph-mon[35583]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:38.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:37 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:38.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:37 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:38.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:37 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:38.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:37 smithi121 ceph-mon[35577]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:38.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:37 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:38.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:37 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:38.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:37 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:38.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:37 smithi001 ceph-mon[31225]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:38.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:37 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:38.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:37 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:38.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:37 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:39.969 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:39 smithi121 ceph-mon[35577]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:40.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:39 smithi022 ceph-mon[35583]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:40.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:39 smithi001 ceph-mon[31225]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:41.102 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:41.100+0000 7f1dac992640 1 -- 172.21.15.121:0/1441423288 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1da8062630 con 0x7f1d900a3240 2024-09-19T09:32:41.102 INFO:teuthology.orchestra.run.smithi121.stdout:Created osd(s) 5 on host 'smithi121' 2024-09-19T09:32:41.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:41.102+0000 7f1dad994640 1 -- 172.21.15.121:0/1441423288 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f1d900a3240 msgr2=0x7f1d900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:41.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:41.102+0000 7f1dad994640 1 --2- 172.21.15.121:0/1441423288 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f1d900a3240 0x7f1d900a5700 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1d98006010 tx=0x7f1d98032dd0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:41.103+0000 7f1dad994640 1 -- 172.21.15.121:0/1441423288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1da8101d10 msgr2=0x7f1da819cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:41.104 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:41.103+0000 7f1dad994640 1 --2- 172.21.15.121:0/1441423288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1da8101d10 0x7f1da819cce0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c00d950 tx=0x7f1d9c00de10 comp rx=0 tx=0).stop 2024-09-19T09:32:41.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:41.103+0000 7f1dad994640 1 -- 172.21.15.121:0/1441423288 shutdown_connections 2024-09-19T09:32:41.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:41.103+0000 7f1dad994640 1 --2- 172.21.15.121:0/1441423288 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f1d900a3240 0x7f1d900a5700 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:41.103+0000 7f1dad994640 1 --2- 172.21.15.121:0/1441423288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1da81026d0 0x7f1da819f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:41.103+0000 7f1dad994640 1 --2- 172.21.15.121:0/1441423288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1da8101d10 0x7f1da819cce0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:41.103+0000 7f1dad994640 1 --2- 172.21.15.121:0/1441423288 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1da8100b10 0x7f1da806b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:41.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:41.103+0000 7f1dad994640 1 -- 172.21.15.121:0/1441423288 >> 172.21.15.121:0/1441423288 conn(0x7f1da80fc2a0 msgr2=0x7f1da8105150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:41.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:41.103+0000 7f1dad994640 1 -- 172.21.15.121:0/1441423288 shutdown_connections 2024-09-19T09:32:41.105 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:32:41.103+0000 7f1dad994640 1 -- 172.21.15.121:0/1441423288 wait complete. 2024-09-19T09:32:41.907 DEBUG:teuthology.orchestra.run.smithi121:osd.5> sudo journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@osd.5.service 2024-09-19T09:32:41.910 INFO:tasks.cephadm:Deploying osd.6 on smithi001 with /dev/vg_nvme/lv_2... 2024-09-19T09:32:41.910 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T09:32:42.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:41 smithi022 ceph-mon[35583]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:42.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:41 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:42.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:41 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:42.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:41 smithi121 ceph-mon[35577]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:42.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:41 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:42.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:41 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:42.178 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:32:42.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:41 smithi001 ceph-mon[31225]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:42.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:41 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:42.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:41 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:43.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:42 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:43.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:42 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:43.326 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:42 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:43.327 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:42 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:43.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:42 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:43.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:42 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:44.006 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:43 smithi001 ceph-mon[31225]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:44.339 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:43 smithi121 ceph-mon[35577]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:44.340 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 19 09:32:44 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-5[47045]: 2024-09-19T09:32:43.998+0000 7f457f593640 -1 osd.5 0 log_to_monitors true 2024-09-19T09:32:44.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:43 smithi022 ceph-mon[35583]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:45.079 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:44 smithi001 ceph-mon[31225]: from='osd.5 [v2:172.21.15.121:6808/3137245658,v1:172.21.15.121:6809/3137245658]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:32:45.080 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:44 smithi001 ceph-mon[31225]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:32:45.080 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:32:45.107 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi001:vg_nvme/lv_2 2024-09-19T09:32:45.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:44 smithi022 ceph-mon[35583]: from='osd.5 [v2:172.21.15.121:6808/3137245658,v1:172.21.15.121:6809/3137245658]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:32:45.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:44 smithi022 ceph-mon[35583]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:32:45.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:44 smithi121 ceph-mon[35577]: from='osd.5 [v2:172.21.15.121:6808/3137245658,v1:172.21.15.121:6809/3137245658]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:32:45.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:44 smithi121 ceph-mon[35577]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T09:32:45.371 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:32:45.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.882+0000 7f57d4507640 1 -- 172.21.15.1:0/2097048898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57cc103930 msgr2=0x7f57cc10a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:45.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.882+0000 7f57d4507640 1 --2- 172.21.15.1:0/2097048898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57cc103930 0x7f57cc10a1c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f57c4009cd0 tx=0x7f57c402a8e0 comp rx=0 tx=0).stop 2024-09-19T09:32:45.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.883+0000 7f57d4507640 1 -- 172.21.15.1:0/2097048898 shutdown_connections 2024-09-19T09:32:45.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.883+0000 7f57d4507640 1 --2- 172.21.15.1:0/2097048898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57cc103930 0x7f57cc10a1c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:45.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.883+0000 7f57d4507640 1 --2- 172.21.15.1:0/2097048898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57cc102f70 0x7f57cc1033f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:45.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.883+0000 7f57d4507640 1 --2- 172.21.15.1:0/2097048898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57cc0ffef0 0x7f57cc1002f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:45.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.883+0000 7f57d4507640 1 -- 172.21.15.1:0/2097048898 >> 172.21.15.1:0/2097048898 conn(0x7f57cc0fba40 msgr2=0x7f57cc0fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:32:45.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.883+0000 7f57d4507640 1 -- 172.21.15.1:0/2097048898 shutdown_connections 2024-09-19T09:32:45.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.883+0000 7f57d4507640 1 -- 172.21.15.1:0/2097048898 wait complete. 2024-09-19T09:32:45.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.883+0000 7f57d4507640 1 Processor -- start 2024-09-19T09:32:45.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.883+0000 7f57d4507640 1 -- start start 2024-09-19T09:32:45.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.883+0000 7f57d4507640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57cc0ffef0 0x7f57cc1980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:45.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.883+0000 7f57d4507640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57cc102f70 0x7f57cc198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:45.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.883+0000 7f57d4507640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57cc103930 0x7f57cc19f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:45.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.883+0000 7f57d4507640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f57cc10d9a0 con 0x7f57cc102f70 2024-09-19T09:32:45.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.883+0000 7f57d4507640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f57cc10d820 con 0x7f57cc103930 2024-09-19T09:32:45.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.883+0000 7f57d4507640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f57cc10db20 con 0x7f57cc0ffef0 2024-09-19T09:32:45.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.884+0000 7f57d1aa2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57cc102f70 0x7f57cc198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:45.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.884+0000 7f57d1aa2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57cc102f70 0x7f57cc198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47070/0 (socket says 172.21.15.1:47070) 2024-09-19T09:32:45.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.884+0000 7f57d1aa2640 1 -- 172.21.15.1:0/4172114312 learned_addr learned my addr 172.21.15.1:0/4172114312 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:32:45.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.884+0000 7f57d2aa4640 1 --2- 172.21.15.1:0/4172114312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57cc103930 0x7f57cc19f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:45.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.884+0000 7f57d22a3640 1 --2- 172.21.15.1:0/4172114312 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57cc0ffef0 0x7f57cc1980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:45.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.884+0000 7f57d1aa2640 1 -- 172.21.15.1:0/4172114312 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57cc0ffef0 msgr2=0x7f57cc1980e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:45.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.884+0000 7f57d1aa2640 1 --2- 172.21.15.1:0/4172114312 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57cc0ffef0 0x7f57cc1980e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:45.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.884+0000 7f57d1aa2640 1 -- 172.21.15.1:0/4172114312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57cc103930 msgr2=0x7f57cc19f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:32:45.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.884+0000 7f57d1aa2640 1 --2- 172.21.15.1:0/4172114312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57cc103930 0x7f57cc19f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:32:45.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.884+0000 7f57d1aa2640 1 -- 172.21.15.1:0/4172114312 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57cc19fd10 con 0x7f57cc102f70 2024-09-19T09:32:45.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.884+0000 7f57d22a3640 1 --2- 172.21.15.1:0/4172114312 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57cc0ffef0 0x7f57cc1980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:32:45.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.884+0000 7f57d2aa4640 1 --2- 172.21.15.1:0/4172114312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57cc103930 0x7f57cc19f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:32:45.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.884+0000 7f57d1aa2640 1 --2- 172.21.15.1:0/4172114312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57cc102f70 0x7f57cc198620 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f57bc00b4a0 tx=0x7f57bc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:45.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.884+0000 7f57c37fe640 1 -- 172.21.15.1:0/4172114312 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57bc014070 con 0x7f57cc102f70 2024-09-19T09:32:45.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.884+0000 7f57c37fe640 1 -- 172.21.15.1:0/4172114312 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57bc010af0 con 0x7f57cc102f70 2024-09-19T09:32:45.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.884+0000 7f57d4507640 1 -- 172.21.15.1:0/4172114312 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57cc19ffa0 con 0x7f57cc102f70 2024-09-19T09:32:45.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.884+0000 7f57c37fe640 1 -- 172.21.15.1:0/4172114312 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57bc017d10 con 0x7f57cc102f70 2024-09-19T09:32:45.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.884+0000 7f57d4507640 1 -- 172.21.15.1:0/4172114312 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57cc1a04e0 con 0x7f57cc102f70 2024-09-19T09:32:45.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.885+0000 7f57d4507640 1 -- 172.21.15.1:0/4172114312 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57cc100370 con 0x7f57cc102f70 2024-09-19T09:32:45.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.887+0000 7f57c37fe640 1 -- 172.21.15.1:0/4172114312 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f57bc017070 con 0x7f57cc102f70 2024-09-19T09:32:45.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.887+0000 7f57c37fe640 1 --2- 172.21.15.1:0/4172114312 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f57b80a3270 0x7f57b80a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:32:45.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.887+0000 7f57d22a3640 1 --2- 172.21.15.1:0/4172114312 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f57b80a3270 0x7f57b80a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:32:45.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.887+0000 7f57c37fe640 1 -- 172.21.15.1:0/4172114312 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4237+0+0 (secure 0 0 0) 0x7f57bc0cde00 con 0x7f57cc102f70 2024-09-19T09:32:45.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.888+0000 7f57d22a3640 1 --2- 172.21.15.1:0/4172114312 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f57b80a3270 0x7f57b80a5730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f57cc06a4d0 tx=0x7f57c8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:32:45.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:45.892+0000 7f57c37fe640 1 -- 172.21.15.1:0/4172114312 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f57bc09ba70 con 0x7f57cc102f70 2024-09-19T09:32:46.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:32:46.081+0000 7f57d4507640 1 -- 172.21.15.1:0/4172114312 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f57cc062630 con 0x7f57b80a3270 2024-09-19T09:32:46.083 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:45 smithi001 ceph-mon[31225]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:46.083 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:45 smithi001 ceph-mon[31225]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T09:32:46.083 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:45 smithi001 ceph-mon[31225]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T09:32:46.083 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:45 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:32:46.083 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:45 smithi001 ceph-mon[31225]: from='osd.5 [v2:172.21.15.121:6808/3137245658,v1:172.21.15.121:6809/3137245658]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-19T09:32:46.083 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:45 smithi001 ceph-mon[31225]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-19T09:32:46.083 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:45 smithi001 ceph-mon[31225]: Detected new or changed devices on smithi121 2024-09-19T09:32:46.083 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:45 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:46.083 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:45 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:46.083 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:45 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:32:46.083 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:45 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:32:46.083 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:45 smithi001 ceph-mon[31225]: Adjusting osd_memory_target on smithi121 to 8543M 2024-09-19T09:32:46.083 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:45 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:46.084 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:45 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:46.084 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:45 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:46.084 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:45 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:46.084 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:45 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:46.084 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:45 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:46.084 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:45 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:46.084 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:45 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:46.360 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:45 smithi121 ceph-mon[35577]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:46.360 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:45 smithi121 ceph-mon[35577]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T09:32:46.360 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:45 smithi121 ceph-mon[35577]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T09:32:46.360 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:45 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:32:46.360 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:45 smithi121 ceph-mon[35577]: from='osd.5 [v2:172.21.15.121:6808/3137245658,v1:172.21.15.121:6809/3137245658]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-19T09:32:46.360 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:45 smithi121 ceph-mon[35577]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-19T09:32:46.361 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:45 smithi121 ceph-mon[35577]: Detected new or changed devices on smithi121 2024-09-19T09:32:46.361 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:45 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:46.361 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:45 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:46.361 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:45 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:32:46.361 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:45 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:32:46.361 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:45 smithi121 ceph-mon[35577]: Adjusting osd_memory_target on smithi121 to 8543M 2024-09-19T09:32:46.361 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:45 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:46.361 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:45 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:46.361 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:45 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:46.361 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:45 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:46.361 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:45 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:46.361 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:45 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:46.361 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:45 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:46.361 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:45 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:46.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:45 smithi022 ceph-mon[35583]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:46.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:45 smithi022 ceph-mon[35583]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T09:32:46.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:45 smithi022 ceph-mon[35583]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T09:32:46.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:45 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:32:46.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:45 smithi022 ceph-mon[35583]: from='osd.5 [v2:172.21.15.121:6808/3137245658,v1:172.21.15.121:6809/3137245658]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-19T09:32:46.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:45 smithi022 ceph-mon[35583]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-19T09:32:46.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:45 smithi022 ceph-mon[35583]: Detected new or changed devices on smithi121 2024-09-19T09:32:46.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:45 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:46.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:45 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:46.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:45 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:32:46.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:45 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:32:46.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:45 smithi022 ceph-mon[35583]: Adjusting osd_memory_target on smithi121 to 8543M 2024-09-19T09:32:46.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:45 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:46.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:45 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:46.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:45 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:46.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:45 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:46.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:45 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:32:46.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:45 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:46.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:45 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:32:46.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:45 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:32:46.616 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 19 09:32:46 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-5[47045]: 2024-09-19T09:32:46.358+0000 7f457b516640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T09:32:46.617 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 19 09:32:46 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-5[47045]: 2024-09-19T09:32:46.364+0000 7f4573336640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:32:47.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:46 smithi001 ceph-mon[31225]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-19T09:32:47.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:46 smithi001 ceph-mon[31225]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T09:32:47.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:46 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:32:47.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:46 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:32:47.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:46 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:32:47.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:46 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:32:47.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:46 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:47.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:46 smithi001 ceph-mon[31225]: from='osd.5 ' entity='osd.5' 2024-09-19T09:32:47.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:46 smithi022 ceph-mon[35583]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-19T09:32:47.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:46 smithi022 ceph-mon[35583]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T09:32:47.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:46 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:32:47.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:46 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:32:47.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:46 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:32:47.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:46 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:32:47.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:46 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:47.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:46 smithi022 ceph-mon[35583]: from='osd.5 ' entity='osd.5' 2024-09-19T09:32:47.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:46 smithi121 ceph-mon[35577]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-19T09:32:47.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:46 smithi121 ceph-mon[35577]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T09:32:47.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:46 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:32:47.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:46 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:32:47.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:46 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:32:47.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:46 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:32:47.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:46 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:47.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:46 smithi121 ceph-mon[35577]: from='osd.5 ' entity='osd.5' 2024-09-19T09:32:47.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:47 smithi001 ceph-mon[31225]: purged_snaps scrub starts 2024-09-19T09:32:47.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:47 smithi001 ceph-mon[31225]: purged_snaps scrub ok 2024-09-19T09:32:47.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:47 smithi001 ceph-mon[31225]: from='client.14352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:32:47.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:47 smithi001 ceph-mon[31225]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:47.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:47 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:32:47.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:47 smithi001 ceph-mon[31225]: osd.5 [v2:172.21.15.121:6808/3137245658,v1:172.21.15.121:6809/3137245658] boot 2024-09-19T09:32:47.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:47 smithi001 ceph-mon[31225]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T09:32:47.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:47 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:32:48.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:47 smithi022 ceph-mon[35583]: purged_snaps scrub starts 2024-09-19T09:32:48.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:47 smithi022 ceph-mon[35583]: purged_snaps scrub ok 2024-09-19T09:32:48.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:47 smithi022 ceph-mon[35583]: from='client.14352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:32:48.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:47 smithi022 ceph-mon[35583]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:48.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:47 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:32:48.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:47 smithi022 ceph-mon[35583]: osd.5 [v2:172.21.15.121:6808/3137245658,v1:172.21.15.121:6809/3137245658] boot 2024-09-19T09:32:48.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:47 smithi022 ceph-mon[35583]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T09:32:48.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:47 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:32:48.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:47 smithi121 ceph-mon[35577]: purged_snaps scrub starts 2024-09-19T09:32:48.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:47 smithi121 ceph-mon[35577]: purged_snaps scrub ok 2024-09-19T09:32:48.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:47 smithi121 ceph-mon[35577]: from='client.14352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:32:48.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:47 smithi121 ceph-mon[35577]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 447 GiB / 447 GiB avail 2024-09-19T09:32:48.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:47 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:32:48.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:47 smithi121 ceph-mon[35577]: osd.5 [v2:172.21.15.121:6808/3137245658,v1:172.21.15.121:6809/3137245658] boot 2024-09-19T09:32:48.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:47 smithi121 ceph-mon[35577]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T09:32:48.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:47 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T09:32:49.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:48 smithi001 ceph-mon[31225]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T09:32:49.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:48 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1665497065' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5aecec68-ff7e-440c-bd39-cc35ab89cc91"}]: dispatch 2024-09-19T09:32:49.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:48 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1665497065' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5aecec68-ff7e-440c-bd39-cc35ab89cc91"}]': finished 2024-09-19T09:32:49.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:48 smithi001 ceph-mon[31225]: osdmap e38: 7 total, 6 up, 7 in 2024-09-19T09:32:49.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:48 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:32:49.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:48 smithi022 ceph-mon[35583]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T09:32:49.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:48 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1665497065' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5aecec68-ff7e-440c-bd39-cc35ab89cc91"}]: dispatch 2024-09-19T09:32:49.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:48 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1665497065' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5aecec68-ff7e-440c-bd39-cc35ab89cc91"}]': finished 2024-09-19T09:32:49.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:48 smithi022 ceph-mon[35583]: osdmap e38: 7 total, 6 up, 7 in 2024-09-19T09:32:49.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:48 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:32:49.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:48 smithi121 ceph-mon[35577]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T09:32:49.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:48 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1665497065' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5aecec68-ff7e-440c-bd39-cc35ab89cc91"}]: dispatch 2024-09-19T09:32:49.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:48 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1665497065' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5aecec68-ff7e-440c-bd39-cc35ab89cc91"}]': finished 2024-09-19T09:32:49.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:48 smithi121 ceph-mon[35577]: osdmap e38: 7 total, 6 up, 7 in 2024-09-19T09:32:49.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:48 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:32:50.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:49 smithi001 ceph-mon[31225]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:32:50.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:49 smithi001 ceph-mon[31225]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T09:32:50.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:49 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:32:50.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:49 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/3130477071' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:32:50.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:49 smithi022 ceph-mon[35583]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:32:50.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:49 smithi022 ceph-mon[35583]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T09:32:50.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:49 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:32:50.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:49 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/3130477071' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:32:50.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:49 smithi121 ceph-mon[35577]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:32:50.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:49 smithi121 ceph-mon[35577]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T09:32:50.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:49 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:32:50.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:49 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/3130477071' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:32:51.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:51 smithi022 ceph-mon[35583]: pgmap v137: 1 pgs: 1 peering; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:32:51.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:51 smithi022 ceph-mon[35583]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T09:32:51.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:51 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:32:51.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:51 smithi121 ceph-mon[35577]: pgmap v137: 1 pgs: 1 peering; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:32:51.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:51 smithi121 ceph-mon[35577]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T09:32:51.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:51 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:32:51.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:51 smithi001 ceph-mon[31225]: pgmap v137: 1 pgs: 1 peering; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:32:51.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:51 smithi001 ceph-mon[31225]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T09:32:51.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:51 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:32:53.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:53 smithi022 ceph-mon[35583]: pgmap v139: 1 pgs: 1 peering; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail; 140 KiB/s, 0 objects/s recovering 2024-09-19T09:32:53.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:53 smithi121 ceph-mon[35577]: pgmap v139: 1 pgs: 1 peering; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail; 140 KiB/s, 0 objects/s recovering 2024-09-19T09:32:53.630 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:53 smithi001 ceph-mon[31225]: pgmap v139: 1 pgs: 1 peering; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail; 140 KiB/s, 0 objects/s recovering 2024-09-19T09:32:55.375 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:55 smithi001 ceph-mon[31225]: pgmap v140: 1 pgs: 1 peering; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T09:32:55.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:55 smithi022 ceph-mon[35583]: pgmap v140: 1 pgs: 1 peering; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T09:32:55.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:55 smithi121 ceph-mon[35577]: pgmap v140: 1 pgs: 1 peering; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T09:32:57.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:57 smithi022 ceph-mon[35583]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-19T09:32:57.614 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:57 smithi001 ceph-mon[31225]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-19T09:32:57.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:57 smithi121 ceph-mon[35577]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-19T09:32:58.328 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:58 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T09:32:58.328 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:58 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:58.328 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:58 smithi001 ceph-mon[31225]: Deploying daemon osd.6 on smithi001 2024-09-19T09:32:58.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:58 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T09:32:58.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:58 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:58.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:58 smithi022 ceph-mon[35583]: Deploying daemon osd.6 on smithi001 2024-09-19T09:32:58.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:58 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T09:32:58.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:58 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:32:58.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:58 smithi121 ceph-mon[35577]: Deploying daemon osd.6 on smithi001 2024-09-19T09:32:59.482 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:32:59 smithi001 ceph-mon[31225]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-19T09:32:59.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:32:59 smithi022 ceph-mon[35583]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-19T09:32:59.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:32:59 smithi121 ceph-mon[35577]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-19T09:33:01.412 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:01 smithi001 ceph-mon[31225]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:33:01.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:01 smithi022 ceph-mon[35583]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:33:01.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:01 smithi121 ceph-mon[35577]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:33:03.404 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:03 smithi001 ceph-mon[31225]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:33:03.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:03 smithi022 ceph-mon[35583]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:33:03.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:03 smithi121 ceph-mon[35577]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:33:04.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:04 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:04.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:04 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:04.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:04 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:04.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:04 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:04.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:04 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:04.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:04 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:04.637 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:04 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:04.637 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:04 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:04.637 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:04 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:06.236 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:06 smithi001 ceph-mon[31225]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:33:06.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:06 smithi022 ceph-mon[35583]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:33:06.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:06 smithi121 ceph-mon[35577]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:33:08.163 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:08 smithi001 ceph-mon[31225]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:33:08.164 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:08 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:08.164 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:08 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:08.164 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:08 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:08.164 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:08 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:08.164 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:08 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:08.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:33:08.205+0000 7f57c37fe640 1 -- 172.21.15.1:0/4172114312 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f57cc062630 con 0x7f57b80a3270 2024-09-19T09:33:08.207 INFO:teuthology.orchestra.run.smithi001.stdout:Created osd(s) 6 on host 'smithi001' 2024-09-19T09:33:08.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:33:08.208+0000 7f57d4507640 1 -- 172.21.15.1:0/4172114312 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f57b80a3270 msgr2=0x7f57b80a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:08.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:33:08.208+0000 7f57d4507640 1 --2- 172.21.15.1:0/4172114312 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f57b80a3270 0x7f57b80a5730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f57cc06a4d0 tx=0x7f57c8008040 comp rx=0 tx=0).stop 2024-09-19T09:33:08.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:33:08.208+0000 7f57d4507640 1 -- 172.21.15.1:0/4172114312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57cc102f70 msgr2=0x7f57cc198620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:08.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:33:08.208+0000 7f57d4507640 1 --2- 172.21.15.1:0/4172114312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57cc102f70 0x7f57cc198620 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f57bc00b4a0 tx=0x7f57bc00b960 comp rx=0 tx=0).stop 2024-09-19T09:33:08.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:33:08.208+0000 7f57d4507640 1 -- 172.21.15.1:0/4172114312 shutdown_connections 2024-09-19T09:33:08.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:33:08.208+0000 7f57d4507640 1 --2- 172.21.15.1:0/4172114312 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f57b80a3270 0x7f57b80a5730 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:33:08.208+0000 7f57d4507640 1 --2- 172.21.15.1:0/4172114312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57cc103930 0x7f57cc19f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:33:08.208+0000 7f57d4507640 1 --2- 172.21.15.1:0/4172114312 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57cc102f70 0x7f57cc198620 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:33:08.208+0000 7f57d4507640 1 --2- 172.21.15.1:0/4172114312 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57cc0ffef0 0x7f57cc1980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:08.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:33:08.208+0000 7f57d4507640 1 -- 172.21.15.1:0/4172114312 >> 172.21.15.1:0/4172114312 conn(0x7f57cc0fba40 msgr2=0x7f57cc106430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:08.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:33:08.208+0000 7f57d4507640 1 -- 172.21.15.1:0/4172114312 shutdown_connections 2024-09-19T09:33:08.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:33:08.208+0000 7f57d4507640 1 -- 172.21.15.1:0/4172114312 wait complete. 2024-09-19T09:33:08.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:08 smithi022 ceph-mon[35583]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:33:08.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:08 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:08.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:08 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:08.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:08 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:08.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:08 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:08.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:08 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:08.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:08 smithi121 ceph-mon[35577]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:33:08.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:08 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:08.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:08 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:08.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:08 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:08.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:08 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:08.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:08 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:08.854 DEBUG:teuthology.orchestra.run.smithi001:osd.6> sudo journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@osd.6.service 2024-09-19T09:33:08.857 INFO:tasks.cephadm:Deploying osd.7 on smithi022 with /dev/vg_nvme/lv_2... 2024-09-19T09:33:08.857 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T09:33:09.118 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:33:09.185 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:09 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:09.185 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:09 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:09.185 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:09 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:09.239 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:09 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:09.239 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:09 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:09.239 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:09 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:09.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:09 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:09.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:09 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:09.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:09 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:10.331 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:10 smithi001 ceph-mon[31225]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:33:10.363 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:10 smithi022 ceph-mon[35583]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:33:10.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:10 smithi121 ceph-mon[35577]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:33:10.633 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:33:10 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-6[55253]: 2024-09-19T09:33:10.329+0000 7f7191ee4640 -1 osd.6 0 log_to_monitors true 2024-09-19T09:33:11.338 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:11 smithi022 ceph-mon[35583]: from='osd.6 [v2:172.21.15.1:6818/3376780798,v1:172.21.15.1:6819/3376780798]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T09:33:11.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:11 smithi121 ceph-mon[35577]: from='osd.6 [v2:172.21.15.1:6818/3376780798,v1:172.21.15.1:6819/3376780798]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T09:33:11.491 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:11 smithi001 ceph-mon[31225]: from='osd.6 [v2:172.21.15.1:6818/3376780798,v1:172.21.15.1:6819/3376780798]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T09:33:11.801 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T09:33:11.827 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi022:vg_nvme/lv_2 2024-09-19T09:33:12.085 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:33:12.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:12 smithi001 ceph-mon[31225]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:33:12.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:12 smithi001 ceph-mon[31225]: from='osd.6 [v2:172.21.15.1:6818/3376780798,v1:172.21.15.1:6819/3376780798]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T09:33:12.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:12 smithi001 ceph-mon[31225]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T09:33:12.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:12 smithi001 ceph-mon[31225]: from='osd.6 [v2:172.21.15.1:6818/3376780798,v1:172.21.15.1:6819/3376780798]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T09:33:12.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:12 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:33:12.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:12 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:12.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:12 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:12.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:12 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:12.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:12 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:12.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:12 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:12.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:12 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:12.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:12 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:12.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:12 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:12.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:12 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:12.350 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:12 smithi022 ceph-mon[35583]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:33:12.350 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:12 smithi022 ceph-mon[35583]: from='osd.6 [v2:172.21.15.1:6818/3376780798,v1:172.21.15.1:6819/3376780798]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T09:33:12.350 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:12 smithi022 ceph-mon[35583]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T09:33:12.350 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:12 smithi022 ceph-mon[35583]: from='osd.6 [v2:172.21.15.1:6818/3376780798,v1:172.21.15.1:6819/3376780798]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T09:33:12.350 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:12 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:33:12.350 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:12 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:12.350 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:12 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:12.350 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:12 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:12.350 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:12 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:12.350 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:12 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:12.351 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:12 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:12.351 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:12 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:12.351 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:12 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:12.351 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:12 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:12.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:12 smithi121 ceph-mon[35577]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:33:12.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:12 smithi121 ceph-mon[35577]: from='osd.6 [v2:172.21.15.1:6818/3376780798,v1:172.21.15.1:6819/3376780798]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T09:33:12.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:12 smithi121 ceph-mon[35577]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T09:33:12.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:12 smithi121 ceph-mon[35577]: from='osd.6 [v2:172.21.15.1:6818/3376780798,v1:172.21.15.1:6819/3376780798]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T09:33:12.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:12 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:33:12.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:12 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:12.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:12 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:12.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:12 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:12.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:12 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:12.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:12 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:12.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:12 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:12.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:12 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:12.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:12 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:12.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:12 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:12.747 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:33:12 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-6[55253]: 2024-09-19T09:33:12.483+0000 7f718de67640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T09:33:12.747 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:33:12 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-6[55253]: 2024-09-19T09:33:12.494+0000 7f7185c87640 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:33:12.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.717+0000 7f447119e640 1 -- 172.21.15.22:0/3178550555 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f446c101cd0 msgr2=0x7f446c102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:12.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.717+0000 7f447119e640 1 --2- 172.21.15.22:0/3178550555 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f446c101cd0 0x7f446c102150 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4460009900 tx=0x7f446002a410 comp rx=0 tx=0).stop 2024-09-19T09:33:12.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.718+0000 7f447119e640 1 -- 172.21.15.22:0/3178550555 shutdown_connections 2024-09-19T09:33:12.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.718+0000 7f447119e640 1 --2- 172.21.15.22:0/3178550555 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f446c102690 0x7f446c108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.718+0000 7f447119e640 1 --2- 172.21.15.22:0/3178550555 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f446c101cd0 0x7f446c102150 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.718+0000 7f447119e640 1 --2- 172.21.15.22:0/3178550555 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f446c100ad0 0x7f446c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.718+0000 7f447119e640 1 -- 172.21.15.22:0/3178550555 >> 172.21.15.22:0/3178550555 conn(0x7f446c0fc280 msgr2=0x7f446c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:12.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.718+0000 7f447119e640 1 -- 172.21.15.22:0/3178550555 shutdown_connections 2024-09-19T09:33:12.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.718+0000 7f447119e640 1 -- 172.21.15.22:0/3178550555 wait complete. 2024-09-19T09:33:12.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.718+0000 7f447119e640 1 Processor -- start 2024-09-19T09:33:12.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.719+0000 7f447119e640 1 -- start start 2024-09-19T09:33:12.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.719+0000 7f447119e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f446c100ad0 0x7f446c197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:12.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.719+0000 7f447119e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f446c101cd0 0x7f446c1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:12.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.719+0000 7f447119e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f446c102690 0x7f446c19f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:12.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.719+0000 7f447119e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f446c10c730 con 0x7f446c101cd0 2024-09-19T09:33:12.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.719+0000 7f447119e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f446c10c5b0 con 0x7f446c102690 2024-09-19T09:33:12.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.719+0000 7f447119e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f446c10c8b0 con 0x7f446c100ad0 2024-09-19T09:33:12.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.719+0000 7f446b59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f446c102690 0x7f446c19f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:12.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.719+0000 7f446b59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f446c102690 0x7f446c19f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55128/0 (socket says 172.21.15.22:55128) 2024-09-19T09:33:12.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.719+0000 7f446b59e640 1 -- 172.21.15.22:0/3581838359 learned_addr learned my addr 172.21.15.22:0/3581838359 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-19T09:33:12.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.719+0000 7f446a59c640 1 --2- 172.21.15.22:0/3581838359 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f446c101cd0 0x7f446c1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:12.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.719+0000 7f446ad9d640 1 --2- 172.21.15.22:0/3581838359 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f446c100ad0 0x7f446c197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:12.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.719+0000 7f446b59e640 1 -- 172.21.15.22:0/3581838359 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f446c100ad0 msgr2=0x7f446c197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:12.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.719+0000 7f446b59e640 1 --2- 172.21.15.22:0/3581838359 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f446c100ad0 0x7f446c197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.719+0000 7f446b59e640 1 -- 172.21.15.22:0/3581838359 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f446c101cd0 msgr2=0x7f446c1983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:12.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.719+0000 7f446b59e640 1 --2- 172.21.15.22:0/3581838359 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f446c101cd0 0x7f446c1983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:12.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.719+0000 7f446b59e640 1 -- 172.21.15.22:0/3581838359 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f446c19fad0 con 0x7f446c102690 2024-09-19T09:33:12.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.719+0000 7f446b59e640 1 --2- 172.21.15.22:0/3581838359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f446c102690 0x7f446c19f460 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f446400cce0 tx=0x7f446400a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:12.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.719+0000 7f4453fff640 1 -- 172.21.15.22:0/3581838359 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446400f450 con 0x7f446c102690 2024-09-19T09:33:12.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.720+0000 7f447119e640 1 -- 172.21.15.22:0/3581838359 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f446c19fdc0 con 0x7f446c102690 2024-09-19T09:33:12.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.720+0000 7f4453fff640 1 -- 172.21.15.22:0/3581838359 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f446400fad0 con 0x7f446c102690 2024-09-19T09:33:12.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.720+0000 7f4453fff640 1 -- 172.21.15.22:0/3581838359 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4464018c10 con 0x7f446c102690 2024-09-19T09:33:12.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.720+0000 7f447119e640 1 -- 172.21.15.22:0/3581838359 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f446c1a0220 con 0x7f446c102690 2024-09-19T09:33:12.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.721+0000 7f447119e640 1 -- 172.21.15.22:0/3581838359 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f446c1a04b0 con 0x7f446c102690 2024-09-19T09:33:12.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.722+0000 7f4453fff640 1 -- 172.21.15.22:0/3581838359 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f446400f5f0 con 0x7f446c102690 2024-09-19T09:33:12.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.722+0000 7f4453fff640 1 --2- 172.21.15.22:0/3581838359 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f44540a3270 0x7f44540a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:12.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.722+0000 7f4453fff640 1 -- 172.21.15.22:0/3581838359 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4685+0+0 (secure 0 0 0) 0x7f44640cf1a0 con 0x7f446c102690 2024-09-19T09:33:12.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.723+0000 7f446ad9d640 1 --2- 172.21.15.22:0/3581838359 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f44540a3270 0x7f44540a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:12.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.723+0000 7f446ad9d640 1 --2- 172.21.15.22:0/3581838359 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f44540a3270 0x7f44540a5730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f445c005fd0 tx=0x7f445c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:12.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.727+0000 7f4453fff640 1 -- 172.21.15.22:0/3581838359 <== mon.2 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4464014030 con 0x7f446c102690 2024-09-19T09:33:12.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:12.910+0000 7f447119e640 1 -- 172.21.15.22:0/3581838359 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f446c1a0680 con 0x7f44540a3270 2024-09-19T09:33:13.321 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:13 smithi022 ceph-mon[35583]: Detected new or changed devices on smithi001 2024-09-19T09:33:13.321 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:13 smithi022 ceph-mon[35583]: Adjusting osd_memory_target on smithi001 to 5697M 2024-09-19T09:33:13.321 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:13 smithi022 ceph-mon[35583]: from='osd.6 [v2:172.21.15.1:6818/3376780798,v1:172.21.15.1:6819/3376780798]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T09:33:13.321 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:13 smithi022 ceph-mon[35583]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T09:33:13.321 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:13 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:33:13.321 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:13 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:33:13.322 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:13 smithi022 ceph-mon[35583]: from='osd.6 [v2:172.21.15.1:6818/3376780798,v1:172.21.15.1:6819/3376780798]' entity='osd.6' 2024-09-19T09:33:13.322 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:13 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:33:13.322 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:13 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:33:13.322 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:13 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:13.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:13 smithi121 ceph-mon[35577]: Detected new or changed devices on smithi001 2024-09-19T09:33:13.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:13 smithi121 ceph-mon[35577]: Adjusting osd_memory_target on smithi001 to 5697M 2024-09-19T09:33:13.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:13 smithi121 ceph-mon[35577]: from='osd.6 [v2:172.21.15.1:6818/3376780798,v1:172.21.15.1:6819/3376780798]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T09:33:13.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:13 smithi121 ceph-mon[35577]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T09:33:13.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:13 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:33:13.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:13 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:33:13.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:13 smithi121 ceph-mon[35577]: from='osd.6 [v2:172.21.15.1:6818/3376780798,v1:172.21.15.1:6819/3376780798]' entity='osd.6' 2024-09-19T09:33:13.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:13 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:33:13.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:13 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:33:13.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:13 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:13.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:13 smithi001 ceph-mon[31225]: Detected new or changed devices on smithi001 2024-09-19T09:33:13.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:13 smithi001 ceph-mon[31225]: Adjusting osd_memory_target on smithi001 to 5697M 2024-09-19T09:33:13.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:13 smithi001 ceph-mon[31225]: from='osd.6 [v2:172.21.15.1:6818/3376780798,v1:172.21.15.1:6819/3376780798]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T09:33:13.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:13 smithi001 ceph-mon[31225]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T09:33:13.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:13 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:33:13.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:13 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:33:13.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:13 smithi001 ceph-mon[31225]: from='osd.6 [v2:172.21.15.1:6818/3376780798,v1:172.21.15.1:6819/3376780798]' entity='osd.6' 2024-09-19T09:33:13.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:13 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:33:13.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:13 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:33:13.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:13 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:14.300 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:14 smithi022 ceph-mon[35583]: purged_snaps scrub starts 2024-09-19T09:33:14.300 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:14 smithi022 ceph-mon[35583]: purged_snaps scrub ok 2024-09-19T09:33:14.301 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:14 smithi022 ceph-mon[35583]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:33:14.301 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:14 smithi022 ceph-mon[35583]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:33:14.301 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:14 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:33:14.301 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:14 smithi022 ceph-mon[35583]: osd.6 [v2:172.21.15.1:6818/3376780798,v1:172.21.15.1:6819/3376780798] boot 2024-09-19T09:33:14.301 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:14 smithi022 ceph-mon[35583]: osdmap e43: 7 total, 7 up, 7 in 2024-09-19T09:33:14.301 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:14 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:33:14.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:14 smithi121 ceph-mon[35577]: purged_snaps scrub starts 2024-09-19T09:33:14.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:14 smithi121 ceph-mon[35577]: purged_snaps scrub ok 2024-09-19T09:33:14.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:14 smithi121 ceph-mon[35577]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:33:14.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:14 smithi121 ceph-mon[35577]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:33:14.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:14 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:33:14.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:14 smithi121 ceph-mon[35577]: osd.6 [v2:172.21.15.1:6818/3376780798,v1:172.21.15.1:6819/3376780798] boot 2024-09-19T09:33:14.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:14 smithi121 ceph-mon[35577]: osdmap e43: 7 total, 7 up, 7 in 2024-09-19T09:33:14.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:14 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:33:14.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:14 smithi001 ceph-mon[31225]: purged_snaps scrub starts 2024-09-19T09:33:14.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:14 smithi001 ceph-mon[31225]: purged_snaps scrub ok 2024-09-19T09:33:14.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:14 smithi001 ceph-mon[31225]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 536 GiB / 536 GiB avail 2024-09-19T09:33:14.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:14 smithi001 ceph-mon[31225]: from='client.24284 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:33:14.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:14 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:33:14.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:14 smithi001 ceph-mon[31225]: osd.6 [v2:172.21.15.1:6818/3376780798,v1:172.21.15.1:6819/3376780798] boot 2024-09-19T09:33:14.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:14 smithi001 ceph-mon[31225]: osdmap e43: 7 total, 7 up, 7 in 2024-09-19T09:33:14.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:14 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T09:33:15.094 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:15 smithi022 ceph-mon[35583]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:15.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:15 smithi121 ceph-mon[35577]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:15.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:15 smithi001 ceph-mon[31225]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:16.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:16 smithi022 ceph-mon[35583]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T09:33:16.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:16 smithi022 ceph-mon[35583]: from='client.? 172.21.15.22:0/3382650857' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46556bdf-199e-4268-873b-6d87b54e1176"}]: dispatch 2024-09-19T09:33:16.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:16 smithi022 ceph-mon[35583]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46556bdf-199e-4268-873b-6d87b54e1176"}]: dispatch 2024-09-19T09:33:16.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:16 smithi022 ceph-mon[35583]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46556bdf-199e-4268-873b-6d87b54e1176"}]': finished 2024-09-19T09:33:16.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:16 smithi022 ceph-mon[35583]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T09:33:16.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:16 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:33:16.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:16 smithi022 ceph-mon[35583]: from='client.? 172.21.15.22:0/4237710984' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:33:16.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:16 smithi121 ceph-mon[35577]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T09:33:16.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:16 smithi121 ceph-mon[35577]: from='client.? 172.21.15.22:0/3382650857' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46556bdf-199e-4268-873b-6d87b54e1176"}]: dispatch 2024-09-19T09:33:16.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:16 smithi121 ceph-mon[35577]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46556bdf-199e-4268-873b-6d87b54e1176"}]: dispatch 2024-09-19T09:33:16.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:16 smithi121 ceph-mon[35577]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46556bdf-199e-4268-873b-6d87b54e1176"}]': finished 2024-09-19T09:33:16.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:16 smithi121 ceph-mon[35577]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T09:33:16.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:16 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:33:16.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:16 smithi121 ceph-mon[35577]: from='client.? 172.21.15.22:0/4237710984' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:33:16.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:16 smithi001 ceph-mon[31225]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T09:33:16.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:16 smithi001 ceph-mon[31225]: from='client.? 172.21.15.22:0/3382650857' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46556bdf-199e-4268-873b-6d87b54e1176"}]: dispatch 2024-09-19T09:33:16.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:16 smithi001 ceph-mon[31225]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "46556bdf-199e-4268-873b-6d87b54e1176"}]: dispatch 2024-09-19T09:33:16.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:16 smithi001 ceph-mon[31225]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "46556bdf-199e-4268-873b-6d87b54e1176"}]': finished 2024-09-19T09:33:16.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:16 smithi001 ceph-mon[31225]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T09:33:16.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:16 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:33:16.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:16 smithi001 ceph-mon[31225]: from='client.? 172.21.15.22:0/4237710984' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:33:17.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:17 smithi022 ceph-mon[35583]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:17.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:17 smithi121 ceph-mon[35577]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:17.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:17 smithi001 ceph-mon[31225]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:19.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:19 smithi001 ceph-mon[31225]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:19.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:19 smithi022 ceph-mon[35583]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:19.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:19 smithi121 ceph-mon[35577]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:21.219 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:21 smithi022 ceph-mon[35583]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:21.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:21 smithi001 ceph-mon[31225]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:21.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:21 smithi121 ceph-mon[35577]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:23.419 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:23 smithi121 ceph-mon[35577]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:23.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:23 smithi001 ceph-mon[31225]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:23.548 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:23 smithi022 ceph-mon[35583]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:24.462 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:24 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T09:33:24.462 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:24 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:24.462 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:24 smithi022 ceph-mon[35583]: Deploying daemon osd.7 on smithi022 2024-09-19T09:33:24.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:24 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T09:33:24.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:24 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:24.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:24 smithi001 ceph-mon[31225]: Deploying daemon osd.7 on smithi022 2024-09-19T09:33:24.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:24 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T09:33:24.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:24 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:24.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:24 smithi121 ceph-mon[35577]: Deploying daemon osd.7 on smithi022 2024-09-19T09:33:25.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:25 smithi001 ceph-mon[31225]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:25.522 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:25 smithi022 ceph-mon[35583]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:25.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:25 smithi121 ceph-mon[35577]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:27.315 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:27 smithi022 ceph-mon[35583]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:27.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:27 smithi001 ceph-mon[31225]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:27.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:27 smithi121 ceph-mon[35577]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:29.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:29 smithi022 ceph-mon[35583]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:29.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:29 smithi001 ceph-mon[31225]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:29.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:29 smithi121 ceph-mon[35577]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:30.478 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:30 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:30.478 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:30 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:30.478 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:30 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:30.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:30 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:30.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:30 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:30.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:30 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:30.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:30 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:30.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:30 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:30.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:30 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:32.111 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:32 smithi022 ceph-mon[35583]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:32.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:32 smithi121 ceph-mon[35577]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:32.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:32 smithi001 ceph-mon[31225]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:33.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:33.532+0000 7f4453fff640 1 -- 172.21.15.22:0/3581838359 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f446c1a0680 con 0x7f44540a3270 2024-09-19T09:33:33.535 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 7 on host 'smithi022' 2024-09-19T09:33:33.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:33.534+0000 7f447119e640 1 -- 172.21.15.22:0/3581838359 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f44540a3270 msgr2=0x7f44540a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:33.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:33.534+0000 7f447119e640 1 --2- 172.21.15.22:0/3581838359 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f44540a3270 0x7f44540a5730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f445c005fd0 tx=0x7f445c005850 comp rx=0 tx=0).stop 2024-09-19T09:33:33.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:33.534+0000 7f447119e640 1 -- 172.21.15.22:0/3581838359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f446c102690 msgr2=0x7f446c19f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:33.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:33.534+0000 7f447119e640 1 --2- 172.21.15.22:0/3581838359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f446c102690 0x7f446c19f460 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f446400cce0 tx=0x7f446400a620 comp rx=0 tx=0).stop 2024-09-19T09:33:33.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:33.534+0000 7f447119e640 1 -- 172.21.15.22:0/3581838359 shutdown_connections 2024-09-19T09:33:33.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:33.534+0000 7f447119e640 1 --2- 172.21.15.22:0/3581838359 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f44540a3270 0x7f44540a5730 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:33.534+0000 7f447119e640 1 --2- 172.21.15.22:0/3581838359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f446c102690 0x7f446c19f460 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:33.534+0000 7f447119e640 1 --2- 172.21.15.22:0/3581838359 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f446c101cd0 0x7f446c1983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:33.534+0000 7f447119e640 1 --2- 172.21.15.22:0/3581838359 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f446c100ad0 0x7f446c197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:33.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:33.534+0000 7f447119e640 1 -- 172.21.15.22:0/3581838359 >> 172.21.15.22:0/3581838359 conn(0x7f446c0fc280 msgr2=0x7f446c069fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:33.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:33.534+0000 7f447119e640 1 -- 172.21.15.22:0/3581838359 shutdown_connections 2024-09-19T09:33:33.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:33:33.534+0000 7f447119e640 1 -- 172.21.15.22:0/3581838359 wait complete. 2024-09-19T09:33:34.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:34 smithi022 ceph-mon[35583]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:34.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:34 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:34.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:34 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:34.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:34 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:34.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:34 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:34.188 DEBUG:teuthology.orchestra.run.smithi022:osd.7> sudo journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@osd.7.service 2024-09-19T09:33:34.191 INFO:tasks.cephadm:Deploying osd.8 on smithi121 with /dev/vg_nvme/lv_2... 2024-09-19T09:33:34.191 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T09:33:34.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:34 smithi121 ceph-mon[35577]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:34.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:34 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:34.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:34 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:34.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:34 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:34.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:34 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:34.445 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:33:34.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:34 smithi001 ceph-mon[31225]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:34.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:34 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:34.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:34 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:34.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:34 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:34.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:34 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:36.057 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:33:35 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-7[53304]: 2024-09-19T09:33:35.822+0000 7fcd2e271640 -1 osd.7 0 log_to_monitors true 2024-09-19T09:33:36.323 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:36 smithi121 ceph-mon[35577]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:36.323 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:36 smithi121 ceph-mon[35577]: from='osd.7 [v2:172.21.15.22:6816/2920985295,v1:172.21.15.22:6817/2920985295]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T09:33:36.323 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:36 smithi121 ceph-mon[35577]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T09:33:36.363 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:36 smithi022 ceph-mon[35583]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:36.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:36 smithi022 ceph-mon[35583]: from='osd.7 [v2:172.21.15.22:6816/2920985295,v1:172.21.15.22:6817/2920985295]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T09:33:36.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:36 smithi022 ceph-mon[35583]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T09:33:36.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:36 smithi001 ceph-mon[31225]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:36.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:36 smithi001 ceph-mon[31225]: from='osd.7 [v2:172.21.15.22:6816/2920985295,v1:172.21.15.22:6817/2920985295]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T09:33:36.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:36 smithi001 ceph-mon[31225]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T09:33:37.038 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-19T09:33:37.066 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi121:vg_nvme/lv_2 2024-09-19T09:33:37.114 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:33:37 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-7[53304]: 2024-09-19T09:33:37.064+0000 7fcd2a1f4640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T09:33:37.114 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:33:37 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-7[53304]: 2024-09-19T09:33:37.073+0000 7fcd2601c640 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:33:37.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:37 smithi022 ceph-mon[35583]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T09:33:37.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:37 smithi022 ceph-mon[35583]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T09:33:37.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:37 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:33:37.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:37 smithi022 ceph-mon[35583]: from='osd.7 [v2:172.21.15.22:6816/2920985295,v1:172.21.15.22:6817/2920985295]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T09:33:37.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:37 smithi022 ceph-mon[35583]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T09:33:37.317 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:33:37.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:37 smithi121 ceph-mon[35577]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T09:33:37.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:37 smithi121 ceph-mon[35577]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T09:33:37.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:37 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:33:37.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:37 smithi121 ceph-mon[35577]: from='osd.7 [v2:172.21.15.22:6816/2920985295,v1:172.21.15.22:6817/2920985295]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T09:33:37.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:37 smithi121 ceph-mon[35577]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T09:33:37.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:37 smithi001 ceph-mon[31225]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T09:33:37.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:37 smithi001 ceph-mon[31225]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T09:33:37.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:37 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:33:37.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:37 smithi001 ceph-mon[31225]: from='osd.7 [v2:172.21.15.22:6816/2920985295,v1:172.21.15.22:6817/2920985295]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T09:33:37.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:37 smithi001 ceph-mon[31225]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T09:33:37.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.762+0000 7faa271be640 1 -- 172.21.15.121:0/2019690102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa201026d0 msgr2=0x7faa20108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:37.772 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.762+0000 7faa271be640 1 --2- 172.21.15.121:0/2019690102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa201026d0 0x7faa20108f60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7faa18009ca0 tx=0x7faa1802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:33:37.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.762+0000 7faa271be640 1 -- 172.21.15.121:0/2019690102 shutdown_connections 2024-09-19T09:33:37.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.762+0000 7faa271be640 1 --2- 172.21.15.121:0/2019690102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa201026d0 0x7faa20108f60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:37.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.762+0000 7faa271be640 1 --2- 172.21.15.121:0/2019690102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa20101d10 0x7faa20102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:37.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.762+0000 7faa271be640 1 --2- 172.21.15.121:0/2019690102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa20100b10 0x7faa20100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:37.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.762+0000 7faa271be640 1 -- 172.21.15.121:0/2019690102 >> 172.21.15.121:0/2019690102 conn(0x7faa200fc2a0 msgr2=0x7faa200fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:37.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.762+0000 7faa271be640 1 -- 172.21.15.121:0/2019690102 shutdown_connections 2024-09-19T09:33:37.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.762+0000 7faa271be640 1 -- 172.21.15.121:0/2019690102 wait complete. 2024-09-19T09:33:37.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.763+0000 7faa271be640 1 Processor -- start 2024-09-19T09:33:37.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.763+0000 7faa271be640 1 -- start start 2024-09-19T09:33:37.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.763+0000 7faa271be640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa20100b10 0x7faa20197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:37.773 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.763+0000 7faa271be640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa20101d10 0x7faa201983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:37.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.763+0000 7faa271be640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa201026d0 0x7faa2006dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:37.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.763+0000 7faa271be640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faa2010d8c0 con 0x7faa201026d0 2024-09-19T09:33:37.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.763+0000 7faa271be640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faa2010d740 con 0x7faa20100b10 2024-09-19T09:33:37.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.763+0000 7faa271be640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7faa2010da40 con 0x7faa20101d10 2024-09-19T09:33:37.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.763+0000 7faa1ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa20101d10 0x7faa201983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:37.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.763+0000 7faa1ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa20101d10 0x7faa201983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:42838/0 (socket says 172.21.15.121:42838) 2024-09-19T09:33:37.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.763+0000 7faa1ffff640 1 -- 172.21.15.121:0/3602092465 learned_addr learned my addr 172.21.15.121:0/3602092465 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-19T09:33:37.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.763+0000 7faa24f5a640 1 --2- 172.21.15.121:0/3602092465 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa20100b10 0x7faa20197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:37.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.763+0000 7faa2575b640 1 --2- 172.21.15.121:0/3602092465 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa201026d0 0x7faa2006dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:37.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.764+0000 7faa1ffff640 1 -- 172.21.15.121:0/3602092465 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa20100b10 msgr2=0x7faa20197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:37.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.764+0000 7faa1ffff640 1 --2- 172.21.15.121:0/3602092465 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa20100b10 0x7faa20197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:37.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.764+0000 7faa1ffff640 1 -- 172.21.15.121:0/3602092465 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa201026d0 msgr2=0x7faa2006dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:37.774 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.764+0000 7faa1ffff640 1 --2- 172.21.15.121:0/3602092465 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa201026d0 0x7faa2006dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:37.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.764+0000 7faa1ffff640 1 -- 172.21.15.121:0/3602092465 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa200726a0 con 0x7faa20101d10 2024-09-19T09:33:37.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.764+0000 7faa2575b640 1 --2- 172.21.15.121:0/3602092465 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa201026d0 0x7faa2006dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:33:37.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.764+0000 7faa1ffff640 1 --2- 172.21.15.121:0/3602092465 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa20101d10 0x7faa201983d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00e9f0 tx=0x7faa0c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:37.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.764+0000 7faa1dffb640 1 -- 172.21.15.121:0/3602092465 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c00cd80 con 0x7faa20101d10 2024-09-19T09:33:37.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.764+0000 7faa271be640 1 -- 172.21.15.121:0/3602092465 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa20072990 con 0x7faa20101d10 2024-09-19T09:33:37.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.764+0000 7faa1dffb640 1 -- 172.21.15.121:0/3602092465 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa0c010910 con 0x7faa20101d10 2024-09-19T09:33:37.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.764+0000 7faa1dffb640 1 -- 172.21.15.121:0/3602092465 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c0188f0 con 0x7faa20101d10 2024-09-19T09:33:37.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.764+0000 7faa271be640 1 -- 172.21.15.121:0/3602092465 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa20072f20 con 0x7faa20101d10 2024-09-19T09:33:37.775 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.765+0000 7faa271be640 1 -- 172.21.15.121:0/3602092465 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa20100f10 con 0x7faa20101d10 2024-09-19T09:33:37.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.766+0000 7faa1dffb640 1 -- 172.21.15.121:0/3602092465 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7faa0c010ac0 con 0x7faa20101d10 2024-09-19T09:33:37.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.767+0000 7faa1dffb640 1 --2- 172.21.15.121:0/3602092465 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7faa100a3270 0x7faa100a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:33:37.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.767+0000 7faa1dffb640 1 -- 172.21.15.121:0/3602092465 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5117+0+0 (secure 0 0 0) 0x7faa0c0cf190 con 0x7faa20101d10 2024-09-19T09:33:37.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.767+0000 7faa24f5a640 1 --2- 172.21.15.121:0/3602092465 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7faa100a3270 0x7faa100a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:33:37.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.768+0000 7faa24f5a640 1 --2- 172.21.15.121:0/3602092465 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7faa100a3270 0x7faa100a5730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faa14005fd0 tx=0x7faa1400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:33:37.776 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.771+0000 7faa1dffb640 1 -- 172.21.15.121:0/3602092465 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faa0c09ca90 con 0x7faa20101d10 2024-09-19T09:33:37.948 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:37.946+0000 7faa271be640 1 -- 172.21.15.121:0/3602092465 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7faa20062630 con 0x7faa100a3270 2024-09-19T09:33:38.356 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:38 smithi121 ceph-mon[35577]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:38.357 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:38 smithi121 ceph-mon[35577]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-19T09:33:38.357 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:38 smithi121 ceph-mon[35577]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T09:33:38.357 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:38 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:33:38.357 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:38 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:33:38.357 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:38 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:38.357 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:38 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:38.357 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:38 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:38.357 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:38 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:38.357 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:38 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:38.357 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:38 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:38.357 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:38 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:38.358 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:38 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:38.358 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:38 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:38.358 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:38 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:38.358 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:38 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:38.358 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:38 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:38.358 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:38 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:38.358 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:38 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:33:38.358 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:38 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:33:38.358 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:38 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:38.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:38 smithi022 ceph-mon[35583]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:38.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:38 smithi022 ceph-mon[35583]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-19T09:33:38.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:38 smithi022 ceph-mon[35583]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T09:33:38.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:38 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:33:38.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:38 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:33:38.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:38 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:38.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:38 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:38.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:38 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:38.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:38 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:38.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:38 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:38.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:38 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:38.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:38 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:38.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:38 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:38.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:38 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:38.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:38 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:38.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:38 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:38.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:38 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:38.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:38 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:38.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:38 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:33:38.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:38 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:33:38.366 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:38 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:38.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:38 smithi001 ceph-mon[31225]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:38.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:38 smithi001 ceph-mon[31225]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-19T09:33:38.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:38 smithi001 ceph-mon[31225]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T09:33:38.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:38 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:33:38.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:38 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:33:38.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:38 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:38.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:38 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:38.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:38 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:38.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:38 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:38.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:38 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:33:38.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:38 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:38.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:38 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:38.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:38 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:38.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:38 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:38.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:38 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:38.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:38 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:38.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:38 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:38.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:38 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:38.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:38 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:33:38.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:38 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:33:38.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:38 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:39.359 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:39 smithi121 ceph-mon[35577]: purged_snaps scrub starts 2024-09-19T09:33:39.360 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:39 smithi121 ceph-mon[35577]: purged_snaps scrub ok 2024-09-19T09:33:39.360 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:39 smithi121 ceph-mon[35577]: Detected new or changed devices on smithi022 2024-09-19T09:33:39.360 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:39 smithi121 ceph-mon[35577]: Adjusting osd_memory_target on smithi022 to 5697M 2024-09-19T09:33:39.360 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:39 smithi121 ceph-mon[35577]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:33:39.360 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:39 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:33:39.360 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:39 smithi121 ceph-mon[35577]: osd.7 [v2:172.21.15.22:6816/2920985295,v1:172.21.15.22:6817/2920985295] boot 2024-09-19T09:33:39.360 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:39 smithi121 ceph-mon[35577]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T09:33:39.360 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:39 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:33:39.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:39 smithi022 ceph-mon[35583]: purged_snaps scrub starts 2024-09-19T09:33:39.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:39 smithi022 ceph-mon[35583]: purged_snaps scrub ok 2024-09-19T09:33:39.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:39 smithi022 ceph-mon[35583]: Detected new or changed devices on smithi022 2024-09-19T09:33:39.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:39 smithi022 ceph-mon[35583]: Adjusting osd_memory_target on smithi022 to 5697M 2024-09-19T09:33:39.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:39 smithi022 ceph-mon[35583]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:33:39.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:39 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:33:39.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:39 smithi022 ceph-mon[35583]: osd.7 [v2:172.21.15.22:6816/2920985295,v1:172.21.15.22:6817/2920985295] boot 2024-09-19T09:33:39.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:39 smithi022 ceph-mon[35583]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T09:33:39.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:39 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:33:39.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:39 smithi001 ceph-mon[31225]: purged_snaps scrub starts 2024-09-19T09:33:39.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:39 smithi001 ceph-mon[31225]: purged_snaps scrub ok 2024-09-19T09:33:39.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:39 smithi001 ceph-mon[31225]: Detected new or changed devices on smithi022 2024-09-19T09:33:39.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:39 smithi001 ceph-mon[31225]: Adjusting osd_memory_target on smithi022 to 5697M 2024-09-19T09:33:39.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:39 smithi001 ceph-mon[31225]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:33:39.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:39 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:33:39.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:39 smithi001 ceph-mon[31225]: osd.7 [v2:172.21.15.22:6816/2920985295,v1:172.21.15.22:6817/2920985295] boot 2024-09-19T09:33:39.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:39 smithi001 ceph-mon[31225]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T09:33:39.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:39 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T09:33:40.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:40 smithi022 ceph-mon[35583]: pgmap v170: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:40.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:40 smithi022 ceph-mon[35583]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T09:33:40.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:40 smithi121 ceph-mon[35577]: pgmap v170: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:40.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:40 smithi121 ceph-mon[35577]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T09:33:40.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:40 smithi001 ceph-mon[31225]: pgmap v170: 1 pgs: 1 unknown; 577 KiB data, 233 MiB used, 626 GiB / 626 GiB avail 2024-09-19T09:33:40.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:40 smithi001 ceph-mon[31225]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T09:33:41.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:41 smithi121 ceph-mon[35577]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T09:33:41.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:41 smithi121 ceph-mon[35577]: pgmap v173: 1 pgs: 1 unknown; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:33:41.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:41 smithi121 ceph-mon[35577]: from='client.? 172.21.15.121:0/2844222016' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e7c3792a-94a4-4440-be74-d6abdf3d9566"}]: dispatch 2024-09-19T09:33:41.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:41 smithi121 ceph-mon[35577]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e7c3792a-94a4-4440-be74-d6abdf3d9566"}]: dispatch 2024-09-19T09:33:41.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:41 smithi121 ceph-mon[35577]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e7c3792a-94a4-4440-be74-d6abdf3d9566"}]': finished 2024-09-19T09:33:41.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:41 smithi121 ceph-mon[35577]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T09:33:41.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:41 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:33:41.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:41 smithi121 ceph-mon[35577]: from='client.? 172.21.15.121:0/1107452516' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:33:41.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:41 smithi022 ceph-mon[35583]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T09:33:41.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:41 smithi022 ceph-mon[35583]: pgmap v173: 1 pgs: 1 unknown; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:33:41.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:41 smithi022 ceph-mon[35583]: from='client.? 172.21.15.121:0/2844222016' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e7c3792a-94a4-4440-be74-d6abdf3d9566"}]: dispatch 2024-09-19T09:33:41.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:41 smithi022 ceph-mon[35583]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e7c3792a-94a4-4440-be74-d6abdf3d9566"}]: dispatch 2024-09-19T09:33:41.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:41 smithi022 ceph-mon[35583]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e7c3792a-94a4-4440-be74-d6abdf3d9566"}]': finished 2024-09-19T09:33:41.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:41 smithi022 ceph-mon[35583]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T09:33:41.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:41 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:33:41.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:41 smithi022 ceph-mon[35583]: from='client.? 172.21.15.121:0/1107452516' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:33:41.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:41 smithi001 ceph-mon[31225]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T09:33:41.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:41 smithi001 ceph-mon[31225]: pgmap v173: 1 pgs: 1 unknown; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:33:41.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:41 smithi001 ceph-mon[31225]: from='client.? 172.21.15.121:0/2844222016' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e7c3792a-94a4-4440-be74-d6abdf3d9566"}]: dispatch 2024-09-19T09:33:41.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:41 smithi001 ceph-mon[31225]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e7c3792a-94a4-4440-be74-d6abdf3d9566"}]: dispatch 2024-09-19T09:33:41.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:41 smithi001 ceph-mon[31225]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e7c3792a-94a4-4440-be74-d6abdf3d9566"}]': finished 2024-09-19T09:33:41.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:41 smithi001 ceph-mon[31225]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T09:33:41.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:41 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:33:41.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:41 smithi001 ceph-mon[31225]: from='client.? 172.21.15.121:0/1107452516' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:33:42.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:42 smithi022 ceph-mon[35583]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T09:33:42.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:42 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:33:42.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:42 smithi121 ceph-mon[35577]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T09:33:42.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:42 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:33:42.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:42 smithi001 ceph-mon[31225]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T09:33:42.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:42 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:33:43.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:43 smithi022 ceph-mon[35583]: pgmap v176: 1 pgs: 1 unknown; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:33:43.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:43 smithi121 ceph-mon[35577]: pgmap v176: 1 pgs: 1 unknown; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:33:43.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:43 smithi001 ceph-mon[31225]: pgmap v176: 1 pgs: 1 unknown; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:33:45.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:45 smithi121 ceph-mon[35577]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:33:45.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:45 smithi022 ceph-mon[35583]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:33:45.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:45 smithi001 ceph-mon[31225]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:33:47.561 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:47 smithi121 ceph-mon[35577]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:33:47.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:47 smithi022 ceph-mon[35583]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:33:47.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:47 smithi001 ceph-mon[31225]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:33:49.458 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:49 smithi121 ceph-mon[35577]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:33:49.458 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:49 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T09:33:49.458 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:49 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:49.458 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:49 smithi121 ceph-mon[35577]: Deploying daemon osd.8 on smithi121 2024-09-19T09:33:49.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:49 smithi022 ceph-mon[35583]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:33:49.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:49 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T09:33:49.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:49 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:49.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:49 smithi022 ceph-mon[35583]: Deploying daemon osd.8 on smithi121 2024-09-19T09:33:49.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:49 smithi001 ceph-mon[31225]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:33:49.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:49 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T09:33:49.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:49 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:49.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:49 smithi001 ceph-mon[31225]: Deploying daemon osd.8 on smithi121 2024-09-19T09:33:51.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:51 smithi121 ceph-mon[35577]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:33:51.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:51 smithi001 ceph-mon[31225]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:33:51.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:51 smithi022 ceph-mon[35583]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:33:53.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:53 smithi022 ceph-mon[35583]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:33:53.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:53 smithi121 ceph-mon[35577]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:33:53.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:53 smithi001 ceph-mon[31225]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:33:55.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:55 smithi022 ceph-mon[35583]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:33:55.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:55 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:55.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:55 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:55.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:55 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:55.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:55 smithi121 ceph-mon[35577]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:33:55.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:55 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:55.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:55 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:55.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:55 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:55.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:55 smithi001 ceph-mon[31225]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:33:55.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:55 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:55.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:55 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:55.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:55 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:57.512 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:57 smithi121 ceph-mon[35577]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:33:57.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:57 smithi022 ceph-mon[35583]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:33:57.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:57 smithi001 ceph-mon[31225]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:33:58.632 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:58.630+0000 7faa1dffb640 1 -- 172.21.15.121:0/3602092465 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7faa20062630 con 0x7faa100a3270 2024-09-19T09:33:58.632 INFO:teuthology.orchestra.run.smithi121.stdout:Created osd(s) 8 on host 'smithi121' 2024-09-19T09:33:58.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:58.632+0000 7faa271be640 1 -- 172.21.15.121:0/3602092465 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7faa100a3270 msgr2=0x7faa100a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:58.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:58.632+0000 7faa271be640 1 --2- 172.21.15.121:0/3602092465 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7faa100a3270 0x7faa100a5730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faa14005fd0 tx=0x7faa1400b390 comp rx=0 tx=0).stop 2024-09-19T09:33:58.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:58.632+0000 7faa271be640 1 -- 172.21.15.121:0/3602092465 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa20101d10 msgr2=0x7faa201983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:33:58.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:58.632+0000 7faa271be640 1 --2- 172.21.15.121:0/3602092465 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa20101d10 0x7faa201983d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00e9f0 tx=0x7faa0c00eeb0 comp rx=0 tx=0).stop 2024-09-19T09:33:58.634 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:58.633+0000 7faa271be640 1 -- 172.21.15.121:0/3602092465 shutdown_connections 2024-09-19T09:33:58.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:58.633+0000 7faa271be640 1 --2- 172.21.15.121:0/3602092465 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa201026d0 0x7faa2006dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:58.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:58.633+0000 7faa271be640 1 --2- 172.21.15.121:0/3602092465 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa20101d10 0x7faa201983d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:58.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:58.633+0000 7faa271be640 1 --2- 172.21.15.121:0/3602092465 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7faa100a3270 0x7faa100a5730 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:58.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:58.633+0000 7faa271be640 1 --2- 172.21.15.121:0/3602092465 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa20100b10 0x7faa20197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:33:58.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:58.633+0000 7faa271be640 1 -- 172.21.15.121:0/3602092465 >> 172.21.15.121:0/3602092465 conn(0x7faa200fc2a0 msgr2=0x7faa20105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:33:58.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:58.633+0000 7faa271be640 1 -- 172.21.15.121:0/3602092465 shutdown_connections 2024-09-19T09:33:58.635 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:33:58.633+0000 7faa271be640 1 -- 172.21.15.121:0/3602092465 wait complete. 2024-09-19T09:33:58.866 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:58 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:58.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:58 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:58.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:58 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:58.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:58 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:58.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:58 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:58.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:58 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:58.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:58 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:58.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:58 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:58.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:58 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:58.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:58 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:58.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:58 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:58.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:58 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:58.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:58 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:58.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:58 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:58.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:58 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:58.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:58 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:59.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:58 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:59.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:58 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:59.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:58 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:33:59.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:58 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:33:59.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:58 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:59.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:58 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:33:59.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:58 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:59.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:58 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:33:59.340 DEBUG:teuthology.orchestra.run.smithi121:osd.8> sudo journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@osd.8.service 2024-09-19T09:33:59.342 INFO:tasks.cephadm:Deploying osd.9 on smithi001 with /dev/vg_nvme/lv_1... 2024-09-19T09:33:59.342 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T09:33:59.609 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:33:59.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:33:59 smithi121 ceph-mon[35577]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:33:59.979 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:33:59 smithi001 ceph-mon[31225]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:34:00.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:33:59 smithi022 ceph-mon[35583]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:34:01.117 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 19 09:34:00 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-8[53541]: 2024-09-19T09:34:00.771+0000 7efc00e5c640 -1 osd.8 0 log_to_monitors true 2024-09-19T09:34:01.849 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:01 smithi001 ceph-mon[31225]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:34:01.849 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:01 smithi001 ceph-mon[31225]: from='osd.8 [v2:172.21.15.121:6816/3589985967,v1:172.21.15.121:6817/3589985967]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T09:34:01.849 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:01 smithi001 ceph-mon[31225]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T09:34:02.070 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:01 smithi121 ceph-mon[35577]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:34:02.070 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:01 smithi121 ceph-mon[35577]: from='osd.8 [v2:172.21.15.121:6816/3589985967,v1:172.21.15.121:6817/3589985967]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T09:34:02.070 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:01 smithi121 ceph-mon[35577]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T09:34:02.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:01 smithi022 ceph-mon[35583]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:34:02.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:01 smithi022 ceph-mon[35583]: from='osd.8 [v2:172.21.15.121:6816/3589985967,v1:172.21.15.121:6817/3589985967]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T09:34:02.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:01 smithi022 ceph-mon[35583]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T09:34:02.463 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:34:02.489 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi001:vg_nvme/lv_1 2024-09-19T09:34:02.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:02 smithi001 ceph-mon[31225]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T09:34:02.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:02 smithi001 ceph-mon[31225]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T09:34:02.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:02 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:34:02.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:02 smithi001 ceph-mon[31225]: from='osd.8 [v2:172.21.15.121:6816/3589985967,v1:172.21.15.121:6817/3589985967]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-19T09:34:02.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:02 smithi001 ceph-mon[31225]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-19T09:34:02.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:02 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:02.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:02 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:02.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:02 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:02.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:02 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:02.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:02 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:02.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:02 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:02.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:02 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:02.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:02 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:02.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:02 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:02.757 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:34:03.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:02 smithi022 ceph-mon[35583]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T09:34:03.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:02 smithi022 ceph-mon[35583]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T09:34:03.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:02 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:34:03.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:02 smithi022 ceph-mon[35583]: from='osd.8 [v2:172.21.15.121:6816/3589985967,v1:172.21.15.121:6817/3589985967]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-19T09:34:03.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:02 smithi022 ceph-mon[35583]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-19T09:34:03.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:02 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:03.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:02 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:03.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:02 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:03.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:02 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:03.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:02 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:03.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:02 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:03.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:02 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:03.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:02 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:03.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:02 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:03.117 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 19 09:34:02 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-8[53541]: 2024-09-19T09:34:02.699+0000 7efbfcddf640 -1 osd.8 0 waiting for initial osdmap 2024-09-19T09:34:03.117 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 19 09:34:02 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-8[53541]: 2024-09-19T09:34:02.708+0000 7efbf8c07640 -1 osd.8 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:34:03.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:02 smithi121 ceph-mon[35577]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T09:34:03.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:02 smithi121 ceph-mon[35577]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T09:34:03.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:02 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:34:03.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:02 smithi121 ceph-mon[35577]: from='osd.8 [v2:172.21.15.121:6816/3589985967,v1:172.21.15.121:6817/3589985967]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-19T09:34:03.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:02 smithi121 ceph-mon[35577]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-19T09:34:03.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:02 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:03.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:02 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:03.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:02 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:03.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:02 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:03.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:02 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:03.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:02 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:03.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:02 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:03.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:02 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:03.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:02 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:03.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.241+0000 7f43f2626640 1 -- 172.21.15.1:0/3194080910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43ec1026a0 msgr2=0x7f43ec104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:03.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.241+0000 7f43f2626640 1 --2- 172.21.15.1:0/3194080910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43ec1026a0 0x7f43ec104a90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f43dc009900 tx=0x7f43dc02a410 comp rx=0 tx=0).stop 2024-09-19T09:34:03.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.241+0000 7f43f2626640 1 -- 172.21.15.1:0/3194080910 shutdown_connections 2024-09-19T09:34:03.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.241+0000 7f43f2626640 1 --2- 172.21.15.1:0/3194080910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43ec107900 0x7f43ec109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:03.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.241+0000 7f43f2626640 1 --2- 172.21.15.1:0/3194080910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ec104fd0 0x7f43ec1073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:03.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.241+0000 7f43f2626640 1 --2- 172.21.15.1:0/3194080910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43ec1026a0 0x7f43ec104a90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:03.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.241+0000 7f43f2626640 1 -- 172.21.15.1:0/3194080910 >> 172.21.15.1:0/3194080910 conn(0x7f43ec0fc2a0 msgr2=0x7f43ec0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:03.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.241+0000 7f43f2626640 1 -- 172.21.15.1:0/3194080910 shutdown_connections 2024-09-19T09:34:03.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.241+0000 7f43f2626640 1 -- 172.21.15.1:0/3194080910 wait complete. 2024-09-19T09:34:03.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.241+0000 7f43f2626640 1 Processor -- start 2024-09-19T09:34:03.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.241+0000 7f43f2626640 1 -- start start 2024-09-19T09:34:03.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.242+0000 7f43f2626640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43ec1026a0 0x7f43ec197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:03.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.242+0000 7f43f2626640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43ec104fd0 0x7f43ec198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:03.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.242+0000 7f43f2626640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ec107900 0x7f43ec19f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:03.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.242+0000 7f43f2626640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f43ec10d970 con 0x7f43ec104fd0 2024-09-19T09:34:03.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.242+0000 7f43f2626640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f43ec10d7f0 con 0x7f43ec1026a0 2024-09-19T09:34:03.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.242+0000 7f43f2626640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f43ec10daf0 con 0x7f43ec107900 2024-09-19T09:34:03.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.242+0000 7f43eb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43ec104fd0 0x7f43ec198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:03.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.242+0000 7f43eb7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43ec104fd0 0x7f43ec198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53054/0 (socket says 172.21.15.1:53054) 2024-09-19T09:34:03.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.242+0000 7f43eb7fe640 1 -- 172.21.15.1:0/59849887 learned_addr learned my addr 172.21.15.1:0/59849887 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:34:03.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.242+0000 7f43ebfff640 1 --2- 172.21.15.1:0/59849887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43ec1026a0 0x7f43ec197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:03.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.242+0000 7f43f0bc3640 1 --2- 172.21.15.1:0/59849887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ec107900 0x7f43ec19f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:03.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.242+0000 7f43eb7fe640 1 -- 172.21.15.1:0/59849887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ec107900 msgr2=0x7f43ec19f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:03.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.242+0000 7f43eb7fe640 1 --2- 172.21.15.1:0/59849887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ec107900 0x7f43ec19f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:03.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.242+0000 7f43eb7fe640 1 -- 172.21.15.1:0/59849887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43ec1026a0 msgr2=0x7f43ec197fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:03.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.242+0000 7f43eb7fe640 1 --2- 172.21.15.1:0/59849887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43ec1026a0 0x7f43ec197fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:03.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.242+0000 7f43eb7fe640 1 -- 172.21.15.1:0/59849887 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43ec19fc00 con 0x7f43ec104fd0 2024-09-19T09:34:03.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.242+0000 7f43eb7fe640 1 --2- 172.21.15.1:0/59849887 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43ec104fd0 0x7f43ec198510 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f43e000b450 tx=0x7f43e000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:03.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.242+0000 7f43e97fa640 1 -- 172.21.15.1:0/59849887 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e0015020 con 0x7f43ec104fd0 2024-09-19T09:34:03.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.243+0000 7f43e97fa640 1 -- 172.21.15.1:0/59849887 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43e0011d70 con 0x7f43ec104fd0 2024-09-19T09:34:03.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.243+0000 7f43e97fa640 1 -- 172.21.15.1:0/59849887 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e000f340 con 0x7f43ec104fd0 2024-09-19T09:34:03.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.243+0000 7f43f2626640 1 -- 172.21.15.1:0/59849887 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43ec19fef0 con 0x7f43ec104fd0 2024-09-19T09:34:03.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.243+0000 7f43f2626640 1 -- 172.21.15.1:0/59849887 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43ec1a0420 con 0x7f43ec104fd0 2024-09-19T09:34:03.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.244+0000 7f43f2626640 1 -- 172.21.15.1:0/59849887 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43ec0fdd90 con 0x7f43ec104fd0 2024-09-19T09:34:03.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.245+0000 7f43e97fa640 1 -- 172.21.15.1:0/59849887 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f43e0018020 con 0x7f43ec104fd0 2024-09-19T09:34:03.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.246+0000 7f43e97fa640 1 --2- 172.21.15.1:0/59849887 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f43d40a3270 0x7f43d40a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:03.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.246+0000 7f43ebfff640 1 --2- 172.21.15.1:0/59849887 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f43d40a3270 0x7f43d40a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:03.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.246+0000 7f43e97fa640 1 -- 172.21.15.1:0/59849887 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5549+0+0 (secure 0 0 0) 0x7f43e00ce880 con 0x7f43ec104fd0 2024-09-19T09:34:03.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.246+0000 7f43ebfff640 1 --2- 172.21.15.1:0/59849887 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f43d40a3270 0x7f43d40a5730 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f43dc031440 tx=0x7f43dc0315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:03.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.250+0000 7f43e97fa640 1 -- 172.21.15.1:0/59849887 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f43e001f020 con 0x7f43ec104fd0 2024-09-19T09:34:03.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:03.437+0000 7f43f2626640 1 -- 172.21.15.1:0/59849887 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f43ec062630 con 0x7f43d40a3270 2024-09-19T09:34:03.972 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:03 smithi001 ceph-mon[31225]: Detected new or changed devices on smithi121 2024-09-19T09:34:03.973 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:03 smithi001 ceph-mon[31225]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:34:03.973 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:03 smithi001 ceph-mon[31225]: Adjusting osd_memory_target on smithi121 to 5695M 2024-09-19T09:34:03.973 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:03 smithi001 ceph-mon[31225]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-19T09:34:03.973 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:03 smithi001 ceph-mon[31225]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T09:34:03.973 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:03 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:34:03.973 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:03 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:34:03.973 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:03 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:34:03.973 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:03 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:34:03.973 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:03 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:04.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:03 smithi022 ceph-mon[35583]: Detected new or changed devices on smithi121 2024-09-19T09:34:04.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:03 smithi022 ceph-mon[35583]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:34:04.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:03 smithi022 ceph-mon[35583]: Adjusting osd_memory_target on smithi121 to 5695M 2024-09-19T09:34:04.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:03 smithi022 ceph-mon[35583]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-19T09:34:04.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:03 smithi022 ceph-mon[35583]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T09:34:04.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:03 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:34:04.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:03 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:34:04.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:03 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:34:04.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:03 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:34:04.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:03 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:04.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:03 smithi121 ceph-mon[35577]: Detected new or changed devices on smithi121 2024-09-19T09:34:04.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:03 smithi121 ceph-mon[35577]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:34:04.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:03 smithi121 ceph-mon[35577]: Adjusting osd_memory_target on smithi121 to 5695M 2024-09-19T09:34:04.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:03 smithi121 ceph-mon[35577]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-19T09:34:04.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:03 smithi121 ceph-mon[35577]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T09:34:04.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:03 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:34:04.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:03 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:34:04.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:03 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:34:04.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:03 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:34:04.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:03 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:04.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:04 smithi001 ceph-mon[31225]: purged_snaps scrub starts 2024-09-19T09:34:04.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:04 smithi001 ceph-mon[31225]: purged_snaps scrub ok 2024-09-19T09:34:04.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:04 smithi001 ceph-mon[31225]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:34:04.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:04 smithi001 ceph-mon[31225]: osd.8 [v2:172.21.15.121:6816/3589985967,v1:172.21.15.121:6817/3589985967] boot 2024-09-19T09:34:04.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:04 smithi001 ceph-mon[31225]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T09:34:04.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:04 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:34:04.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:04 smithi001 ceph-mon[31225]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T09:34:05.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:04 smithi022 ceph-mon[35583]: purged_snaps scrub starts 2024-09-19T09:34:05.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:04 smithi022 ceph-mon[35583]: purged_snaps scrub ok 2024-09-19T09:34:05.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:04 smithi022 ceph-mon[35583]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:34:05.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:04 smithi022 ceph-mon[35583]: osd.8 [v2:172.21.15.121:6816/3589985967,v1:172.21.15.121:6817/3589985967] boot 2024-09-19T09:34:05.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:04 smithi022 ceph-mon[35583]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T09:34:05.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:04 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:34:05.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:04 smithi022 ceph-mon[35583]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T09:34:05.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:04 smithi121 ceph-mon[35577]: purged_snaps scrub starts 2024-09-19T09:34:05.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:04 smithi121 ceph-mon[35577]: purged_snaps scrub ok 2024-09-19T09:34:05.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:04 smithi121 ceph-mon[35577]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi001:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:34:05.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:04 smithi121 ceph-mon[35577]: osd.8 [v2:172.21.15.121:6816/3589985967,v1:172.21.15.121:6817/3589985967] boot 2024-09-19T09:34:05.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:04 smithi121 ceph-mon[35577]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T09:34:05.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:04 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T09:34:05.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:04 smithi121 ceph-mon[35577]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T09:34:05.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:05 smithi001 ceph-mon[31225]: pgmap v190: 1 pgs: 1 remapped+peering; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:34:05.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:05 smithi001 ceph-mon[31225]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T09:34:06.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:05 smithi022 ceph-mon[35583]: pgmap v190: 1 pgs: 1 remapped+peering; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:34:06.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:05 smithi022 ceph-mon[35583]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T09:34:06.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:05 smithi121 ceph-mon[35577]: pgmap v190: 1 pgs: 1 remapped+peering; 577 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2024-09-19T09:34:06.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:05 smithi121 ceph-mon[35577]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T09:34:06.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:06 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/3736022732' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8af80ac9-d681-4966-b083-ead5185eff12"}]: dispatch 2024-09-19T09:34:06.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:06 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/3736022732' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8af80ac9-d681-4966-b083-ead5185eff12"}]': finished 2024-09-19T09:34:06.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:06 smithi001 ceph-mon[31225]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T09:34:06.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:06 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:34:06.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:06 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/2800867947' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:34:07.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:06 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/3736022732' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8af80ac9-d681-4966-b083-ead5185eff12"}]: dispatch 2024-09-19T09:34:07.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:06 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/3736022732' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8af80ac9-d681-4966-b083-ead5185eff12"}]': finished 2024-09-19T09:34:07.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:06 smithi022 ceph-mon[35583]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T09:34:07.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:06 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:34:07.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:06 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/2800867947' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:34:07.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:06 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/3736022732' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8af80ac9-d681-4966-b083-ead5185eff12"}]: dispatch 2024-09-19T09:34:07.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:06 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/3736022732' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8af80ac9-d681-4966-b083-ead5185eff12"}]': finished 2024-09-19T09:34:07.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:06 smithi121 ceph-mon[35577]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T09:34:07.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:06 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:34:07.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:06 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/2800867947' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:34:08.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:08 smithi022 ceph-mon[35583]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 287 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:34:08.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:08 smithi022 ceph-mon[35583]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T09:34:08.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:08 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:34:08.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:08 smithi121 ceph-mon[35577]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 287 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:34:08.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:08 smithi121 ceph-mon[35577]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T09:34:08.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:08 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:34:08.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:08 smithi001 ceph-mon[31225]: pgmap v194: 1 pgs: 1 remapped+peering; 577 KiB data, 287 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:34:08.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:08 smithi001 ceph-mon[31225]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T09:34:08.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:08 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:34:10.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:10 smithi022 ceph-mon[35583]: pgmap v196: 1 pgs: 1 remapped+peering; 577 KiB data, 287 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:34:10.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:10 smithi121 ceph-mon[35577]: pgmap v196: 1 pgs: 1 remapped+peering; 577 KiB data, 287 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:34:10.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:10 smithi001 ceph-mon[31225]: pgmap v196: 1 pgs: 1 remapped+peering; 577 KiB data, 287 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:34:12.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:12 smithi001 ceph-mon[31225]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-19T09:34:12.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:12 smithi022 ceph-mon[35583]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-19T09:34:12.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:12 smithi121 ceph-mon[35577]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-19T09:34:14.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:14 smithi022 ceph-mon[35583]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-19T09:34:14.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:14 smithi121 ceph-mon[35577]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-19T09:34:14.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:14 smithi001 ceph-mon[31225]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-19T09:34:15.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:15 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T09:34:15.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:15 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:15.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:15 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T09:34:15.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:15 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:15.379 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:15 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T09:34:15.379 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:15 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:16.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:16 smithi001 ceph-mon[31225]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T09:34:16.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:16 smithi001 ceph-mon[31225]: Deploying daemon osd.9 on smithi001 2024-09-19T09:34:16.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:16 smithi022 ceph-mon[35583]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T09:34:16.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:16 smithi022 ceph-mon[35583]: Deploying daemon osd.9 on smithi001 2024-09-19T09:34:16.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:16 smithi121 ceph-mon[35577]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T09:34:16.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:16 smithi121 ceph-mon[35577]: Deploying daemon osd.9 on smithi001 2024-09-19T09:34:18.289 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:18 smithi001 ceph-mon[31225]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T09:34:18.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:18 smithi022 ceph-mon[35583]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T09:34:18.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:18 smithi121 ceph-mon[35577]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T09:34:20.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:20 smithi022 ceph-mon[35583]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T09:34:20.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:20 smithi121 ceph-mon[35577]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T09:34:20.438 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:20 smithi001 ceph-mon[31225]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T09:34:22.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:22 smithi022 ceph-mon[35583]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T09:34:22.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:22 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:22.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:22 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:22.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:22 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:22.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:22 smithi121 ceph-mon[35577]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T09:34:22.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:22 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:22.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:22 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:22.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:22 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:22.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:22 smithi001 ceph-mon[31225]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T09:34:22.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:22 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:22.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:22 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:22.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:22 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:24.146 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:24 smithi001 ceph-mon[31225]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:34:24.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:24 smithi022 ceph-mon[35583]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:34:24.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:24 smithi121 ceph-mon[35577]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:34:24.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:24.963+0000 7f43e97fa640 1 -- 172.21.15.1:0/59849887 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f43ec062630 con 0x7f43d40a3270 2024-09-19T09:34:24.965 INFO:teuthology.orchestra.run.smithi001.stdout:Created osd(s) 9 on host 'smithi001' 2024-09-19T09:34:24.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:24.966+0000 7f43f2626640 1 -- 172.21.15.1:0/59849887 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f43d40a3270 msgr2=0x7f43d40a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:24.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:24.966+0000 7f43f2626640 1 --2- 172.21.15.1:0/59849887 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f43d40a3270 0x7f43d40a5730 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f43dc031440 tx=0x7f43dc0315b0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:24.966+0000 7f43f2626640 1 -- 172.21.15.1:0/59849887 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43ec104fd0 msgr2=0x7f43ec198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:24.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:24.966+0000 7f43f2626640 1 --2- 172.21.15.1:0/59849887 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43ec104fd0 0x7f43ec198510 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f43e000b450 tx=0x7f43e000b910 comp rx=0 tx=0).stop 2024-09-19T09:34:24.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:24.966+0000 7f43f2626640 1 -- 172.21.15.1:0/59849887 shutdown_connections 2024-09-19T09:34:24.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:24.966+0000 7f43f2626640 1 --2- 172.21.15.1:0/59849887 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ec107900 0x7f43ec19f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:24.966+0000 7f43f2626640 1 --2- 172.21.15.1:0/59849887 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43ec104fd0 0x7f43ec198510 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:24.966+0000 7f43f2626640 1 --2- 172.21.15.1:0/59849887 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f43d40a3270 0x7f43d40a5730 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:24.966+0000 7f43f2626640 1 --2- 172.21.15.1:0/59849887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43ec1026a0 0x7f43ec197fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:24.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:24.966+0000 7f43f2626640 1 -- 172.21.15.1:0/59849887 >> 172.21.15.1:0/59849887 conn(0x7f43ec0fc2a0 msgr2=0x7f43ec103020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:24.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:24.966+0000 7f43f2626640 1 -- 172.21.15.1:0/59849887 shutdown_connections 2024-09-19T09:34:24.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:34:24.966+0000 7f43f2626640 1 -- 172.21.15.1:0/59849887 wait complete. 2024-09-19T09:34:25.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:25 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:25.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:25 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:25.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:25 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:25.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:25 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:25.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:25 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:25.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:25 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:25.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:25 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:25.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:25 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:25.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:25 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:25.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:25 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:25.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:25 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:25.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:25 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:25.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:25 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:25.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:25 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:25.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:25 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:25.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:25 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:25.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:25 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:25.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:25 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:25.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:25 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:25.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:25 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:25.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:25 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:25.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:25 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:25.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:25 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:25.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:25 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:25.780 DEBUG:teuthology.orchestra.run.smithi001:osd.9> sudo journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@osd.9.service 2024-09-19T09:34:25.783 INFO:tasks.cephadm:Deploying osd.10 on smithi022 with /dev/vg_nvme/lv_1... 2024-09-19T09:34:25.783 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T09:34:26.046 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:34:26.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:26 smithi022 ceph-mon[35583]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:34:26.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:26 smithi121 ceph-mon[35577]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:34:26.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:26 smithi001 ceph-mon[31225]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:34:26.985 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:34:26 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-9[62219]: 2024-09-19T09:34:26.878+0000 7f37f4e59640 -1 osd.9 0 log_to_monitors true 2024-09-19T09:34:27.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:27 smithi001 ceph-mon[31225]: from='osd.9 [v2:172.21.15.1:6826/1143859822,v1:172.21.15.1:6827/1143859822]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T09:34:27.349 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:27 smithi022 ceph-mon[35583]: from='osd.9 [v2:172.21.15.1:6826/1143859822,v1:172.21.15.1:6827/1143859822]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T09:34:27.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:27 smithi121 ceph-mon[35577]: from='osd.9 [v2:172.21.15.1:6826/1143859822,v1:172.21.15.1:6827/1143859822]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T09:34:28.257 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:28 smithi022 ceph-mon[35583]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:34:28.257 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:28 smithi022 ceph-mon[35583]: from='osd.9 [v2:172.21.15.1:6826/1143859822,v1:172.21.15.1:6827/1143859822]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T09:34:28.257 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:28 smithi022 ceph-mon[35583]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T09:34:28.257 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:28 smithi022 ceph-mon[35583]: from='osd.9 [v2:172.21.15.1:6826/1143859822,v1:172.21.15.1:6827/1143859822]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T09:34:28.257 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:28 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:34:28.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:28 smithi121 ceph-mon[35577]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:34:28.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:28 smithi121 ceph-mon[35577]: from='osd.9 [v2:172.21.15.1:6826/1143859822,v1:172.21.15.1:6827/1143859822]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T09:34:28.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:28 smithi121 ceph-mon[35577]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T09:34:28.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:28 smithi121 ceph-mon[35577]: from='osd.9 [v2:172.21.15.1:6826/1143859822,v1:172.21.15.1:6827/1143859822]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T09:34:28.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:28 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:34:28.410 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:28 smithi001 ceph-mon[31225]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:34:28.410 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:28 smithi001 ceph-mon[31225]: from='osd.9 [v2:172.21.15.1:6826/1143859822,v1:172.21.15.1:6827/1143859822]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T09:34:28.410 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:28 smithi001 ceph-mon[31225]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T09:34:28.410 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:28 smithi001 ceph-mon[31225]: from='osd.9 [v2:172.21.15.1:6826/1143859822,v1:172.21.15.1:6827/1143859822]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]: dispatch 2024-09-19T09:34:28.410 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:28 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:34:28.578 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-19T09:34:28.608 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi022:vg_nvme/lv_1 2024-09-19T09:34:28.747 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:34:28 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-9[62219]: 2024-09-19T09:34:28.513+0000 7f37f0ddc640 -1 osd.9 0 waiting for initial osdmap 2024-09-19T09:34:28.747 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:34:28 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-9[62219]: 2024-09-19T09:34:28.527+0000 7f37e8bfc640 -1 osd.9 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:34:28.878 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:34:29.167 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:29 smithi022 ceph-mon[35583]: from='osd.9 [v2:172.21.15.1:6826/1143859822,v1:172.21.15.1:6827/1143859822]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T09:34:29.167 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:29 smithi022 ceph-mon[35583]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T09:34:29.167 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:29 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:34:29.168 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:29 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:34:29.168 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:29 smithi022 ceph-mon[35583]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:34:29.168 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:29 smithi022 ceph-mon[35583]: from='osd.9 [v2:172.21.15.1:6826/1143859822,v1:172.21.15.1:6827/1143859822]' entity='osd.9' 2024-09-19T09:34:29.168 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:29 smithi022 ceph-mon[35583]: Detected new or changed devices on smithi001 2024-09-19T09:34:29.168 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:29 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:29.168 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:29 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:29.168 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:29 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:29.168 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:29 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:29.168 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:29 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:29.168 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:29 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:29.168 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:29 smithi022 ceph-mon[35583]: Adjusting osd_memory_target on smithi001 to 4273M 2024-09-19T09:34:29.168 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:29 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:29.168 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:29 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:29.168 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:29 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:29.169 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:29 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:29.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.364+0000 7f54ef7a5640 1 -- 172.21.15.22:0/3404162844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54e81026c0 msgr2=0x7f54e8108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:29.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.364+0000 7f54ef7a5640 1 --2- 172.21.15.22:0/3404162844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54e81026c0 0x7f54e8108f50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f54e4009900 tx=0x7f54e402a410 comp rx=0 tx=0).stop 2024-09-19T09:34:29.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.364+0000 7f54ef7a5640 1 -- 172.21.15.22:0/3404162844 shutdown_connections 2024-09-19T09:34:29.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.364+0000 7f54ef7a5640 1 --2- 172.21.15.22:0/3404162844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54e81026c0 0x7f54e8108f50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.364+0000 7f54ef7a5640 1 --2- 172.21.15.22:0/3404162844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54e8101d00 0x7f54e8102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.364+0000 7f54ef7a5640 1 --2- 172.21.15.22:0/3404162844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54e8100b00 0x7f54e8100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.364+0000 7f54ef7a5640 1 -- 172.21.15.22:0/3404162844 >> 172.21.15.22:0/3404162844 conn(0x7f54e80fc290 msgr2=0x7f54e80fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:29.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.364+0000 7f54ef7a5640 1 -- 172.21.15.22:0/3404162844 shutdown_connections 2024-09-19T09:34:29.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.364+0000 7f54ef7a5640 1 -- 172.21.15.22:0/3404162844 wait complete. 2024-09-19T09:34:29.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.365+0000 7f54ef7a5640 1 Processor -- start 2024-09-19T09:34:29.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.365+0000 7f54ef7a5640 1 -- start start 2024-09-19T09:34:29.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.365+0000 7f54ef7a5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54e8100b00 0x7f54e8104a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:29.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.365+0000 7f54ef7a5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54e8101d00 0x7f54e81030e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:29.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.365+0000 7f54ef7a5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54e81026c0 0x7f54e8103620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:29.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.365+0000 7f54ef7a5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f54e810c800 con 0x7f54e8101d00 2024-09-19T09:34:29.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.365+0000 7f54ef7a5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f54e810c680 con 0x7f54e81026c0 2024-09-19T09:34:29.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.365+0000 7f54ef7a5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f54e810c980 con 0x7f54e8100b00 2024-09-19T09:34:29.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.365+0000 7f54edd42640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54e81026c0 0x7f54e8103620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:29.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.365+0000 7f54ecd40640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54e8101d00 0x7f54e81030e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:29.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.365+0000 7f54edd42640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54e81026c0 0x7f54e8103620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46614/0 (socket says 172.21.15.22:46614) 2024-09-19T09:34:29.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.365+0000 7f54edd42640 1 -- 172.21.15.22:0/501055373 learned_addr learned my addr 172.21.15.22:0/501055373 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-19T09:34:29.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.366+0000 7f54ed541640 1 --2- 172.21.15.22:0/501055373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54e8100b00 0x7f54e8104a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:29.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.366+0000 7f54edd42640 1 -- 172.21.15.22:0/501055373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54e8100b00 msgr2=0x7f54e8104a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:29.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.366+0000 7f54edd42640 1 --2- 172.21.15.22:0/501055373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54e8100b00 0x7f54e8104a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.366+0000 7f54edd42640 1 -- 172.21.15.22:0/501055373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54e8101d00 msgr2=0x7f54e81030e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:29.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.366+0000 7f54edd42640 1 --2- 172.21.15.22:0/501055373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54e8101d00 0x7f54e81030e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:29.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.366+0000 7f54edd42640 1 -- 172.21.15.22:0/501055373 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54e8103ee0 con 0x7f54e81026c0 2024-09-19T09:34:29.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.366+0000 7f54edd42640 1 --2- 172.21.15.22:0/501055373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54e81026c0 0x7f54e8103620 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f54e4031610 tx=0x7f54e40042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:29.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.366+0000 7f54de7fc640 1 -- 172.21.15.22:0/501055373 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e403f030 con 0x7f54e81026c0 2024-09-19T09:34:29.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.366+0000 7f54ef7a5640 1 -- 172.21.15.22:0/501055373 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54e81a20e0 con 0x7f54e81026c0 2024-09-19T09:34:29.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.366+0000 7f54ef7a5640 1 -- 172.21.15.22:0/501055373 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54e81a2660 con 0x7f54e81026c0 2024-09-19T09:34:29.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.366+0000 7f54de7fc640 1 -- 172.21.15.22:0/501055373 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54e4003ce0 con 0x7f54e81026c0 2024-09-19T09:34:29.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.366+0000 7f54de7fc640 1 -- 172.21.15.22:0/501055373 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e4035070 con 0x7f54e81026c0 2024-09-19T09:34:29.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.367+0000 7f54ef7a5640 1 -- 172.21.15.22:0/501055373 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54cc0052c0 con 0x7f54e81026c0 2024-09-19T09:34:29.371 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:29 smithi121 ceph-mon[35577]: from='osd.9 [v2:172.21.15.1:6826/1143859822,v1:172.21.15.1:6827/1143859822]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T09:34:29.371 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:29 smithi121 ceph-mon[35577]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T09:34:29.371 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:29 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:34:29.371 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:29 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:34:29.371 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:29 smithi121 ceph-mon[35577]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:34:29.371 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:29 smithi121 ceph-mon[35577]: from='osd.9 [v2:172.21.15.1:6826/1143859822,v1:172.21.15.1:6827/1143859822]' entity='osd.9' 2024-09-19T09:34:29.371 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:29 smithi121 ceph-mon[35577]: Detected new or changed devices on smithi001 2024-09-19T09:34:29.371 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:29 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:29.371 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:29 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:29.372 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:29 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:29.372 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:29 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:29.372 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:29 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:29.372 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:29 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:29.372 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:29 smithi121 ceph-mon[35577]: Adjusting osd_memory_target on smithi001 to 4273M 2024-09-19T09:34:29.372 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:29 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:29.372 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:29 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:29.372 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:29 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:29.372 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:29 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:29.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.369+0000 7f54de7fc640 1 -- 172.21.15.22:0/501055373 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f54e4042030 con 0x7f54e81026c0 2024-09-19T09:34:29.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.369+0000 7f54de7fc640 1 --2- 172.21.15.22:0/501055373 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f54d40a32c0 0x7f54d40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:29.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.370+0000 7f54de7fc640 1 -- 172.21.15.22:0/501055373 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5981+0+0 (secure 0 0 0) 0x7f54e40ef510 con 0x7f54e81026c0 2024-09-19T09:34:29.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.370+0000 7f54ed541640 1 --2- 172.21.15.22:0/501055373 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f54d40a32c0 0x7f54d40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:29.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.370+0000 7f54ed541640 1 --2- 172.21.15.22:0/501055373 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f54d40a32c0 0x7f54d40a5780 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f54e8101b60 tx=0x7f54e000d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:29.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.372+0000 7f54de7fc640 1 -- 172.21.15.22:0/501055373 <== mon.2 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f54e40bc500 con 0x7f54e81026c0 2024-09-19T09:34:29.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:29 smithi001 ceph-mon[31225]: from='osd.9 [v2:172.21.15.1:6826/1143859822,v1:172.21.15.1:6827/1143859822]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi001", "root=default"]}]': finished 2024-09-19T09:34:29.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:29 smithi001 ceph-mon[31225]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T09:34:29.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:29 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:34:29.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:29 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:34:29.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:29 smithi001 ceph-mon[31225]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail 2024-09-19T09:34:29.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:29 smithi001 ceph-mon[31225]: from='osd.9 [v2:172.21.15.1:6826/1143859822,v1:172.21.15.1:6827/1143859822]' entity='osd.9' 2024-09-19T09:34:29.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:29 smithi001 ceph-mon[31225]: Detected new or changed devices on smithi001 2024-09-19T09:34:29.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:29 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:29.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:29 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:29.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:29 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:29.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:29 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:29.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:29 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:29.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:29 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:29.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:29 smithi001 ceph-mon[31225]: Adjusting osd_memory_target on smithi001 to 4273M 2024-09-19T09:34:29.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:29 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:29.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:29 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:29.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:29 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:29.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:29 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:29.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:29.559+0000 7f54ef7a5640 1 -- 172.21.15.22:0/501055373 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f54cc000bf0 con 0x7f54d40a32c0 2024-09-19T09:34:30.257 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:30 smithi022 ceph-mon[35583]: purged_snaps scrub starts 2024-09-19T09:34:30.257 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:30 smithi022 ceph-mon[35583]: purged_snaps scrub ok 2024-09-19T09:34:30.257 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:30 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:34:30.258 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:30 smithi022 ceph-mon[35583]: osd.9 [v2:172.21.15.1:6826/1143859822,v1:172.21.15.1:6827/1143859822] boot 2024-09-19T09:34:30.258 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:30 smithi022 ceph-mon[35583]: osdmap e62: 10 total, 10 up, 10 in 2024-09-19T09:34:30.258 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:30 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:34:30.258 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:30 smithi022 ceph-mon[35583]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:34:30.258 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:30 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:34:30.258 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:30 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:34:30.258 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:30 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:30.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:30 smithi121 ceph-mon[35577]: purged_snaps scrub starts 2024-09-19T09:34:30.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:30 smithi121 ceph-mon[35577]: purged_snaps scrub ok 2024-09-19T09:34:30.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:30 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:34:30.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:30 smithi121 ceph-mon[35577]: osd.9 [v2:172.21.15.1:6826/1143859822,v1:172.21.15.1:6827/1143859822] boot 2024-09-19T09:34:30.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:30 smithi121 ceph-mon[35577]: osdmap e62: 10 total, 10 up, 10 in 2024-09-19T09:34:30.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:30 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:34:30.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:30 smithi121 ceph-mon[35577]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:34:30.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:30 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:34:30.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:30 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:34:30.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:30 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:30.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:30 smithi001 ceph-mon[31225]: purged_snaps scrub starts 2024-09-19T09:34:30.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:30 smithi001 ceph-mon[31225]: purged_snaps scrub ok 2024-09-19T09:34:30.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:30 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:34:30.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:30 smithi001 ceph-mon[31225]: osd.9 [v2:172.21.15.1:6826/1143859822,v1:172.21.15.1:6827/1143859822] boot 2024-09-19T09:34:30.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:30 smithi001 ceph-mon[31225]: osdmap e62: 10 total, 10 up, 10 in 2024-09-19T09:34:30.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:30 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T09:34:30.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:30 smithi001 ceph-mon[31225]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:34:30.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:30 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:34:30.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:30 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:34:30.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:30 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:31.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:31 smithi022 ceph-mon[35583]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:31.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:31 smithi022 ceph-mon[35583]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T09:34:31.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:31 smithi121 ceph-mon[35577]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:31.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:31 smithi121 ceph-mon[35577]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T09:34:31.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:31 smithi001 ceph-mon[31225]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:31.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:31 smithi001 ceph-mon[31225]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T09:34:32.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:32 smithi022 ceph-mon[35583]: from='client.? 172.21.15.22:0/2978791151' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "34edd06a-7f60-4465-bfe1-0c646abd53f3"}]: dispatch 2024-09-19T09:34:32.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:32 smithi022 ceph-mon[35583]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "34edd06a-7f60-4465-bfe1-0c646abd53f3"}]: dispatch 2024-09-19T09:34:32.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:32 smithi022 ceph-mon[35583]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "34edd06a-7f60-4465-bfe1-0c646abd53f3"}]': finished 2024-09-19T09:34:32.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:32 smithi022 ceph-mon[35583]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T09:34:32.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:32 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:34:32.866 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:32 smithi121 ceph-mon[35577]: from='client.? 172.21.15.22:0/2978791151' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "34edd06a-7f60-4465-bfe1-0c646abd53f3"}]: dispatch 2024-09-19T09:34:32.866 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:32 smithi121 ceph-mon[35577]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "34edd06a-7f60-4465-bfe1-0c646abd53f3"}]: dispatch 2024-09-19T09:34:32.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:32 smithi121 ceph-mon[35577]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "34edd06a-7f60-4465-bfe1-0c646abd53f3"}]': finished 2024-09-19T09:34:32.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:32 smithi121 ceph-mon[35577]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T09:34:32.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:32 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:34:32.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:32 smithi001 ceph-mon[31225]: from='client.? 172.21.15.22:0/2978791151' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "34edd06a-7f60-4465-bfe1-0c646abd53f3"}]: dispatch 2024-09-19T09:34:32.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:32 smithi001 ceph-mon[31225]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "34edd06a-7f60-4465-bfe1-0c646abd53f3"}]: dispatch 2024-09-19T09:34:32.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:32 smithi001 ceph-mon[31225]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "34edd06a-7f60-4465-bfe1-0c646abd53f3"}]': finished 2024-09-19T09:34:32.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:32 smithi001 ceph-mon[31225]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T09:34:32.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:32 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:34:33.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:33 smithi022 ceph-mon[35583]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:33.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:33 smithi022 ceph-mon[35583]: from='client.? 172.21.15.22:0/2941844901' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:34:33.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:33 smithi121 ceph-mon[35577]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:33.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:33 smithi121 ceph-mon[35577]: from='client.? 172.21.15.22:0/2941844901' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:34:33.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:33 smithi001 ceph-mon[31225]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:33.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:33 smithi001 ceph-mon[31225]: from='client.? 172.21.15.22:0/2941844901' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:34:35.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:35 smithi022 ceph-mon[35583]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:35.866 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:35 smithi121 ceph-mon[35577]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:35.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:35 smithi001 ceph-mon[31225]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:37.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:37 smithi022 ceph-mon[35583]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:37.866 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:37 smithi121 ceph-mon[35577]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:37.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:37 smithi001 ceph-mon[31225]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:39.740 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:39 smithi022 ceph-mon[35583]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:39.866 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:39 smithi121 ceph-mon[35577]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:39.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:39 smithi001 ceph-mon[31225]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:40.842 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:40 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T09:34:40.842 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:40 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:40.866 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:40 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T09:34:40.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:40 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:40.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:40 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T09:34:40.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:40 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:41.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:41 smithi022 ceph-mon[35583]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:41.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:41 smithi022 ceph-mon[35583]: Deploying daemon osd.10 on smithi022 2024-09-19T09:34:41.866 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:41 smithi121 ceph-mon[35577]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:41.866 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:41 smithi121 ceph-mon[35577]: Deploying daemon osd.10 on smithi022 2024-09-19T09:34:41.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:41 smithi001 ceph-mon[31225]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:41.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:41 smithi001 ceph-mon[31225]: Deploying daemon osd.10 on smithi022 2024-09-19T09:34:43.849 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:43 smithi022 ceph-mon[35583]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:43.866 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:43 smithi121 ceph-mon[35577]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:43.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:43 smithi001 ceph-mon[31225]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:45.698 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:45 smithi022 ceph-mon[35583]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:45.866 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:45 smithi121 ceph-mon[35577]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:45.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:45 smithi001 ceph-mon[31225]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:46.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:46 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:46.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:46 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:46.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:46 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:46.866 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:46 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:46.866 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:46 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:46.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:46 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:46.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:46 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:46.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:46 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:46.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:46 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:47.860 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:47 smithi022 ceph-mon[35583]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:47.866 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:47 smithi121 ceph-mon[35577]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:47.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:47 smithi001 ceph-mon[31225]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:49.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:49.914+0000 7f54de7fc640 1 -- 172.21.15.22:0/501055373 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f54cc000bf0 con 0x7f54d40a32c0 2024-09-19T09:34:49.916 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 10 on host 'smithi022' 2024-09-19T09:34:49.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:49.916+0000 7f54ef7a5640 1 -- 172.21.15.22:0/501055373 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f54d40a32c0 msgr2=0x7f54d40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:49.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:49.916+0000 7f54ef7a5640 1 --2- 172.21.15.22:0/501055373 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f54d40a32c0 0x7f54d40a5780 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f54e8101b60 tx=0x7f54e000d040 comp rx=0 tx=0).stop 2024-09-19T09:34:49.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:49.916+0000 7f54ef7a5640 1 -- 172.21.15.22:0/501055373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54e81026c0 msgr2=0x7f54e8103620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:49.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:49.916+0000 7f54ef7a5640 1 --2- 172.21.15.22:0/501055373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54e81026c0 0x7f54e8103620 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f54e4031610 tx=0x7f54e40042f0 comp rx=0 tx=0).stop 2024-09-19T09:34:49.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:49.916+0000 7f54ef7a5640 1 -- 172.21.15.22:0/501055373 shutdown_connections 2024-09-19T09:34:49.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:49.916+0000 7f54ef7a5640 1 --2- 172.21.15.22:0/501055373 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f54d40a32c0 0x7f54d40a5780 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:49.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:49.916+0000 7f54ef7a5640 1 --2- 172.21.15.22:0/501055373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54e81026c0 0x7f54e8103620 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:49.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:49.916+0000 7f54ef7a5640 1 --2- 172.21.15.22:0/501055373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54e8101d00 0x7f54e81030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:49.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:49.916+0000 7f54ef7a5640 1 --2- 172.21.15.22:0/501055373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f54e8100b00 0x7f54e8104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:49.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:49.916+0000 7f54ef7a5640 1 -- 172.21.15.22:0/501055373 >> 172.21.15.22:0/501055373 conn(0x7f54e80fc290 msgr2=0x7f54e806a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:49.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:49.916+0000 7f54ef7a5640 1 -- 172.21.15.22:0/501055373 shutdown_connections 2024-09-19T09:34:49.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-19T09:34:49.916+0000 7f54ef7a5640 1 -- 172.21.15.22:0/501055373 wait complete. 2024-09-19T09:34:50.285 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:50 smithi022 ceph-mon[35583]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:50.285 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:50 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:50.285 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:50 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:50.285 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:50 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:50.285 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:50 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:50.285 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:50 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:50.285 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:50 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:50.285 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:50 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:50.285 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:50 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:50.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:50 smithi121 ceph-mon[35577]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:50.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:50 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:50.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:50 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:50.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:50 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:50.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:50 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:50.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:50 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:50.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:50 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:50.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:50 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:50.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:50 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:50.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:50 smithi001 ceph-mon[31225]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:50.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:50 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:50.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:50 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:50.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:50 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:50.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:50 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:50.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:50 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:50.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:50 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:34:50.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:50 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:50.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:50 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:50.629 DEBUG:teuthology.orchestra.run.smithi022:osd.10> sudo journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@osd.10.service 2024-09-19T09:34:50.631 INFO:tasks.cephadm:Deploying osd.11 on smithi121 with /dev/vg_nvme/lv_1... 2024-09-19T09:34:50.631 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T09:34:50.883 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:34:52.328 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:52 smithi022 ceph-mon[35583]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:52.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:52 smithi121 ceph-mon[35577]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:52.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:52 smithi001 ceph-mon[31225]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:52.614 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:34:52 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:34:52.325+0000 7fb84388f640 -1 osd.10 0 log_to_monitors true 2024-09-19T09:34:53.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:53 smithi022 ceph-mon[35583]: from='osd.10 [v2:172.21.15.22:6824/343155547,v1:172.21.15.22:6825/343155547]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:34:53.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:53 smithi022 ceph-mon[35583]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:34:53.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:53 smithi121 ceph-mon[35577]: from='osd.10 [v2:172.21.15.22:6824/343155547,v1:172.21.15.22:6825/343155547]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:34:53.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:53 smithi121 ceph-mon[35577]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:34:53.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:53 smithi001 ceph-mon[31225]: from='osd.10 [v2:172.21.15.22:6824/343155547,v1:172.21.15.22:6825/343155547]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:34:53.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:53 smithi001 ceph-mon[31225]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T09:34:53.583 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-19T09:34:53.613 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi121:vg_nvme/lv_1 2024-09-19T09:34:53.864 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:34:54.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:54 smithi022 ceph-mon[35583]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:54.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:54 smithi022 ceph-mon[35583]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T09:34:54.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:54 smithi022 ceph-mon[35583]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T09:34:54.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:54 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:34:54.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:54 smithi022 ceph-mon[35583]: from='osd.10 [v2:172.21.15.22:6824/343155547,v1:172.21.15.22:6825/343155547]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T09:34:54.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:54 smithi022 ceph-mon[35583]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T09:34:54.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:54 smithi022 ceph-mon[35583]: Detected new or changed devices on smithi022 2024-09-19T09:34:54.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:54 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:54.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:54 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:54.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:54 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:54.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:54 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:54.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:54 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:54.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:54 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:54.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:54 smithi022 ceph-mon[35583]: Adjusting osd_memory_target on smithi022 to 4273M 2024-09-19T09:34:54.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:54 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:54.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:54 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:54.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:54 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:54.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:54 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:54.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:54 smithi121 ceph-mon[35577]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:54.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:54 smithi121 ceph-mon[35577]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T09:34:54.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:54 smithi121 ceph-mon[35577]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T09:34:54.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:54 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:34:54.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:54 smithi121 ceph-mon[35577]: from='osd.10 [v2:172.21.15.22:6824/343155547,v1:172.21.15.22:6825/343155547]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T09:34:54.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:54 smithi121 ceph-mon[35577]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T09:34:54.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:54 smithi121 ceph-mon[35577]: Detected new or changed devices on smithi022 2024-09-19T09:34:54.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:54 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:54.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:54 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:54.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:54 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:54.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:54 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:54.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:54 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:54.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:54 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:54.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:54 smithi121 ceph-mon[35577]: Adjusting osd_memory_target on smithi022 to 4273M 2024-09-19T09:34:54.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:54 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:54.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:54 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:54.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:54 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:54.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:54 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:54.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.385+0000 7f3fcfcc5640 1 -- 172.21.15.121:0/133647247 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fc8101c00 msgr2=0x7f3fc8102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:54.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.385+0000 7f3fcfcc5640 1 --2- 172.21.15.121:0/133647247 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fc8101c00 0x7f3fc8102000 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4009900 tx=0x7f3fc402a410 comp rx=0 tx=0).stop 2024-09-19T09:34:54.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.385+0000 7f3fcfcc5640 1 -- 172.21.15.121:0/133647247 shutdown_connections 2024-09-19T09:34:54.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.385+0000 7f3fcfcc5640 1 --2- 172.21.15.121:0/133647247 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fc81037c0 0x7f3fc810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:54.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.385+0000 7f3fcfcc5640 1 --2- 172.21.15.121:0/133647247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fc8102e00 0x7f3fc8103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:54.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.385+0000 7f3fcfcc5640 1 --2- 172.21.15.121:0/133647247 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fc8101c00 0x7f3fc8102000 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:54.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.385+0000 7f3fcfcc5640 1 -- 172.21.15.121:0/133647247 >> 172.21.15.121:0/133647247 conn(0x7f3fc80fd3b0 msgr2=0x7f3fc80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:34:54.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.385+0000 7f3fcfcc5640 1 -- 172.21.15.121:0/133647247 shutdown_connections 2024-09-19T09:34:54.418 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.385+0000 7f3fcfcc5640 1 -- 172.21.15.121:0/133647247 wait complete. 2024-09-19T09:34:54.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.386+0000 7f3fcfcc5640 1 Processor -- start 2024-09-19T09:34:54.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.386+0000 7f3fcfcc5640 1 -- start start 2024-09-19T09:34:54.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.386+0000 7f3fcfcc5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fc8101c00 0x7f3fc8075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:54.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.386+0000 7f3fcfcc5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fc8102e00 0x7f3fc80745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:54.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.386+0000 7f3fcfcc5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fc81037c0 0x7f3fc8074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:54.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.386+0000 7f3fcfcc5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc810d880 con 0x7f3fc81037c0 2024-09-19T09:34:54.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.386+0000 7f3fcfcc5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc810d700 con 0x7f3fc8102e00 2024-09-19T09:34:54.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.386+0000 7f3fcfcc5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc810da00 con 0x7f3fc8101c00 2024-09-19T09:34:54.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.386+0000 7f3fcda61640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fc8101c00 0x7f3fc8075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:54.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.386+0000 7f3fcda61640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fc8101c00 0x7f3fc8075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:36348/0 (socket says 172.21.15.121:36348) 2024-09-19T09:34:54.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.386+0000 7f3fcda61640 1 -- 172.21.15.121:0/1232357041 learned_addr learned my addr 172.21.15.121:0/1232357041 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-19T09:34:54.419 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.386+0000 7f3fcd260640 1 --2- 172.21.15.121:0/1232357041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fc8102e00 0x7f3fc80745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:54.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.386+0000 7f3fce262640 1 --2- 172.21.15.121:0/1232357041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fc81037c0 0x7f3fc8074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:54.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.386+0000 7f3fcda61640 1 -- 172.21.15.121:0/1232357041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fc8102e00 msgr2=0x7f3fc80745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:54.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.386+0000 7f3fcda61640 1 --2- 172.21.15.121:0/1232357041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fc8102e00 0x7f3fc80745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:54.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.387+0000 7f3fcda61640 1 -- 172.21.15.121:0/1232357041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fc81037c0 msgr2=0x7f3fc8074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:34:54.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.387+0000 7f3fcda61640 1 --2- 172.21.15.121:0/1232357041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fc81037c0 0x7f3fc8074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:34:54.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.387+0000 7f3fcda61640 1 -- 172.21.15.121:0/1232357041 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc80753e0 con 0x7f3fc8101c00 2024-09-19T09:34:54.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.387+0000 7f3fcd260640 1 --2- 172.21.15.121:0/1232357041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fc8102e00 0x7f3fc80745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:34:54.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.387+0000 7f3fcda61640 1 --2- 172.21.15.121:0/1232357041 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fc8101c00 0x7f3fc8075f90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4031610 tx=0x7f3fc4004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:54.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.387+0000 7f3fbeffd640 1 -- 172.21.15.121:0/1232357041 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc403f030 con 0x7f3fc8101c00 2024-09-19T09:34:54.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.387+0000 7f3fcfcc5640 1 -- 172.21.15.121:0/1232357041 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fc81a2000 con 0x7f3fc8101c00 2024-09-19T09:34:54.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.387+0000 7f3fbeffd640 1 -- 172.21.15.121:0/1232357041 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3fc4003ad0 con 0x7f3fc8101c00 2024-09-19T09:34:54.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.387+0000 7f3fbeffd640 1 -- 172.21.15.121:0/1232357041 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc4035070 con 0x7f3fc8101c00 2024-09-19T09:34:54.420 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.387+0000 7f3fcfcc5640 1 -- 172.21.15.121:0/1232357041 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fc81a24b0 con 0x7f3fc8101c00 2024-09-19T09:34:54.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.388+0000 7f3fcfcc5640 1 -- 172.21.15.121:0/1232357041 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fc8108fb0 con 0x7f3fc8101c00 2024-09-19T09:34:54.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.390+0000 7f3fbeffd640 1 -- 172.21.15.121:0/1232357041 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f3fc4042030 con 0x7f3fc8101c00 2024-09-19T09:34:54.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.391+0000 7f3fbeffd640 1 --2- 172.21.15.121:0/1232357041 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3fb40a3240 0x7f3fb40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:34:54.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.391+0000 7f3fbeffd640 1 -- 172.21.15.121:0/1232357041 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6447+0+0 (secure 0 0 0) 0x7f3fc40efa30 con 0x7f3fc8101c00 2024-09-19T09:34:54.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.391+0000 7f3fcd260640 1 --2- 172.21.15.121:0/1232357041 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3fb40a3240 0x7f3fb40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:34:54.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.392+0000 7f3fcd260640 1 --2- 172.21.15.121:0/1232357041 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3fb40a3240 0x7f3fb40a5700 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8075d10 tx=0x7f3fb8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:34:54.421 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.394+0000 7f3fbeffd640 1 -- 172.21.15.121:0/1232357041 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3fc40bc850 con 0x7f3fc8101c00 2024-09-19T09:34:54.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:54 smithi001 ceph-mon[31225]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:54.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:54 smithi001 ceph-mon[31225]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T09:34:54.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:54 smithi001 ceph-mon[31225]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T09:34:54.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:54 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:34:54.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:54 smithi001 ceph-mon[31225]: from='osd.10 [v2:172.21.15.22:6824/343155547,v1:172.21.15.22:6825/343155547]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T09:34:54.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:54 smithi001 ceph-mon[31225]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-19T09:34:54.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:54 smithi001 ceph-mon[31225]: Detected new or changed devices on smithi022 2024-09-19T09:34:54.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:54 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:54.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:54 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:54.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:54 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:54.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:54 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:54.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:54 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:54.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:54 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:34:54.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:54 smithi001 ceph-mon[31225]: Adjusting osd_memory_target on smithi022 to 4273M 2024-09-19T09:34:54.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:54 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:54.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:54 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:54.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:54 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:34:54.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:54 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:34:54.579 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:34:54.578+0000 7f3fcfcc5640 1 -- 172.21.15.121:0/1232357041 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f3fc8062630 con 0x7f3fb40a3240 2024-09-19T09:34:54.864 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:34:54 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:34:54.501+0000 7fb83f812640 -1 osd.10 0 waiting for initial osdmap 2024-09-19T09:34:54.864 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:34:54 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:34:54.512+0000 7fb837632640 -1 osd.10 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:34:55.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:55 smithi022 ceph-mon[35583]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-19T09:34:55.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:55 smithi022 ceph-mon[35583]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T09:34:55.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:55 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:34:55.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:55 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:34:55.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:55 smithi022 ceph-mon[35583]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:55.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:55 smithi022 ceph-mon[35583]: osdmap e67: 11 total, 10 up, 11 in 2024-09-19T09:34:55.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:55 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:34:55.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:55 smithi022 ceph-mon[35583]: from='osd.10 ' entity='osd.10' 2024-09-19T09:34:55.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:55 smithi022 ceph-mon[35583]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:34:55.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:55 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:34:55.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:55 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:34:55.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:55 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:55.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:55 smithi121 ceph-mon[35577]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-19T09:34:55.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:55 smithi121 ceph-mon[35577]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T09:34:55.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:55 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:34:55.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:55 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:34:55.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:55 smithi121 ceph-mon[35577]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:55.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:55 smithi121 ceph-mon[35577]: osdmap e67: 11 total, 10 up, 11 in 2024-09-19T09:34:55.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:55 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:34:55.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:55 smithi121 ceph-mon[35577]: from='osd.10 ' entity='osd.10' 2024-09-19T09:34:55.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:55 smithi121 ceph-mon[35577]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:34:55.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:55 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:34:55.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:55 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:34:55.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:55 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:55.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:55 smithi001 ceph-mon[31225]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-19T09:34:55.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:55 smithi001 ceph-mon[31225]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T09:34:55.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:55 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:34:55.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:55 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:34:55.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:55 smithi001 ceph-mon[31225]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 894 GiB / 894 GiB avail 2024-09-19T09:34:55.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:55 smithi001 ceph-mon[31225]: osdmap e67: 11 total, 10 up, 11 in 2024-09-19T09:34:55.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:55 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:34:55.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:55 smithi001 ceph-mon[31225]: from='osd.10 ' entity='osd.10' 2024-09-19T09:34:55.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:55 smithi001 ceph-mon[31225]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:34:55.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:55 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T09:34:55.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:55 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T09:34:55.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:55 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:34:56.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:56 smithi022 ceph-mon[35583]: purged_snaps scrub starts 2024-09-19T09:34:56.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:56 smithi022 ceph-mon[35583]: purged_snaps scrub ok 2024-09-19T09:34:56.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:56 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:34:56.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:56 smithi022 ceph-mon[35583]: osd.10 [v2:172.21.15.22:6824/343155547,v1:172.21.15.22:6825/343155547] boot 2024-09-19T09:34:56.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:56 smithi022 ceph-mon[35583]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T09:34:56.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:56 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:34:56.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:56 smithi121 ceph-mon[35577]: purged_snaps scrub starts 2024-09-19T09:34:56.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:56 smithi121 ceph-mon[35577]: purged_snaps scrub ok 2024-09-19T09:34:56.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:56 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:34:56.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:56 smithi121 ceph-mon[35577]: osd.10 [v2:172.21.15.22:6824/343155547,v1:172.21.15.22:6825/343155547] boot 2024-09-19T09:34:56.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:56 smithi121 ceph-mon[35577]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T09:34:56.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:56 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:34:56.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:56 smithi001 ceph-mon[31225]: purged_snaps scrub starts 2024-09-19T09:34:56.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:56 smithi001 ceph-mon[31225]: purged_snaps scrub ok 2024-09-19T09:34:56.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:56 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:34:56.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:56 smithi001 ceph-mon[31225]: osd.10 [v2:172.21.15.22:6824/343155547,v1:172.21.15.22:6825/343155547] boot 2024-09-19T09:34:56.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:56 smithi001 ceph-mon[31225]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T09:34:56.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:56 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T09:34:57.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:57 smithi022 ceph-mon[35583]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:34:57.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:57 smithi022 ceph-mon[35583]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T09:34:57.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:57 smithi022 ceph-mon[35583]: from='client.? 172.21.15.121:0/3196128662' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5a831eb6-ad66-4ab6-a30a-b6299ce1f88d"}]: dispatch 2024-09-19T09:34:57.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:57 smithi022 ceph-mon[35583]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5a831eb6-ad66-4ab6-a30a-b6299ce1f88d"}]: dispatch 2024-09-19T09:34:57.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:57 smithi022 ceph-mon[35583]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5a831eb6-ad66-4ab6-a30a-b6299ce1f88d"}]': finished 2024-09-19T09:34:57.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:57 smithi022 ceph-mon[35583]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T09:34:57.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:57 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:34:57.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:57 smithi121 ceph-mon[35577]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:34:57.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:57 smithi121 ceph-mon[35577]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T09:34:57.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:57 smithi121 ceph-mon[35577]: from='client.? 172.21.15.121:0/3196128662' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5a831eb6-ad66-4ab6-a30a-b6299ce1f88d"}]: dispatch 2024-09-19T09:34:57.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:57 smithi121 ceph-mon[35577]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5a831eb6-ad66-4ab6-a30a-b6299ce1f88d"}]: dispatch 2024-09-19T09:34:57.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:57 smithi121 ceph-mon[35577]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5a831eb6-ad66-4ab6-a30a-b6299ce1f88d"}]': finished 2024-09-19T09:34:57.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:57 smithi121 ceph-mon[35577]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T09:34:57.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:57 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:34:57.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:57 smithi001 ceph-mon[31225]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:34:57.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:57 smithi001 ceph-mon[31225]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T09:34:57.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:57 smithi001 ceph-mon[31225]: from='client.? 172.21.15.121:0/3196128662' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5a831eb6-ad66-4ab6-a30a-b6299ce1f88d"}]: dispatch 2024-09-19T09:34:57.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:57 smithi001 ceph-mon[31225]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5a831eb6-ad66-4ab6-a30a-b6299ce1f88d"}]: dispatch 2024-09-19T09:34:57.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:57 smithi001 ceph-mon[31225]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5a831eb6-ad66-4ab6-a30a-b6299ce1f88d"}]': finished 2024-09-19T09:34:57.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:57 smithi001 ceph-mon[31225]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T09:34:57.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:57 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:34:58.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:58 smithi022 ceph-mon[35583]: from='client.? 172.21.15.121:0/2220936486' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:34:58.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:58 smithi121 ceph-mon[35577]: from='client.? 172.21.15.121:0/2220936486' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:34:58.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:58 smithi001 ceph-mon[31225]: from='client.? 172.21.15.121:0/2220936486' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T09:34:59.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:59 smithi022 ceph-mon[35583]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:34:59.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:59 smithi022 ceph-mon[35583]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T09:34:59.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:34:59 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:34:59.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:59 smithi121 ceph-mon[35577]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:34:59.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:59 smithi121 ceph-mon[35577]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T09:34:59.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:34:59 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:34:59.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:59 smithi001 ceph-mon[31225]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:34:59.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:59 smithi001 ceph-mon[31225]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T09:34:59.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:34:59 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:35:00.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:00 smithi022 ceph-mon[35583]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T09:35:00.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:00 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:35:00.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:00 smithi121 ceph-mon[35577]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T09:35:00.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:00 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:35:00.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:00 smithi001 ceph-mon[31225]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T09:35:00.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:00 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:35:01.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:01 smithi022 ceph-mon[35583]: pgmap v235: 1 pgs: 1 peering; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:35:01.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:01 smithi121 ceph-mon[35577]: pgmap v235: 1 pgs: 1 peering; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:35:01.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:01 smithi001 ceph-mon[31225]: pgmap v235: 1 pgs: 1 peering; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T09:35:03.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:03 smithi121 ceph-mon[35577]: pgmap v236: 1 pgs: 1 peering; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-19T09:35:03.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:03 smithi022 ceph-mon[35583]: pgmap v236: 1 pgs: 1 peering; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-19T09:35:03.676 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:03 smithi001 ceph-mon[31225]: pgmap v236: 1 pgs: 1 peering; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-19T09:35:05.559 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:05 smithi121 ceph-mon[35577]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-19T09:35:05.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:05 smithi022 ceph-mon[35583]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-19T09:35:05.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:05 smithi001 ceph-mon[31225]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-19T09:35:06.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:06 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T09:35:06.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:06 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:06.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:06 smithi022 ceph-mon[35583]: Deploying daemon osd.11 on smithi121 2024-09-19T09:35:06.614 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:06 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T09:35:06.615 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:06 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:06.615 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:06 smithi121 ceph-mon[35577]: Deploying daemon osd.11 on smithi121 2024-09-19T09:35:06.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:06 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T09:35:06.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:06 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:06.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:06 smithi001 ceph-mon[31225]: Deploying daemon osd.11 on smithi121 2024-09-19T09:35:07.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:07 smithi022 ceph-mon[35583]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:35:07.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:07 smithi121 ceph-mon[35577]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:35:07.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:07 smithi001 ceph-mon[31225]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T09:35:09.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:09 smithi022 ceph-mon[35583]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-19T09:35:09.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:09 smithi121 ceph-mon[35577]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-19T09:35:09.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:09 smithi001 ceph-mon[31225]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-19T09:35:11.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:11 smithi022 ceph-mon[35583]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:35:11.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:11 smithi121 ceph-mon[35577]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:35:11.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:11 smithi001 ceph-mon[31225]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:35:12.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:12 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:35:12.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:12 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:12.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:12 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:12.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:12 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:35:12.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:12 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:12.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:12 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:12.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:12 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:35:12.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:12 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:12.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:12 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:13.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:13 smithi022 ceph-mon[35583]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:35:13.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:13 smithi121 ceph-mon[35577]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:35:13.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:13 smithi001 ceph-mon[31225]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:35:15.789 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:15.787+0000 7f3fbeffd640 1 -- 172.21.15.121:0/1232357041 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f3fc8062630 con 0x7f3fb40a3240 2024-09-19T09:35:15.789 INFO:teuthology.orchestra.run.smithi121.stdout:Created osd(s) 11 on host 'smithi121' 2024-09-19T09:35:15.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:15.789+0000 7f3fcfcc5640 1 -- 172.21.15.121:0/1232357041 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3fb40a3240 msgr2=0x7f3fb40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:15.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:15.789+0000 7f3fcfcc5640 1 --2- 172.21.15.121:0/1232357041 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3fb40a3240 0x7f3fb40a5700 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8075d10 tx=0x7f3fb8005f90 comp rx=0 tx=0).stop 2024-09-19T09:35:15.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:15.789+0000 7f3fcfcc5640 1 -- 172.21.15.121:0/1232357041 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fc8101c00 msgr2=0x7f3fc8075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:15.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:15.789+0000 7f3fcfcc5640 1 --2- 172.21.15.121:0/1232357041 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fc8101c00 0x7f3fc8075f90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4031610 tx=0x7f3fc4004270 comp rx=0 tx=0).stop 2024-09-19T09:35:15.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:15.789+0000 7f3fcfcc5640 1 -- 172.21.15.121:0/1232357041 shutdown_connections 2024-09-19T09:35:15.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:15.789+0000 7f3fcfcc5640 1 --2- 172.21.15.121:0/1232357041 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fc81037c0 0x7f3fc8074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:15.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:15.789+0000 7f3fcfcc5640 1 --2- 172.21.15.121:0/1232357041 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3fb40a3240 0x7f3fb40a5700 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:15.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:15.789+0000 7f3fcfcc5640 1 --2- 172.21.15.121:0/1232357041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fc8102e00 0x7f3fc80745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:15.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:15.789+0000 7f3fcfcc5640 1 --2- 172.21.15.121:0/1232357041 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fc8101c00 0x7f3fc8075f90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:15.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:15.789+0000 7f3fcfcc5640 1 -- 172.21.15.121:0/1232357041 >> 172.21.15.121:0/1232357041 conn(0x7f3fc80fd3b0 msgr2=0x7f3fc8106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:15.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:15.789+0000 7f3fcfcc5640 1 -- 172.21.15.121:0/1232357041 shutdown_connections 2024-09-19T09:35:15.792 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:15.789+0000 7f3fcfcc5640 1 -- 172.21.15.121:0/1232357041 wait complete. 2024-09-19T09:35:16.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:16 smithi022 ceph-mon[35583]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:35:16.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:16 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:16.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:16 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:16.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:16 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:16.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:16 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:35:16.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:16 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:16.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:16 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:35:16.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:16 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:16.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:16 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:16.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:16 smithi121 ceph-mon[35577]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:35:16.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:16 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:16.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:16 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:16.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:16 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:16.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:16 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:35:16.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:16 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:16.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:16 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:35:16.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:16 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:16.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:16 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:16.493 DEBUG:teuthology.orchestra.run.smithi121:osd.11> sudo journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@osd.11.service 2024-09-19T09:35:16.495 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-19T09:35:16.496 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T09:35:16.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:16 smithi001 ceph-mon[31225]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:35:16.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:16 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:16.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:16 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:16.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:16 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:16.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:16 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:35:16.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:16 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:16.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:16 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:35:16.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:16 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:16.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:16 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:16.762 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:17.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.262+0000 7f9aea8f5640 1 -- 172.21.15.1:0/2368479483 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ae4101d10 msgr2=0x7f9ae4102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:17.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.262+0000 7f9aea8f5640 1 --2- 172.21.15.1:0/2368479483 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ae4101d10 0x7f9ae4102190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8009900 tx=0x7f9ad802a410 comp rx=0 tx=0).stop 2024-09-19T09:35:17.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.262+0000 7f9aea8f5640 1 -- 172.21.15.1:0/2368479483 shutdown_connections 2024-09-19T09:35:17.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.262+0000 7f9aea8f5640 1 --2- 172.21.15.1:0/2368479483 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ae41026d0 0x7f9ae4108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:17.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.262+0000 7f9aea8f5640 1 --2- 172.21.15.1:0/2368479483 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ae4101d10 0x7f9ae4102190 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:17.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.262+0000 7f9aea8f5640 1 --2- 172.21.15.1:0/2368479483 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ae4100b10 0x7f9ae4100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:17.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.262+0000 7f9aea8f5640 1 -- 172.21.15.1:0/2368479483 >> 172.21.15.1:0/2368479483 conn(0x7f9ae40fc2a0 msgr2=0x7f9ae40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:17.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.262+0000 7f9aea8f5640 1 -- 172.21.15.1:0/2368479483 shutdown_connections 2024-09-19T09:35:17.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.262+0000 7f9aea8f5640 1 -- 172.21.15.1:0/2368479483 wait complete. 2024-09-19T09:35:17.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.262+0000 7f9aea8f5640 1 Processor -- start 2024-09-19T09:35:17.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.263+0000 7f9aea8f5640 1 -- start start 2024-09-19T09:35:17.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.263+0000 7f9aea8f5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ae4100b10 0x7f9ae406b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:17.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.263+0000 7f9aea8f5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ae4101d10 0x7f9ae419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:17.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.263+0000 7f9aea8f5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ae41026d0 0x7f9ae419f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:17.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.263+0000 7f9aea8f5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae410c7e0 con 0x7f9ae41026d0 2024-09-19T09:35:17.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.263+0000 7f9aea8f5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae410c660 con 0x7f9ae4100b10 2024-09-19T09:35:17.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.263+0000 7f9aea8f5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae410c960 con 0x7f9ae4101d10 2024-09-19T09:35:17.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.263+0000 7f9ae8e92640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ae41026d0 0x7f9ae419f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:17.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.263+0000 7f9ae8e92640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ae41026d0 0x7f9ae419f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51068/0 (socket says 172.21.15.1:51068) 2024-09-19T09:35:17.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.263+0000 7f9ae8e92640 1 -- 172.21.15.1:0/1139156102 learned_addr learned my addr 172.21.15.1:0/1139156102 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:35:17.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.263+0000 7f9ae3fff640 1 --2- 172.21.15.1:0/1139156102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ae4100b10 0x7f9ae406b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:17.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.263+0000 7f9ae37fe640 1 --2- 172.21.15.1:0/1139156102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ae4101d10 0x7f9ae419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:17.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.263+0000 7f9ae8e92640 1 -- 172.21.15.1:0/1139156102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ae4101d10 msgr2=0x7f9ae419ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:17.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.263+0000 7f9ae8e92640 1 --2- 172.21.15.1:0/1139156102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ae4101d10 0x7f9ae419ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:17.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.263+0000 7f9ae8e92640 1 -- 172.21.15.1:0/1139156102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ae4100b10 msgr2=0x7f9ae406b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:17.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.263+0000 7f9ae8e92640 1 --2- 172.21.15.1:0/1139156102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ae4100b10 0x7f9ae406b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:17.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.263+0000 7f9ae8e92640 1 -- 172.21.15.1:0/1139156102 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae419fbf0 con 0x7f9ae41026d0 2024-09-19T09:35:17.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.264+0000 7f9ae8e92640 1 --2- 172.21.15.1:0/1139156102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ae41026d0 0x7f9ae419f2e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00eaa0 tx=0x7f9adc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:17.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.264+0000 7f9ae17fa640 1 -- 172.21.15.1:0/1139156102 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc00cdb0 con 0x7f9ae41026d0 2024-09-19T09:35:17.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.264+0000 7f9ae17fa640 1 -- 172.21.15.1:0/1139156102 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9adc005020 con 0x7f9ae41026d0 2024-09-19T09:35:17.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.264+0000 7f9aea8f5640 1 -- 172.21.15.1:0/1139156102 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ae419fe80 con 0x7f9ae41026d0 2024-09-19T09:35:17.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.264+0000 7f9ae17fa640 1 -- 172.21.15.1:0/1139156102 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc0116b0 con 0x7f9ae41026d0 2024-09-19T09:35:17.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.264+0000 7f9aea8f5640 1 -- 172.21.15.1:0/1139156102 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ae41a0330 con 0x7f9ae41026d0 2024-09-19T09:35:17.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.265+0000 7f9aea8f5640 1 -- 172.21.15.1:0/1139156102 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ae4107ee0 con 0x7f9ae41026d0 2024-09-19T09:35:17.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.266+0000 7f9ae17fa640 1 -- 172.21.15.1:0/1139156102 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f9adc005560 con 0x7f9ae41026d0 2024-09-19T09:35:17.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.267+0000 7f9ae17fa640 1 --2- 172.21.15.1:0/1139156102 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f9acc0a32c0 0x7f9acc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:17.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.267+0000 7f9ae3fff640 1 --2- 172.21.15.1:0/1139156102 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f9acc0a32c0 0x7f9acc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:17.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.267+0000 7f9ae17fa640 1 -- 172.21.15.1:0/1139156102 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6809+0+0 (secure 0 0 0) 0x7f9adc0cf400 con 0x7f9ae41026d0 2024-09-19T09:35:17.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.267+0000 7f9ae3fff640 1 --2- 172.21.15.1:0/1139156102 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f9acc0a32c0 0x7f9acc0a5780 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4101b70 tx=0x7f9ad4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:17.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.271+0000 7f9ae17fa640 1 -- 172.21.15.1:0/1139156102 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9adc016030 con 0x7f9ae41026d0 2024-09-19T09:35:17.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.447+0000 7f9aea8f5640 1 -- 172.21.15.1:0/1139156102 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f9ae402d970 con 0x7f9ae41026d0 2024-09-19T09:35:17.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.447+0000 7f9ae17fa640 1 -- 172.21.15.1:0/1139156102 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7f9adc09c0b0 con 0x7f9ae41026d0 2024-09-19T09:35:17.449 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:35:17.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.449+0000 7f9aea8f5640 1 -- 172.21.15.1:0/1139156102 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f9acc0a32c0 msgr2=0x7f9acc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:17.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.449+0000 7f9aea8f5640 1 --2- 172.21.15.1:0/1139156102 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f9acc0a32c0 0x7f9acc0a5780 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4101b70 tx=0x7f9ad4005f90 comp rx=0 tx=0).stop 2024-09-19T09:35:17.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.449+0000 7f9aea8f5640 1 -- 172.21.15.1:0/1139156102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ae41026d0 msgr2=0x7f9ae419f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:17.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.449+0000 7f9aea8f5640 1 --2- 172.21.15.1:0/1139156102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ae41026d0 0x7f9ae419f2e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00eaa0 tx=0x7f9adc00ef60 comp rx=0 tx=0).stop 2024-09-19T09:35:17.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.449+0000 7f9aea8f5640 1 -- 172.21.15.1:0/1139156102 shutdown_connections 2024-09-19T09:35:17.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.449+0000 7f9aea8f5640 1 --2- 172.21.15.1:0/1139156102 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ae41026d0 0x7f9ae419f2e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:17.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.449+0000 7f9aea8f5640 1 --2- 172.21.15.1:0/1139156102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ae4101d10 0x7f9ae419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:17.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.449+0000 7f9aea8f5640 1 --2- 172.21.15.1:0/1139156102 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f9acc0a32c0 0x7f9acc0a5780 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:17.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.449+0000 7f9aea8f5640 1 --2- 172.21.15.1:0/1139156102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ae4100b10 0x7f9ae406b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:17.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.449+0000 7f9aea8f5640 1 -- 172.21.15.1:0/1139156102 >> 172.21.15.1:0/1139156102 conn(0x7f9ae40fc2a0 msgr2=0x7f9ae41050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:17.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.449+0000 7f9aea8f5640 1 -- 172.21.15.1:0/1139156102 shutdown_connections 2024-09-19T09:35:17.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:17.449+0000 7f9aea8f5640 1 -- 172.21.15.1:0/1139156102 wait complete. 2024-09-19T09:35:18.170 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:18 smithi121 ceph-mon[35577]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:35:18.171 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:18 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1139156102' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:35:18.171 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:35:18 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:35:18.056+0000 7f40675bf640 -1 osd.11 0 log_to_monitors true 2024-09-19T09:35:18.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:18 smithi022 ceph-mon[35583]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:35:18.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:18 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1139156102' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:35:18.429 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:18 smithi001 ceph-mon[31225]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:35:18.429 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:18 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1139156102' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:35:18.464 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":72,"num_osds":12,"num_up_osds":11,"osd_up_since":1726738495,"num_in_osds":12,"osd_in_since":1726738497,"num_remapped_pgs":0} 2024-09-19T09:35:19.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:19 smithi001 ceph-mon[31225]: from='osd.11 [v2:172.21.15.121:6824/3202514460,v1:172.21.15.121:6825/3202514460]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:35:19.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:19 smithi001 ceph-mon[31225]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:35:19.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:19 smithi022 ceph-mon[35583]: from='osd.11 [v2:172.21.15.121:6824/3202514460,v1:172.21.15.121:6825/3202514460]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:35:19.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:19 smithi022 ceph-mon[35583]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:35:19.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:19 smithi121 ceph-mon[35577]: from='osd.11 [v2:172.21.15.121:6824/3202514460,v1:172.21.15.121:6825/3202514460]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:35:19.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:19 smithi121 ceph-mon[35577]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T09:35:19.465 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T09:35:19.730 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:20.019 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:20 smithi001 ceph-mon[31225]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:35:20.019 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:20 smithi001 ceph-mon[31225]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T09:35:20.019 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:20 smithi001 ceph-mon[31225]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T09:35:20.019 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:20 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:35:20.019 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:20 smithi001 ceph-mon[31225]: from='osd.11 [v2:172.21.15.121:6824/3202514460,v1:172.21.15.121:6825/3202514460]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-19T09:35:20.020 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:20 smithi001 ceph-mon[31225]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-19T09:35:20.020 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:20 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:20.020 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:20 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:20.020 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:20 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:20.020 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:20 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:20.020 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:20 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:20.020 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:20 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:20.020 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:20 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:20.020 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:20 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:20.020 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:20 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:35:20.020 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:20 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:20.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.230+0000 7fe431ed1640 1 -- 172.21.15.1:0/2458379591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe42c102e00 msgr2=0x7fe42c103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:20.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.230+0000 7fe431ed1640 1 --2- 172.21.15.1:0/2458379591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe42c102e00 0x7fe42c103280 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe414009900 tx=0x7fe41402a410 comp rx=0 tx=0).stop 2024-09-19T09:35:20.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.231+0000 7fe431ed1640 1 -- 172.21.15.1:0/2458379591 shutdown_connections 2024-09-19T09:35:20.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.231+0000 7fe431ed1640 1 --2- 172.21.15.1:0/2458379591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe42c1037c0 0x7fe42c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:20.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.231+0000 7fe431ed1640 1 --2- 172.21.15.1:0/2458379591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe42c102e00 0x7fe42c103280 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:20.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.231+0000 7fe431ed1640 1 --2- 172.21.15.1:0/2458379591 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe42c101c00 0x7fe42c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:20.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.231+0000 7fe431ed1640 1 -- 172.21.15.1:0/2458379591 >> 172.21.15.1:0/2458379591 conn(0x7fe42c0fd390 msgr2=0x7fe42c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:20.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.231+0000 7fe431ed1640 1 -- 172.21.15.1:0/2458379591 shutdown_connections 2024-09-19T09:35:20.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.231+0000 7fe431ed1640 1 -- 172.21.15.1:0/2458379591 wait complete. 2024-09-19T09:35:20.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.231+0000 7fe431ed1640 1 Processor -- start 2024-09-19T09:35:20.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.231+0000 7fe431ed1640 1 -- start start 2024-09-19T09:35:20.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.232+0000 7fe431ed1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe42c101c00 0x7fe42c075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:20.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.232+0000 7fe431ed1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe42c102e00 0x7fe42c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:20.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.232+0000 7fe431ed1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe42c1037c0 0x7fe42c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:20.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.232+0000 7fe431ed1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c10d880 con 0x7fe42c102e00 2024-09-19T09:35:20.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.232+0000 7fe431ed1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c10d700 con 0x7fe42c101c00 2024-09-19T09:35:20.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.232+0000 7fe431ed1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c10da00 con 0x7fe42c1037c0 2024-09-19T09:35:20.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.232+0000 7fe422ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe42c102e00 0x7fe42c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:20.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.232+0000 7fe422ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe42c102e00 0x7fe42c0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51084/0 (socket says 172.21.15.1:51084) 2024-09-19T09:35:20.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.232+0000 7fe422ffd640 1 -- 172.21.15.1:0/1523630510 learned_addr learned my addr 172.21.15.1:0/1523630510 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:35:20.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.232+0000 7fe42bfff640 1 --2- 172.21.15.1:0/1523630510 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe42c1037c0 0x7fe42c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:20.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.232+0000 7fe42b7fe640 1 --2- 172.21.15.1:0/1523630510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe42c101c00 0x7fe42c075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:20.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.232+0000 7fe42bfff640 1 -- 172.21.15.1:0/1523630510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe42c101c00 msgr2=0x7fe42c075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:20.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.232+0000 7fe42bfff640 1 --2- 172.21.15.1:0/1523630510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe42c101c00 0x7fe42c075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:20.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.232+0000 7fe42bfff640 1 -- 172.21.15.1:0/1523630510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe42c102e00 msgr2=0x7fe42c0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:20.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.232+0000 7fe42bfff640 1 --2- 172.21.15.1:0/1523630510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe42c102e00 0x7fe42c0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:20.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.232+0000 7fe42bfff640 1 -- 172.21.15.1:0/1523630510 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42c0753e0 con 0x7fe42c1037c0 2024-09-19T09:35:20.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.232+0000 7fe422ffd640 1 --2- 172.21.15.1:0/1523630510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe42c102e00 0x7fe42c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:35:20.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.232+0000 7fe42bfff640 1 --2- 172.21.15.1:0/1523630510 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe42c1037c0 0x7fe42c074b20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe424009fd0 tx=0x7fe42400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:20.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.233+0000 7fe4297fa640 1 -- 172.21.15.1:0/1523630510 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42400ce20 con 0x7fe42c1037c0 2024-09-19T09:35:20.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.233+0000 7fe4297fa640 1 -- 172.21.15.1:0/1523630510 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe424005020 con 0x7fe42c1037c0 2024-09-19T09:35:20.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.233+0000 7fe431ed1640 1 -- 172.21.15.1:0/1523630510 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe42c1a2060 con 0x7fe42c1037c0 2024-09-19T09:35:20.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.233+0000 7fe4297fa640 1 -- 172.21.15.1:0/1523630510 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe424010720 con 0x7fe42c1037c0 2024-09-19T09:35:20.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.233+0000 7fe431ed1640 1 -- 172.21.15.1:0/1523630510 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe42c1a2570 con 0x7fe42c1037c0 2024-09-19T09:35:20.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.234+0000 7fe431ed1640 1 -- 172.21.15.1:0/1523630510 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe42c108fd0 con 0x7fe42c1037c0 2024-09-19T09:35:20.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.235+0000 7fe4297fa640 1 -- 172.21.15.1:0/1523630510 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fe424005540 con 0x7fe42c1037c0 2024-09-19T09:35:20.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.236+0000 7fe4297fa640 1 --2- 172.21.15.1:0/1523630510 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe4180a3240 0x7fe4180a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:20.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.236+0000 7fe42b7fe640 1 --2- 172.21.15.1:0/1523630510 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe4180a3240 0x7fe4180a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:20.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.236+0000 7fe4297fa640 1 -- 172.21.15.1:0/1523630510 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6847+0+0 (secure 0 0 0) 0x7fe4240cfa00 con 0x7fe42c1037c0 2024-09-19T09:35:20.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.236+0000 7fe42b7fe640 1 --2- 172.21.15.1:0/1523630510 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe4180a3240 0x7fe4180a5700 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe42c102c60 tx=0x7fe41c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:20.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.240+0000 7fe4297fa640 1 -- 172.21.15.1:0/1523630510 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe42409cc40 con 0x7fe42c1037c0 2024-09-19T09:35:20.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:20 smithi022 ceph-mon[35583]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:35:20.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:20 smithi022 ceph-mon[35583]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T09:35:20.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:20 smithi022 ceph-mon[35583]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T09:35:20.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:20 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:35:20.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:20 smithi022 ceph-mon[35583]: from='osd.11 [v2:172.21.15.121:6824/3202514460,v1:172.21.15.121:6825/3202514460]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-19T09:35:20.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:20 smithi022 ceph-mon[35583]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-19T09:35:20.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:20 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:20.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:20 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:20.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:20 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:20.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:20 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:20.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:20 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:20.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:20 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:20.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:20 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:20.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:20 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:20.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:20 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:35:20.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:20 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:20.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:20 smithi121 ceph-mon[35577]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:35:20.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:20 smithi121 ceph-mon[35577]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T09:35:20.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:20 smithi121 ceph-mon[35577]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T09:35:20.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:20 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:35:20.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:20 smithi121 ceph-mon[35577]: from='osd.11 [v2:172.21.15.121:6824/3202514460,v1:172.21.15.121:6825/3202514460]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-19T09:35:20.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:20 smithi121 ceph-mon[35577]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-09-19T09:35:20.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:20 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:20.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:20 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:20.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:20 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:20.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:20 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:20.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:20 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:20.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:20 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:35:20.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:20 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:20.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:20 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:20.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:20 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:35:20.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:20 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:20.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.418+0000 7fe431ed1640 1 -- 172.21.15.1:0/1523630510 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fe42c062df0 con 0x7fe42c1037c0 2024-09-19T09:35:20.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.419+0000 7fe4297fa640 1 -- 172.21.15.1:0/1523630510 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7fe42409c540 con 0x7fe42c1037c0 2024-09-19T09:35:20.421 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:35:20.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.421+0000 7fe431ed1640 1 -- 172.21.15.1:0/1523630510 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe4180a3240 msgr2=0x7fe4180a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:20.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.421+0000 7fe431ed1640 1 --2- 172.21.15.1:0/1523630510 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe4180a3240 0x7fe4180a5700 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe42c102c60 tx=0x7fe41c00a2d0 comp rx=0 tx=0).stop 2024-09-19T09:35:20.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.422+0000 7fe431ed1640 1 -- 172.21.15.1:0/1523630510 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe42c1037c0 msgr2=0x7fe42c074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:20.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.422+0000 7fe431ed1640 1 --2- 172.21.15.1:0/1523630510 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe42c1037c0 0x7fe42c074b20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe424009fd0 tx=0x7fe42400ef10 comp rx=0 tx=0).stop 2024-09-19T09:35:20.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.422+0000 7fe431ed1640 1 -- 172.21.15.1:0/1523630510 shutdown_connections 2024-09-19T09:35:20.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.422+0000 7fe431ed1640 1 --2- 172.21.15.1:0/1523630510 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe42c1037c0 0x7fe42c074b20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:20.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.422+0000 7fe431ed1640 1 --2- 172.21.15.1:0/1523630510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe42c102e00 0x7fe42c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:20.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.422+0000 7fe431ed1640 1 --2- 172.21.15.1:0/1523630510 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe4180a3240 0x7fe4180a5700 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:20.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.422+0000 7fe431ed1640 1 --2- 172.21.15.1:0/1523630510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe42c101c00 0x7fe42c075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:20.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.422+0000 7fe431ed1640 1 -- 172.21.15.1:0/1523630510 >> 172.21.15.1:0/1523630510 conn(0x7fe42c0fd390 msgr2=0x7fe42c1061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:20.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.422+0000 7fe431ed1640 1 -- 172.21.15.1:0/1523630510 shutdown_connections 2024-09-19T09:35:20.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:20.422+0000 7fe431ed1640 1 -- 172.21.15.1:0/1523630510 wait complete. 2024-09-19T09:35:20.867 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:35:20 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:35:20.420+0000 7f4063d56640 -1 osd.11 0 waiting for initial osdmap 2024-09-19T09:35:20.867 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:35:20 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:35:20.430+0000 7f405b362640 -1 osd.11 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:35:21.163 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:21 smithi001 ceph-mon[31225]: Detected new or changed devices on smithi121 2024-09-19T09:35:21.163 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:21 smithi001 ceph-mon[31225]: Adjusting osd_memory_target on smithi121 to 4271M 2024-09-19T09:35:21.164 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:21 smithi001 ceph-mon[31225]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-19T09:35:21.164 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:21 smithi001 ceph-mon[31225]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T09:35:21.164 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:21 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:35:21.164 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:21 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:35:21.164 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:21 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1523630510' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:35:21.164 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:21 smithi001 ceph-mon[31225]: from='osd.11 ' entity='osd.11' 2024-09-19T09:35:21.194 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":74,"num_osds":12,"num_up_osds":11,"osd_up_since":1726738495,"num_in_osds":12,"osd_in_since":1726738497,"num_remapped_pgs":0} 2024-09-19T09:35:21.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:21 smithi022 ceph-mon[35583]: Detected new or changed devices on smithi121 2024-09-19T09:35:21.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:21 smithi022 ceph-mon[35583]: Adjusting osd_memory_target on smithi121 to 4271M 2024-09-19T09:35:21.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:21 smithi022 ceph-mon[35583]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-19T09:35:21.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:21 smithi022 ceph-mon[35583]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T09:35:21.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:21 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:35:21.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:21 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:35:21.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:21 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1523630510' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:35:21.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:21 smithi022 ceph-mon[35583]: from='osd.11 ' entity='osd.11' 2024-09-19T09:35:21.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:21 smithi121 ceph-mon[35577]: Detected new or changed devices on smithi121 2024-09-19T09:35:21.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:21 smithi121 ceph-mon[35577]: Adjusting osd_memory_target on smithi121 to 4271M 2024-09-19T09:35:21.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:21 smithi121 ceph-mon[35577]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-19T09:35:21.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:21 smithi121 ceph-mon[35577]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T09:35:21.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:21 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:35:21.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:21 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:35:21.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:21 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1523630510' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:35:21.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:21 smithi121 ceph-mon[35577]: from='osd.11 ' entity='osd.11' 2024-09-19T09:35:22.196 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T09:35:22.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:22 smithi022 ceph-mon[35583]: purged_snaps scrub starts 2024-09-19T09:35:22.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:22 smithi022 ceph-mon[35583]: purged_snaps scrub ok 2024-09-19T09:35:22.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:22 smithi022 ceph-mon[35583]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:35:22.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:22 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:35:22.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:22 smithi022 ceph-mon[35583]: osd.11 [v2:172.21.15.121:6824/3202514460,v1:172.21.15.121:6825/3202514460] boot 2024-09-19T09:35:22.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:22 smithi022 ceph-mon[35583]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T09:35:22.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:22 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:35:22.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:22 smithi121 ceph-mon[35577]: purged_snaps scrub starts 2024-09-19T09:35:22.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:22 smithi121 ceph-mon[35577]: purged_snaps scrub ok 2024-09-19T09:35:22.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:22 smithi121 ceph-mon[35577]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:35:22.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:22 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:35:22.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:22 smithi121 ceph-mon[35577]: osd.11 [v2:172.21.15.121:6824/3202514460,v1:172.21.15.121:6825/3202514460] boot 2024-09-19T09:35:22.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:22 smithi121 ceph-mon[35577]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T09:35:22.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:22 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:35:22.398 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:22 smithi001 ceph-mon[31225]: purged_snaps scrub starts 2024-09-19T09:35:22.399 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:22 smithi001 ceph-mon[31225]: purged_snaps scrub ok 2024-09-19T09:35:22.399 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:22 smithi001 ceph-mon[31225]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 983 GiB / 983 GiB avail 2024-09-19T09:35:22.399 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:22 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:35:22.399 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:22 smithi001 ceph-mon[31225]: osd.11 [v2:172.21.15.121:6824/3202514460,v1:172.21.15.121:6825/3202514460] boot 2024-09-19T09:35:22.399 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:22 smithi001 ceph-mon[31225]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T09:35:22.399 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:22 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T09:35:22.462 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:22.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.930+0000 7f3d519fb640 1 -- 172.21.15.1:0/2315033336 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d4c101d10 msgr2=0x7f3d4c102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:22.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.930+0000 7f3d519fb640 1 --2- 172.21.15.1:0/2315033336 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d4c101d10 0x7f3d4c102190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3d40009900 tx=0x7f3d4002a410 comp rx=0 tx=0).stop 2024-09-19T09:35:22.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.930+0000 7f3d519fb640 1 -- 172.21.15.1:0/2315033336 shutdown_connections 2024-09-19T09:35:22.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.930+0000 7f3d519fb640 1 --2- 172.21.15.1:0/2315033336 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d4c1026d0 0x7f3d4c108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:22.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.930+0000 7f3d519fb640 1 --2- 172.21.15.1:0/2315033336 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d4c101d10 0x7f3d4c102190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:22.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.930+0000 7f3d519fb640 1 --2- 172.21.15.1:0/2315033336 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d4c100b10 0x7f3d4c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:22.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.930+0000 7f3d519fb640 1 -- 172.21.15.1:0/2315033336 >> 172.21.15.1:0/2315033336 conn(0x7f3d4c0fc2a0 msgr2=0x7f3d4c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:22.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.930+0000 7f3d519fb640 1 -- 172.21.15.1:0/2315033336 shutdown_connections 2024-09-19T09:35:22.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.930+0000 7f3d519fb640 1 -- 172.21.15.1:0/2315033336 wait complete. 2024-09-19T09:35:22.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.931+0000 7f3d519fb640 1 Processor -- start 2024-09-19T09:35:22.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.931+0000 7f3d519fb640 1 -- start start 2024-09-19T09:35:22.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.931+0000 7f3d519fb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d4c100b10 0x7f3d4c197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:22.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.931+0000 7f3d519fb640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d4c101d10 0x7f3d4c198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:22.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.931+0000 7f3d519fb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d4c1026d0 0x7f3d4c19f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:22.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.931+0000 7f3d519fb640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4c10c790 con 0x7f3d4c1026d0 2024-09-19T09:35:22.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.931+0000 7f3d519fb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4c10c610 con 0x7f3d4c100b10 2024-09-19T09:35:22.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.931+0000 7f3d519fb640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4c10c910 con 0x7f3d4c101d10 2024-09-19T09:35:22.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.931+0000 7f3d4b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d4c1026d0 0x7f3d4c19f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:22.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.931+0000 7f3d4b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d4c1026d0 0x7f3d4c19f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51112/0 (socket says 172.21.15.1:51112) 2024-09-19T09:35:22.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.931+0000 7f3d4b7fe640 1 -- 172.21.15.1:0/2876546632 learned_addr learned my addr 172.21.15.1:0/2876546632 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:35:22.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.931+0000 7f3d4a7fc640 1 --2- 172.21.15.1:0/2876546632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d4c101d10 0x7f3d4c198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:22.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.931+0000 7f3d4affd640 1 --2- 172.21.15.1:0/2876546632 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d4c100b10 0x7f3d4c197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:22.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.931+0000 7f3d4b7fe640 1 -- 172.21.15.1:0/2876546632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d4c101d10 msgr2=0x7f3d4c198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:22.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.931+0000 7f3d4b7fe640 1 --2- 172.21.15.1:0/2876546632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d4c101d10 0x7f3d4c198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:22.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.931+0000 7f3d4b7fe640 1 -- 172.21.15.1:0/2876546632 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d4c100b10 msgr2=0x7f3d4c197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:22.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.931+0000 7f3d4b7fe640 1 --2- 172.21.15.1:0/2876546632 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d4c100b10 0x7f3d4c197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:22.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.932+0000 7f3d4b7fe640 1 -- 172.21.15.1:0/2876546632 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d4c19fb70 con 0x7f3d4c1026d0 2024-09-19T09:35:22.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.932+0000 7f3d4affd640 1 --2- 172.21.15.1:0/2876546632 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d4c100b10 0x7f3d4c197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:35:22.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.932+0000 7f3d4b7fe640 1 --2- 172.21.15.1:0/2876546632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d4c1026d0 0x7f3d4c19f500 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3d44009fd0 tx=0x7f3d4400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:22.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.932+0000 7f3d509f9640 1 -- 172.21.15.1:0/2876546632 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d44017070 con 0x7f3d4c1026d0 2024-09-19T09:35:22.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.932+0000 7f3d519fb640 1 -- 172.21.15.1:0/2876546632 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d4c19fe60 con 0x7f3d4c1026d0 2024-09-19T09:35:22.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.932+0000 7f3d509f9640 1 -- 172.21.15.1:0/2876546632 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d44003e50 con 0x7f3d4c1026d0 2024-09-19T09:35:22.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.932+0000 7f3d509f9640 1 -- 172.21.15.1:0/2876546632 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d440106c0 con 0x7f3d4c1026d0 2024-09-19T09:35:22.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.932+0000 7f3d519fb640 1 -- 172.21.15.1:0/2876546632 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d4c1a02c0 con 0x7f3d4c1026d0 2024-09-19T09:35:22.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.933+0000 7f3d519fb640 1 -- 172.21.15.1:0/2876546632 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d4c1a04f0 con 0x7f3d4c1026d0 2024-09-19T09:35:22.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.934+0000 7f3d509f9640 1 -- 172.21.15.1:0/2876546632 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f3d44003970 con 0x7f3d4c1026d0 2024-09-19T09:35:22.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.935+0000 7f3d509f9640 1 --2- 172.21.15.1:0/2876546632 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3d340a3270 0x7f3d340a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:22.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.935+0000 7f3d4affd640 1 --2- 172.21.15.1:0/2876546632 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3d340a3270 0x7f3d340a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:22.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.935+0000 7f3d509f9640 1 -- 172.21.15.1:0/2876546632 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f3d440cf1d0 con 0x7f3d4c1026d0 2024-09-19T09:35:22.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.935+0000 7f3d4affd640 1 --2- 172.21.15.1:0/2876546632 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3d340a3270 0x7f3d340a5730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c101b70 tx=0x7f3d3c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:22.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:22.939+0000 7f3d509f9640 1 -- 172.21.15.1:0/2876546632 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3d4409c390 con 0x7f3d4c1026d0 2024-09-19T09:35:23.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:23.117+0000 7f3d519fb640 1 -- 172.21.15.1:0/2876546632 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f3d4c1a07e0 con 0x7f3d4c1026d0 2024-09-19T09:35:23.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:23.118+0000 7f3d509f9640 1 -- 172.21.15.1:0/2876546632 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) ==== 74+0+133 (secure 0 0 0) 0x7f3d4409bc90 con 0x7f3d4c1026d0 2024-09-19T09:35:23.119 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:35:23.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:23.120+0000 7f3d519fb640 1 -- 172.21.15.1:0/2876546632 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3d340a3270 msgr2=0x7f3d340a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:23.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:23.120+0000 7f3d519fb640 1 --2- 172.21.15.1:0/2876546632 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3d340a3270 0x7f3d340a5730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c101b70 tx=0x7f3d3c005f90 comp rx=0 tx=0).stop 2024-09-19T09:35:23.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:23.120+0000 7f3d519fb640 1 -- 172.21.15.1:0/2876546632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d4c1026d0 msgr2=0x7f3d4c19f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:23.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:23.120+0000 7f3d519fb640 1 --2- 172.21.15.1:0/2876546632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d4c1026d0 0x7f3d4c19f500 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3d44009fd0 tx=0x7f3d4400b260 comp rx=0 tx=0).stop 2024-09-19T09:35:23.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:23.120+0000 7f3d519fb640 1 -- 172.21.15.1:0/2876546632 shutdown_connections 2024-09-19T09:35:23.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:23.120+0000 7f3d519fb640 1 --2- 172.21.15.1:0/2876546632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3d4c1026d0 0x7f3d4c19f500 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:23.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:23.120+0000 7f3d519fb640 1 --2- 172.21.15.1:0/2876546632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d4c101d10 0x7f3d4c198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:23.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:23.120+0000 7f3d519fb640 1 --2- 172.21.15.1:0/2876546632 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3d340a3270 0x7f3d340a5730 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:23.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:23.120+0000 7f3d519fb640 1 --2- 172.21.15.1:0/2876546632 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3d4c100b10 0x7f3d4c197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:23.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:23.120+0000 7f3d519fb640 1 -- 172.21.15.1:0/2876546632 >> 172.21.15.1:0/2876546632 conn(0x7f3d4c0fc2a0 msgr2=0x7f3d4c06a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:23.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:23.120+0000 7f3d519fb640 1 -- 172.21.15.1:0/2876546632 shutdown_connections 2024-09-19T09:35:23.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:23.120+0000 7f3d519fb640 1 -- 172.21.15.1:0/2876546632 wait complete. 2024-09-19T09:35:23.885 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":76,"num_osds":12,"num_up_osds":12,"osd_up_since":1726738521,"num_in_osds":12,"osd_in_since":1726738497,"num_remapped_pgs":0} 2024-09-19T09:35:23.885 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:35:24.137 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:24.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:24 smithi001 ceph-mon[31225]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:24.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:24 smithi001 ceph-mon[31225]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T09:35:24.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:24 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/2876546632' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:35:24.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:24 smithi022 ceph-mon[35583]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:24.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:24 smithi022 ceph-mon[35583]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T09:35:24.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:24 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/2876546632' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:35:24.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:24 smithi121 ceph-mon[35577]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:24.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:24 smithi121 ceph-mon[35577]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T09:35:24.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:24 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/2876546632' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T09:35:24.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.638+0000 7fb9c2d8f640 1 -- 172.21.15.1:0/3950767500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9bc102570 msgr2=0x7fb9bc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:24.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.638+0000 7fb9c2d8f640 1 --2- 172.21.15.1:0/3950767500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9bc102570 0x7fb9bc1029b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4009900 tx=0x7fb9a402a480 comp rx=0 tx=0).stop 2024-09-19T09:35:24.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.639+0000 7fb9c2d8f640 1 -- 172.21.15.1:0/3950767500 shutdown_connections 2024-09-19T09:35:24.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.639+0000 7fb9c2d8f640 1 --2- 172.21.15.1:0/3950767500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9bc102ef0 0x7fb9bc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:24.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.639+0000 7fb9c2d8f640 1 --2- 172.21.15.1:0/3950767500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9bc102570 0x7fb9bc1029b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:24.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.639+0000 7fb9c2d8f640 1 --2- 172.21.15.1:0/3950767500 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9bc100e20 0x7fb9bc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:24.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.639+0000 7fb9c2d8f640 1 -- 172.21.15.1:0/3950767500 >> 172.21.15.1:0/3950767500 conn(0x7fb9bc0fc7d0 msgr2=0x7fb9bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:24.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.639+0000 7fb9c2d8f640 1 -- 172.21.15.1:0/3950767500 shutdown_connections 2024-09-19T09:35:24.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.639+0000 7fb9c2d8f640 1 -- 172.21.15.1:0/3950767500 wait complete. 2024-09-19T09:35:24.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.639+0000 7fb9c2d8f640 1 Processor -- start 2024-09-19T09:35:24.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.639+0000 7fb9c2d8f640 1 -- start start 2024-09-19T09:35:24.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.639+0000 7fb9c2d8f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9bc100e20 0x7fb9bc198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:24.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.639+0000 7fb9c2d8f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9bc102570 0x7fb9bc198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:24.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.639+0000 7fb9c2d8f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9bc102ef0 0x7fb9bc19cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:24.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.640+0000 7fb9c2d8f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc112120 con 0x7fb9bc102570 2024-09-19T09:35:24.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.640+0000 7fb9c2d8f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc111fa0 con 0x7fb9bc100e20 2024-09-19T09:35:24.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.640+0000 7fb9c2d8f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc1122a0 con 0x7fb9bc102ef0 2024-09-19T09:35:24.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.640+0000 7fb9bbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9bc102570 0x7fb9bc198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:24.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.640+0000 7fb9bbfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9bc102570 0x7fb9bc198b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51122/0 (socket says 172.21.15.1:51122) 2024-09-19T09:35:24.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.640+0000 7fb9bbfff640 1 -- 172.21.15.1:0/1525407805 learned_addr learned my addr 172.21.15.1:0/1525407805 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:35:24.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.640+0000 7fb9c0b2b640 1 --2- 172.21.15.1:0/1525407805 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9bc100e20 0x7fb9bc198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:24.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.640+0000 7fb9c132c640 1 --2- 172.21.15.1:0/1525407805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9bc102ef0 0x7fb9bc19cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:24.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.640+0000 7fb9bbfff640 1 -- 172.21.15.1:0/1525407805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9bc102ef0 msgr2=0x7fb9bc19cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:24.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.640+0000 7fb9bbfff640 1 --2- 172.21.15.1:0/1525407805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9bc102ef0 0x7fb9bc19cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:24.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.640+0000 7fb9bbfff640 1 -- 172.21.15.1:0/1525407805 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9bc100e20 msgr2=0x7fb9bc198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:24.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.640+0000 7fb9bbfff640 1 --2- 172.21.15.1:0/1525407805 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9bc100e20 0x7fb9bc198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:24.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.640+0000 7fb9bbfff640 1 -- 172.21.15.1:0/1525407805 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9bc19d5f0 con 0x7fb9bc102570 2024-09-19T09:35:24.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.640+0000 7fb9c0b2b640 1 --2- 172.21.15.1:0/1525407805 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9bc100e20 0x7fb9bc198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:35:24.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.640+0000 7fb9bbfff640 1 --2- 172.21.15.1:0/1525407805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9bc102570 0x7fb9bc198b80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4006010 tx=0x7fb9a4003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:24.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.640+0000 7fb9b9ffb640 1 -- 172.21.15.1:0/1525407805 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a403f070 con 0x7fb9bc102570 2024-09-19T09:35:24.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.640+0000 7fb9b9ffb640 1 -- 172.21.15.1:0/1525407805 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9a4031e30 con 0x7fb9bc102570 2024-09-19T09:35:24.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.640+0000 7fb9c2d8f640 1 -- 172.21.15.1:0/1525407805 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9bc19d880 con 0x7fb9bc102570 2024-09-19T09:35:24.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.640+0000 7fb9b9ffb640 1 -- 172.21.15.1:0/1525407805 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a4035030 con 0x7fb9bc102570 2024-09-19T09:35:24.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.641+0000 7fb9c2d8f640 1 -- 172.21.15.1:0/1525407805 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9bc1a51c0 con 0x7fb9bc102570 2024-09-19T09:35:24.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.641+0000 7fb9c2d8f640 1 -- 172.21.15.1:0/1525407805 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9bc101280 con 0x7fb9bc102570 2024-09-19T09:35:24.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.643+0000 7fb9b9ffb640 1 -- 172.21.15.1:0/1525407805 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fb9a4042070 con 0x7fb9bc102570 2024-09-19T09:35:24.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.644+0000 7fb9b9ffb640 1 --2- 172.21.15.1:0/1525407805 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb9a80a3240 0x7fb9a80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:24.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.644+0000 7fb9c0b2b640 1 --2- 172.21.15.1:0/1525407805 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb9a80a3240 0x7fb9a80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:24.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.644+0000 7fb9b9ffb640 1 -- 172.21.15.1:0/1525407805 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fb9a40f0500 con 0x7fb9bc102570 2024-09-19T09:35:24.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.644+0000 7fb9c0b2b640 1 --2- 172.21.15.1:0/1525407805 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb9a80a3240 0x7fb9a80a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac009930 tx=0x7fb9ac008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:24.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.647+0000 7fb9b9ffb640 1 -- 172.21.15.1:0/1525407805 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb9a40bd6b0 con 0x7fb9bc102570 2024-09-19T09:35:24.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.825+0000 7fb9c2d8f640 1 -- 172.21.15.1:0/1525407805 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9bc109090 con 0x7fb9bc102570 2024-09-19T09:35:24.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.826+0000 7fb9b9ffb640 1 -- 172.21.15.1:0/1525407805 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+18376 (secure 0 0 0) 0x7fb9a40bcfb0 con 0x7fb9bc102570 2024-09-19T09:35:24.828 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:35:24.828 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":76,"fsid":"57238232-7669-11ef-bceb-c7b262605968","created":"2024-09-19T09:28:28.406983+0000","modified":"2024-09-19T09:35:23.022459+0000","last_up_change":"2024-09-19T09:35:21.422825+0000","last_in_change":"2024-09-19T09:34:57.199184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:31:30.566509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c165571d-43f1-4c43-ba1e-35872d914f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6803","nonce":502676986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6805","nonce":502676986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6809","nonce":502676986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6807","nonce":502676986}]},"public_addr":"172.21.15.1:6803/502676986","cluster_addr":"172.21.15.1:6805/502676986","heartbeat_back_addr":"172.21.15.1:6809/502676986","heartbeat_front_addr":"172.21.15.1:6807/502676986","state":["exists","up"]},{"osd":1,"uuid":"baf120f8-8ba3-4aa5-a12a-41cdc97ff11b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6801","nonce":3735826323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6803","nonce":3735826323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6807","nonce":3735826323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6805","nonce":3735826323}]},"public_addr":"172.21.15.22:6801/3735826323","cluster_addr":"172.21.15.22:6803/3735826323","heartbeat_back_addr":"172.21.15.22:6807/3735826323","heartbeat_front_addr":"172.21.15.22:6805/3735826323","state":["exists","up"]},{"osd":2,"uuid":"72c520bf-c5cc-44ee-a38c-c9bac0a6280b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6801","nonce":1924970833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6803","nonce":1924970833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6807","nonce":1924970833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6805","nonce":1924970833}]},"public_addr":"172.21.15.121:6801/1924970833","cluster_addr":"172.21.15.121:6803/1924970833","heartbeat_back_addr":"172.21.15.121:6807/1924970833","heartbeat_front_addr":"172.21.15.121:6805/1924970833","state":["exists","up"]},{"osd":3,"uuid":"adad6d17-16d9-4c43-b581-35ac1bb9d807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6811","nonce":1515009793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6813","nonce":1515009793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6817","nonce":1515009793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6815","nonce":1515009793}]},"public_addr":"172.21.15.1:6811/1515009793","cluster_addr":"172.21.15.1:6813/1515009793","heartbeat_back_addr":"172.21.15.1:6817/1515009793","heartbeat_front_addr":"172.21.15.1:6815/1515009793","state":["exists","up"]},{"osd":4,"uuid":"8fb06efe-c3a0-48a3-9730-3e8f3e60922d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6809","nonce":923697266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6811","nonce":923697266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6815","nonce":923697266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6813","nonce":923697266}]},"public_addr":"172.21.15.22:6809/923697266","cluster_addr":"172.21.15.22:6811/923697266","heartbeat_back_addr":"172.21.15.22:6815/923697266","heartbeat_front_addr":"172.21.15.22:6813/923697266","state":["exists","up"]},{"osd":5,"uuid":"3b2f428c-8a5a-49be-9f43-a9f379a1c7e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6809","nonce":3137245658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6811","nonce":3137245658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6815","nonce":3137245658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6813","nonce":3137245658}]},"public_addr":"172.21.15.121:6809/3137245658","cluster_addr":"172.21.15.121:6811/3137245658","heartbeat_back_addr":"172.21.15.121:6815/3137245658","heartbeat_front_addr":"172.21.15.121:6813/3137245658","state":["exists","up"]},{"osd":6,"uuid":"5aecec68-ff7e-440c-bd39-cc35ab89cc91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6819","nonce":3376780798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6821","nonce":3376780798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6825","nonce":3376780798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6823","nonce":3376780798}]},"public_addr":"172.21.15.1:6819/3376780798","cluster_addr":"172.21.15.1:6821/3376780798","heartbeat_back_addr":"172.21.15.1:6825/3376780798","heartbeat_front_addr":"172.21.15.1:6823/3376780798","state":["exists","up"]},{"osd":7,"uuid":"46556bdf-199e-4268-873b-6d87b54e1176","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6817","nonce":2920985295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6819","nonce":2920985295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6823","nonce":2920985295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6821","nonce":2920985295}]},"public_addr":"172.21.15.22:6817/2920985295","cluster_addr":"172.21.15.22:6819/2920985295","heartbeat_back_addr":"172.21.15.22:6823/2920985295","heartbeat_front_addr":"172.21.15.22:6821/2920985295","state":["exists","up"]},{"osd":8,"uuid":"e7c3792a-94a4-4440-be74-d6abdf3d9566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6817","nonce":3589985967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6819","nonce":3589985967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6823","nonce":3589985967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6821","nonce":3589985967}]},"public_addr":"172.21.15.121:6817/3589985967","cluster_addr":"172.21.15.121:6819/3589985967","heartbeat_back_addr":"172.21.15.121:6823/3589985967","heartbeat_front_addr":"172.21.15.121:6821/3589985967","state":["exists","up"]},{"osd":9,"uuid":"8af80ac9-d681-4966-b083-ead5185eff12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6827","nonce":1143859822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6829","nonce":1143859822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6833","nonce":1143859822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6831","nonce":1143859822}]},"public_addr":"172.21.15.1:6827/1143859822","cluster_addr":"172.21.15.1:6829/1143859822","heartbeat_back_addr":"172.21.15.1:6833/1143859822","heartbeat_front_addr":"172.21.15.1:6831/1143859822","state":["exists","up"]},{"osd":10,"uuid":"34edd06a-7f60-4465-bfe1-0c646abd53f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6825","nonce":343155547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6827","nonce":343155547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6831","nonce":343155547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6829","nonce":343155547}]},"public_addr":"172.21.15.22:6825/343155547","cluster_addr":"172.21.15.22:6827/343155547","heartbeat_back_addr":"172.21.15.22:6831/343155547","heartbeat_front_addr":"172.21.15.22:6829/343155547","state":["exists","up"]},{"osd":11,"uuid":"5a831eb6-ad66-4ab6-a30a-b6299ce1f88d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6825","nonce":3202514460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6827","nonce":3202514460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6831","nonce":3202514460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6829","nonce":3202514460}]},"public_addr":"172.21.15.121:6825/3202514460","cluster_addr":"172.21.15.121:6827/3202514460","heartbeat_back_addr":"172.21.15.121:6831/3202514460","heartbeat_front_addr":"172.21.15.121:6829/3202514460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:30:37.582893+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:01.915252+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:26.783477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:53.407014+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:19.407005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:45.022320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:11.377986+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:36.818700+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:01.745428+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:27.928916+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:53.363906+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:19.037551+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6800/1028873727":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/3137949087":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/1951370933":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2008363642":"2024-09-20T09:28:50.074985+0000","172.21.15.1:0/3006931063":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2486161758":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6801/1296304385":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6801/1028873727":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2783823049":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6800/1296304385":"2024-09-20T09:28:50.074985+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:35:24.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.828+0000 7fb9c2d8f640 1 -- 172.21.15.1:0/1525407805 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb9a80a3240 msgr2=0x7fb9a80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:24.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.828+0000 7fb9c2d8f640 1 --2- 172.21.15.1:0/1525407805 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb9a80a3240 0x7fb9a80a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac009930 tx=0x7fb9ac008040 comp rx=0 tx=0).stop 2024-09-19T09:35:24.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.828+0000 7fb9c2d8f640 1 -- 172.21.15.1:0/1525407805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9bc102570 msgr2=0x7fb9bc198b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:24.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.828+0000 7fb9c2d8f640 1 --2- 172.21.15.1:0/1525407805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9bc102570 0x7fb9bc198b80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4006010 tx=0x7fb9a4003c80 comp rx=0 tx=0).stop 2024-09-19T09:35:24.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.829+0000 7fb9c2d8f640 1 -- 172.21.15.1:0/1525407805 shutdown_connections 2024-09-19T09:35:24.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.829+0000 7fb9c2d8f640 1 --2- 172.21.15.1:0/1525407805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb9bc102ef0 0x7fb9bc19cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:24.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.829+0000 7fb9c2d8f640 1 --2- 172.21.15.1:0/1525407805 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb9bc102570 0x7fb9bc198b80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:24.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.829+0000 7fb9c2d8f640 1 --2- 172.21.15.1:0/1525407805 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb9a80a3240 0x7fb9a80a5700 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:24.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.829+0000 7fb9c2d8f640 1 --2- 172.21.15.1:0/1525407805 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9bc100e20 0x7fb9bc198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:24.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.829+0000 7fb9c2d8f640 1 -- 172.21.15.1:0/1525407805 >> 172.21.15.1:0/1525407805 conn(0x7fb9bc0fc7d0 msgr2=0x7fb9bc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:24.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.829+0000 7fb9c2d8f640 1 -- 172.21.15.1:0/1525407805 shutdown_connections 2024-09-19T09:35:24.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:24.829+0000 7fb9c2d8f640 1 -- 172.21.15.1:0/1525407805 wait complete. 2024-09-19T09:35:25.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:25 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1525407805' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:35:25.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:25 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1525407805' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:35:25.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:25 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1525407805' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:35:25.574 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T09:31:30.566509+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T09:35:25.575 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-19T09:35:25.829 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:26.203 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:26 smithi001 ceph-mon[31225]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:26.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.286+0000 7fd5c9bb1640 1 -- 172.21.15.1:0/1526214965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5c4101420 msgr2=0x7fd5c410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:26.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.286+0000 7fd5c9bb1640 1 --2- 172.21.15.1:0/1526214965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5c4101420 0x7fd5c410d950 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc009cd0 tx=0x7fd5bc02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:35:26.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.286+0000 7fd5c9bb1640 1 -- 172.21.15.1:0/1526214965 shutdown_connections 2024-09-19T09:35:26.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.286+0000 7fd5c9bb1640 1 --2- 172.21.15.1:0/1526214965 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5c4101420 0x7fd5c410d950 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:26.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.286+0000 7fd5c9bb1640 1 --2- 172.21.15.1:0/1526214965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5c4100a80 0x7fd5c4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:26.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.286+0000 7fd5c9bb1640 1 --2- 172.21.15.1:0/1526214965 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5c4106a80 0x7fd5c4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:26.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.286+0000 7fd5c9bb1640 1 -- 172.21.15.1:0/1526214965 >> 172.21.15.1:0/1526214965 conn(0x7fd5c40fc7a0 msgr2=0x7fd5c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:26.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.286+0000 7fd5c9bb1640 1 -- 172.21.15.1:0/1526214965 shutdown_connections 2024-09-19T09:35:26.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.286+0000 7fd5c9bb1640 1 -- 172.21.15.1:0/1526214965 wait complete. 2024-09-19T09:35:26.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.286+0000 7fd5c9bb1640 1 Processor -- start 2024-09-19T09:35:26.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.287+0000 7fd5c9bb1640 1 -- start start 2024-09-19T09:35:26.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.287+0000 7fd5c9bb1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5c4100a80 0x7fd5c4198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:26.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.287+0000 7fd5c9bb1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5c4101420 0x7fd5c4198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:26.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.287+0000 7fd5c9bb1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5c4106a80 0x7fd5c419ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:26.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.287+0000 7fd5c9bb1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c4110e80 con 0x7fd5c4101420 2024-09-19T09:35:26.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.287+0000 7fd5c9bb1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c4110d00 con 0x7fd5c4100a80 2024-09-19T09:35:26.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.287+0000 7fd5c9bb1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c4111000 con 0x7fd5c4106a80 2024-09-19T09:35:26.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.287+0000 7fd5c2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5c4101420 0x7fd5c4198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:26.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.287+0000 7fd5c2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5c4101420 0x7fd5c4198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50558/0 (socket says 172.21.15.1:50558) 2024-09-19T09:35:26.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.287+0000 7fd5c2ffd640 1 -- 172.21.15.1:0/585163884 learned_addr learned my addr 172.21.15.1:0/585163884 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:35:26.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.287+0000 7fd5c3fff640 1 --2- 172.21.15.1:0/585163884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5c4106a80 0x7fd5c419ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:26.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.287+0000 7fd5c37fe640 1 --2- 172.21.15.1:0/585163884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5c4100a80 0x7fd5c4198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:26.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.287+0000 7fd5c2ffd640 1 -- 172.21.15.1:0/585163884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5c4106a80 msgr2=0x7fd5c419ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:26.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.287+0000 7fd5c2ffd640 1 --2- 172.21.15.1:0/585163884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5c4106a80 0x7fd5c419ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:26.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.287+0000 7fd5c2ffd640 1 -- 172.21.15.1:0/585163884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5c4100a80 msgr2=0x7fd5c4198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:26.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.287+0000 7fd5c2ffd640 1 --2- 172.21.15.1:0/585163884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5c4100a80 0x7fd5c4198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:26.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.287+0000 7fd5c2ffd640 1 -- 172.21.15.1:0/585163884 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5c419d3d0 con 0x7fd5c4101420 2024-09-19T09:35:26.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.287+0000 7fd5c37fe640 1 --2- 172.21.15.1:0/585163884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5c4100a80 0x7fd5c4198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:26.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.287+0000 7fd5c2ffd640 1 --2- 172.21.15.1:0/585163884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5c4101420 0x7fd5c4198960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd5b800c890 tx=0x7fd5b800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:26.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.288+0000 7fd5c0ff9640 1 -- 172.21.15.1:0/585163884 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b8004220 con 0x7fd5c4101420 2024-09-19T09:35:26.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.288+0000 7fd5c9bb1640 1 -- 172.21.15.1:0/585163884 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5c419d6c0 con 0x7fd5c4101420 2024-09-19T09:35:26.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.288+0000 7fd5c0ff9640 1 -- 172.21.15.1:0/585163884 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5b80043c0 con 0x7fd5c4101420 2024-09-19T09:35:26.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.288+0000 7fd5c0ff9640 1 -- 172.21.15.1:0/585163884 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b80049e0 con 0x7fd5c4101420 2024-09-19T09:35:26.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.288+0000 7fd5c9bb1640 1 -- 172.21.15.1:0/585163884 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5c41a4fa0 con 0x7fd5c4101420 2024-09-19T09:35:26.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.289+0000 7fd5c9bb1640 1 -- 172.21.15.1:0/585163884 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5c4100ee0 con 0x7fd5c4101420 2024-09-19T09:35:26.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.290+0000 7fd5c0ff9640 1 -- 172.21.15.1:0/585163884 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fd5b80079b0 con 0x7fd5c4101420 2024-09-19T09:35:26.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.290+0000 7fd5c0ff9640 1 --2- 172.21.15.1:0/585163884 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd5ac0a3240 0x7fd5ac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:26.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.291+0000 7fd5c0ff9640 1 -- 172.21.15.1:0/585163884 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fd5b80cf4d0 con 0x7fd5c4101420 2024-09-19T09:35:26.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.291+0000 7fd5c37fe640 1 --2- 172.21.15.1:0/585163884 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd5ac0a3240 0x7fd5ac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:26.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.291+0000 7fd5c37fe640 1 --2- 172.21.15.1:0/585163884 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd5ac0a3240 0x7fd5ac0a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4005fd0 tx=0x7fd5b40094d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:26.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.295+0000 7fd5c0ff9640 1 -- 172.21.15.1:0/585163884 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd5b8014030 con 0x7fd5c4101420 2024-09-19T09:35:26.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:26 smithi022 ceph-mon[35583]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:26.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:26 smithi121 ceph-mon[35577]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:26.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.468+0000 7fd5c9bb1640 1 -- 172.21.15.1:0/585163884 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd5c402d7c0 con 0x7fd5c4101420 2024-09-19T09:35:26.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.468+0000 7fd5c0ff9640 1 -- 172.21.15.1:0/585163884 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) ==== 93+0+10 (secure 0 0 0) 0x7fd5b809c690 con 0x7fd5c4101420 2024-09-19T09:35:26.470 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2024-09-19T09:35:26.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.471+0000 7fd5c9bb1640 1 -- 172.21.15.1:0/585163884 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd5ac0a3240 msgr2=0x7fd5ac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:26.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.471+0000 7fd5c9bb1640 1 --2- 172.21.15.1:0/585163884 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd5ac0a3240 0x7fd5ac0a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4005fd0 tx=0x7fd5b40094d0 comp rx=0 tx=0).stop 2024-09-19T09:35:26.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.471+0000 7fd5c9bb1640 1 -- 172.21.15.1:0/585163884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5c4101420 msgr2=0x7fd5c4198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:26.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.471+0000 7fd5c9bb1640 1 --2- 172.21.15.1:0/585163884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5c4101420 0x7fd5c4198960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd5b800c890 tx=0x7fd5b800cd50 comp rx=0 tx=0).stop 2024-09-19T09:35:26.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.471+0000 7fd5c9bb1640 1 -- 172.21.15.1:0/585163884 shutdown_connections 2024-09-19T09:35:26.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.471+0000 7fd5c9bb1640 1 --2- 172.21.15.1:0/585163884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd5c4106a80 0x7fd5c419ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:26.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.471+0000 7fd5c9bb1640 1 --2- 172.21.15.1:0/585163884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5c4101420 0x7fd5c4198960 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:26.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.471+0000 7fd5c9bb1640 1 --2- 172.21.15.1:0/585163884 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd5ac0a3240 0x7fd5ac0a5700 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:26.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.471+0000 7fd5c9bb1640 1 --2- 172.21.15.1:0/585163884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5c4100a80 0x7fd5c4198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:26.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.471+0000 7fd5c9bb1640 1 -- 172.21.15.1:0/585163884 >> 172.21.15.1:0/585163884 conn(0x7fd5c40fc7a0 msgr2=0x7fd5c406aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:26.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.471+0000 7fd5c9bb1640 1 -- 172.21.15.1:0/585163884 shutdown_connections 2024-09-19T09:35:26.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:26.471+0000 7fd5c9bb1640 1 -- 172.21.15.1:0/585163884 wait complete. 2024-09-19T09:35:27.141 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:27 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/585163884' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:35:27.177 INFO:tasks.cephadm:Adding mds.a on smithi001 2024-09-19T09:35:27.177 INFO:tasks.cephadm:Adding mds.d on smithi001 2024-09-19T09:35:27.177 INFO:tasks.cephadm:Adding mds.g on smithi001 2024-09-19T09:35:27.177 INFO:tasks.cephadm:Adding mds.j on smithi001 2024-09-19T09:35:27.177 INFO:tasks.cephadm:Adding mds.b on smithi022 2024-09-19T09:35:27.177 INFO:tasks.cephadm:Adding mds.e on smithi022 2024-09-19T09:35:27.177 INFO:tasks.cephadm:Adding mds.h on smithi022 2024-09-19T09:35:27.177 INFO:tasks.cephadm:Adding mds.k on smithi022 2024-09-19T09:35:27.177 INFO:tasks.cephadm:Adding mds.c on smithi121 2024-09-19T09:35:27.178 INFO:tasks.cephadm:Adding mds.f on smithi121 2024-09-19T09:35:27.178 INFO:tasks.cephadm:Adding mds.i on smithi121 2024-09-19T09:35:27.178 INFO:tasks.cephadm:Adding mds.l on smithi121 2024-09-19T09:35:27.178 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi022=b;smithi022=e;smithi022=h;smithi022=k;smithi121=c;smithi121=f;smithi121=i;smithi121=l' 2024-09-19T09:35:27.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:27 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/585163884' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:35:27.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:27 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/585163884' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:35:27.422 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:35:27.937 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.919+0000 7f6ab1863640 1 -- 172.21.15.121:0/3479000081 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6aac102e00 msgr2=0x7f6aac103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:27.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.919+0000 7f6ab1863640 1 --2- 172.21.15.121:0/3479000081 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6aac102e00 0x7f6aac103280 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0009900 tx=0x7f6aa002a410 comp rx=0 tx=0).stop 2024-09-19T09:35:27.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.919+0000 7f6ab1863640 1 -- 172.21.15.121:0/3479000081 shutdown_connections 2024-09-19T09:35:27.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.919+0000 7f6ab1863640 1 --2- 172.21.15.121:0/3479000081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6aac1037c0 0x7f6aac10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:27.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.919+0000 7f6ab1863640 1 --2- 172.21.15.121:0/3479000081 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6aac102e00 0x7f6aac103280 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:27.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.919+0000 7f6ab1863640 1 --2- 172.21.15.121:0/3479000081 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6aac101c00 0x7f6aac102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:27.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.919+0000 7f6ab1863640 1 -- 172.21.15.121:0/3479000081 >> 172.21.15.121:0/3479000081 conn(0x7f6aac0fd390 msgr2=0x7f6aac0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:27.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.919+0000 7f6ab1863640 1 -- 172.21.15.121:0/3479000081 shutdown_connections 2024-09-19T09:35:27.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.919+0000 7f6ab1863640 1 -- 172.21.15.121:0/3479000081 wait complete. 2024-09-19T09:35:27.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.919+0000 7f6ab1863640 1 Processor -- start 2024-09-19T09:35:27.938 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.920+0000 7f6ab1863640 1 -- start start 2024-09-19T09:35:27.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.920+0000 7f6ab1863640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6aac101c00 0x7f6aac198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:27.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.920+0000 7f6ab1863640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6aac102e00 0x7f6aac1985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:27.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.920+0000 7f6ab1863640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6aac1037c0 0x7f6aac19f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:27.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.920+0000 7f6ab1863640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6aac10d9d0 con 0x7f6aac102e00 2024-09-19T09:35:27.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.920+0000 7f6ab1863640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6aac10d850 con 0x7f6aac101c00 2024-09-19T09:35:27.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.920+0000 7f6ab1863640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6aac10db50 con 0x7f6aac1037c0 2024-09-19T09:35:27.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.920+0000 7f6aab7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6aac1037c0 0x7f6aac19f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:27.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.920+0000 7f6aab7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6aac1037c0 0x7f6aac19f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55928/0 (socket says 172.21.15.121:55928) 2024-09-19T09:35:27.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.920+0000 7f6aab7fe640 1 -- 172.21.15.121:0/1833383530 learned_addr learned my addr 172.21.15.121:0/1833383530 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-19T09:35:27.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.920+0000 7f6aaa7fc640 1 --2- 172.21.15.121:0/1833383530 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6aac102e00 0x7f6aac1985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:27.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.920+0000 7f6aaaffd640 1 --2- 172.21.15.121:0/1833383530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6aac101c00 0x7f6aac198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:27.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.920+0000 7f6aab7fe640 1 -- 172.21.15.121:0/1833383530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6aac101c00 msgr2=0x7f6aac198090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:27.939 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.920+0000 7f6aab7fe640 1 --2- 172.21.15.121:0/1833383530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6aac101c00 0x7f6aac198090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:27.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.920+0000 7f6aab7fe640 1 -- 172.21.15.121:0/1833383530 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6aac102e00 msgr2=0x7f6aac1985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:27.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.920+0000 7f6aab7fe640 1 --2- 172.21.15.121:0/1833383530 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6aac102e00 0x7f6aac1985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:27.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.920+0000 7f6aab7fe640 1 -- 172.21.15.121:0/1833383530 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aac19fcc0 con 0x7f6aac1037c0 2024-09-19T09:35:27.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.920+0000 7f6aaa7fc640 1 --2- 172.21.15.121:0/1833383530 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6aac102e00 0x7f6aac1985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:35:27.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.920+0000 7f6aaaffd640 1 --2- 172.21.15.121:0/1833383530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6aac101c00 0x7f6aac198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:27.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.920+0000 7f6aab7fe640 1 --2- 172.21.15.121:0/1833383530 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6aac1037c0 0x7f6aac19f650 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6aa400b970 tx=0x7f6aa400be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:27.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.921+0000 7f6ab0861640 1 -- 172.21.15.121:0/1833383530 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4019070 con 0x7f6aac1037c0 2024-09-19T09:35:27.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.921+0000 7f6ab1863640 1 -- 172.21.15.121:0/1833383530 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6aac19ffb0 con 0x7f6aac1037c0 2024-09-19T09:35:27.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.921+0000 7f6ab0861640 1 -- 172.21.15.121:0/1833383530 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6aa400cb40 con 0x7f6aac1037c0 2024-09-19T09:35:27.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.921+0000 7f6ab0861640 1 -- 172.21.15.121:0/1833383530 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4007610 con 0x7f6aac1037c0 2024-09-19T09:35:27.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.921+0000 7f6ab1863640 1 -- 172.21.15.121:0/1833383530 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6aac1a0530 con 0x7f6aac1037c0 2024-09-19T09:35:27.940 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.922+0000 7f6ab1863640 1 -- 172.21.15.121:0/1833383530 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6aac1090a0 con 0x7f6aac1037c0 2024-09-19T09:35:27.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.923+0000 7f6ab0861640 1 -- 172.21.15.121:0/1833383530 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f6aa401c070 con 0x7f6aac1037c0 2024-09-19T09:35:27.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.923+0000 7f6ab0861640 1 --2- 172.21.15.121:0/1833383530 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f6a940a3270 0x7f6a940a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:27.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.924+0000 7f6ab0861640 1 -- 172.21.15.121:0/1833383530 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f6aa40cef40 con 0x7f6aac1037c0 2024-09-19T09:35:27.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.924+0000 7f6aaaffd640 1 --2- 172.21.15.121:0/1833383530 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f6a940a3270 0x7f6a940a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:27.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.924+0000 7f6aaaffd640 1 --2- 172.21.15.121:0/1833383530 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f6a940a3270 0x7f6a940a5730 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c006fd0 tx=0x7f6a9c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:27.941 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:27.927+0000 7f6ab0861640 1 -- 172.21.15.121:0/1833383530 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6aa409c0e0 con 0x7f6aac1037c0 2024-09-19T09:35:28.108 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:28.106+0000 7f6ab1863640 1 -- 172.21.15.121:0/1833383530 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi022=b;smithi022=e;smithi022=h;smithi022=k;smithi121=c;smithi121=f;smithi121=i;smithi121=l", "target": ["mon-mgr", ""]}) -- 0x7f6aac062730 con 0x7f6a940a3270 2024-09-19T09:35:28.109 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:28 smithi121 ceph-mon[35577]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:28.115 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:28.113+0000 7f6ab0861640 1 -- 172.21.15.121:0/1833383530 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f6aac062730 con 0x7f6a940a3270 2024-09-19T09:35:28.116 INFO:teuthology.orchestra.run.smithi121.stdout:Scheduled mds.all update... 2024-09-19T09:35:28.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:28.115+0000 7f6ab1863640 1 -- 172.21.15.121:0/1833383530 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f6a940a3270 msgr2=0x7f6a940a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:28.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:28.115+0000 7f6ab1863640 1 --2- 172.21.15.121:0/1833383530 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f6a940a3270 0x7f6a940a5730 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c006fd0 tx=0x7f6a9c008040 comp rx=0 tx=0).stop 2024-09-19T09:35:28.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:28.115+0000 7f6ab1863640 1 -- 172.21.15.121:0/1833383530 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6aac1037c0 msgr2=0x7f6aac19f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:28.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:28.115+0000 7f6ab1863640 1 --2- 172.21.15.121:0/1833383530 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6aac1037c0 0x7f6aac19f650 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6aa400b970 tx=0x7f6aa400be30 comp rx=0 tx=0).stop 2024-09-19T09:35:28.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:28.115+0000 7f6ab1863640 1 -- 172.21.15.121:0/1833383530 shutdown_connections 2024-09-19T09:35:28.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:28.115+0000 7f6ab1863640 1 --2- 172.21.15.121:0/1833383530 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6aac1037c0 0x7f6aac19f650 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:28.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:28.115+0000 7f6ab1863640 1 --2- 172.21.15.121:0/1833383530 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6aac102e00 0x7f6aac1985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:28.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:28.115+0000 7f6ab1863640 1 --2- 172.21.15.121:0/1833383530 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f6a940a3270 0x7f6a940a5730 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:28.118 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:28.115+0000 7f6ab1863640 1 --2- 172.21.15.121:0/1833383530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6aac101c00 0x7f6aac198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:28.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:28.115+0000 7f6ab1863640 1 -- 172.21.15.121:0/1833383530 >> 172.21.15.121:0/1833383530 conn(0x7f6aac0fd390 msgr2=0x7f6aac106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:28.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:28.116+0000 7f6ab1863640 1 -- 172.21.15.121:0/1833383530 shutdown_connections 2024-09-19T09:35:28.119 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-19T09:35:28.116+0000 7f6ab1863640 1 -- 172.21.15.121:0/1833383530 wait complete. 2024-09-19T09:35:28.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:28 smithi022 ceph-mon[35583]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:28.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:28 smithi001 ceph-mon[31225]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:28.902 DEBUG:teuthology.orchestra.run.smithi001:mds.a> sudo journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mds.a.service 2024-09-19T09:35:28.919 DEBUG:teuthology.orchestra.run.smithi001:mds.d> sudo journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mds.d.service 2024-09-19T09:35:28.986 DEBUG:teuthology.orchestra.run.smithi001:mds.g> sudo journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mds.g.service 2024-09-19T09:35:29.038 DEBUG:teuthology.orchestra.run.smithi001:mds.j> sudo journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mds.j.service 2024-09-19T09:35:29.084 DEBUG:teuthology.orchestra.run.smithi022:mds.b> sudo journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mds.b.service 2024-09-19T09:35:29.087 DEBUG:teuthology.orchestra.run.smithi022:mds.e> sudo journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mds.e.service 2024-09-19T09:35:29.130 DEBUG:teuthology.orchestra.run.smithi022:mds.h> sudo journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mds.h.service 2024-09-19T09:35:29.174 DEBUG:teuthology.orchestra.run.smithi022:mds.k> sudo journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mds.k.service 2024-09-19T09:35:29.218 DEBUG:teuthology.orchestra.run.smithi121:mds.c> sudo journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mds.c.service 2024-09-19T09:35:29.220 DEBUG:teuthology.orchestra.run.smithi121:mds.f> sudo journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mds.f.service 2024-09-19T09:35:29.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:29 smithi121 ceph-mon[35577]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi022=b;smithi022=e;smithi022=h;smithi022=k;smithi121=c;smithi121=f;smithi121=i;smithi121=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:35:29.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:29 smithi121 ceph-mon[35577]: Saving service mds.all spec with placement smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi022=b;smithi022=e;smithi022=h;smithi022=k;smithi121=c;smithi121=f;smithi121=i;smithi121=l;count:12 2024-09-19T09:35:29.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:29 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:29.230 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:29 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:35:29.231 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:29 smithi121 ceph-mon[35577]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:29.231 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:29 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:29.231 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:29 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:35:29.231 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:29 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:29.231 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:29 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:29.231 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:29 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:29.231 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:29 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:29.231 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:29 smithi121 ceph-mon[35577]: Deploying daemon mds.l on smithi121 2024-09-19T09:35:29.232 DEBUG:teuthology.orchestra.run.smithi121:mds.i> sudo journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mds.i.service 2024-09-19T09:35:29.274 DEBUG:teuthology.orchestra.run.smithi121:mds.l> sudo journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mds.l.service 2024-09-19T09:35:29.317 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-19T09:35:29.317 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:35:29.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:29 smithi022 ceph-mon[35583]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi022=b;smithi022=e;smithi022=h;smithi022=k;smithi121=c;smithi121=f;smithi121=i;smithi121=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:35:29.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:29 smithi022 ceph-mon[35583]: Saving service mds.all spec with placement smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi022=b;smithi022=e;smithi022=h;smithi022=k;smithi121=c;smithi121=f;smithi121=i;smithi121=l;count:12 2024-09-19T09:35:29.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:29 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:29.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:29 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:35:29.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:29 smithi022 ceph-mon[35583]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:29.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:29 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:29.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:29 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:35:29.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:29 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:29.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:29 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:29.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:29 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:29.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:29 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:29.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:29 smithi022 ceph-mon[35583]: Deploying daemon mds.l on smithi121 2024-09-19T09:35:29.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:29 smithi001 ceph-mon[31225]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi022=b;smithi022=e;smithi022=h;smithi022=k;smithi121=c;smithi121=f;smithi121=i;smithi121=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:35:29.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:29 smithi001 ceph-mon[31225]: Saving service mds.all spec with placement smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi022=b;smithi022=e;smithi022=h;smithi022=k;smithi121=c;smithi121=f;smithi121=i;smithi121=l;count:12 2024-09-19T09:35:29.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:29 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:29.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:29 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:35:29.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:29 smithi001 ceph-mon[31225]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:29.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:29 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:29.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:29 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:35:29.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:29 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:29.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:29 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:29.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:29 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:29.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:29 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:29.499 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:29 smithi001 ceph-mon[31225]: Deploying daemon mds.l on smithi121 2024-09-19T09:35:29.571 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:30.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.083+0000 7ff0c4c3d640 1 -- 172.21.15.1:0/2317081871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0c010c1a0 msgr2=0x7ff0c010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:30.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.083+0000 7ff0c4c3d640 1 --2- 172.21.15.1:0/2317081871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0c010c1a0 0x7ff0c010e610 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8009ca0 tx=0x7ff0b802a950 comp rx=0 tx=0).stop 2024-09-19T09:35:30.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.083+0000 7ff0c4c3d640 1 -- 172.21.15.1:0/2317081871 shutdown_connections 2024-09-19T09:35:30.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.083+0000 7ff0c4c3d640 1 --2- 172.21.15.1:0/2317081871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0c010c1a0 0x7ff0c010e610 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:30.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.083+0000 7ff0c4c3d640 1 --2- 172.21.15.1:0/2317081871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0c0103720 0x7ff0c010bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:30.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.083+0000 7ff0c4c3d640 1 --2- 172.21.15.1:0/2317081871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0c0102e00 0x7ff0c01031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:30.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.083+0000 7ff0c4c3d640 1 -- 172.21.15.1:0/2317081871 >> 172.21.15.1:0/2317081871 conn(0x7ff0c00fc7a0 msgr2=0x7ff0c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:30.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.083+0000 7ff0c4c3d640 1 -- 172.21.15.1:0/2317081871 shutdown_connections 2024-09-19T09:35:30.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.083+0000 7ff0c4c3d640 1 -- 172.21.15.1:0/2317081871 wait complete. 2024-09-19T09:35:30.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.084+0000 7ff0c4c3d640 1 Processor -- start 2024-09-19T09:35:30.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.084+0000 7ff0c4c3d640 1 -- start start 2024-09-19T09:35:30.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.084+0000 7ff0c4c3d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0c0102e00 0x7ff0c01983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:30.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.084+0000 7ff0c4c3d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0c0103720 0x7ff0c0198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:30.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.084+0000 7ff0c4c3d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0c010c1a0 0x7ff0c019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:30.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.084+0000 7ff0c4c3d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c0111f70 con 0x7ff0c010c1a0 2024-09-19T09:35:30.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.084+0000 7ff0c4c3d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c0111df0 con 0x7ff0c0102e00 2024-09-19T09:35:30.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.084+0000 7ff0c4c3d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c01120f0 con 0x7ff0c0103720 2024-09-19T09:35:30.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.084+0000 7ff0bed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0c010c1a0 0x7ff0c019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:30.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.085+0000 7ff0bed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0c010c1a0 0x7ff0c019ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50574/0 (socket says 172.21.15.1:50574) 2024-09-19T09:35:30.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.085+0000 7ff0bed9d640 1 -- 172.21.15.1:0/810818696 learned_addr learned my addr 172.21.15.1:0/810818696 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:35:30.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.085+0000 7ff0be59c640 1 --2- 172.21.15.1:0/810818696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0c0102e00 0x7ff0c01983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:30.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.085+0000 7ff0b5d9b640 1 --2- 172.21.15.1:0/810818696 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0c0103720 0x7ff0c0198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:30.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.085+0000 7ff0bed9d640 1 -- 172.21.15.1:0/810818696 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0c0103720 msgr2=0x7ff0c0198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:30.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.085+0000 7ff0bed9d640 1 --2- 172.21.15.1:0/810818696 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0c0103720 0x7ff0c0198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:30.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.085+0000 7ff0bed9d640 1 -- 172.21.15.1:0/810818696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0c0102e00 msgr2=0x7ff0c01983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:30.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.085+0000 7ff0bed9d640 1 --2- 172.21.15.1:0/810818696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0c0102e00 0x7ff0c01983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:30.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.085+0000 7ff0bed9d640 1 -- 172.21.15.1:0/810818696 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c019d3a0 con 0x7ff0c010c1a0 2024-09-19T09:35:30.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.085+0000 7ff0b5d9b640 1 --2- 172.21.15.1:0/810818696 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0c0103720 0x7ff0c0198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:30.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.085+0000 7ff0bed9d640 1 --2- 172.21.15.1:0/810818696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0c010c1a0 0x7ff0c019ccc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff0b802ae70 tx=0x7ff0b802f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:30.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.085+0000 7ff0b7fff640 1 -- 172.21.15.1:0/810818696 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8034040 con 0x7ff0c010c1a0 2024-09-19T09:35:30.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.085+0000 7ff0c4c3d640 1 -- 172.21.15.1:0/810818696 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0c019d630 con 0x7ff0c010c1a0 2024-09-19T09:35:30.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.085+0000 7ff0b7fff640 1 -- 172.21.15.1:0/810818696 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0b8030920 con 0x7ff0c010c1a0 2024-09-19T09:35:30.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.085+0000 7ff0b7fff640 1 -- 172.21.15.1:0/810818696 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8045480 con 0x7ff0c010c1a0 2024-09-19T09:35:30.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.085+0000 7ff0c4c3d640 1 -- 172.21.15.1:0/810818696 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0c01a4f70 con 0x7ff0c010c1a0 2024-09-19T09:35:30.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.086+0000 7ff0c4c3d640 1 -- 172.21.15.1:0/810818696 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0c006afb0 con 0x7ff0c010c1a0 2024-09-19T09:35:30.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.087+0000 7ff0b7fff640 1 -- 172.21.15.1:0/810818696 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7ff0b8037020 con 0x7ff0c010c1a0 2024-09-19T09:35:30.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.088+0000 7ff0b7fff640 1 --2- 172.21.15.1:0/810818696 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff0ac0a3240 0x7ff0ac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:30.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.088+0000 7ff0be59c640 1 --2- 172.21.15.1:0/810818696 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff0ac0a3240 0x7ff0ac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:30.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.088+0000 7ff0b7fff640 1 -- 172.21.15.1:0/810818696 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7ff0b80f0470 con 0x7ff0c010c1a0 2024-09-19T09:35:30.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.089+0000 7ff0be59c640 1 --2- 172.21.15.1:0/810818696 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff0ac0a3240 0x7ff0ac0a5700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0005fd0 tx=0x7ff0b000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:30.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.092+0000 7ff0b7fff640 1 -- 172.21.15.1:0/810818696 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff0b80bd590 con 0x7ff0c010c1a0 2024-09-19T09:35:30.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.307+0000 7ff0c4c3d640 1 -- 172.21.15.1:0/810818696 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0c0107280 con 0x7ff0c010c1a0 2024-09-19T09:35:30.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.308+0000 7ff0b7fff640 1 -- 172.21.15.1:0/810818696 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7ff0b80bce90 con 0x7ff0c010c1a0 2024-09-19T09:35:30.309 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:35:30.310 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":1,"btime":"2024-09-19T09:28:28:406821+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-19T09:35:30.310 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 1 2024-09-19T09:35:30.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.311+0000 7ff0c4c3d640 1 -- 172.21.15.1:0/810818696 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff0ac0a3240 msgr2=0x7ff0ac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:30.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.311+0000 7ff0c4c3d640 1 --2- 172.21.15.1:0/810818696 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff0ac0a3240 0x7ff0ac0a5700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0005fd0 tx=0x7ff0b000b390 comp rx=0 tx=0).stop 2024-09-19T09:35:30.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.311+0000 7ff0c4c3d640 1 -- 172.21.15.1:0/810818696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0c010c1a0 msgr2=0x7ff0c019ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:30.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.311+0000 7ff0c4c3d640 1 --2- 172.21.15.1:0/810818696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0c010c1a0 0x7ff0c019ccc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff0b802ae70 tx=0x7ff0b802f5b0 comp rx=0 tx=0).stop 2024-09-19T09:35:30.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.311+0000 7ff0c4c3d640 1 -- 172.21.15.1:0/810818696 shutdown_connections 2024-09-19T09:35:30.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.311+0000 7ff0c4c3d640 1 --2- 172.21.15.1:0/810818696 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff0c010c1a0 0x7ff0c019ccc0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:30.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.311+0000 7ff0c4c3d640 1 --2- 172.21.15.1:0/810818696 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0c0103720 0x7ff0c0198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:30.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.311+0000 7ff0c4c3d640 1 --2- 172.21.15.1:0/810818696 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff0ac0a3240 0x7ff0ac0a5700 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:30.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.311+0000 7ff0c4c3d640 1 --2- 172.21.15.1:0/810818696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0c0102e00 0x7ff0c01983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:30.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.311+0000 7ff0c4c3d640 1 -- 172.21.15.1:0/810818696 >> 172.21.15.1:0/810818696 conn(0x7ff0c00fc7a0 msgr2=0x7ff0c00fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:30.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.311+0000 7ff0c4c3d640 1 -- 172.21.15.1:0/810818696 shutdown_connections 2024-09-19T09:35:30.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:30.312+0000 7ff0c4c3d640 1 -- 172.21.15.1:0/810818696 wait complete. 2024-09-19T09:35:30.805 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 19 09:35:30 smithi121 systemd[1]: Starting Ceph mds.l for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:35:31.072 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 19 09:35:30 smithi121 podman[64265]: 2024-09-19 09:35:30.706750947 +0000 UTC m=+0.016009051 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:35:31.073 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 19 09:35:30 smithi121 podman[64265]: 2024-09-19 09:35:30.828093742 +0000 UTC m=+0.137351843 container create 77f3a4df8fad6945cdfc121dd39a18d595bb3e6a9a00bd51c3c09b828b8f6e7a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-l, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-19T09:35:31.073 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 19 09:35:31 smithi121 podman[64265]: 2024-09-19 09:35:31.071930951 +0000 UTC m=+0.381189056 container init 77f3a4df8fad6945cdfc121dd39a18d595bb3e6a9a00bd51c3c09b828b8f6e7a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-l, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-19T09:35:31.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:31 smithi121 ceph-mon[35577]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:31.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:31 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/810818696' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:31.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:31 smithi121 ceph-mon[35577]: mds.? [v2:172.21.15.121:6832/2706759319,v1:172.21.15.121:6833/2706759319] up:boot 2024-09-19T09:35:31.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:31 smithi121 ceph-mon[35577]: fsmap 1 up:standby 2024-09-19T09:35:31.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:31 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:35:31.367 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 19 09:35:31 smithi121 podman[64265]: 2024-09-19 09:35:31.074918459 +0000 UTC m=+0.384176561 container start 77f3a4df8fad6945cdfc121dd39a18d595bb3e6a9a00bd51c3c09b828b8f6e7a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-l, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T09:35:31.368 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 19 09:35:31 smithi121 ceph-mds[64284]: -- 172.21.15.121:0/3924291385 <== mon.1 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562ad1983860 con 0x562ad1960800 2024-09-19T09:35:31.368 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 19 09:35:31 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-l[64280]: starting mds.l at 2024-09-19T09:35:31.368 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 19 09:35:31 smithi121 bash[64265]: 77f3a4df8fad6945cdfc121dd39a18d595bb3e6a9a00bd51c3c09b828b8f6e7a 2024-09-19T09:35:31.368 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 19 09:35:31 smithi121 systemd[1]: Started Ceph mds.l for 57238232-7669-11ef-bceb-c7b262605968. 2024-09-19T09:35:31.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:31 smithi001 ceph-mon[31225]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:31.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:31 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/810818696' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:31.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:31 smithi001 ceph-mon[31225]: mds.? [v2:172.21.15.121:6832/2706759319,v1:172.21.15.121:6833/2706759319] up:boot 2024-09-19T09:35:31.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:31 smithi001 ceph-mon[31225]: fsmap 1 up:standby 2024-09-19T09:35:31.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:31 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:35:31.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:31 smithi022 ceph-mon[35583]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:31.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:31 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/810818696' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:31.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:31 smithi022 ceph-mon[35583]: mds.? [v2:172.21.15.121:6832/2706759319,v1:172.21.15.121:6833/2706759319] up:boot 2024-09-19T09:35:31.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:31 smithi022 ceph-mon[35583]: fsmap 1 up:standby 2024-09-19T09:35:31.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:31 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:35:32.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:32 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:32.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:32 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:32.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:32 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:32.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:32 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:32.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:32 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:32.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:32 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:32.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:32 smithi022 ceph-mon[35583]: Deploying daemon mds.k on smithi022 2024-09-19T09:35:32.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:32 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:32.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:32 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:32.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:32 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:32.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:32 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:32.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:32 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:32.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:32 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:32.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:32 smithi001 ceph-mon[31225]: Deploying daemon mds.k on smithi022 2024-09-19T09:35:32.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:32 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:32.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:32 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:32.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:32 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:32.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:32 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:32.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:32 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:32.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:32 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:32.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:32 smithi121 ceph-mon[35577]: Deploying daemon mds.k on smithi022 2024-09-19T09:35:33.104 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:35:33.371 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:33.493 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:33 smithi001 ceph-mon[31225]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:33.559 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:33 smithi022 ceph-mon[35583]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:33.560 INFO:journalctl@ceph.mds.k.smithi022.stdout:Sep 19 09:35:33 smithi022 systemd[1]: Starting Ceph mds.k for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:35:33.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:33 smithi121 ceph-mon[35577]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:33.822 INFO:journalctl@ceph.mds.k.smithi022.stdout:Sep 19 09:35:33 smithi022 podman[64397]: 2024-09-19 09:35:33.461194155 +0000 UTC m=+0.015865686 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:35:33.822 INFO:journalctl@ceph.mds.k.smithi022.stdout:Sep 19 09:35:33 smithi022 podman[64397]: 2024-09-19 09:35:33.576695561 +0000 UTC m=+0.131367079 container create 7e839c0b40c0b8815ced5f03d07d8bf7fd3a231276f9daf3ff03cfdf80cfaf9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-k, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:35:33.822 INFO:journalctl@ceph.mds.k.smithi022.stdout:Sep 19 09:35:33 smithi022 podman[64397]: 2024-09-19 09:35:33.821220623 +0000 UTC m=+0.375892144 container init 7e839c0b40c0b8815ced5f03d07d8bf7fd3a231276f9daf3ff03cfdf80cfaf9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-k, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-19T09:35:33.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.869+0000 7fda3b48f640 1 -- 172.21.15.1:0/2374507919 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda3410e480 msgr2=0x7fda34110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:33.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.869+0000 7fda3b48f640 1 --2- 172.21.15.1:0/2374507919 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda3410e480 0x7fda34110870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fda2c009ca0 tx=0x7fda2c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:35:33.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.869+0000 7fda3b48f640 1 -- 172.21.15.1:0/2374507919 shutdown_connections 2024-09-19T09:35:33.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.869+0000 7fda3b48f640 1 --2- 172.21.15.1:0/2374507919 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda3410e480 0x7fda34110870 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:33.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.869+0000 7fda3b48f640 1 --2- 172.21.15.1:0/2374507919 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda34101280 0x7fda3410df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:33.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.869+0000 7fda3b48f640 1 --2- 172.21.15.1:0/2374507919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda341008d0 0x7fda34100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:33.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.869+0000 7fda3b48f640 1 -- 172.21.15.1:0/2374507919 >> 172.21.15.1:0/2374507919 conn(0x7fda340fc7a0 msgr2=0x7fda340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:33.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.870+0000 7fda3b48f640 1 -- 172.21.15.1:0/2374507919 shutdown_connections 2024-09-19T09:35:33.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.870+0000 7fda3b48f640 1 -- 172.21.15.1:0/2374507919 wait complete. 2024-09-19T09:35:33.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.870+0000 7fda3b48f640 1 Processor -- start 2024-09-19T09:35:33.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.870+0000 7fda3b48f640 1 -- start start 2024-09-19T09:35:33.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.870+0000 7fda3b48f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda341008d0 0x7fda3419a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:33.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.870+0000 7fda3b48f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda34101280 0x7fda3419abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:33.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.870+0000 7fda3b48f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda3410e480 0x7fda3419ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:33.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.870+0000 7fda3b48f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fda34114180 con 0x7fda3410e480 2024-09-19T09:35:33.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.870+0000 7fda3b48f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fda34114000 con 0x7fda341008d0 2024-09-19T09:35:33.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.870+0000 7fda3b48f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fda34114300 con 0x7fda34101280 2024-09-19T09:35:33.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.871+0000 7fda39a2c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda3410e480 0x7fda3419ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:33.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.871+0000 7fda39a2c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda3410e480 0x7fda3419ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50594/0 (socket says 172.21.15.1:50594) 2024-09-19T09:35:33.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.871+0000 7fda39a2c640 1 -- 172.21.15.1:0/4131408272 learned_addr learned my addr 172.21.15.1:0/4131408272 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:35:33.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.871+0000 7fda3922b640 1 --2- 172.21.15.1:0/4131408272 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda341008d0 0x7fda3419a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:33.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.871+0000 7fda38a2a640 1 --2- 172.21.15.1:0/4131408272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda34101280 0x7fda3419abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:33.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.871+0000 7fda39a2c640 1 -- 172.21.15.1:0/4131408272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda34101280 msgr2=0x7fda3419abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:33.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.871+0000 7fda39a2c640 1 --2- 172.21.15.1:0/4131408272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda34101280 0x7fda3419abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:33.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.871+0000 7fda39a2c640 1 -- 172.21.15.1:0/4131408272 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda341008d0 msgr2=0x7fda3419a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:33.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.871+0000 7fda39a2c640 1 --2- 172.21.15.1:0/4131408272 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda341008d0 0x7fda3419a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:33.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.871+0000 7fda39a2c640 1 -- 172.21.15.1:0/4131408272 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda3419f650 con 0x7fda3410e480 2024-09-19T09:35:33.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.871+0000 7fda38a2a640 1 --2- 172.21.15.1:0/4131408272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda34101280 0x7fda3419abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:33.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.871+0000 7fda3922b640 1 --2- 172.21.15.1:0/4131408272 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda341008d0 0x7fda3419a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:35:33.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.871+0000 7fda39a2c640 1 --2- 172.21.15.1:0/4131408272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda3410e480 0x7fda3419ef70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fda2c02ade0 tx=0x7fda2c0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:33.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.871+0000 7fda2a7fc640 1 -- 172.21.15.1:0/4131408272 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2c003c30 con 0x7fda3410e480 2024-09-19T09:35:33.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.871+0000 7fda2a7fc640 1 -- 172.21.15.1:0/4131408272 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda2c003dd0 con 0x7fda3410e480 2024-09-19T09:35:33.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.871+0000 7fda3b48f640 1 -- 172.21.15.1:0/4131408272 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda3419f8e0 con 0x7fda3410e480 2024-09-19T09:35:33.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.871+0000 7fda2a7fc640 1 -- 172.21.15.1:0/4131408272 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2c02fc40 con 0x7fda3410e480 2024-09-19T09:35:33.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.871+0000 7fda3b48f640 1 -- 172.21.15.1:0/4131408272 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda341a7220 con 0x7fda3410e480 2024-09-19T09:35:33.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.872+0000 7fda3b48f640 1 -- 172.21.15.1:0/4131408272 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda34100cb0 con 0x7fda3410e480 2024-09-19T09:35:33.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.874+0000 7fda2a7fc640 1 -- 172.21.15.1:0/4131408272 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fda2c004050 con 0x7fda3410e480 2024-09-19T09:35:33.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.874+0000 7fda2a7fc640 1 --2- 172.21.15.1:0/4131408272 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fda200a3240 0x7fda200a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:33.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.874+0000 7fda3922b640 1 --2- 172.21.15.1:0/4131408272 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fda200a3240 0x7fda200a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:33.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.874+0000 7fda2a7fc640 1 -- 172.21.15.1:0/4131408272 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fda2c0f0840 con 0x7fda3410e480 2024-09-19T09:35:33.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.875+0000 7fda3922b640 1 --2- 172.21.15.1:0/4131408272 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fda200a3240 0x7fda200a5700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fda30009c30 tx=0x7fda30005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:33.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:33.877+0000 7fda2a7fc640 1 -- 172.21.15.1:0/4131408272 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fda2c0bda00 con 0x7fda3410e480 2024-09-19T09:35:34.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:34.091+0000 7fda3b48f640 1 -- 172.21.15.1:0/4131408272 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda3419ba00 con 0x7fda3410e480 2024-09-19T09:35:34.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:34.091+0000 7fda2a7fc640 1 -- 172.21.15.1:0/4131408272 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7fda3419ba00 con 0x7fda3410e480 2024-09-19T09:35:34.093 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:35:34.093 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":2,"btime":"2024-09-19T09:35:31:103295+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T09:35:34.094 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 2 2024-09-19T09:35:34.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:34.094+0000 7fda3b48f640 1 -- 172.21.15.1:0/4131408272 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fda200a3240 msgr2=0x7fda200a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:34.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:34.094+0000 7fda3b48f640 1 --2- 172.21.15.1:0/4131408272 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fda200a3240 0x7fda200a5700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fda30009c30 tx=0x7fda30005f90 comp rx=0 tx=0).stop 2024-09-19T09:35:34.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:34.094+0000 7fda3b48f640 1 -- 172.21.15.1:0/4131408272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda3410e480 msgr2=0x7fda3419ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:34.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:34.094+0000 7fda3b48f640 1 --2- 172.21.15.1:0/4131408272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda3410e480 0x7fda3419ef70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fda2c02ade0 tx=0x7fda2c0319f0 comp rx=0 tx=0).stop 2024-09-19T09:35:34.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:34.094+0000 7fda3b48f640 1 -- 172.21.15.1:0/4131408272 shutdown_connections 2024-09-19T09:35:34.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:34.094+0000 7fda3b48f640 1 --2- 172.21.15.1:0/4131408272 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda3410e480 0x7fda3419ef70 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:34.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:34.094+0000 7fda3b48f640 1 --2- 172.21.15.1:0/4131408272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fda34101280 0x7fda3419abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:34.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:34.094+0000 7fda3b48f640 1 --2- 172.21.15.1:0/4131408272 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fda200a3240 0x7fda200a5700 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:34.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:34.094+0000 7fda3b48f640 1 --2- 172.21.15.1:0/4131408272 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda341008d0 0x7fda3419a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:34.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:34.094+0000 7fda3b48f640 1 -- 172.21.15.1:0/4131408272 >> 172.21.15.1:0/4131408272 conn(0x7fda340fc7a0 msgr2=0x7fda340feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:34.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:34.094+0000 7fda3b48f640 1 -- 172.21.15.1:0/4131408272 shutdown_connections 2024-09-19T09:35:34.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:34.094+0000 7fda3b48f640 1 -- 172.21.15.1:0/4131408272 wait complete. 2024-09-19T09:35:34.114 INFO:journalctl@ceph.mds.k.smithi022.stdout:Sep 19 09:35:33 smithi022 podman[64397]: 2024-09-19 09:35:33.824311012 +0000 UTC m=+0.378982533 container start 7e839c0b40c0b8815ced5f03d07d8bf7fd3a231276f9daf3ff03cfdf80cfaf9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-k, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T09:35:34.114 INFO:journalctl@ceph.mds.k.smithi022.stdout:Sep 19 09:35:33 smithi022 ceph-mds[64416]: -- 172.21.15.22:0/1940283299 <== mon.2 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b408393860 con 0x55b408370800 2024-09-19T09:35:34.114 INFO:journalctl@ceph.mds.k.smithi022.stdout:Sep 19 09:35:33 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-k[64412]: starting mds.k at 2024-09-19T09:35:34.114 INFO:journalctl@ceph.mds.k.smithi022.stdout:Sep 19 09:35:33 smithi022 bash[64397]: 7e839c0b40c0b8815ced5f03d07d8bf7fd3a231276f9daf3ff03cfdf80cfaf9d 2024-09-19T09:35:34.114 INFO:journalctl@ceph.mds.k.smithi022.stdout:Sep 19 09:35:33 smithi022 systemd[1]: Started Ceph mds.k for 57238232-7669-11ef-bceb-c7b262605968. 2024-09-19T09:35:35.205 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:34 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:35.205 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:34 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:35.205 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:34 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:35.205 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:34 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:35.205 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:34 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:35.205 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:34 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:35.205 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:34 smithi001 ceph-mon[31225]: Deploying daemon mds.j on smithi001 2024-09-19T09:35:35.205 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:34 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/4131408272' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:35.206 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:34 smithi001 ceph-mon[31225]: mds.? [v2:172.21.15.22:6832/3676626194,v1:172.21.15.22:6833/3676626194] up:boot 2024-09-19T09:35:35.206 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:34 smithi001 ceph-mon[31225]: fsmap 2 up:standby 2024-09-19T09:35:35.206 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:34 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:35:35.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:34 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:35.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:34 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:35.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:34 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:35.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:34 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:35.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:34 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:35.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:34 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:35.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:34 smithi022 ceph-mon[35583]: Deploying daemon mds.j on smithi001 2024-09-19T09:35:35.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:34 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/4131408272' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:35.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:34 smithi022 ceph-mon[35583]: mds.? [v2:172.21.15.22:6832/3676626194,v1:172.21.15.22:6833/3676626194] up:boot 2024-09-19T09:35:35.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:34 smithi022 ceph-mon[35583]: fsmap 2 up:standby 2024-09-19T09:35:35.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:34 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:35:35.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:34 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:35.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:34 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:35.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:34 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:35.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:34 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:35.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:34 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:35.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:34 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:35.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:34 smithi121 ceph-mon[35577]: Deploying daemon mds.j on smithi001 2024-09-19T09:35:35.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:34 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/4131408272' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:35.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:34 smithi121 ceph-mon[35577]: mds.? [v2:172.21.15.22:6832/3676626194,v1:172.21.15.22:6833/3676626194] up:boot 2024-09-19T09:35:35.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:34 smithi121 ceph-mon[35577]: fsmap 2 up:standby 2024-09-19T09:35:35.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:34 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:35:36.212 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:35 smithi001 ceph-mon[31225]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:36.252 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:35 smithi022 ceph-mon[35583]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:36.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:35 smithi121 ceph-mon[35577]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:36.904 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 09:35:36 smithi001 systemd[1]: Starting Ceph mds.j for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:35:36.910 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:35:37.178 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 09:35:36 smithi001 podman[67476]: 2024-09-19 09:35:36.806172974 +0000 UTC m=+0.016636299 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:35:37.178 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 09:35:36 smithi001 podman[67476]: 2024-09-19 09:35:36.913612725 +0000 UTC m=+0.124076044 container create 5b9ead5d5375c403492b04bc3f4b2281b205693903b7c748a6beacce3ec316f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-j, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T09:35:37.178 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 09:35:37 smithi001 podman[67476]: 2024-09-19 09:35:37.149832359 +0000 UTC m=+0.360295676 container init 5b9ead5d5375c403492b04bc3f4b2281b205693903b7c748a6beacce3ec316f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-j, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:35:37.178 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 09:35:37 smithi001 podman[67476]: 2024-09-19 09:35:37.153394537 +0000 UTC m=+0.363857859 container start 5b9ead5d5375c403492b04bc3f4b2281b205693903b7c748a6beacce3ec316f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-j, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T09:35:37.358 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:37.482 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 09:35:37 smithi001 ceph-mds[67526]: -- 172.21.15.1:0/3087749676 <== mon.0 v2:172.21.15.1:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558d7eff5860 con 0x558d7efd3000 2024-09-19T09:35:37.482 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 09:35:37 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-j[67509]: starting mds.j at 2024-09-19T09:35:37.482 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 09:35:37 smithi001 bash[67476]: 5b9ead5d5375c403492b04bc3f4b2281b205693903b7c748a6beacce3ec316f1 2024-09-19T09:35:37.482 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 09:35:37 smithi001 systemd[1]: Started Ceph mds.j for 57238232-7669-11ef-bceb-c7b262605968. 2024-09-19T09:35:37.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.887+0000 7f43b58bd640 1 -- 172.21.15.1:0/3884043029 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43b0102d30 msgr2=0x7f43b0103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:37.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.887+0000 7f43b58bd640 1 --2- 172.21.15.1:0/3884043029 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43b0102d30 0x7f43b0103110 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f43a8009930 tx=0x7f43a802a420 comp rx=0 tx=0).stop 2024-09-19T09:35:37.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.887+0000 7f43b58bd640 1 -- 172.21.15.1:0/3884043029 shutdown_connections 2024-09-19T09:35:37.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.887+0000 7f43b58bd640 1 --2- 172.21.15.1:0/3884043029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43b01082a0 0x7f43b010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:37.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.887+0000 7f43b58bd640 1 --2- 172.21.15.1:0/3884043029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43b01036e0 0x7f43b0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:37.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.887+0000 7f43b58bd640 1 --2- 172.21.15.1:0/3884043029 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43b0102d30 0x7f43b0103110 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:37.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.887+0000 7f43b58bd640 1 -- 172.21.15.1:0/3884043029 >> 172.21.15.1:0/3884043029 conn(0x7f43b00fc7d0 msgr2=0x7f43b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:37.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.887+0000 7f43b58bd640 1 -- 172.21.15.1:0/3884043029 shutdown_connections 2024-09-19T09:35:37.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.887+0000 7f43b58bd640 1 -- 172.21.15.1:0/3884043029 wait complete. 2024-09-19T09:35:37.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.887+0000 7f43b58bd640 1 Processor -- start 2024-09-19T09:35:37.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.888+0000 7f43b58bd640 1 -- start start 2024-09-19T09:35:37.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.888+0000 7f43b58bd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43b0102d30 0x7f43b0100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:37.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.888+0000 7f43b58bd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43b01036e0 0x7f43b0100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:37.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.888+0000 7f43b58bd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43b01082a0 0x7f43b0101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:37.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.888+0000 7f43b58bd640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f43b01120e0 con 0x7f43b01036e0 2024-09-19T09:35:37.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.888+0000 7f43b58bd640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f43b0111f60 con 0x7f43b01082a0 2024-09-19T09:35:37.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.888+0000 7f43b58bd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f43b0112260 con 0x7f43b0102d30 2024-09-19T09:35:37.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.888+0000 7f43ae7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43b01036e0 0x7f43b0100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:37.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.888+0000 7f43ae7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43b01036e0 0x7f43b0100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53774/0 (socket says 172.21.15.1:53774) 2024-09-19T09:35:37.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.888+0000 7f43ae7fc640 1 -- 172.21.15.1:0/648701568 learned_addr learned my addr 172.21.15.1:0/648701568 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:35:37.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.888+0000 7f43af7fe640 1 --2- 172.21.15.1:0/648701568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43b01082a0 0x7f43b0101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:37.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.888+0000 7f43aeffd640 1 --2- 172.21.15.1:0/648701568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43b0102d30 0x7f43b0100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:37.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.888+0000 7f43ae7fc640 1 -- 172.21.15.1:0/648701568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43b0102d30 msgr2=0x7f43b0100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:37.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.888+0000 7f43ae7fc640 1 --2- 172.21.15.1:0/648701568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43b0102d30 0x7f43b0100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:37.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.888+0000 7f43ae7fc640 1 -- 172.21.15.1:0/648701568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43b01082a0 msgr2=0x7f43b0101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:37.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.888+0000 7f43ae7fc640 1 --2- 172.21.15.1:0/648701568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43b01082a0 0x7f43b0101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:37.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.888+0000 7f43ae7fc640 1 -- 172.21.15.1:0/648701568 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b01a6a60 con 0x7f43b01036e0 2024-09-19T09:35:37.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.889+0000 7f43ae7fc640 1 --2- 172.21.15.1:0/648701568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43b01036e0 0x7f43b0100ed0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f439800c970 tx=0x7f439800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:37.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.889+0000 7f43b48bb640 1 -- 172.21.15.1:0/648701568 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4398007bb0 con 0x7f43b01036e0 2024-09-19T09:35:37.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.889+0000 7f43b58bd640 1 -- 172.21.15.1:0/648701568 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43b01a6d50 con 0x7f43b01036e0 2024-09-19T09:35:37.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.889+0000 7f43b48bb640 1 -- 172.21.15.1:0/648701568 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4398007d50 con 0x7f43b01036e0 2024-09-19T09:35:37.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.889+0000 7f43b48bb640 1 -- 172.21.15.1:0/648701568 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439800f450 con 0x7f43b01036e0 2024-09-19T09:35:37.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.889+0000 7f43b58bd640 1 -- 172.21.15.1:0/648701568 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43b01a7200 con 0x7f43b01036e0 2024-09-19T09:35:37.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.890+0000 7f43b58bd640 1 -- 172.21.15.1:0/648701568 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43b006a850 con 0x7f43b01036e0 2024-09-19T09:35:37.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.891+0000 7f43b48bb640 1 -- 172.21.15.1:0/648701568 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f4398004f40 con 0x7f43b01036e0 2024-09-19T09:35:37.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.892+0000 7f43b48bb640 1 --2- 172.21.15.1:0/648701568 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f439c0a3240 0x7f439c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:37.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.892+0000 7f43aeffd640 1 --2- 172.21.15.1:0/648701568 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f439c0a3240 0x7f439c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:37.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.892+0000 7f43b48bb640 1 -- 172.21.15.1:0/648701568 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f43980cf470 con 0x7f43b01036e0 2024-09-19T09:35:37.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.893+0000 7f43aeffd640 1 --2- 172.21.15.1:0/648701568 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f439c0a3240 0x7f439c0a5700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f43a8006010 tx=0x7f43a8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:37.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:37.895+0000 7f43b48bb640 1 -- 172.21.15.1:0/648701568 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4398014030 con 0x7f43b01036e0 2024-09-19T09:35:38.069 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:37 smithi001 ceph-mon[31225]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:38.069 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:37 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:38.069 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:37 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:38.069 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:37 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:38.069 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:37 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:38.069 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:37 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:38.070 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:37 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:38.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:38.121+0000 7f43b58bd640 1 -- 172.21.15.1:0/648701568 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43b0103110 con 0x7f43b01036e0 2024-09-19T09:35:38.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:38.121+0000 7f43b48bb640 1 -- 172.21.15.1:0/648701568 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3082 (secure 0 0 0) 0x7f43b0103110 con 0x7f43b01036e0 2024-09-19T09:35:38.123 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:35:38.123 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":4,"btime":"2024-09-19T09:35:37:983505+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T09:35:38.123 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 4 2024-09-19T09:35:38.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:38.124+0000 7f43b58bd640 1 -- 172.21.15.1:0/648701568 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f439c0a3240 msgr2=0x7f439c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:38.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:38.124+0000 7f43b58bd640 1 --2- 172.21.15.1:0/648701568 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f439c0a3240 0x7f439c0a5700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f43a8006010 tx=0x7f43a8000bc0 comp rx=0 tx=0).stop 2024-09-19T09:35:38.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:38.124+0000 7f43b58bd640 1 -- 172.21.15.1:0/648701568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43b01036e0 msgr2=0x7f43b0100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:38.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:38.124+0000 7f43b58bd640 1 --2- 172.21.15.1:0/648701568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43b01036e0 0x7f43b0100ed0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f439800c970 tx=0x7f439800ce30 comp rx=0 tx=0).stop 2024-09-19T09:35:38.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:38.124+0000 7f43b58bd640 1 -- 172.21.15.1:0/648701568 shutdown_connections 2024-09-19T09:35:38.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:38.124+0000 7f43b58bd640 1 --2- 172.21.15.1:0/648701568 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f439c0a3240 0x7f439c0a5700 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:38.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:38.124+0000 7f43b58bd640 1 --2- 172.21.15.1:0/648701568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43b01082a0 0x7f43b0101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:38.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:38.124+0000 7f43b58bd640 1 --2- 172.21.15.1:0/648701568 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f43b01036e0 0x7f43b0100ed0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:38.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:38.124+0000 7f43b58bd640 1 --2- 172.21.15.1:0/648701568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43b0102d30 0x7f43b0100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:38.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:38.124+0000 7f43b58bd640 1 -- 172.21.15.1:0/648701568 >> 172.21.15.1:0/648701568 conn(0x7f43b00fc7d0 msgr2=0x7f43b0106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:38.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:38.124+0000 7f43b58bd640 1 -- 172.21.15.1:0/648701568 shutdown_connections 2024-09-19T09:35:38.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:38.124+0000 7f43b58bd640 1 -- 172.21.15.1:0/648701568 wait complete. 2024-09-19T09:35:38.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:37 smithi022 ceph-mon[35583]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:38.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:37 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:38.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:37 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:38.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:37 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:38.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:37 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:38.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:37 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:38.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:37 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:38.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:37 smithi121 ceph-mon[35577]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:38.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:37 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:38.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:37 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:38.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:37 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:38.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:37 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:38.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:37 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:38.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:37 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:39.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:38 smithi001 ceph-mon[31225]: Deploying daemon mds.d on smithi001 2024-09-19T09:35:39.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:38 smithi001 ceph-mon[31225]: mds.? [v2:172.21.15.1:6834/553959571,v1:172.21.15.1:6835/553959571] up:boot 2024-09-19T09:35:39.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:38 smithi001 ceph-mon[31225]: fsmap 3 up:standby 2024-09-19T09:35:39.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:38 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T09:35:39.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:38 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/648701568' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:39.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:38 smithi022 ceph-mon[35583]: Deploying daemon mds.d on smithi001 2024-09-19T09:35:39.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:38 smithi022 ceph-mon[35583]: mds.? [v2:172.21.15.1:6834/553959571,v1:172.21.15.1:6835/553959571] up:boot 2024-09-19T09:35:39.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:38 smithi022 ceph-mon[35583]: fsmap 3 up:standby 2024-09-19T09:35:39.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:38 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T09:35:39.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:38 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/648701568' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:39.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:38 smithi121 ceph-mon[35577]: Deploying daemon mds.d on smithi001 2024-09-19T09:35:39.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:38 smithi121 ceph-mon[35577]: mds.? [v2:172.21.15.1:6834/553959571,v1:172.21.15.1:6835/553959571] up:boot 2024-09-19T09:35:39.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:38 smithi121 ceph-mon[35577]: fsmap 3 up:standby 2024-09-19T09:35:39.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:38 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T09:35:39.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:38 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/648701568' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:40.166 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:39 smithi001 ceph-mon[31225]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:40.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:39 smithi022 ceph-mon[35583]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:40.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:39 smithi121 ceph-mon[35577]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:40.498 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 09:35:40 smithi001 systemd[1]: Starting Ceph mds.d for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:35:40.844 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 09:35:40 smithi001 podman[67890]: 2024-09-19 09:35:40.469442175 +0000 UTC m=+0.016681941 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:35:40.844 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 09:35:40 smithi001 podman[67890]: 2024-09-19 09:35:40.582166481 +0000 UTC m=+0.129406301 container create 5e8d87397b2c19050f70ef9f8b620d113161cb1195f27f875c4e4103d4cedeae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-d, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T09:35:40.844 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 09:35:40 smithi001 podman[67890]: 2024-09-19 09:35:40.843303171 +0000 UTC m=+0.390542931 container init 5e8d87397b2c19050f70ef9f8b620d113161cb1195f27f875c4e4103d4cedeae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-d, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:35:41.248 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 09:35:40 smithi001 podman[67890]: 2024-09-19 09:35:40.846386167 +0000 UTC m=+0.393625927 container start 5e8d87397b2c19050f70ef9f8b620d113161cb1195f27f875c4e4103d4cedeae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-d, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:35:41.248 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 09:35:40 smithi001 ceph-mds[67909]: -- 172.21.15.1:0/18583367 <== mon.0 v2:172.21.15.1:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56247fb93860 con 0x56247fb71400 2024-09-19T09:35:41.248 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 09:35:40 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-d[67905]: starting mds.d at 2024-09-19T09:35:41.248 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 09:35:40 smithi001 bash[67890]: 5e8d87397b2c19050f70ef9f8b620d113161cb1195f27f875c4e4103d4cedeae 2024-09-19T09:35:41.248 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 09:35:40 smithi001 systemd[1]: Started Ceph mds.d for 57238232-7669-11ef-bceb-c7b262605968. 2024-09-19T09:35:41.479 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:35:41.743 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:42.156 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:41 smithi001 ceph-mon[31225]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:42.156 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:41 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:42.156 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:41 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:42.157 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:41 smithi001 ceph-mon[31225]: mds.? [v2:172.21.15.1:6836/2692725949,v1:172.21.15.1:6837/2692725949] up:boot 2024-09-19T09:35:42.157 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:41 smithi001 ceph-mon[31225]: fsmap 4 up:standby 2024-09-19T09:35:42.157 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:41 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T09:35:42.157 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:41 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:42.157 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:41 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:42.157 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:41 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:42.157 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:41 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:42.157 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:41 smithi001 ceph-mon[31225]: Deploying daemon mds.e on smithi022 2024-09-19T09:35:42.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.239+0000 7f36821a2640 1 -- 172.21.15.1:0/2225909520 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f367c1036e0 msgr2=0x7f367c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:42.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.239+0000 7f36821a2640 1 --2- 172.21.15.1:0/2225909520 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f367c1036e0 0x7f367c107b90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3664009930 tx=0x7f366402a420 comp rx=0 tx=0).stop 2024-09-19T09:35:42.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.239+0000 7f36821a2640 1 -- 172.21.15.1:0/2225909520 shutdown_connections 2024-09-19T09:35:42.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.239+0000 7f36821a2640 1 --2- 172.21.15.1:0/2225909520 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f367c1082a0 0x7f367c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:42.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.239+0000 7f36821a2640 1 --2- 172.21.15.1:0/2225909520 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f367c1036e0 0x7f367c107b90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:42.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.239+0000 7f36821a2640 1 --2- 172.21.15.1:0/2225909520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f367c102d30 0x7f367c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:42.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.239+0000 7f36821a2640 1 -- 172.21.15.1:0/2225909520 >> 172.21.15.1:0/2225909520 conn(0x7f367c0fc7d0 msgr2=0x7f367c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:42.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.239+0000 7f36821a2640 1 -- 172.21.15.1:0/2225909520 shutdown_connections 2024-09-19T09:35:42.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.239+0000 7f36821a2640 1 -- 172.21.15.1:0/2225909520 wait complete. 2024-09-19T09:35:42.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.240+0000 7f36821a2640 1 Processor -- start 2024-09-19T09:35:42.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.240+0000 7f36821a2640 1 -- start start 2024-09-19T09:35:42.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.240+0000 7f36821a2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f367c102d30 0x7f367c198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:42.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.240+0000 7f36821a2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f367c1036e0 0x7f367c198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:42.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.240+0000 7f36821a2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f367c1082a0 0x7f367c19ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:42.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.240+0000 7f36821a2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f367c1120a0 con 0x7f367c102d30 2024-09-19T09:35:42.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.240+0000 7f36821a2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f367c111f20 con 0x7f367c1036e0 2024-09-19T09:35:42.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.240+0000 7f36821a2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f367c112220 con 0x7f367c1082a0 2024-09-19T09:35:42.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.240+0000 7f367b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f367c102d30 0x7f367c198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:42.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.240+0000 7f367b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f367c102d30 0x7f367c198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53802/0 (socket says 172.21.15.1:53802) 2024-09-19T09:35:42.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.240+0000 7f367b7fe640 1 -- 172.21.15.1:0/1653080932 learned_addr learned my addr 172.21.15.1:0/1653080932 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:35:42.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.240+0000 7f367affd640 1 --2- 172.21.15.1:0/1653080932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f367c1036e0 0x7f367c198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:42.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.240+0000 7f367b7fe640 1 -- 172.21.15.1:0/1653080932 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f367c1082a0 msgr2=0x7f367c19ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:42.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.240+0000 7f367bfff640 1 --2- 172.21.15.1:0/1653080932 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f367c1082a0 0x7f367c19ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:42.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.240+0000 7f367b7fe640 1 --2- 172.21.15.1:0/1653080932 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f367c1082a0 0x7f367c19ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:42.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.240+0000 7f367b7fe640 1 -- 172.21.15.1:0/1653080932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f367c1036e0 msgr2=0x7f367c198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:42.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.240+0000 7f367b7fe640 1 --2- 172.21.15.1:0/1653080932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f367c1036e0 0x7f367c198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:42.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.240+0000 7f367b7fe640 1 -- 172.21.15.1:0/1653080932 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f367c19d500 con 0x7f367c102d30 2024-09-19T09:35:42.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.240+0000 7f367affd640 1 --2- 172.21.15.1:0/1653080932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f367c1036e0 0x7f367c198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:35:42.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.240+0000 7f367bfff640 1 --2- 172.21.15.1:0/1653080932 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f367c1082a0 0x7f367c19ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:42.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.241+0000 7f367b7fe640 1 --2- 172.21.15.1:0/1653080932 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f367c102d30 0x7f367c198550 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f366c00eab0 tx=0x7f366c00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:42.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.241+0000 7f3678ff9640 1 -- 172.21.15.1:0/1653080932 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c00ce40 con 0x7f367c102d30 2024-09-19T09:35:42.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.241+0000 7f36821a2640 1 -- 172.21.15.1:0/1653080932 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f367c19d7f0 con 0x7f367c102d30 2024-09-19T09:35:42.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.241+0000 7f3678ff9640 1 -- 172.21.15.1:0/1653080932 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f366c011950 con 0x7f367c102d30 2024-09-19T09:35:42.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.241+0000 7f3678ff9640 1 -- 172.21.15.1:0/1653080932 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c010ae0 con 0x7f367c102d30 2024-09-19T09:35:42.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.241+0000 7f36821a2640 1 -- 172.21.15.1:0/1653080932 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f367c1a50d0 con 0x7f367c102d30 2024-09-19T09:35:42.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.242+0000 7f36821a2640 1 -- 172.21.15.1:0/1653080932 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f367c103110 con 0x7f367c102d30 2024-09-19T09:35:42.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.243+0000 7f3678ff9640 1 -- 172.21.15.1:0/1653080932 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f366c011b00 con 0x7f367c102d30 2024-09-19T09:35:42.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.244+0000 7f3678ff9640 1 --2- 172.21.15.1:0/1653080932 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f36680a3240 0x7f36680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:42.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.244+0000 7f367affd640 1 --2- 172.21.15.1:0/1653080932 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f36680a3240 0x7f36680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:42.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.244+0000 7f3678ff9640 1 -- 172.21.15.1:0/1653080932 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f366c0cfbf0 con 0x7f367c102d30 2024-09-19T09:35:42.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.244+0000 7f367affd640 1 --2- 172.21.15.1:0/1653080932 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f36680a3240 0x7f36680a5700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3664009900 tx=0x7f3664005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:42.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.247+0000 7f3678ff9640 1 -- 172.21.15.1:0/1653080932 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f366c016030 con 0x7f367c102d30 2024-09-19T09:35:42.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:41 smithi022 ceph-mon[35583]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:42.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:41 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:42.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:41 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:42.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:41 smithi022 ceph-mon[35583]: mds.? [v2:172.21.15.1:6836/2692725949,v1:172.21.15.1:6837/2692725949] up:boot 2024-09-19T09:35:42.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:41 smithi022 ceph-mon[35583]: fsmap 4 up:standby 2024-09-19T09:35:42.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:41 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T09:35:42.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:41 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:42.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:41 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:42.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:41 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:42.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:41 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:42.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:41 smithi022 ceph-mon[35583]: Deploying daemon mds.e on smithi022 2024-09-19T09:35:42.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:41 smithi121 ceph-mon[35577]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:42.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:41 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:42.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:41 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:42.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:41 smithi121 ceph-mon[35577]: mds.? [v2:172.21.15.1:6836/2692725949,v1:172.21.15.1:6837/2692725949] up:boot 2024-09-19T09:35:42.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:41 smithi121 ceph-mon[35577]: fsmap 4 up:standby 2024-09-19T09:35:42.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:41 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T09:35:42.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:41 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:42.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:41 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:42.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:41 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:42.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:41 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:42.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:41 smithi121 ceph-mon[35577]: Deploying daemon mds.e on smithi022 2024-09-19T09:35:42.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.459+0000 7f36821a2640 1 -- 172.21.15.1:0/1653080932 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f367c10a2b0 con 0x7f367c102d30 2024-09-19T09:35:42.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.460+0000 7f3678ff9640 1 -- 172.21.15.1:0/1653080932 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3904 (secure 0 0 0) 0x7f366c09cdb0 con 0x7f367c102d30 2024-09-19T09:35:42.461 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:35:42.462 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":5,"btime":"2024-09-19T09:35:40:994903+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T09:35:42.462 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 5 2024-09-19T09:35:42.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.462+0000 7f36821a2640 1 -- 172.21.15.1:0/1653080932 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f36680a3240 msgr2=0x7f36680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:42.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.462+0000 7f36821a2640 1 --2- 172.21.15.1:0/1653080932 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f36680a3240 0x7f36680a5700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3664009900 tx=0x7f3664005a20 comp rx=0 tx=0).stop 2024-09-19T09:35:42.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.462+0000 7f36821a2640 1 -- 172.21.15.1:0/1653080932 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f367c102d30 msgr2=0x7f367c198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:42.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.462+0000 7f36821a2640 1 --2- 172.21.15.1:0/1653080932 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f367c102d30 0x7f367c198550 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f366c00eab0 tx=0x7f366c00ef70 comp rx=0 tx=0).stop 2024-09-19T09:35:42.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.462+0000 7f36821a2640 1 -- 172.21.15.1:0/1653080932 shutdown_connections 2024-09-19T09:35:42.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.462+0000 7f36821a2640 1 --2- 172.21.15.1:0/1653080932 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f367c1082a0 0x7f367c19ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:42.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.462+0000 7f36821a2640 1 --2- 172.21.15.1:0/1653080932 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f36680a3240 0x7f36680a5700 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:42.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.462+0000 7f36821a2640 1 --2- 172.21.15.1:0/1653080932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f367c1036e0 0x7f367c198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:42.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.462+0000 7f36821a2640 1 --2- 172.21.15.1:0/1653080932 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f367c102d30 0x7f367c198550 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:42.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.462+0000 7f36821a2640 1 -- 172.21.15.1:0/1653080932 >> 172.21.15.1:0/1653080932 conn(0x7f367c0fc7d0 msgr2=0x7f367c105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:42.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.462+0000 7f36821a2640 1 -- 172.21.15.1:0/1653080932 shutdown_connections 2024-09-19T09:35:42.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:42.462+0000 7f36821a2640 1 -- 172.21.15.1:0/1653080932 wait complete. 2024-09-19T09:35:43.282 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:42 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1653080932' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:43.283 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:35:43 smithi022 systemd[1]: Starting Ceph mds.e for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:35:43.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:42 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1653080932' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:43.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:42 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1653080932' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:43.587 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:35:43 smithi022 podman[64713]: 2024-09-19 09:35:43.184176598 +0000 UTC m=+0.015935284 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:35:43.587 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:35:43 smithi022 podman[64713]: 2024-09-19 09:35:43.324798813 +0000 UTC m=+0.156557486 container create e4de37a7b3cb124677a3d87de48065258b5a45bb2b0039bdd40c10146cd8c04a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-e, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731) 2024-09-19T09:35:43.587 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:35:43 smithi022 podman[64713]: 2024-09-19 09:35:43.586093193 +0000 UTC m=+0.417851868 container init e4de37a7b3cb124677a3d87de48065258b5a45bb2b0039bdd40c10146cd8c04a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-e, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:35:43.864 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:35:43 smithi022 podman[64713]: 2024-09-19 09:35:43.58917419 +0000 UTC m=+0.420932865 container start e4de37a7b3cb124677a3d87de48065258b5a45bb2b0039bdd40c10146cd8c04a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-19T09:35:43.864 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:35:43 smithi022 ceph-mds[64733]: -- 172.21.15.22:0/1244431589 <== mon.2 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ccef2cb860 con 0x55ccef2a9000 2024-09-19T09:35:43.864 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:35:43 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-e[64729]: starting mds.e at 2024-09-19T09:35:43.865 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:35:43 smithi022 bash[64713]: e4de37a7b3cb124677a3d87de48065258b5a45bb2b0039bdd40c10146cd8c04a 2024-09-19T09:35:43.865 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:35:43 smithi022 systemd[1]: Started Ceph mds.e for 57238232-7669-11ef-bceb-c7b262605968. 2024-09-19T09:35:44.316 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:44 smithi121 ceph-mon[35577]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:44.316 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:44 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:44.317 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:44 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:44.317 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:44 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:44.317 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:44 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:44.317 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:44 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:44.317 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:44 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:44.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:43 smithi022 ceph-mon[35583]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:44.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:43 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:44.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:43 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:44.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:43 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:44.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:43 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:44.366 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:43 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:44.366 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:43 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:44.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:43 smithi001 ceph-mon[31225]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:44.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:43 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:44.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:43 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:44.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:43 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:44.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:43 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:44.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:43 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:44.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:43 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:45.176 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:35:45.312 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:45 smithi121 ceph-mon[35577]: Deploying daemon mds.f on smithi121 2024-09-19T09:35:45.312 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:45 smithi121 ceph-mon[35577]: mds.? [v2:172.21.15.22:6834/2003930762,v1:172.21.15.22:6835/2003930762] up:boot 2024-09-19T09:35:45.312 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:45 smithi121 ceph-mon[35577]: fsmap 5 up:standby 2024-09-19T09:35:45.312 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:45 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:35:45.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:45 smithi022 ceph-mon[35583]: Deploying daemon mds.f on smithi121 2024-09-19T09:35:45.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:45 smithi022 ceph-mon[35583]: mds.? [v2:172.21.15.22:6834/2003930762,v1:172.21.15.22:6835/2003930762] up:boot 2024-09-19T09:35:45.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:45 smithi022 ceph-mon[35583]: fsmap 5 up:standby 2024-09-19T09:35:45.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:45 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:35:45.449 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:45.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:45 smithi001 ceph-mon[31225]: Deploying daemon mds.f on smithi121 2024-09-19T09:35:45.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:45 smithi001 ceph-mon[31225]: mds.? [v2:172.21.15.22:6834/2003930762,v1:172.21.15.22:6835/2003930762] up:boot 2024-09-19T09:35:45.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:45 smithi001 ceph-mon[31225]: fsmap 5 up:standby 2024-09-19T09:35:45.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:45 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:35:45.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.947+0000 7f0cffdf4640 1 -- 172.21.15.1:0/3942300159 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cf8106f10 msgr2=0x7f0cf810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:45.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.947+0000 7f0cffdf4640 1 --2- 172.21.15.1:0/3942300159 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cf8106f10 0x7f0cf810ea90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0009ca0 tx=0x7f0cf002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:35:45.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.947+0000 7f0cffdf4640 1 -- 172.21.15.1:0/3942300159 shutdown_connections 2024-09-19T09:35:45.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.947+0000 7f0cffdf4640 1 --2- 172.21.15.1:0/3942300159 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cf8106f10 0x7f0cf810ea90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:45.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.947+0000 7f0cffdf4640 1 --2- 172.21.15.1:0/3942300159 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0cf8102790 0x7f0cf81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:45.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.947+0000 7f0cffdf4640 1 --2- 172.21.15.1:0/3942300159 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cf8101de0 0x7f0cf81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:45.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.947+0000 7f0cffdf4640 1 -- 172.21.15.1:0/3942300159 >> 172.21.15.1:0/3942300159 conn(0x7f0cf80fd8c0 msgr2=0x7f0cf80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:45.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.947+0000 7f0cffdf4640 1 -- 172.21.15.1:0/3942300159 shutdown_connections 2024-09-19T09:35:45.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.947+0000 7f0cffdf4640 1 -- 172.21.15.1:0/3942300159 wait complete. 2024-09-19T09:35:45.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.948+0000 7f0cffdf4640 1 Processor -- start 2024-09-19T09:35:45.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.948+0000 7f0cffdf4640 1 -- start start 2024-09-19T09:35:45.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.948+0000 7f0cffdf4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0cf8101de0 0x7f0cf81983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:45.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.948+0000 7f0cffdf4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cf8102790 0x7f0cf8198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:45.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.948+0000 7f0cffdf4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cf8106f10 0x7f0cf819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:45.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.948+0000 7f0cffdf4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf8111f70 con 0x7f0cf8102790 2024-09-19T09:35:45.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.948+0000 7f0cffdf4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf8111df0 con 0x7f0cf8106f10 2024-09-19T09:35:45.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.948+0000 7f0cffdf4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf81120f0 con 0x7f0cf8101de0 2024-09-19T09:35:45.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.948+0000 7f0cfd38f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cf8102790 0x7f0cf8198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:45.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.948+0000 7f0cfd38f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cf8102790 0x7f0cf8198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58944/0 (socket says 172.21.15.1:58944) 2024-09-19T09:35:45.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.948+0000 7f0cfd38f640 1 -- 172.21.15.1:0/3738856155 learned_addr learned my addr 172.21.15.1:0/3738856155 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:35:45.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.948+0000 7f0cfdb90640 1 --2- 172.21.15.1:0/3738856155 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0cf8101de0 0x7f0cf81983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:45.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.948+0000 7f0cfe391640 1 --2- 172.21.15.1:0/3738856155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cf8106f10 0x7f0cf819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:45.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.948+0000 7f0cfd38f640 1 -- 172.21.15.1:0/3738856155 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0cf8101de0 msgr2=0x7f0cf81983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:45.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.948+0000 7f0cfd38f640 1 --2- 172.21.15.1:0/3738856155 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0cf8101de0 0x7f0cf81983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:45.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.948+0000 7f0cfd38f640 1 -- 172.21.15.1:0/3738856155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cf8106f10 msgr2=0x7f0cf819ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:45.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.949+0000 7f0cfd38f640 1 --2- 172.21.15.1:0/3738856155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cf8106f10 0x7f0cf819ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:45.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.949+0000 7f0cfd38f640 1 -- 172.21.15.1:0/3738856155 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cf819d3a0 con 0x7f0cf8102790 2024-09-19T09:35:45.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.949+0000 7f0cfd38f640 1 --2- 172.21.15.1:0/3738856155 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cf8102790 0x7f0cf8198930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0ce800e9f0 tx=0x7f0ce800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:45.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.949+0000 7f0ceeffd640 1 -- 172.21.15.1:0/3738856155 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce800cd80 con 0x7f0cf8102790 2024-09-19T09:35:45.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.949+0000 7f0cffdf4640 1 -- 172.21.15.1:0/3738856155 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cf819d690 con 0x7f0cf8102790 2024-09-19T09:35:45.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.949+0000 7f0ceeffd640 1 -- 172.21.15.1:0/3738856155 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ce8005500 con 0x7f0cf8102790 2024-09-19T09:35:45.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.949+0000 7f0ceeffd640 1 -- 172.21.15.1:0/3738856155 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce8010690 con 0x7f0cf8102790 2024-09-19T09:35:45.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.949+0000 7f0cffdf4640 1 -- 172.21.15.1:0/3738856155 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cf81a4f70 con 0x7f0cf8102790 2024-09-19T09:35:45.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.950+0000 7f0cffdf4640 1 -- 172.21.15.1:0/3738856155 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cf81021c0 con 0x7f0cf8102790 2024-09-19T09:35:45.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.951+0000 7f0ceeffd640 1 -- 172.21.15.1:0/3738856155 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f0ce80046c0 con 0x7f0cf8102790 2024-09-19T09:35:45.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.952+0000 7f0ceeffd640 1 --2- 172.21.15.1:0/3738856155 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f0ce40a3240 0x7f0ce40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:45.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.952+0000 7f0cfdb90640 1 --2- 172.21.15.1:0/3738856155 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f0ce40a3240 0x7f0ce40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:45.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.952+0000 7f0ceeffd640 1 -- 172.21.15.1:0/3738856155 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f0ce80cfa10 con 0x7f0cf8102790 2024-09-19T09:35:45.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.952+0000 7f0cfdb90640 1 --2- 172.21.15.1:0/3738856155 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f0ce40a3240 0x7f0ce40a5700 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4005fd0 tx=0x7f0cf4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:45.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:45.956+0000 7f0ceeffd640 1 -- 172.21.15.1:0/3738856155 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0ce809cb30 con 0x7f0cf8102790 2024-09-19T09:35:46.011 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 19 09:35:45 smithi121 podman[64566]: 2024-09-19 09:35:45.939674059 +0000 UTC m=+0.150419252 container create 7f23f6a767fb58e1220e50c0a77bd816aaa7527d05ea80bb7e9df071bb06a0cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-f, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T09:35:46.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:46.168+0000 7f0cffdf4640 1 -- 172.21.15.1:0/3738856155 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0cf802d7c0 con 0x7f0cf8102790 2024-09-19T09:35:46.170 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:46 smithi001 ceph-mon[31225]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:46.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:46.169+0000 7f0ceeffd640 1 -- 172.21.15.1:0/3738856155 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4729 (secure 0 0 0) 0x7f0ce809c430 con 0x7f0cf8102790 2024-09-19T09:35:46.171 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:35:46.171 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":6,"btime":"2024-09-19T09:35:43:998522+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-19T09:35:46.171 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 6 2024-09-19T09:35:46.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:46.171+0000 7f0cffdf4640 1 -- 172.21.15.1:0/3738856155 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f0ce40a3240 msgr2=0x7f0ce40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:46.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:46.171+0000 7f0cffdf4640 1 --2- 172.21.15.1:0/3738856155 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f0ce40a3240 0x7f0ce40a5700 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4005fd0 tx=0x7f0cf4005850 comp rx=0 tx=0).stop 2024-09-19T09:35:46.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:46.171+0000 7f0cffdf4640 1 -- 172.21.15.1:0/3738856155 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cf8102790 msgr2=0x7f0cf8198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:46.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:46.171+0000 7f0cffdf4640 1 --2- 172.21.15.1:0/3738856155 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cf8102790 0x7f0cf8198930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0ce800e9f0 tx=0x7f0ce800edf0 comp rx=0 tx=0).stop 2024-09-19T09:35:46.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:46.171+0000 7f0cffdf4640 1 -- 172.21.15.1:0/3738856155 shutdown_connections 2024-09-19T09:35:46.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:46.171+0000 7f0cffdf4640 1 --2- 172.21.15.1:0/3738856155 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f0ce40a3240 0x7f0ce40a5700 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:46.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:46.171+0000 7f0cffdf4640 1 --2- 172.21.15.1:0/3738856155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cf8106f10 0x7f0cf819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:46.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:46.171+0000 7f0cffdf4640 1 --2- 172.21.15.1:0/3738856155 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0cf8102790 0x7f0cf8198930 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:46.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:46.171+0000 7f0cffdf4640 1 --2- 172.21.15.1:0/3738856155 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0cf8101de0 0x7f0cf81983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:46.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:46.171+0000 7f0cffdf4640 1 -- 172.21.15.1:0/3738856155 >> 172.21.15.1:0/3738856155 conn(0x7f0cf80fd8c0 msgr2=0x7f0cf80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:46.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:46.171+0000 7f0cffdf4640 1 -- 172.21.15.1:0/3738856155 shutdown_connections 2024-09-19T09:35:46.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:46.171+0000 7f0cffdf4640 1 -- 172.21.15.1:0/3738856155 wait complete. 2024-09-19T09:35:46.268 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:46 smithi121 ceph-mon[35577]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:46.269 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 19 09:35:46 smithi121 podman[64566]: 2024-09-19 09:35:46.167937306 +0000 UTC m=+0.378682499 container init 7f23f6a767fb58e1220e50c0a77bd816aaa7527d05ea80bb7e9df071bb06a0cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-f, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T09:35:46.269 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 19 09:35:46 smithi121 podman[64566]: 2024-09-19 09:35:46.170771182 +0000 UTC m=+0.381516375 container start 7f23f6a767fb58e1220e50c0a77bd816aaa7527d05ea80bb7e9df071bb06a0cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-f, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T09:35:46.269 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 19 09:35:46 smithi121 ceph-mds[64585]: -- 172.21.15.121:0/3742601390 <== mon.1 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d170f05860 con 0x55d170ee2800 2024-09-19T09:35:46.269 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 19 09:35:46 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-f[64581]: starting mds.f at 2024-09-19T09:35:46.269 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 19 09:35:46 smithi121 bash[64566]: 7f23f6a767fb58e1220e50c0a77bd816aaa7527d05ea80bb7e9df071bb06a0cb 2024-09-19T09:35:46.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:46 smithi022 ceph-mon[35583]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:46.616 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 19 09:35:46 smithi121 systemd[1]: Started Ceph mds.f for 57238232-7669-11ef-bceb-c7b262605968. 2024-09-19T09:35:47.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:47 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/3738856155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:47.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:47 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:47.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:47 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:47.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:47 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:47.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:47 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:47.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:47 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:47.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:47 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:47.310 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:47 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/3738856155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:47.310 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:47 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:47.310 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:47 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:47.310 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:47 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:47.311 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:47 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:47.311 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:47 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:47.311 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:47 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:47.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:47 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/3738856155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:47.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:47 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:47.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:47 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:47.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:47 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:47.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:47 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:47.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:47 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:47.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:47 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:48.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:48 smithi022 ceph-mon[35583]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:48.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:48 smithi022 ceph-mon[35583]: Deploying daemon mds.c on smithi121 2024-09-19T09:35:48.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:48 smithi022 ceph-mon[35583]: mds.? [v2:172.21.15.121:6834/2300524808,v1:172.21.15.121:6835/2300524808] up:boot 2024-09-19T09:35:48.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:48 smithi022 ceph-mon[35583]: fsmap 6 up:standby 2024-09-19T09:35:48.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:48 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:35:48.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:48 smithi121 ceph-mon[35577]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:48.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:48 smithi121 ceph-mon[35577]: Deploying daemon mds.c on smithi121 2024-09-19T09:35:48.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:48 smithi121 ceph-mon[35577]: mds.? [v2:172.21.15.121:6834/2300524808,v1:172.21.15.121:6835/2300524808] up:boot 2024-09-19T09:35:48.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:48 smithi121 ceph-mon[35577]: fsmap 6 up:standby 2024-09-19T09:35:48.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:48 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:35:48.367 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 19 09:35:48 smithi121 systemd[1]: Starting Ceph mds.c for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:35:48.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:48 smithi001 ceph-mon[31225]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:48.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:48 smithi001 ceph-mon[31225]: Deploying daemon mds.c on smithi121 2024-09-19T09:35:48.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:48 smithi001 ceph-mon[31225]: mds.? [v2:172.21.15.121:6834/2300524808,v1:172.21.15.121:6835/2300524808] up:boot 2024-09-19T09:35:48.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:48 smithi001 ceph-mon[31225]: fsmap 6 up:standby 2024-09-19T09:35:48.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:48 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:35:48.690 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 19 09:35:48 smithi121 podman[64872]: 2024-09-19 09:35:48.296473886 +0000 UTC m=+0.015993677 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:35:48.691 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 19 09:35:48 smithi121 podman[64872]: 2024-09-19 09:35:48.420194668 +0000 UTC m=+0.139714448 container create 1a89475d9e5c66225846f5d74a027212f897cbf079562948033f1b1e6656c3d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-c, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4) 2024-09-19T09:35:48.691 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 19 09:35:48 smithi121 podman[64872]: 2024-09-19 09:35:48.689687136 +0000 UTC m=+0.409206915 container init 1a89475d9e5c66225846f5d74a027212f897cbf079562948033f1b1e6656c3d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-c, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD) 2024-09-19T09:35:48.883 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:35:49.117 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 19 09:35:48 smithi121 podman[64872]: 2024-09-19 09:35:48.692720212 +0000 UTC m=+0.412240000 container start 1a89475d9e5c66225846f5d74a027212f897cbf079562948033f1b1e6656c3d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-c, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-19T09:35:49.117 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 19 09:35:48 smithi121 ceph-mds[64891]: -- 172.21.15.121:0/2252596259 <== mon.1 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558918e6b860 con 0x558918e49400 2024-09-19T09:35:49.117 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 19 09:35:48 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-c[64887]: starting mds.c at 2024-09-19T09:35:49.117 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 19 09:35:48 smithi121 bash[64872]: 1a89475d9e5c66225846f5d74a027212f897cbf079562948033f1b1e6656c3d0 2024-09-19T09:35:49.117 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 19 09:35:48 smithi121 systemd[1]: Started Ceph mds.c for 57238232-7669-11ef-bceb-c7b262605968. 2024-09-19T09:35:49.153 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:49.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.657+0000 7f75725e0640 1 -- 172.21.15.1:0/3806034839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f756c102570 msgr2=0x7f756c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:49.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.657+0000 7f75725e0640 1 --2- 172.21.15.1:0/3806034839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f756c102570 0x7f756c1029b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7560009900 tx=0x7f756002a480 comp rx=0 tx=0).stop 2024-09-19T09:35:49.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.657+0000 7f75725e0640 1 -- 172.21.15.1:0/3806034839 shutdown_connections 2024-09-19T09:35:49.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.657+0000 7f75725e0640 1 --2- 172.21.15.1:0/3806034839 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f756c102ef0 0x7f756c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:49.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.657+0000 7f75725e0640 1 --2- 172.21.15.1:0/3806034839 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f756c102570 0x7f756c1029b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:49.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.657+0000 7f75725e0640 1 --2- 172.21.15.1:0/3806034839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f756c100e20 0x7f756c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:49.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.657+0000 7f75725e0640 1 -- 172.21.15.1:0/3806034839 >> 172.21.15.1:0/3806034839 conn(0x7f756c0fc7d0 msgr2=0x7f756c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:49.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.657+0000 7f75725e0640 1 -- 172.21.15.1:0/3806034839 shutdown_connections 2024-09-19T09:35:49.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.657+0000 7f75725e0640 1 -- 172.21.15.1:0/3806034839 wait complete. 2024-09-19T09:35:49.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.658+0000 7f75725e0640 1 Processor -- start 2024-09-19T09:35:49.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.658+0000 7f75725e0640 1 -- start start 2024-09-19T09:35:49.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.658+0000 7f75725e0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f756c100e20 0x7f756c1970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:49.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.659+0000 7f75725e0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f756c102570 0x7f756c197630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:49.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.659+0000 7f75725e0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f756c102ef0 0x7f756c197b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:49.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.659+0000 7f75725e0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f756c110fd0 con 0x7f756c102ef0 2024-09-19T09:35:49.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.659+0000 7f75725e0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f756c110e50 con 0x7f756c100e20 2024-09-19T09:35:49.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.659+0000 7f75725e0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f756c111150 con 0x7f756c102570 2024-09-19T09:35:49.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.659+0000 7f7570b7d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f756c102ef0 0x7f756c197b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:49.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.659+0000 7f756bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f756c100e20 0x7f756c1970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:49.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.659+0000 7f756bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f756c100e20 0x7f756c1970f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:56558/0 (socket says 172.21.15.1:56558) 2024-09-19T09:35:49.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.659+0000 7f7570b7d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f756c102ef0 0x7f756c197b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58958/0 (socket says 172.21.15.1:58958) 2024-09-19T09:35:49.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.659+0000 7f756bfff640 1 -- 172.21.15.1:0/1687267447 learned_addr learned my addr 172.21.15.1:0/1687267447 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:35:49.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.659+0000 7f756b7fe640 1 --2- 172.21.15.1:0/1687267447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f756c102570 0x7f756c197630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:49.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.659+0000 7f756bfff640 1 -- 172.21.15.1:0/1687267447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f756c102570 msgr2=0x7f756c197630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:49.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.659+0000 7f756bfff640 1 --2- 172.21.15.1:0/1687267447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f756c102570 0x7f756c197630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:49.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.659+0000 7f756bfff640 1 -- 172.21.15.1:0/1687267447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f756c102ef0 msgr2=0x7f756c197b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:49.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.659+0000 7f756bfff640 1 --2- 172.21.15.1:0/1687267447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f756c102ef0 0x7f756c197b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:49.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.659+0000 7f756bfff640 1 -- 172.21.15.1:0/1687267447 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f756c1a6960 con 0x7f756c100e20 2024-09-19T09:35:49.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.659+0000 7f7570b7d640 1 --2- 172.21.15.1:0/1687267447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f756c102ef0 0x7f756c197b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:35:49.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.659+0000 7f756bfff640 1 --2- 172.21.15.1:0/1687267447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f756c100e20 0x7f756c1970f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f755c00d950 tx=0x7f755c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:49.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.659+0000 7f75697fa640 1 -- 172.21.15.1:0/1687267447 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c017070 con 0x7f756c100e20 2024-09-19T09:35:49.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.660+0000 7f75725e0640 1 -- 172.21.15.1:0/1687267447 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f756c1a6c50 con 0x7f756c100e20 2024-09-19T09:35:49.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.660+0000 7f75697fa640 1 -- 172.21.15.1:0/1687267447 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f755c009c30 con 0x7f756c100e20 2024-09-19T09:35:49.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.660+0000 7f75697fa640 1 -- 172.21.15.1:0/1687267447 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c00f6b0 con 0x7f756c100e20 2024-09-19T09:35:49.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.660+0000 7f75725e0640 1 -- 172.21.15.1:0/1687267447 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f756c1a71b0 con 0x7f756c100e20 2024-09-19T09:35:49.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.661+0000 7f75725e0640 1 -- 172.21.15.1:0/1687267447 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f756c101200 con 0x7f756c100e20 2024-09-19T09:35:49.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.662+0000 7f75697fa640 1 -- 172.21.15.1:0/1687267447 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f755c0109d0 con 0x7f756c100e20 2024-09-19T09:35:49.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.662+0000 7f75697fa640 1 --2- 172.21.15.1:0/1687267447 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f75540a32c0 0x7f75540a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:49.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.663+0000 7f756b7fe640 1 --2- 172.21.15.1:0/1687267447 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f75540a32c0 0x7f75540a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:49.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.663+0000 7f75697fa640 1 -- 172.21.15.1:0/1687267447 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f755c0cf010 con 0x7f756c100e20 2024-09-19T09:35:49.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.663+0000 7f756b7fe640 1 --2- 172.21.15.1:0/1687267447 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f75540a32c0 0x7f75540a5780 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7560000c00 tx=0x7f7560005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:49.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.667+0000 7f75697fa640 1 -- 172.21.15.1:0/1687267447 <== mon.2 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f755c009de0 con 0x7f756c100e20 2024-09-19T09:35:49.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.897+0000 7f75725e0640 1 -- 172.21.15.1:0/1687267447 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f756c1a7380 con 0x7f756c100e20 2024-09-19T09:35:49.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.898+0000 7f75697fa640 1 -- 172.21.15.1:0/1687267447 <== mon.2 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6385 (secure 0 0 0) 0x7f755c09bae0 con 0x7f756c100e20 2024-09-19T09:35:49.899 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:35:49.899 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":8,"btime":"2024-09-19T09:35:49:016537+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-19T09:35:49.899 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 8 2024-09-19T09:35:49.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.900+0000 7f75725e0640 1 -- 172.21.15.1:0/1687267447 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f75540a32c0 msgr2=0x7f75540a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:49.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.900+0000 7f75725e0640 1 --2- 172.21.15.1:0/1687267447 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f75540a32c0 0x7f75540a5780 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7560000c00 tx=0x7f7560005b50 comp rx=0 tx=0).stop 2024-09-19T09:35:49.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.900+0000 7f75725e0640 1 -- 172.21.15.1:0/1687267447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f756c100e20 msgr2=0x7f756c1970f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:49.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.900+0000 7f75725e0640 1 --2- 172.21.15.1:0/1687267447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f756c100e20 0x7f756c1970f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f755c00d950 tx=0x7f755c00de10 comp rx=0 tx=0).stop 2024-09-19T09:35:49.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.900+0000 7f75725e0640 1 -- 172.21.15.1:0/1687267447 shutdown_connections 2024-09-19T09:35:49.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.900+0000 7f75725e0640 1 --2- 172.21.15.1:0/1687267447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f756c102ef0 0x7f756c197b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:49.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.900+0000 7f75725e0640 1 --2- 172.21.15.1:0/1687267447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f756c102570 0x7f756c197630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:49.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.900+0000 7f75725e0640 1 --2- 172.21.15.1:0/1687267447 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f75540a32c0 0x7f75540a5780 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:49.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.900+0000 7f75725e0640 1 --2- 172.21.15.1:0/1687267447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f756c100e20 0x7f756c1970f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:49.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.900+0000 7f75725e0640 1 -- 172.21.15.1:0/1687267447 >> 172.21.15.1:0/1687267447 conn(0x7f756c0fc7d0 msgr2=0x7f756c106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:49.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.900+0000 7f75725e0640 1 -- 172.21.15.1:0/1687267447 shutdown_connections 2024-09-19T09:35:49.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:49.900+0000 7f75725e0640 1 -- 172.21.15.1:0/1687267447 wait complete. 2024-09-19T09:35:50.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:49 smithi022 ceph-mon[35583]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:50.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:49 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:50.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:49 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:50.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:49 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:50.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:49 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:50.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:49 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:50.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:49 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:50.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:49 smithi022 ceph-mon[35583]: Deploying daemon mds.h on smithi022 2024-09-19T09:35:50.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:49 smithi022 ceph-mon[35583]: mds.? [v2:172.21.15.121:6836/3966150520,v1:172.21.15.121:6837/3966150520] up:boot 2024-09-19T09:35:50.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:49 smithi022 ceph-mon[35583]: fsmap 7 up:standby 2024-09-19T09:35:50.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:49 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:35:50.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:49 smithi121 ceph-mon[35577]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:50.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:49 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:50.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:49 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:50.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:49 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:50.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:49 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:50.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:49 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:50.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:49 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:50.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:49 smithi121 ceph-mon[35577]: Deploying daemon mds.h on smithi022 2024-09-19T09:35:50.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:49 smithi121 ceph-mon[35577]: mds.? [v2:172.21.15.121:6836/3966150520,v1:172.21.15.121:6837/3966150520] up:boot 2024-09-19T09:35:50.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:49 smithi121 ceph-mon[35577]: fsmap 7 up:standby 2024-09-19T09:35:50.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:49 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:35:50.221 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:49 smithi001 ceph-mon[31225]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:50.221 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:49 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:50.221 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:49 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:50.221 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:49 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:50.221 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:49 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:50.221 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:49 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:50.221 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:49 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:50.222 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:49 smithi001 ceph-mon[31225]: Deploying daemon mds.h on smithi022 2024-09-19T09:35:50.222 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:49 smithi001 ceph-mon[31225]: mds.? [v2:172.21.15.121:6836/3966150520,v1:172.21.15.121:6837/3966150520] up:boot 2024-09-19T09:35:50.222 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:49 smithi001 ceph-mon[31225]: fsmap 7 up:standby 2024-09-19T09:35:50.222 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:49 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:35:51.025 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:50 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1687267447' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:51.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:50 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1687267447' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:51.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:50 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1687267447' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:51.614 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:35:51 smithi022 systemd[1]: Started Ceph mds.h for 57238232-7669-11ef-bceb-c7b262605968. 2024-09-19T09:35:52.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:51 smithi022 ceph-mon[35583]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:52.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:51 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:52.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:51 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:52.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:51 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:52.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:51 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:52.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:51 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:52.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:51 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:52.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:51 smithi121 ceph-mon[35577]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:52.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:51 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:52.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:51 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:52.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:51 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:52.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:51 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:52.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:51 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:52.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:51 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:52.149 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:51 smithi001 ceph-mon[31225]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:52.149 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:51 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:52.149 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:51 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:52.150 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:51 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:52.150 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:51 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:52.150 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:51 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:52.150 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:51 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:52.600 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:35:52.873 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:52.995 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:52 smithi001 ceph-mon[31225]: Deploying daemon mds.i on smithi121 2024-09-19T09:35:52.995 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:52 smithi001 ceph-mon[31225]: mds.? [v2:172.21.15.22:6836/1288432373,v1:172.21.15.22:6837/1288432373] up:boot 2024-09-19T09:35:52.995 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:52 smithi001 ceph-mon[31225]: fsmap 8 up:standby 2024-09-19T09:35:52.995 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:52 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:35:53.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:52 smithi121 ceph-mon[35577]: Deploying daemon mds.i on smithi121 2024-09-19T09:35:53.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:52 smithi121 ceph-mon[35577]: mds.? [v2:172.21.15.22:6836/1288432373,v1:172.21.15.22:6837/1288432373] up:boot 2024-09-19T09:35:53.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:52 smithi121 ceph-mon[35577]: fsmap 8 up:standby 2024-09-19T09:35:53.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:52 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:35:53.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:52 smithi022 ceph-mon[35583]: Deploying daemon mds.i on smithi121 2024-09-19T09:35:53.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:52 smithi022 ceph-mon[35583]: mds.? [v2:172.21.15.22:6836/1288432373,v1:172.21.15.22:6837/1288432373] up:boot 2024-09-19T09:35:53.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:52 smithi022 ceph-mon[35583]: fsmap 8 up:standby 2024-09-19T09:35:53.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:52 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:35:53.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.391+0000 7f17698d2640 1 -- 172.21.15.1:0/1122304907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1764102790 msgr2=0x7f17641067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:53.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.391+0000 7f17698d2640 1 --2- 172.21.15.1:0/1122304907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1764102790 0x7f17641067e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f174c009900 tx=0x7f174c02a410 comp rx=0 tx=0).stop 2024-09-19T09:35:53.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.391+0000 7f17698d2640 1 -- 172.21.15.1:0/1122304907 shutdown_connections 2024-09-19T09:35:53.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.391+0000 7f17698d2640 1 --2- 172.21.15.1:0/1122304907 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1764106f10 0x7f176410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.391+0000 7f17698d2640 1 --2- 172.21.15.1:0/1122304907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1764102790 0x7f17641067e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.391+0000 7f17698d2640 1 --2- 172.21.15.1:0/1122304907 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1764101de0 0x7f17641021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.391+0000 7f17698d2640 1 -- 172.21.15.1:0/1122304907 >> 172.21.15.1:0/1122304907 conn(0x7f17640fd8c0 msgr2=0x7f17640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:53.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.391+0000 7f17698d2640 1 -- 172.21.15.1:0/1122304907 shutdown_connections 2024-09-19T09:35:53.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.391+0000 7f17698d2640 1 -- 172.21.15.1:0/1122304907 wait complete. 2024-09-19T09:35:53.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.392+0000 7f17698d2640 1 Processor -- start 2024-09-19T09:35:53.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.392+0000 7f17698d2640 1 -- start start 2024-09-19T09:35:53.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.392+0000 7f17698d2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1764101de0 0x7f17640744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:53.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.392+0000 7f17698d2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1764102790 0x7f1764074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:53.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.393+0000 7f17698d2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1764106f10 0x7f1764074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:53.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.393+0000 7f17698d2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1764111f70 con 0x7f1764101de0 2024-09-19T09:35:53.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.393+0000 7f17698d2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1764111df0 con 0x7f1764102790 2024-09-19T09:35:53.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.393+0000 7f17698d2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f17641120f0 con 0x7f1764106f10 2024-09-19T09:35:53.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.393+0000 7f1762ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1764101de0 0x7f17640744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:53.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.393+0000 7f1762ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1764101de0 0x7f17640744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:58964/0 (socket says 172.21.15.1:58964) 2024-09-19T09:35:53.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.393+0000 7f1762ffd640 1 -- 172.21.15.1:0/593408345 learned_addr learned my addr 172.21.15.1:0/593408345 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:35:53.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.393+0000 7f17637fe640 1 --2- 172.21.15.1:0/593408345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1764106f10 0x7f1764074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:53.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.393+0000 7f175a7fc640 1 --2- 172.21.15.1:0/593408345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1764102790 0x7f1764074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:53.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.393+0000 7f1762ffd640 1 -- 172.21.15.1:0/593408345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1764106f10 msgr2=0x7f1764074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:53.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.393+0000 7f1762ffd640 1 --2- 172.21.15.1:0/593408345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1764106f10 0x7f1764074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.393+0000 7f1762ffd640 1 -- 172.21.15.1:0/593408345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1764102790 msgr2=0x7f1764074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:53.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.393+0000 7f1762ffd640 1 --2- 172.21.15.1:0/593408345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1764102790 0x7f1764074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.393+0000 7f1762ffd640 1 -- 172.21.15.1:0/593408345 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17641a69d0 con 0x7f1764101de0 2024-09-19T09:35:53.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.393+0000 7f175a7fc640 1 --2- 172.21.15.1:0/593408345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1764102790 0x7f1764074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:35:53.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.393+0000 7f1762ffd640 1 --2- 172.21.15.1:0/593408345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1764101de0 0x7f17640744f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f175400e9f0 tx=0x7f175400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:53.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.393+0000 7f17688d0640 1 -- 172.21.15.1:0/593408345 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f175400cd80 con 0x7f1764101de0 2024-09-19T09:35:53.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.393+0000 7f17698d2640 1 -- 172.21.15.1:0/593408345 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17641a6cc0 con 0x7f1764101de0 2024-09-19T09:35:53.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.393+0000 7f17688d0640 1 -- 172.21.15.1:0/593408345 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1754005500 con 0x7f1764101de0 2024-09-19T09:35:53.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.393+0000 7f17688d0640 1 -- 172.21.15.1:0/593408345 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1754010690 con 0x7f1764101de0 2024-09-19T09:35:53.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.393+0000 7f17698d2640 1 -- 172.21.15.1:0/593408345 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17641a71b0 con 0x7f1764101de0 2024-09-19T09:35:53.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.394+0000 7f17698d2640 1 -- 172.21.15.1:0/593408345 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17641021c0 con 0x7f1764101de0 2024-09-19T09:35:53.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.396+0000 7f17688d0640 1 -- 172.21.15.1:0/593408345 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f17540046c0 con 0x7f1764101de0 2024-09-19T09:35:53.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.396+0000 7f17688d0640 1 --2- 172.21.15.1:0/593408345 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f17500a32c0 0x7f17500a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:53.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.396+0000 7f175a7fc640 1 --2- 172.21.15.1:0/593408345 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f17500a32c0 0x7f17500a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:53.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.397+0000 7f17688d0640 1 -- 172.21.15.1:0/593408345 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f17540cf8a0 con 0x7f1764101de0 2024-09-19T09:35:53.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.397+0000 7f175a7fc640 1 --2- 172.21.15.1:0/593408345 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f17500a32c0 0x7f17500a5780 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f174c000c00 tx=0x7f174c032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:53.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.400+0000 7f17688d0640 1 -- 172.21.15.1:0/593408345 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f175409ca60 con 0x7f1764101de0 2024-09-19T09:35:53.501 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 19 09:35:53 smithi121 systemd[1]: Starting Ceph mds.i for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:35:53.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.613+0000 7f17698d2640 1 -- 172.21.15.1:0/593408345 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f176410a180 con 0x7f1764101de0 2024-09-19T09:35:53.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.614+0000 7f17688d0640 1 -- 172.21.15.1:0/593408345 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7210 (secure 0 0 0) 0x7f175409c360 con 0x7f1764101de0 2024-09-19T09:35:53.616 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:35:53.616 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":9,"btime":"2024-09-19T09:35:51:853563+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-19T09:35:53.616 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 9 2024-09-19T09:35:53.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.617+0000 7f17698d2640 1 -- 172.21.15.1:0/593408345 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f17500a32c0 msgr2=0x7f17500a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:53.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.617+0000 7f17698d2640 1 --2- 172.21.15.1:0/593408345 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f17500a32c0 0x7f17500a5780 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f174c000c00 tx=0x7f174c032c70 comp rx=0 tx=0).stop 2024-09-19T09:35:53.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.617+0000 7f17698d2640 1 -- 172.21.15.1:0/593408345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1764101de0 msgr2=0x7f17640744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:53.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.617+0000 7f17698d2640 1 --2- 172.21.15.1:0/593408345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1764101de0 0x7f17640744f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f175400e9f0 tx=0x7f175400edf0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.617+0000 7f17698d2640 1 -- 172.21.15.1:0/593408345 shutdown_connections 2024-09-19T09:35:53.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.617+0000 7f17698d2640 1 --2- 172.21.15.1:0/593408345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1764106f10 0x7f1764074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.617+0000 7f17698d2640 1 --2- 172.21.15.1:0/593408345 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f17500a32c0 0x7f17500a5780 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.617+0000 7f17698d2640 1 --2- 172.21.15.1:0/593408345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1764102790 0x7f1764074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.617+0000 7f17698d2640 1 --2- 172.21.15.1:0/593408345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1764101de0 0x7f17640744f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:53.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.617+0000 7f17698d2640 1 -- 172.21.15.1:0/593408345 >> 172.21.15.1:0/593408345 conn(0x7f17640fd8c0 msgr2=0x7f17640fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:53.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.617+0000 7f17698d2640 1 -- 172.21.15.1:0/593408345 shutdown_connections 2024-09-19T09:35:53.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:53.617+0000 7f17698d2640 1 -- 172.21.15.1:0/593408345 wait complete. 2024-09-19T09:35:53.753 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 19 09:35:53 smithi121 podman[65174]: 2024-09-19 09:35:53.611635534 +0000 UTC m=+0.015523399 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:35:53.753 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 19 09:35:53 smithi121 podman[65174]: 2024-09-19 09:35:53.752792508 +0000 UTC m=+0.156680367 container create c569610bce6a6272a799b0e19fdbf3069ab7255cdee61a8b801c9c125196d021 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-i, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-19T09:35:54.015 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:53 smithi121 ceph-mon[35577]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:54.015 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:53 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/593408345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:54.015 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 19 09:35:53 smithi121 podman[65174]: 2024-09-19 09:35:53.988944203 +0000 UTC m=+0.392832064 container init c569610bce6a6272a799b0e19fdbf3069ab7255cdee61a8b801c9c125196d021 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-i, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T09:35:54.015 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 19 09:35:53 smithi121 podman[65174]: 2024-09-19 09:35:53.991694011 +0000 UTC m=+0.395581870 container start c569610bce6a6272a799b0e19fdbf3069ab7255cdee61a8b801c9c125196d021 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-i, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:35:54.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:53 smithi001 ceph-mon[31225]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:54.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:53 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/593408345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:54.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:53 smithi022 ceph-mon[35583]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:54.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:53 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/593408345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:54.367 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 19 09:35:54 smithi121 ceph-mds[65193]: -- 172.21.15.121:0/2644300959 <== mon.1 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55914ff45860 con 0x55914ff23000 2024-09-19T09:35:54.367 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 19 09:35:54 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-i[65189]: starting mds.i at 2024-09-19T09:35:54.367 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 19 09:35:54 smithi121 bash[65174]: c569610bce6a6272a799b0e19fdbf3069ab7255cdee61a8b801c9c125196d021 2024-09-19T09:35:54.367 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 19 09:35:54 smithi121 systemd[1]: Started Ceph mds.i for 57238232-7669-11ef-bceb-c7b262605968. 2024-09-19T09:35:55.433 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:55 smithi121 ceph-mon[35577]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:55.433 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:55 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:55.434 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:55 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:55.434 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:55 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:55.434 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:55 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:55.434 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:55 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:55.434 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:55 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:55.434 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:55 smithi121 ceph-mon[35577]: Deploying daemon mds.g on smithi001 2024-09-19T09:35:55.434 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:55 smithi121 ceph-mon[35577]: mds.? [v2:172.21.15.121:6838/3279971690,v1:172.21.15.121:6839/3279971690] up:boot 2024-09-19T09:35:55.434 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:55 smithi121 ceph-mon[35577]: fsmap 9 up:standby 2024-09-19T09:35:55.434 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:55 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:35:55.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:55 smithi001 ceph-mon[31225]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:55.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:55 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:55.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:55 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:55.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:55 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:55.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:55 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:55.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:55 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:55.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:55 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:55.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:55 smithi001 ceph-mon[31225]: Deploying daemon mds.g on smithi001 2024-09-19T09:35:55.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:55 smithi001 ceph-mon[31225]: mds.? [v2:172.21.15.121:6838/3279971690,v1:172.21.15.121:6839/3279971690] up:boot 2024-09-19T09:35:55.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:55 smithi001 ceph-mon[31225]: fsmap 9 up:standby 2024-09-19T09:35:55.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:55 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:35:55.542 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:55 smithi022 ceph-mon[35583]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:55.542 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:55 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:55.542 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:55 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:55.542 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:55 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:55.542 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:55 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:55.543 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:55 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:55.543 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:55 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:55.543 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:55 smithi022 ceph-mon[35583]: Deploying daemon mds.g on smithi001 2024-09-19T09:35:55.543 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:55 smithi022 ceph-mon[35583]: mds.? [v2:172.21.15.121:6838/3279971690,v1:172.21.15.121:6839/3279971690] up:boot 2024-09-19T09:35:55.543 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:55 smithi022 ceph-mon[35583]: fsmap 9 up:standby 2024-09-19T09:35:55.543 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:55 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:35:56.338 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:35:56.365 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 09:35:56 smithi001 systemd[1]: Starting Ceph mds.g for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:35:56.648 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 09:35:56 smithi001 podman[68679]: 2024-09-19 09:35:56.387148703 +0000 UTC m=+0.017154967 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:35:56.648 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 09:35:56 smithi001 podman[68679]: 2024-09-19 09:35:56.522145292 +0000 UTC m=+0.152151543 container create 14008ea33ca1a88a75fcff0dc8c9d93eb857d734aad64747cfa77172576ec545 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-g, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-19T09:35:56.922 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:35:57.045 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 09:35:56 smithi001 podman[68679]: 2024-09-19 09:35:56.769418661 +0000 UTC m=+0.399424921 container init 14008ea33ca1a88a75fcff0dc8c9d93eb857d734aad64747cfa77172576ec545 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-g, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T09:35:57.045 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 09:35:56 smithi001 podman[68679]: 2024-09-19 09:35:56.772915381 +0000 UTC m=+0.402921634 container start 14008ea33ca1a88a75fcff0dc8c9d93eb857d734aad64747cfa77172576ec545 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-g, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True) 2024-09-19T09:35:57.045 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 09:35:56 smithi001 ceph-mds[68723]: -- 172.21.15.1:0/1466475954 <== mon.0 v2:172.21.15.1:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557552ac3c20 con 0x557552aa1000 2024-09-19T09:35:57.045 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 09:35:56 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-g[68707]: starting mds.g at 2024-09-19T09:35:57.045 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 09:35:56 smithi001 bash[68679]: 14008ea33ca1a88a75fcff0dc8c9d93eb857d734aad64747cfa77172576ec545 2024-09-19T09:35:57.045 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 09:35:56 smithi001 systemd[1]: Started Ceph mds.g for 57238232-7669-11ef-bceb-c7b262605968. 2024-09-19T09:35:57.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.424+0000 7ff46b18c640 1 -- 172.21.15.1:0/1032815922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff464101420 msgr2=0x7ff46410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:57.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.424+0000 7ff46b18c640 1 --2- 172.21.15.1:0/1032815922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff464101420 0x7ff46410d950 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff45c009930 tx=0x7ff45c02a420 comp rx=0 tx=0).stop 2024-09-19T09:35:57.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.424+0000 7ff46b18c640 1 -- 172.21.15.1:0/1032815922 shutdown_connections 2024-09-19T09:35:57.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.424+0000 7ff46b18c640 1 --2- 172.21.15.1:0/1032815922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff464101420 0x7ff46410d950 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.424+0000 7ff46b18c640 1 --2- 172.21.15.1:0/1032815922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff464100a80 0x7ff464100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.424+0000 7ff46b18c640 1 --2- 172.21.15.1:0/1032815922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff464106a80 0x7ff464106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.424+0000 7ff46b18c640 1 -- 172.21.15.1:0/1032815922 >> 172.21.15.1:0/1032815922 conn(0x7ff4640fc7a0 msgr2=0x7ff4640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:57.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.424+0000 7ff46b18c640 1 -- 172.21.15.1:0/1032815922 shutdown_connections 2024-09-19T09:35:57.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.424+0000 7ff46b18c640 1 -- 172.21.15.1:0/1032815922 wait complete. 2024-09-19T09:35:57.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.425+0000 7ff46b18c640 1 Processor -- start 2024-09-19T09:35:57.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.425+0000 7ff46b18c640 1 -- start start 2024-09-19T09:35:57.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.425+0000 7ff46b18c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff464100a80 0x7ff4641991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:57.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.425+0000 7ff46b18c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff464101420 0x7ff464199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:57.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.425+0000 7ff46b18c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff464106a80 0x7ff4641a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:57.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.425+0000 7ff46b18c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff464110e80 con 0x7ff464106a80 2024-09-19T09:35:57.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.425+0000 7ff46b18c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff464110d00 con 0x7ff464101420 2024-09-19T09:35:57.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.425+0000 7ff46b18c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff464111000 con 0x7ff464100a80 2024-09-19T09:35:57.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.425+0000 7ff469729640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff464106a80 0x7ff4641a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:57.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.425+0000 7ff469729640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff464106a80 0x7ff4641a4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44188/0 (socket says 172.21.15.1:44188) 2024-09-19T09:35:57.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.425+0000 7ff469729640 1 -- 172.21.15.1:0/1622133962 learned_addr learned my addr 172.21.15.1:0/1622133962 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:35:57.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.425+0000 7ff468f28640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff464100a80 0x7ff4641991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:57.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.425+0000 7ff463fff640 1 --2- 172.21.15.1:0/1622133962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff464101420 0x7ff464199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:57.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.426+0000 7ff469729640 1 -- 172.21.15.1:0/1622133962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff464100a80 msgr2=0x7ff4641991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:57.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.426+0000 7ff469729640 1 --2- 172.21.15.1:0/1622133962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff464100a80 0x7ff4641991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.426+0000 7ff469729640 1 -- 172.21.15.1:0/1622133962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff464101420 msgr2=0x7ff464199700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:57.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.426+0000 7ff469729640 1 --2- 172.21.15.1:0/1622133962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff464101420 0x7ff464199700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.426+0000 7ff469729640 1 -- 172.21.15.1:0/1622133962 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4641a4780 con 0x7ff464106a80 2024-09-19T09:35:57.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.426+0000 7ff469729640 1 --2- 172.21.15.1:0/1622133962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff464106a80 0x7ff4641a4240 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff45c005ab0 tx=0x7ff45c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:57.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.426+0000 7ff461ffb640 1 -- 172.21.15.1:0/1622133962 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45c03f030 con 0x7ff464106a80 2024-09-19T09:35:57.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.426+0000 7ff461ffb640 1 -- 172.21.15.1:0/1622133962 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff45c003ce0 con 0x7ff464106a80 2024-09-19T09:35:57.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.426+0000 7ff46b18c640 1 -- 172.21.15.1:0/1622133962 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4641a4950 con 0x7ff464106a80 2024-09-19T09:35:57.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.426+0000 7ff461ffb640 1 -- 172.21.15.1:0/1622133962 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45c035070 con 0x7ff464106a80 2024-09-19T09:35:57.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.426+0000 7ff46b18c640 1 -- 172.21.15.1:0/1622133962 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4641a4e00 con 0x7ff464106a80 2024-09-19T09:35:57.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.427+0000 7ff46b18c640 1 -- 172.21.15.1:0/1622133962 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff464100ee0 con 0x7ff464106a80 2024-09-19T09:35:57.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.429+0000 7ff461ffb640 1 -- 172.21.15.1:0/1622133962 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7ff45c042030 con 0x7ff464106a80 2024-09-19T09:35:57.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.430+0000 7ff461ffb640 1 --2- 172.21.15.1:0/1622133962 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff4500a3240 0x7ff4500a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:35:57.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.430+0000 7ff468f28640 1 --2- 172.21.15.1:0/1622133962 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff4500a3240 0x7ff4500a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:35:57.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.430+0000 7ff461ffb640 1 -- 172.21.15.1:0/1622133962 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7ff45c0ef900 con 0x7ff464106a80 2024-09-19T09:35:57.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.430+0000 7ff468f28640 1 --2- 172.21.15.1:0/1622133962 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff4500a3240 0x7ff4500a5700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff44c005fd0 tx=0x7ff44c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:35:57.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.434+0000 7ff461ffb640 1 -- 172.21.15.1:0/1622133962 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff45c0bc3d0 con 0x7ff464106a80 2024-09-19T09:35:57.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.654+0000 7ff46b18c640 1 -- 172.21.15.1:0/1622133962 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff4641a5030 con 0x7ff464106a80 2024-09-19T09:35:57.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.655+0000 7ff461ffb640 1 -- 172.21.15.1:0/1622133962 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8863 (secure 0 0 0) 0x7ff45c0c06d0 con 0x7ff464106a80 2024-09-19T09:35:57.656 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:35:57.657 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":11,"btime":"2024-09-19T09:35:57:173469+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24490,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6839/3279971690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3279971690},{"type":"v1","addr":"172.21.15.121:6839","nonce":3279971690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T09:35:57.657 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 11 2024-09-19T09:35:57.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.657+0000 7ff46b18c640 1 -- 172.21.15.1:0/1622133962 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff4500a3240 msgr2=0x7ff4500a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:57.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.657+0000 7ff46b18c640 1 --2- 172.21.15.1:0/1622133962 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff4500a3240 0x7ff4500a5700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff44c005fd0 tx=0x7ff44c00b390 comp rx=0 tx=0).stop 2024-09-19T09:35:57.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.657+0000 7ff46b18c640 1 -- 172.21.15.1:0/1622133962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff464106a80 msgr2=0x7ff4641a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:35:57.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.657+0000 7ff46b18c640 1 --2- 172.21.15.1:0/1622133962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff464106a80 0x7ff4641a4240 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff45c005ab0 tx=0x7ff45c0042f0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.657+0000 7ff46b18c640 1 -- 172.21.15.1:0/1622133962 shutdown_connections 2024-09-19T09:35:57.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.657+0000 7ff46b18c640 1 --2- 172.21.15.1:0/1622133962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff464106a80 0x7ff4641a4240 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.657+0000 7ff46b18c640 1 --2- 172.21.15.1:0/1622133962 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff4500a3240 0x7ff4500a5700 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.657+0000 7ff46b18c640 1 --2- 172.21.15.1:0/1622133962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff464101420 0x7ff464199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.657+0000 7ff46b18c640 1 --2- 172.21.15.1:0/1622133962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff464100a80 0x7ff4641991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:35:57.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.657+0000 7ff46b18c640 1 -- 172.21.15.1:0/1622133962 >> 172.21.15.1:0/1622133962 conn(0x7ff4640fc7a0 msgr2=0x7ff4640fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:35:57.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.657+0000 7ff46b18c640 1 -- 172.21.15.1:0/1622133962 shutdown_connections 2024-09-19T09:35:57.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:35:57.657+0000 7ff46b18c640 1 -- 172.21.15.1:0/1622133962 wait complete. 2024-09-19T09:35:58.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:57 smithi001 ceph-mon[31225]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:58.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:57 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:58.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:57 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:58.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:57 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:58.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:57 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:58.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:57 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:58.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:57 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:58.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:57 smithi001 ceph-mon[31225]: Deploying daemon mds.a on smithi001 2024-09-19T09:35:58.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:57 smithi001 ceph-mon[31225]: mds.? [v2:172.21.15.1:6838/2581765152,v1:172.21.15.1:6839/2581765152] up:boot 2024-09-19T09:35:58.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:57 smithi001 ceph-mon[31225]: fsmap 10 up:standby 2024-09-19T09:35:58.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:57 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:35:58.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:57 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1622133962' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:58.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:57 smithi022 ceph-mon[35583]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:58.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:57 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:58.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:57 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:58.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:57 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:58.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:57 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:58.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:57 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:58.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:57 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:58.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:57 smithi022 ceph-mon[35583]: Deploying daemon mds.a on smithi001 2024-09-19T09:35:58.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:57 smithi022 ceph-mon[35583]: mds.? [v2:172.21.15.1:6838/2581765152,v1:172.21.15.1:6839/2581765152] up:boot 2024-09-19T09:35:58.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:57 smithi022 ceph-mon[35583]: fsmap 10 up:standby 2024-09-19T09:35:58.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:57 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:35:58.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:57 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1622133962' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:58.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:57 smithi121 ceph-mon[35577]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:35:58.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:57 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:58.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:57 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:58.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:57 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:35:58.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:57 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:35:58.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:57 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:35:58.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:57 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:35:58.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:57 smithi121 ceph-mon[35577]: Deploying daemon mds.a on smithi001 2024-09-19T09:35:58.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:57 smithi121 ceph-mon[35577]: mds.? [v2:172.21.15.1:6838/2581765152,v1:172.21.15.1:6839/2581765152] up:boot 2024-09-19T09:35:58.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:57 smithi121 ceph-mon[35577]: fsmap 10 up:standby 2024-09-19T09:35:58.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:57 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:35:58.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:57 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1622133962' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:35:59.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:35:59 smithi001 ceph-mon[31225]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:00.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:35:59 smithi022 ceph-mon[35583]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:00.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:35:59 smithi121 ceph-mon[35577]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:00.441 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:36:00.721 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:01.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.236+0000 7f133c5c6640 1 -- 172.21.15.1:0/753824333 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1334108300 msgr2=0x7f133410ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:01.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.236+0000 7f133c5c6640 1 --2- 172.21.15.1:0/753824333 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1334108300 0x7f133410ec70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f132c009930 tx=0x7f132c02a440 comp rx=0 tx=0).stop 2024-09-19T09:36:01.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.236+0000 7f133c5c6640 1 -- 172.21.15.1:0/753824333 shutdown_connections 2024-09-19T09:36:01.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.236+0000 7f133c5c6640 1 --2- 172.21.15.1:0/753824333 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1334108300 0x7f133410ec70 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.236+0000 7f133c5c6640 1 --2- 172.21.15.1:0/753824333 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1334103780 0x7f1334107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.236+0000 7f133c5c6640 1 --2- 172.21.15.1:0/753824333 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1334102dd0 0x7f13341031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.236+0000 7f133c5c6640 1 -- 172.21.15.1:0/753824333 >> 172.21.15.1:0/753824333 conn(0x7f13340fc7d0 msgr2=0x7f13340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:01.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.236+0000 7f133c5c6640 1 -- 172.21.15.1:0/753824333 shutdown_connections 2024-09-19T09:36:01.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.236+0000 7f133c5c6640 1 -- 172.21.15.1:0/753824333 wait complete. 2024-09-19T09:36:01.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.237+0000 7f133c5c6640 1 Processor -- start 2024-09-19T09:36:01.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.237+0000 7f133c5c6640 1 -- start start 2024-09-19T09:36:01.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.237+0000 7f133c5c6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1334102dd0 0x7f13341986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:01.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.237+0000 7f133c5c6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1334103780 0x7f1334198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:01.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.237+0000 7f133c5c6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1334108300 0x7f133419cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:01.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.237+0000 7f133c5c6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1334112170 con 0x7f1334108300 2024-09-19T09:36:01.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.237+0000 7f133c5c6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1334111ff0 con 0x7f1334102dd0 2024-09-19T09:36:01.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.237+0000 7f133c5c6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f13341122f0 con 0x7f1334103780 2024-09-19T09:36:01.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.237+0000 7f133ab63640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1334108300 0x7f133419cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:01.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.237+0000 7f133ab63640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1334108300 0x7f133419cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44218/0 (socket says 172.21.15.1:44218) 2024-09-19T09:36:01.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.237+0000 7f133ab63640 1 -- 172.21.15.1:0/460577517 learned_addr learned my addr 172.21.15.1:0/460577517 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:01.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.237+0000 7f133a362640 1 --2- 172.21.15.1:0/460577517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1334102dd0 0x7f13341986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:01.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.237+0000 7f1339b61640 1 --2- 172.21.15.1:0/460577517 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1334103780 0x7f1334198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:01.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.237+0000 7f133ab63640 1 -- 172.21.15.1:0/460577517 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1334103780 msgr2=0x7f1334198c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:01.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.237+0000 7f133ab63640 1 --2- 172.21.15.1:0/460577517 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1334103780 0x7f1334198c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.237+0000 7f133ab63640 1 -- 172.21.15.1:0/460577517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1334102dd0 msgr2=0x7f13341986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:01.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.237+0000 7f133ab63640 1 --2- 172.21.15.1:0/460577517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1334102dd0 0x7f13341986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.237+0000 7f133ab63640 1 -- 172.21.15.1:0/460577517 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f133419d680 con 0x7f1334108300 2024-09-19T09:36:01.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.238+0000 7f133ab63640 1 --2- 172.21.15.1:0/460577517 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1334108300 0x7f133419cfa0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f132c005ab0 tx=0x7f132c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:01.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.238+0000 7f13337fe640 1 -- 172.21.15.1:0/460577517 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f132c03f030 con 0x7f1334108300 2024-09-19T09:36:01.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.238+0000 7f13337fe640 1 -- 172.21.15.1:0/460577517 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f132c003ce0 con 0x7f1334108300 2024-09-19T09:36:01.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.238+0000 7f133c5c6640 1 -- 172.21.15.1:0/460577517 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f133419d910 con 0x7f1334108300 2024-09-19T09:36:01.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.238+0000 7f13337fe640 1 -- 172.21.15.1:0/460577517 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f132c035070 con 0x7f1334108300 2024-09-19T09:36:01.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.238+0000 7f133c5c6640 1 -- 172.21.15.1:0/460577517 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13341a5250 con 0x7f1334108300 2024-09-19T09:36:01.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.239+0000 7f133c5c6640 1 -- 172.21.15.1:0/460577517 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f133406a7b0 con 0x7f1334108300 2024-09-19T09:36:01.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.240+0000 7f13337fe640 1 -- 172.21.15.1:0/460577517 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f132c042030 con 0x7f1334108300 2024-09-19T09:36:01.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.241+0000 7f13337fe640 1 --2- 172.21.15.1:0/460577517 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f131c0a3240 0x7f131c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:01.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.241+0000 7f133a362640 1 --2- 172.21.15.1:0/460577517 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f131c0a3240 0x7f131c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:01.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.241+0000 7f13337fe640 1 -- 172.21.15.1:0/460577517 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f132c0efa10 con 0x7f1334108300 2024-09-19T09:36:01.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.241+0000 7f133a362640 1 --2- 172.21.15.1:0/460577517 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f131c0a3240 0x7f131c0a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f132400a400 tx=0x7f132400d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:01.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.245+0000 7f13337fe640 1 -- 172.21.15.1:0/460577517 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f132c0bcbd0 con 0x7f1334108300 2024-09-19T09:36:01.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.458+0000 7f133c5c6640 1 -- 172.21.15.1:0/460577517 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f133410a290 con 0x7f1334108300 2024-09-19T09:36:01.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.459+0000 7f13337fe640 1 -- 172.21.15.1:0/460577517 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9686 (secure 0 0 0) 0x7f132c0bc4d0 con 0x7f1334108300 2024-09-19T09:36:01.460 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:36:01.461 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":12,"btime":"2024-09-19T09:36:00:939759+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24490,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6839/3279971690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3279971690},{"type":"v1","addr":"172.21.15.121:6839","nonce":3279971690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T09:36:01.461 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 12 2024-09-19T09:36:01.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.461+0000 7f133c5c6640 1 -- 172.21.15.1:0/460577517 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f131c0a3240 msgr2=0x7f131c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:01.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.461+0000 7f133c5c6640 1 --2- 172.21.15.1:0/460577517 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f131c0a3240 0x7f131c0a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f132400a400 tx=0x7f132400d040 comp rx=0 tx=0).stop 2024-09-19T09:36:01.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.461+0000 7f133c5c6640 1 -- 172.21.15.1:0/460577517 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1334108300 msgr2=0x7f133419cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:01.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.461+0000 7f133c5c6640 1 --2- 172.21.15.1:0/460577517 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1334108300 0x7f133419cfa0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f132c005ab0 tx=0x7f132c0042f0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.461+0000 7f133c5c6640 1 -- 172.21.15.1:0/460577517 shutdown_connections 2024-09-19T09:36:01.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.461+0000 7f133c5c6640 1 --2- 172.21.15.1:0/460577517 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1334108300 0x7f133419cfa0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.461+0000 7f133c5c6640 1 --2- 172.21.15.1:0/460577517 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1334103780 0x7f1334198c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.461+0000 7f133c5c6640 1 --2- 172.21.15.1:0/460577517 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f131c0a3240 0x7f131c0a5700 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.461+0000 7f133c5c6640 1 --2- 172.21.15.1:0/460577517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1334102dd0 0x7f13341986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:01.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.461+0000 7f133c5c6640 1 -- 172.21.15.1:0/460577517 >> 172.21.15.1:0/460577517 conn(0x7f13340fc7d0 msgr2=0x7f1334105e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:01.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.462+0000 7f133c5c6640 1 -- 172.21.15.1:0/460577517 shutdown_connections 2024-09-19T09:36:01.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:01.462+0000 7f133c5c6640 1 -- 172.21.15.1:0/460577517 wait complete. 2024-09-19T09:36:01.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:01 smithi001 ceph-mon[31225]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:01.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:01 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:01.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:01 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:01.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:01 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:01.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:01 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:01.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:01 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:01.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:01 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:01.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:01 smithi001 ceph-mon[31225]: Deploying daemon mds.b on smithi022 2024-09-19T09:36:01.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:01 smithi001 ceph-mon[31225]: mds.? [v2:172.21.15.1:6840/3388580532,v1:172.21.15.1:6841/3388580532] up:boot 2024-09-19T09:36:01.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:01 smithi001 ceph-mon[31225]: fsmap 11 up:standby 2024-09-19T09:36:01.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:01 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:36:01.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:01 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/460577517' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:01.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:01 smithi022 ceph-mon[35583]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:01.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:01 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:01.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:01 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:01.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:01 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:01.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:01 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:01.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:01 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:01.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:01 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:01.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:01 smithi022 ceph-mon[35583]: Deploying daemon mds.b on smithi022 2024-09-19T09:36:01.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:01 smithi022 ceph-mon[35583]: mds.? [v2:172.21.15.1:6840/3388580532,v1:172.21.15.1:6841/3388580532] up:boot 2024-09-19T09:36:01.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:01 smithi022 ceph-mon[35583]: fsmap 11 up:standby 2024-09-19T09:36:01.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:01 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:36:01.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:01 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/460577517' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:01.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:01 smithi121 ceph-mon[35577]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:01.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:01 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:01.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:01 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:01.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:01 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:01.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:01 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T09:36:01.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:01 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T09:36:01.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:01 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:01.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:01 smithi121 ceph-mon[35577]: Deploying daemon mds.b on smithi022 2024-09-19T09:36:01.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:01 smithi121 ceph-mon[35577]: mds.? [v2:172.21.15.1:6840/3388580532,v1:172.21.15.1:6841/3388580532] up:boot 2024-09-19T09:36:01.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:01 smithi121 ceph-mon[35577]: fsmap 11 up:standby 2024-09-19T09:36:01.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:01 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:36:01.868 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:01 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/460577517' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:02.802 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:36:02 smithi022 systemd[1]: Starting Ceph mds.b for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:36:03.057 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:36:02 smithi022 podman[65328]: 2024-09-19 09:36:02.703575558 +0000 UTC m=+0.015859877 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:36:03.057 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:36:02 smithi022 podman[65328]: 2024-09-19 09:36:02.811692652 +0000 UTC m=+0.123976956 container create 3f7d58492c6e29a8de24eab0296a96302861de9cfc4b0ad097c1b8f409a17c74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731) 2024-09-19T09:36:03.364 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:36:03 smithi022 podman[65328]: 2024-09-19 09:36:03.056258489 +0000 UTC m=+0.368542794 container init 3f7d58492c6e29a8de24eab0296a96302861de9cfc4b0ad097c1b8f409a17c74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-b, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T09:36:03.364 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:36:03 smithi022 podman[65328]: 2024-09-19 09:36:03.059584936 +0000 UTC m=+0.371869242 container start 3f7d58492c6e29a8de24eab0296a96302861de9cfc4b0ad097c1b8f409a17c74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-b, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-19T09:36:03.364 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:36:03 smithi022 ceph-mds[65347]: -- 172.21.15.22:0/361123532 <== mon.2 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5600e4da5860 con 0x5600e4d83000 2024-09-19T09:36:03.364 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:36:03 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-b[65343]: starting mds.b at 2024-09-19T09:36:03.364 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:36:03 smithi022 bash[65328]: 3f7d58492c6e29a8de24eab0296a96302861de9cfc4b0ad097c1b8f409a17c74 2024-09-19T09:36:03.364 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:36:03 smithi022 systemd[1]: Started Ceph mds.b for 57238232-7669-11ef-bceb-c7b262605968. 2024-09-19T09:36:03.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:03 smithi022 ceph-mon[35583]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:03.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:03 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:03.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:03 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:03.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:03 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:03.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:03 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:03.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:03 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:03.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:03 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:36:03.866 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:03 smithi121 ceph-mon[35577]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:03.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:03 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:03.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:03 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:03.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:03 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:03.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:03 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:03.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:03 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:03.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:03 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:36:03.983 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:03 smithi001 ceph-mon[31225]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:03.983 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:03 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:03.983 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:03 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:03.983 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:03 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:03.983 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:03 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:03.983 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:03 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:03.983 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:03 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:36:04.102 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:36:04.543 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:04.801 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:04 smithi001 ceph-mon[31225]: mds.? [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] up:boot 2024-09-19T09:36:04.801 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:04 smithi001 ceph-mon[31225]: fsmap 12 up:standby 2024-09-19T09:36:04.801 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:04 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:36:04.801 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:04 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:04.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:04 smithi022 ceph-mon[35583]: mds.? [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] up:boot 2024-09-19T09:36:04.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:04 smithi022 ceph-mon[35583]: fsmap 12 up:standby 2024-09-19T09:36:04.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:04 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:36:04.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:04 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:04.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:04 smithi121 ceph-mon[35577]: mds.? [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] up:boot 2024-09-19T09:36:04.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:04 smithi121 ceph-mon[35577]: fsmap 12 up:standby 2024-09-19T09:36:04.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:04 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:36:04.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:04 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:05.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.018+0000 7fc155521640 1 -- 172.21.15.1:0/2246160874 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc150100e20 msgr2=0x7fc150101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:05.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.018+0000 7fc155521640 1 --2- 172.21.15.1:0/2246160874 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc150100e20 0x7fc150101200 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc140009ca0 tx=0x7fc14002a950 comp rx=0 tx=0).stop 2024-09-19T09:36:05.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.018+0000 7fc155521640 1 -- 172.21.15.1:0/2246160874 shutdown_connections 2024-09-19T09:36:05.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.018+0000 7fc155521640 1 --2- 172.21.15.1:0/2246160874 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc150102ef0 0x7fc15010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.018+0000 7fc155521640 1 --2- 172.21.15.1:0/2246160874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc150102570 0x7fc1501029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.018+0000 7fc155521640 1 --2- 172.21.15.1:0/2246160874 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc150100e20 0x7fc150101200 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.018+0000 7fc155521640 1 -- 172.21.15.1:0/2246160874 >> 172.21.15.1:0/2246160874 conn(0x7fc1500fc7d0 msgr2=0x7fc1500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:05.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.018+0000 7fc155521640 1 -- 172.21.15.1:0/2246160874 shutdown_connections 2024-09-19T09:36:05.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.018+0000 7fc155521640 1 -- 172.21.15.1:0/2246160874 wait complete. 2024-09-19T09:36:05.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.018+0000 7fc155521640 1 Processor -- start 2024-09-19T09:36:05.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.019+0000 7fc155521640 1 -- start start 2024-09-19T09:36:05.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.019+0000 7fc155521640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc150100e20 0x7fc150199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:05.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.019+0000 7fc155521640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc150102570 0x7fc1501998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:05.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.019+0000 7fc155521640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc150102ef0 0x7fc1501a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:05.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.019+0000 7fc155521640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc150110ff0 con 0x7fc150102ef0 2024-09-19T09:36:05.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.019+0000 7fc155521640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc150110e70 con 0x7fc150100e20 2024-09-19T09:36:05.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.019+0000 7fc155521640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc150111170 con 0x7fc150102570 2024-09-19T09:36:05.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.019+0000 7fc14f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc150102ef0 0x7fc1501a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:05.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.019+0000 7fc14effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc150100e20 0x7fc150199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:05.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.019+0000 7fc14f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc150102ef0 0x7fc1501a4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44234/0 (socket says 172.21.15.1:44234) 2024-09-19T09:36:05.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.019+0000 7fc14effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc150100e20 0x7fc150199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:50262/0 (socket says 172.21.15.1:50262) 2024-09-19T09:36:05.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.019+0000 7fc14f7fe640 1 -- 172.21.15.1:0/3412327656 learned_addr learned my addr 172.21.15.1:0/3412327656 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:05.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.019+0000 7fc14e7fc640 1 --2- 172.21.15.1:0/3412327656 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc150102570 0x7fc1501998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:05.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.019+0000 7fc14f7fe640 1 -- 172.21.15.1:0/3412327656 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc150102570 msgr2=0x7fc1501998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:05.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.019+0000 7fc14f7fe640 1 --2- 172.21.15.1:0/3412327656 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc150102570 0x7fc1501998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.019+0000 7fc14f7fe640 1 -- 172.21.15.1:0/3412327656 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc150100e20 msgr2=0x7fc150199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:05.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.019+0000 7fc14f7fe640 1 --2- 172.21.15.1:0/3412327656 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc150100e20 0x7fc150199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.019+0000 7fc14f7fe640 1 -- 172.21.15.1:0/3412327656 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1501a4950 con 0x7fc150102ef0 2024-09-19T09:36:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.020+0000 7fc14f7fe640 1 --2- 172.21.15.1:0/3412327656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc150102ef0 0x7fc1501a4410 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc148009fd0 tx=0x7fc14800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.020+0000 7fc137fff640 1 -- 172.21.15.1:0/3412327656 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc148011830 con 0x7fc150102ef0 2024-09-19T09:36:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.020+0000 7fc137fff640 1 -- 172.21.15.1:0/3412327656 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc148016070 con 0x7fc150102ef0 2024-09-19T09:36:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.020+0000 7fc155521640 1 -- 172.21.15.1:0/3412327656 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1501a4b20 con 0x7fc150102ef0 2024-09-19T09:36:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.020+0000 7fc137fff640 1 -- 172.21.15.1:0/3412327656 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14800f2e0 con 0x7fc150102ef0 2024-09-19T09:36:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.020+0000 7fc155521640 1 -- 172.21.15.1:0/3412327656 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1501a5030 con 0x7fc150102ef0 2024-09-19T09:36:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.021+0000 7fc155521640 1 -- 172.21.15.1:0/3412327656 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc150101200 con 0x7fc150102ef0 2024-09-19T09:36:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.022+0000 7fc137fff640 1 -- 172.21.15.1:0/3412327656 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fc1480119d0 con 0x7fc150102ef0 2024-09-19T09:36:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.023+0000 7fc137fff640 1 --2- 172.21.15.1:0/3412327656 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc1380a3240 0x7fc1380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.023+0000 7fc14effd640 1 --2- 172.21.15.1:0/3412327656 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc1380a3240 0x7fc1380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.023+0000 7fc137fff640 1 -- 172.21.15.1:0/3412327656 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fc1480ce9e0 con 0x7fc150102ef0 2024-09-19T09:36:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.023+0000 7fc14effd640 1 --2- 172.21.15.1:0/3412327656 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc1380a3240 0x7fc1380a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc14002af40 tx=0x7fc140005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.027+0000 7fc137fff640 1 -- 172.21.15.1:0/3412327656 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc14809bba0 con 0x7fc150102ef0 2024-09-19T09:36:05.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.263+0000 7fc155521640 1 -- 172.21.15.1:0/3412327656 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1501a52c0 con 0x7fc150102ef0 2024-09-19T09:36:05.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.264+0000 7fc137fff640 1 -- 172.21.15.1:0/3412327656 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10512 (secure 0 0 0) 0x7fc14809b4a0 con 0x7fc150102ef0 2024-09-19T09:36:05.265 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:36:05.266 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":13,"btime":"2024-09-19T09:36:03:517137+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24490,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6839/3279971690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3279971690},{"type":"v1","addr":"172.21.15.121:6839","nonce":3279971690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-19T09:36:05.266 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 13 2024-09-19T09:36:05.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.266+0000 7fc155521640 1 -- 172.21.15.1:0/3412327656 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc1380a3240 msgr2=0x7fc1380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:05.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.266+0000 7fc155521640 1 --2- 172.21.15.1:0/3412327656 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc1380a3240 0x7fc1380a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc14002af40 tx=0x7fc140005d80 comp rx=0 tx=0).stop 2024-09-19T09:36:05.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.266+0000 7fc155521640 1 -- 172.21.15.1:0/3412327656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc150102ef0 msgr2=0x7fc1501a4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:05.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.266+0000 7fc155521640 1 --2- 172.21.15.1:0/3412327656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc150102ef0 0x7fc1501a4410 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc148009fd0 tx=0x7fc14800b8e0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.266+0000 7fc155521640 1 -- 172.21.15.1:0/3412327656 shutdown_connections 2024-09-19T09:36:05.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.266+0000 7fc155521640 1 --2- 172.21.15.1:0/3412327656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc150102ef0 0x7fc1501a4410 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.266+0000 7fc155521640 1 --2- 172.21.15.1:0/3412327656 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc150102570 0x7fc1501998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.266+0000 7fc155521640 1 --2- 172.21.15.1:0/3412327656 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc1380a3240 0x7fc1380a5700 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.266+0000 7fc155521640 1 --2- 172.21.15.1:0/3412327656 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc150100e20 0x7fc150199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:05.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.266+0000 7fc155521640 1 -- 172.21.15.1:0/3412327656 >> 172.21.15.1:0/3412327656 conn(0x7fc1500fc7d0 msgr2=0x7fc1500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:05.268 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.266+0000 7fc155521640 1 -- 172.21.15.1:0/3412327656 shutdown_connections 2024-09-19T09:36:05.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:05.266+0000 7fc155521640 1 -- 172.21.15.1:0/3412327656 wait complete. 2024-09-19T09:36:05.969 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:05 smithi001 ceph-mon[31225]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:05.969 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:05 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:05.969 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:05 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:05.969 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:05 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:05.969 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:05 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:05.969 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:05 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/3412327656' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:05.969 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:05 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:05.969 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:05 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:05.969 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:05 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:05.969 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:05 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:36:05.969 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:05 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:05.969 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:05 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:36:06.000 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-19T09:36:06.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:05 smithi022 ceph-mon[35583]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:06.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:05 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:06.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:05 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:06.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:05 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:06.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:05 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:06.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:05 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/3412327656' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:06.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:05 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:06.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:05 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:06.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:05 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:06.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:05 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:36:06.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:05 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:06.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:05 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:36:06.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:05 smithi121 ceph-mon[35577]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:06.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:05 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:06.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:05 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:06.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:05 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:06.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:05 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:06.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:05 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/3412327656' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:06.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:05 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:06.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:05 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:06.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:05 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:06.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:05 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:36:06.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:05 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:06.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:05 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:36:06.855 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:07.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.332+0000 7ff36204a640 1 -- 172.21.15.1:0/4200623074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff35c101de0 msgr2=0x7ff35c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:07.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.332+0000 7ff36204a640 1 --2- 172.21.15.1:0/4200623074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff35c101de0 0x7ff35c1021c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009ca0 tx=0x7ff34c02ecd0 comp rx=0 tx=0).stop 2024-09-19T09:36:07.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.332+0000 7ff36204a640 1 -- 172.21.15.1:0/4200623074 shutdown_connections 2024-09-19T09:36:07.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.332+0000 7ff36204a640 1 --2- 172.21.15.1:0/4200623074 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff35c106f10 0x7ff35c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:07.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.332+0000 7ff36204a640 1 --2- 172.21.15.1:0/4200623074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff35c102790 0x7ff35c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:07.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.332+0000 7ff36204a640 1 --2- 172.21.15.1:0/4200623074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff35c101de0 0x7ff35c1021c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:07.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.332+0000 7ff36204a640 1 -- 172.21.15.1:0/4200623074 >> 172.21.15.1:0/4200623074 conn(0x7ff35c0fd8c0 msgr2=0x7ff35c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:07.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.332+0000 7ff36204a640 1 -- 172.21.15.1:0/4200623074 shutdown_connections 2024-09-19T09:36:07.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.332+0000 7ff36204a640 1 -- 172.21.15.1:0/4200623074 wait complete. 2024-09-19T09:36:07.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.332+0000 7ff36204a640 1 Processor -- start 2024-09-19T09:36:07.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.332+0000 7ff36204a640 1 -- start start 2024-09-19T09:36:07.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.333+0000 7ff36204a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff35c101de0 0x7ff35c1962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:07.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.333+0000 7ff36204a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff35c102790 0x7ff35c196800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:07.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.333+0000 7ff36204a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff35c106f10 0x7ff35c19ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:07.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.333+0000 7ff36204a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff35c10fd60 con 0x7ff35c106f10 2024-09-19T09:36:07.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.333+0000 7ff36204a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff35c10fbe0 con 0x7ff35c102790 2024-09-19T09:36:07.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.333+0000 7ff36204a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff35c10fee0 con 0x7ff35c101de0 2024-09-19T09:36:07.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.333+0000 7ff35bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff35c106f10 0x7ff35c19ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:07.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.333+0000 7ff35bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff35c106f10 0x7ff35c19ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34680/0 (socket says 172.21.15.1:34680) 2024-09-19T09:36:07.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.333+0000 7ff35bfff640 1 -- 172.21.15.1:0/4258127078 learned_addr learned my addr 172.21.15.1:0/4258127078 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:07.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.333+0000 7ff35b7fe640 1 --2- 172.21.15.1:0/4258127078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff35c101de0 0x7ff35c1962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:07.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.333+0000 7ff35affd640 1 --2- 172.21.15.1:0/4258127078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff35c102790 0x7ff35c196800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:07.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.333+0000 7ff35bfff640 1 -- 172.21.15.1:0/4258127078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff35c101de0 msgr2=0x7ff35c1962c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:07.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.333+0000 7ff35bfff640 1 --2- 172.21.15.1:0/4258127078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff35c101de0 0x7ff35c1962c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:07.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.333+0000 7ff35bfff640 1 -- 172.21.15.1:0/4258127078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff35c102790 msgr2=0x7ff35c196800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:07.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.333+0000 7ff35bfff640 1 --2- 172.21.15.1:0/4258127078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff35c102790 0x7ff35c196800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:07.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.333+0000 7ff35bfff640 1 -- 172.21.15.1:0/4258127078 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff35c19b270 con 0x7ff35c106f10 2024-09-19T09:36:07.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.333+0000 7ff35bfff640 1 --2- 172.21.15.1:0/4258127078 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff35c106f10 0x7ff35c19ab90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff35400e970 tx=0x7ff35400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:07.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.333+0000 7ff358ff9640 1 -- 172.21.15.1:0/4258127078 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35400ccc0 con 0x7ff35c106f10 2024-09-19T09:36:07.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.334+0000 7ff36204a640 1 -- 172.21.15.1:0/4258127078 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff35c19b560 con 0x7ff35c106f10 2024-09-19T09:36:07.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.334+0000 7ff358ff9640 1 -- 172.21.15.1:0/4258127078 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff35400ce60 con 0x7ff35c106f10 2024-09-19T09:36:07.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.334+0000 7ff358ff9640 1 -- 172.21.15.1:0/4258127078 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff354010450 con 0x7ff35c106f10 2024-09-19T09:36:07.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.334+0000 7ff36204a640 1 -- 172.21.15.1:0/4258127078 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff35c1a2e40 con 0x7ff35c106f10 2024-09-19T09:36:07.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.335+0000 7ff36204a640 1 -- 172.21.15.1:0/4258127078 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff35c1021c0 con 0x7ff35c106f10 2024-09-19T09:36:07.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.336+0000 7ff358ff9640 1 -- 172.21.15.1:0/4258127078 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7ff354005020 con 0x7ff35c106f10 2024-09-19T09:36:07.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.336+0000 7ff358ff9640 1 --2- 172.21.15.1:0/4258127078 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff3440a3240 0x7ff3440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:07.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.337+0000 7ff35b7fe640 1 --2- 172.21.15.1:0/4258127078 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff3440a3240 0x7ff3440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:07.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.337+0000 7ff358ff9640 1 -- 172.21.15.1:0/4258127078 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7ff3540cf810 con 0x7ff35c106f10 2024-09-19T09:36:07.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.337+0000 7ff35b7fe640 1 --2- 172.21.15.1:0/4258127078 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff3440a3240 0x7ff3440a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff34c004af0 tx=0x7ff34c031040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:07.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.341+0000 7ff358ff9640 1 -- 172.21.15.1:0/4258127078 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff35409c9d0 con 0x7ff35c106f10 2024-09-19T09:36:07.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.535+0000 7ff36204a640 1 -- 172.21.15.1:0/4258127078 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff35c10a0f0 con 0x7ff35c106f10 2024-09-19T09:36:07.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.535+0000 7ff358ff9640 1 -- 172.21.15.1:0/4258127078 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v76) ==== 84+0+65 (secure 0 0 0) 0x7ff35409c2d0 con 0x7ff35c106f10 2024-09-19T09:36:07.537 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:36:07.537 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2024-09-19T09:36:07.537 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:36:07.537 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 1, 2024-09-19T09:36:07.537 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": ".mgr" 2024-09-19T09:36:07.537 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:36:07.537 INFO:teuthology.orchestra.run.smithi001.stdout:] 2024-09-19T09:36:07.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.537+0000 7ff36204a640 1 -- 172.21.15.1:0/4258127078 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff3440a3240 msgr2=0x7ff3440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:07.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.537+0000 7ff36204a640 1 --2- 172.21.15.1:0/4258127078 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff3440a3240 0x7ff3440a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff34c004af0 tx=0x7ff34c031040 comp rx=0 tx=0).stop 2024-09-19T09:36:07.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.537+0000 7ff36204a640 1 -- 172.21.15.1:0/4258127078 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff35c106f10 msgr2=0x7ff35c19ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:07.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.537+0000 7ff36204a640 1 --2- 172.21.15.1:0/4258127078 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff35c106f10 0x7ff35c19ab90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff35400e970 tx=0x7ff35400ed70 comp rx=0 tx=0).stop 2024-09-19T09:36:07.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.537+0000 7ff36204a640 1 -- 172.21.15.1:0/4258127078 shutdown_connections 2024-09-19T09:36:07.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.537+0000 7ff36204a640 1 --2- 172.21.15.1:0/4258127078 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff35c106f10 0x7ff35c19ab90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:07.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.537+0000 7ff36204a640 1 --2- 172.21.15.1:0/4258127078 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff3440a3240 0x7ff3440a5700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:07.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.537+0000 7ff36204a640 1 --2- 172.21.15.1:0/4258127078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff35c102790 0x7ff35c196800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:07.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.537+0000 7ff36204a640 1 --2- 172.21.15.1:0/4258127078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff35c101de0 0x7ff35c1962c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:07.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.537+0000 7ff36204a640 1 -- 172.21.15.1:0/4258127078 >> 172.21.15.1:0/4258127078 conn(0x7ff35c0fd8c0 msgr2=0x7ff35c0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:07.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.538+0000 7ff36204a640 1 -- 172.21.15.1:0/4258127078 shutdown_connections 2024-09-19T09:36:07.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:07.538+0000 7ff36204a640 1 -- 172.21.15.1:0/4258127078 wait complete. 2024-09-19T09:36:08.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:07 smithi022 ceph-mon[35583]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:08.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:07 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:08.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:07 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:08.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:07 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:08.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:07 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:08.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:07 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/4258127078' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T09:36:08.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:07 smithi121 ceph-mon[35577]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:08.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:07 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:08.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:07 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:08.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:07 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:08.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:07 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:08.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:07 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/4258127078' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T09:36:08.148 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:07 smithi001 ceph-mon[31225]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:08.148 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:07 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:08.148 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:07 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:08.148 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:07 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:08.149 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:07 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:08.149 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:07 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/4258127078' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T09:36:08.179 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T09:36:08.179 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T09:36:08.451 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:08.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.902+0000 7fc58d90d640 1 -- 172.21.15.1:0/2072352138 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc58810c1a0 msgr2=0x7fc58810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:08.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.902+0000 7fc58d90d640 1 --2- 172.21.15.1:0/2072352138 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc58810c1a0 0x7fc58810e610 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc580009ca0 tx=0x7fc58002a950 comp rx=0 tx=0).stop 2024-09-19T09:36:08.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.902+0000 7fc58d90d640 1 -- 172.21.15.1:0/2072352138 shutdown_connections 2024-09-19T09:36:08.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.902+0000 7fc58d90d640 1 --2- 172.21.15.1:0/2072352138 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc58810c1a0 0x7fc58810e610 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:08.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.902+0000 7fc58d90d640 1 --2- 172.21.15.1:0/2072352138 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc588103720 0x7fc58810bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:08.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.902+0000 7fc58d90d640 1 --2- 172.21.15.1:0/2072352138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc588102e00 0x7fc5881031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:08.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.902+0000 7fc58d90d640 1 -- 172.21.15.1:0/2072352138 >> 172.21.15.1:0/2072352138 conn(0x7fc5880fc7a0 msgr2=0x7fc5880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:08.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.902+0000 7fc58d90d640 1 -- 172.21.15.1:0/2072352138 shutdown_connections 2024-09-19T09:36:08.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.902+0000 7fc58d90d640 1 -- 172.21.15.1:0/2072352138 wait complete. 2024-09-19T09:36:08.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.903+0000 7fc58d90d640 1 Processor -- start 2024-09-19T09:36:08.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.903+0000 7fc58d90d640 1 -- start start 2024-09-19T09:36:08.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.903+0000 7fc58d90d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc588102e00 0x7fc588100a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:08.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.903+0000 7fc58d90d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc588103720 0x7fc588100fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:08.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.903+0000 7fc58d90d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc58810c1a0 0x7fc5881014e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:08.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.903+0000 7fc58d90d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc588111fb0 con 0x7fc588103720 2024-09-19T09:36:08.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.903+0000 7fc58d90d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc588111e30 con 0x7fc58810c1a0 2024-09-19T09:36:08.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.903+0000 7fc58d90d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc588112130 con 0x7fc588102e00 2024-09-19T09:36:08.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.903+0000 7fc57e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc588103720 0x7fc588100fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:08.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.903+0000 7fc57e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc588103720 0x7fc588100fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34694/0 (socket says 172.21.15.1:34694) 2024-09-19T09:36:08.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.903+0000 7fc57e7fc640 1 -- 172.21.15.1:0/1290586414 learned_addr learned my addr 172.21.15.1:0/1290586414 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:08.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.903+0000 7fc5877fe640 1 --2- 172.21.15.1:0/1290586414 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc58810c1a0 0x7fc5881014e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:08.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.903+0000 7fc586ffd640 1 --2- 172.21.15.1:0/1290586414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc588102e00 0x7fc588100a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:08.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.904+0000 7fc57e7fc640 1 -- 172.21.15.1:0/1290586414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc588102e00 msgr2=0x7fc588100a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:08.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.904+0000 7fc57e7fc640 1 --2- 172.21.15.1:0/1290586414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc588102e00 0x7fc588100a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:08.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.904+0000 7fc57e7fc640 1 -- 172.21.15.1:0/1290586414 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc58810c1a0 msgr2=0x7fc5881014e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:08.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.904+0000 7fc57e7fc640 1 --2- 172.21.15.1:0/1290586414 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc58810c1a0 0x7fc5881014e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:08.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.904+0000 7fc57e7fc640 1 -- 172.21.15.1:0/1290586414 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5881a68b0 con 0x7fc588103720 2024-09-19T09:36:08.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.904+0000 7fc57e7fc640 1 --2- 172.21.15.1:0/1290586414 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc588103720 0x7fc588100fa0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc57000c920 tx=0x7fc57000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:08.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.904+0000 7fc58c90b640 1 -- 172.21.15.1:0/1290586414 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc570007c70 con 0x7fc588103720 2024-09-19T09:36:08.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.904+0000 7fc58c90b640 1 -- 172.21.15.1:0/1290586414 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc570007e10 con 0x7fc588103720 2024-09-19T09:36:08.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.904+0000 7fc58c90b640 1 -- 172.21.15.1:0/1290586414 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc570018890 con 0x7fc588103720 2024-09-19T09:36:08.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.904+0000 7fc58d90d640 1 -- 172.21.15.1:0/1290586414 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5881a6ba0 con 0x7fc588103720 2024-09-19T09:36:08.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.904+0000 7fc58d90d640 1 -- 172.21.15.1:0/1290586414 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5881a70e0 con 0x7fc588103720 2024-09-19T09:36:08.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.905+0000 7fc58d90d640 1 -- 172.21.15.1:0/1290586414 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5881031e0 con 0x7fc588103720 2024-09-19T09:36:08.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.906+0000 7fc58c90b640 1 -- 172.21.15.1:0/1290586414 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fc570018a70 con 0x7fc588103720 2024-09-19T09:36:08.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.907+0000 7fc58c90b640 1 --2- 172.21.15.1:0/1290586414 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc5740a3240 0x7fc5740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:08.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.907+0000 7fc58c90b640 1 -- 172.21.15.1:0/1290586414 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fc5700cf5c0 con 0x7fc588103720 2024-09-19T09:36:08.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.907+0000 7fc586ffd640 1 --2- 172.21.15.1:0/1290586414 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc5740a3240 0x7fc5740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:08.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.907+0000 7fc586ffd640 1 --2- 172.21.15.1:0/1290586414 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc5740a3240 0x7fc5740a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc578009890 tx=0x7fc578008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:08.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:08.911+0000 7fc58c90b640 1 -- 172.21.15.1:0/1290586414 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc570014030 con 0x7fc588103720 2024-09-19T09:36:09.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:09.087+0000 7fc58d90d640 1 -- 172.21.15.1:0/1290586414 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc5881a7310 con 0x7fc588103720 2024-09-19T09:36:09.825 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:09.823+0000 7fc58c90b640 1 -- 172.21.15.1:0/1290586414 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v77) ==== 138+0+0 (secure 0 0 0) 0x7fc57009c780 con 0x7fc588103720 2024-09-19T09:36:09.825 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' created 2024-09-19T09:36:09.825 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:09 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:09.825 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:09 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:09.825 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:09 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:09.825 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:09 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:36:09.826 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:09 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:09.826 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:09 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1290586414' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T09:36:09.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:09.826+0000 7fc58d90d640 1 -- 172.21.15.1:0/1290586414 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc5740a3240 msgr2=0x7fc5740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:09.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:09.826+0000 7fc58d90d640 1 --2- 172.21.15.1:0/1290586414 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc5740a3240 0x7fc5740a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc578009890 tx=0x7fc578008040 comp rx=0 tx=0).stop 2024-09-19T09:36:09.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:09.826+0000 7fc58d90d640 1 -- 172.21.15.1:0/1290586414 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc588103720 msgr2=0x7fc588100fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:09.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:09.826+0000 7fc58d90d640 1 --2- 172.21.15.1:0/1290586414 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc588103720 0x7fc588100fa0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc57000c920 tx=0x7fc57000cde0 comp rx=0 tx=0).stop 2024-09-19T09:36:09.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:09.826+0000 7fc58d90d640 1 -- 172.21.15.1:0/1290586414 shutdown_connections 2024-09-19T09:36:09.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:09.826+0000 7fc58d90d640 1 --2- 172.21.15.1:0/1290586414 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc5740a3240 0x7fc5740a5700 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:09.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:09.826+0000 7fc58d90d640 1 --2- 172.21.15.1:0/1290586414 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc58810c1a0 0x7fc5881014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:09.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:09.826+0000 7fc58d90d640 1 --2- 172.21.15.1:0/1290586414 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc588103720 0x7fc588100fa0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:09.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:09.826+0000 7fc58d90d640 1 --2- 172.21.15.1:0/1290586414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc588102e00 0x7fc588100a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:09.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:09.826+0000 7fc58d90d640 1 -- 172.21.15.1:0/1290586414 >> 172.21.15.1:0/1290586414 conn(0x7fc5880fc7a0 msgr2=0x7fc5880fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:09.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:09.826+0000 7fc58d90d640 1 -- 172.21.15.1:0/1290586414 shutdown_connections 2024-09-19T09:36:09.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:09.826+0000 7fc58d90d640 1 -- 172.21.15.1:0/1290586414 wait complete. 2024-09-19T09:36:09.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:09 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:09.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:09 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:09.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:09 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:09.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:09 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:36:09.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:09 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:09.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:09 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1290586414' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T09:36:09.866 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:09 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:09.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:09 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:09.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:09 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:36:09.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:09 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:36:09.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:09 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:36:09.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:09 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1290586414' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T09:36:10.573 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T09:36:10.833 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:10.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:10 smithi022 ceph-mon[35583]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:10.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:10 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1290586414' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T09:36:10.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:10 smithi022 ceph-mon[35583]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T09:36:10.866 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:10 smithi121 ceph-mon[35577]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:10.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:10 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1290586414' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T09:36:10.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:10 smithi121 ceph-mon[35577]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T09:36:10.959 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:10 smithi001 ceph-mon[31225]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:10.959 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:10 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1290586414' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T09:36:10.959 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:10 smithi001 ceph-mon[31225]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T09:36:11.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.331+0000 7f4f432c0640 1 -- 172.21.15.1:0/1338318722 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f3c102d30 msgr2=0x7f4f3c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:11.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.331+0000 7f4f432c0640 1 --2- 172.21.15.1:0/1338318722 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f3c102d30 0x7f4f3c103110 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4f38009930 tx=0x7f4f3802a440 comp rx=0 tx=0).stop 2024-09-19T09:36:11.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.331+0000 7f4f432c0640 1 -- 172.21.15.1:0/1338318722 shutdown_connections 2024-09-19T09:36:11.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.331+0000 7f4f432c0640 1 --2- 172.21.15.1:0/1338318722 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f3c1082a0 0x7f4f3c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:11.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.331+0000 7f4f432c0640 1 --2- 172.21.15.1:0/1338318722 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f3c1036e0 0x7f4f3c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:11.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.331+0000 7f4f432c0640 1 --2- 172.21.15.1:0/1338318722 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f3c102d30 0x7f4f3c103110 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:11.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.331+0000 7f4f432c0640 1 -- 172.21.15.1:0/1338318722 >> 172.21.15.1:0/1338318722 conn(0x7f4f3c0fc7d0 msgr2=0x7f4f3c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:11.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.331+0000 7f4f432c0640 1 -- 172.21.15.1:0/1338318722 shutdown_connections 2024-09-19T09:36:11.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.331+0000 7f4f432c0640 1 -- 172.21.15.1:0/1338318722 wait complete. 2024-09-19T09:36:11.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.331+0000 7f4f432c0640 1 Processor -- start 2024-09-19T09:36:11.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.331+0000 7f4f432c0640 1 -- start start 2024-09-19T09:36:11.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.332+0000 7f4f432c0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f3c102d30 0x7f4f3c1a05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:11.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.332+0000 7f4f432c0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f3c1036e0 0x7f4f3c1a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:11.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.332+0000 7f4f432c0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f3c1082a0 0x7f4f3c19a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:11.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.332+0000 7f4f432c0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3c1120e0 con 0x7f4f3c1082a0 2024-09-19T09:36:11.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.332+0000 7f4f432c0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3c111f60 con 0x7f4f3c1036e0 2024-09-19T09:36:11.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.332+0000 7f4f432c0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4f3c112260 con 0x7f4f3c102d30 2024-09-19T09:36:11.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.332+0000 7f4f4185d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f3c1082a0 0x7f4f3c19a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:11.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.332+0000 7f4f4185d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f3c1082a0 0x7f4f3c19a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34716/0 (socket says 172.21.15.1:34716) 2024-09-19T09:36:11.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.332+0000 7f4f4185d640 1 -- 172.21.15.1:0/215438735 learned_addr learned my addr 172.21.15.1:0/215438735 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:11.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.332+0000 7f4f4105c640 1 --2- 172.21.15.1:0/215438735 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f3c102d30 0x7f4f3c1a05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:11.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.332+0000 7f4f4085b640 1 --2- 172.21.15.1:0/215438735 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f3c1036e0 0x7f4f3c1a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:11.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.332+0000 7f4f4185d640 1 -- 172.21.15.1:0/215438735 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f3c102d30 msgr2=0x7f4f3c1a05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:11.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.332+0000 7f4f4185d640 1 --2- 172.21.15.1:0/215438735 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f3c102d30 0x7f4f3c1a05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:11.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.332+0000 7f4f4185d640 1 -- 172.21.15.1:0/215438735 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f3c1036e0 msgr2=0x7f4f3c1a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:11.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.332+0000 7f4f4185d640 1 --2- 172.21.15.1:0/215438735 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f3c1036e0 0x7f4f3c1a0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:11.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.332+0000 7f4f4185d640 1 -- 172.21.15.1:0/215438735 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f3c19af00 con 0x7f4f3c1082a0 2024-09-19T09:36:11.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.332+0000 7f4f4085b640 1 --2- 172.21.15.1:0/215438735 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f3c1036e0 0x7f4f3c1a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:36:11.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.332+0000 7f4f4185d640 1 --2- 172.21.15.1:0/215438735 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f3c1082a0 0x7f4f3c19a690 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400eb10 tx=0x7f4f3400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:11.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.333+0000 7f4f327fc640 1 -- 172.21.15.1:0/215438735 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f34004b20 con 0x7f4f3c1082a0 2024-09-19T09:36:11.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.333+0000 7f4f432c0640 1 -- 172.21.15.1:0/215438735 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f3c19b1f0 con 0x7f4f3c1082a0 2024-09-19T09:36:11.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.333+0000 7f4f327fc640 1 -- 172.21.15.1:0/215438735 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f34004cc0 con 0x7f4f3c1082a0 2024-09-19T09:36:11.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.333+0000 7f4f327fc640 1 -- 172.21.15.1:0/215438735 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f34010760 con 0x7f4f3c1082a0 2024-09-19T09:36:11.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.333+0000 7f4f432c0640 1 -- 172.21.15.1:0/215438735 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f3c1a7370 con 0x7f4f3c1082a0 2024-09-19T09:36:11.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.334+0000 7f4f432c0640 1 -- 172.21.15.1:0/215438735 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f3c06a850 con 0x7f4f3c1082a0 2024-09-19T09:36:11.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.335+0000 7f4f327fc640 1 -- 172.21.15.1:0/215438735 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f4f34005020 con 0x7f4f3c1082a0 2024-09-19T09:36:11.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.335+0000 7f4f327fc640 1 --2- 172.21.15.1:0/215438735 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4f280a3240 0x7f4f280a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:11.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.336+0000 7f4f4105c640 1 --2- 172.21.15.1:0/215438735 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4f280a3240 0x7f4f280a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:11.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.336+0000 7f4f327fc640 1 -- 172.21.15.1:0/215438735 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7497+0+0 (secure 0 0 0) 0x7f4f340cfcc0 con 0x7f4f3c1082a0 2024-09-19T09:36:11.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.336+0000 7f4f4105c640 1 --2- 172.21.15.1:0/215438735 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4f280a3240 0x7f4f280a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4f38000c00 tx=0x7f4f380058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:11.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.340+0000 7f4f327fc640 1 -- 172.21.15.1:0/215438735 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4f3409cd10 con 0x7f4f3c1082a0 2024-09-19T09:36:11.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.519+0000 7f4f432c0640 1 -- 172.21.15.1:0/215438735 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f4f3c10c2c0 con 0x7f4f3c1082a0 2024-09-19T09:36:11.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.959+0000 7f4f327fc640 1 -- 172.21.15.1:0/215438735 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v79) ==== 170+0+0 (secure 0 0 0) 0x7f4f3409c610 con 0x7f4f3c1082a0 2024-09-19T09:36:11.961 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' created 2024-09-19T09:36:11.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.964+0000 7f4f432c0640 1 -- 172.21.15.1:0/215438735 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4f280a3240 msgr2=0x7f4f280a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:11.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.964+0000 7f4f432c0640 1 --2- 172.21.15.1:0/215438735 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4f280a3240 0x7f4f280a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4f38000c00 tx=0x7f4f380058b0 comp rx=0 tx=0).stop 2024-09-19T09:36:11.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.964+0000 7f4f432c0640 1 -- 172.21.15.1:0/215438735 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f3c1082a0 msgr2=0x7f4f3c19a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:11.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.964+0000 7f4f432c0640 1 --2- 172.21.15.1:0/215438735 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f3c1082a0 0x7f4f3c19a690 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400eb10 tx=0x7f4f3400c2d0 comp rx=0 tx=0).stop 2024-09-19T09:36:11.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.964+0000 7f4f432c0640 1 -- 172.21.15.1:0/215438735 shutdown_connections 2024-09-19T09:36:11.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.964+0000 7f4f432c0640 1 --2- 172.21.15.1:0/215438735 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f3c1082a0 0x7f4f3c19a690 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:11.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.964+0000 7f4f432c0640 1 --2- 172.21.15.1:0/215438735 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4f280a3240 0x7f4f280a5700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:11.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.964+0000 7f4f432c0640 1 --2- 172.21.15.1:0/215438735 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f3c1036e0 0x7f4f3c1a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:11.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.964+0000 7f4f432c0640 1 --2- 172.21.15.1:0/215438735 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f3c102d30 0x7f4f3c1a05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:11.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.964+0000 7f4f432c0640 1 -- 172.21.15.1:0/215438735 >> 172.21.15.1:0/215438735 conn(0x7f4f3c0fc7d0 msgr2=0x7f4f3c0fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:11.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.966+0000 7f4f432c0640 1 -- 172.21.15.1:0/215438735 shutdown_connections 2024-09-19T09:36:11.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:11.967+0000 7f4f432c0640 1 -- 172.21.15.1:0/215438735 wait complete. 2024-09-19T09:36:12.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:11 smithi001 ceph-mon[31225]: pgmap v275: 33 pgs: 3 creating+peering, 29 unknown, 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:12.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:11 smithi001 ceph-mon[31225]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T09:36:12.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:11 smithi001 ceph-mon[31225]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T09:36:12.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:11 smithi022 ceph-mon[35583]: pgmap v275: 33 pgs: 3 creating+peering, 29 unknown, 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:12.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:11 smithi022 ceph-mon[35583]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T09:36:12.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:11 smithi022 ceph-mon[35583]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T09:36:12.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:11 smithi121 ceph-mon[35577]: pgmap v275: 33 pgs: 3 creating+peering, 29 unknown, 1 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:12.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:11 smithi121 ceph-mon[35577]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T09:36:12.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:11 smithi121 ceph-mon[35577]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T09:36:12.664 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T09:36:12.922 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:13.218 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:12 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/215438735' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T09:36:13.218 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:12 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/215438735' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T09:36:13.218 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:12 smithi001 ceph-mon[31225]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T09:36:13.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:12 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/215438735' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T09:36:13.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:12 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/215438735' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T09:36:13.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:12 smithi022 ceph-mon[35583]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T09:36:13.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:12 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/215438735' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T09:36:13.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:12 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/215438735' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T09:36:13.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:12 smithi121 ceph-mon[35577]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T09:36:13.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.413+0000 7ff4ec83f640 1 -- 172.21.15.1:0/3698945386 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4e8102570 msgr2=0x7ff4e81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:13.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.413+0000 7ff4ec83f640 1 --2- 172.21.15.1:0/3698945386 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4e8102570 0x7ff4e81029b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0009900 tx=0x7ff4d002a480 comp rx=0 tx=0).stop 2024-09-19T09:36:13.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.413+0000 7ff4ec83f640 1 -- 172.21.15.1:0/3698945386 shutdown_connections 2024-09-19T09:36:13.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.413+0000 7ff4ec83f640 1 --2- 172.21.15.1:0/3698945386 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4e8102ef0 0x7ff4e810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:13.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.413+0000 7ff4ec83f640 1 --2- 172.21.15.1:0/3698945386 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4e8102570 0x7ff4e81029b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:13.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.413+0000 7ff4ec83f640 1 --2- 172.21.15.1:0/3698945386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4e8100e20 0x7ff4e8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:13.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.413+0000 7ff4ec83f640 1 -- 172.21.15.1:0/3698945386 >> 172.21.15.1:0/3698945386 conn(0x7ff4e80fc7d0 msgr2=0x7ff4e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:13.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.413+0000 7ff4ec83f640 1 -- 172.21.15.1:0/3698945386 shutdown_connections 2024-09-19T09:36:13.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.413+0000 7ff4ec83f640 1 -- 172.21.15.1:0/3698945386 wait complete. 2024-09-19T09:36:13.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.414+0000 7ff4ec83f640 1 Processor -- start 2024-09-19T09:36:13.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.414+0000 7ff4ec83f640 1 -- start start 2024-09-19T09:36:13.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.414+0000 7ff4ec83f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4e8100e20 0x7ff4e819a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:13.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.414+0000 7ff4ec83f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4e8102570 0x7ff4e819ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:13.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.414+0000 7ff4ec83f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4e8102ef0 0x7ff4e819efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:13.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.414+0000 7ff4ec83f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e8110fa0 con 0x7ff4e8102ef0 2024-09-19T09:36:13.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.414+0000 7ff4ec83f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e8110e20 con 0x7ff4e8100e20 2024-09-19T09:36:13.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.414+0000 7ff4ec83f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e8111120 con 0x7ff4e8102570 2024-09-19T09:36:13.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.414+0000 7ff4e6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4e8102ef0 0x7ff4e819efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:13.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.414+0000 7ff4e6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4e8102ef0 0x7ff4e819efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34738/0 (socket says 172.21.15.1:34738) 2024-09-19T09:36:13.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.414+0000 7ff4e6d9d640 1 -- 172.21.15.1:0/317699293 learned_addr learned my addr 172.21.15.1:0/317699293 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:13.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.414+0000 7ff4e659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4e8100e20 0x7ff4e819a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:13.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.415+0000 7ff4dffff640 1 --2- 172.21.15.1:0/317699293 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4e8102570 0x7ff4e819ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:13.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.415+0000 7ff4e6d9d640 1 -- 172.21.15.1:0/317699293 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4e8102570 msgr2=0x7ff4e819ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:13.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.415+0000 7ff4e6d9d640 1 --2- 172.21.15.1:0/317699293 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4e8102570 0x7ff4e819ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:13.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.415+0000 7ff4e6d9d640 1 -- 172.21.15.1:0/317699293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4e8100e20 msgr2=0x7ff4e819a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:13.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.415+0000 7ff4e6d9d640 1 --2- 172.21.15.1:0/317699293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4e8100e20 0x7ff4e819a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:13.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.415+0000 7ff4e6d9d640 1 -- 172.21.15.1:0/317699293 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4e819f6c0 con 0x7ff4e8102ef0 2024-09-19T09:36:13.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.415+0000 7ff4e6d9d640 1 --2- 172.21.15.1:0/317699293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4e8102ef0 0x7ff4e819efe0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000b970 tx=0x7ff4e000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:13.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.415+0000 7ff4df7fe640 1 -- 172.21.15.1:0/317699293 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e0019070 con 0x7ff4e8102ef0 2024-09-19T09:36:13.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.415+0000 7ff4df7fe640 1 -- 172.21.15.1:0/317699293 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4e000cb40 con 0x7ff4e8102ef0 2024-09-19T09:36:13.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.415+0000 7ff4ec83f640 1 -- 172.21.15.1:0/317699293 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4e819f9b0 con 0x7ff4e8102ef0 2024-09-19T09:36:13.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.415+0000 7ff4df7fe640 1 -- 172.21.15.1:0/317699293 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e0007650 con 0x7ff4e8102ef0 2024-09-19T09:36:13.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.415+0000 7ff4ec83f640 1 -- 172.21.15.1:0/317699293 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4e81a7290 con 0x7ff4e8102ef0 2024-09-19T09:36:13.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.416+0000 7ff4ec83f640 1 -- 172.21.15.1:0/317699293 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4e8101200 con 0x7ff4e8102ef0 2024-09-19T09:36:13.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.418+0000 7ff4df7fe640 1 -- 172.21.15.1:0/317699293 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7ff4e001c070 con 0x7ff4e8102ef0 2024-09-19T09:36:13.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.418+0000 7ff4df7fe640 1 --2- 172.21.15.1:0/317699293 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff4d40a32c0 0x7ff4d40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:13.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.419+0000 7ff4e659c640 1 --2- 172.21.15.1:0/317699293 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff4d40a32c0 0x7ff4d40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:13.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.419+0000 7ff4df7fe640 1 -- 172.21.15.1:0/317699293 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7879+0+0 (secure 0 0 0) 0x7ff4e00cf150 con 0x7ff4e8102ef0 2024-09-19T09:36:13.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.419+0000 7ff4e659c640 1 --2- 172.21.15.1:0/317699293 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff4d40a32c0 0x7ff4d40a5780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff4d80058c0 tx=0x7ff4d800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:13.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.422+0000 7ff4df7fe640 1 -- 172.21.15.1:0/317699293 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff4e009b9d0 con 0x7ff4e8102ef0 2024-09-19T09:36:13.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.636+0000 7ff4ec83f640 1 -- 172.21.15.1:0/317699293 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff4e81a74f0 con 0x7ff4e8102ef0 2024-09-19T09:36:13.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.967+0000 7ff4df7fe640 1 -- 172.21.15.1:0/317699293 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7ff4e009fcd0 con 0x7ff4e8102ef0 2024-09-19T09:36:13.969 INFO:teuthology.orchestra.run.smithi001.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T09:36:13.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.970+0000 7ff4ec83f640 1 -- 172.21.15.1:0/317699293 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff4d40a32c0 msgr2=0x7ff4d40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:13.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.970+0000 7ff4ec83f640 1 --2- 172.21.15.1:0/317699293 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff4d40a32c0 0x7ff4d40a5780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff4d80058c0 tx=0x7ff4d800a2d0 comp rx=0 tx=0).stop 2024-09-19T09:36:13.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.970+0000 7ff4ec83f640 1 -- 172.21.15.1:0/317699293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4e8102ef0 msgr2=0x7ff4e819efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:13.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.970+0000 7ff4ec83f640 1 --2- 172.21.15.1:0/317699293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4e8102ef0 0x7ff4e819efe0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000b970 tx=0x7ff4e000be30 comp rx=0 tx=0).stop 2024-09-19T09:36:13.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.970+0000 7ff4ec83f640 1 -- 172.21.15.1:0/317699293 shutdown_connections 2024-09-19T09:36:13.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.970+0000 7ff4ec83f640 1 --2- 172.21.15.1:0/317699293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4e8102ef0 0x7ff4e819efe0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:13.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.970+0000 7ff4ec83f640 1 --2- 172.21.15.1:0/317699293 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4e8102570 0x7ff4e819ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:13.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.970+0000 7ff4ec83f640 1 --2- 172.21.15.1:0/317699293 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff4d40a32c0 0x7ff4d40a5780 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:13.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.970+0000 7ff4ec83f640 1 --2- 172.21.15.1:0/317699293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4e8100e20 0x7ff4e819a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:13.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.970+0000 7ff4ec83f640 1 -- 172.21.15.1:0/317699293 >> 172.21.15.1:0/317699293 conn(0x7ff4e80fc7d0 msgr2=0x7ff4e806a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:13.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.970+0000 7ff4ec83f640 1 -- 172.21.15.1:0/317699293 shutdown_connections 2024-09-19T09:36:13.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:13.970+0000 7ff4ec83f640 1 -- 172.21.15.1:0/317699293 wait complete. 2024-09-19T09:36:14.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:13 smithi001 ceph-mon[31225]: pgmap v278: 97 pgs: 10 creating+peering, 81 unknown, 6 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:14.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:13 smithi001 ceph-mon[31225]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T09:36:14.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:13 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/317699293' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T09:36:14.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:13 smithi001 ceph-mon[31225]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T09:36:14.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:13 smithi022 ceph-mon[35583]: pgmap v278: 97 pgs: 10 creating+peering, 81 unknown, 6 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:14.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:13 smithi022 ceph-mon[35583]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T09:36:14.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:13 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/317699293' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T09:36:14.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:13 smithi022 ceph-mon[35583]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T09:36:14.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:13 smithi121 ceph-mon[35577]: pgmap v278: 97 pgs: 10 creating+peering, 81 unknown, 6 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:36:14.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:13 smithi121 ceph-mon[35577]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T09:36:14.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:13 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/317699293' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T09:36:14.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:13 smithi121 ceph-mon[35577]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T09:36:14.779 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:36:14.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:14 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/317699293' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T09:36:14.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:14 smithi001 ceph-mon[31225]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T09:36:14.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:14 smithi001 ceph-mon[31225]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T09:36:14.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:14 smithi001 ceph-mon[31225]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T09:36:14.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:14 smithi001 ceph-mon[31225]: mds.? [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] up:active 2024-09-19T09:36:14.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:14 smithi001 ceph-mon[31225]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:36:15.042 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:15.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:14 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/317699293' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T09:36:15.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:14 smithi022 ceph-mon[35583]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T09:36:15.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:14 smithi022 ceph-mon[35583]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T09:36:15.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:14 smithi022 ceph-mon[35583]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T09:36:15.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:14 smithi022 ceph-mon[35583]: mds.? [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] up:active 2024-09-19T09:36:15.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:14 smithi022 ceph-mon[35583]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:36:15.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:14 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/317699293' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T09:36:15.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:14 smithi121 ceph-mon[35577]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T09:36:15.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:14 smithi121 ceph-mon[35577]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T09:36:15.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:14 smithi121 ceph-mon[35577]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T09:36:15.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:14 smithi121 ceph-mon[35577]: mds.? [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] up:active 2024-09-19T09:36:15.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:14 smithi121 ceph-mon[35577]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:36:15.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.667+0000 7fb6cca84640 1 -- 172.21.15.1:0/805202928 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6c81036e0 msgr2=0x7fb6c8107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:15.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.667+0000 7fb6cca84640 1 --2- 172.21.15.1:0/805202928 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6c81036e0 0x7fb6c8107b90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0009930 tx=0x7fb6b002a420 comp rx=0 tx=0).stop 2024-09-19T09:36:15.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.667+0000 7fb6cca84640 1 -- 172.21.15.1:0/805202928 shutdown_connections 2024-09-19T09:36:15.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.667+0000 7fb6cca84640 1 --2- 172.21.15.1:0/805202928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6c81082a0 0x7fb6c810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:15.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.667+0000 7fb6cca84640 1 --2- 172.21.15.1:0/805202928 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6c81036e0 0x7fb6c8107b90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:15.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.667+0000 7fb6cca84640 1 --2- 172.21.15.1:0/805202928 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6c8102d30 0x7fb6c8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:15.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.667+0000 7fb6cca84640 1 -- 172.21.15.1:0/805202928 >> 172.21.15.1:0/805202928 conn(0x7fb6c80fc7d0 msgr2=0x7fb6c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:15.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.667+0000 7fb6cca84640 1 -- 172.21.15.1:0/805202928 shutdown_connections 2024-09-19T09:36:15.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.667+0000 7fb6cca84640 1 -- 172.21.15.1:0/805202928 wait complete. 2024-09-19T09:36:15.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.668+0000 7fb6cca84640 1 Processor -- start 2024-09-19T09:36:15.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.668+0000 7fb6cca84640 1 -- start start 2024-09-19T09:36:15.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.668+0000 7fb6cca84640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6c8102d30 0x7fb6c8198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:15.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.668+0000 7fb6cca84640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6c81036e0 0x7fb6c8198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:15.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.668+0000 7fb6cca84640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6c81082a0 0x7fb6c819ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:15.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.668+0000 7fb6cca84640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c81120c0 con 0x7fb6c81082a0 2024-09-19T09:36:15.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.668+0000 7fb6cca84640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c8111f40 con 0x7fb6c81036e0 2024-09-19T09:36:15.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.668+0000 7fb6cca84640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c8112240 con 0x7fb6c8102d30 2024-09-19T09:36:15.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.668+0000 7fb6c6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6c81082a0 0x7fb6c819ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:15.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.668+0000 7fb6c6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6c81082a0 0x7fb6c819ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41480/0 (socket says 172.21.15.1:41480) 2024-09-19T09:36:15.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.668+0000 7fb6c6d9d640 1 -- 172.21.15.1:0/2717317651 learned_addr learned my addr 172.21.15.1:0/2717317651 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:15.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.669+0000 7fb6c5d9b640 1 --2- 172.21.15.1:0/2717317651 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6c81036e0 0x7fb6c8198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:15.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.669+0000 7fb6c659c640 1 --2- 172.21.15.1:0/2717317651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6c8102d30 0x7fb6c8198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:15.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.669+0000 7fb6c6d9d640 1 -- 172.21.15.1:0/2717317651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6c8102d30 msgr2=0x7fb6c8198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:15.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.669+0000 7fb6c6d9d640 1 --2- 172.21.15.1:0/2717317651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6c8102d30 0x7fb6c8198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:15.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.669+0000 7fb6c6d9d640 1 -- 172.21.15.1:0/2717317651 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6c81036e0 msgr2=0x7fb6c8198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:15.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.669+0000 7fb6c6d9d640 1 --2- 172.21.15.1:0/2717317651 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6c81036e0 0x7fb6c8198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:15.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.669+0000 7fb6c6d9d640 1 -- 172.21.15.1:0/2717317651 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c819d540 con 0x7fb6c81082a0 2024-09-19T09:36:15.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.669+0000 7fb6c5d9b640 1 --2- 172.21.15.1:0/2717317651 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6c81036e0 0x7fb6c8198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:15.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.669+0000 7fb6c6d9d640 1 --2- 172.21.15.1:0/2717317651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6c81082a0 0x7fb6c819ce60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb6c000b970 tx=0x7fb6c000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:15.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.669+0000 7fb6bf7fe640 1 -- 172.21.15.1:0/2717317651 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0019070 con 0x7fb6c81082a0 2024-09-19T09:36:15.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.669+0000 7fb6cca84640 1 -- 172.21.15.1:0/2717317651 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c819d830 con 0x7fb6c81082a0 2024-09-19T09:36:15.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.669+0000 7fb6bf7fe640 1 -- 172.21.15.1:0/2717317651 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6c000cb40 con 0x7fb6c81082a0 2024-09-19T09:36:15.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.669+0000 7fb6bf7fe640 1 -- 172.21.15.1:0/2717317651 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0007650 con 0x7fb6c81082a0 2024-09-19T09:36:15.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.669+0000 7fb6cca84640 1 -- 172.21.15.1:0/2717317651 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c81a5110 con 0x7fb6c81082a0 2024-09-19T09:36:15.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.670+0000 7fb6cca84640 1 -- 172.21.15.1:0/2717317651 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6c8103110 con 0x7fb6c81082a0 2024-09-19T09:36:15.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.671+0000 7fb6bf7fe640 1 -- 172.21.15.1:0/2717317651 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fb6c001c070 con 0x7fb6c81082a0 2024-09-19T09:36:15.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.673+0000 7fb6bf7fe640 1 --2- 172.21.15.1:0/2717317651 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb6b40a3240 0x7fb6b40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:15.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.673+0000 7fb6c659c640 1 --2- 172.21.15.1:0/2717317651 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb6b40a3240 0x7fb6b40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:15.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.673+0000 7fb6bf7fe640 1 -- 172.21.15.1:0/2717317651 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fb6c00cee60 con 0x7fb6c81082a0 2024-09-19T09:36:15.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.673+0000 7fb6c659c640 1 --2- 172.21.15.1:0/2717317651 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb6b40a3240 0x7fb6b40a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8005e10 tx=0x7fb6b8005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:15.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.677+0000 7fb6bf7fe640 1 -- 172.21.15.1:0/2717317651 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb6c009bcd0 con 0x7fb6c81082a0 2024-09-19T09:36:15.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.855+0000 7fb6cca84640 1 -- 172.21.15.1:0/2717317651 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb6c810a2b0 con 0x7fb6c81082a0 2024-09-19T09:36:15.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.856+0000 7fb6bf7fe640 1 -- 172.21.15.1:0/2717317651 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22187 (secure 0 0 0) 0x7fb6c009b5d0 con 0x7fb6c81082a0 2024-09-19T09:36:15.859 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:36:15.859 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":81,"fsid":"57238232-7669-11ef-bceb-c7b262605968","created":"2024-09-19T09:28:28.406983+0000","modified":"2024-09-19T09:36:13.637291+0000","last_up_change":"2024-09-19T09:35:21.422825+0000","last_in_change":"2024-09-19T09:34:57.199184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:31:30.566509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:36:09.521275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:36:11.954337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c165571d-43f1-4c43-ba1e-35872d914f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6803","nonce":502676986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6805","nonce":502676986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6809","nonce":502676986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6807","nonce":502676986}]},"public_addr":"172.21.15.1:6803/502676986","cluster_addr":"172.21.15.1:6805/502676986","heartbeat_back_addr":"172.21.15.1:6809/502676986","heartbeat_front_addr":"172.21.15.1:6807/502676986","state":["exists","up"]},{"osd":1,"uuid":"baf120f8-8ba3-4aa5-a12a-41cdc97ff11b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6801","nonce":3735826323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6803","nonce":3735826323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6807","nonce":3735826323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6805","nonce":3735826323}]},"public_addr":"172.21.15.22:6801/3735826323","cluster_addr":"172.21.15.22:6803/3735826323","heartbeat_back_addr":"172.21.15.22:6807/3735826323","heartbeat_front_addr":"172.21.15.22:6805/3735826323","state":["exists","up"]},{"osd":2,"uuid":"72c520bf-c5cc-44ee-a38c-c9bac0a6280b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6801","nonce":1924970833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6803","nonce":1924970833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6807","nonce":1924970833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6805","nonce":1924970833}]},"public_addr":"172.21.15.121:6801/1924970833","cluster_addr":"172.21.15.121:6803/1924970833","heartbeat_back_addr":"172.21.15.121:6807/1924970833","heartbeat_front_addr":"172.21.15.121:6805/1924970833","state":["exists","up"]},{"osd":3,"uuid":"adad6d17-16d9-4c43-b581-35ac1bb9d807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6811","nonce":1515009793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6813","nonce":1515009793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6817","nonce":1515009793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6815","nonce":1515009793}]},"public_addr":"172.21.15.1:6811/1515009793","cluster_addr":"172.21.15.1:6813/1515009793","heartbeat_back_addr":"172.21.15.1:6817/1515009793","heartbeat_front_addr":"172.21.15.1:6815/1515009793","state":["exists","up"]},{"osd":4,"uuid":"8fb06efe-c3a0-48a3-9730-3e8f3e60922d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6809","nonce":923697266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6811","nonce":923697266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6815","nonce":923697266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6813","nonce":923697266}]},"public_addr":"172.21.15.22:6809/923697266","cluster_addr":"172.21.15.22:6811/923697266","heartbeat_back_addr":"172.21.15.22:6815/923697266","heartbeat_front_addr":"172.21.15.22:6813/923697266","state":["exists","up"]},{"osd":5,"uuid":"3b2f428c-8a5a-49be-9f43-a9f379a1c7e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6809","nonce":3137245658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6811","nonce":3137245658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6815","nonce":3137245658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6813","nonce":3137245658}]},"public_addr":"172.21.15.121:6809/3137245658","cluster_addr":"172.21.15.121:6811/3137245658","heartbeat_back_addr":"172.21.15.121:6815/3137245658","heartbeat_front_addr":"172.21.15.121:6813/3137245658","state":["exists","up"]},{"osd":6,"uuid":"5aecec68-ff7e-440c-bd39-cc35ab89cc91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6819","nonce":3376780798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6821","nonce":3376780798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6825","nonce":3376780798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6823","nonce":3376780798}]},"public_addr":"172.21.15.1:6819/3376780798","cluster_addr":"172.21.15.1:6821/3376780798","heartbeat_back_addr":"172.21.15.1:6825/3376780798","heartbeat_front_addr":"172.21.15.1:6823/3376780798","state":["exists","up"]},{"osd":7,"uuid":"46556bdf-199e-4268-873b-6d87b54e1176","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6817","nonce":2920985295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6819","nonce":2920985295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6823","nonce":2920985295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6821","nonce":2920985295}]},"public_addr":"172.21.15.22:6817/2920985295","cluster_addr":"172.21.15.22:6819/2920985295","heartbeat_back_addr":"172.21.15.22:6823/2920985295","heartbeat_front_addr":"172.21.15.22:6821/2920985295","state":["exists","up"]},{"osd":8,"uuid":"e7c3792a-94a4-4440-be74-d6abdf3d9566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6817","nonce":3589985967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6819","nonce":3589985967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6823","nonce":3589985967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6821","nonce":3589985967}]},"public_addr":"172.21.15.121:6817/3589985967","cluster_addr":"172.21.15.121:6819/3589985967","heartbeat_back_addr":"172.21.15.121:6823/3589985967","heartbeat_front_addr":"172.21.15.121:6821/3589985967","state":["exists","up"]},{"osd":9,"uuid":"8af80ac9-d681-4966-b083-ead5185eff12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6827","nonce":1143859822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6829","nonce":1143859822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6833","nonce":1143859822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6831","nonce":1143859822}]},"public_addr":"172.21.15.1:6827/1143859822","cluster_addr":"172.21.15.1:6829/1143859822","heartbeat_back_addr":"172.21.15.1:6833/1143859822","heartbeat_front_addr":"172.21.15.1:6831/1143859822","state":["exists","up"]},{"osd":10,"uuid":"34edd06a-7f60-4465-bfe1-0c646abd53f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6825","nonce":343155547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6827","nonce":343155547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6831","nonce":343155547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6829","nonce":343155547}]},"public_addr":"172.21.15.22:6825/343155547","cluster_addr":"172.21.15.22:6827/343155547","heartbeat_back_addr":"172.21.15.22:6831/343155547","heartbeat_front_addr":"172.21.15.22:6829/343155547","state":["exists","up"]},{"osd":11,"uuid":"5a831eb6-ad66-4ab6-a30a-b6299ce1f88d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6825","nonce":3202514460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6827","nonce":3202514460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6831","nonce":3202514460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6829","nonce":3202514460}]},"public_addr":"172.21.15.121:6825/3202514460","cluster_addr":"172.21.15.121:6827/3202514460","heartbeat_back_addr":"172.21.15.121:6831/3202514460","heartbeat_front_addr":"172.21.15.121:6829/3202514460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:30:37.582893+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:01.915252+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:26.783477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:53.407014+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:19.407005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:45.022320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:11.377986+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:36.818700+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:01.745428+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:27.928916+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:53.363906+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:19.037551+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6800/1028873727":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/3137949087":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/1951370933":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2008363642":"2024-09-20T09:28:50.074985+0000","172.21.15.1:0/3006931063":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2486161758":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6801/1296304385":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6801/1028873727":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2783823049":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6800/1296304385":"2024-09-20T09:28:50.074985+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:36:15.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.858+0000 7fb6cca84640 1 -- 172.21.15.1:0/2717317651 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb6b40a3240 msgr2=0x7fb6b40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:15.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.858+0000 7fb6cca84640 1 --2- 172.21.15.1:0/2717317651 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb6b40a3240 0x7fb6b40a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8005e10 tx=0x7fb6b8005da0 comp rx=0 tx=0).stop 2024-09-19T09:36:15.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.858+0000 7fb6cca84640 1 -- 172.21.15.1:0/2717317651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6c81082a0 msgr2=0x7fb6c819ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:15.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.858+0000 7fb6cca84640 1 --2- 172.21.15.1:0/2717317651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6c81082a0 0x7fb6c819ce60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb6c000b970 tx=0x7fb6c000be30 comp rx=0 tx=0).stop 2024-09-19T09:36:15.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.858+0000 7fb6cca84640 1 -- 172.21.15.1:0/2717317651 shutdown_connections 2024-09-19T09:36:15.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.858+0000 7fb6cca84640 1 --2- 172.21.15.1:0/2717317651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6c81082a0 0x7fb6c819ce60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:15.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.858+0000 7fb6cca84640 1 --2- 172.21.15.1:0/2717317651 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb6b40a3240 0x7fb6b40a5700 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:15.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.858+0000 7fb6cca84640 1 --2- 172.21.15.1:0/2717317651 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6c81036e0 0x7fb6c8198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:15.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.858+0000 7fb6cca84640 1 --2- 172.21.15.1:0/2717317651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6c8102d30 0x7fb6c8198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:15.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.858+0000 7fb6cca84640 1 -- 172.21.15.1:0/2717317651 >> 172.21.15.1:0/2717317651 conn(0x7fb6c80fc7d0 msgr2=0x7fb6c8105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:15.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.858+0000 7fb6cca84640 1 -- 172.21.15.1:0/2717317651 shutdown_connections 2024-09-19T09:36:15.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:15.858+0000 7fb6cca84640 1 -- 172.21.15.1:0/2717317651 wait complete. 2024-09-19T09:36:16.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:15 smithi001 ceph-mon[31225]: pgmap v281: 97 pgs: 4 creating+activating, 12 creating+peering, 46 unknown, 35 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-19T09:36:16.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:15 smithi001 ceph-mon[31225]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T09:36:16.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:15 smithi001 ceph-mon[31225]: Cluster is now healthy 2024-09-19T09:36:16.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:15 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/2717317651' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:36:16.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:15 smithi022 ceph-mon[35583]: pgmap v281: 97 pgs: 4 creating+activating, 12 creating+peering, 46 unknown, 35 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-19T09:36:16.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:15 smithi022 ceph-mon[35583]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T09:36:16.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:15 smithi022 ceph-mon[35583]: Cluster is now healthy 2024-09-19T09:36:16.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:15 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/2717317651' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:36:16.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:15 smithi121 ceph-mon[35577]: pgmap v281: 97 pgs: 4 creating+activating, 12 creating+peering, 46 unknown, 35 active+clean; 577 KiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-19T09:36:16.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:15 smithi121 ceph-mon[35577]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T09:36:16.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:15 smithi121 ceph-mon[35577]: Cluster is now healthy 2024-09-19T09:36:16.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:15 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/2717317651' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:36:16.645 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:36:16.908 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:17.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.450+0000 7f94bee95640 1 -- 172.21.15.1:0/2653007442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94b8101de0 msgr2=0x7f94b81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:17.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.450+0000 7f94bee95640 1 --2- 172.21.15.1:0/2653007442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94b8101de0 0x7f94b81021c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f94ac009900 tx=0x7f94ac02a3f0 comp rx=0 tx=0).stop 2024-09-19T09:36:17.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.450+0000 7f94bee95640 1 -- 172.21.15.1:0/2653007442 shutdown_connections 2024-09-19T09:36:17.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.450+0000 7f94bee95640 1 --2- 172.21.15.1:0/2653007442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94b8106f10 0x7f94b810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:17.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.450+0000 7f94bee95640 1 --2- 172.21.15.1:0/2653007442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f94b8102790 0x7f94b81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:17.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.450+0000 7f94bee95640 1 --2- 172.21.15.1:0/2653007442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94b8101de0 0x7f94b81021c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:17.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.450+0000 7f94bee95640 1 -- 172.21.15.1:0/2653007442 >> 172.21.15.1:0/2653007442 conn(0x7f94b80fd8c0 msgr2=0x7f94b80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:17.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.450+0000 7f94bee95640 1 -- 172.21.15.1:0/2653007442 shutdown_connections 2024-09-19T09:36:17.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.450+0000 7f94bee95640 1 -- 172.21.15.1:0/2653007442 wait complete. 2024-09-19T09:36:17.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.451+0000 7f94bee95640 1 Processor -- start 2024-09-19T09:36:17.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.451+0000 7f94bee95640 1 -- start start 2024-09-19T09:36:17.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.451+0000 7f94bee95640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94b8101de0 0x7f94b8198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:17.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.451+0000 7f94bee95640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f94b8102790 0x7f94b8198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:17.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.451+0000 7f94bee95640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94b8106f10 0x7f94b819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:17.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.451+0000 7f94bee95640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f94b8111fc0 con 0x7f94b8106f10 2024-09-19T09:36:17.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.451+0000 7f94bee95640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f94b8111e40 con 0x7f94b8102790 2024-09-19T09:36:17.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.451+0000 7f94bee95640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f94b8112140 con 0x7f94b8101de0 2024-09-19T09:36:17.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.451+0000 7f94bd432640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94b8106f10 0x7f94b819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:17.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.451+0000 7f94bd432640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94b8106f10 0x7f94b819cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41500/0 (socket says 172.21.15.1:41500) 2024-09-19T09:36:17.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.451+0000 7f94bd432640 1 -- 172.21.15.1:0/3718185320 learned_addr learned my addr 172.21.15.1:0/3718185320 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:17.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.451+0000 7f94b7fff640 1 --2- 172.21.15.1:0/3718185320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f94b8102790 0x7f94b8198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:17.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.452+0000 7f94bcc31640 1 --2- 172.21.15.1:0/3718185320 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94b8101de0 0x7f94b8198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:17.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.452+0000 7f94bd432640 1 -- 172.21.15.1:0/3718185320 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94b8101de0 msgr2=0x7f94b8198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:17.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.452+0000 7f94bd432640 1 --2- 172.21.15.1:0/3718185320 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94b8101de0 0x7f94b8198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:17.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.452+0000 7f94bd432640 1 -- 172.21.15.1:0/3718185320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f94b8102790 msgr2=0x7f94b8198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:17.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.452+0000 7f94bd432640 1 --2- 172.21.15.1:0/3718185320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f94b8102790 0x7f94b8198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:17.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.452+0000 7f94bd432640 1 -- 172.21.15.1:0/3718185320 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b819d3f0 con 0x7f94b8106f10 2024-09-19T09:36:17.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.452+0000 7f94bd432640 1 --2- 172.21.15.1:0/3718185320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94b8106f10 0x7f94b819cd10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f94b000cad0 tx=0x7f94b000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:17.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.452+0000 7f94b5ffb640 1 -- 172.21.15.1:0/3718185320 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b000ad60 con 0x7f94b8106f10 2024-09-19T09:36:17.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.452+0000 7f94bee95640 1 -- 172.21.15.1:0/3718185320 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94b819d6e0 con 0x7f94b8106f10 2024-09-19T09:36:17.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.452+0000 7f94b5ffb640 1 -- 172.21.15.1:0/3718185320 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94b0005020 con 0x7f94b8106f10 2024-09-19T09:36:17.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.452+0000 7f94b5ffb640 1 -- 172.21.15.1:0/3718185320 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b000f6b0 con 0x7f94b8106f10 2024-09-19T09:36:17.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.452+0000 7f94bee95640 1 -- 172.21.15.1:0/3718185320 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94b81a4fc0 con 0x7f94b8106f10 2024-09-19T09:36:17.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.453+0000 7f94bee95640 1 -- 172.21.15.1:0/3718185320 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94b81021c0 con 0x7f94b8106f10 2024-09-19T09:36:17.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.454+0000 7f94b5ffb640 1 -- 172.21.15.1:0/3718185320 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f94b0005560 con 0x7f94b8106f10 2024-09-19T09:36:17.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.455+0000 7f94b5ffb640 1 --2- 172.21.15.1:0/3718185320 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f94a80a3240 0x7f94a80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:17.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.455+0000 7f94b5ffb640 1 -- 172.21.15.1:0/3718185320 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f94b00cf7a0 con 0x7f94b8106f10 2024-09-19T09:36:17.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.455+0000 7f94bcc31640 1 --2- 172.21.15.1:0/3718185320 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f94a80a3240 0x7f94a80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:17.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.455+0000 7f94bcc31640 1 --2- 172.21.15.1:0/3718185320 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f94a80a3240 0x7f94a80a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f94ac000c00 tx=0x7f94ac005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:17.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.459+0000 7f94b5ffb640 1 -- 172.21.15.1:0/3718185320 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f94b0014030 con 0x7f94b8106f10 2024-09-19T09:36:17.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.636+0000 7f94bee95640 1 -- 172.21.15.1:0/3718185320 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f94b810a0f0 con 0x7f94b8106f10 2024-09-19T09:36:17.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.638+0000 7f94b5ffb640 1 -- 172.21.15.1:0/3718185320 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22187 (secure 0 0 0) 0x7f94b009c610 con 0x7f94b8106f10 2024-09-19T09:36:17.641 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:36:17.641 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":81,"fsid":"57238232-7669-11ef-bceb-c7b262605968","created":"2024-09-19T09:28:28.406983+0000","modified":"2024-09-19T09:36:13.637291+0000","last_up_change":"2024-09-19T09:35:21.422825+0000","last_in_change":"2024-09-19T09:34:57.199184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:31:30.566509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:36:09.521275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:36:11.954337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c165571d-43f1-4c43-ba1e-35872d914f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6803","nonce":502676986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6805","nonce":502676986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6809","nonce":502676986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6807","nonce":502676986}]},"public_addr":"172.21.15.1:6803/502676986","cluster_addr":"172.21.15.1:6805/502676986","heartbeat_back_addr":"172.21.15.1:6809/502676986","heartbeat_front_addr":"172.21.15.1:6807/502676986","state":["exists","up"]},{"osd":1,"uuid":"baf120f8-8ba3-4aa5-a12a-41cdc97ff11b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6801","nonce":3735826323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6803","nonce":3735826323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6807","nonce":3735826323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6805","nonce":3735826323}]},"public_addr":"172.21.15.22:6801/3735826323","cluster_addr":"172.21.15.22:6803/3735826323","heartbeat_back_addr":"172.21.15.22:6807/3735826323","heartbeat_front_addr":"172.21.15.22:6805/3735826323","state":["exists","up"]},{"osd":2,"uuid":"72c520bf-c5cc-44ee-a38c-c9bac0a6280b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6801","nonce":1924970833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6803","nonce":1924970833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6807","nonce":1924970833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6805","nonce":1924970833}]},"public_addr":"172.21.15.121:6801/1924970833","cluster_addr":"172.21.15.121:6803/1924970833","heartbeat_back_addr":"172.21.15.121:6807/1924970833","heartbeat_front_addr":"172.21.15.121:6805/1924970833","state":["exists","up"]},{"osd":3,"uuid":"adad6d17-16d9-4c43-b581-35ac1bb9d807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6811","nonce":1515009793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6813","nonce":1515009793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6817","nonce":1515009793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6815","nonce":1515009793}]},"public_addr":"172.21.15.1:6811/1515009793","cluster_addr":"172.21.15.1:6813/1515009793","heartbeat_back_addr":"172.21.15.1:6817/1515009793","heartbeat_front_addr":"172.21.15.1:6815/1515009793","state":["exists","up"]},{"osd":4,"uuid":"8fb06efe-c3a0-48a3-9730-3e8f3e60922d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6809","nonce":923697266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6811","nonce":923697266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6815","nonce":923697266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6813","nonce":923697266}]},"public_addr":"172.21.15.22:6809/923697266","cluster_addr":"172.21.15.22:6811/923697266","heartbeat_back_addr":"172.21.15.22:6815/923697266","heartbeat_front_addr":"172.21.15.22:6813/923697266","state":["exists","up"]},{"osd":5,"uuid":"3b2f428c-8a5a-49be-9f43-a9f379a1c7e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6809","nonce":3137245658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6811","nonce":3137245658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6815","nonce":3137245658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6813","nonce":3137245658}]},"public_addr":"172.21.15.121:6809/3137245658","cluster_addr":"172.21.15.121:6811/3137245658","heartbeat_back_addr":"172.21.15.121:6815/3137245658","heartbeat_front_addr":"172.21.15.121:6813/3137245658","state":["exists","up"]},{"osd":6,"uuid":"5aecec68-ff7e-440c-bd39-cc35ab89cc91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6819","nonce":3376780798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6821","nonce":3376780798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6825","nonce":3376780798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6823","nonce":3376780798}]},"public_addr":"172.21.15.1:6819/3376780798","cluster_addr":"172.21.15.1:6821/3376780798","heartbeat_back_addr":"172.21.15.1:6825/3376780798","heartbeat_front_addr":"172.21.15.1:6823/3376780798","state":["exists","up"]},{"osd":7,"uuid":"46556bdf-199e-4268-873b-6d87b54e1176","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6817","nonce":2920985295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6819","nonce":2920985295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6823","nonce":2920985295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6821","nonce":2920985295}]},"public_addr":"172.21.15.22:6817/2920985295","cluster_addr":"172.21.15.22:6819/2920985295","heartbeat_back_addr":"172.21.15.22:6823/2920985295","heartbeat_front_addr":"172.21.15.22:6821/2920985295","state":["exists","up"]},{"osd":8,"uuid":"e7c3792a-94a4-4440-be74-d6abdf3d9566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6817","nonce":3589985967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6819","nonce":3589985967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6823","nonce":3589985967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6821","nonce":3589985967}]},"public_addr":"172.21.15.121:6817/3589985967","cluster_addr":"172.21.15.121:6819/3589985967","heartbeat_back_addr":"172.21.15.121:6823/3589985967","heartbeat_front_addr":"172.21.15.121:6821/3589985967","state":["exists","up"]},{"osd":9,"uuid":"8af80ac9-d681-4966-b083-ead5185eff12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6827","nonce":1143859822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6829","nonce":1143859822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6833","nonce":1143859822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6831","nonce":1143859822}]},"public_addr":"172.21.15.1:6827/1143859822","cluster_addr":"172.21.15.1:6829/1143859822","heartbeat_back_addr":"172.21.15.1:6833/1143859822","heartbeat_front_addr":"172.21.15.1:6831/1143859822","state":["exists","up"]},{"osd":10,"uuid":"34edd06a-7f60-4465-bfe1-0c646abd53f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6825","nonce":343155547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6827","nonce":343155547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6831","nonce":343155547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6829","nonce":343155547}]},"public_addr":"172.21.15.22:6825/343155547","cluster_addr":"172.21.15.22:6827/343155547","heartbeat_back_addr":"172.21.15.22:6831/343155547","heartbeat_front_addr":"172.21.15.22:6829/343155547","state":["exists","up"]},{"osd":11,"uuid":"5a831eb6-ad66-4ab6-a30a-b6299ce1f88d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6825","nonce":3202514460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6827","nonce":3202514460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6831","nonce":3202514460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6829","nonce":3202514460}]},"public_addr":"172.21.15.121:6825/3202514460","cluster_addr":"172.21.15.121:6827/3202514460","heartbeat_back_addr":"172.21.15.121:6831/3202514460","heartbeat_front_addr":"172.21.15.121:6829/3202514460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:30:37.582893+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:01.915252+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:26.783477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:53.407014+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:19.407005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:45.022320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:11.377986+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:36.818700+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:01.745428+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:27.928916+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:53.363906+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:19.037551+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6800/1028873727":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/3137949087":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/1951370933":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2008363642":"2024-09-20T09:28:50.074985+0000","172.21.15.1:0/3006931063":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2486161758":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6801/1296304385":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6801/1028873727":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2783823049":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6800/1296304385":"2024-09-20T09:28:50.074985+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:36:17.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.641+0000 7f94bee95640 1 -- 172.21.15.1:0/3718185320 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f94a80a3240 msgr2=0x7f94a80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:17.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.641+0000 7f94bee95640 1 --2- 172.21.15.1:0/3718185320 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f94a80a3240 0x7f94a80a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f94ac000c00 tx=0x7f94ac005a20 comp rx=0 tx=0).stop 2024-09-19T09:36:17.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.641+0000 7f94bee95640 1 -- 172.21.15.1:0/3718185320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94b8106f10 msgr2=0x7f94b819cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:17.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.641+0000 7f94bee95640 1 --2- 172.21.15.1:0/3718185320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94b8106f10 0x7f94b819cd10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f94b000cad0 tx=0x7f94b000ced0 comp rx=0 tx=0).stop 2024-09-19T09:36:17.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.641+0000 7f94bee95640 1 -- 172.21.15.1:0/3718185320 shutdown_connections 2024-09-19T09:36:17.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.641+0000 7f94bee95640 1 --2- 172.21.15.1:0/3718185320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94b8106f10 0x7f94b819cd10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:17.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.641+0000 7f94bee95640 1 --2- 172.21.15.1:0/3718185320 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f94a80a3240 0x7f94a80a5700 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:17.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.641+0000 7f94bee95640 1 --2- 172.21.15.1:0/3718185320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f94b8102790 0x7f94b8198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:17.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.641+0000 7f94bee95640 1 --2- 172.21.15.1:0/3718185320 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94b8101de0 0x7f94b8198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:17.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.641+0000 7f94bee95640 1 -- 172.21.15.1:0/3718185320 >> 172.21.15.1:0/3718185320 conn(0x7f94b80fd8c0 msgr2=0x7f94b80feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:17.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.641+0000 7f94bee95640 1 -- 172.21.15.1:0/3718185320 shutdown_connections 2024-09-19T09:36:17.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:17.641+0000 7f94bee95640 1 -- 172.21.15.1:0/3718185320 wait complete. 2024-09-19T09:36:18.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:17 smithi001 ceph-mon[31225]: pgmap v282: 97 pgs: 4 creating+activating, 9 creating+peering, 84 active+clean; 579 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-19T09:36:18.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:17 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/3718185320' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:36:18.283 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-19T09:36:18.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:17 smithi022 ceph-mon[35583]: pgmap v282: 97 pgs: 4 creating+activating, 9 creating+peering, 84 active+clean; 579 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-19T09:36:18.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:17 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/3718185320' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:36:18.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:17 smithi121 ceph-mon[35577]: pgmap v282: 97 pgs: 4 creating+activating, 9 creating+peering, 84 active+clean; 579 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-19T09:36:18.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:17 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/3718185320' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:36:18.540 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:18.864 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:36:18 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-b[65343]: 2024-09-19T09:36:18.527+0000 7f611b0d6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T09:36:19.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.030+0000 7fc8bf6ab640 1 -- 172.21.15.1:0/3890865821 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8b8074f40 msgr2=0x7fc8b810de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:19.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.030+0000 7fc8bf6ab640 1 --2- 172.21.15.1:0/3890865821 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8b8074f40 0x7fc8b810de80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009900 tx=0x7fc8ac02a480 comp rx=0 tx=0).stop 2024-09-19T09:36:19.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.030+0000 7fc8bf6ab640 1 -- 172.21.15.1:0/3890865821 shutdown_connections 2024-09-19T09:36:19.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.030+0000 7fc8bf6ab640 1 --2- 172.21.15.1:0/3890865821 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8b810e3c0 0x7fc8b8110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:19.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.030+0000 7fc8bf6ab640 1 --2- 172.21.15.1:0/3890865821 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8b8074f40 0x7fc8b810de80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:19.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.030+0000 7fc8bf6ab640 1 --2- 172.21.15.1:0/3890865821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8b8074620 0x7fc8b8074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:19.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.030+0000 7fc8bf6ab640 1 -- 172.21.15.1:0/3890865821 >> 172.21.15.1:0/3890865821 conn(0x7fc8b80fd8c0 msgr2=0x7fc8b80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:19.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.030+0000 7fc8bf6ab640 1 -- 172.21.15.1:0/3890865821 shutdown_connections 2024-09-19T09:36:19.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.031+0000 7fc8bf6ab640 1 -- 172.21.15.1:0/3890865821 wait complete. 2024-09-19T09:36:19.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.031+0000 7fc8bf6ab640 1 Processor -- start 2024-09-19T09:36:19.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.031+0000 7fc8bf6ab640 1 -- start start 2024-09-19T09:36:19.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.031+0000 7fc8bf6ab640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8b8074620 0x7fc8b819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:19.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.031+0000 7fc8bf6ab640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8b8074f40 0x7fc8b819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:19.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.031+0000 7fc8bf6ab640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8b810e3c0 0x7fc8b819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:19.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.031+0000 7fc8bf6ab640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b8114160 con 0x7fc8b810e3c0 2024-09-19T09:36:19.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.031+0000 7fc8bf6ab640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b8113fe0 con 0x7fc8b8074f40 2024-09-19T09:36:19.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.031+0000 7fc8bf6ab640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b81142e0 con 0x7fc8b8074620 2024-09-19T09:36:19.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.031+0000 7fc8bdc48640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8b810e3c0 0x7fc8b819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:19.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.032+0000 7fc8bd447640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8b8074620 0x7fc8b819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:19.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.032+0000 7fc8bcc46640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8b8074f40 0x7fc8b819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:19.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.032+0000 7fc8bdc48640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8b810e3c0 0x7fc8b819ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41512/0 (socket says 172.21.15.1:41512) 2024-09-19T09:36:19.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.032+0000 7fc8bdc48640 1 -- 172.21.15.1:0/439508996 learned_addr learned my addr 172.21.15.1:0/439508996 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:19.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.032+0000 7fc8bdc48640 1 -- 172.21.15.1:0/439508996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8b8074620 msgr2=0x7fc8b819a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:19.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.032+0000 7fc8bdc48640 1 --2- 172.21.15.1:0/439508996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8b8074620 0x7fc8b819a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:19.090 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.032+0000 7fc8bdc48640 1 -- 172.21.15.1:0/439508996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8b8074f40 msgr2=0x7fc8b819abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:19.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.032+0000 7fc8bdc48640 1 --2- 172.21.15.1:0/439508996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8b8074f40 0x7fc8b819abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:19.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.032+0000 7fc8bdc48640 1 -- 172.21.15.1:0/439508996 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b819f650 con 0x7fc8b810e3c0 2024-09-19T09:36:19.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.032+0000 7fc8bcc46640 1 --2- 172.21.15.1:0/439508996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8b8074f40 0x7fc8b819abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:36:19.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.032+0000 7fc8bd447640 1 --2- 172.21.15.1:0/439508996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8b8074620 0x7fc8b819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:36:19.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.032+0000 7fc8bdc48640 1 --2- 172.21.15.1:0/439508996 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8b810e3c0 0x7fc8b819ef70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc8b000d750 tx=0x7fc8b000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:19.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.032+0000 7fc8b67fc640 1 -- 172.21.15.1:0/439508996 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0017070 con 0x7fc8b810e3c0 2024-09-19T09:36:19.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.032+0000 7fc8b67fc640 1 -- 172.21.15.1:0/439508996 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8b0005500 con 0x7fc8b810e3c0 2024-09-19T09:36:19.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.032+0000 7fc8bf6ab640 1 -- 172.21.15.1:0/439508996 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b819f940 con 0x7fc8b810e3c0 2024-09-19T09:36:19.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.032+0000 7fc8b67fc640 1 -- 172.21.15.1:0/439508996 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0004d90 con 0x7fc8b810e3c0 2024-09-19T09:36:19.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.032+0000 7fc8bf6ab640 1 -- 172.21.15.1:0/439508996 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b81a7220 con 0x7fc8b810e3c0 2024-09-19T09:36:19.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.033+0000 7fc8bf6ab640 1 -- 172.21.15.1:0/439508996 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8b8075cd0 con 0x7fc8b810e3c0 2024-09-19T09:36:19.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.034+0000 7fc8b67fc640 1 -- 172.21.15.1:0/439508996 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fc8b0004f30 con 0x7fc8b810e3c0 2024-09-19T09:36:19.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.035+0000 7fc8b67fc640 1 --2- 172.21.15.1:0/439508996 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc8a00a3240 0x7fc8a00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:19.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.035+0000 7fc8bd447640 1 --2- 172.21.15.1:0/439508996 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc8a00a3240 0x7fc8a00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:19.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.035+0000 7fc8b67fc640 1 -- 172.21.15.1:0/439508996 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fc8b00cf0a0 con 0x7fc8b810e3c0 2024-09-19T09:36:19.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.036+0000 7fc8bd447640 1 --2- 172.21.15.1:0/439508996 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc8a00a3240 0x7fc8a00a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8005c40 tx=0x7fc8a800a570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:19.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.039+0000 7fc8b67fc640 1 -- 172.21.15.1:0/439508996 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc8b009b8a0 con 0x7fc8b810e3c0 2024-09-19T09:36:19.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.254+0000 7fc8bf6ab640 1 -- 172.21.15.1:0/439508996 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc8b8109540 con 0x7fc8b810e3c0 2024-09-19T09:36:19.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.983+0000 7fc8b67fc640 1 -- 172.21.15.1:0/439508996 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7fc8b009fba0 con 0x7fc8b810e3c0 2024-09-19T09:36:19.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.986+0000 7fc8bf6ab640 1 -- 172.21.15.1:0/439508996 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc8a00a3240 msgr2=0x7fc8a00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:19.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.986+0000 7fc8bf6ab640 1 --2- 172.21.15.1:0/439508996 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc8a00a3240 0x7fc8a00a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8005c40 tx=0x7fc8a800a570 comp rx=0 tx=0).stop 2024-09-19T09:36:19.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.986+0000 7fc8bf6ab640 1 -- 172.21.15.1:0/439508996 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8b810e3c0 msgr2=0x7fc8b819ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:19.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.986+0000 7fc8bf6ab640 1 --2- 172.21.15.1:0/439508996 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8b810e3c0 0x7fc8b819ef70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc8b000d750 tx=0x7fc8b000dc10 comp rx=0 tx=0).stop 2024-09-19T09:36:19.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.986+0000 7fc8bf6ab640 1 -- 172.21.15.1:0/439508996 shutdown_connections 2024-09-19T09:36:19.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.986+0000 7fc8bf6ab640 1 --2- 172.21.15.1:0/439508996 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc8b810e3c0 0x7fc8b819ef70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:19.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.986+0000 7fc8bf6ab640 1 --2- 172.21.15.1:0/439508996 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc8a00a3240 0x7fc8a00a5700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:19.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.986+0000 7fc8bf6ab640 1 --2- 172.21.15.1:0/439508996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8b8074f40 0x7fc8b819abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:19.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.986+0000 7fc8bf6ab640 1 --2- 172.21.15.1:0/439508996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8b8074620 0x7fc8b819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:19.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.986+0000 7fc8bf6ab640 1 -- 172.21.15.1:0/439508996 >> 172.21.15.1:0/439508996 conn(0x7fc8b80fd8c0 msgr2=0x7fc8b80fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:19.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.986+0000 7fc8bf6ab640 1 -- 172.21.15.1:0/439508996 shutdown_connections 2024-09-19T09:36:19.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:19.986+0000 7fc8bf6ab640 1 -- 172.21.15.1:0/439508996 wait complete. 2024-09-19T09:36:20.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:19 smithi001 ceph-mon[31225]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-19T09:36:20.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:19 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/439508996' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T09:36:20.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:19 smithi022 ceph-mon[35583]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-19T09:36:20.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:19 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/439508996' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T09:36:20.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:19 smithi121 ceph-mon[35577]: pgmap v283: 97 pgs: 97 active+clean; 579 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-19T09:36:20.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:19 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/439508996' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T09:36:20.695 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 1, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-19T09:36:20.696 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-19T09:36:20.961 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:21.258 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:20 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/439508996' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T09:36:21.258 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:20 smithi001 ceph-mon[31225]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:36:21.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:20 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/439508996' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T09:36:21.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:20 smithi022 ceph-mon[35583]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:36:21.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:20 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/439508996' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T09:36:21.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:20 smithi121 ceph-mon[35577]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:36:21.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.438+0000 7f0497169640 1 -- 172.21.15.1:0/3308563005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0490100a80 msgr2=0x7f0490100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:21.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.438+0000 7f0497169640 1 --2- 172.21.15.1:0/3308563005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0490100a80 0x7f0490100ee0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f047c009930 tx=0x7f047c02a420 comp rx=0 tx=0).stop 2024-09-19T09:36:21.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.438+0000 7f0497169640 1 -- 172.21.15.1:0/3308563005 shutdown_connections 2024-09-19T09:36:21.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.438+0000 7f0497169640 1 --2- 172.21.15.1:0/3308563005 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0490101420 0x7f049010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:21.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.438+0000 7f0497169640 1 --2- 172.21.15.1:0/3308563005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0490100a80 0x7f0490100ee0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:21.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.438+0000 7f0497169640 1 --2- 172.21.15.1:0/3308563005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0490106a80 0x7f0490106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:21.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.438+0000 7f0497169640 1 -- 172.21.15.1:0/3308563005 >> 172.21.15.1:0/3308563005 conn(0x7f04900fc7a0 msgr2=0x7f04900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:21.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.438+0000 7f0497169640 1 -- 172.21.15.1:0/3308563005 shutdown_connections 2024-09-19T09:36:21.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.438+0000 7f0497169640 1 -- 172.21.15.1:0/3308563005 wait complete. 2024-09-19T09:36:21.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.439+0000 7f0497169640 1 Processor -- start 2024-09-19T09:36:21.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.439+0000 7f0497169640 1 -- start start 2024-09-19T09:36:21.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.439+0000 7f0497169640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0490100a80 0x7f04901983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:21.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.439+0000 7f0497169640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0490101420 0x7f04901988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:21.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.439+0000 7f0497169640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0490106a80 0x7f049019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:21.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.439+0000 7f0497169640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0490110e80 con 0x7f0490106a80 2024-09-19T09:36:21.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.439+0000 7f0497169640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0490110d00 con 0x7f0490101420 2024-09-19T09:36:21.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.439+0000 7f0497169640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0490111000 con 0x7f0490100a80 2024-09-19T09:36:21.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.439+0000 7f0495706640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0490106a80 0x7f049019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:21.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.439+0000 7f0495706640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0490106a80 0x7f049019cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41540/0 (socket says 172.21.15.1:41540) 2024-09-19T09:36:21.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.439+0000 7f0495706640 1 -- 172.21.15.1:0/2852563664 learned_addr learned my addr 172.21.15.1:0/2852563664 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:21.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.439+0000 7f0494f05640 1 --2- 172.21.15.1:0/2852563664 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0490100a80 0x7f04901983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:21.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.439+0000 7f048ffff640 1 --2- 172.21.15.1:0/2852563664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0490101420 0x7f04901988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:21.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.440+0000 7f0495706640 1 -- 172.21.15.1:0/2852563664 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0490100a80 msgr2=0x7f04901983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:21.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.440+0000 7f0495706640 1 --2- 172.21.15.1:0/2852563664 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0490100a80 0x7f04901983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:21.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.440+0000 7f0495706640 1 -- 172.21.15.1:0/2852563664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0490101420 msgr2=0x7f04901988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:21.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.440+0000 7f0495706640 1 --2- 172.21.15.1:0/2852563664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0490101420 0x7f04901988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:21.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.440+0000 7f0495706640 1 -- 172.21.15.1:0/2852563664 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f049019d350 con 0x7f0490106a80 2024-09-19T09:36:21.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.440+0000 7f0495706640 1 --2- 172.21.15.1:0/2852563664 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0490106a80 0x7f049019cc70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f048800cce0 tx=0x7f048800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:21.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.440+0000 7f048dffb640 1 -- 172.21.15.1:0/2852563664 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048800f450 con 0x7f0490106a80 2024-09-19T09:36:21.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.440+0000 7f048dffb640 1 -- 172.21.15.1:0/2852563664 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f048800fad0 con 0x7f0490106a80 2024-09-19T09:36:21.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.440+0000 7f0497169640 1 -- 172.21.15.1:0/2852563664 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f049019d640 con 0x7f0490106a80 2024-09-19T09:36:21.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.440+0000 7f048dffb640 1 -- 172.21.15.1:0/2852563664 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488018c10 con 0x7f0490106a80 2024-09-19T09:36:21.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.440+0000 7f0497169640 1 -- 172.21.15.1:0/2852563664 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04901a4f20 con 0x7f0490106a80 2024-09-19T09:36:21.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.441+0000 7f0497169640 1 -- 172.21.15.1:0/2852563664 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0490100ee0 con 0x7f0490106a80 2024-09-19T09:36:21.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.442+0000 7f048dffb640 1 -- 172.21.15.1:0/2852563664 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f048800f5f0 con 0x7f0490106a80 2024-09-19T09:36:21.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.443+0000 7f048dffb640 1 --2- 172.21.15.1:0/2852563664 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f04800a3240 0x7f04800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:21.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.443+0000 7f0494f05640 1 --2- 172.21.15.1:0/2852563664 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f04800a3240 0x7f04800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:21.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.443+0000 7f048dffb640 1 -- 172.21.15.1:0/2852563664 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f04880cfea0 con 0x7f0490106a80 2024-09-19T09:36:21.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.444+0000 7f0494f05640 1 --2- 172.21.15.1:0/2852563664 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f04800a3240 0x7f04800a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f048400bb60 tx=0x7f048400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:21.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.448+0000 7f048dffb640 1 -- 172.21.15.1:0/2852563664 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0488014030 con 0x7f0490106a80 2024-09-19T09:36:21.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.663+0000 7f0497169640 1 -- 172.21.15.1:0/2852563664 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f049010a000 con 0x7f0490106a80 2024-09-19T09:36:22.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:21.998+0000 7f048dffb640 1 -- 172.21.15.1:0/2852563664 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v17) ==== 121+0+0 (secure 0 0 0) 0x7f04880bc0c0 con 0x7f0490106a80 2024-09-19T09:36:22.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:22.001+0000 7f0497169640 1 -- 172.21.15.1:0/2852563664 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f04800a3240 msgr2=0x7f04800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:22.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:22.001+0000 7f0497169640 1 --2- 172.21.15.1:0/2852563664 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f04800a3240 0x7f04800a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f048400bb60 tx=0x7f048400b390 comp rx=0 tx=0).stop 2024-09-19T09:36:22.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:22.001+0000 7f0497169640 1 -- 172.21.15.1:0/2852563664 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0490106a80 msgr2=0x7f049019cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:22.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:22.001+0000 7f0497169640 1 --2- 172.21.15.1:0/2852563664 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0490106a80 0x7f049019cc70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f048800cce0 tx=0x7f048800a620 comp rx=0 tx=0).stop 2024-09-19T09:36:22.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:22.001+0000 7f0497169640 1 -- 172.21.15.1:0/2852563664 shutdown_connections 2024-09-19T09:36:22.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:22.001+0000 7f0497169640 1 --2- 172.21.15.1:0/2852563664 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0490106a80 0x7f049019cc70 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:22.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:22.001+0000 7f0497169640 1 --2- 172.21.15.1:0/2852563664 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f04800a3240 0x7f04800a5700 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:22.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:22.001+0000 7f0497169640 1 --2- 172.21.15.1:0/2852563664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0490101420 0x7f04901988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:22.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:22.001+0000 7f0497169640 1 --2- 172.21.15.1:0/2852563664 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0490100a80 0x7f04901983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:22.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:22.001+0000 7f0497169640 1 -- 172.21.15.1:0/2852563664 >> 172.21.15.1:0/2852563664 conn(0x7f04900fc7a0 msgr2=0x7f049006aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:22.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:22.001+0000 7f0497169640 1 -- 172.21.15.1:0/2852563664 shutdown_connections 2024-09-19T09:36:22.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:22.001+0000 7f0497169640 1 -- 172.21.15.1:0/2852563664 wait complete. 2024-09-19T09:36:22.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:21 smithi001 ceph-mon[31225]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T09:36:22.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:21 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/2852563664' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T09:36:22.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:21 smithi022 ceph-mon[35583]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T09:36:22.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:21 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/2852563664' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T09:36:22.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:21 smithi121 ceph-mon[35577]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T09:36:22.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:21 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/2852563664' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T09:36:22.716 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-19T09:36:22.977 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:23.273 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:23 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/2852563664' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T09:36:23.274 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:23 smithi001 ceph-mon[31225]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:36:23.274 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:23 smithi001 ceph-mon[31225]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T09:36:23.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:23 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/2852563664' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T09:36:23.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:23 smithi022 ceph-mon[35583]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:36:23.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:23 smithi022 ceph-mon[35583]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T09:36:23.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:23 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/2852563664' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T09:36:23.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:23 smithi121 ceph-mon[35577]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:36:23.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:23 smithi121 ceph-mon[35577]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T09:36:23.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.499+0000 7fbe5b923640 1 -- 172.21.15.1:0/760994925 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe5410e500 msgr2=0x7fbe54110910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:23.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.499+0000 7fbe5b923640 1 --2- 172.21.15.1:0/760994925 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe5410e500 0x7fbe54110910 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c009ca0 tx=0x7fbe4c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:36:23.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.500+0000 7fbe5b923640 1 -- 172.21.15.1:0/760994925 shutdown_connections 2024-09-19T09:36:23.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.500+0000 7fbe5b923640 1 --2- 172.21.15.1:0/760994925 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe5410e500 0x7fbe54110910 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:23.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.500+0000 7fbe5b923640 1 --2- 172.21.15.1:0/760994925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe54101440 0x7fbe5410df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:23.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.500+0000 7fbe5b923640 1 --2- 172.21.15.1:0/760994925 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe54100b20 0x7fbe54100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:23.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.500+0000 7fbe5b923640 1 -- 172.21.15.1:0/760994925 >> 172.21.15.1:0/760994925 conn(0x7fbe540fc7d0 msgr2=0x7fbe540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:23.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.500+0000 7fbe5b923640 1 -- 172.21.15.1:0/760994925 shutdown_connections 2024-09-19T09:36:23.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.500+0000 7fbe5b923640 1 -- 172.21.15.1:0/760994925 wait complete. 2024-09-19T09:36:23.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.500+0000 7fbe5b923640 1 Processor -- start 2024-09-19T09:36:23.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.500+0000 7fbe5b923640 1 -- start start 2024-09-19T09:36:23.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.501+0000 7fbe5b923640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe54100b20 0x7fbe5419a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:23.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.501+0000 7fbe5b923640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe54101440 0x7fbe5419ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:23.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.501+0000 7fbe5b923640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe5410e500 0x7fbe5419efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:23.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.501+0000 7fbe5b923640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbe54114250 con 0x7fbe5410e500 2024-09-19T09:36:23.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.501+0000 7fbe5b923640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbe541140d0 con 0x7fbe54101440 2024-09-19T09:36:23.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.501+0000 7fbe5b923640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbe541143d0 con 0x7fbe54100b20 2024-09-19T09:36:23.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.501+0000 7fbe59ec0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe5410e500 0x7fbe5419efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:23.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.501+0000 7fbe59ec0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe5410e500 0x7fbe5419efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41570/0 (socket says 172.21.15.1:41570) 2024-09-19T09:36:23.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.501+0000 7fbe59ec0640 1 -- 172.21.15.1:0/1488125094 learned_addr learned my addr 172.21.15.1:0/1488125094 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:23.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.501+0000 7fbe596bf640 1 --2- 172.21.15.1:0/1488125094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe54100b20 0x7fbe5419a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:23.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.501+0000 7fbe58ebe640 1 --2- 172.21.15.1:0/1488125094 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe54101440 0x7fbe5419ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:23.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.501+0000 7fbe59ec0640 1 -- 172.21.15.1:0/1488125094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe54100b20 msgr2=0x7fbe5419a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:23.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.501+0000 7fbe59ec0640 1 --2- 172.21.15.1:0/1488125094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe54100b20 0x7fbe5419a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:23.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.501+0000 7fbe59ec0640 1 -- 172.21.15.1:0/1488125094 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe54101440 msgr2=0x7fbe5419ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:23.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.501+0000 7fbe59ec0640 1 --2- 172.21.15.1:0/1488125094 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe54101440 0x7fbe5419ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:23.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.501+0000 7fbe59ec0640 1 -- 172.21.15.1:0/1488125094 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe5419f6a0 con 0x7fbe5410e500 2024-09-19T09:36:23.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.501+0000 7fbe596bf640 1 --2- 172.21.15.1:0/1488125094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe54100b20 0x7fbe5419a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:23.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.501+0000 7fbe59ec0640 1 --2- 172.21.15.1:0/1488125094 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe5410e500 0x7fbe5419efc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c0319f0 tx=0x7fbe4c031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:23.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.502+0000 7fbe4a7fc640 1 -- 172.21.15.1:0/1488125094 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c003c30 con 0x7fbe5410e500 2024-09-19T09:36:23.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.502+0000 7fbe4a7fc640 1 -- 172.21.15.1:0/1488125094 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe4c003dd0 con 0x7fbe5410e500 2024-09-19T09:36:23.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.502+0000 7fbe5b923640 1 -- 172.21.15.1:0/1488125094 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe5419f930 con 0x7fbe5410e500 2024-09-19T09:36:23.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.502+0000 7fbe4a7fc640 1 -- 172.21.15.1:0/1488125094 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c02fdd0 con 0x7fbe5410e500 2024-09-19T09:36:23.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.502+0000 7fbe5b923640 1 -- 172.21.15.1:0/1488125094 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe541a7270 con 0x7fbe5410e500 2024-09-19T09:36:23.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.503+0000 7fbe5b923640 1 -- 172.21.15.1:0/1488125094 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe5406a850 con 0x7fbe5410e500 2024-09-19T09:36:23.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.504+0000 7fbe4a7fc640 1 -- 172.21.15.1:0/1488125094 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7fbe4c004050 con 0x7fbe5410e500 2024-09-19T09:36:23.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.505+0000 7fbe4a7fc640 1 --2- 172.21.15.1:0/1488125094 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbe400a3240 0x7fbe400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:23.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.505+0000 7fbe596bf640 1 --2- 172.21.15.1:0/1488125094 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbe400a3240 0x7fbe400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:23.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.505+0000 7fbe4a7fc640 1 -- 172.21.15.1:0/1488125094 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fbe4c0f0b00 con 0x7fbe5410e500 2024-09-19T09:36:23.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.505+0000 7fbe596bf640 1 --2- 172.21.15.1:0/1488125094 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbe400a3240 0x7fbe400a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbe500058c0 tx=0x7fbe50005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:23.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.509+0000 7fbe4a7fc640 1 -- 172.21.15.1:0/1488125094 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbe4c0bd960 con 0x7fbe5410e500 2024-09-19T09:36:23.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:23.721+0000 7fbe5b923640 1 -- 172.21.15.1:0/1488125094 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fbe54109600 con 0x7fbe5410e500 2024-09-19T09:36:24.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:24.009+0000 7fbe4a7fc640 1 -- 172.21.15.1:0/1488125094 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v19) ==== 115+0+0 (secure 0 0 0) 0x7fbe4c0bd260 con 0x7fbe5410e500 2024-09-19T09:36:24.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:24.012+0000 7fbe5b923640 1 -- 172.21.15.1:0/1488125094 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbe400a3240 msgr2=0x7fbe400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:24.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:24.012+0000 7fbe5b923640 1 --2- 172.21.15.1:0/1488125094 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbe400a3240 0x7fbe400a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbe500058c0 tx=0x7fbe50005850 comp rx=0 tx=0).stop 2024-09-19T09:36:24.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:24.012+0000 7fbe5b923640 1 -- 172.21.15.1:0/1488125094 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe5410e500 msgr2=0x7fbe5419efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:24.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:24.012+0000 7fbe5b923640 1 --2- 172.21.15.1:0/1488125094 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe5410e500 0x7fbe5419efc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c0319f0 tx=0x7fbe4c031a20 comp rx=0 tx=0).stop 2024-09-19T09:36:24.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:24.012+0000 7fbe5b923640 1 -- 172.21.15.1:0/1488125094 shutdown_connections 2024-09-19T09:36:24.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:24.012+0000 7fbe5b923640 1 --2- 172.21.15.1:0/1488125094 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe5410e500 0x7fbe5419efc0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:24.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:24.012+0000 7fbe5b923640 1 --2- 172.21.15.1:0/1488125094 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbe400a3240 0x7fbe400a5700 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:24.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:24.012+0000 7fbe5b923640 1 --2- 172.21.15.1:0/1488125094 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe54101440 0x7fbe5419ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:24.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:24.012+0000 7fbe5b923640 1 --2- 172.21.15.1:0/1488125094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe54100b20 0x7fbe5419a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:24.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:24.012+0000 7fbe5b923640 1 -- 172.21.15.1:0/1488125094 >> 172.21.15.1:0/1488125094 conn(0x7fbe540fc7d0 msgr2=0x7fbe540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:24.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:24.012+0000 7fbe5b923640 1 -- 172.21.15.1:0/1488125094 shutdown_connections 2024-09-19T09:36:24.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:24.012+0000 7fbe5b923640 1 -- 172.21.15.1:0/1488125094 wait complete. 2024-09-19T09:36:24.268 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:24 smithi121 ceph-mon[35577]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-19T09:36:24.268 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:24 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1488125094' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T09:36:24.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:24 smithi022 ceph-mon[35583]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-19T09:36:24.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:24 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1488125094' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T09:36:24.379 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:24 smithi001 ceph-mon[31225]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-19T09:36:24.379 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:24 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1488125094' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T09:36:24.716 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-19T09:36:24.716 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-19T09:36:24.981 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:25.280 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:25 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1488125094' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T09:36:25.280 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:25 smithi022 ceph-mon[35583]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T09:36:25.281 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:25 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1488125094' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T09:36:25.281 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:25 smithi121 ceph-mon[35577]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T09:36:25.358 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:25 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1488125094' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T09:36:25.358 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:25 smithi001 ceph-mon[31225]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T09:36:25.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.440+0000 7f1bd2753640 1 -- 172.21.15.1:0/3565610605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bcc103740 msgr2=0x7f1bcc107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:25.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.440+0000 7f1bd2753640 1 --2- 172.21.15.1:0/3565610605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bcc103740 0x7f1bcc107b80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4009930 tx=0x7f1bb402a420 comp rx=0 tx=0).stop 2024-09-19T09:36:25.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.440+0000 7f1bd2753640 1 -- 172.21.15.1:0/3565610605 shutdown_connections 2024-09-19T09:36:25.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.440+0000 7f1bd2753640 1 --2- 172.21.15.1:0/3565610605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bcc108290 0x7f1bcc10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:25.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.440+0000 7f1bd2753640 1 --2- 172.21.15.1:0/3565610605 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bcc103740 0x7f1bcc107b80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:25.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.440+0000 7f1bd2753640 1 --2- 172.21.15.1:0/3565610605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bcc102d90 0x7f1bcc103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:25.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.440+0000 7f1bd2753640 1 -- 172.21.15.1:0/3565610605 >> 172.21.15.1:0/3565610605 conn(0x7f1bcc0fc7d0 msgr2=0x7f1bcc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:25.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.440+0000 7f1bd2753640 1 -- 172.21.15.1:0/3565610605 shutdown_connections 2024-09-19T09:36:25.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.440+0000 7f1bd2753640 1 -- 172.21.15.1:0/3565610605 wait complete. 2024-09-19T09:36:25.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.441+0000 7f1bd2753640 1 Processor -- start 2024-09-19T09:36:25.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.441+0000 7f1bd2753640 1 -- start start 2024-09-19T09:36:25.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.441+0000 7f1bd2753640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bcc102d90 0x7f1bcc198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:25.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.441+0000 7f1bd2753640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bcc103740 0x7f1bcc198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:25.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.441+0000 7f1bd2753640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bcc108290 0x7f1bcc19cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:25.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.441+0000 7f1bd2753640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc1120b0 con 0x7f1bcc108290 2024-09-19T09:36:25.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.441+0000 7f1bd2753640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc111f30 con 0x7f1bcc102d90 2024-09-19T09:36:25.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.441+0000 7f1bd2753640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc112230 con 0x7f1bcc103740 2024-09-19T09:36:25.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.441+0000 7f1bd0cf0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bcc108290 0x7f1bcc19cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:25.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.441+0000 7f1bcbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bcc102d90 0x7f1bcc198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:25.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.441+0000 7f1bd0cf0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bcc108290 0x7f1bcc19cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40442/0 (socket says 172.21.15.1:40442) 2024-09-19T09:36:25.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.441+0000 7f1bd0cf0640 1 -- 172.21.15.1:0/3116525832 learned_addr learned my addr 172.21.15.1:0/3116525832 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:25.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.441+0000 7f1bc3fff640 1 --2- 172.21.15.1:0/3116525832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bcc103740 0x7f1bcc198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:25.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.441+0000 7f1bd0cf0640 1 -- 172.21.15.1:0/3116525832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bcc103740 msgr2=0x7f1bcc198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:25.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.441+0000 7f1bd0cf0640 1 --2- 172.21.15.1:0/3116525832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bcc103740 0x7f1bcc198b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:25.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.441+0000 7f1bd0cf0640 1 -- 172.21.15.1:0/3116525832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bcc102d90 msgr2=0x7f1bcc198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:25.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.441+0000 7f1bd0cf0640 1 --2- 172.21.15.1:0/3116525832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bcc102d90 0x7f1bcc198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:25.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.441+0000 7f1bd0cf0640 1 -- 172.21.15.1:0/3116525832 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bcc19d5e0 con 0x7f1bcc108290 2024-09-19T09:36:25.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.442+0000 7f1bc3fff640 1 --2- 172.21.15.1:0/3116525832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bcc103740 0x7f1bcc198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:25.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.442+0000 7f1bd0cf0640 1 --2- 172.21.15.1:0/3116525832 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bcc108290 0x7f1bcc19cf00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4009fd0 tx=0x7f1bc400def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:25.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.442+0000 7f1bc9ffb640 1 -- 172.21.15.1:0/3116525832 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4017070 con 0x7f1bcc108290 2024-09-19T09:36:25.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.442+0000 7f1bc9ffb640 1 -- 172.21.15.1:0/3116525832 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bc4003e50 con 0x7f1bcc108290 2024-09-19T09:36:25.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.442+0000 7f1bc9ffb640 1 -- 172.21.15.1:0/3116525832 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4010460 con 0x7f1bcc108290 2024-09-19T09:36:25.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.442+0000 7f1bd2753640 1 -- 172.21.15.1:0/3116525832 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bcc19d8d0 con 0x7f1bcc108290 2024-09-19T09:36:25.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.442+0000 7f1bd2753640 1 -- 172.21.15.1:0/3116525832 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bcc1a51b0 con 0x7f1bcc108290 2024-09-19T09:36:25.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.443+0000 7f1bd2753640 1 -- 172.21.15.1:0/3116525832 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bcc06a7f0 con 0x7f1bcc108290 2024-09-19T09:36:25.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.444+0000 7f1bc9ffb640 1 -- 172.21.15.1:0/3116525832 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 16) ==== 138354+0+0 (secure 0 0 0) 0x7f1bc4003970 con 0x7f1bcc108290 2024-09-19T09:36:25.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.445+0000 7f1bc9ffb640 1 --2- 172.21.15.1:0/3116525832 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f1bb80a32c0 0x7f1bb80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:25.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.445+0000 7f1bcbfff640 1 --2- 172.21.15.1:0/3116525832 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f1bb80a32c0 0x7f1bb80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:25.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.445+0000 7f1bc9ffb640 1 -- 172.21.15.1:0/3116525832 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f1bc40cf520 con 0x7f1bcc108290 2024-09-19T09:36:25.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.445+0000 7f1bcbfff640 1 --2- 172.21.15.1:0/3116525832 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f1bb80a32c0 0x7f1bb80a5780 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc009990 tx=0x7f1bbc009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:25.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.449+0000 7f1bc9ffb640 1 -- 172.21.15.1:0/3116525832 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1bc409c2f0 con 0x7f1bcc108290 2024-09-19T09:36:25.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.647+0000 7f1bd2753640 1 -- 172.21.15.1:0/3116525832 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f1bcc062630 con 0x7f1bb80a32c0 2024-09-19T09:36:25.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.665+0000 7f1bc9ffb640 1 -- 172.21.15.1:0/3116525832 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1bcc062630 con 0x7f1bb80a32c0 2024-09-19T09:36:25.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.667+0000 7f1bd2753640 1 -- 172.21.15.1:0/3116525832 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f1bb80a32c0 msgr2=0x7f1bb80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:25.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.667+0000 7f1bd2753640 1 --2- 172.21.15.1:0/3116525832 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f1bb80a32c0 0x7f1bb80a5780 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc009990 tx=0x7f1bbc009110 comp rx=0 tx=0).stop 2024-09-19T09:36:25.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.667+0000 7f1bd2753640 1 -- 172.21.15.1:0/3116525832 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bcc108290 msgr2=0x7f1bcc19cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:25.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.667+0000 7f1bd2753640 1 --2- 172.21.15.1:0/3116525832 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bcc108290 0x7f1bcc19cf00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4009fd0 tx=0x7f1bc400def0 comp rx=0 tx=0).stop 2024-09-19T09:36:25.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.667+0000 7f1bd2753640 1 -- 172.21.15.1:0/3116525832 shutdown_connections 2024-09-19T09:36:25.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.667+0000 7f1bd2753640 1 --2- 172.21.15.1:0/3116525832 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1bcc108290 0x7f1bcc19cf00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:25.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.667+0000 7f1bd2753640 1 --2- 172.21.15.1:0/3116525832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bcc103740 0x7f1bcc198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:25.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.667+0000 7f1bd2753640 1 --2- 172.21.15.1:0/3116525832 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f1bb80a32c0 0x7f1bb80a5780 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:25.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.667+0000 7f1bd2753640 1 --2- 172.21.15.1:0/3116525832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1bcc102d90 0x7f1bcc198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:25.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.667+0000 7f1bd2753640 1 -- 172.21.15.1:0/3116525832 >> 172.21.15.1:0/3116525832 conn(0x7f1bcc0fc7d0 msgr2=0x7f1bcc105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:25.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.667+0000 7f1bd2753640 1 -- 172.21.15.1:0/3116525832 shutdown_connections 2024-09-19T09:36:25.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:25.667+0000 7f1bd2753640 1 -- 172.21.15.1:0/3116525832 wait complete. 2024-09-19T09:36:25.998 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:36:25 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:36:25.652+0000 7f8fb23dc640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:36:25.998 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:36:25 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:36:25.652+0000 7f8fb23dc640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:36:25.998 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:36:25 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:36:25.652+0000 7f8fb23dc640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:36:25.998 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:36:25 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:36:25.652+0000 7f8fb23dc640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:36:25.998 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:36:25 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:36:25.652+0000 7f8fb23dc640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T09:36:26.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:26 smithi022 ceph-mon[35583]: pgmap v286: 97 pgs: 97 active+clean; 579 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 100 B/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-19T09:36:26.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:26 smithi121 ceph-mon[35577]: pgmap v286: 97 pgs: 97 active+clean; 579 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 100 B/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-19T09:36:26.481 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:26 smithi001 ceph-mon[31225]: pgmap v286: 97 pgs: 97 active+clean; 579 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 100 B/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-19T09:36:26.513 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-19T09:36:26.772 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:27.161 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:27 smithi001 ceph-mon[31225]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:27.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.246+0000 7f797de32640 1 -- 172.21.15.1:0/3785448185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7978101420 msgr2=0x7f797810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:27.270 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.246+0000 7f797de32640 1 --2- 172.21.15.1:0/3785448185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7978101420 0x7f797810d950 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7970009cd0 tx=0x7f797002a8e0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.246+0000 7f797de32640 1 -- 172.21.15.1:0/3785448185 shutdown_connections 2024-09-19T09:36:27.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.246+0000 7f797de32640 1 --2- 172.21.15.1:0/3785448185 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7978101420 0x7f797810d950 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.246+0000 7f797de32640 1 --2- 172.21.15.1:0/3785448185 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7978100a80 0x7f7978100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.246+0000 7f797de32640 1 --2- 172.21.15.1:0/3785448185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7978106a80 0x7f7978106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.246+0000 7f797de32640 1 -- 172.21.15.1:0/3785448185 >> 172.21.15.1:0/3785448185 conn(0x7f79780fc7a0 msgr2=0x7f79780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:27.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.246+0000 7f797de32640 1 -- 172.21.15.1:0/3785448185 shutdown_connections 2024-09-19T09:36:27.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.246+0000 7f797de32640 1 -- 172.21.15.1:0/3785448185 wait complete. 2024-09-19T09:36:27.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.247+0000 7f797de32640 1 Processor -- start 2024-09-19T09:36:27.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.247+0000 7f797de32640 1 -- start start 2024-09-19T09:36:27.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.247+0000 7f797de32640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7978100a80 0x7f7978198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:27.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.247+0000 7f797de32640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7978101420 0x7f7978198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:27.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.247+0000 7f797de32640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7978106a80 0x7f797819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:27.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.247+0000 7f797de32640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7978110e80 con 0x7f7978106a80 2024-09-19T09:36:27.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.247+0000 7f797de32640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7978110d00 con 0x7f7978101420 2024-09-19T09:36:27.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.247+0000 7f797de32640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7978111000 con 0x7f7978100a80 2024-09-19T09:36:27.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.247+0000 7f7977fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7978106a80 0x7f797819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:27.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.248+0000 7f7977fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7978106a80 0x7f797819cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40470/0 (socket says 172.21.15.1:40470) 2024-09-19T09:36:27.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.248+0000 7f7977fff640 1 -- 172.21.15.1:0/3080965095 learned_addr learned my addr 172.21.15.1:0/3080965095 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:27.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.248+0000 7f7976ffd640 1 --2- 172.21.15.1:0/3080965095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7978101420 0x7f7978198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:27.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.248+0000 7f79777fe640 1 --2- 172.21.15.1:0/3080965095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7978100a80 0x7f7978198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:27.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.248+0000 7f7977fff640 1 -- 172.21.15.1:0/3080965095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7978100a80 msgr2=0x7f7978198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:27.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.248+0000 7f7977fff640 1 --2- 172.21.15.1:0/3080965095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7978100a80 0x7f7978198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.248+0000 7f7977fff640 1 -- 172.21.15.1:0/3080965095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7978101420 msgr2=0x7f7978198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:27.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.248+0000 7f7977fff640 1 --2- 172.21.15.1:0/3080965095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7978101420 0x7f7978198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.248+0000 7f7977fff640 1 -- 172.21.15.1:0/3080965095 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797819d3e0 con 0x7f7978106a80 2024-09-19T09:36:27.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.248+0000 7f7977fff640 1 --2- 172.21.15.1:0/3080965095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7978106a80 0x7f797819cd00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7970005cc0 tx=0x7f7970003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:27.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.248+0000 7f7974ff9640 1 -- 172.21.15.1:0/3080965095 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7970004040 con 0x7f7978106a80 2024-09-19T09:36:27.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.248+0000 7f797de32640 1 -- 172.21.15.1:0/3080965095 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f797819d670 con 0x7f7978106a80 2024-09-19T09:36:27.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.248+0000 7f7974ff9640 1 -- 172.21.15.1:0/3080965095 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79700046c0 con 0x7f7978106a80 2024-09-19T09:36:27.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.248+0000 7f7974ff9640 1 -- 172.21.15.1:0/3080965095 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7970046480 con 0x7f7978106a80 2024-09-19T09:36:27.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.248+0000 7f797de32640 1 -- 172.21.15.1:0/3080965095 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79781a4fb0 con 0x7f7978106a80 2024-09-19T09:36:27.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.249+0000 7f797de32640 1 -- 172.21.15.1:0/3080965095 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7978100ee0 con 0x7f7978106a80 2024-09-19T09:36:27.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.251+0000 7f7974ff9640 1 -- 172.21.15.1:0/3080965095 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f79700305a0 con 0x7f7978106a80 2024-09-19T09:36:27.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.251+0000 7f7974ff9640 1 --2- 172.21.15.1:0/3080965095 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f79600a32d0 0x7f79600a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:27.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.251+0000 7f79777fe640 1 --2- 172.21.15.1:0/3080965095 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f79600a32d0 0x7f79600a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:27.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.251+0000 7f7974ff9640 1 -- 172.21.15.1:0/3080965095 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f797002e030 con 0x7f7978106a80 2024-09-19T09:36:27.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.252+0000 7f79777fe640 1 --2- 172.21.15.1:0/3080965095 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f79600a32d0 0x7f79600a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7968005e00 tx=0x7f7968005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:27.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.255+0000 7f7974ff9640 1 -- 172.21.15.1:0/3080965095 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f797004b060 con 0x7f7978106a80 2024-09-19T09:36:27.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:27 smithi022 ceph-mon[35583]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:27.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:27 smithi121 ceph-mon[35577]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:27.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.457+0000 7f797de32640 1 -- 172.21.15.1:0/3080965095 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f797806a790 con 0x7f79600a32d0 2024-09-19T09:36:27.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.480+0000 7f7974ff9640 1 -- 172.21.15.1:0/3080965095 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f797806a790 con 0x7f79600a32d0 2024-09-19T09:36:27.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.482+0000 7f797de32640 1 -- 172.21.15.1:0/3080965095 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f79600a32d0 msgr2=0x7f79600a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:27.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.482+0000 7f797de32640 1 --2- 172.21.15.1:0/3080965095 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f79600a32d0 0x7f79600a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7968005e00 tx=0x7f7968005c50 comp rx=0 tx=0).stop 2024-09-19T09:36:27.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.482+0000 7f797de32640 1 -- 172.21.15.1:0/3080965095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7978106a80 msgr2=0x7f797819cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:27.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.482+0000 7f797de32640 1 --2- 172.21.15.1:0/3080965095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7978106a80 0x7f797819cd00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7970005cc0 tx=0x7f7970003970 comp rx=0 tx=0).stop 2024-09-19T09:36:27.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.482+0000 7f797de32640 1 -- 172.21.15.1:0/3080965095 shutdown_connections 2024-09-19T09:36:27.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.482+0000 7f797de32640 1 --2- 172.21.15.1:0/3080965095 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7978106a80 0x7f797819cd00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.482+0000 7f797de32640 1 --2- 172.21.15.1:0/3080965095 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f79600a32d0 0x7f79600a5790 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.482+0000 7f797de32640 1 --2- 172.21.15.1:0/3080965095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7978101420 0x7f7978198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.482+0000 7f797de32640 1 --2- 172.21.15.1:0/3080965095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7978100a80 0x7f7978198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:27.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.482+0000 7f797de32640 1 -- 172.21.15.1:0/3080965095 >> 172.21.15.1:0/3080965095 conn(0x7f79780fc7a0 msgr2=0x7f7978104830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:27.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.482+0000 7f797de32640 1 -- 172.21.15.1:0/3080965095 shutdown_connections 2024-09-19T09:36:27.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:27.482+0000 7f797de32640 1 -- 172.21.15.1:0/3080965095 wait complete. 2024-09-19T09:36:28.184 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:28 smithi001 ceph-mon[31225]: pgmap v287: 97 pgs: 97 active+clean; 585 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-09-19T09:36:28.184 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:28 smithi001 ceph-mon[31225]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T09:36:28.217 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-19T09:36:28.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:28 smithi022 ceph-mon[35583]: pgmap v287: 97 pgs: 97 active+clean; 585 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-09-19T09:36:28.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:28 smithi022 ceph-mon[35583]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T09:36:28.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:28 smithi121 ceph-mon[35577]: pgmap v287: 97 pgs: 97 active+clean; 585 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-09-19T09:36:28.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:28 smithi121 ceph-mon[35577]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T09:36:28.487 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:28.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.957+0000 7f87d27a7640 1 -- 172.21.15.1:0/3897619538 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f87cc101420 msgr2=0x7f87cc10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:28.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.957+0000 7f87d27a7640 1 --2- 172.21.15.1:0/3897619538 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f87cc101420 0x7f87cc10d950 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f87c4009cd0 tx=0x7f87c402a8e0 comp rx=0 tx=0).stop 2024-09-19T09:36:28.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.957+0000 7f87d27a7640 1 -- 172.21.15.1:0/3897619538 shutdown_connections 2024-09-19T09:36:28.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.957+0000 7f87d27a7640 1 --2- 172.21.15.1:0/3897619538 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f87cc101420 0x7f87cc10d950 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:28.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.957+0000 7f87d27a7640 1 --2- 172.21.15.1:0/3897619538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87cc100a80 0x7f87cc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:28.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.957+0000 7f87d27a7640 1 --2- 172.21.15.1:0/3897619538 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87cc106a80 0x7f87cc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:28.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.957+0000 7f87d27a7640 1 -- 172.21.15.1:0/3897619538 >> 172.21.15.1:0/3897619538 conn(0x7f87cc0fc7a0 msgr2=0x7f87cc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:28.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.957+0000 7f87d27a7640 1 -- 172.21.15.1:0/3897619538 shutdown_connections 2024-09-19T09:36:28.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.957+0000 7f87d27a7640 1 -- 172.21.15.1:0/3897619538 wait complete. 2024-09-19T09:36:28.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.958+0000 7f87d27a7640 1 Processor -- start 2024-09-19T09:36:28.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.958+0000 7f87d27a7640 1 -- start start 2024-09-19T09:36:28.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.958+0000 7f87d27a7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87cc100a80 0x7f87cc198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:28.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.958+0000 7f87d27a7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87cc101420 0x7f87cc1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:28.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.958+0000 7f87d27a7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f87cc106a80 0x7f87cc19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:28.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.958+0000 7f87d27a7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f87cc110e80 con 0x7f87cc106a80 2024-09-19T09:36:28.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.958+0000 7f87d27a7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f87cc110d00 con 0x7f87cc101420 2024-09-19T09:36:28.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.958+0000 7f87d27a7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f87cc111000 con 0x7f87cc100a80 2024-09-19T09:36:28.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.958+0000 7f87d0d44640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f87cc106a80 0x7f87cc19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:28.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.958+0000 7f87d0d44640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f87cc106a80 0x7f87cc19cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40488/0 (socket says 172.21.15.1:40488) 2024-09-19T09:36:28.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.958+0000 7f87d0d44640 1 -- 172.21.15.1:0/3156944256 learned_addr learned my addr 172.21.15.1:0/3156944256 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:28.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.958+0000 7f87cbfff640 1 --2- 172.21.15.1:0/3156944256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87cc100a80 0x7f87cc198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:28.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.958+0000 7f87cb7fe640 1 --2- 172.21.15.1:0/3156944256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87cc101420 0x7f87cc1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:28.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.959+0000 7f87d0d44640 1 -- 172.21.15.1:0/3156944256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87cc100a80 msgr2=0x7f87cc198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:28.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.959+0000 7f87d0d44640 1 --2- 172.21.15.1:0/3156944256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87cc100a80 0x7f87cc198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:28.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.959+0000 7f87d0d44640 1 -- 172.21.15.1:0/3156944256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87cc101420 msgr2=0x7f87cc1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:28.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.959+0000 7f87d0d44640 1 --2- 172.21.15.1:0/3156944256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87cc101420 0x7f87cc1989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:28.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.959+0000 7f87d0d44640 1 -- 172.21.15.1:0/3156944256 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87cc19d420 con 0x7f87cc106a80 2024-09-19T09:36:28.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.959+0000 7f87d0d44640 1 --2- 172.21.15.1:0/3156944256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f87cc106a80 0x7f87cc19cd40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f87c4005cc0 tx=0x7f87c4003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:28.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.959+0000 7f87c97fa640 1 -- 172.21.15.1:0/3156944256 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c4004040 con 0x7f87cc106a80 2024-09-19T09:36:28.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.959+0000 7f87c97fa640 1 -- 172.21.15.1:0/3156944256 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87c40046c0 con 0x7f87cc106a80 2024-09-19T09:36:28.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.959+0000 7f87d27a7640 1 -- 172.21.15.1:0/3156944256 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87cc19d6b0 con 0x7f87cc106a80 2024-09-19T09:36:28.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.959+0000 7f87c97fa640 1 -- 172.21.15.1:0/3156944256 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c4046480 con 0x7f87cc106a80 2024-09-19T09:36:28.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.959+0000 7f87d27a7640 1 -- 172.21.15.1:0/3156944256 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87cc1a4ff0 con 0x7f87cc106a80 2024-09-19T09:36:28.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.960+0000 7f87d27a7640 1 -- 172.21.15.1:0/3156944256 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87cc100ee0 con 0x7f87cc106a80 2024-09-19T09:36:28.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.961+0000 7f87c97fa640 1 -- 172.21.15.1:0/3156944256 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f87c40305a0 con 0x7f87cc106a80 2024-09-19T09:36:28.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.962+0000 7f87c97fa640 1 --2- 172.21.15.1:0/3156944256 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f87b40a32d0 0x7f87b40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:28.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.962+0000 7f87cbfff640 1 --2- 172.21.15.1:0/3156944256 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f87b40a32d0 0x7f87b40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:28.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.963+0000 7f87c97fa640 1 -- 172.21.15.1:0/3156944256 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f87c402e030 con 0x7f87cc106a80 2024-09-19T09:36:28.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.963+0000 7f87cbfff640 1 --2- 172.21.15.1:0/3156944256 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f87b40a32d0 0x7f87b40a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f87bc00bb60 tx=0x7f87bc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:28.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:28.967+0000 7f87c97fa640 1 -- 172.21.15.1:0/3156944256 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f87c404b060 con 0x7f87cc106a80 2024-09-19T09:36:29.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:29.173+0000 7f87d27a7640 1 -- 172.21.15.1:0/3156944256 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f87cc062630 con 0x7f87b40a32d0 2024-09-19T09:36:29.176 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:29 smithi001 ceph-mon[31225]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:29.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:29.179+0000 7f87c97fa640 1 -- 172.21.15.1:0/3156944256 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f87cc062630 con 0x7f87b40a32d0 2024-09-19T09:36:29.181 INFO:teuthology.orchestra.run.smithi001.stdout:/volumes/qa/sv_0/629c21ca-8f8b-4bfd-a5c7-cef68a9f662a 2024-09-19T09:36:29.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:29.181+0000 7f87d27a7640 1 -- 172.21.15.1:0/3156944256 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f87b40a32d0 msgr2=0x7f87b40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:29.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:29.181+0000 7f87d27a7640 1 --2- 172.21.15.1:0/3156944256 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f87b40a32d0 0x7f87b40a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f87bc00bb60 tx=0x7f87bc00b390 comp rx=0 tx=0).stop 2024-09-19T09:36:29.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:29.181+0000 7f87d27a7640 1 -- 172.21.15.1:0/3156944256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f87cc106a80 msgr2=0x7f87cc19cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:29.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:29.181+0000 7f87d27a7640 1 --2- 172.21.15.1:0/3156944256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f87cc106a80 0x7f87cc19cd40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f87c4005cc0 tx=0x7f87c4003970 comp rx=0 tx=0).stop 2024-09-19T09:36:29.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:29.181+0000 7f87d27a7640 1 -- 172.21.15.1:0/3156944256 shutdown_connections 2024-09-19T09:36:29.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:29.181+0000 7f87d27a7640 1 --2- 172.21.15.1:0/3156944256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f87cc106a80 0x7f87cc19cd40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:29.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:29.181+0000 7f87d27a7640 1 --2- 172.21.15.1:0/3156944256 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f87b40a32d0 0x7f87b40a5790 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:29.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:29.181+0000 7f87d27a7640 1 --2- 172.21.15.1:0/3156944256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87cc101420 0x7f87cc1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:29.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:29.181+0000 7f87d27a7640 1 --2- 172.21.15.1:0/3156944256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87cc100a80 0x7f87cc198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:29.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:29.181+0000 7f87d27a7640 1 -- 172.21.15.1:0/3156944256 >> 172.21.15.1:0/3156944256 conn(0x7f87cc0fc7a0 msgr2=0x7f87cc06aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:29.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:29.182+0000 7f87d27a7640 1 -- 172.21.15.1:0/3156944256 shutdown_connections 2024-09-19T09:36:29.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:29.182+0000 7f87d27a7640 1 -- 172.21.15.1:0/3156944256 wait complete. 2024-09-19T09:36:29.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:29 smithi022 ceph-mon[35583]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:29.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:29 smithi121 ceph-mon[35577]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:29.968 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-19T09:36:30.228 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:30.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:30 smithi001 ceph-mon[31225]: pgmap v288: 97 pgs: 97 active+clean; 585 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 853 B/s wr, 2 op/s 2024-09-19T09:36:30.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:30 smithi022 ceph-mon[35583]: pgmap v288: 97 pgs: 97 active+clean; 585 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 853 B/s wr, 2 op/s 2024-09-19T09:36:30.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:30 smithi121 ceph-mon[35577]: pgmap v288: 97 pgs: 97 active+clean; 585 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 853 B/s wr, 2 op/s 2024-09-19T09:36:30.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.698+0000 7fbc6745a640 1 -- 172.21.15.1:0/2120470726 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc60106f20 msgr2=0x7fbc6010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:30.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.698+0000 7fbc6745a640 1 --2- 172.21.15.1:0/2120470726 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc60106f20 0x7fbc6010eaa0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbc50009ca0 tx=0x7fbc5002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:36:30.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.698+0000 7fbc6745a640 1 -- 172.21.15.1:0/2120470726 shutdown_connections 2024-09-19T09:36:30.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.698+0000 7fbc6745a640 1 --2- 172.21.15.1:0/2120470726 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc60106f20 0x7fbc6010eaa0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:30.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.698+0000 7fbc6745a640 1 --2- 172.21.15.1:0/2120470726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc601027a0 0x7fbc601067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:30.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.698+0000 7fbc6745a640 1 --2- 172.21.15.1:0/2120470726 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc60101df0 0x7fbc601021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:30.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.698+0000 7fbc6745a640 1 -- 172.21.15.1:0/2120470726 >> 172.21.15.1:0/2120470726 conn(0x7fbc600fd8b0 msgr2=0x7fbc600ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:30.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.698+0000 7fbc6745a640 1 -- 172.21.15.1:0/2120470726 shutdown_connections 2024-09-19T09:36:30.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.698+0000 7fbc6745a640 1 -- 172.21.15.1:0/2120470726 wait complete. 2024-09-19T09:36:30.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.699+0000 7fbc6745a640 1 Processor -- start 2024-09-19T09:36:30.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.699+0000 7fbc6745a640 1 -- start start 2024-09-19T09:36:30.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.699+0000 7fbc6745a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc60101df0 0x7fbc600744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:30.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.699+0000 7fbc6745a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc601027a0 0x7fbc60074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:30.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.699+0000 7fbc6745a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc60106f20 0x7fbc60074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:30.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.699+0000 7fbc6745a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbc60111f80 con 0x7fbc60101df0 2024-09-19T09:36:30.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.699+0000 7fbc6745a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbc60111e00 con 0x7fbc601027a0 2024-09-19T09:36:30.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.699+0000 7fbc6745a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbc60112100 con 0x7fbc60106f20 2024-09-19T09:36:30.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.699+0000 7fbc651f6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc60101df0 0x7fbc600744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:30.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.699+0000 7fbc651f6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc60101df0 0x7fbc600744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40516/0 (socket says 172.21.15.1:40516) 2024-09-19T09:36:30.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.699+0000 7fbc651f6640 1 -- 172.21.15.1:0/1220442448 learned_addr learned my addr 172.21.15.1:0/1220442448 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:30.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.699+0000 7fbc649f5640 1 --2- 172.21.15.1:0/1220442448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc601027a0 0x7fbc60074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:30.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.700+0000 7fbc659f7640 1 --2- 172.21.15.1:0/1220442448 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc60106f20 0x7fbc60074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:30.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.700+0000 7fbc651f6640 1 -- 172.21.15.1:0/1220442448 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc60106f20 msgr2=0x7fbc60074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:30.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.700+0000 7fbc651f6640 1 --2- 172.21.15.1:0/1220442448 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc60106f20 0x7fbc60074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:30.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.700+0000 7fbc651f6640 1 -- 172.21.15.1:0/1220442448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc601027a0 msgr2=0x7fbc60074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:30.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.700+0000 7fbc651f6640 1 --2- 172.21.15.1:0/1220442448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc601027a0 0x7fbc60074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:30.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.700+0000 7fbc651f6640 1 -- 172.21.15.1:0/1220442448 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc601a6900 con 0x7fbc60101df0 2024-09-19T09:36:30.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.700+0000 7fbc659f7640 1 --2- 172.21.15.1:0/1220442448 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc60106f20 0x7fbc60074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:36:30.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.700+0000 7fbc651f6640 1 --2- 172.21.15.1:0/1220442448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc60101df0 0x7fbc600744f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbc5800d950 tx=0x7fbc5800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:30.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.700+0000 7fbc5e7fc640 1 -- 172.21.15.1:0/1220442448 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc58017070 con 0x7fbc60101df0 2024-09-19T09:36:30.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.700+0000 7fbc5e7fc640 1 -- 172.21.15.1:0/1220442448 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc58009c30 con 0x7fbc60101df0 2024-09-19T09:36:30.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.700+0000 7fbc6745a640 1 -- 172.21.15.1:0/1220442448 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc601a6bf0 con 0x7fbc60101df0 2024-09-19T09:36:30.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.700+0000 7fbc5e7fc640 1 -- 172.21.15.1:0/1220442448 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5800f6b0 con 0x7fbc60101df0 2024-09-19T09:36:30.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.700+0000 7fbc6745a640 1 -- 172.21.15.1:0/1220442448 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc601a7130 con 0x7fbc60101df0 2024-09-19T09:36:30.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.701+0000 7fbc6745a640 1 -- 172.21.15.1:0/1220442448 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc601021d0 con 0x7fbc60101df0 2024-09-19T09:36:30.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.702+0000 7fbc5e7fc640 1 -- 172.21.15.1:0/1220442448 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fbc580109d0 con 0x7fbc60101df0 2024-09-19T09:36:30.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.703+0000 7fbc5e7fc640 1 --2- 172.21.15.1:0/1220442448 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbc480a32d0 0x7fbc480a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:30.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.703+0000 7fbc649f5640 1 --2- 172.21.15.1:0/1220442448 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbc480a32d0 0x7fbc480a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:30.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.703+0000 7fbc5e7fc640 1 -- 172.21.15.1:0/1220442448 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fbc580cf640 con 0x7fbc60101df0 2024-09-19T09:36:30.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.703+0000 7fbc649f5640 1 --2- 172.21.15.1:0/1220442448 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbc480a32d0 0x7fbc480a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbc60075f80 tx=0x7fbc5400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:30.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.707+0000 7fbc5e7fc640 1 -- 172.21.15.1:0/1220442448 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbc58009de0 con 0x7fbc60101df0 2024-09-19T09:36:30.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.908+0000 7fbc6745a640 1 -- 172.21.15.1:0/1220442448 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fbc60062630 con 0x7fbc480a32d0 2024-09-19T09:36:30.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.930+0000 7fbc5e7fc640 1 -- 172.21.15.1:0/1220442448 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fbc60062630 con 0x7fbc480a32d0 2024-09-19T09:36:30.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.932+0000 7fbc6745a640 1 -- 172.21.15.1:0/1220442448 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbc480a32d0 msgr2=0x7fbc480a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:30.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.932+0000 7fbc6745a640 1 --2- 172.21.15.1:0/1220442448 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbc480a32d0 0x7fbc480a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbc60075f80 tx=0x7fbc5400b390 comp rx=0 tx=0).stop 2024-09-19T09:36:30.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.932+0000 7fbc6745a640 1 -- 172.21.15.1:0/1220442448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc60101df0 msgr2=0x7fbc600744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:30.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.932+0000 7fbc6745a640 1 --2- 172.21.15.1:0/1220442448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc60101df0 0x7fbc600744f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbc5800d950 tx=0x7fbc5800de10 comp rx=0 tx=0).stop 2024-09-19T09:36:30.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.932+0000 7fbc6745a640 1 -- 172.21.15.1:0/1220442448 shutdown_connections 2024-09-19T09:36:30.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.932+0000 7fbc6745a640 1 --2- 172.21.15.1:0/1220442448 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc60106f20 0x7fbc60074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:30.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.932+0000 7fbc6745a640 1 --2- 172.21.15.1:0/1220442448 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbc480a32d0 0x7fbc480a5790 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:30.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.932+0000 7fbc6745a640 1 --2- 172.21.15.1:0/1220442448 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc601027a0 0x7fbc60074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:30.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.932+0000 7fbc6745a640 1 --2- 172.21.15.1:0/1220442448 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbc60101df0 0x7fbc600744f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:30.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.932+0000 7fbc6745a640 1 -- 172.21.15.1:0/1220442448 >> 172.21.15.1:0/1220442448 conn(0x7fbc600fd8b0 msgr2=0x7fbc600feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:30.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.932+0000 7fbc6745a640 1 -- 172.21.15.1:0/1220442448 shutdown_connections 2024-09-19T09:36:30.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:30.932+0000 7fbc6745a640 1 -- 172.21.15.1:0/1220442448 wait complete. 2024-09-19T09:36:31.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:31 smithi001 ceph-mon[31225]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:31.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:31 smithi022 ceph-mon[35583]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:31.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:31 smithi121 ceph-mon[35577]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:31.687 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-19T09:36:31.949 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:32.314 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:32 smithi001 ceph-mon[31225]: pgmap v289: 97 pgs: 97 active+clean; 585 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-19T09:36:32.315 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:32 smithi001 ceph-mon[31225]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:32.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:32 smithi022 ceph-mon[35583]: pgmap v289: 97 pgs: 97 active+clean; 585 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-19T09:36:32.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:32 smithi022 ceph-mon[35583]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:32.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:32 smithi121 ceph-mon[35577]: pgmap v289: 97 pgs: 97 active+clean; 585 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-19T09:36:32.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:32 smithi121 ceph-mon[35577]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:32.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.400+0000 7f4da8133640 1 -- 172.21.15.1:0/3826954271 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4da01055b0 msgr2=0x7f4da010d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:32.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.400+0000 7f4da8133640 1 --2- 172.21.15.1:0/3826954271 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4da01055b0 0x7f4da010d130 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4d98009ca0 tx=0x7f4d9802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:36:32.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.400+0000 7f4da8133640 1 -- 172.21.15.1:0/3826954271 shutdown_connections 2024-09-19T09:36:32.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.400+0000 7f4da8133640 1 --2- 172.21.15.1:0/3826954271 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4da01055b0 0x7f4da010d130 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:32.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.400+0000 7f4da8133640 1 --2- 172.21.15.1:0/3826954271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4da0100e30 0x7f4da0104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:32.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.400+0000 7f4da8133640 1 --2- 172.21.15.1:0/3826954271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4da0100480 0x7f4da0100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:32.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.400+0000 7f4da8133640 1 -- 172.21.15.1:0/3826954271 >> 172.21.15.1:0/3826954271 conn(0x7f4da0077210 msgr2=0x7f4da00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:32.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.400+0000 7f4da8133640 1 -- 172.21.15.1:0/3826954271 shutdown_connections 2024-09-19T09:36:32.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.400+0000 7f4da8133640 1 -- 172.21.15.1:0/3826954271 wait complete. 2024-09-19T09:36:32.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.401+0000 7f4da8133640 1 Processor -- start 2024-09-19T09:36:32.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.401+0000 7f4da8133640 1 -- start start 2024-09-19T09:36:32.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.401+0000 7f4da8133640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4da0100480 0x7f4da01992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:32.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.401+0000 7f4da8133640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4da0100e30 0x7f4da0199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:32.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.401+0000 7f4da8133640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4da01055b0 0x7f4da01a4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:32.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.401+0000 7f4da8133640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4da0110eb0 con 0x7f4da0100480 2024-09-19T09:36:32.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.401+0000 7f4da8133640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4da0110d30 con 0x7f4da0100e30 2024-09-19T09:36:32.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.401+0000 7f4da8133640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4da0111030 con 0x7f4da01055b0 2024-09-19T09:36:32.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.401+0000 7f4da5ecf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4da0100480 0x7f4da01992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:32.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.401+0000 7f4da5ecf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4da0100480 0x7f4da01992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40530/0 (socket says 172.21.15.1:40530) 2024-09-19T09:36:32.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.401+0000 7f4da5ecf640 1 -- 172.21.15.1:0/3645992459 learned_addr learned my addr 172.21.15.1:0/3645992459 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:32.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.401+0000 7f4da56ce640 1 --2- 172.21.15.1:0/3645992459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4da0100e30 0x7f4da0199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:32.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.402+0000 7f4da66d0640 1 --2- 172.21.15.1:0/3645992459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4da01055b0 0x7f4da01a4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:32.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.402+0000 7f4da5ecf640 1 -- 172.21.15.1:0/3645992459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4da01055b0 msgr2=0x7f4da01a4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:32.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.402+0000 7f4da5ecf640 1 --2- 172.21.15.1:0/3645992459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4da01055b0 0x7f4da01a4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:32.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.402+0000 7f4da5ecf640 1 -- 172.21.15.1:0/3645992459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4da0100e30 msgr2=0x7f4da0199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:32.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.402+0000 7f4da5ecf640 1 --2- 172.21.15.1:0/3645992459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4da0100e30 0x7f4da0199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:32.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.402+0000 7f4da5ecf640 1 -- 172.21.15.1:0/3645992459 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da01a4880 con 0x7f4da0100480 2024-09-19T09:36:32.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.402+0000 7f4da56ce640 1 --2- 172.21.15.1:0/3645992459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4da0100e30 0x7f4da0199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:32.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.402+0000 7f4da5ecf640 1 --2- 172.21.15.1:0/3645992459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4da0100480 0x7f4da01992c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00c890 tx=0x7f4d9c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:32.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.402+0000 7f4d96ffd640 1 -- 172.21.15.1:0/3645992459 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c004220 con 0x7f4da0100480 2024-09-19T09:36:32.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.402+0000 7f4d96ffd640 1 -- 172.21.15.1:0/3645992459 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d9c0043c0 con 0x7f4da0100480 2024-09-19T09:36:32.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.402+0000 7f4da8133640 1 -- 172.21.15.1:0/3645992459 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4da01a4a50 con 0x7f4da0100480 2024-09-19T09:36:32.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.402+0000 7f4d96ffd640 1 -- 172.21.15.1:0/3645992459 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c0049e0 con 0x7f4da0100480 2024-09-19T09:36:32.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.402+0000 7f4da8133640 1 -- 172.21.15.1:0/3645992459 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4da01a4f60 con 0x7f4da0100480 2024-09-19T09:36:32.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.403+0000 7f4da8133640 1 -- 172.21.15.1:0/3645992459 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4da0100860 con 0x7f4da0100480 2024-09-19T09:36:32.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.404+0000 7f4d96ffd640 1 -- 172.21.15.1:0/3645992459 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f4d9c0079b0 con 0x7f4da0100480 2024-09-19T09:36:32.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.405+0000 7f4d96ffd640 1 --2- 172.21.15.1:0/3645992459 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4d8c0a32d0 0x7f4d8c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:32.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.405+0000 7f4da56ce640 1 --2- 172.21.15.1:0/3645992459 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4d8c0a32d0 0x7f4d8c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:32.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.405+0000 7f4d96ffd640 1 -- 172.21.15.1:0/3645992459 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f4d9c0cfa00 con 0x7f4da0100480 2024-09-19T09:36:32.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.405+0000 7f4da56ce640 1 --2- 172.21.15.1:0/3645992459 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4d8c0a32d0 0x7f4d8c0a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4da010e1c0 tx=0x7f4d90008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:32.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.409+0000 7f4d96ffd640 1 -- 172.21.15.1:0/3645992459 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4d9c014030 con 0x7f4da0100480 2024-09-19T09:36:32.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.611+0000 7f4da8133640 1 -- 172.21.15.1:0/3645992459 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f4da0062630 con 0x7f4d8c0a32d0 2024-09-19T09:36:32.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.616+0000 7f4d96ffd640 1 -- 172.21.15.1:0/3645992459 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f4da0062630 con 0x7f4d8c0a32d0 2024-09-19T09:36:32.618 INFO:teuthology.orchestra.run.smithi001.stdout:/volumes/qa/sv_1/ce3aacc7-b6a0-43fb-b6d8-210c142b6771 2024-09-19T09:36:32.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.619+0000 7f4da8133640 1 -- 172.21.15.1:0/3645992459 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4d8c0a32d0 msgr2=0x7f4d8c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:32.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.619+0000 7f4da8133640 1 --2- 172.21.15.1:0/3645992459 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4d8c0a32d0 0x7f4d8c0a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4da010e1c0 tx=0x7f4d90008040 comp rx=0 tx=0).stop 2024-09-19T09:36:32.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.619+0000 7f4da8133640 1 -- 172.21.15.1:0/3645992459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4da0100480 msgr2=0x7f4da01992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:32.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.619+0000 7f4da8133640 1 --2- 172.21.15.1:0/3645992459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4da0100480 0x7f4da01992c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00c890 tx=0x7f4d9c00cd50 comp rx=0 tx=0).stop 2024-09-19T09:36:32.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.619+0000 7f4da8133640 1 -- 172.21.15.1:0/3645992459 shutdown_connections 2024-09-19T09:36:32.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.619+0000 7f4da8133640 1 --2- 172.21.15.1:0/3645992459 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4da01055b0 0x7f4da01a4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:32.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.619+0000 7f4da8133640 1 --2- 172.21.15.1:0/3645992459 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4d8c0a32d0 0x7f4d8c0a5790 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:32.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.619+0000 7f4da8133640 1 --2- 172.21.15.1:0/3645992459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4da0100e30 0x7f4da0199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:32.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.619+0000 7f4da8133640 1 --2- 172.21.15.1:0/3645992459 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4da0100480 0x7f4da01992c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:32.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.619+0000 7f4da8133640 1 -- 172.21.15.1:0/3645992459 >> 172.21.15.1:0/3645992459 conn(0x7f4da0077210 msgr2=0x7f4da0103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:32.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.619+0000 7f4da8133640 1 -- 172.21.15.1:0/3645992459 shutdown_connections 2024-09-19T09:36:32.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:32.619+0000 7f4da8133640 1 -- 172.21.15.1:0/3645992459 wait complete. 2024-09-19T09:36:33.364 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:36:33.620 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:34.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.097+0000 7feffa39e640 1 -- 172.21.15.1:0/3386555583 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feff4102380 msgr2=0x7feff410e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:34.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.097+0000 7feffa39e640 1 --2- 172.21.15.1:0/3386555583 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feff4102380 0x7feff410e9c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fefec009cd0 tx=0x7fefec02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.097+0000 7feffa39e640 1 -- 172.21.15.1:0/3386555583 shutdown_connections 2024-09-19T09:36:34.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.097+0000 7feffa39e640 1 --2- 172.21.15.1:0/3386555583 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feff4102380 0x7feff410e9c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.097+0000 7feffa39e640 1 --2- 172.21.15.1:0/3386555583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feff41019e0 0x7feff4101e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.097+0000 7feffa39e640 1 --2- 172.21.15.1:0/3386555583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feff4107af0 0x7feff4107ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.097+0000 7feffa39e640 1 -- 172.21.15.1:0/3386555583 >> 172.21.15.1:0/3386555583 conn(0x7feff40fd700 msgr2=0x7feff40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:34.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.097+0000 7feffa39e640 1 -- 172.21.15.1:0/3386555583 shutdown_connections 2024-09-19T09:36:34.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.097+0000 7feffa39e640 1 -- 172.21.15.1:0/3386555583 wait complete. 2024-09-19T09:36:34.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.098+0000 7feffa39e640 1 Processor -- start 2024-09-19T09:36:34.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.098+0000 7feffa39e640 1 -- start start 2024-09-19T09:36:34.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.098+0000 7feffa39e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feff41019e0 0x7feff4198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:34.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.098+0000 7feffa39e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feff4102380 0x7feff41987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:34.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.098+0000 7feffa39e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feff4107af0 0x7feff419cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:34.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.098+0000 7feffa39e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7feff4111ef0 con 0x7feff4102380 2024-09-19T09:36:34.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.098+0000 7feffa39e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7feff4111d70 con 0x7feff41019e0 2024-09-19T09:36:34.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.098+0000 7feffa39e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7feff4112070 con 0x7feff4107af0 2024-09-19T09:36:34.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.098+0000 7feff8b9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feff4102380 0x7feff41987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:34.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.099+0000 7feff8b9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feff4102380 0x7feff41987d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40554/0 (socket says 172.21.15.1:40554) 2024-09-19T09:36:34.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.099+0000 7feff8b9b640 1 -- 172.21.15.1:0/193324549 learned_addr learned my addr 172.21.15.1:0/193324549 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:34.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.099+0000 7feff939c640 1 --2- 172.21.15.1:0/193324549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feff41019e0 0x7feff4198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:34.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.099+0000 7feff9b9d640 1 --2- 172.21.15.1:0/193324549 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feff4107af0 0x7feff419cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:34.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.099+0000 7feff8b9b640 1 -- 172.21.15.1:0/193324549 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feff4107af0 msgr2=0x7feff419cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:34.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.099+0000 7feff8b9b640 1 --2- 172.21.15.1:0/193324549 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feff4107af0 0x7feff419cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.099+0000 7feff8b9b640 1 -- 172.21.15.1:0/193324549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feff41019e0 msgr2=0x7feff4198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:34.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.099+0000 7feff8b9b640 1 --2- 172.21.15.1:0/193324549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feff41019e0 0x7feff4198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.099+0000 7feff8b9b640 1 -- 172.21.15.1:0/193324549 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff419d240 con 0x7feff4102380 2024-09-19T09:36:34.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.099+0000 7feff939c640 1 --2- 172.21.15.1:0/193324549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feff41019e0 0x7feff4198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:36:34.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.099+0000 7feff9b9d640 1 --2- 172.21.15.1:0/193324549 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feff4107af0 0x7feff419cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:36:34.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.099+0000 7feff8b9b640 1 --2- 172.21.15.1:0/193324549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feff4102380 0x7feff41987d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fefe400c970 tx=0x7fefe400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:34.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.099+0000 7fefea7fc640 1 -- 172.21.15.1:0/193324549 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe4007bb0 con 0x7feff4102380 2024-09-19T09:36:34.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.099+0000 7feffa39e640 1 -- 172.21.15.1:0/193324549 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feff419d530 con 0x7feff4102380 2024-09-19T09:36:34.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.099+0000 7fefea7fc640 1 -- 172.21.15.1:0/193324549 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fefe4007d50 con 0x7feff4102380 2024-09-19T09:36:34.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.099+0000 7fefea7fc640 1 -- 172.21.15.1:0/193324549 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe400f450 con 0x7feff4102380 2024-09-19T09:36:34.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.099+0000 7feffa39e640 1 -- 172.21.15.1:0/193324549 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feff41a4e10 con 0x7feff4102380 2024-09-19T09:36:34.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.100+0000 7feffa39e640 1 -- 172.21.15.1:0/193324549 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feff4101e40 con 0x7feff4102380 2024-09-19T09:36:34.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.101+0000 7fefea7fc640 1 -- 172.21.15.1:0/193324549 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fefe4005020 con 0x7feff4102380 2024-09-19T09:36:34.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.102+0000 7fefea7fc640 1 --2- 172.21.15.1:0/193324549 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fefe00a32d0 0x7fefe00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:34.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.102+0000 7feff939c640 1 --2- 172.21.15.1:0/193324549 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fefe00a32d0 0x7fefe00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:34.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.102+0000 7fefea7fc640 1 -- 172.21.15.1:0/193324549 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fefe40cf780 con 0x7feff4102380 2024-09-19T09:36:34.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.103+0000 7feff939c640 1 --2- 172.21.15.1:0/193324549 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fefe00a32d0 0x7fefe00a5790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7feff000baa0 tx=0x7feff0005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:34.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.106+0000 7fefea7fc640 1 -- 172.21.15.1:0/193324549 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fefe4014030 con 0x7feff4102380 2024-09-19T09:36:34.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.320+0000 7feffa39e640 1 -- 172.21.15.1:0/193324549 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feff4103120 con 0x7feff4102380 2024-09-19T09:36:34.322 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:34 smithi001 ceph-mon[31225]: pgmap v290: 97 pgs: 97 active+clean; 618 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.8 KiB/s wr, 4 op/s 2024-09-19T09:36:34.322 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:34 smithi001 ceph-mon[31225]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:34.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.321+0000 7fefea7fc640 1 -- 172.21.15.1:0/193324549 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11837 (secure 0 0 0) 0x7fefe409c4f0 con 0x7feff4102380 2024-09-19T09:36:34.323 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:36:34.323 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":19,"btime":"2024-09-19T09:36:24:006349+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:36:23.723388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6839/3279971690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3279971690},{"type":"v1","addr":"172.21.15.121:6839","nonce":3279971690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:36:34.323 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 19 2024-09-19T09:36:34.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.323+0000 7feffa39e640 1 -- 172.21.15.1:0/193324549 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fefe00a32d0 msgr2=0x7fefe00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:34.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.323+0000 7feffa39e640 1 --2- 172.21.15.1:0/193324549 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fefe00a32d0 0x7fefe00a5790 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7feff000baa0 tx=0x7feff0005d20 comp rx=0 tx=0).stop 2024-09-19T09:36:34.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.323+0000 7feffa39e640 1 -- 172.21.15.1:0/193324549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feff4102380 msgr2=0x7feff41987d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:34.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.323+0000 7feffa39e640 1 --2- 172.21.15.1:0/193324549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feff4102380 0x7feff41987d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fefe400c970 tx=0x7fefe400ce30 comp rx=0 tx=0).stop 2024-09-19T09:36:34.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.323+0000 7feffa39e640 1 -- 172.21.15.1:0/193324549 shutdown_connections 2024-09-19T09:36:34.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.323+0000 7feffa39e640 1 --2- 172.21.15.1:0/193324549 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feff4107af0 0x7feff419cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.323+0000 7feffa39e640 1 --2- 172.21.15.1:0/193324549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7feff4102380 0x7feff41987d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.323+0000 7feffa39e640 1 --2- 172.21.15.1:0/193324549 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fefe00a32d0 0x7fefe00a5790 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.323+0000 7feffa39e640 1 --2- 172.21.15.1:0/193324549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feff41019e0 0x7feff4198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:34.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.323+0000 7feffa39e640 1 -- 172.21.15.1:0/193324549 >> 172.21.15.1:0/193324549 conn(0x7feff40fd700 msgr2=0x7feff40fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:34.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.323+0000 7feffa39e640 1 -- 172.21.15.1:0/193324549 shutdown_connections 2024-09-19T09:36:34.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:34.324+0000 7feffa39e640 1 -- 172.21.15.1:0/193324549 wait complete. 2024-09-19T09:36:34.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:34 smithi022 ceph-mon[35583]: pgmap v290: 97 pgs: 97 active+clean; 618 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.8 KiB/s wr, 4 op/s 2024-09-19T09:36:34.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:34 smithi022 ceph-mon[35583]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:34.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:34 smithi121 ceph-mon[35577]: pgmap v290: 97 pgs: 97 active+clean; 618 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.8 KiB/s wr, 4 op/s 2024-09-19T09:36:34.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:34 smithi121 ceph-mon[35577]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:36:35.044 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:36:35.304 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:35.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:35 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/193324549' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:35.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:35 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/193324549' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:35.425 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:35 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/193324549' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:36:35.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.813+0000 7f61dad2d640 1 -- 172.21.15.1:0/1900346529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61d4103700 msgr2=0x7f61d410bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:35.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.813+0000 7f61dad2d640 1 --2- 172.21.15.1:0/1900346529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61d4103700 0x7f61d410bbf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f61c8009900 tx=0x7f61c802a480 comp rx=0 tx=0).stop 2024-09-19T09:36:35.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.813+0000 7f61dad2d640 1 -- 172.21.15.1:0/1900346529 shutdown_connections 2024-09-19T09:36:35.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.813+0000 7f61dad2d640 1 --2- 172.21.15.1:0/1900346529 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61d410c180 0x7f61d410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:35.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.813+0000 7f61dad2d640 1 --2- 172.21.15.1:0/1900346529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61d4103700 0x7f61d410bbf0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:35.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.813+0000 7f61dad2d640 1 --2- 172.21.15.1:0/1900346529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61d4102de0 0x7f61d41031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:35.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.813+0000 7f61dad2d640 1 -- 172.21.15.1:0/1900346529 >> 172.21.15.1:0/1900346529 conn(0x7f61d40fc7a0 msgr2=0x7f61d40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:35.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.813+0000 7f61dad2d640 1 -- 172.21.15.1:0/1900346529 shutdown_connections 2024-09-19T09:36:35.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.813+0000 7f61dad2d640 1 -- 172.21.15.1:0/1900346529 wait complete. 2024-09-19T09:36:35.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.813+0000 7f61dad2d640 1 Processor -- start 2024-09-19T09:36:35.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.813+0000 7f61dad2d640 1 -- start start 2024-09-19T09:36:35.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.814+0000 7f61dad2d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61d4102de0 0x7f61d4100a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:35.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.814+0000 7f61dad2d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61d4103700 0x7f61d4100f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:35.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.814+0000 7f61dad2d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61d410c180 0x7f61d41014c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:35.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.814+0000 7f61dad2d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f61d4112000 con 0x7f61d4102de0 2024-09-19T09:36:35.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.814+0000 7f61dad2d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f61d4111e80 con 0x7f61d410c180 2024-09-19T09:36:35.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.814+0000 7f61dad2d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f61d4112180 con 0x7f61d4103700 2024-09-19T09:36:35.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.814+0000 7f61d8ac9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61d4102de0 0x7f61d4100a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:35.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.814+0000 7f61d8ac9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61d4102de0 0x7f61d4100a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46274/0 (socket says 172.21.15.1:46274) 2024-09-19T09:36:35.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.814+0000 7f61d8ac9640 1 -- 172.21.15.1:0/2180983343 learned_addr learned my addr 172.21.15.1:0/2180983343 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:35.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.814+0000 7f61d3fff640 1 --2- 172.21.15.1:0/2180983343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61d4103700 0x7f61d4100f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:35.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.814+0000 7f61d8ac9640 1 -- 172.21.15.1:0/2180983343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61d4103700 msgr2=0x7f61d4100f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:35.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.814+0000 7f61d8ac9640 1 --2- 172.21.15.1:0/2180983343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61d4103700 0x7f61d4100f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:35.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.814+0000 7f61d8ac9640 1 -- 172.21.15.1:0/2180983343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61d410c180 msgr2=0x7f61d41014c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:35.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.814+0000 7f61d92ca640 1 --2- 172.21.15.1:0/2180983343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61d410c180 0x7f61d41014c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:35.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.814+0000 7f61d8ac9640 1 --2- 172.21.15.1:0/2180983343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61d410c180 0x7f61d41014c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:35.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.814+0000 7f61d8ac9640 1 -- 172.21.15.1:0/2180983343 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d41a6a00 con 0x7f61d4102de0 2024-09-19T09:36:35.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.814+0000 7f61d3fff640 1 --2- 172.21.15.1:0/2180983343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61d4103700 0x7f61d4100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:35.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.814+0000 7f61d8ac9640 1 --2- 172.21.15.1:0/2180983343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61d4102de0 0x7f61d4100a40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f61c400c890 tx=0x7f61c400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:35.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.814+0000 7f61d1ffb640 1 -- 172.21.15.1:0/2180983343 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c4004220 con 0x7f61d4102de0 2024-09-19T09:36:35.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.814+0000 7f61dad2d640 1 -- 172.21.15.1:0/2180983343 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61d41a6cf0 con 0x7f61d4102de0 2024-09-19T09:36:35.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.814+0000 7f61d1ffb640 1 -- 172.21.15.1:0/2180983343 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61c40043c0 con 0x7f61d4102de0 2024-09-19T09:36:35.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.814+0000 7f61d1ffb640 1 -- 172.21.15.1:0/2180983343 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c4004a00 con 0x7f61d4102de0 2024-09-19T09:36:35.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.815+0000 7f61dad2d640 1 -- 172.21.15.1:0/2180983343 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61d41a71a0 con 0x7f61d4102de0 2024-09-19T09:36:35.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.816+0000 7f61dad2d640 1 -- 172.21.15.1:0/2180983343 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61d41031c0 con 0x7f61d4102de0 2024-09-19T09:36:35.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.817+0000 7f61d1ffb640 1 -- 172.21.15.1:0/2180983343 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f61c40079b0 con 0x7f61d4102de0 2024-09-19T09:36:35.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.817+0000 7f61d1ffb640 1 --2- 172.21.15.1:0/2180983343 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f61bc0a32d0 0x7f61bc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:35.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.817+0000 7f61d3fff640 1 --2- 172.21.15.1:0/2180983343 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f61bc0a32d0 0x7f61bc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:35.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.818+0000 7f61d1ffb640 1 -- 172.21.15.1:0/2180983343 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f61c40cf6a0 con 0x7f61d4102de0 2024-09-19T09:36:35.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.818+0000 7f61d3fff640 1 --2- 172.21.15.1:0/2180983343 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f61bc0a32d0 0x7f61bc0a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f61c8000c00 tx=0x7f61c8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:35.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.822+0000 7f61d1ffb640 1 -- 172.21.15.1:0/2180983343 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f61c4014030 con 0x7f61d4102de0 2024-09-19T09:36:36.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:35.999+0000 7f61dad2d640 1 -- 172.21.15.1:0/2180983343 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f61d402d7c0 con 0x7f61d4102de0 2024-09-19T09:36:36.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:36.001+0000 7f61d1ffb640 1 -- 172.21.15.1:0/2180983343 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22187 (secure 0 0 0) 0x7f61c409c410 con 0x7f61d4102de0 2024-09-19T09:36:36.002 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:36:36.003 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":81,"fsid":"57238232-7669-11ef-bceb-c7b262605968","created":"2024-09-19T09:28:28.406983+0000","modified":"2024-09-19T09:36:13.637291+0000","last_up_change":"2024-09-19T09:35:21.422825+0000","last_in_change":"2024-09-19T09:34:57.199184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:31:30.566509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:36:09.521275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:36:11.954337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c165571d-43f1-4c43-ba1e-35872d914f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6803","nonce":502676986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6805","nonce":502676986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6809","nonce":502676986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6807","nonce":502676986}]},"public_addr":"172.21.15.1:6803/502676986","cluster_addr":"172.21.15.1:6805/502676986","heartbeat_back_addr":"172.21.15.1:6809/502676986","heartbeat_front_addr":"172.21.15.1:6807/502676986","state":["exists","up"]},{"osd":1,"uuid":"baf120f8-8ba3-4aa5-a12a-41cdc97ff11b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6801","nonce":3735826323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6803","nonce":3735826323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6807","nonce":3735826323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6805","nonce":3735826323}]},"public_addr":"172.21.15.22:6801/3735826323","cluster_addr":"172.21.15.22:6803/3735826323","heartbeat_back_addr":"172.21.15.22:6807/3735826323","heartbeat_front_addr":"172.21.15.22:6805/3735826323","state":["exists","up"]},{"osd":2,"uuid":"72c520bf-c5cc-44ee-a38c-c9bac0a6280b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6801","nonce":1924970833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6803","nonce":1924970833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6807","nonce":1924970833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6805","nonce":1924970833}]},"public_addr":"172.21.15.121:6801/1924970833","cluster_addr":"172.21.15.121:6803/1924970833","heartbeat_back_addr":"172.21.15.121:6807/1924970833","heartbeat_front_addr":"172.21.15.121:6805/1924970833","state":["exists","up"]},{"osd":3,"uuid":"adad6d17-16d9-4c43-b581-35ac1bb9d807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6811","nonce":1515009793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6813","nonce":1515009793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6817","nonce":1515009793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6815","nonce":1515009793}]},"public_addr":"172.21.15.1:6811/1515009793","cluster_addr":"172.21.15.1:6813/1515009793","heartbeat_back_addr":"172.21.15.1:6817/1515009793","heartbeat_front_addr":"172.21.15.1:6815/1515009793","state":["exists","up"]},{"osd":4,"uuid":"8fb06efe-c3a0-48a3-9730-3e8f3e60922d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6809","nonce":923697266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6811","nonce":923697266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6815","nonce":923697266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6813","nonce":923697266}]},"public_addr":"172.21.15.22:6809/923697266","cluster_addr":"172.21.15.22:6811/923697266","heartbeat_back_addr":"172.21.15.22:6815/923697266","heartbeat_front_addr":"172.21.15.22:6813/923697266","state":["exists","up"]},{"osd":5,"uuid":"3b2f428c-8a5a-49be-9f43-a9f379a1c7e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6809","nonce":3137245658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6811","nonce":3137245658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6815","nonce":3137245658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6813","nonce":3137245658}]},"public_addr":"172.21.15.121:6809/3137245658","cluster_addr":"172.21.15.121:6811/3137245658","heartbeat_back_addr":"172.21.15.121:6815/3137245658","heartbeat_front_addr":"172.21.15.121:6813/3137245658","state":["exists","up"]},{"osd":6,"uuid":"5aecec68-ff7e-440c-bd39-cc35ab89cc91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6819","nonce":3376780798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6821","nonce":3376780798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6825","nonce":3376780798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6823","nonce":3376780798}]},"public_addr":"172.21.15.1:6819/3376780798","cluster_addr":"172.21.15.1:6821/3376780798","heartbeat_back_addr":"172.21.15.1:6825/3376780798","heartbeat_front_addr":"172.21.15.1:6823/3376780798","state":["exists","up"]},{"osd":7,"uuid":"46556bdf-199e-4268-873b-6d87b54e1176","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6817","nonce":2920985295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6819","nonce":2920985295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6823","nonce":2920985295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6821","nonce":2920985295}]},"public_addr":"172.21.15.22:6817/2920985295","cluster_addr":"172.21.15.22:6819/2920985295","heartbeat_back_addr":"172.21.15.22:6823/2920985295","heartbeat_front_addr":"172.21.15.22:6821/2920985295","state":["exists","up"]},{"osd":8,"uuid":"e7c3792a-94a4-4440-be74-d6abdf3d9566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6817","nonce":3589985967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6819","nonce":3589985967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6823","nonce":3589985967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6821","nonce":3589985967}]},"public_addr":"172.21.15.121:6817/3589985967","cluster_addr":"172.21.15.121:6819/3589985967","heartbeat_back_addr":"172.21.15.121:6823/3589985967","heartbeat_front_addr":"172.21.15.121:6821/3589985967","state":["exists","up"]},{"osd":9,"uuid":"8af80ac9-d681-4966-b083-ead5185eff12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6827","nonce":1143859822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6829","nonce":1143859822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6833","nonce":1143859822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6831","nonce":1143859822}]},"public_addr":"172.21.15.1:6827/1143859822","cluster_addr":"172.21.15.1:6829/1143859822","heartbeat_back_addr":"172.21.15.1:6833/1143859822","heartbeat_front_addr":"172.21.15.1:6831/1143859822","state":["exists","up"]},{"osd":10,"uuid":"34edd06a-7f60-4465-bfe1-0c646abd53f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6825","nonce":343155547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6827","nonce":343155547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6831","nonce":343155547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6829","nonce":343155547}]},"public_addr":"172.21.15.22:6825/343155547","cluster_addr":"172.21.15.22:6827/343155547","heartbeat_back_addr":"172.21.15.22:6831/343155547","heartbeat_front_addr":"172.21.15.22:6829/343155547","state":["exists","up"]},{"osd":11,"uuid":"5a831eb6-ad66-4ab6-a30a-b6299ce1f88d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6825","nonce":3202514460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6827","nonce":3202514460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6831","nonce":3202514460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6829","nonce":3202514460}]},"public_addr":"172.21.15.121:6825/3202514460","cluster_addr":"172.21.15.121:6827/3202514460","heartbeat_back_addr":"172.21.15.121:6831/3202514460","heartbeat_front_addr":"172.21.15.121:6829/3202514460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:30:37.582893+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:01.915252+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:26.783477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:53.407014+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:19.407005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:45.022320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:11.377986+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:36.818700+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:01.745428+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:27.928916+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:53.363906+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:19.037551+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6800/1028873727":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/3137949087":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/1951370933":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2008363642":"2024-09-20T09:28:50.074985+0000","172.21.15.1:0/3006931063":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2486161758":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6801/1296304385":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6801/1028873727":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2783823049":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6800/1296304385":"2024-09-20T09:28:50.074985+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:36:36.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:36.003+0000 7f61dad2d640 1 -- 172.21.15.1:0/2180983343 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f61bc0a32d0 msgr2=0x7f61bc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:36.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:36.003+0000 7f61dad2d640 1 --2- 172.21.15.1:0/2180983343 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f61bc0a32d0 0x7f61bc0a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f61c8000c00 tx=0x7f61c8005a20 comp rx=0 tx=0).stop 2024-09-19T09:36:36.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:36.003+0000 7f61dad2d640 1 -- 172.21.15.1:0/2180983343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61d4102de0 msgr2=0x7f61d4100a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:36.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:36.003+0000 7f61dad2d640 1 --2- 172.21.15.1:0/2180983343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61d4102de0 0x7f61d4100a40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f61c400c890 tx=0x7f61c400cd50 comp rx=0 tx=0).stop 2024-09-19T09:36:36.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:36.003+0000 7f61dad2d640 1 -- 172.21.15.1:0/2180983343 shutdown_connections 2024-09-19T09:36:36.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:36.003+0000 7f61dad2d640 1 --2- 172.21.15.1:0/2180983343 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f61bc0a32d0 0x7f61bc0a5790 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:36.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:36.003+0000 7f61dad2d640 1 --2- 172.21.15.1:0/2180983343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61d410c180 0x7f61d41014c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:36.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:36.003+0000 7f61dad2d640 1 --2- 172.21.15.1:0/2180983343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61d4103700 0x7f61d4100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:36.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:36.003+0000 7f61dad2d640 1 --2- 172.21.15.1:0/2180983343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61d4102de0 0x7f61d4100a40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:36.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:36.003+0000 7f61dad2d640 1 -- 172.21.15.1:0/2180983343 >> 172.21.15.1:0/2180983343 conn(0x7f61d40fc7a0 msgr2=0x7f61d40fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:36.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:36.003+0000 7f61dad2d640 1 -- 172.21.15.1:0/2180983343 shutdown_connections 2024-09-19T09:36:36.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:36.003+0000 7f61dad2d640 1 -- 172.21.15.1:0/2180983343 wait complete. 2024-09-19T09:36:36.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:36 smithi022 ceph-mon[35583]: pgmap v291: 97 pgs: 97 active+clean; 618 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.9 KiB/s wr, 4 op/s 2024-09-19T09:36:36.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:36 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/2180983343' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:36:36.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:36 smithi121 ceph-mon[35577]: pgmap v291: 97 pgs: 97 active+clean; 618 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.9 KiB/s wr, 4 op/s 2024-09-19T09:36:36.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:36 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/2180983343' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:36:36.378 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:36 smithi001 ceph-mon[31225]: pgmap v291: 97 pgs: 97 active+clean; 618 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 3.9 KiB/s wr, 4 op/s 2024-09-19T09:36:36.379 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:36 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/2180983343' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:36:36.823 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T09:36:36.823 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:36:37.087 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:37.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.589+0000 7fdf6f07e640 1 -- 172.21.15.1:0/2448787927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf68106a80 msgr2=0x7fdf68106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:37.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.589+0000 7fdf6f07e640 1 --2- 172.21.15.1:0/2448787927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf68106a80 0x7fdf68106e60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdf58009930 tx=0x7fdf5802a420 comp rx=0 tx=0).stop 2024-09-19T09:36:37.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.589+0000 7fdf6f07e640 1 -- 172.21.15.1:0/2448787927 shutdown_connections 2024-09-19T09:36:37.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.589+0000 7fdf6f07e640 1 --2- 172.21.15.1:0/2448787927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf68101420 0x7fdf6810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.589+0000 7fdf6f07e640 1 --2- 172.21.15.1:0/2448787927 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf68100a80 0x7fdf68100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.589+0000 7fdf6f07e640 1 --2- 172.21.15.1:0/2448787927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf68106a80 0x7fdf68106e60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.589+0000 7fdf6f07e640 1 -- 172.21.15.1:0/2448787927 >> 172.21.15.1:0/2448787927 conn(0x7fdf680fc7a0 msgr2=0x7fdf680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:37.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.589+0000 7fdf6f07e640 1 -- 172.21.15.1:0/2448787927 shutdown_connections 2024-09-19T09:36:37.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.589+0000 7fdf6f07e640 1 -- 172.21.15.1:0/2448787927 wait complete. 2024-09-19T09:36:37.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.590+0000 7fdf6f07e640 1 Processor -- start 2024-09-19T09:36:37.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.590+0000 7fdf6f07e640 1 -- start start 2024-09-19T09:36:37.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.590+0000 7fdf6f07e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf68100a80 0x7fdf681984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:37.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.590+0000 7fdf6f07e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf68101420 0x7fdf681989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:37.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.590+0000 7fdf6f07e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf68106a80 0x7fdf6819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:37.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.590+0000 7fdf6f07e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdf68110e80 con 0x7fdf68100a80 2024-09-19T09:36:37.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.590+0000 7fdf6f07e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdf68110d00 con 0x7fdf68106a80 2024-09-19T09:36:37.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.590+0000 7fdf6f07e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdf68111000 con 0x7fdf68101420 2024-09-19T09:36:37.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.590+0000 7fdf6ce1a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf68100a80 0x7fdf681984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:37.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.590+0000 7fdf6ce1a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf68100a80 0x7fdf681984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46288/0 (socket says 172.21.15.1:46288) 2024-09-19T09:36:37.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.590+0000 7fdf6ce1a640 1 -- 172.21.15.1:0/25961541 learned_addr learned my addr 172.21.15.1:0/25961541 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:37.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.591+0000 7fdf6d61b640 1 --2- 172.21.15.1:0/25961541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf68106a80 0x7fdf6819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:37.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.591+0000 7fdf67fff640 1 --2- 172.21.15.1:0/25961541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf68101420 0x7fdf681989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:37.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.591+0000 7fdf6ce1a640 1 -- 172.21.15.1:0/25961541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf68101420 msgr2=0x7fdf681989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:37.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.591+0000 7fdf6ce1a640 1 --2- 172.21.15.1:0/25961541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf68101420 0x7fdf681989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.591+0000 7fdf6ce1a640 1 -- 172.21.15.1:0/25961541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf68106a80 msgr2=0x7fdf6819cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:37.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.591+0000 7fdf6ce1a640 1 --2- 172.21.15.1:0/25961541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf68106a80 0x7fdf6819cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.591+0000 7fdf6ce1a640 1 -- 172.21.15.1:0/25961541 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf6819d460 con 0x7fdf68100a80 2024-09-19T09:36:37.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.591+0000 7fdf6ce1a640 1 --2- 172.21.15.1:0/25961541 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf68100a80 0x7fdf681984b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdf58009230 tx=0x7fdf58004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:37.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.591+0000 7fdf65ffb640 1 -- 172.21.15.1:0/25961541 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf5803f030 con 0x7fdf68100a80 2024-09-19T09:36:37.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.591+0000 7fdf6f07e640 1 -- 172.21.15.1:0/25961541 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf6819d6f0 con 0x7fdf68100a80 2024-09-19T09:36:37.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.591+0000 7fdf65ffb640 1 -- 172.21.15.1:0/25961541 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdf58003ad0 con 0x7fdf68100a80 2024-09-19T09:36:37.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.591+0000 7fdf65ffb640 1 -- 172.21.15.1:0/25961541 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf58035070 con 0x7fdf68100a80 2024-09-19T09:36:37.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.591+0000 7fdf6f07e640 1 -- 172.21.15.1:0/25961541 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf681a5030 con 0x7fdf68100a80 2024-09-19T09:36:37.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.592+0000 7fdf6f07e640 1 -- 172.21.15.1:0/25961541 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf68100ee0 con 0x7fdf68100a80 2024-09-19T09:36:37.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.594+0000 7fdf65ffb640 1 -- 172.21.15.1:0/25961541 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fdf58042030 con 0x7fdf68100a80 2024-09-19T09:36:37.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.594+0000 7fdf65ffb640 1 --2- 172.21.15.1:0/25961541 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fdf500a32d0 0x7fdf500a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:37.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.594+0000 7fdf67fff640 1 --2- 172.21.15.1:0/25961541 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fdf500a32d0 0x7fdf500a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:37.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.594+0000 7fdf65ffb640 1 -- 172.21.15.1:0/25961541 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fdf580efde0 con 0x7fdf68100a80 2024-09-19T09:36:37.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.595+0000 7fdf67fff640 1 --2- 172.21.15.1:0/25961541 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fdf500a32d0 0x7fdf500a5790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdf6806b7e0 tx=0x7fdf5c00b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:37.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.598+0000 7fdf65ffb640 1 -- 172.21.15.1:0/25961541 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdf580bcb50 con 0x7fdf68100a80 2024-09-19T09:36:37.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.774+0000 7fdf6f07e640 1 -- 172.21.15.1:0/25961541 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdf680fce60 con 0x7fdf500a32d0 2024-09-19T09:36:37.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.781+0000 7fdf65ffb640 1 -- 172.21.15.1:0/25961541 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258791 (secure 0 0 0) 0x7fdf680fce60 con 0x7fdf500a32d0 2024-09-19T09:36:37.785 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:36:37.786 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-19T09:36:37.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.783+0000 7fdf6f07e640 1 -- 172.21.15.1:0/25961541 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fdf500a32d0 msgr2=0x7fdf500a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:37.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.783+0000 7fdf6f07e640 1 --2- 172.21.15.1:0/25961541 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fdf500a32d0 0x7fdf500a5790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdf6806b7e0 tx=0x7fdf5c00b590 comp rx=0 tx=0).stop 2024-09-19T09:36:37.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.783+0000 7fdf6f07e640 1 -- 172.21.15.1:0/25961541 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf68100a80 msgr2=0x7fdf681984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:37.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.783+0000 7fdf6f07e640 1 --2- 172.21.15.1:0/25961541 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf68100a80 0x7fdf681984b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdf58009230 tx=0x7fdf58004270 comp rx=0 tx=0).stop 2024-09-19T09:36:37.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.783+0000 7fdf6f07e640 1 -- 172.21.15.1:0/25961541 shutdown_connections 2024-09-19T09:36:37.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.783+0000 7fdf6f07e640 1 --2- 172.21.15.1:0/25961541 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fdf500a32d0 0x7fdf500a5790 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.783+0000 7fdf6f07e640 1 --2- 172.21.15.1:0/25961541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf68106a80 0x7fdf6819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.783+0000 7fdf6f07e640 1 --2- 172.21.15.1:0/25961541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf68101420 0x7fdf681989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.783+0000 7fdf6f07e640 1 --2- 172.21.15.1:0/25961541 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdf68100a80 0x7fdf681984b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:37.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.783+0000 7fdf6f07e640 1 -- 172.21.15.1:0/25961541 >> 172.21.15.1:0/25961541 conn(0x7fdf680fc7a0 msgr2=0x7fdf68104930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:37.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.784+0000 7fdf6f07e640 1 -- 172.21.15.1:0/25961541 shutdown_connections 2024-09-19T09:36:37.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:37.784+0000 7fdf6f07e640 1 -- 172.21.15.1:0/25961541 wait complete. 2024-09-19T09:36:38.050 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:38 smithi001 ceph-mon[31225]: pgmap v292: 97 pgs: 97 active+clean; 629 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.3 KiB/s wr, 6 op/s 2024-09-19T09:36:38.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:38 smithi022 ceph-mon[35583]: pgmap v292: 97 pgs: 97 active+clean; 629 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.3 KiB/s wr, 6 op/s 2024-09-19T09:36:38.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:38 smithi121 ceph-mon[35577]: pgmap v292: 97 pgs: 97 active+clean; 629 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 5.3 KiB/s wr, 6 op/s 2024-09-19T09:36:38.623 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-09-19T09:36:36.135008+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644567,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":169,"num_read_kb":184,"num_write":261,"num_write_kb":3016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":405664,"kb_used_data":10632,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124536160,"statfs":{"total":1151940427776,"available":1151525027840,"internally_reserved":0,"allocated":10887168,"data_stored":7020729,"data_compressed":107955,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19141,"internal_metadata":404272443},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":51789,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":74,"num_write":35,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003180"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971317+0000","last_change":"2024-09-19T09:36:12.985228+0000","last_active":"2024-09-19T09:36:13.971317+0000","last_peered":"2024-09-19T09:36:13.971317+0000","last_clean":"2024-09-19T09:36:13.971317+0000","last_became_active":"2024-09-19T09:36:12.984306+0000","last_became_peered":"2024-09-19T09:36:12.984306+0000","last_unstale":"2024-09-19T09:36:13.971317+0000","last_undegraded":"2024-09-19T09:36:13.971317+0000","last_fullsized":"2024-09-19T09:36:13.971317+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:45.988859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979575+0000","last_change":"2024-09-19T09:36:12.987631+0000","last_active":"2024-09-19T09:36:13.979575+0000","last_peered":"2024-09-19T09:36:13.979575+0000","last_clean":"2024-09-19T09:36:13.979575+0000","last_became_active":"2024-09-19T09:36:12.987298+0000","last_became_peered":"2024-09-19T09:36:12.987298+0000","last_unstale":"2024-09-19T09:36:13.979575+0000","last_undegraded":"2024-09-19T09:36:13.979575+0000","last_fullsized":"2024-09-19T09:36:13.979575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:47.397162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979729+0000","last_change":"2024-09-19T09:36:12.991466+0000","last_active":"2024-09-19T09:36:13.979729+0000","last_peered":"2024-09-19T09:36:13.979729+0000","last_clean":"2024-09-19T09:36:13.979729+0000","last_became_active":"2024-09-19T09:36:12.990903+0000","last_became_peered":"2024-09-19T09:36:12.990903+0000","last_unstale":"2024-09-19T09:36:13.979729+0000","last_undegraded":"2024-09-19T09:36:13.979729+0000","last_fullsized":"2024-09-19T09:36:13.979729+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:04.128768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980669+0000","last_change":"2024-09-19T09:36:12.986686+0000","last_active":"2024-09-19T09:36:13.980669+0000","last_peered":"2024-09-19T09:36:13.980669+0000","last_clean":"2024-09-19T09:36:13.980669+0000","last_became_active":"2024-09-19T09:36:12.986334+0000","last_became_peered":"2024-09-19T09:36:12.986334+0000","last_unstale":"2024-09-19T09:36:13.980669+0000","last_undegraded":"2024-09-19T09:36:13.980669+0000","last_fullsized":"2024-09-19T09:36:13.980669+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:39.926343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979886+0000","last_change":"2024-09-19T09:36:12.981964+0000","last_active":"2024-09-19T09:36:13.979886+0000","last_peered":"2024-09-19T09:36:13.979886+0000","last_clean":"2024-09-19T09:36:13.979886+0000","last_became_active":"2024-09-19T09:36:12.981558+0000","last_became_peered":"2024-09-19T09:36:12.981558+0000","last_unstale":"2024-09-19T09:36:13.979886+0000","last_undegraded":"2024-09-19T09:36:13.979886+0000","last_fullsized":"2024-09-19T09:36:13.979886+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:33.706451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971758+0000","last_change":"2024-09-19T09:36:12.992598+0000","last_active":"2024-09-19T09:36:13.971758+0000","last_peered":"2024-09-19T09:36:13.971758+0000","last_clean":"2024-09-19T09:36:13.971758+0000","last_became_active":"2024-09-19T09:36:12.992281+0000","last_became_peered":"2024-09-19T09:36:12.992281+0000","last_unstale":"2024-09-19T09:36:13.971758+0000","last_undegraded":"2024-09-19T09:36:13.971758+0000","last_fullsized":"2024-09-19T09:36:13.971758+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:26.107432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983518+0000","last_change":"2024-09-19T09:36:12.988583+0000","last_active":"2024-09-19T09:36:13.983518+0000","last_peered":"2024-09-19T09:36:13.983518+0000","last_clean":"2024-09-19T09:36:13.983518+0000","last_became_active":"2024-09-19T09:36:12.987895+0000","last_became_peered":"2024-09-19T09:36:12.987895+0000","last_unstale":"2024-09-19T09:36:13.983518+0000","last_undegraded":"2024-09-19T09:36:13.983518+0000","last_fullsized":"2024-09-19T09:36:13.983518+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:47.617324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977053+0000","last_change":"2024-09-19T09:36:12.988526+0000","last_active":"2024-09-19T09:36:13.977053+0000","last_peered":"2024-09-19T09:36:13.977053+0000","last_clean":"2024-09-19T09:36:13.977053+0000","last_became_active":"2024-09-19T09:36:12.988093+0000","last_became_peered":"2024-09-19T09:36:12.988093+0000","last_unstale":"2024-09-19T09:36:13.977053+0000","last_undegraded":"2024-09-19T09:36:13.977053+0000","last_fullsized":"2024-09-19T09:36:13.977053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:48.949397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977695+0000","last_change":"2024-09-19T09:36:12.992360+0000","last_active":"2024-09-19T09:36:13.977695+0000","last_peered":"2024-09-19T09:36:13.977695+0000","last_clean":"2024-09-19T09:36:13.977695+0000","last_became_active":"2024-09-19T09:36:12.991833+0000","last_became_peered":"2024-09-19T09:36:12.991833+0000","last_unstale":"2024-09-19T09:36:13.977695+0000","last_undegraded":"2024-09-19T09:36:13.977695+0000","last_fullsized":"2024-09-19T09:36:13.977695+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:47.715012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.972202+0000","last_change":"2024-09-19T09:36:12.993435+0000","last_active":"2024-09-19T09:36:13.972202+0000","last_peered":"2024-09-19T09:36:13.972202+0000","last_clean":"2024-09-19T09:36:13.972202+0000","last_became_active":"2024-09-19T09:36:12.993108+0000","last_became_peered":"2024-09-19T09:36:12.993108+0000","last_unstale":"2024-09-19T09:36:13.972202+0000","last_undegraded":"2024-09-19T09:36:13.972202+0000","last_fullsized":"2024-09-19T09:36:13.972202+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:54.453593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983462+0000","last_change":"2024-09-19T09:36:12.991044+0000","last_active":"2024-09-19T09:36:13.983462+0000","last_peered":"2024-09-19T09:36:13.983462+0000","last_clean":"2024-09-19T09:36:13.983462+0000","last_became_active":"2024-09-19T09:36:12.989955+0000","last_became_peered":"2024-09-19T09:36:12.989955+0000","last_unstale":"2024-09-19T09:36:13.983462+0000","last_undegraded":"2024-09-19T09:36:13.983462+0000","last_fullsized":"2024-09-19T09:36:13.983462+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:21.034023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980631+0000","last_change":"2024-09-19T09:36:12.989679+0000","last_active":"2024-09-19T09:36:13.980631+0000","last_peered":"2024-09-19T09:36:13.980631+0000","last_clean":"2024-09-19T09:36:13.980631+0000","last_became_active":"2024-09-19T09:36:12.988463+0000","last_became_peered":"2024-09-19T09:36:12.988463+0000","last_unstale":"2024-09-19T09:36:13.980631+0000","last_undegraded":"2024-09-19T09:36:13.980631+0000","last_fullsized":"2024-09-19T09:36:13.980631+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:28.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971006+0000","last_change":"2024-09-19T09:36:12.983494+0000","last_active":"2024-09-19T09:36:13.971006+0000","last_peered":"2024-09-19T09:36:13.971006+0000","last_clean":"2024-09-19T09:36:13.971006+0000","last_became_active":"2024-09-19T09:36:12.983143+0000","last_became_peered":"2024-09-19T09:36:12.983143+0000","last_unstale":"2024-09-19T09:36:13.971006+0000","last_undegraded":"2024-09-19T09:36:13.971006+0000","last_fullsized":"2024-09-19T09:36:13.971006+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:23.378183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980072+0000","last_change":"2024-09-19T09:36:12.987512+0000","last_active":"2024-09-19T09:36:13.980072+0000","last_peered":"2024-09-19T09:36:13.980072+0000","last_clean":"2024-09-19T09:36:13.980072+0000","last_became_active":"2024-09-19T09:36:12.987288+0000","last_became_peered":"2024-09-19T09:36:12.987288+0000","last_unstale":"2024-09-19T09:36:13.980072+0000","last_undegraded":"2024-09-19T09:36:13.980072+0000","last_fullsized":"2024-09-19T09:36:13.980072+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:14.614333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979944+0000","last_change":"2024-09-19T09:36:12.989725+0000","last_active":"2024-09-19T09:36:13.979944+0000","last_peered":"2024-09-19T09:36:13.979944+0000","last_clean":"2024-09-19T09:36:13.979944+0000","last_became_active":"2024-09-19T09:36:12.989229+0000","last_became_peered":"2024-09-19T09:36:12.989229+0000","last_unstale":"2024-09-19T09:36:13.979944+0000","last_undegraded":"2024-09-19T09:36:13.979944+0000","last_fullsized":"2024-09-19T09:36:13.979944+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:07.896864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977084+0000","last_change":"2024-09-19T09:36:12.988210+0000","last_active":"2024-09-19T09:36:13.977084+0000","last_peered":"2024-09-19T09:36:13.977084+0000","last_clean":"2024-09-19T09:36:13.977084+0000","last_became_active":"2024-09-19T09:36:12.987904+0000","last_became_peered":"2024-09-19T09:36:12.987904+0000","last_unstale":"2024-09-19T09:36:13.977084+0000","last_undegraded":"2024-09-19T09:36:13.977084+0000","last_fullsized":"2024-09-19T09:36:13.977084+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:13.588237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971389+0000","last_change":"2024-09-19T09:36:12.984028+0000","last_active":"2024-09-19T09:36:13.971389+0000","last_peered":"2024-09-19T09:36:13.971389+0000","last_clean":"2024-09-19T09:36:13.971389+0000","last_became_active":"2024-09-19T09:36:12.982062+0000","last_became_peered":"2024-09-19T09:36:12.982062+0000","last_unstale":"2024-09-19T09:36:13.971389+0000","last_undegraded":"2024-09-19T09:36:13.971389+0000","last_fullsized":"2024-09-19T09:36:13.971389+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:26.610287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979548+0000","last_change":"2024-09-19T09:36:12.979277+0000","last_active":"2024-09-19T09:36:13.979548+0000","last_peered":"2024-09-19T09:36:13.979548+0000","last_clean":"2024-09-19T09:36:13.979548+0000","last_became_active":"2024-09-19T09:36:12.978970+0000","last_became_peered":"2024-09-19T09:36:12.978970+0000","last_unstale":"2024-09-19T09:36:13.979548+0000","last_undegraded":"2024-09-19T09:36:13.979548+0000","last_fullsized":"2024-09-19T09:36:13.979548+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:00.424728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979950+0000","last_change":"2024-09-19T09:36:12.981021+0000","last_active":"2024-09-19T09:36:13.979950+0000","last_peered":"2024-09-19T09:36:13.979950+0000","last_clean":"2024-09-19T09:36:13.979950+0000","last_became_active":"2024-09-19T09:36:12.980580+0000","last_became_peered":"2024-09-19T09:36:12.980580+0000","last_unstale":"2024-09-19T09:36:13.979950+0000","last_undegraded":"2024-09-19T09:36:13.979950+0000","last_fullsized":"2024-09-19T09:36:13.979950+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:17.464873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971081+0000","last_change":"2024-09-19T09:36:12.986090+0000","last_active":"2024-09-19T09:36:13.971081+0000","last_peered":"2024-09-19T09:36:13.971081+0000","last_clean":"2024-09-19T09:36:13.971081+0000","last_became_active":"2024-09-19T09:36:12.985740+0000","last_became_peered":"2024-09-19T09:36:12.985740+0000","last_unstale":"2024-09-19T09:36:13.971081+0000","last_undegraded":"2024-09-19T09:36:13.971081+0000","last_fullsized":"2024-09-19T09:36:13.971081+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:35.252834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971039+0000","last_change":"2024-09-19T09:36:12.981257+0000","last_active":"2024-09-19T09:36:13.971039+0000","last_peered":"2024-09-19T09:36:13.971039+0000","last_clean":"2024-09-19T09:36:13.971039+0000","last_became_active":"2024-09-19T09:36:12.980911+0000","last_became_peered":"2024-09-19T09:36:12.980911+0000","last_unstale":"2024-09-19T09:36:13.971039+0000","last_undegraded":"2024-09-19T09:36:13.971039+0000","last_fullsized":"2024-09-19T09:36:13.971039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:41.470514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977617+0000","last_change":"2024-09-19T09:36:12.982585+0000","last_active":"2024-09-19T09:36:13.977617+0000","last_peered":"2024-09-19T09:36:13.977617+0000","last_clean":"2024-09-19T09:36:13.977617+0000","last_became_active":"2024-09-19T09:36:12.982193+0000","last_became_peered":"2024-09-19T09:36:12.982193+0000","last_unstale":"2024-09-19T09:36:13.977617+0000","last_undegraded":"2024-09-19T09:36:13.977617+0000","last_fullsized":"2024-09-19T09:36:13.977617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:30.057088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977206+0000","last_change":"2024-09-19T09:36:12.985236+0000","last_active":"2024-09-19T09:36:13.977206+0000","last_peered":"2024-09-19T09:36:13.977206+0000","last_clean":"2024-09-19T09:36:13.977206+0000","last_became_active":"2024-09-19T09:36:12.984751+0000","last_became_peered":"2024-09-19T09:36:12.984751+0000","last_unstale":"2024-09-19T09:36:13.977206+0000","last_undegraded":"2024-09-19T09:36:13.977206+0000","last_fullsized":"2024-09-19T09:36:13.977206+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:52.784216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983846+0000","last_change":"2024-09-19T09:36:12.985856+0000","last_active":"2024-09-19T09:36:13.983846+0000","last_peered":"2024-09-19T09:36:13.983846+0000","last_clean":"2024-09-19T09:36:13.983846+0000","last_became_active":"2024-09-19T09:36:12.985312+0000","last_became_peered":"2024-09-19T09:36:12.985312+0000","last_unstale":"2024-09-19T09:36:13.983846+0000","last_undegraded":"2024-09-19T09:36:13.983846+0000","last_fullsized":"2024-09-19T09:36:13.983846+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:25.235945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977734+0000","last_change":"2024-09-19T09:36:12.982443+0000","last_active":"2024-09-19T09:36:13.977734+0000","last_peered":"2024-09-19T09:36:13.977734+0000","last_clean":"2024-09-19T09:36:13.977734+0000","last_became_active":"2024-09-19T09:36:12.982130+0000","last_became_peered":"2024-09-19T09:36:12.982130+0000","last_unstale":"2024-09-19T09:36:13.977734+0000","last_undegraded":"2024-09-19T09:36:13.977734+0000","last_fullsized":"2024-09-19T09:36:13.977734+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:17.177563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980374+0000","last_change":"2024-09-19T09:36:12.990439+0000","last_active":"2024-09-19T09:36:13.980374+0000","last_peered":"2024-09-19T09:36:13.980374+0000","last_clean":"2024-09-19T09:36:13.980374+0000","last_became_active":"2024-09-19T09:36:12.990135+0000","last_became_peered":"2024-09-19T09:36:12.990135+0000","last_unstale":"2024-09-19T09:36:13.980374+0000","last_undegraded":"2024-09-19T09:36:13.980374+0000","last_fullsized":"2024-09-19T09:36:13.980374+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:51.685192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971233+0000","last_change":"2024-09-19T09:36:12.987261+0000","last_active":"2024-09-19T09:36:13.971233+0000","last_peered":"2024-09-19T09:36:13.971233+0000","last_clean":"2024-09-19T09:36:13.971233+0000","last_became_active":"2024-09-19T09:36:12.986192+0000","last_became_peered":"2024-09-19T09:36:12.986192+0000","last_unstale":"2024-09-19T09:36:13.971233+0000","last_undegraded":"2024-09-19T09:36:13.971233+0000","last_fullsized":"2024-09-19T09:36:13.971233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:58.435605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971115+0000","last_change":"2024-09-19T09:36:12.981248+0000","last_active":"2024-09-19T09:36:13.971115+0000","last_peered":"2024-09-19T09:36:13.971115+0000","last_clean":"2024-09-19T09:36:13.971115+0000","last_became_active":"2024-09-19T09:36:12.980754+0000","last_became_peered":"2024-09-19T09:36:12.980754+0000","last_unstale":"2024-09-19T09:36:13.971115+0000","last_undegraded":"2024-09-19T09:36:13.971115+0000","last_fullsized":"2024-09-19T09:36:13.971115+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:03.970402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980069+0000","last_change":"2024-09-19T09:36:12.990841+0000","last_active":"2024-09-19T09:36:13.980069+0000","last_peered":"2024-09-19T09:36:13.980069+0000","last_clean":"2024-09-19T09:36:13.980069+0000","last_became_active":"2024-09-19T09:36:12.989667+0000","last_became_peered":"2024-09-19T09:36:12.989667+0000","last_unstale":"2024-09-19T09:36:13.980069+0000","last_undegraded":"2024-09-19T09:36:13.980069+0000","last_fullsized":"2024-09-19T09:36:13.980069+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:46:00.314590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979717+0000","last_change":"2024-09-19T09:36:12.984007+0000","last_active":"2024-09-19T09:36:13.979717+0000","last_peered":"2024-09-19T09:36:13.979717+0000","last_clean":"2024-09-19T09:36:13.979717+0000","last_became_active":"2024-09-19T09:36:12.983627+0000","last_became_peered":"2024-09-19T09:36:12.983627+0000","last_unstale":"2024-09-19T09:36:13.979717+0000","last_undegraded":"2024-09-19T09:36:13.979717+0000","last_fullsized":"2024-09-19T09:36:13.979717+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:42.038673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980949+0000","last_change":"2024-09-19T09:36:12.988032+0000","last_active":"2024-09-19T09:36:13.980949+0000","last_peered":"2024-09-19T09:36:13.980949+0000","last_clean":"2024-09-19T09:36:13.980949+0000","last_became_active":"2024-09-19T09:36:12.987588+0000","last_became_peered":"2024-09-19T09:36:12.987588+0000","last_unstale":"2024-09-19T09:36:13.980949+0000","last_undegraded":"2024-09-19T09:36:13.980949+0000","last_fullsized":"2024-09-19T09:36:13.980949+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:01.518543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.970969+0000","last_change":"2024-09-19T09:36:12.991186+0000","last_active":"2024-09-19T09:36:13.970969+0000","last_peered":"2024-09-19T09:36:13.970969+0000","last_clean":"2024-09-19T09:36:13.970969+0000","last_became_active":"2024-09-19T09:36:12.987125+0000","last_became_peered":"2024-09-19T09:36:12.987125+0000","last_unstale":"2024-09-19T09:36:13.970969+0000","last_undegraded":"2024-09-19T09:36:13.970969+0000","last_fullsized":"2024-09-19T09:36:13.970969+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:35.316046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979987+0000","last_change":"2024-09-19T09:36:12.989709+0000","last_active":"2024-09-19T09:36:13.979987+0000","last_peered":"2024-09-19T09:36:13.979987+0000","last_clean":"2024-09-19T09:36:13.979987+0000","last_became_active":"2024-09-19T09:36:12.989324+0000","last_became_peered":"2024-09-19T09:36:12.989324+0000","last_unstale":"2024-09-19T09:36:13.979987+0000","last_undegraded":"2024-09-19T09:36:13.979987+0000","last_fullsized":"2024-09-19T09:36:13.979987+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:09.843175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983299+0000","last_change":"2024-09-19T09:36:10.843617+0000","last_active":"2024-09-19T09:36:13.983299+0000","last_peered":"2024-09-19T09:36:13.983299+0000","last_clean":"2024-09-19T09:36:13.983299+0000","last_became_active":"2024-09-19T09:36:10.843211+0000","last_became_peered":"2024-09-19T09:36:10.843211+0000","last_unstale":"2024-09-19T09:36:13.983299+0000","last_undegraded":"2024-09-19T09:36:13.983299+0000","last_fullsized":"2024-09-19T09:36:13.983299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:10.137291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983051+0000","last_change":"2024-09-19T09:36:12.992456+0000","last_active":"2024-09-19T09:36:13.983051+0000","last_peered":"2024-09-19T09:36:13.983051+0000","last_clean":"2024-09-19T09:36:13.983051+0000","last_became_active":"2024-09-19T09:36:12.992119+0000","last_became_peered":"2024-09-19T09:36:12.992119+0000","last_unstale":"2024-09-19T09:36:13.983051+0000","last_undegraded":"2024-09-19T09:36:13.983051+0000","last_fullsized":"2024-09-19T09:36:13.983051+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:20.850631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971692+0000","last_change":"2024-09-19T09:36:10.839487+0000","last_active":"2024-09-19T09:36:13.971692+0000","last_peered":"2024-09-19T09:36:13.971692+0000","last_clean":"2024-09-19T09:36:13.971692+0000","last_became_active":"2024-09-19T09:36:10.839074+0000","last_became_peered":"2024-09-19T09:36:10.839074+0000","last_unstale":"2024-09-19T09:36:13.971692+0000","last_undegraded":"2024-09-19T09:36:13.971692+0000","last_fullsized":"2024-09-19T09:36:13.971692+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:30.299698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.970682+0000","last_change":"2024-09-19T09:36:10.837287+0000","last_active":"2024-09-19T09:36:13.970682+0000","last_peered":"2024-09-19T09:36:13.970682+0000","last_clean":"2024-09-19T09:36:13.970682+0000","last_became_active":"2024-09-19T09:36:10.836890+0000","last_became_peered":"2024-09-19T09:36:10.836890+0000","last_unstale":"2024-09-19T09:36:13.970682+0000","last_undegraded":"2024-09-19T09:36:13.970682+0000","last_fullsized":"2024-09-19T09:36:13.970682+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:09.676728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977125+0000","last_change":"2024-09-19T09:36:12.975690+0000","last_active":"2024-09-19T09:36:13.977125+0000","last_peered":"2024-09-19T09:36:13.977125+0000","last_clean":"2024-09-19T09:36:13.977125+0000","last_became_active":"2024-09-19T09:36:12.975370+0000","last_became_peered":"2024-09-19T09:36:12.975370+0000","last_unstale":"2024-09-19T09:36:13.977125+0000","last_undegraded":"2024-09-19T09:36:13.977125+0000","last_fullsized":"2024-09-19T09:36:13.977125+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:05.650917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.984270+0000","last_change":"2024-09-19T09:36:10.843736+0000","last_active":"2024-09-19T09:36:13.984270+0000","last_peered":"2024-09-19T09:36:13.984270+0000","last_clean":"2024-09-19T09:36:13.984270+0000","last_became_active":"2024-09-19T09:36:10.843353+0000","last_became_peered":"2024-09-19T09:36:10.843353+0000","last_unstale":"2024-09-19T09:36:13.984270+0000","last_undegraded":"2024-09-19T09:36:13.984270+0000","last_fullsized":"2024-09-19T09:36:13.984270+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:29.818642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979800+0000","last_change":"2024-09-19T09:36:12.978841+0000","last_active":"2024-09-19T09:36:13.979800+0000","last_peered":"2024-09-19T09:36:13.979800+0000","last_clean":"2024-09-19T09:36:13.979800+0000","last_became_active":"2024-09-19T09:36:12.978501+0000","last_became_peered":"2024-09-19T09:36:12.978501+0000","last_unstale":"2024-09-19T09:36:13.979800+0000","last_undegraded":"2024-09-19T09:36:13.979800+0000","last_fullsized":"2024-09-19T09:36:13.979800+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:07.974576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.972053+0000","last_change":"2024-09-19T09:36:10.841997+0000","last_active":"2024-09-19T09:36:13.972053+0000","last_peered":"2024-09-19T09:36:13.972053+0000","last_clean":"2024-09-19T09:36:13.972053+0000","last_became_active":"2024-09-19T09:36:10.841641+0000","last_became_peered":"2024-09-19T09:36:10.841641+0000","last_unstale":"2024-09-19T09:36:13.972053+0000","last_undegraded":"2024-09-19T09:36:13.972053+0000","last_fullsized":"2024-09-19T09:36:13.972053+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:10.477879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.978167+0000","last_change":"2024-09-19T09:36:12.981486+0000","last_active":"2024-09-19T09:36:13.978167+0000","last_peered":"2024-09-19T09:36:13.978167+0000","last_clean":"2024-09-19T09:36:13.978167+0000","last_became_active":"2024-09-19T09:36:12.981165+0000","last_became_peered":"2024-09-19T09:36:12.981165+0000","last_unstale":"2024-09-19T09:36:13.978167+0000","last_undegraded":"2024-09-19T09:36:13.978167+0000","last_fullsized":"2024-09-19T09:36:13.978167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:21.986132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.982877+0000","last_change":"2024-09-19T09:36:10.845362+0000","last_active":"2024-09-19T09:36:13.982877+0000","last_peered":"2024-09-19T09:36:13.982877+0000","last_clean":"2024-09-19T09:36:13.982877+0000","last_became_active":"2024-09-19T09:36:10.844992+0000","last_became_peered":"2024-09-19T09:36:10.844992+0000","last_unstale":"2024-09-19T09:36:13.982877+0000","last_undegraded":"2024-09-19T09:36:13.982877+0000","last_fullsized":"2024-09-19T09:36:13.982877+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:52.854333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980323+0000","last_change":"2024-09-19T09:36:12.988924+0000","last_active":"2024-09-19T09:36:13.980323+0000","last_peered":"2024-09-19T09:36:13.980323+0000","last_clean":"2024-09-19T09:36:13.980323+0000","last_became_active":"2024-09-19T09:36:12.988331+0000","last_became_peered":"2024-09-19T09:36:12.988331+0000","last_unstale":"2024-09-19T09:36:13.980323+0000","last_undegraded":"2024-09-19T09:36:13.980323+0000","last_fullsized":"2024-09-19T09:36:13.980323+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:24.754252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.986823+0000","last_change":"2024-09-19T09:36:10.860003+0000","last_active":"2024-09-19T09:36:13.986823+0000","last_peered":"2024-09-19T09:36:13.986823+0000","last_clean":"2024-09-19T09:36:13.986823+0000","last_became_active":"2024-09-19T09:36:10.859584+0000","last_became_peered":"2024-09-19T09:36:10.859584+0000","last_unstale":"2024-09-19T09:36:13.986823+0000","last_undegraded":"2024-09-19T09:36:13.986823+0000","last_fullsized":"2024-09-19T09:36:13.986823+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:44.837960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977224+0000","last_change":"2024-09-19T09:36:12.985446+0000","last_active":"2024-09-19T09:36:13.977224+0000","last_peered":"2024-09-19T09:36:13.977224+0000","last_clean":"2024-09-19T09:36:13.977224+0000","last_became_active":"2024-09-19T09:36:12.984671+0000","last_became_peered":"2024-09-19T09:36:12.984671+0000","last_unstale":"2024-09-19T09:36:13.977224+0000","last_undegraded":"2024-09-19T09:36:13.977224+0000","last_fullsized":"2024-09-19T09:36:13.977224+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:54.800151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'25","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:36.037745+0000","last_change":"2024-09-19T09:36:10.841056+0000","last_active":"2024-09-19T09:36:36.037745+0000","last_peered":"2024-09-19T09:36:36.037745+0000","last_clean":"2024-09-19T09:36:36.037745+0000","last_became_active":"2024-09-19T09:36:10.840731+0000","last_became_peered":"2024-09-19T09:36:10.840731+0000","last_unstale":"2024-09-19T09:36:36.037745+0000","last_undegraded":"2024-09-19T09:36:36.037745+0000","last_fullsized":"2024-09-19T09:36:36.037745+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:13.676188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53167,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":37,"num_read_kb":69,"num_write":25,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.981591+0000","last_change":"2024-09-19T09:36:12.990223+0000","last_active":"2024-09-19T09:36:13.981591+0000","last_peered":"2024-09-19T09:36:13.981591+0000","last_clean":"2024-09-19T09:36:13.981591+0000","last_became_active":"2024-09-19T09:36:12.989720+0000","last_became_peered":"2024-09-19T09:36:12.989720+0000","last_unstale":"2024-09-19T09:36:13.981591+0000","last_undegraded":"2024-09-19T09:36:13.981591+0000","last_fullsized":"2024-09-19T09:36:13.981591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:37.003075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:14.496063+0000","last_change":"2024-09-19T09:36:10.843288+0000","last_active":"2024-09-19T09:36:14.496063+0000","last_peered":"2024-09-19T09:36:14.496063+0000","last_clean":"2024-09-19T09:36:14.496063+0000","last_became_active":"2024-09-19T09:36:10.842844+0000","last_became_peered":"2024-09-19T09:36:10.842844+0000","last_unstale":"2024-09-19T09:36:14.496063+0000","last_undegraded":"2024-09-19T09:36:14.496063+0000","last_fullsized":"2024-09-19T09:36:14.496063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:38.695411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.970737+0000","last_change":"2024-09-19T09:36:12.981251+0000","last_active":"2024-09-19T09:36:13.970737+0000","last_peered":"2024-09-19T09:36:13.970737+0000","last_clean":"2024-09-19T09:36:13.970737+0000","last_became_active":"2024-09-19T09:36:12.980861+0000","last_became_peered":"2024-09-19T09:36:12.980861+0000","last_unstale":"2024-09-19T09:36:13.970737+0000","last_undegraded":"2024-09-19T09:36:13.970737+0000","last_fullsized":"2024-09-19T09:36:13.970737+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:09.633644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.982414+0000","last_change":"2024-09-19T09:36:10.843448+0000","last_active":"2024-09-19T09:36:13.982414+0000","last_peered":"2024-09-19T09:36:13.982414+0000","last_clean":"2024-09-19T09:36:13.982414+0000","last_became_active":"2024-09-19T09:36:10.843087+0000","last_became_peered":"2024-09-19T09:36:10.843087+0000","last_unstale":"2024-09-19T09:36:13.982414+0000","last_undegraded":"2024-09-19T09:36:13.982414+0000","last_fullsized":"2024-09-19T09:36:13.982414+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:20.623613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.982971+0000","last_change":"2024-09-19T09:36:12.981160+0000","last_active":"2024-09-19T09:36:13.982971+0000","last_peered":"2024-09-19T09:36:13.982971+0000","last_clean":"2024-09-19T09:36:13.982971+0000","last_became_active":"2024-09-19T09:36:12.980823+0000","last_became_peered":"2024-09-19T09:36:12.980823+0000","last_unstale":"2024-09-19T09:36:13.982971+0000","last_undegraded":"2024-09-19T09:36:13.982971+0000","last_fullsized":"2024-09-19T09:36:13.982971+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:39.323439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980537+0000","last_change":"2024-09-19T09:36:10.842536+0000","last_active":"2024-09-19T09:36:13.980537+0000","last_peered":"2024-09-19T09:36:13.980537+0000","last_clean":"2024-09-19T09:36:13.980537+0000","last_became_active":"2024-09-19T09:36:10.842176+0000","last_became_peered":"2024-09-19T09:36:10.842176+0000","last_unstale":"2024-09-19T09:36:13.980537+0000","last_undegraded":"2024-09-19T09:36:13.980537+0000","last_fullsized":"2024-09-19T09:36:13.980537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:37.871299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.982395+0000","last_change":"2024-09-19T09:36:12.987271+0000","last_active":"2024-09-19T09:36:13.982395+0000","last_peered":"2024-09-19T09:36:13.982395+0000","last_clean":"2024-09-19T09:36:13.982395+0000","last_became_active":"2024-09-19T09:36:12.986918+0000","last_became_peered":"2024-09-19T09:36:12.986918+0000","last_unstale":"2024-09-19T09:36:13.982395+0000","last_undegraded":"2024-09-19T09:36:13.982395+0000","last_fullsized":"2024-09-19T09:36:13.982395+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:07.608541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.989197+0000","last_change":"2024-09-19T09:36:10.860370+0000","last_active":"2024-09-19T09:36:13.989197+0000","last_peered":"2024-09-19T09:36:13.989197+0000","last_clean":"2024-09-19T09:36:13.989197+0000","last_became_active":"2024-09-19T09:36:10.859820+0000","last_became_peered":"2024-09-19T09:36:10.859820+0000","last_unstale":"2024-09-19T09:36:13.989197+0000","last_undegraded":"2024-09-19T09:36:13.989197+0000","last_fullsized":"2024-09-19T09:36:13.989197+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:12.121038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.984738+0000","last_change":"2024-09-19T09:36:12.994449+0000","last_active":"2024-09-19T09:36:13.984738+0000","last_peered":"2024-09-19T09:36:13.984738+0000","last_clean":"2024-09-19T09:36:13.984738+0000","last_became_active":"2024-09-19T09:36:12.994141+0000","last_became_peered":"2024-09-19T09:36:12.994141+0000","last_unstale":"2024-09-19T09:36:13.984738+0000","last_undegraded":"2024-09-19T09:36:13.984738+0000","last_fullsized":"2024-09-19T09:36:13.984738+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:21.416453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:14.710833+0000","last_change":"2024-09-19T09:36:10.839609+0000","last_active":"2024-09-19T09:36:14.710833+0000","last_peered":"2024-09-19T09:36:14.710833+0000","last_clean":"2024-09-19T09:36:14.710833+0000","last_became_active":"2024-09-19T09:36:10.839227+0000","last_became_peered":"2024-09-19T09:36:10.839227+0000","last_unstale":"2024-09-19T09:36:14.710833+0000","last_undegraded":"2024-09-19T09:36:14.710833+0000","last_fullsized":"2024-09-19T09:36:14.710833+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:00.734924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971232+0000","last_change":"2024-09-19T09:36:12.983573+0000","last_active":"2024-09-19T09:36:13.971232+0000","last_peered":"2024-09-19T09:36:13.971232+0000","last_clean":"2024-09-19T09:36:13.971232+0000","last_became_active":"2024-09-19T09:36:12.983241+0000","last_became_peered":"2024-09-19T09:36:12.983241+0000","last_unstale":"2024-09-19T09:36:13.971232+0000","last_undegraded":"2024-09-19T09:36:13.971232+0000","last_fullsized":"2024-09-19T09:36:13.971232+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:44.050271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.981922+0000","last_change":"2024-09-19T09:36:10.839789+0000","last_active":"2024-09-19T09:36:13.981922+0000","last_peered":"2024-09-19T09:36:13.981922+0000","last_clean":"2024-09-19T09:36:13.981922+0000","last_became_active":"2024-09-19T09:36:10.839445+0000","last_became_peered":"2024-09-19T09:36:10.839445+0000","last_unstale":"2024-09-19T09:36:13.981922+0000","last_undegraded":"2024-09-19T09:36:13.981922+0000","last_fullsized":"2024-09-19T09:36:13.981922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:16.040249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.984009+0000","last_change":"2024-09-19T09:36:12.993420+0000","last_active":"2024-09-19T09:36:13.984009+0000","last_peered":"2024-09-19T09:36:13.984009+0000","last_clean":"2024-09-19T09:36:13.984009+0000","last_became_active":"2024-09-19T09:36:12.992334+0000","last_became_peered":"2024-09-19T09:36:12.992334+0000","last_unstale":"2024-09-19T09:36:13.984009+0000","last_undegraded":"2024-09-19T09:36:13.984009+0000","last_fullsized":"2024-09-19T09:36:13.984009+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:21.693164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.987081+0000","last_change":"2024-09-19T09:36:10.839461+0000","last_active":"2024-09-19T09:36:13.987081+0000","last_peered":"2024-09-19T09:36:13.987081+0000","last_clean":"2024-09-19T09:36:13.987081+0000","last_became_active":"2024-09-19T09:36:10.839092+0000","last_became_peered":"2024-09-19T09:36:10.839092+0000","last_unstale":"2024-09-19T09:36:13.987081+0000","last_undegraded":"2024-09-19T09:36:13.987081+0000","last_fullsized":"2024-09-19T09:36:13.987081+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:02.367267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:14.080586+0000","last_change":"2024-09-19T09:36:12.988234+0000","last_active":"2024-09-19T09:36:14.080586+0000","last_peered":"2024-09-19T09:36:14.080586+0000","last_clean":"2024-09-19T09:36:14.080586+0000","last_became_active":"2024-09-19T09:36:12.987813+0000","last_became_peered":"2024-09-19T09:36:12.987813+0000","last_unstale":"2024-09-19T09:36:14.080586+0000","last_undegraded":"2024-09-19T09:36:14.080586+0000","last_fullsized":"2024-09-19T09:36:14.080586+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:56.024428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.981458+0000","last_change":"2024-09-19T09:36:10.945705+0000","last_active":"2024-09-19T09:36:13.981458+0000","last_peered":"2024-09-19T09:36:13.981458+0000","last_clean":"2024-09-19T09:36:13.981458+0000","last_became_active":"2024-09-19T09:36:10.945323+0000","last_became_peered":"2024-09-19T09:36:10.945323+0000","last_unstale":"2024-09-19T09:36:13.981458+0000","last_undegraded":"2024-09-19T09:36:13.981458+0000","last_fullsized":"2024-09-19T09:36:13.981458+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:24.211909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983646+0000","last_change":"2024-09-19T09:36:12.990517+0000","last_active":"2024-09-19T09:36:13.983646+0000","last_peered":"2024-09-19T09:36:13.983646+0000","last_clean":"2024-09-19T09:36:13.983646+0000","last_became_active":"2024-09-19T09:36:12.989291+0000","last_became_peered":"2024-09-19T09:36:12.989291+0000","last_unstale":"2024-09-19T09:36:13.983646+0000","last_undegraded":"2024-09-19T09:36:13.983646+0000","last_fullsized":"2024-09-19T09:36:13.983646+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:31.087798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":334,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.982963+0000","last_change":"2024-09-19T09:34:59.337025+0000","last_active":"2024-09-19T09:36:13.982963+0000","last_peered":"2024-09-19T09:36:13.982963+0000","last_clean":"2024-09-19T09:36:13.982963+0000","last_became_active":"2024-09-19T09:34:59.336556+0000","last_became_peered":"2024-09-19T09:34:59.336556+0000","last_unstale":"2024-09-19T09:36:13.982963+0000","last_undegraded":"2024-09-19T09:36:13.982963+0000","last_fullsized":"2024-09-19T09:36:13.982963+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:31:30.566923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:31:30.566923+0000","last_clean_scrub_stamp":"2024-09-19T09:31:30.566923+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:00.675254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980632+0000","last_change":"2024-09-19T09:36:10.838131+0000","last_active":"2024-09-19T09:36:13.980632+0000","last_peered":"2024-09-19T09:36:13.980632+0000","last_clean":"2024-09-19T09:36:13.980632+0000","last_became_active":"2024-09-19T09:36:10.837725+0000","last_became_peered":"2024-09-19T09:36:10.837725+0000","last_unstale":"2024-09-19T09:36:13.980632+0000","last_undegraded":"2024-09-19T09:36:13.980632+0000","last_fullsized":"2024-09-19T09:36:13.980632+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:57.104726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977566+0000","last_change":"2024-09-19T09:36:12.981951+0000","last_active":"2024-09-19T09:36:13.977566+0000","last_peered":"2024-09-19T09:36:13.977566+0000","last_clean":"2024-09-19T09:36:13.977566+0000","last_became_active":"2024-09-19T09:36:12.981558+0000","last_became_peered":"2024-09-19T09:36:12.981558+0000","last_unstale":"2024-09-19T09:36:13.977566+0000","last_undegraded":"2024-09-19T09:36:13.977566+0000","last_fullsized":"2024-09-19T09:36:13.977566+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:31.119853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983301+0000","last_change":"2024-09-19T09:36:10.843574+0000","last_active":"2024-09-19T09:36:13.983301+0000","last_peered":"2024-09-19T09:36:13.983301+0000","last_clean":"2024-09-19T09:36:13.983301+0000","last_became_active":"2024-09-19T09:36:10.843252+0000","last_became_peered":"2024-09-19T09:36:10.843252+0000","last_unstale":"2024-09-19T09:36:13.983301+0000","last_undegraded":"2024-09-19T09:36:13.983301+0000","last_fullsized":"2024-09-19T09:36:13.983301+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:10.492812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.970701+0000","last_change":"2024-09-19T09:36:12.984538+0000","last_active":"2024-09-19T09:36:13.970701+0000","last_peered":"2024-09-19T09:36:13.970701+0000","last_clean":"2024-09-19T09:36:13.970701+0000","last_became_active":"2024-09-19T09:36:12.983448+0000","last_became_peered":"2024-09-19T09:36:12.983448+0000","last_unstale":"2024-09-19T09:36:13.970701+0000","last_undegraded":"2024-09-19T09:36:13.970701+0000","last_fullsized":"2024-09-19T09:36:13.970701+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:48.294473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.970841+0000","last_change":"2024-09-19T09:36:10.858959+0000","last_active":"2024-09-19T09:36:13.970841+0000","last_peered":"2024-09-19T09:36:13.970841+0000","last_clean":"2024-09-19T09:36:13.970841+0000","last_became_active":"2024-09-19T09:36:10.858638+0000","last_became_peered":"2024-09-19T09:36:10.858638+0000","last_unstale":"2024-09-19T09:36:13.970841+0000","last_undegraded":"2024-09-19T09:36:13.970841+0000","last_fullsized":"2024-09-19T09:36:13.970841+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:12.646483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.984042+0000","last_change":"2024-09-19T09:36:12.992710+0000","last_active":"2024-09-19T09:36:13.984042+0000","last_peered":"2024-09-19T09:36:13.984042+0000","last_clean":"2024-09-19T09:36:13.984042+0000","last_became_active":"2024-09-19T09:36:12.992436+0000","last_became_peered":"2024-09-19T09:36:12.992436+0000","last_unstale":"2024-09-19T09:36:13.984042+0000","last_undegraded":"2024-09-19T09:36:13.984042+0000","last_fullsized":"2024-09-19T09:36:13.984042+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:51.685516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983385+0000","last_change":"2024-09-19T09:36:10.842031+0000","last_active":"2024-09-19T09:36:13.983385+0000","last_peered":"2024-09-19T09:36:13.983385+0000","last_clean":"2024-09-19T09:36:13.983385+0000","last_became_active":"2024-09-19T09:36:10.841693+0000","last_became_peered":"2024-09-19T09:36:10.841693+0000","last_unstale":"2024-09-19T09:36:13.983385+0000","last_undegraded":"2024-09-19T09:36:13.983385+0000","last_fullsized":"2024-09-19T09:36:13.983385+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:28:51.040551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971661+0000","last_change":"2024-09-19T09:36:12.995510+0000","last_active":"2024-09-19T09:36:13.971661+0000","last_peered":"2024-09-19T09:36:13.971661+0000","last_clean":"2024-09-19T09:36:13.971661+0000","last_became_active":"2024-09-19T09:36:12.995128+0000","last_became_peered":"2024-09-19T09:36:12.995128+0000","last_unstale":"2024-09-19T09:36:13.971661+0000","last_undegraded":"2024-09-19T09:36:13.971661+0000","last_fullsized":"2024-09-19T09:36:13.971661+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:27.955678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979849+0000","last_change":"2024-09-19T09:36:10.860470+0000","last_active":"2024-09-19T09:36:13.979849+0000","last_peered":"2024-09-19T09:36:13.979849+0000","last_clean":"2024-09-19T09:36:13.979849+0000","last_became_active":"2024-09-19T09:36:10.860097+0000","last_became_peered":"2024-09-19T09:36:10.860097+0000","last_unstale":"2024-09-19T09:36:13.979849+0000","last_undegraded":"2024-09-19T09:36:13.979849+0000","last_fullsized":"2024-09-19T09:36:13.979849+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:14.933378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:16.106609+0000","last_change":"2024-09-19T09:36:12.988489+0000","last_active":"2024-09-19T09:36:16.106609+0000","last_peered":"2024-09-19T09:36:16.106609+0000","last_clean":"2024-09-19T09:36:16.106609+0000","last_became_active":"2024-09-19T09:36:12.988151+0000","last_became_peered":"2024-09-19T09:36:12.988151+0000","last_unstale":"2024-09-19T09:36:16.106609+0000","last_undegraded":"2024-09-19T09:36:16.106609+0000","last_fullsized":"2024-09-19T09:36:16.106609+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:24.088771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.981909+0000","last_change":"2024-09-19T09:36:10.860103+0000","last_active":"2024-09-19T09:36:13.981909+0000","last_peered":"2024-09-19T09:36:13.981909+0000","last_clean":"2024-09-19T09:36:13.981909+0000","last_became_active":"2024-09-19T09:36:10.859526+0000","last_became_peered":"2024-09-19T09:36:10.859526+0000","last_unstale":"2024-09-19T09:36:13.981909+0000","last_undegraded":"2024-09-19T09:36:13.981909+0000","last_fullsized":"2024-09-19T09:36:13.981909+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:25.460372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971039+0000","last_change":"2024-09-19T09:36:12.986286+0000","last_active":"2024-09-19T09:36:13.971039+0000","last_peered":"2024-09-19T09:36:13.971039+0000","last_clean":"2024-09-19T09:36:13.971039+0000","last_became_active":"2024-09-19T09:36:12.985982+0000","last_became_peered":"2024-09-19T09:36:12.985982+0000","last_unstale":"2024-09-19T09:36:13.971039+0000","last_undegraded":"2024-09-19T09:36:13.971039+0000","last_fullsized":"2024-09-19T09:36:13.971039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:19.026134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'8","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:33.978313+0000","last_change":"2024-09-19T09:36:10.839280+0000","last_active":"2024-09-19T09:36:33.978313+0000","last_peered":"2024-09-19T09:36:33.978313+0000","last_clean":"2024-09-19T09:36:33.978313+0000","last_became_active":"2024-09-19T09:36:10.838979+0000","last_became_peered":"2024-09-19T09:36:10.838979+0000","last_unstale":"2024-09-19T09:36:33.978313+0000","last_undegraded":"2024-09-19T09:36:33.978313+0000","last_fullsized":"2024-09-19T09:36:33.978313+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:06.303175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977725+0000","last_change":"2024-09-19T09:36:12.979778+0000","last_active":"2024-09-19T09:36:13.977725+0000","last_peered":"2024-09-19T09:36:13.977725+0000","last_clean":"2024-09-19T09:36:13.977725+0000","last_became_active":"2024-09-19T09:36:12.979455+0000","last_became_peered":"2024-09-19T09:36:12.979455+0000","last_unstale":"2024-09-19T09:36:13.977725+0000","last_undegraded":"2024-09-19T09:36:13.977725+0000","last_fullsized":"2024-09-19T09:36:13.977725+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:36.620368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983429+0000","last_change":"2024-09-19T09:36:10.945706+0000","last_active":"2024-09-19T09:36:13.983429+0000","last_peered":"2024-09-19T09:36:13.983429+0000","last_clean":"2024-09-19T09:36:13.983429+0000","last_became_active":"2024-09-19T09:36:10.945314+0000","last_became_peered":"2024-09-19T09:36:10.945314+0000","last_unstale":"2024-09-19T09:36:13.983429+0000","last_undegraded":"2024-09-19T09:36:13.983429+0000","last_fullsized":"2024-09-19T09:36:13.983429+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:49.786913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979575+0000","last_change":"2024-09-19T09:36:12.989412+0000","last_active":"2024-09-19T09:36:13.979575+0000","last_peered":"2024-09-19T09:36:13.979575+0000","last_clean":"2024-09-19T09:36:13.979575+0000","last_became_active":"2024-09-19T09:36:12.989109+0000","last_became_peered":"2024-09-19T09:36:12.989109+0000","last_unstale":"2024-09-19T09:36:13.979575+0000","last_undegraded":"2024-09-19T09:36:13.979575+0000","last_fullsized":"2024-09-19T09:36:13.979575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:33.142592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977297+0000","last_change":"2024-09-19T09:36:10.858581+0000","last_active":"2024-09-19T09:36:13.977297+0000","last_peered":"2024-09-19T09:36:13.977297+0000","last_clean":"2024-09-19T09:36:13.977297+0000","last_became_active":"2024-09-19T09:36:10.858240+0000","last_became_peered":"2024-09-19T09:36:10.858240+0000","last_unstale":"2024-09-19T09:36:13.977297+0000","last_undegraded":"2024-09-19T09:36:13.977297+0000","last_fullsized":"2024-09-19T09:36:13.977297+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:45.285839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979917+0000","last_change":"2024-09-19T09:36:12.989075+0000","last_active":"2024-09-19T09:36:13.979917+0000","last_peered":"2024-09-19T09:36:13.979917+0000","last_clean":"2024-09-19T09:36:13.979917+0000","last_became_active":"2024-09-19T09:36:12.988752+0000","last_became_peered":"2024-09-19T09:36:12.988752+0000","last_unstale":"2024-09-19T09:36:13.979917+0000","last_undegraded":"2024-09-19T09:36:13.979917+0000","last_fullsized":"2024-09-19T09:36:13.979917+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.424032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977294+0000","last_change":"2024-09-19T09:36:10.838716+0000","last_active":"2024-09-19T09:36:13.977294+0000","last_peered":"2024-09-19T09:36:13.977294+0000","last_clean":"2024-09-19T09:36:13.977294+0000","last_became_active":"2024-09-19T09:36:10.838393+0000","last_became_peered":"2024-09-19T09:36:10.838393+0000","last_unstale":"2024-09-19T09:36:13.977294+0000","last_undegraded":"2024-09-19T09:36:13.977294+0000","last_fullsized":"2024-09-19T09:36:13.977294+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:54.107223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971121+0000","last_change":"2024-09-19T09:36:12.991721+0000","last_active":"2024-09-19T09:36:13.971121+0000","last_peered":"2024-09-19T09:36:13.971121+0000","last_clean":"2024-09-19T09:36:13.971121+0000","last_became_active":"2024-09-19T09:36:12.991398+0000","last_became_peered":"2024-09-19T09:36:12.991398+0000","last_unstale":"2024-09-19T09:36:13.971121+0000","last_undegraded":"2024-09-19T09:36:13.971121+0000","last_fullsized":"2024-09-19T09:36:13.971121+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:19:31.312072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979724+0000","last_change":"2024-09-19T09:36:10.839625+0000","last_active":"2024-09-19T09:36:13.979724+0000","last_peered":"2024-09-19T09:36:13.979724+0000","last_clean":"2024-09-19T09:36:13.979724+0000","last_became_active":"2024-09-19T09:36:10.839255+0000","last_became_peered":"2024-09-19T09:36:10.839255+0000","last_unstale":"2024-09-19T09:36:13.979724+0000","last_undegraded":"2024-09-19T09:36:13.979724+0000","last_fullsized":"2024-09-19T09:36:13.979724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:37.221951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977214+0000","last_change":"2024-09-19T09:36:12.984180+0000","last_active":"2024-09-19T09:36:13.977214+0000","last_peered":"2024-09-19T09:36:13.977214+0000","last_clean":"2024-09-19T09:36:13.977214+0000","last_became_active":"2024-09-19T09:36:12.983876+0000","last_became_peered":"2024-09-19T09:36:12.983876+0000","last_unstale":"2024-09-19T09:36:13.977214+0000","last_undegraded":"2024-09-19T09:36:13.977214+0000","last_fullsized":"2024-09-19T09:36:13.977214+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:45.876771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:14.710787+0000","last_change":"2024-09-19T09:36:10.845391+0000","last_active":"2024-09-19T09:36:14.710787+0000","last_peered":"2024-09-19T09:36:14.710787+0000","last_clean":"2024-09-19T09:36:14.710787+0000","last_became_active":"2024-09-19T09:36:10.844974+0000","last_became_peered":"2024-09-19T09:36:10.844974+0000","last_unstale":"2024-09-19T09:36:14.710787+0000","last_undegraded":"2024-09-19T09:36:14.710787+0000","last_fullsized":"2024-09-19T09:36:14.710787+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:00.318337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983307+0000","last_change":"2024-09-19T09:36:12.991145+0000","last_active":"2024-09-19T09:36:13.983307+0000","last_peered":"2024-09-19T09:36:13.983307+0000","last_clean":"2024-09-19T09:36:13.983307+0000","last_became_active":"2024-09-19T09:36:12.989891+0000","last_became_peered":"2024-09-19T09:36:12.989891+0000","last_unstale":"2024-09-19T09:36:13.983307+0000","last_undegraded":"2024-09-19T09:36:13.983307+0000","last_fullsized":"2024-09-19T09:36:13.983307+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:21.054936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.982316+0000","last_change":"2024-09-19T09:36:12.995378+0000","last_active":"2024-09-19T09:36:13.982316+0000","last_peered":"2024-09-19T09:36:13.982316+0000","last_clean":"2024-09-19T09:36:13.982316+0000","last_became_active":"2024-09-19T09:36:12.995028+0000","last_became_peered":"2024-09-19T09:36:12.995028+0000","last_unstale":"2024-09-19T09:36:13.982316+0000","last_undegraded":"2024-09-19T09:36:13.982316+0000","last_fullsized":"2024-09-19T09:36:13.982316+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:41.102130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.987910+0000","last_change":"2024-09-19T09:36:10.839595+0000","last_active":"2024-09-19T09:36:13.987910+0000","last_peered":"2024-09-19T09:36:13.987910+0000","last_clean":"2024-09-19T09:36:13.987910+0000","last_became_active":"2024-09-19T09:36:10.839196+0000","last_became_peered":"2024-09-19T09:36:10.839196+0000","last_unstale":"2024-09-19T09:36:13.987910+0000","last_undegraded":"2024-09-19T09:36:13.987910+0000","last_fullsized":"2024-09-19T09:36:13.987910+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:02.272731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977120+0000","last_change":"2024-09-19T09:36:12.984485+0000","last_active":"2024-09-19T09:36:13.977120+0000","last_peered":"2024-09-19T09:36:13.977120+0000","last_clean":"2024-09-19T09:36:13.977120+0000","last_became_active":"2024-09-19T09:36:12.984004+0000","last_became_peered":"2024-09-19T09:36:12.984004+0000","last_unstale":"2024-09-19T09:36:13.977120+0000","last_undegraded":"2024-09-19T09:36:13.977120+0000","last_fullsized":"2024-09-19T09:36:13.977120+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:37.646776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.988493+0000","last_change":"2024-09-19T09:36:10.845306+0000","last_active":"2024-09-19T09:36:13.988493+0000","last_peered":"2024-09-19T09:36:13.988493+0000","last_clean":"2024-09-19T09:36:13.988493+0000","last_became_active":"2024-09-19T09:36:10.844952+0000","last_became_peered":"2024-09-19T09:36:10.844952+0000","last_unstale":"2024-09-19T09:36:13.988493+0000","last_undegraded":"2024-09-19T09:36:13.988493+0000","last_fullsized":"2024-09-19T09:36:13.988493+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:09.792482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980247+0000","last_change":"2024-09-19T09:36:12.991260+0000","last_active":"2024-09-19T09:36:13.980247+0000","last_peered":"2024-09-19T09:36:13.980247+0000","last_clean":"2024-09-19T09:36:13.980247+0000","last_became_active":"2024-09-19T09:36:12.989981+0000","last_became_peered":"2024-09-19T09:36:12.989981+0000","last_unstale":"2024-09-19T09:36:13.980247+0000","last_undegraded":"2024-09-19T09:36:13.980247+0000","last_fullsized":"2024-09-19T09:36:13.980247+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:11.301790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977625+0000","last_change":"2024-09-19T09:36:10.859016+0000","last_active":"2024-09-19T09:36:13.977625+0000","last_peered":"2024-09-19T09:36:13.977625+0000","last_clean":"2024-09-19T09:36:13.977625+0000","last_became_active":"2024-09-19T09:36:10.858661+0000","last_became_peered":"2024-09-19T09:36:10.858661+0000","last_unstale":"2024-09-19T09:36:13.977625+0000","last_undegraded":"2024-09-19T09:36:13.977625+0000","last_fullsized":"2024-09-19T09:36:13.977625+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:54.395977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977465+0000","last_change":"2024-09-19T09:36:12.987989+0000","last_active":"2024-09-19T09:36:13.977465+0000","last_peered":"2024-09-19T09:36:13.977465+0000","last_clean":"2024-09-19T09:36:13.977465+0000","last_became_active":"2024-09-19T09:36:12.987615+0000","last_became_peered":"2024-09-19T09:36:12.987615+0000","last_unstale":"2024-09-19T09:36:13.977465+0000","last_undegraded":"2024-09-19T09:36:13.977465+0000","last_fullsized":"2024-09-19T09:36:13.977465+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:01.853678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.988121+0000","last_change":"2024-09-19T09:36:10.840593+0000","last_active":"2024-09-19T09:36:13.988121+0000","last_peered":"2024-09-19T09:36:13.988121+0000","last_clean":"2024-09-19T09:36:13.988121+0000","last_became_active":"2024-09-19T09:36:10.840233+0000","last_became_peered":"2024-09-19T09:36:10.840233+0000","last_unstale":"2024-09-19T09:36:13.988121+0000","last_undegraded":"2024-09-19T09:36:13.988121+0000","last_fullsized":"2024-09-19T09:36:13.988121+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:16.986234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":53965,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":43,"num_read_kb":75,"num_write":78,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":161895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65,"ondisk_log_size":65,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282954,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547217,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":872448,"data_stored":423919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776151,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":999424,"data_stored":1067765,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972380,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36200,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708952,"statfs":{"total":95995035648,"available":95957966848,"internally_reserved":0,"allocated":876544,"data_stored":424501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201312,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":424523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430246,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":1014986,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593771,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36200,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708952,"statfs":{"total":95995035648,"available":95957966848,"internally_reserved":0,"allocated":876544,"data_stored":424036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822704,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":1014586,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953525,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":876544,"data_stored":423941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215163,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":888832,"data_stored":424257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444095,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36260,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708892,"statfs":{"total":95995035648,"available":95957905408,"internally_reserved":0,"allocated":937984,"data_stored":477120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":933888,"data_stored":477086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":876544,"data_stored":424009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":53167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":53201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":53361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:36:38.628 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:36:38.884 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:39.289 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:39 smithi001 ceph-mon[31225]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:36:39.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:39 smithi022 ceph-mon[35583]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:36:39.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:39 smithi121 ceph-mon[35577]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:36:39.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.370+0000 7f15939e5640 1 -- 172.21.15.1:0/3436943368 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f158c1036e0 msgr2=0x7f158c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:39.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.370+0000 7f15939e5640 1 --2- 172.21.15.1:0/3436943368 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f158c1036e0 0x7f158c107b90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f157c009930 tx=0x7f157c02a420 comp rx=0 tx=0).stop 2024-09-19T09:36:39.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.370+0000 7f15939e5640 1 -- 172.21.15.1:0/3436943368 shutdown_connections 2024-09-19T09:36:39.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.370+0000 7f15939e5640 1 --2- 172.21.15.1:0/3436943368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f158c1082a0 0x7f158c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:39.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.370+0000 7f15939e5640 1 --2- 172.21.15.1:0/3436943368 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f158c1036e0 0x7f158c107b90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:39.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.370+0000 7f15939e5640 1 --2- 172.21.15.1:0/3436943368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f158c102d30 0x7f158c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:39.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.370+0000 7f15939e5640 1 -- 172.21.15.1:0/3436943368 >> 172.21.15.1:0/3436943368 conn(0x7f158c0fc7d0 msgr2=0x7f158c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:39.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.370+0000 7f15939e5640 1 -- 172.21.15.1:0/3436943368 shutdown_connections 2024-09-19T09:36:39.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.370+0000 7f15939e5640 1 -- 172.21.15.1:0/3436943368 wait complete. 2024-09-19T09:36:39.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.371+0000 7f15939e5640 1 Processor -- start 2024-09-19T09:36:39.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.371+0000 7f15939e5640 1 -- start start 2024-09-19T09:36:39.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.371+0000 7f15939e5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f158c102d30 0x7f158c1986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:39.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.371+0000 7f15939e5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f158c1036e0 0x7f158c198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:39.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.371+0000 7f15939e5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f158c1082a0 0x7f158c19cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:39.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.371+0000 7f15939e5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f158c1120c0 con 0x7f158c1082a0 2024-09-19T09:36:39.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.371+0000 7f15939e5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f158c111f40 con 0x7f158c102d30 2024-09-19T09:36:39.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.371+0000 7f15939e5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f158c112240 con 0x7f158c1036e0 2024-09-19T09:36:39.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.371+0000 7f1591f82640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f158c1082a0 0x7f158c19cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:39.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.371+0000 7f1591f82640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f158c1082a0 0x7f158c19cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46304/0 (socket says 172.21.15.1:46304) 2024-09-19T09:36:39.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.371+0000 7f1591f82640 1 -- 172.21.15.1:0/3397460496 learned_addr learned my addr 172.21.15.1:0/3397460496 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:39.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.371+0000 7f1591781640 1 --2- 172.21.15.1:0/3397460496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f158c102d30 0x7f158c1986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:39.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.371+0000 7f1590f80640 1 --2- 172.21.15.1:0/3397460496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f158c1036e0 0x7f158c198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:39.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.371+0000 7f1591f82640 1 -- 172.21.15.1:0/3397460496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f158c1036e0 msgr2=0x7f158c198c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:39.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.371+0000 7f1591f82640 1 --2- 172.21.15.1:0/3397460496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f158c1036e0 0x7f158c198c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:39.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.371+0000 7f1591f82640 1 -- 172.21.15.1:0/3397460496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f158c102d30 msgr2=0x7f158c1986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:39.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.371+0000 7f1591f82640 1 --2- 172.21.15.1:0/3397460496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f158c102d30 0x7f158c1986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:39.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.371+0000 7f1591f82640 1 -- 172.21.15.1:0/3397460496 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f158c19d670 con 0x7f158c1082a0 2024-09-19T09:36:39.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.372+0000 7f1591f82640 1 --2- 172.21.15.1:0/3397460496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f158c1082a0 0x7f158c19cf90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f158400eaa0 tx=0x7f158400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:39.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.372+0000 7f15827fc640 1 -- 172.21.15.1:0/3397460496 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1584004d20 con 0x7f158c1082a0 2024-09-19T09:36:39.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.372+0000 7f15827fc640 1 -- 172.21.15.1:0/3397460496 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1584005020 con 0x7f158c1082a0 2024-09-19T09:36:39.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.372+0000 7f15939e5640 1 -- 172.21.15.1:0/3397460496 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f158c19d960 con 0x7f158c1082a0 2024-09-19T09:36:39.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.372+0000 7f15827fc640 1 -- 172.21.15.1:0/3397460496 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15840116d0 con 0x7f158c1082a0 2024-09-19T09:36:39.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.372+0000 7f15939e5640 1 -- 172.21.15.1:0/3397460496 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f158c1a5240 con 0x7f158c1082a0 2024-09-19T09:36:39.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.373+0000 7f15939e5640 1 -- 172.21.15.1:0/3397460496 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f158c103110 con 0x7f158c1082a0 2024-09-19T09:36:39.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.374+0000 7f15827fc640 1 -- 172.21.15.1:0/3397460496 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f15840051d0 con 0x7f158c1082a0 2024-09-19T09:36:39.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.375+0000 7f15827fc640 1 --2- 172.21.15.1:0/3397460496 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f15780a3350 0x7f15780a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:39.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.375+0000 7f1591781640 1 --2- 172.21.15.1:0/3397460496 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f15780a3350 0x7f15780a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:39.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.375+0000 7f15827fc640 1 -- 172.21.15.1:0/3397460496 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f15840cfa50 con 0x7f158c1082a0 2024-09-19T09:36:39.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.375+0000 7f1591781640 1 --2- 172.21.15.1:0/3397460496 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f15780a3350 0x7f15780a5810 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1588009990 tx=0x7f1588009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:39.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.379+0000 7f15827fc640 1 -- 172.21.15.1:0/3397460496 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1584016030 con 0x7f158c1082a0 2024-09-19T09:36:39.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.552+0000 7f15939e5640 1 -- 172.21.15.1:0/3397460496 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f158c062630 con 0x7f15780a3350 2024-09-19T09:36:39.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.559+0000 7f15827fc640 1 -- 172.21.15.1:0/3397460496 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258791 (secure 0 0 0) 0x7f158c062630 con 0x7f15780a3350 2024-09-19T09:36:39.562 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:36:39.563 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-19T09:36:39.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.562+0000 7f15939e5640 1 -- 172.21.15.1:0/3397460496 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f15780a3350 msgr2=0x7f15780a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:39.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.562+0000 7f15939e5640 1 --2- 172.21.15.1:0/3397460496 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f15780a3350 0x7f15780a5810 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1588009990 tx=0x7f1588009110 comp rx=0 tx=0).stop 2024-09-19T09:36:39.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.562+0000 7f15939e5640 1 -- 172.21.15.1:0/3397460496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f158c1082a0 msgr2=0x7f158c19cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:39.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.562+0000 7f15939e5640 1 --2- 172.21.15.1:0/3397460496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f158c1082a0 0x7f158c19cf90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f158400eaa0 tx=0x7f158400eea0 comp rx=0 tx=0).stop 2024-09-19T09:36:39.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.562+0000 7f15939e5640 1 -- 172.21.15.1:0/3397460496 shutdown_connections 2024-09-19T09:36:39.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.562+0000 7f15939e5640 1 --2- 172.21.15.1:0/3397460496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f158c1082a0 0x7f158c19cf90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:39.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.562+0000 7f15939e5640 1 --2- 172.21.15.1:0/3397460496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f158c1036e0 0x7f158c198c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:39.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.562+0000 7f15939e5640 1 --2- 172.21.15.1:0/3397460496 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f15780a3350 0x7f15780a5810 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:39.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.562+0000 7f15939e5640 1 --2- 172.21.15.1:0/3397460496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f158c102d30 0x7f158c1986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:39.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.562+0000 7f15939e5640 1 -- 172.21.15.1:0/3397460496 >> 172.21.15.1:0/3397460496 conn(0x7f158c0fc7d0 msgr2=0x7f158c106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:39.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.562+0000 7f15939e5640 1 -- 172.21.15.1:0/3397460496 shutdown_connections 2024-09-19T09:36:39.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:39.562+0000 7f15939e5640 1 -- 172.21.15.1:0/3397460496 wait complete. 2024-09-19T09:36:40.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:40 smithi001 ceph-mon[31225]: pgmap v293: 97 pgs: 97 active+clean; 629 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2024-09-19T09:36:40.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:40 smithi022 ceph-mon[35583]: pgmap v293: 97 pgs: 97 active+clean; 629 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2024-09-19T09:36:40.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:40 smithi121 ceph-mon[35577]: pgmap v293: 97 pgs: 97 active+clean; 629 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2024-09-19T09:36:40.406 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":293,"stamp":"2024-09-19T09:36:38.135598+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644567,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":169,"num_read_kb":184,"num_write":261,"num_write_kb":3016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":405664,"kb_used_data":10632,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124536160,"statfs":{"total":1151940427776,"available":1151525027840,"internally_reserved":0,"allocated":10887168,"data_stored":7020729,"data_compressed":107955,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19141,"internal_metadata":404272443},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45187,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":55,"num_write":32,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003200"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971317+0000","last_change":"2024-09-19T09:36:12.985228+0000","last_active":"2024-09-19T09:36:13.971317+0000","last_peered":"2024-09-19T09:36:13.971317+0000","last_clean":"2024-09-19T09:36:13.971317+0000","last_became_active":"2024-09-19T09:36:12.984306+0000","last_became_peered":"2024-09-19T09:36:12.984306+0000","last_unstale":"2024-09-19T09:36:13.971317+0000","last_undegraded":"2024-09-19T09:36:13.971317+0000","last_fullsized":"2024-09-19T09:36:13.971317+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:45.988859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979575+0000","last_change":"2024-09-19T09:36:12.987631+0000","last_active":"2024-09-19T09:36:13.979575+0000","last_peered":"2024-09-19T09:36:13.979575+0000","last_clean":"2024-09-19T09:36:13.979575+0000","last_became_active":"2024-09-19T09:36:12.987298+0000","last_became_peered":"2024-09-19T09:36:12.987298+0000","last_unstale":"2024-09-19T09:36:13.979575+0000","last_undegraded":"2024-09-19T09:36:13.979575+0000","last_fullsized":"2024-09-19T09:36:13.979575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:47.397162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979729+0000","last_change":"2024-09-19T09:36:12.991466+0000","last_active":"2024-09-19T09:36:13.979729+0000","last_peered":"2024-09-19T09:36:13.979729+0000","last_clean":"2024-09-19T09:36:13.979729+0000","last_became_active":"2024-09-19T09:36:12.990903+0000","last_became_peered":"2024-09-19T09:36:12.990903+0000","last_unstale":"2024-09-19T09:36:13.979729+0000","last_undegraded":"2024-09-19T09:36:13.979729+0000","last_fullsized":"2024-09-19T09:36:13.979729+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:04.128768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980669+0000","last_change":"2024-09-19T09:36:12.986686+0000","last_active":"2024-09-19T09:36:13.980669+0000","last_peered":"2024-09-19T09:36:13.980669+0000","last_clean":"2024-09-19T09:36:13.980669+0000","last_became_active":"2024-09-19T09:36:12.986334+0000","last_became_peered":"2024-09-19T09:36:12.986334+0000","last_unstale":"2024-09-19T09:36:13.980669+0000","last_undegraded":"2024-09-19T09:36:13.980669+0000","last_fullsized":"2024-09-19T09:36:13.980669+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:39.926343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979886+0000","last_change":"2024-09-19T09:36:12.981964+0000","last_active":"2024-09-19T09:36:13.979886+0000","last_peered":"2024-09-19T09:36:13.979886+0000","last_clean":"2024-09-19T09:36:13.979886+0000","last_became_active":"2024-09-19T09:36:12.981558+0000","last_became_peered":"2024-09-19T09:36:12.981558+0000","last_unstale":"2024-09-19T09:36:13.979886+0000","last_undegraded":"2024-09-19T09:36:13.979886+0000","last_fullsized":"2024-09-19T09:36:13.979886+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:33.706451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971758+0000","last_change":"2024-09-19T09:36:12.992598+0000","last_active":"2024-09-19T09:36:13.971758+0000","last_peered":"2024-09-19T09:36:13.971758+0000","last_clean":"2024-09-19T09:36:13.971758+0000","last_became_active":"2024-09-19T09:36:12.992281+0000","last_became_peered":"2024-09-19T09:36:12.992281+0000","last_unstale":"2024-09-19T09:36:13.971758+0000","last_undegraded":"2024-09-19T09:36:13.971758+0000","last_fullsized":"2024-09-19T09:36:13.971758+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:26.107432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983518+0000","last_change":"2024-09-19T09:36:12.988583+0000","last_active":"2024-09-19T09:36:13.983518+0000","last_peered":"2024-09-19T09:36:13.983518+0000","last_clean":"2024-09-19T09:36:13.983518+0000","last_became_active":"2024-09-19T09:36:12.987895+0000","last_became_peered":"2024-09-19T09:36:12.987895+0000","last_unstale":"2024-09-19T09:36:13.983518+0000","last_undegraded":"2024-09-19T09:36:13.983518+0000","last_fullsized":"2024-09-19T09:36:13.983518+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:47.617324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977053+0000","last_change":"2024-09-19T09:36:12.988526+0000","last_active":"2024-09-19T09:36:13.977053+0000","last_peered":"2024-09-19T09:36:13.977053+0000","last_clean":"2024-09-19T09:36:13.977053+0000","last_became_active":"2024-09-19T09:36:12.988093+0000","last_became_peered":"2024-09-19T09:36:12.988093+0000","last_unstale":"2024-09-19T09:36:13.977053+0000","last_undegraded":"2024-09-19T09:36:13.977053+0000","last_fullsized":"2024-09-19T09:36:13.977053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:48.949397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977695+0000","last_change":"2024-09-19T09:36:12.992360+0000","last_active":"2024-09-19T09:36:13.977695+0000","last_peered":"2024-09-19T09:36:13.977695+0000","last_clean":"2024-09-19T09:36:13.977695+0000","last_became_active":"2024-09-19T09:36:12.991833+0000","last_became_peered":"2024-09-19T09:36:12.991833+0000","last_unstale":"2024-09-19T09:36:13.977695+0000","last_undegraded":"2024-09-19T09:36:13.977695+0000","last_fullsized":"2024-09-19T09:36:13.977695+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:47.715012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.972202+0000","last_change":"2024-09-19T09:36:12.993435+0000","last_active":"2024-09-19T09:36:13.972202+0000","last_peered":"2024-09-19T09:36:13.972202+0000","last_clean":"2024-09-19T09:36:13.972202+0000","last_became_active":"2024-09-19T09:36:12.993108+0000","last_became_peered":"2024-09-19T09:36:12.993108+0000","last_unstale":"2024-09-19T09:36:13.972202+0000","last_undegraded":"2024-09-19T09:36:13.972202+0000","last_fullsized":"2024-09-19T09:36:13.972202+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:54.453593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983462+0000","last_change":"2024-09-19T09:36:12.991044+0000","last_active":"2024-09-19T09:36:13.983462+0000","last_peered":"2024-09-19T09:36:13.983462+0000","last_clean":"2024-09-19T09:36:13.983462+0000","last_became_active":"2024-09-19T09:36:12.989955+0000","last_became_peered":"2024-09-19T09:36:12.989955+0000","last_unstale":"2024-09-19T09:36:13.983462+0000","last_undegraded":"2024-09-19T09:36:13.983462+0000","last_fullsized":"2024-09-19T09:36:13.983462+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:21.034023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980631+0000","last_change":"2024-09-19T09:36:12.989679+0000","last_active":"2024-09-19T09:36:13.980631+0000","last_peered":"2024-09-19T09:36:13.980631+0000","last_clean":"2024-09-19T09:36:13.980631+0000","last_became_active":"2024-09-19T09:36:12.988463+0000","last_became_peered":"2024-09-19T09:36:12.988463+0000","last_unstale":"2024-09-19T09:36:13.980631+0000","last_undegraded":"2024-09-19T09:36:13.980631+0000","last_fullsized":"2024-09-19T09:36:13.980631+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:28.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971006+0000","last_change":"2024-09-19T09:36:12.983494+0000","last_active":"2024-09-19T09:36:13.971006+0000","last_peered":"2024-09-19T09:36:13.971006+0000","last_clean":"2024-09-19T09:36:13.971006+0000","last_became_active":"2024-09-19T09:36:12.983143+0000","last_became_peered":"2024-09-19T09:36:12.983143+0000","last_unstale":"2024-09-19T09:36:13.971006+0000","last_undegraded":"2024-09-19T09:36:13.971006+0000","last_fullsized":"2024-09-19T09:36:13.971006+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:23.378183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980072+0000","last_change":"2024-09-19T09:36:12.987512+0000","last_active":"2024-09-19T09:36:13.980072+0000","last_peered":"2024-09-19T09:36:13.980072+0000","last_clean":"2024-09-19T09:36:13.980072+0000","last_became_active":"2024-09-19T09:36:12.987288+0000","last_became_peered":"2024-09-19T09:36:12.987288+0000","last_unstale":"2024-09-19T09:36:13.980072+0000","last_undegraded":"2024-09-19T09:36:13.980072+0000","last_fullsized":"2024-09-19T09:36:13.980072+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:14.614333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979944+0000","last_change":"2024-09-19T09:36:12.989725+0000","last_active":"2024-09-19T09:36:13.979944+0000","last_peered":"2024-09-19T09:36:13.979944+0000","last_clean":"2024-09-19T09:36:13.979944+0000","last_became_active":"2024-09-19T09:36:12.989229+0000","last_became_peered":"2024-09-19T09:36:12.989229+0000","last_unstale":"2024-09-19T09:36:13.979944+0000","last_undegraded":"2024-09-19T09:36:13.979944+0000","last_fullsized":"2024-09-19T09:36:13.979944+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:07.896864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977084+0000","last_change":"2024-09-19T09:36:12.988210+0000","last_active":"2024-09-19T09:36:13.977084+0000","last_peered":"2024-09-19T09:36:13.977084+0000","last_clean":"2024-09-19T09:36:13.977084+0000","last_became_active":"2024-09-19T09:36:12.987904+0000","last_became_peered":"2024-09-19T09:36:12.987904+0000","last_unstale":"2024-09-19T09:36:13.977084+0000","last_undegraded":"2024-09-19T09:36:13.977084+0000","last_fullsized":"2024-09-19T09:36:13.977084+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:13.588237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971389+0000","last_change":"2024-09-19T09:36:12.984028+0000","last_active":"2024-09-19T09:36:13.971389+0000","last_peered":"2024-09-19T09:36:13.971389+0000","last_clean":"2024-09-19T09:36:13.971389+0000","last_became_active":"2024-09-19T09:36:12.982062+0000","last_became_peered":"2024-09-19T09:36:12.982062+0000","last_unstale":"2024-09-19T09:36:13.971389+0000","last_undegraded":"2024-09-19T09:36:13.971389+0000","last_fullsized":"2024-09-19T09:36:13.971389+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:26.610287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979548+0000","last_change":"2024-09-19T09:36:12.979277+0000","last_active":"2024-09-19T09:36:13.979548+0000","last_peered":"2024-09-19T09:36:13.979548+0000","last_clean":"2024-09-19T09:36:13.979548+0000","last_became_active":"2024-09-19T09:36:12.978970+0000","last_became_peered":"2024-09-19T09:36:12.978970+0000","last_unstale":"2024-09-19T09:36:13.979548+0000","last_undegraded":"2024-09-19T09:36:13.979548+0000","last_fullsized":"2024-09-19T09:36:13.979548+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:00.424728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979950+0000","last_change":"2024-09-19T09:36:12.981021+0000","last_active":"2024-09-19T09:36:13.979950+0000","last_peered":"2024-09-19T09:36:13.979950+0000","last_clean":"2024-09-19T09:36:13.979950+0000","last_became_active":"2024-09-19T09:36:12.980580+0000","last_became_peered":"2024-09-19T09:36:12.980580+0000","last_unstale":"2024-09-19T09:36:13.979950+0000","last_undegraded":"2024-09-19T09:36:13.979950+0000","last_fullsized":"2024-09-19T09:36:13.979950+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:17.464873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971081+0000","last_change":"2024-09-19T09:36:12.986090+0000","last_active":"2024-09-19T09:36:13.971081+0000","last_peered":"2024-09-19T09:36:13.971081+0000","last_clean":"2024-09-19T09:36:13.971081+0000","last_became_active":"2024-09-19T09:36:12.985740+0000","last_became_peered":"2024-09-19T09:36:12.985740+0000","last_unstale":"2024-09-19T09:36:13.971081+0000","last_undegraded":"2024-09-19T09:36:13.971081+0000","last_fullsized":"2024-09-19T09:36:13.971081+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:35.252834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971039+0000","last_change":"2024-09-19T09:36:12.981257+0000","last_active":"2024-09-19T09:36:13.971039+0000","last_peered":"2024-09-19T09:36:13.971039+0000","last_clean":"2024-09-19T09:36:13.971039+0000","last_became_active":"2024-09-19T09:36:12.980911+0000","last_became_peered":"2024-09-19T09:36:12.980911+0000","last_unstale":"2024-09-19T09:36:13.971039+0000","last_undegraded":"2024-09-19T09:36:13.971039+0000","last_fullsized":"2024-09-19T09:36:13.971039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:41.470514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977617+0000","last_change":"2024-09-19T09:36:12.982585+0000","last_active":"2024-09-19T09:36:13.977617+0000","last_peered":"2024-09-19T09:36:13.977617+0000","last_clean":"2024-09-19T09:36:13.977617+0000","last_became_active":"2024-09-19T09:36:12.982193+0000","last_became_peered":"2024-09-19T09:36:12.982193+0000","last_unstale":"2024-09-19T09:36:13.977617+0000","last_undegraded":"2024-09-19T09:36:13.977617+0000","last_fullsized":"2024-09-19T09:36:13.977617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:30.057088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977206+0000","last_change":"2024-09-19T09:36:12.985236+0000","last_active":"2024-09-19T09:36:13.977206+0000","last_peered":"2024-09-19T09:36:13.977206+0000","last_clean":"2024-09-19T09:36:13.977206+0000","last_became_active":"2024-09-19T09:36:12.984751+0000","last_became_peered":"2024-09-19T09:36:12.984751+0000","last_unstale":"2024-09-19T09:36:13.977206+0000","last_undegraded":"2024-09-19T09:36:13.977206+0000","last_fullsized":"2024-09-19T09:36:13.977206+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:52.784216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983846+0000","last_change":"2024-09-19T09:36:12.985856+0000","last_active":"2024-09-19T09:36:13.983846+0000","last_peered":"2024-09-19T09:36:13.983846+0000","last_clean":"2024-09-19T09:36:13.983846+0000","last_became_active":"2024-09-19T09:36:12.985312+0000","last_became_peered":"2024-09-19T09:36:12.985312+0000","last_unstale":"2024-09-19T09:36:13.983846+0000","last_undegraded":"2024-09-19T09:36:13.983846+0000","last_fullsized":"2024-09-19T09:36:13.983846+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:25.235945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977734+0000","last_change":"2024-09-19T09:36:12.982443+0000","last_active":"2024-09-19T09:36:13.977734+0000","last_peered":"2024-09-19T09:36:13.977734+0000","last_clean":"2024-09-19T09:36:13.977734+0000","last_became_active":"2024-09-19T09:36:12.982130+0000","last_became_peered":"2024-09-19T09:36:12.982130+0000","last_unstale":"2024-09-19T09:36:13.977734+0000","last_undegraded":"2024-09-19T09:36:13.977734+0000","last_fullsized":"2024-09-19T09:36:13.977734+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:17.177563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980374+0000","last_change":"2024-09-19T09:36:12.990439+0000","last_active":"2024-09-19T09:36:13.980374+0000","last_peered":"2024-09-19T09:36:13.980374+0000","last_clean":"2024-09-19T09:36:13.980374+0000","last_became_active":"2024-09-19T09:36:12.990135+0000","last_became_peered":"2024-09-19T09:36:12.990135+0000","last_unstale":"2024-09-19T09:36:13.980374+0000","last_undegraded":"2024-09-19T09:36:13.980374+0000","last_fullsized":"2024-09-19T09:36:13.980374+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:51.685192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971233+0000","last_change":"2024-09-19T09:36:12.987261+0000","last_active":"2024-09-19T09:36:13.971233+0000","last_peered":"2024-09-19T09:36:13.971233+0000","last_clean":"2024-09-19T09:36:13.971233+0000","last_became_active":"2024-09-19T09:36:12.986192+0000","last_became_peered":"2024-09-19T09:36:12.986192+0000","last_unstale":"2024-09-19T09:36:13.971233+0000","last_undegraded":"2024-09-19T09:36:13.971233+0000","last_fullsized":"2024-09-19T09:36:13.971233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:58.435605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971115+0000","last_change":"2024-09-19T09:36:12.981248+0000","last_active":"2024-09-19T09:36:13.971115+0000","last_peered":"2024-09-19T09:36:13.971115+0000","last_clean":"2024-09-19T09:36:13.971115+0000","last_became_active":"2024-09-19T09:36:12.980754+0000","last_became_peered":"2024-09-19T09:36:12.980754+0000","last_unstale":"2024-09-19T09:36:13.971115+0000","last_undegraded":"2024-09-19T09:36:13.971115+0000","last_fullsized":"2024-09-19T09:36:13.971115+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:03.970402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980069+0000","last_change":"2024-09-19T09:36:12.990841+0000","last_active":"2024-09-19T09:36:13.980069+0000","last_peered":"2024-09-19T09:36:13.980069+0000","last_clean":"2024-09-19T09:36:13.980069+0000","last_became_active":"2024-09-19T09:36:12.989667+0000","last_became_peered":"2024-09-19T09:36:12.989667+0000","last_unstale":"2024-09-19T09:36:13.980069+0000","last_undegraded":"2024-09-19T09:36:13.980069+0000","last_fullsized":"2024-09-19T09:36:13.980069+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:46:00.314590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979717+0000","last_change":"2024-09-19T09:36:12.984007+0000","last_active":"2024-09-19T09:36:13.979717+0000","last_peered":"2024-09-19T09:36:13.979717+0000","last_clean":"2024-09-19T09:36:13.979717+0000","last_became_active":"2024-09-19T09:36:12.983627+0000","last_became_peered":"2024-09-19T09:36:12.983627+0000","last_unstale":"2024-09-19T09:36:13.979717+0000","last_undegraded":"2024-09-19T09:36:13.979717+0000","last_fullsized":"2024-09-19T09:36:13.979717+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:42.038673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980949+0000","last_change":"2024-09-19T09:36:12.988032+0000","last_active":"2024-09-19T09:36:13.980949+0000","last_peered":"2024-09-19T09:36:13.980949+0000","last_clean":"2024-09-19T09:36:13.980949+0000","last_became_active":"2024-09-19T09:36:12.987588+0000","last_became_peered":"2024-09-19T09:36:12.987588+0000","last_unstale":"2024-09-19T09:36:13.980949+0000","last_undegraded":"2024-09-19T09:36:13.980949+0000","last_fullsized":"2024-09-19T09:36:13.980949+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:01.518543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.970969+0000","last_change":"2024-09-19T09:36:12.991186+0000","last_active":"2024-09-19T09:36:13.970969+0000","last_peered":"2024-09-19T09:36:13.970969+0000","last_clean":"2024-09-19T09:36:13.970969+0000","last_became_active":"2024-09-19T09:36:12.987125+0000","last_became_peered":"2024-09-19T09:36:12.987125+0000","last_unstale":"2024-09-19T09:36:13.970969+0000","last_undegraded":"2024-09-19T09:36:13.970969+0000","last_fullsized":"2024-09-19T09:36:13.970969+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:35.316046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979987+0000","last_change":"2024-09-19T09:36:12.989709+0000","last_active":"2024-09-19T09:36:13.979987+0000","last_peered":"2024-09-19T09:36:13.979987+0000","last_clean":"2024-09-19T09:36:13.979987+0000","last_became_active":"2024-09-19T09:36:12.989324+0000","last_became_peered":"2024-09-19T09:36:12.989324+0000","last_unstale":"2024-09-19T09:36:13.979987+0000","last_undegraded":"2024-09-19T09:36:13.979987+0000","last_fullsized":"2024-09-19T09:36:13.979987+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:09.843175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983299+0000","last_change":"2024-09-19T09:36:10.843617+0000","last_active":"2024-09-19T09:36:13.983299+0000","last_peered":"2024-09-19T09:36:13.983299+0000","last_clean":"2024-09-19T09:36:13.983299+0000","last_became_active":"2024-09-19T09:36:10.843211+0000","last_became_peered":"2024-09-19T09:36:10.843211+0000","last_unstale":"2024-09-19T09:36:13.983299+0000","last_undegraded":"2024-09-19T09:36:13.983299+0000","last_fullsized":"2024-09-19T09:36:13.983299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:10.137291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983051+0000","last_change":"2024-09-19T09:36:12.992456+0000","last_active":"2024-09-19T09:36:13.983051+0000","last_peered":"2024-09-19T09:36:13.983051+0000","last_clean":"2024-09-19T09:36:13.983051+0000","last_became_active":"2024-09-19T09:36:12.992119+0000","last_became_peered":"2024-09-19T09:36:12.992119+0000","last_unstale":"2024-09-19T09:36:13.983051+0000","last_undegraded":"2024-09-19T09:36:13.983051+0000","last_fullsized":"2024-09-19T09:36:13.983051+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:20.850631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971692+0000","last_change":"2024-09-19T09:36:10.839487+0000","last_active":"2024-09-19T09:36:13.971692+0000","last_peered":"2024-09-19T09:36:13.971692+0000","last_clean":"2024-09-19T09:36:13.971692+0000","last_became_active":"2024-09-19T09:36:10.839074+0000","last_became_peered":"2024-09-19T09:36:10.839074+0000","last_unstale":"2024-09-19T09:36:13.971692+0000","last_undegraded":"2024-09-19T09:36:13.971692+0000","last_fullsized":"2024-09-19T09:36:13.971692+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:30.299698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.970682+0000","last_change":"2024-09-19T09:36:10.837287+0000","last_active":"2024-09-19T09:36:13.970682+0000","last_peered":"2024-09-19T09:36:13.970682+0000","last_clean":"2024-09-19T09:36:13.970682+0000","last_became_active":"2024-09-19T09:36:10.836890+0000","last_became_peered":"2024-09-19T09:36:10.836890+0000","last_unstale":"2024-09-19T09:36:13.970682+0000","last_undegraded":"2024-09-19T09:36:13.970682+0000","last_fullsized":"2024-09-19T09:36:13.970682+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:09.676728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977125+0000","last_change":"2024-09-19T09:36:12.975690+0000","last_active":"2024-09-19T09:36:13.977125+0000","last_peered":"2024-09-19T09:36:13.977125+0000","last_clean":"2024-09-19T09:36:13.977125+0000","last_became_active":"2024-09-19T09:36:12.975370+0000","last_became_peered":"2024-09-19T09:36:12.975370+0000","last_unstale":"2024-09-19T09:36:13.977125+0000","last_undegraded":"2024-09-19T09:36:13.977125+0000","last_fullsized":"2024-09-19T09:36:13.977125+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:05.650917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.984270+0000","last_change":"2024-09-19T09:36:10.843736+0000","last_active":"2024-09-19T09:36:13.984270+0000","last_peered":"2024-09-19T09:36:13.984270+0000","last_clean":"2024-09-19T09:36:13.984270+0000","last_became_active":"2024-09-19T09:36:10.843353+0000","last_became_peered":"2024-09-19T09:36:10.843353+0000","last_unstale":"2024-09-19T09:36:13.984270+0000","last_undegraded":"2024-09-19T09:36:13.984270+0000","last_fullsized":"2024-09-19T09:36:13.984270+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:29.818642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979800+0000","last_change":"2024-09-19T09:36:12.978841+0000","last_active":"2024-09-19T09:36:13.979800+0000","last_peered":"2024-09-19T09:36:13.979800+0000","last_clean":"2024-09-19T09:36:13.979800+0000","last_became_active":"2024-09-19T09:36:12.978501+0000","last_became_peered":"2024-09-19T09:36:12.978501+0000","last_unstale":"2024-09-19T09:36:13.979800+0000","last_undegraded":"2024-09-19T09:36:13.979800+0000","last_fullsized":"2024-09-19T09:36:13.979800+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:07.974576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.972053+0000","last_change":"2024-09-19T09:36:10.841997+0000","last_active":"2024-09-19T09:36:13.972053+0000","last_peered":"2024-09-19T09:36:13.972053+0000","last_clean":"2024-09-19T09:36:13.972053+0000","last_became_active":"2024-09-19T09:36:10.841641+0000","last_became_peered":"2024-09-19T09:36:10.841641+0000","last_unstale":"2024-09-19T09:36:13.972053+0000","last_undegraded":"2024-09-19T09:36:13.972053+0000","last_fullsized":"2024-09-19T09:36:13.972053+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:10.477879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.978167+0000","last_change":"2024-09-19T09:36:12.981486+0000","last_active":"2024-09-19T09:36:13.978167+0000","last_peered":"2024-09-19T09:36:13.978167+0000","last_clean":"2024-09-19T09:36:13.978167+0000","last_became_active":"2024-09-19T09:36:12.981165+0000","last_became_peered":"2024-09-19T09:36:12.981165+0000","last_unstale":"2024-09-19T09:36:13.978167+0000","last_undegraded":"2024-09-19T09:36:13.978167+0000","last_fullsized":"2024-09-19T09:36:13.978167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:21.986132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.982877+0000","last_change":"2024-09-19T09:36:10.845362+0000","last_active":"2024-09-19T09:36:13.982877+0000","last_peered":"2024-09-19T09:36:13.982877+0000","last_clean":"2024-09-19T09:36:13.982877+0000","last_became_active":"2024-09-19T09:36:10.844992+0000","last_became_peered":"2024-09-19T09:36:10.844992+0000","last_unstale":"2024-09-19T09:36:13.982877+0000","last_undegraded":"2024-09-19T09:36:13.982877+0000","last_fullsized":"2024-09-19T09:36:13.982877+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:52.854333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980323+0000","last_change":"2024-09-19T09:36:12.988924+0000","last_active":"2024-09-19T09:36:13.980323+0000","last_peered":"2024-09-19T09:36:13.980323+0000","last_clean":"2024-09-19T09:36:13.980323+0000","last_became_active":"2024-09-19T09:36:12.988331+0000","last_became_peered":"2024-09-19T09:36:12.988331+0000","last_unstale":"2024-09-19T09:36:13.980323+0000","last_undegraded":"2024-09-19T09:36:13.980323+0000","last_fullsized":"2024-09-19T09:36:13.980323+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:24.754252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.986823+0000","last_change":"2024-09-19T09:36:10.860003+0000","last_active":"2024-09-19T09:36:13.986823+0000","last_peered":"2024-09-19T09:36:13.986823+0000","last_clean":"2024-09-19T09:36:13.986823+0000","last_became_active":"2024-09-19T09:36:10.859584+0000","last_became_peered":"2024-09-19T09:36:10.859584+0000","last_unstale":"2024-09-19T09:36:13.986823+0000","last_undegraded":"2024-09-19T09:36:13.986823+0000","last_fullsized":"2024-09-19T09:36:13.986823+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:44.837960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977224+0000","last_change":"2024-09-19T09:36:12.985446+0000","last_active":"2024-09-19T09:36:13.977224+0000","last_peered":"2024-09-19T09:36:13.977224+0000","last_clean":"2024-09-19T09:36:13.977224+0000","last_became_active":"2024-09-19T09:36:12.984671+0000","last_became_peered":"2024-09-19T09:36:12.984671+0000","last_unstale":"2024-09-19T09:36:13.977224+0000","last_undegraded":"2024-09-19T09:36:13.977224+0000","last_fullsized":"2024-09-19T09:36:13.977224+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:54.800151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'25","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:36.037745+0000","last_change":"2024-09-19T09:36:10.841056+0000","last_active":"2024-09-19T09:36:36.037745+0000","last_peered":"2024-09-19T09:36:36.037745+0000","last_clean":"2024-09-19T09:36:36.037745+0000","last_became_active":"2024-09-19T09:36:10.840731+0000","last_became_peered":"2024-09-19T09:36:10.840731+0000","last_unstale":"2024-09-19T09:36:36.037745+0000","last_undegraded":"2024-09-19T09:36:36.037745+0000","last_fullsized":"2024-09-19T09:36:36.037745+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:13.676188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53167,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":37,"num_read_kb":69,"num_write":25,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.981591+0000","last_change":"2024-09-19T09:36:12.990223+0000","last_active":"2024-09-19T09:36:13.981591+0000","last_peered":"2024-09-19T09:36:13.981591+0000","last_clean":"2024-09-19T09:36:13.981591+0000","last_became_active":"2024-09-19T09:36:12.989720+0000","last_became_peered":"2024-09-19T09:36:12.989720+0000","last_unstale":"2024-09-19T09:36:13.981591+0000","last_undegraded":"2024-09-19T09:36:13.981591+0000","last_fullsized":"2024-09-19T09:36:13.981591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:37.003075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:14.496063+0000","last_change":"2024-09-19T09:36:10.843288+0000","last_active":"2024-09-19T09:36:14.496063+0000","last_peered":"2024-09-19T09:36:14.496063+0000","last_clean":"2024-09-19T09:36:14.496063+0000","last_became_active":"2024-09-19T09:36:10.842844+0000","last_became_peered":"2024-09-19T09:36:10.842844+0000","last_unstale":"2024-09-19T09:36:14.496063+0000","last_undegraded":"2024-09-19T09:36:14.496063+0000","last_fullsized":"2024-09-19T09:36:14.496063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:38.695411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.970737+0000","last_change":"2024-09-19T09:36:12.981251+0000","last_active":"2024-09-19T09:36:13.970737+0000","last_peered":"2024-09-19T09:36:13.970737+0000","last_clean":"2024-09-19T09:36:13.970737+0000","last_became_active":"2024-09-19T09:36:12.980861+0000","last_became_peered":"2024-09-19T09:36:12.980861+0000","last_unstale":"2024-09-19T09:36:13.970737+0000","last_undegraded":"2024-09-19T09:36:13.970737+0000","last_fullsized":"2024-09-19T09:36:13.970737+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:09.633644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.982414+0000","last_change":"2024-09-19T09:36:10.843448+0000","last_active":"2024-09-19T09:36:13.982414+0000","last_peered":"2024-09-19T09:36:13.982414+0000","last_clean":"2024-09-19T09:36:13.982414+0000","last_became_active":"2024-09-19T09:36:10.843087+0000","last_became_peered":"2024-09-19T09:36:10.843087+0000","last_unstale":"2024-09-19T09:36:13.982414+0000","last_undegraded":"2024-09-19T09:36:13.982414+0000","last_fullsized":"2024-09-19T09:36:13.982414+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:20.623613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.982971+0000","last_change":"2024-09-19T09:36:12.981160+0000","last_active":"2024-09-19T09:36:13.982971+0000","last_peered":"2024-09-19T09:36:13.982971+0000","last_clean":"2024-09-19T09:36:13.982971+0000","last_became_active":"2024-09-19T09:36:12.980823+0000","last_became_peered":"2024-09-19T09:36:12.980823+0000","last_unstale":"2024-09-19T09:36:13.982971+0000","last_undegraded":"2024-09-19T09:36:13.982971+0000","last_fullsized":"2024-09-19T09:36:13.982971+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:39.323439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980537+0000","last_change":"2024-09-19T09:36:10.842536+0000","last_active":"2024-09-19T09:36:13.980537+0000","last_peered":"2024-09-19T09:36:13.980537+0000","last_clean":"2024-09-19T09:36:13.980537+0000","last_became_active":"2024-09-19T09:36:10.842176+0000","last_became_peered":"2024-09-19T09:36:10.842176+0000","last_unstale":"2024-09-19T09:36:13.980537+0000","last_undegraded":"2024-09-19T09:36:13.980537+0000","last_fullsized":"2024-09-19T09:36:13.980537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:37.871299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.982395+0000","last_change":"2024-09-19T09:36:12.987271+0000","last_active":"2024-09-19T09:36:13.982395+0000","last_peered":"2024-09-19T09:36:13.982395+0000","last_clean":"2024-09-19T09:36:13.982395+0000","last_became_active":"2024-09-19T09:36:12.986918+0000","last_became_peered":"2024-09-19T09:36:12.986918+0000","last_unstale":"2024-09-19T09:36:13.982395+0000","last_undegraded":"2024-09-19T09:36:13.982395+0000","last_fullsized":"2024-09-19T09:36:13.982395+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:07.608541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.989197+0000","last_change":"2024-09-19T09:36:10.860370+0000","last_active":"2024-09-19T09:36:13.989197+0000","last_peered":"2024-09-19T09:36:13.989197+0000","last_clean":"2024-09-19T09:36:13.989197+0000","last_became_active":"2024-09-19T09:36:10.859820+0000","last_became_peered":"2024-09-19T09:36:10.859820+0000","last_unstale":"2024-09-19T09:36:13.989197+0000","last_undegraded":"2024-09-19T09:36:13.989197+0000","last_fullsized":"2024-09-19T09:36:13.989197+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:12.121038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.984738+0000","last_change":"2024-09-19T09:36:12.994449+0000","last_active":"2024-09-19T09:36:13.984738+0000","last_peered":"2024-09-19T09:36:13.984738+0000","last_clean":"2024-09-19T09:36:13.984738+0000","last_became_active":"2024-09-19T09:36:12.994141+0000","last_became_peered":"2024-09-19T09:36:12.994141+0000","last_unstale":"2024-09-19T09:36:13.984738+0000","last_undegraded":"2024-09-19T09:36:13.984738+0000","last_fullsized":"2024-09-19T09:36:13.984738+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:21.416453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:14.710833+0000","last_change":"2024-09-19T09:36:10.839609+0000","last_active":"2024-09-19T09:36:14.710833+0000","last_peered":"2024-09-19T09:36:14.710833+0000","last_clean":"2024-09-19T09:36:14.710833+0000","last_became_active":"2024-09-19T09:36:10.839227+0000","last_became_peered":"2024-09-19T09:36:10.839227+0000","last_unstale":"2024-09-19T09:36:14.710833+0000","last_undegraded":"2024-09-19T09:36:14.710833+0000","last_fullsized":"2024-09-19T09:36:14.710833+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:00.734924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971232+0000","last_change":"2024-09-19T09:36:12.983573+0000","last_active":"2024-09-19T09:36:13.971232+0000","last_peered":"2024-09-19T09:36:13.971232+0000","last_clean":"2024-09-19T09:36:13.971232+0000","last_became_active":"2024-09-19T09:36:12.983241+0000","last_became_peered":"2024-09-19T09:36:12.983241+0000","last_unstale":"2024-09-19T09:36:13.971232+0000","last_undegraded":"2024-09-19T09:36:13.971232+0000","last_fullsized":"2024-09-19T09:36:13.971232+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:44.050271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.981922+0000","last_change":"2024-09-19T09:36:10.839789+0000","last_active":"2024-09-19T09:36:13.981922+0000","last_peered":"2024-09-19T09:36:13.981922+0000","last_clean":"2024-09-19T09:36:13.981922+0000","last_became_active":"2024-09-19T09:36:10.839445+0000","last_became_peered":"2024-09-19T09:36:10.839445+0000","last_unstale":"2024-09-19T09:36:13.981922+0000","last_undegraded":"2024-09-19T09:36:13.981922+0000","last_fullsized":"2024-09-19T09:36:13.981922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:16.040249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.984009+0000","last_change":"2024-09-19T09:36:12.993420+0000","last_active":"2024-09-19T09:36:13.984009+0000","last_peered":"2024-09-19T09:36:13.984009+0000","last_clean":"2024-09-19T09:36:13.984009+0000","last_became_active":"2024-09-19T09:36:12.992334+0000","last_became_peered":"2024-09-19T09:36:12.992334+0000","last_unstale":"2024-09-19T09:36:13.984009+0000","last_undegraded":"2024-09-19T09:36:13.984009+0000","last_fullsized":"2024-09-19T09:36:13.984009+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:21.693164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.987081+0000","last_change":"2024-09-19T09:36:10.839461+0000","last_active":"2024-09-19T09:36:13.987081+0000","last_peered":"2024-09-19T09:36:13.987081+0000","last_clean":"2024-09-19T09:36:13.987081+0000","last_became_active":"2024-09-19T09:36:10.839092+0000","last_became_peered":"2024-09-19T09:36:10.839092+0000","last_unstale":"2024-09-19T09:36:13.987081+0000","last_undegraded":"2024-09-19T09:36:13.987081+0000","last_fullsized":"2024-09-19T09:36:13.987081+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:02.367267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:14.080586+0000","last_change":"2024-09-19T09:36:12.988234+0000","last_active":"2024-09-19T09:36:14.080586+0000","last_peered":"2024-09-19T09:36:14.080586+0000","last_clean":"2024-09-19T09:36:14.080586+0000","last_became_active":"2024-09-19T09:36:12.987813+0000","last_became_peered":"2024-09-19T09:36:12.987813+0000","last_unstale":"2024-09-19T09:36:14.080586+0000","last_undegraded":"2024-09-19T09:36:14.080586+0000","last_fullsized":"2024-09-19T09:36:14.080586+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:56.024428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.981458+0000","last_change":"2024-09-19T09:36:10.945705+0000","last_active":"2024-09-19T09:36:13.981458+0000","last_peered":"2024-09-19T09:36:13.981458+0000","last_clean":"2024-09-19T09:36:13.981458+0000","last_became_active":"2024-09-19T09:36:10.945323+0000","last_became_peered":"2024-09-19T09:36:10.945323+0000","last_unstale":"2024-09-19T09:36:13.981458+0000","last_undegraded":"2024-09-19T09:36:13.981458+0000","last_fullsized":"2024-09-19T09:36:13.981458+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:24.211909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983646+0000","last_change":"2024-09-19T09:36:12.990517+0000","last_active":"2024-09-19T09:36:13.983646+0000","last_peered":"2024-09-19T09:36:13.983646+0000","last_clean":"2024-09-19T09:36:13.983646+0000","last_became_active":"2024-09-19T09:36:12.989291+0000","last_became_peered":"2024-09-19T09:36:12.989291+0000","last_unstale":"2024-09-19T09:36:13.983646+0000","last_undegraded":"2024-09-19T09:36:13.983646+0000","last_fullsized":"2024-09-19T09:36:13.983646+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:31.087798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":334,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.982963+0000","last_change":"2024-09-19T09:34:59.337025+0000","last_active":"2024-09-19T09:36:13.982963+0000","last_peered":"2024-09-19T09:36:13.982963+0000","last_clean":"2024-09-19T09:36:13.982963+0000","last_became_active":"2024-09-19T09:34:59.336556+0000","last_became_peered":"2024-09-19T09:34:59.336556+0000","last_unstale":"2024-09-19T09:36:13.982963+0000","last_undegraded":"2024-09-19T09:36:13.982963+0000","last_fullsized":"2024-09-19T09:36:13.982963+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:31:30.566923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:31:30.566923+0000","last_clean_scrub_stamp":"2024-09-19T09:31:30.566923+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:00.675254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980632+0000","last_change":"2024-09-19T09:36:10.838131+0000","last_active":"2024-09-19T09:36:13.980632+0000","last_peered":"2024-09-19T09:36:13.980632+0000","last_clean":"2024-09-19T09:36:13.980632+0000","last_became_active":"2024-09-19T09:36:10.837725+0000","last_became_peered":"2024-09-19T09:36:10.837725+0000","last_unstale":"2024-09-19T09:36:13.980632+0000","last_undegraded":"2024-09-19T09:36:13.980632+0000","last_fullsized":"2024-09-19T09:36:13.980632+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:57.104726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977566+0000","last_change":"2024-09-19T09:36:12.981951+0000","last_active":"2024-09-19T09:36:13.977566+0000","last_peered":"2024-09-19T09:36:13.977566+0000","last_clean":"2024-09-19T09:36:13.977566+0000","last_became_active":"2024-09-19T09:36:12.981558+0000","last_became_peered":"2024-09-19T09:36:12.981558+0000","last_unstale":"2024-09-19T09:36:13.977566+0000","last_undegraded":"2024-09-19T09:36:13.977566+0000","last_fullsized":"2024-09-19T09:36:13.977566+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:31.119853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983301+0000","last_change":"2024-09-19T09:36:10.843574+0000","last_active":"2024-09-19T09:36:13.983301+0000","last_peered":"2024-09-19T09:36:13.983301+0000","last_clean":"2024-09-19T09:36:13.983301+0000","last_became_active":"2024-09-19T09:36:10.843252+0000","last_became_peered":"2024-09-19T09:36:10.843252+0000","last_unstale":"2024-09-19T09:36:13.983301+0000","last_undegraded":"2024-09-19T09:36:13.983301+0000","last_fullsized":"2024-09-19T09:36:13.983301+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:10.492812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.970701+0000","last_change":"2024-09-19T09:36:12.984538+0000","last_active":"2024-09-19T09:36:13.970701+0000","last_peered":"2024-09-19T09:36:13.970701+0000","last_clean":"2024-09-19T09:36:13.970701+0000","last_became_active":"2024-09-19T09:36:12.983448+0000","last_became_peered":"2024-09-19T09:36:12.983448+0000","last_unstale":"2024-09-19T09:36:13.970701+0000","last_undegraded":"2024-09-19T09:36:13.970701+0000","last_fullsized":"2024-09-19T09:36:13.970701+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:48.294473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.970841+0000","last_change":"2024-09-19T09:36:10.858959+0000","last_active":"2024-09-19T09:36:13.970841+0000","last_peered":"2024-09-19T09:36:13.970841+0000","last_clean":"2024-09-19T09:36:13.970841+0000","last_became_active":"2024-09-19T09:36:10.858638+0000","last_became_peered":"2024-09-19T09:36:10.858638+0000","last_unstale":"2024-09-19T09:36:13.970841+0000","last_undegraded":"2024-09-19T09:36:13.970841+0000","last_fullsized":"2024-09-19T09:36:13.970841+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:12.646483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.984042+0000","last_change":"2024-09-19T09:36:12.992710+0000","last_active":"2024-09-19T09:36:13.984042+0000","last_peered":"2024-09-19T09:36:13.984042+0000","last_clean":"2024-09-19T09:36:13.984042+0000","last_became_active":"2024-09-19T09:36:12.992436+0000","last_became_peered":"2024-09-19T09:36:12.992436+0000","last_unstale":"2024-09-19T09:36:13.984042+0000","last_undegraded":"2024-09-19T09:36:13.984042+0000","last_fullsized":"2024-09-19T09:36:13.984042+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:51.685516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983385+0000","last_change":"2024-09-19T09:36:10.842031+0000","last_active":"2024-09-19T09:36:13.983385+0000","last_peered":"2024-09-19T09:36:13.983385+0000","last_clean":"2024-09-19T09:36:13.983385+0000","last_became_active":"2024-09-19T09:36:10.841693+0000","last_became_peered":"2024-09-19T09:36:10.841693+0000","last_unstale":"2024-09-19T09:36:13.983385+0000","last_undegraded":"2024-09-19T09:36:13.983385+0000","last_fullsized":"2024-09-19T09:36:13.983385+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:28:51.040551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971661+0000","last_change":"2024-09-19T09:36:12.995510+0000","last_active":"2024-09-19T09:36:13.971661+0000","last_peered":"2024-09-19T09:36:13.971661+0000","last_clean":"2024-09-19T09:36:13.971661+0000","last_became_active":"2024-09-19T09:36:12.995128+0000","last_became_peered":"2024-09-19T09:36:12.995128+0000","last_unstale":"2024-09-19T09:36:13.971661+0000","last_undegraded":"2024-09-19T09:36:13.971661+0000","last_fullsized":"2024-09-19T09:36:13.971661+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:27.955678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979849+0000","last_change":"2024-09-19T09:36:10.860470+0000","last_active":"2024-09-19T09:36:13.979849+0000","last_peered":"2024-09-19T09:36:13.979849+0000","last_clean":"2024-09-19T09:36:13.979849+0000","last_became_active":"2024-09-19T09:36:10.860097+0000","last_became_peered":"2024-09-19T09:36:10.860097+0000","last_unstale":"2024-09-19T09:36:13.979849+0000","last_undegraded":"2024-09-19T09:36:13.979849+0000","last_fullsized":"2024-09-19T09:36:13.979849+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:14.933378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:16.106609+0000","last_change":"2024-09-19T09:36:12.988489+0000","last_active":"2024-09-19T09:36:16.106609+0000","last_peered":"2024-09-19T09:36:16.106609+0000","last_clean":"2024-09-19T09:36:16.106609+0000","last_became_active":"2024-09-19T09:36:12.988151+0000","last_became_peered":"2024-09-19T09:36:12.988151+0000","last_unstale":"2024-09-19T09:36:16.106609+0000","last_undegraded":"2024-09-19T09:36:16.106609+0000","last_fullsized":"2024-09-19T09:36:16.106609+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:24.088771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.981909+0000","last_change":"2024-09-19T09:36:10.860103+0000","last_active":"2024-09-19T09:36:13.981909+0000","last_peered":"2024-09-19T09:36:13.981909+0000","last_clean":"2024-09-19T09:36:13.981909+0000","last_became_active":"2024-09-19T09:36:10.859526+0000","last_became_peered":"2024-09-19T09:36:10.859526+0000","last_unstale":"2024-09-19T09:36:13.981909+0000","last_undegraded":"2024-09-19T09:36:13.981909+0000","last_fullsized":"2024-09-19T09:36:13.981909+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:25.460372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971039+0000","last_change":"2024-09-19T09:36:12.986286+0000","last_active":"2024-09-19T09:36:13.971039+0000","last_peered":"2024-09-19T09:36:13.971039+0000","last_clean":"2024-09-19T09:36:13.971039+0000","last_became_active":"2024-09-19T09:36:12.985982+0000","last_became_peered":"2024-09-19T09:36:12.985982+0000","last_unstale":"2024-09-19T09:36:13.971039+0000","last_undegraded":"2024-09-19T09:36:13.971039+0000","last_fullsized":"2024-09-19T09:36:13.971039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:19.026134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'8","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:33.978313+0000","last_change":"2024-09-19T09:36:10.839280+0000","last_active":"2024-09-19T09:36:33.978313+0000","last_peered":"2024-09-19T09:36:33.978313+0000","last_clean":"2024-09-19T09:36:33.978313+0000","last_became_active":"2024-09-19T09:36:10.838979+0000","last_became_peered":"2024-09-19T09:36:10.838979+0000","last_unstale":"2024-09-19T09:36:33.978313+0000","last_undegraded":"2024-09-19T09:36:33.978313+0000","last_fullsized":"2024-09-19T09:36:33.978313+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:06.303175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977725+0000","last_change":"2024-09-19T09:36:12.979778+0000","last_active":"2024-09-19T09:36:13.977725+0000","last_peered":"2024-09-19T09:36:13.977725+0000","last_clean":"2024-09-19T09:36:13.977725+0000","last_became_active":"2024-09-19T09:36:12.979455+0000","last_became_peered":"2024-09-19T09:36:12.979455+0000","last_unstale":"2024-09-19T09:36:13.977725+0000","last_undegraded":"2024-09-19T09:36:13.977725+0000","last_fullsized":"2024-09-19T09:36:13.977725+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:36.620368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983429+0000","last_change":"2024-09-19T09:36:10.945706+0000","last_active":"2024-09-19T09:36:13.983429+0000","last_peered":"2024-09-19T09:36:13.983429+0000","last_clean":"2024-09-19T09:36:13.983429+0000","last_became_active":"2024-09-19T09:36:10.945314+0000","last_became_peered":"2024-09-19T09:36:10.945314+0000","last_unstale":"2024-09-19T09:36:13.983429+0000","last_undegraded":"2024-09-19T09:36:13.983429+0000","last_fullsized":"2024-09-19T09:36:13.983429+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:49.786913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979575+0000","last_change":"2024-09-19T09:36:12.989412+0000","last_active":"2024-09-19T09:36:13.979575+0000","last_peered":"2024-09-19T09:36:13.979575+0000","last_clean":"2024-09-19T09:36:13.979575+0000","last_became_active":"2024-09-19T09:36:12.989109+0000","last_became_peered":"2024-09-19T09:36:12.989109+0000","last_unstale":"2024-09-19T09:36:13.979575+0000","last_undegraded":"2024-09-19T09:36:13.979575+0000","last_fullsized":"2024-09-19T09:36:13.979575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:33.142592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977297+0000","last_change":"2024-09-19T09:36:10.858581+0000","last_active":"2024-09-19T09:36:13.977297+0000","last_peered":"2024-09-19T09:36:13.977297+0000","last_clean":"2024-09-19T09:36:13.977297+0000","last_became_active":"2024-09-19T09:36:10.858240+0000","last_became_peered":"2024-09-19T09:36:10.858240+0000","last_unstale":"2024-09-19T09:36:13.977297+0000","last_undegraded":"2024-09-19T09:36:13.977297+0000","last_fullsized":"2024-09-19T09:36:13.977297+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:45.285839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979917+0000","last_change":"2024-09-19T09:36:12.989075+0000","last_active":"2024-09-19T09:36:13.979917+0000","last_peered":"2024-09-19T09:36:13.979917+0000","last_clean":"2024-09-19T09:36:13.979917+0000","last_became_active":"2024-09-19T09:36:12.988752+0000","last_became_peered":"2024-09-19T09:36:12.988752+0000","last_unstale":"2024-09-19T09:36:13.979917+0000","last_undegraded":"2024-09-19T09:36:13.979917+0000","last_fullsized":"2024-09-19T09:36:13.979917+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.424032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977294+0000","last_change":"2024-09-19T09:36:10.838716+0000","last_active":"2024-09-19T09:36:13.977294+0000","last_peered":"2024-09-19T09:36:13.977294+0000","last_clean":"2024-09-19T09:36:13.977294+0000","last_became_active":"2024-09-19T09:36:10.838393+0000","last_became_peered":"2024-09-19T09:36:10.838393+0000","last_unstale":"2024-09-19T09:36:13.977294+0000","last_undegraded":"2024-09-19T09:36:13.977294+0000","last_fullsized":"2024-09-19T09:36:13.977294+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:54.107223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971121+0000","last_change":"2024-09-19T09:36:12.991721+0000","last_active":"2024-09-19T09:36:13.971121+0000","last_peered":"2024-09-19T09:36:13.971121+0000","last_clean":"2024-09-19T09:36:13.971121+0000","last_became_active":"2024-09-19T09:36:12.991398+0000","last_became_peered":"2024-09-19T09:36:12.991398+0000","last_unstale":"2024-09-19T09:36:13.971121+0000","last_undegraded":"2024-09-19T09:36:13.971121+0000","last_fullsized":"2024-09-19T09:36:13.971121+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:19:31.312072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979724+0000","last_change":"2024-09-19T09:36:10.839625+0000","last_active":"2024-09-19T09:36:13.979724+0000","last_peered":"2024-09-19T09:36:13.979724+0000","last_clean":"2024-09-19T09:36:13.979724+0000","last_became_active":"2024-09-19T09:36:10.839255+0000","last_became_peered":"2024-09-19T09:36:10.839255+0000","last_unstale":"2024-09-19T09:36:13.979724+0000","last_undegraded":"2024-09-19T09:36:13.979724+0000","last_fullsized":"2024-09-19T09:36:13.979724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:37.221951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977214+0000","last_change":"2024-09-19T09:36:12.984180+0000","last_active":"2024-09-19T09:36:13.977214+0000","last_peered":"2024-09-19T09:36:13.977214+0000","last_clean":"2024-09-19T09:36:13.977214+0000","last_became_active":"2024-09-19T09:36:12.983876+0000","last_became_peered":"2024-09-19T09:36:12.983876+0000","last_unstale":"2024-09-19T09:36:13.977214+0000","last_undegraded":"2024-09-19T09:36:13.977214+0000","last_fullsized":"2024-09-19T09:36:13.977214+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:45.876771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:14.710787+0000","last_change":"2024-09-19T09:36:10.845391+0000","last_active":"2024-09-19T09:36:14.710787+0000","last_peered":"2024-09-19T09:36:14.710787+0000","last_clean":"2024-09-19T09:36:14.710787+0000","last_became_active":"2024-09-19T09:36:10.844974+0000","last_became_peered":"2024-09-19T09:36:10.844974+0000","last_unstale":"2024-09-19T09:36:14.710787+0000","last_undegraded":"2024-09-19T09:36:14.710787+0000","last_fullsized":"2024-09-19T09:36:14.710787+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:00.318337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983307+0000","last_change":"2024-09-19T09:36:12.991145+0000","last_active":"2024-09-19T09:36:13.983307+0000","last_peered":"2024-09-19T09:36:13.983307+0000","last_clean":"2024-09-19T09:36:13.983307+0000","last_became_active":"2024-09-19T09:36:12.989891+0000","last_became_peered":"2024-09-19T09:36:12.989891+0000","last_unstale":"2024-09-19T09:36:13.983307+0000","last_undegraded":"2024-09-19T09:36:13.983307+0000","last_fullsized":"2024-09-19T09:36:13.983307+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:21.054936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.982316+0000","last_change":"2024-09-19T09:36:12.995378+0000","last_active":"2024-09-19T09:36:13.982316+0000","last_peered":"2024-09-19T09:36:13.982316+0000","last_clean":"2024-09-19T09:36:13.982316+0000","last_became_active":"2024-09-19T09:36:12.995028+0000","last_became_peered":"2024-09-19T09:36:12.995028+0000","last_unstale":"2024-09-19T09:36:13.982316+0000","last_undegraded":"2024-09-19T09:36:13.982316+0000","last_fullsized":"2024-09-19T09:36:13.982316+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:41.102130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.987910+0000","last_change":"2024-09-19T09:36:10.839595+0000","last_active":"2024-09-19T09:36:13.987910+0000","last_peered":"2024-09-19T09:36:13.987910+0000","last_clean":"2024-09-19T09:36:13.987910+0000","last_became_active":"2024-09-19T09:36:10.839196+0000","last_became_peered":"2024-09-19T09:36:10.839196+0000","last_unstale":"2024-09-19T09:36:13.987910+0000","last_undegraded":"2024-09-19T09:36:13.987910+0000","last_fullsized":"2024-09-19T09:36:13.987910+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:02.272731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977120+0000","last_change":"2024-09-19T09:36:12.984485+0000","last_active":"2024-09-19T09:36:13.977120+0000","last_peered":"2024-09-19T09:36:13.977120+0000","last_clean":"2024-09-19T09:36:13.977120+0000","last_became_active":"2024-09-19T09:36:12.984004+0000","last_became_peered":"2024-09-19T09:36:12.984004+0000","last_unstale":"2024-09-19T09:36:13.977120+0000","last_undegraded":"2024-09-19T09:36:13.977120+0000","last_fullsized":"2024-09-19T09:36:13.977120+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:37.646776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.988493+0000","last_change":"2024-09-19T09:36:10.845306+0000","last_active":"2024-09-19T09:36:13.988493+0000","last_peered":"2024-09-19T09:36:13.988493+0000","last_clean":"2024-09-19T09:36:13.988493+0000","last_became_active":"2024-09-19T09:36:10.844952+0000","last_became_peered":"2024-09-19T09:36:10.844952+0000","last_unstale":"2024-09-19T09:36:13.988493+0000","last_undegraded":"2024-09-19T09:36:13.988493+0000","last_fullsized":"2024-09-19T09:36:13.988493+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:09.792482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980247+0000","last_change":"2024-09-19T09:36:12.991260+0000","last_active":"2024-09-19T09:36:13.980247+0000","last_peered":"2024-09-19T09:36:13.980247+0000","last_clean":"2024-09-19T09:36:13.980247+0000","last_became_active":"2024-09-19T09:36:12.989981+0000","last_became_peered":"2024-09-19T09:36:12.989981+0000","last_unstale":"2024-09-19T09:36:13.980247+0000","last_undegraded":"2024-09-19T09:36:13.980247+0000","last_fullsized":"2024-09-19T09:36:13.980247+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:11.301790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977625+0000","last_change":"2024-09-19T09:36:10.859016+0000","last_active":"2024-09-19T09:36:13.977625+0000","last_peered":"2024-09-19T09:36:13.977625+0000","last_clean":"2024-09-19T09:36:13.977625+0000","last_became_active":"2024-09-19T09:36:10.858661+0000","last_became_peered":"2024-09-19T09:36:10.858661+0000","last_unstale":"2024-09-19T09:36:13.977625+0000","last_undegraded":"2024-09-19T09:36:13.977625+0000","last_fullsized":"2024-09-19T09:36:13.977625+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:54.395977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977465+0000","last_change":"2024-09-19T09:36:12.987989+0000","last_active":"2024-09-19T09:36:13.977465+0000","last_peered":"2024-09-19T09:36:13.977465+0000","last_clean":"2024-09-19T09:36:13.977465+0000","last_became_active":"2024-09-19T09:36:12.987615+0000","last_became_peered":"2024-09-19T09:36:12.987615+0000","last_unstale":"2024-09-19T09:36:13.977465+0000","last_undegraded":"2024-09-19T09:36:13.977465+0000","last_fullsized":"2024-09-19T09:36:13.977465+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:01.853678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.988121+0000","last_change":"2024-09-19T09:36:10.840593+0000","last_active":"2024-09-19T09:36:13.988121+0000","last_peered":"2024-09-19T09:36:13.988121+0000","last_clean":"2024-09-19T09:36:13.988121+0000","last_became_active":"2024-09-19T09:36:10.840233+0000","last_became_peered":"2024-09-19T09:36:10.840233+0000","last_unstale":"2024-09-19T09:36:13.988121+0000","last_undegraded":"2024-09-19T09:36:13.988121+0000","last_fullsized":"2024-09-19T09:36:13.988121+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:16.986234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":53965,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":43,"num_read_kb":75,"num_write":78,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":161895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65,"ondisk_log_size":65,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282954,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547218,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":872448,"data_stored":423919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776151,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":999424,"data_stored":1067765,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972380,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36200,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708952,"statfs":{"total":95995035648,"available":95957966848,"internally_reserved":0,"allocated":876544,"data_stored":424501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201312,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":424523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430246,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":1014986,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593771,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36200,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708952,"statfs":{"total":95995035648,"available":95957966848,"internally_reserved":0,"allocated":876544,"data_stored":424036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822705,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":1014586,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953526,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":876544,"data_stored":423941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215163,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":888832,"data_stored":424257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444095,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36260,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708892,"statfs":{"total":95995035648,"available":95957905408,"internally_reserved":0,"allocated":937984,"data_stored":477120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":933888,"data_stored":477086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":876544,"data_stored":424009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":53167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":53201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":53361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:36:40.410 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T09:36:40.413 INFO:tasks.cephadm:Setting up client nodes... 2024-09-19T09:36:40.414 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T09:36:40.672 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:41.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.155+0000 7f0de7058640 1 -- 172.21.15.1:0/2107482331 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0de0101720 msgr2=0x7f0de0108fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:41.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.155+0000 7f0de7058640 1 --2- 172.21.15.1:0/2107482331 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0de0101720 0x7f0de0108fc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8009ca0 tx=0x7f0dd802a8b0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.155+0000 7f0de7058640 1 -- 172.21.15.1:0/2107482331 shutdown_connections 2024-09-19T09:36:41.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.155+0000 7f0de7058640 1 --2- 172.21.15.1:0/2107482331 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0de0101720 0x7f0de0108fc0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.155+0000 7f0de7058640 1 --2- 172.21.15.1:0/2107482331 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0de0100d60 0x7f0de01011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.155+0000 7f0de7058640 1 --2- 172.21.15.1:0/2107482331 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0de0102190 0x7f0de0102590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.155+0000 7f0de7058640 1 -- 172.21.15.1:0/2107482331 >> 172.21.15.1:0/2107482331 conn(0x7f0de00fba40 msgr2=0x7f0de00fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:41.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.155+0000 7f0de7058640 1 -- 172.21.15.1:0/2107482331 shutdown_connections 2024-09-19T09:36:41.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.155+0000 7f0de7058640 1 -- 172.21.15.1:0/2107482331 wait complete. 2024-09-19T09:36:41.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.155+0000 7f0de7058640 1 Processor -- start 2024-09-19T09:36:41.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.156+0000 7f0de7058640 1 -- start start 2024-09-19T09:36:41.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.156+0000 7f0de7058640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0de0100d60 0x7f0de0104b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:41.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.156+0000 7f0de7058640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0de0101720 0x7f0de0103150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:41.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.156+0000 7f0de7058640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0de0102190 0x7f0de0103690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:41.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.156+0000 7f0de7058640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0de010c8b0 con 0x7f0de0101720 2024-09-19T09:36:41.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.156+0000 7f0de7058640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0de010c730 con 0x7f0de0100d60 2024-09-19T09:36:41.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.156+0000 7f0de7058640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0de010ca30 con 0x7f0de0102190 2024-09-19T09:36:41.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.156+0000 7f0dd7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0de0101720 0x7f0de0103150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:41.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.156+0000 7f0dd7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0de0101720 0x7f0de0103150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46316/0 (socket says 172.21.15.1:46316) 2024-09-19T09:36:41.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.156+0000 7f0dd7fff640 1 -- 172.21.15.1:0/910395892 learned_addr learned my addr 172.21.15.1:0/910395892 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:41.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.156+0000 7f0de55f5640 1 --2- 172.21.15.1:0/910395892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0de0102190 0x7f0de0103690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:41.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.156+0000 7f0de4df4640 1 --2- 172.21.15.1:0/910395892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0de0100d60 0x7f0de0104b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:41.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.156+0000 7f0dd7fff640 1 -- 172.21.15.1:0/910395892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0de0102190 msgr2=0x7f0de0103690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:41.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.156+0000 7f0dd7fff640 1 --2- 172.21.15.1:0/910395892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0de0102190 0x7f0de0103690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.156+0000 7f0dd7fff640 1 -- 172.21.15.1:0/910395892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0de0100d60 msgr2=0x7f0de0104b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:41.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.156+0000 7f0dd7fff640 1 --2- 172.21.15.1:0/910395892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0de0100d60 0x7f0de0104b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.156+0000 7f0dd7fff640 1 -- 172.21.15.1:0/910395892 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0de0103f50 con 0x7f0de0101720 2024-09-19T09:36:41.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.156+0000 7f0de4df4640 1 --2- 172.21.15.1:0/910395892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0de0100d60 0x7f0de0104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:36:41.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.156+0000 7f0dd7fff640 1 --2- 172.21.15.1:0/910395892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0de0101720 0x7f0de0103150 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0dd000b450 tx=0x7f0dd000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:41.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.157+0000 7f0dd5ffb640 1 -- 172.21.15.1:0/910395892 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd0015020 con 0x7f0de0101720 2024-09-19T09:36:41.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.157+0000 7f0dd5ffb640 1 -- 172.21.15.1:0/910395892 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0dd0011d70 con 0x7f0de0101720 2024-09-19T09:36:41.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.157+0000 7f0de7058640 1 -- 172.21.15.1:0/910395892 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0de01a2260 con 0x7f0de0101720 2024-09-19T09:36:41.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.157+0000 7f0dd5ffb640 1 -- 172.21.15.1:0/910395892 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dd000f340 con 0x7f0de0101720 2024-09-19T09:36:41.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.157+0000 7f0de7058640 1 -- 172.21.15.1:0/910395892 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0de01a2840 con 0x7f0de0101720 2024-09-19T09:36:41.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.158+0000 7f0de7058640 1 -- 172.21.15.1:0/910395892 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0de01a2ad0 con 0x7f0de0101720 2024-09-19T09:36:41.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.159+0000 7f0dd5ffb640 1 -- 172.21.15.1:0/910395892 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f0dd0018020 con 0x7f0de0101720 2024-09-19T09:36:41.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.159+0000 7f0dd5ffb640 1 --2- 172.21.15.1:0/910395892 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f0dc80a3350 0x7f0dc80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:41.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.160+0000 7f0de4df4640 1 --2- 172.21.15.1:0/910395892 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f0dc80a3350 0x7f0dc80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:41.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.160+0000 7f0dd5ffb640 1 -- 172.21.15.1:0/910395892 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f0dd00cf3a0 con 0x7f0de0101720 2024-09-19T09:36:41.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.160+0000 7f0de4df4640 1 --2- 172.21.15.1:0/910395892 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f0dc80a3350 0x7f0dc80a5810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc006fd0 tx=0x7f0ddc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:41.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.164+0000 7f0dd5ffb640 1 -- 172.21.15.1:0/910395892 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0dd001f020 con 0x7f0de0101720 2024-09-19T09:36:41.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:41 smithi022 ceph-mon[35583]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:36:41.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:41 smithi121 ceph-mon[35577]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:36:41.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.405+0000 7f0de7058640 1 -- 172.21.15.1:0/910395892 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f0de01a2ca0 con 0x7f0de0101720 2024-09-19T09:36:41.407 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:41 smithi001 ceph-mon[31225]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:36:41.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.407+0000 7f0dd5ffb640 1 -- 172.21.15.1:0/910395892 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f0dd000d040 con 0x7f0de0101720 2024-09-19T09:36:41.409 INFO:teuthology.orchestra.run.smithi001.stdout:[client.0] 2024-09-19T09:36:41.409 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQCp8OtmZVs8GBAAyr9t5zC/+GKoW05VAyRsiw== 2024-09-19T09:36:41.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.410+0000 7f0de7058640 1 -- 172.21.15.1:0/910395892 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f0dc80a3350 msgr2=0x7f0dc80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:41.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.410+0000 7f0de7058640 1 --2- 172.21.15.1:0/910395892 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f0dc80a3350 0x7f0dc80a5810 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc006fd0 tx=0x7f0ddc008040 comp rx=0 tx=0).stop 2024-09-19T09:36:41.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.410+0000 7f0de7058640 1 -- 172.21.15.1:0/910395892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0de0101720 msgr2=0x7f0de0103150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:41.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.410+0000 7f0de7058640 1 --2- 172.21.15.1:0/910395892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0de0101720 0x7f0de0103150 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0dd000b450 tx=0x7f0dd000b910 comp rx=0 tx=0).stop 2024-09-19T09:36:41.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.410+0000 7f0de7058640 1 -- 172.21.15.1:0/910395892 shutdown_connections 2024-09-19T09:36:41.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.410+0000 7f0de7058640 1 --2- 172.21.15.1:0/910395892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0de0102190 0x7f0de0103690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.411+0000 7f0de7058640 1 --2- 172.21.15.1:0/910395892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0de0101720 0x7f0de0103150 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.411+0000 7f0de7058640 1 --2- 172.21.15.1:0/910395892 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f0dc80a3350 0x7f0dc80a5810 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.411+0000 7f0de7058640 1 --2- 172.21.15.1:0/910395892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0de0100d60 0x7f0de0104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:41.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.411+0000 7f0de7058640 1 -- 172.21.15.1:0/910395892 >> 172.21.15.1:0/910395892 conn(0x7f0de00fba40 msgr2=0x7f0de00ffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:41.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.411+0000 7f0de7058640 1 -- 172.21.15.1:0/910395892 shutdown_connections 2024-09-19T09:36:41.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:41.411+0000 7f0de7058640 1 -- 172.21.15.1:0/910395892 wait complete. 2024-09-19T09:36:42.184 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:42 smithi001 ceph-mon[31225]: pgmap v294: 97 pgs: 97 active+clean; 629 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2024-09-19T09:36:42.184 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:42 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/910395892' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T09:36:42.185 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:42 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/910395892' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T09:36:42.214 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T09:36:42.214 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-19T09:36:42.214 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T09:36:42.251 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T09:36:42.251 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-19T09:36:42.252 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-19T09:36:42.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:42 smithi022 ceph-mon[35583]: pgmap v294: 97 pgs: 97 active+clean; 629 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2024-09-19T09:36:42.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:42 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/910395892' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T09:36:42.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:42 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/910395892' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T09:36:42.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:42 smithi121 ceph-mon[35577]: pgmap v294: 97 pgs: 97 active+clean; 629 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2024-09-19T09:36:42.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:42 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/910395892' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T09:36:42.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:42 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/910395892' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T09:36:42.546 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:43.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.043+0000 7f270613b640 1 -- 172.21.15.1:0/1026377256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2700102da0 msgr2=0x7f2700103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:43.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.043+0000 7f270613b640 1 --2- 172.21.15.1:0/1026377256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2700102da0 0x7f2700103180 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f26f0009ca0 tx=0x7f26f002a950 comp rx=0 tx=0).stop 2024-09-19T09:36:43.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.043+0000 7f270613b640 1 -- 172.21.15.1:0/1026377256 shutdown_connections 2024-09-19T09:36:43.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.043+0000 7f270613b640 1 --2- 172.21.15.1:0/1026377256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f270010c180 0x7f270010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.043+0000 7f270613b640 1 --2- 172.21.15.1:0/1026377256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27001036c0 0x7f270010bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.043+0000 7f270613b640 1 --2- 172.21.15.1:0/1026377256 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2700102da0 0x7f2700103180 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.043+0000 7f270613b640 1 -- 172.21.15.1:0/1026377256 >> 172.21.15.1:0/1026377256 conn(0x7f27000fc7a0 msgr2=0x7f27000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:43.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.043+0000 7f270613b640 1 -- 172.21.15.1:0/1026377256 shutdown_connections 2024-09-19T09:36:43.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.043+0000 7f270613b640 1 -- 172.21.15.1:0/1026377256 wait complete. 2024-09-19T09:36:43.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.044+0000 7f270613b640 1 Processor -- start 2024-09-19T09:36:43.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.044+0000 7f270613b640 1 -- start start 2024-09-19T09:36:43.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.044+0000 7f270613b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2700102da0 0x7f270019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:43.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.044+0000 7f270613b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27001036c0 0x7f270019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:43.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.044+0000 7f270613b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f270010c180 0x7f270019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:43.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.044+0000 7f270613b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2700111fa0 con 0x7f270010c180 2024-09-19T09:36:43.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.044+0000 7f270613b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2700111e20 con 0x7f2700102da0 2024-09-19T09:36:43.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.044+0000 7f270613b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2700112120 con 0x7f27001036c0 2024-09-19T09:36:43.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.045+0000 7f26fffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f270010c180 0x7f270019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:43.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.045+0000 7f26fffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f270010c180 0x7f270019ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46338/0 (socket says 172.21.15.1:46338) 2024-09-19T09:36:43.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.045+0000 7f26ff7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2700102da0 0x7f270019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:43.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.045+0000 7f26fffff640 1 -- 172.21.15.1:0/983394577 learned_addr learned my addr 172.21.15.1:0/983394577 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:43.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.045+0000 7f26feffd640 1 --2- 172.21.15.1:0/983394577 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27001036c0 0x7f270019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:43.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.045+0000 7f26fffff640 1 -- 172.21.15.1:0/983394577 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27001036c0 msgr2=0x7f270019ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:43.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.045+0000 7f26fffff640 1 --2- 172.21.15.1:0/983394577 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27001036c0 0x7f270019ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.045+0000 7f26fffff640 1 -- 172.21.15.1:0/983394577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2700102da0 msgr2=0x7f270019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:43.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.045+0000 7f26fffff640 1 --2- 172.21.15.1:0/983394577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2700102da0 0x7f270019a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.045+0000 7f26fffff640 1 -- 172.21.15.1:0/983394577 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f270019f5f0 con 0x7f270010c180 2024-09-19T09:36:43.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.045+0000 7f26feffd640 1 --2- 172.21.15.1:0/983394577 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27001036c0 0x7f270019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:43.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.045+0000 7f26fffff640 1 --2- 172.21.15.1:0/983394577 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f270010c180 0x7f270019ef10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f26f800c970 tx=0x7f26f800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:43.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.045+0000 7f26fcff9640 1 -- 172.21.15.1:0/983394577 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f8007bb0 con 0x7f270010c180 2024-09-19T09:36:43.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.045+0000 7f270613b640 1 -- 172.21.15.1:0/983394577 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f270019f8e0 con 0x7f270010c180 2024-09-19T09:36:43.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.045+0000 7f26fcff9640 1 -- 172.21.15.1:0/983394577 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f26f8007d50 con 0x7f270010c180 2024-09-19T09:36:43.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.045+0000 7f26fcff9640 1 -- 172.21.15.1:0/983394577 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f8018800 con 0x7f270010c180 2024-09-19T09:36:43.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.045+0000 7f270613b640 1 -- 172.21.15.1:0/983394577 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27001a71c0 con 0x7f270010c180 2024-09-19T09:36:43.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.046+0000 7f270613b640 1 -- 172.21.15.1:0/983394577 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2700103180 con 0x7f270010c180 2024-09-19T09:36:43.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.048+0000 7f26fcff9640 1 -- 172.21.15.1:0/983394577 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f26f800fa50 con 0x7f270010c180 2024-09-19T09:36:43.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.049+0000 7f26fcff9640 1 --2- 172.21.15.1:0/983394577 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f26e80a3350 0x7f26e80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:43.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.049+0000 7f26ff7fe640 1 --2- 172.21.15.1:0/983394577 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f26e80a3350 0x7f26e80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:43.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.049+0000 7f26fcff9640 1 -- 172.21.15.1:0/983394577 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f26f80cfa80 con 0x7f270010c180 2024-09-19T09:36:43.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.049+0000 7f26ff7fe640 1 --2- 172.21.15.1:0/983394577 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f26e80a3350 0x7f26e80a5810 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f26f00093d0 tx=0x7f26f0009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:43.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.052+0000 7f26fcff9640 1 -- 172.21.15.1:0/983394577 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f26f8014030 con 0x7f270010c180 2024-09-19T09:36:43.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.274+0000 7f270613b640 1 -- 172.21.15.1:0/983394577 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f270019b9a0 con 0x7f270010c180 2024-09-19T09:36:43.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.279+0000 7f26fcff9640 1 -- 172.21.15.1:0/983394577 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264039 (secure 0 0 0) 0x7f270019b9a0 con 0x7f270010c180 2024-09-19T09:36:43.283 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:36:43.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.281+0000 7f270613b640 1 -- 172.21.15.1:0/983394577 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f26e80a3350 msgr2=0x7f26e80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:43.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.281+0000 7f270613b640 1 --2- 172.21.15.1:0/983394577 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f26e80a3350 0x7f26e80a5810 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f26f00093d0 tx=0x7f26f0009360 comp rx=0 tx=0).stop 2024-09-19T09:36:43.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.281+0000 7f270613b640 1 -- 172.21.15.1:0/983394577 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f270010c180 msgr2=0x7f270019ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:43.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.281+0000 7f270613b640 1 --2- 172.21.15.1:0/983394577 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f270010c180 0x7f270019ef10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f26f800c970 tx=0x7f26f800ce30 comp rx=0 tx=0).stop 2024-09-19T09:36:43.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.282+0000 7f270613b640 1 -- 172.21.15.1:0/983394577 shutdown_connections 2024-09-19T09:36:43.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.282+0000 7f270613b640 1 --2- 172.21.15.1:0/983394577 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f270010c180 0x7f270019ef10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.282+0000 7f270613b640 1 --2- 172.21.15.1:0/983394577 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27001036c0 0x7f270019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.282+0000 7f270613b640 1 --2- 172.21.15.1:0/983394577 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f26e80a3350 0x7f26e80a5810 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.282+0000 7f270613b640 1 --2- 172.21.15.1:0/983394577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2700102da0 0x7f270019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:43.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.282+0000 7f270613b640 1 -- 172.21.15.1:0/983394577 >> 172.21.15.1:0/983394577 conn(0x7f27000fc7a0 msgr2=0x7f2700100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:43.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.282+0000 7f270613b640 1 -- 172.21.15.1:0/983394577 shutdown_connections 2024-09-19T09:36:43.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:43.282+0000 7f270613b640 1 -- 172.21.15.1:0/983394577 wait complete. 2024-09-19T09:36:44.010 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":3871697789},{"type":"v1","addr":"172.21.15.1:6801","nonce":3871697789}]},"active_addr":"172.21.15.1:6801/3871697789","active_change":"2024-09-19T09:29:14.047073+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.1:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":44706134}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":1262110380}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":3056123799}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":3629407954}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.1:0","nonce":3139149452}]}]} 2024-09-19T09:36:44.017 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-19T09:36:44.017 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-19T09:36:44.017 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:36:44.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:44 smithi001 ceph-mon[31225]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.2 KiB/s wr, 5 op/s 2024-09-19T09:36:44.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:44 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/983394577' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T09:36:44.276 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:44.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:44 smithi022 ceph-mon[35583]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.2 KiB/s wr, 5 op/s 2024-09-19T09:36:44.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:44 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/983394577' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T09:36:44.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:44 smithi121 ceph-mon[35577]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 5.2 KiB/s wr, 5 op/s 2024-09-19T09:36:44.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:44 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/983394577' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T09:36:44.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.788+0000 7fdafa64f640 1 -- 172.21.15.1:0/3127933592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdaf4102790 msgr2=0x7fdaf41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:44.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.788+0000 7fdafa64f640 1 --2- 172.21.15.1:0/3127933592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdaf4102790 0x7fdaf41067e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdae8009900 tx=0x7fdae802a410 comp rx=0 tx=0).stop 2024-09-19T09:36:44.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.788+0000 7fdafa64f640 1 -- 172.21.15.1:0/3127933592 shutdown_connections 2024-09-19T09:36:44.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.788+0000 7fdafa64f640 1 --2- 172.21.15.1:0/3127933592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdaf4106f10 0x7fdaf410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.788+0000 7fdafa64f640 1 --2- 172.21.15.1:0/3127933592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdaf4102790 0x7fdaf41067e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.788+0000 7fdafa64f640 1 --2- 172.21.15.1:0/3127933592 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdaf4101de0 0x7fdaf41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.788+0000 7fdafa64f640 1 -- 172.21.15.1:0/3127933592 >> 172.21.15.1:0/3127933592 conn(0x7fdaf40fd8c0 msgr2=0x7fdaf40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:44.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.788+0000 7fdafa64f640 1 -- 172.21.15.1:0/3127933592 shutdown_connections 2024-09-19T09:36:44.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.788+0000 7fdafa64f640 1 -- 172.21.15.1:0/3127933592 wait complete. 2024-09-19T09:36:44.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.788+0000 7fdafa64f640 1 Processor -- start 2024-09-19T09:36:44.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.788+0000 7fdafa64f640 1 -- start start 2024-09-19T09:36:44.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.789+0000 7fdafa64f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdaf4101de0 0x7fdaf4198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:44.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.789+0000 7fdafa64f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdaf4102790 0x7fdaf4198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:44.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.789+0000 7fdafa64f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdaf4106f10 0x7fdaf419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:44.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.789+0000 7fdafa64f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf4111f90 con 0x7fdaf4102790 2024-09-19T09:36:44.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.789+0000 7fdafa64f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf4111e10 con 0x7fdaf4106f10 2024-09-19T09:36:44.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.789+0000 7fdafa64f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf4112110 con 0x7fdaf4101de0 2024-09-19T09:36:44.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.789+0000 7fdaf37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdaf4102790 0x7fdaf4198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:44.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.789+0000 7fdaf37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdaf4102790 0x7fdaf4198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46358/0 (socket says 172.21.15.1:46358) 2024-09-19T09:36:44.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.789+0000 7fdaf37fe640 1 -- 172.21.15.1:0/1069752778 learned_addr learned my addr 172.21.15.1:0/1069752778 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:44.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.789+0000 7fdaf8bec640 1 --2- 172.21.15.1:0/1069752778 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdaf4106f10 0x7fdaf419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:44.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.789+0000 7fdaf3fff640 1 --2- 172.21.15.1:0/1069752778 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdaf4101de0 0x7fdaf4198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:44.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.789+0000 7fdaf37fe640 1 -- 172.21.15.1:0/1069752778 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdaf4101de0 msgr2=0x7fdaf4198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:44.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.789+0000 7fdaf37fe640 1 --2- 172.21.15.1:0/1069752778 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdaf4101de0 0x7fdaf4198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.789+0000 7fdaf37fe640 1 -- 172.21.15.1:0/1069752778 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdaf4106f10 msgr2=0x7fdaf419cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:44.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.789+0000 7fdaf37fe640 1 --2- 172.21.15.1:0/1069752778 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdaf4106f10 0x7fdaf419cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.789+0000 7fdaf37fe640 1 -- 172.21.15.1:0/1069752778 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf419d4c0 con 0x7fdaf4102790 2024-09-19T09:36:44.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.789+0000 7fdaf8bec640 1 --2- 172.21.15.1:0/1069752778 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdaf4106f10 0x7fdaf419cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:44.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.789+0000 7fdaf3fff640 1 --2- 172.21.15.1:0/1069752778 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdaf4101de0 0x7fdaf4198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:44.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.789+0000 7fdaf37fe640 1 --2- 172.21.15.1:0/1069752778 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdaf4102790 0x7fdaf4198a50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdae8005ab0 tx=0x7fdae80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:44.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.789+0000 7fdaf17fa640 1 -- 172.21.15.1:0/1069752778 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae803f030 con 0x7fdaf4102790 2024-09-19T09:36:44.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.789+0000 7fdafa64f640 1 -- 172.21.15.1:0/1069752778 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaf419d750 con 0x7fdaf4102790 2024-09-19T09:36:44.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.789+0000 7fdaf17fa640 1 -- 172.21.15.1:0/1069752778 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdae8003ce0 con 0x7fdaf4102790 2024-09-19T09:36:44.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.789+0000 7fdaf17fa640 1 -- 172.21.15.1:0/1069752778 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae8035070 con 0x7fdaf4102790 2024-09-19T09:36:44.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.790+0000 7fdafa64f640 1 -- 172.21.15.1:0/1069752778 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaf41a5090 con 0x7fdaf4102790 2024-09-19T09:36:44.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.790+0000 7fdafa64f640 1 -- 172.21.15.1:0/1069752778 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaf41021c0 con 0x7fdaf4102790 2024-09-19T09:36:44.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.792+0000 7fdaf17fa640 1 -- 172.21.15.1:0/1069752778 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fdae8042030 con 0x7fdaf4102790 2024-09-19T09:36:44.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.793+0000 7fdaf17fa640 1 --2- 172.21.15.1:0/1069752778 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fdadc0a32d0 0x7fdadc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:44.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.793+0000 7fdaf3fff640 1 --2- 172.21.15.1:0/1069752778 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fdadc0a32d0 0x7fdadc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:44.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.793+0000 7fdaf17fa640 1 -- 172.21.15.1:0/1069752778 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fdae80f0290 con 0x7fdaf4102790 2024-09-19T09:36:44.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.793+0000 7fdaf3fff640 1 --2- 172.21.15.1:0/1069752778 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fdadc0a32d0 0x7fdadc0a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdae4009930 tx=0x7fdae4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:44.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.797+0000 7fdaf17fa640 1 -- 172.21.15.1:0/1069752778 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdae80bd000 con 0x7fdaf4102790 2024-09-19T09:36:44.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.975+0000 7fdafa64f640 1 -- 172.21.15.1:0/1069752778 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdaf410a0f0 con 0x7fdaf4102790 2024-09-19T09:36:44.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.976+0000 7fdaf17fa640 1 -- 172.21.15.1:0/1069752778 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22187 (secure 0 0 0) 0x7fdae80bc900 con 0x7fdaf4102790 2024-09-19T09:36:44.978 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:36:44.978 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":81,"fsid":"57238232-7669-11ef-bceb-c7b262605968","created":"2024-09-19T09:28:28.406983+0000","modified":"2024-09-19T09:36:13.637291+0000","last_up_change":"2024-09-19T09:35:21.422825+0000","last_in_change":"2024-09-19T09:34:57.199184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:31:30.566509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:36:09.521275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:36:11.954337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c165571d-43f1-4c43-ba1e-35872d914f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6803","nonce":502676986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6805","nonce":502676986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6809","nonce":502676986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6807","nonce":502676986}]},"public_addr":"172.21.15.1:6803/502676986","cluster_addr":"172.21.15.1:6805/502676986","heartbeat_back_addr":"172.21.15.1:6809/502676986","heartbeat_front_addr":"172.21.15.1:6807/502676986","state":["exists","up"]},{"osd":1,"uuid":"baf120f8-8ba3-4aa5-a12a-41cdc97ff11b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6801","nonce":3735826323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6803","nonce":3735826323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6807","nonce":3735826323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6805","nonce":3735826323}]},"public_addr":"172.21.15.22:6801/3735826323","cluster_addr":"172.21.15.22:6803/3735826323","heartbeat_back_addr":"172.21.15.22:6807/3735826323","heartbeat_front_addr":"172.21.15.22:6805/3735826323","state":["exists","up"]},{"osd":2,"uuid":"72c520bf-c5cc-44ee-a38c-c9bac0a6280b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6801","nonce":1924970833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6803","nonce":1924970833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6807","nonce":1924970833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6805","nonce":1924970833}]},"public_addr":"172.21.15.121:6801/1924970833","cluster_addr":"172.21.15.121:6803/1924970833","heartbeat_back_addr":"172.21.15.121:6807/1924970833","heartbeat_front_addr":"172.21.15.121:6805/1924970833","state":["exists","up"]},{"osd":3,"uuid":"adad6d17-16d9-4c43-b581-35ac1bb9d807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6811","nonce":1515009793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6813","nonce":1515009793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6817","nonce":1515009793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6815","nonce":1515009793}]},"public_addr":"172.21.15.1:6811/1515009793","cluster_addr":"172.21.15.1:6813/1515009793","heartbeat_back_addr":"172.21.15.1:6817/1515009793","heartbeat_front_addr":"172.21.15.1:6815/1515009793","state":["exists","up"]},{"osd":4,"uuid":"8fb06efe-c3a0-48a3-9730-3e8f3e60922d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6809","nonce":923697266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6811","nonce":923697266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6815","nonce":923697266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6813","nonce":923697266}]},"public_addr":"172.21.15.22:6809/923697266","cluster_addr":"172.21.15.22:6811/923697266","heartbeat_back_addr":"172.21.15.22:6815/923697266","heartbeat_front_addr":"172.21.15.22:6813/923697266","state":["exists","up"]},{"osd":5,"uuid":"3b2f428c-8a5a-49be-9f43-a9f379a1c7e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6809","nonce":3137245658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6811","nonce":3137245658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6815","nonce":3137245658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6813","nonce":3137245658}]},"public_addr":"172.21.15.121:6809/3137245658","cluster_addr":"172.21.15.121:6811/3137245658","heartbeat_back_addr":"172.21.15.121:6815/3137245658","heartbeat_front_addr":"172.21.15.121:6813/3137245658","state":["exists","up"]},{"osd":6,"uuid":"5aecec68-ff7e-440c-bd39-cc35ab89cc91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6819","nonce":3376780798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6821","nonce":3376780798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6825","nonce":3376780798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6823","nonce":3376780798}]},"public_addr":"172.21.15.1:6819/3376780798","cluster_addr":"172.21.15.1:6821/3376780798","heartbeat_back_addr":"172.21.15.1:6825/3376780798","heartbeat_front_addr":"172.21.15.1:6823/3376780798","state":["exists","up"]},{"osd":7,"uuid":"46556bdf-199e-4268-873b-6d87b54e1176","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6817","nonce":2920985295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6819","nonce":2920985295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6823","nonce":2920985295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6821","nonce":2920985295}]},"public_addr":"172.21.15.22:6817/2920985295","cluster_addr":"172.21.15.22:6819/2920985295","heartbeat_back_addr":"172.21.15.22:6823/2920985295","heartbeat_front_addr":"172.21.15.22:6821/2920985295","state":["exists","up"]},{"osd":8,"uuid":"e7c3792a-94a4-4440-be74-d6abdf3d9566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6817","nonce":3589985967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6819","nonce":3589985967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6823","nonce":3589985967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6821","nonce":3589985967}]},"public_addr":"172.21.15.121:6817/3589985967","cluster_addr":"172.21.15.121:6819/3589985967","heartbeat_back_addr":"172.21.15.121:6823/3589985967","heartbeat_front_addr":"172.21.15.121:6821/3589985967","state":["exists","up"]},{"osd":9,"uuid":"8af80ac9-d681-4966-b083-ead5185eff12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6827","nonce":1143859822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6829","nonce":1143859822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6833","nonce":1143859822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6831","nonce":1143859822}]},"public_addr":"172.21.15.1:6827/1143859822","cluster_addr":"172.21.15.1:6829/1143859822","heartbeat_back_addr":"172.21.15.1:6833/1143859822","heartbeat_front_addr":"172.21.15.1:6831/1143859822","state":["exists","up"]},{"osd":10,"uuid":"34edd06a-7f60-4465-bfe1-0c646abd53f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6825","nonce":343155547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6827","nonce":343155547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6831","nonce":343155547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6829","nonce":343155547}]},"public_addr":"172.21.15.22:6825/343155547","cluster_addr":"172.21.15.22:6827/343155547","heartbeat_back_addr":"172.21.15.22:6831/343155547","heartbeat_front_addr":"172.21.15.22:6829/343155547","state":["exists","up"]},{"osd":11,"uuid":"5a831eb6-ad66-4ab6-a30a-b6299ce1f88d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6825","nonce":3202514460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6827","nonce":3202514460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6831","nonce":3202514460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6829","nonce":3202514460}]},"public_addr":"172.21.15.121:6825/3202514460","cluster_addr":"172.21.15.121:6827/3202514460","heartbeat_back_addr":"172.21.15.121:6831/3202514460","heartbeat_front_addr":"172.21.15.121:6829/3202514460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:30:37.582893+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:01.915252+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:26.783477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:53.407014+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:19.407005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:45.022320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:11.377986+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:36.818700+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:01.745428+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:27.928916+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:53.363906+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:19.037551+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6800/1028873727":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/3137949087":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/1951370933":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2008363642":"2024-09-20T09:28:50.074985+0000","172.21.15.1:0/3006931063":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2486161758":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6801/1296304385":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6801/1028873727":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2783823049":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6800/1296304385":"2024-09-20T09:28:50.074985+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:36:44.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.978+0000 7fdafa64f640 1 -- 172.21.15.1:0/1069752778 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fdadc0a32d0 msgr2=0x7fdadc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:44.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.978+0000 7fdafa64f640 1 --2- 172.21.15.1:0/1069752778 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fdadc0a32d0 0x7fdadc0a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdae4009930 tx=0x7fdae4008040 comp rx=0 tx=0).stop 2024-09-19T09:36:44.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.978+0000 7fdafa64f640 1 -- 172.21.15.1:0/1069752778 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdaf4102790 msgr2=0x7fdaf4198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:44.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.978+0000 7fdafa64f640 1 --2- 172.21.15.1:0/1069752778 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdaf4102790 0x7fdaf4198a50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdae8005ab0 tx=0x7fdae80042f0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.979+0000 7fdafa64f640 1 -- 172.21.15.1:0/1069752778 shutdown_connections 2024-09-19T09:36:44.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.979+0000 7fdafa64f640 1 --2- 172.21.15.1:0/1069752778 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fdadc0a32d0 0x7fdadc0a5790 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.979+0000 7fdafa64f640 1 --2- 172.21.15.1:0/1069752778 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdaf4106f10 0x7fdaf419cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.979+0000 7fdafa64f640 1 --2- 172.21.15.1:0/1069752778 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdaf4102790 0x7fdaf4198a50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.979+0000 7fdafa64f640 1 --2- 172.21.15.1:0/1069752778 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdaf4101de0 0x7fdaf4198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:44.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.979+0000 7fdafa64f640 1 -- 172.21.15.1:0/1069752778 >> 172.21.15.1:0/1069752778 conn(0x7fdaf40fd8c0 msgr2=0x7fdaf40fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:44.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.979+0000 7fdafa64f640 1 -- 172.21.15.1:0/1069752778 shutdown_connections 2024-09-19T09:36:44.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:44.979+0000 7fdafa64f640 1 -- 172.21.15.1:0/1069752778 wait complete. 2024-09-19T09:36:45.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:45 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1069752778' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:36:45.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:45 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1069752778' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:36:45.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:45 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1069752778' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:36:45.720 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-19T09:36:45.721 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:36:45.980 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:46.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:46 smithi022 ceph-mon[35583]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-19T09:36:46.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:46 smithi121 ceph-mon[35577]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-19T09:36:46.400 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:46 smithi001 ceph-mon[31225]: pgmap v296: 97 pgs: 97 active+clean; 638 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-19T09:36:46.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.480+0000 7f4693f0c640 1 -- 172.21.15.1:0/2115044495 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f468c106f10 msgr2=0x7f468c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:46.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.480+0000 7f4693f0c640 1 --2- 172.21.15.1:0/2115044495 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f468c106f10 0x7f468c10ea90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4684009ca0 tx=0x7f468402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:36:46.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.480+0000 7f4693f0c640 1 -- 172.21.15.1:0/2115044495 shutdown_connections 2024-09-19T09:36:46.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.480+0000 7f4693f0c640 1 --2- 172.21.15.1:0/2115044495 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f468c106f10 0x7f468c10ea90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:46.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.480+0000 7f4693f0c640 1 --2- 172.21.15.1:0/2115044495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f468c102790 0x7f468c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:46.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.480+0000 7f4693f0c640 1 --2- 172.21.15.1:0/2115044495 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f468c101de0 0x7f468c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:46.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.480+0000 7f4693f0c640 1 -- 172.21.15.1:0/2115044495 >> 172.21.15.1:0/2115044495 conn(0x7f468c0fd8c0 msgr2=0x7f468c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:46.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.480+0000 7f4693f0c640 1 -- 172.21.15.1:0/2115044495 shutdown_connections 2024-09-19T09:36:46.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.481+0000 7f4693f0c640 1 -- 172.21.15.1:0/2115044495 wait complete. 2024-09-19T09:36:46.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.481+0000 7f4693f0c640 1 Processor -- start 2024-09-19T09:36:46.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.481+0000 7f4693f0c640 1 -- start start 2024-09-19T09:36:46.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.481+0000 7f4693f0c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f468c101de0 0x7f468c1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:46.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.481+0000 7f4693f0c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f468c102790 0x7f468c1988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:46.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.481+0000 7f4693f0c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f468c106f10 0x7f468c19cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:46.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.481+0000 7f4693f0c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f468c111f70 con 0x7f468c106f10 2024-09-19T09:36:46.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.481+0000 7f4693f0c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f468c111df0 con 0x7f468c102790 2024-09-19T09:36:46.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.481+0000 7f4693f0c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f468c1120f0 con 0x7f468c101de0 2024-09-19T09:36:46.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.482+0000 7f46924a9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f468c106f10 0x7f468c19cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:46.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.482+0000 7f46924a9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f468c106f10 0x7f468c19cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55242/0 (socket says 172.21.15.1:55242) 2024-09-19T09:36:46.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.482+0000 7f46924a9640 1 -- 172.21.15.1:0/1158421576 learned_addr learned my addr 172.21.15.1:0/1158421576 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:46.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.482+0000 7f46914a7640 1 --2- 172.21.15.1:0/1158421576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f468c102790 0x7f468c1988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:46.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.482+0000 7f4691ca8640 1 --2- 172.21.15.1:0/1158421576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f468c101de0 0x7f468c1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:46.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.482+0000 7f46924a9640 1 -- 172.21.15.1:0/1158421576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f468c101de0 msgr2=0x7f468c1983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:46.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.482+0000 7f46924a9640 1 --2- 172.21.15.1:0/1158421576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f468c101de0 0x7f468c1983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:46.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.482+0000 7f46924a9640 1 -- 172.21.15.1:0/1158421576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f468c102790 msgr2=0x7f468c1988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:46.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.482+0000 7f46924a9640 1 --2- 172.21.15.1:0/1158421576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f468c102790 0x7f468c1988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:46.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.482+0000 7f46924a9640 1 -- 172.21.15.1:0/1158421576 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f468c19d360 con 0x7f468c106f10 2024-09-19T09:36:46.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.482+0000 7f46924a9640 1 --2- 172.21.15.1:0/1158421576 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f468c106f10 0x7f468c19cc80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4684031a20 tx=0x7f4684031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:46.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.482+0000 7f4682ffd640 1 -- 172.21.15.1:0/1158421576 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4684003c30 con 0x7f468c106f10 2024-09-19T09:36:46.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.482+0000 7f4693f0c640 1 -- 172.21.15.1:0/1158421576 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f468c19d5f0 con 0x7f468c106f10 2024-09-19T09:36:46.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.482+0000 7f4682ffd640 1 -- 172.21.15.1:0/1158421576 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4684003dd0 con 0x7f468c106f10 2024-09-19T09:36:46.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.482+0000 7f4682ffd640 1 -- 172.21.15.1:0/1158421576 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468402fcf0 con 0x7f468c106f10 2024-09-19T09:36:46.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.483+0000 7f4693f0c640 1 -- 172.21.15.1:0/1158421576 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f468c1a4f30 con 0x7f468c106f10 2024-09-19T09:36:46.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.483+0000 7f4693f0c640 1 -- 172.21.15.1:0/1158421576 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f468c1021c0 con 0x7f468c106f10 2024-09-19T09:36:46.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.485+0000 7f4682ffd640 1 -- 172.21.15.1:0/1158421576 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f4684004050 con 0x7f468c106f10 2024-09-19T09:36:46.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.485+0000 7f4682ffd640 1 --2- 172.21.15.1:0/1158421576 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f46780a32d0 0x7f46780a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:46.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.486+0000 7f4691ca8640 1 --2- 172.21.15.1:0/1158421576 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f46780a32d0 0x7f46780a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:46.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.486+0000 7f4682ffd640 1 -- 172.21.15.1:0/1158421576 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f46840f0c60 con 0x7f468c106f10 2024-09-19T09:36:46.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.486+0000 7f4691ca8640 1 --2- 172.21.15.1:0/1158421576 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f46780a32d0 0x7f46780a5790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4688005d00 tx=0x7f468800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:46.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.490+0000 7f4682ffd640 1 -- 172.21.15.1:0/1158421576 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f46840bdb70 con 0x7f468c106f10 2024-09-19T09:36:46.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.669+0000 7f4693f0c640 1 -- 172.21.15.1:0/1158421576 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f468c10a150 con 0x7f468c106f10 2024-09-19T09:36:46.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.670+0000 7f4682ffd640 1 -- 172.21.15.1:0/1158421576 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22187 (secure 0 0 0) 0x7f468402fe90 con 0x7f468c106f10 2024-09-19T09:36:46.672 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:36:46.672 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":81,"fsid":"57238232-7669-11ef-bceb-c7b262605968","created":"2024-09-19T09:28:28.406983+0000","modified":"2024-09-19T09:36:13.637291+0000","last_up_change":"2024-09-19T09:35:21.422825+0000","last_in_change":"2024-09-19T09:34:57.199184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:31:30.566509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:36:09.521275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:36:11.954337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c165571d-43f1-4c43-ba1e-35872d914f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6803","nonce":502676986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6805","nonce":502676986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6809","nonce":502676986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6807","nonce":502676986}]},"public_addr":"172.21.15.1:6803/502676986","cluster_addr":"172.21.15.1:6805/502676986","heartbeat_back_addr":"172.21.15.1:6809/502676986","heartbeat_front_addr":"172.21.15.1:6807/502676986","state":["exists","up"]},{"osd":1,"uuid":"baf120f8-8ba3-4aa5-a12a-41cdc97ff11b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6801","nonce":3735826323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6803","nonce":3735826323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6807","nonce":3735826323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6805","nonce":3735826323}]},"public_addr":"172.21.15.22:6801/3735826323","cluster_addr":"172.21.15.22:6803/3735826323","heartbeat_back_addr":"172.21.15.22:6807/3735826323","heartbeat_front_addr":"172.21.15.22:6805/3735826323","state":["exists","up"]},{"osd":2,"uuid":"72c520bf-c5cc-44ee-a38c-c9bac0a6280b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6801","nonce":1924970833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6803","nonce":1924970833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6807","nonce":1924970833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6805","nonce":1924970833}]},"public_addr":"172.21.15.121:6801/1924970833","cluster_addr":"172.21.15.121:6803/1924970833","heartbeat_back_addr":"172.21.15.121:6807/1924970833","heartbeat_front_addr":"172.21.15.121:6805/1924970833","state":["exists","up"]},{"osd":3,"uuid":"adad6d17-16d9-4c43-b581-35ac1bb9d807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6811","nonce":1515009793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6813","nonce":1515009793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6817","nonce":1515009793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6815","nonce":1515009793}]},"public_addr":"172.21.15.1:6811/1515009793","cluster_addr":"172.21.15.1:6813/1515009793","heartbeat_back_addr":"172.21.15.1:6817/1515009793","heartbeat_front_addr":"172.21.15.1:6815/1515009793","state":["exists","up"]},{"osd":4,"uuid":"8fb06efe-c3a0-48a3-9730-3e8f3e60922d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6809","nonce":923697266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6811","nonce":923697266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6815","nonce":923697266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6813","nonce":923697266}]},"public_addr":"172.21.15.22:6809/923697266","cluster_addr":"172.21.15.22:6811/923697266","heartbeat_back_addr":"172.21.15.22:6815/923697266","heartbeat_front_addr":"172.21.15.22:6813/923697266","state":["exists","up"]},{"osd":5,"uuid":"3b2f428c-8a5a-49be-9f43-a9f379a1c7e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6809","nonce":3137245658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6811","nonce":3137245658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6815","nonce":3137245658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6813","nonce":3137245658}]},"public_addr":"172.21.15.121:6809/3137245658","cluster_addr":"172.21.15.121:6811/3137245658","heartbeat_back_addr":"172.21.15.121:6815/3137245658","heartbeat_front_addr":"172.21.15.121:6813/3137245658","state":["exists","up"]},{"osd":6,"uuid":"5aecec68-ff7e-440c-bd39-cc35ab89cc91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6819","nonce":3376780798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6821","nonce":3376780798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6825","nonce":3376780798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6823","nonce":3376780798}]},"public_addr":"172.21.15.1:6819/3376780798","cluster_addr":"172.21.15.1:6821/3376780798","heartbeat_back_addr":"172.21.15.1:6825/3376780798","heartbeat_front_addr":"172.21.15.1:6823/3376780798","state":["exists","up"]},{"osd":7,"uuid":"46556bdf-199e-4268-873b-6d87b54e1176","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6817","nonce":2920985295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6819","nonce":2920985295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6823","nonce":2920985295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6821","nonce":2920985295}]},"public_addr":"172.21.15.22:6817/2920985295","cluster_addr":"172.21.15.22:6819/2920985295","heartbeat_back_addr":"172.21.15.22:6823/2920985295","heartbeat_front_addr":"172.21.15.22:6821/2920985295","state":["exists","up"]},{"osd":8,"uuid":"e7c3792a-94a4-4440-be74-d6abdf3d9566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6817","nonce":3589985967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6819","nonce":3589985967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6823","nonce":3589985967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6821","nonce":3589985967}]},"public_addr":"172.21.15.121:6817/3589985967","cluster_addr":"172.21.15.121:6819/3589985967","heartbeat_back_addr":"172.21.15.121:6823/3589985967","heartbeat_front_addr":"172.21.15.121:6821/3589985967","state":["exists","up"]},{"osd":9,"uuid":"8af80ac9-d681-4966-b083-ead5185eff12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6827","nonce":1143859822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6829","nonce":1143859822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6833","nonce":1143859822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6831","nonce":1143859822}]},"public_addr":"172.21.15.1:6827/1143859822","cluster_addr":"172.21.15.1:6829/1143859822","heartbeat_back_addr":"172.21.15.1:6833/1143859822","heartbeat_front_addr":"172.21.15.1:6831/1143859822","state":["exists","up"]},{"osd":10,"uuid":"34edd06a-7f60-4465-bfe1-0c646abd53f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6825","nonce":343155547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6827","nonce":343155547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6831","nonce":343155547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6829","nonce":343155547}]},"public_addr":"172.21.15.22:6825/343155547","cluster_addr":"172.21.15.22:6827/343155547","heartbeat_back_addr":"172.21.15.22:6831/343155547","heartbeat_front_addr":"172.21.15.22:6829/343155547","state":["exists","up"]},{"osd":11,"uuid":"5a831eb6-ad66-4ab6-a30a-b6299ce1f88d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6825","nonce":3202514460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6827","nonce":3202514460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6831","nonce":3202514460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6829","nonce":3202514460}]},"public_addr":"172.21.15.121:6825/3202514460","cluster_addr":"172.21.15.121:6827/3202514460","heartbeat_back_addr":"172.21.15.121:6831/3202514460","heartbeat_front_addr":"172.21.15.121:6829/3202514460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:30:37.582893+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:01.915252+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:26.783477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:53.407014+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:19.407005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:45.022320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:11.377986+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:36.818700+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:01.745428+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:27.928916+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:53.363906+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:19.037551+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6800/1028873727":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/3137949087":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/1951370933":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2008363642":"2024-09-20T09:28:50.074985+0000","172.21.15.1:0/3006931063":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2486161758":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6801/1296304385":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6801/1028873727":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2783823049":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6800/1296304385":"2024-09-20T09:28:50.074985+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:36:46.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.672+0000 7f4693f0c640 1 -- 172.21.15.1:0/1158421576 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f46780a32d0 msgr2=0x7f46780a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:46.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.672+0000 7f4693f0c640 1 --2- 172.21.15.1:0/1158421576 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f46780a32d0 0x7f46780a5790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4688005d00 tx=0x7f468800b410 comp rx=0 tx=0).stop 2024-09-19T09:36:46.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.672+0000 7f4693f0c640 1 -- 172.21.15.1:0/1158421576 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f468c106f10 msgr2=0x7f468c19cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:46.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.672+0000 7f4693f0c640 1 --2- 172.21.15.1:0/1158421576 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f468c106f10 0x7f468c19cc80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4684031a20 tx=0x7f4684031a50 comp rx=0 tx=0).stop 2024-09-19T09:36:46.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.672+0000 7f4693f0c640 1 -- 172.21.15.1:0/1158421576 shutdown_connections 2024-09-19T09:36:46.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.672+0000 7f4693f0c640 1 --2- 172.21.15.1:0/1158421576 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f468c106f10 0x7f468c19cc80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:46.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.672+0000 7f4693f0c640 1 --2- 172.21.15.1:0/1158421576 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f46780a32d0 0x7f46780a5790 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:46.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.672+0000 7f4693f0c640 1 --2- 172.21.15.1:0/1158421576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f468c102790 0x7f468c1988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:46.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.672+0000 7f4693f0c640 1 --2- 172.21.15.1:0/1158421576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f468c101de0 0x7f468c1983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:46.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.672+0000 7f4693f0c640 1 -- 172.21.15.1:0/1158421576 >> 172.21.15.1:0/1158421576 conn(0x7f468c0fd8c0 msgr2=0x7f468c0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:46.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.672+0000 7f4693f0c640 1 -- 172.21.15.1:0/1158421576 shutdown_connections 2024-09-19T09:36:46.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:46.672+0000 7f4693f0c640 1 -- 172.21.15.1:0/1158421576 wait complete. 2024-09-19T09:36:47.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:47 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1158421576' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:36:47.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:47 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1158421576' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:36:47.382 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:47 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1158421576' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:36:47.414 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-19T09:36:47.415 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-19T09:36:47.415 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-19T09:36:47.415 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-19T09:36:47.416 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-19T09:36:47.416 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-19T09:36:47.417 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-19T09:36:47.418 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-19T09:36:47.418 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-19T09:36:47.419 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-19T09:36:47.419 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-19T09:36:47.419 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-19T09:36:48.165 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:48.360 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:48 smithi001 ceph-mon[31225]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.3 KiB/s wr, 4 op/s 2024-09-19T09:36:48.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:48 smithi022 ceph-mon[35583]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.3 KiB/s wr, 4 op/s 2024-09-19T09:36:48.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:48 smithi121 ceph-mon[35577]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.3 KiB/s wr, 4 op/s 2024-09-19T09:36:48.546 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:48.551 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:48.551 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:48.560 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:48.560 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:48.560 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:48.562 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:48.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.877+0000 7f22d89fa640 1 -- 172.21.15.1:0/2793451015 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22d4103740 msgr2=0x7f22d4107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:48.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.877+0000 7f22d89fa640 1 --2- 172.21.15.1:0/2793451015 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22d4103740 0x7f22d4107b80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f22bc009930 tx=0x7f22bc02a420 comp rx=0 tx=0).stop 2024-09-19T09:36:48.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.877+0000 7f22d89fa640 1 -- 172.21.15.1:0/2793451015 shutdown_connections 2024-09-19T09:36:48.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.877+0000 7f22d89fa640 1 --2- 172.21.15.1:0/2793451015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22d4108290 0x7f22d410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.877+0000 7f22d89fa640 1 --2- 172.21.15.1:0/2793451015 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22d4103740 0x7f22d4107b80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.877+0000 7f22d89fa640 1 --2- 172.21.15.1:0/2793451015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22d4102d90 0x7f22d4103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.877+0000 7f22d89fa640 1 -- 172.21.15.1:0/2793451015 >> 172.21.15.1:0/2793451015 conn(0x7f22d40fc7d0 msgr2=0x7f22d40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:48.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.877+0000 7f22d89fa640 1 -- 172.21.15.1:0/2793451015 shutdown_connections 2024-09-19T09:36:48.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.877+0000 7f22d89fa640 1 -- 172.21.15.1:0/2793451015 wait complete. 2024-09-19T09:36:48.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.878+0000 7f22d89fa640 1 Processor -- start 2024-09-19T09:36:48.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.878+0000 7f22d89fa640 1 -- start start 2024-09-19T09:36:48.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.878+0000 7f22d89fa640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22d4102d90 0x7f22d41984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:48.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.878+0000 7f22d89fa640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22d4103740 0x7f22d41989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:48.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.878+0000 7f22d89fa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22d4108290 0x7f22d419cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:48.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.878+0000 7f22d89fa640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f22d4112090 con 0x7f22d4102d90 2024-09-19T09:36:48.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.878+0000 7f22d89fa640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f22d4111f10 con 0x7f22d4108290 2024-09-19T09:36:48.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.878+0000 7f22d89fa640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f22d4112210 con 0x7f22d4103740 2024-09-19T09:36:48.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.878+0000 7f22d259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22d4102d90 0x7f22d41984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:48.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.878+0000 7f22d259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22d4102d90 0x7f22d41984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55258/0 (socket says 172.21.15.1:55258) 2024-09-19T09:36:48.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.878+0000 7f22d259c640 1 -- 172.21.15.1:0/2397153369 learned_addr learned my addr 172.21.15.1:0/2397153369 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:48.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.878+0000 7f22d2d9d640 1 --2- 172.21.15.1:0/2397153369 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22d4108290 0x7f22d419cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:48.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.879+0000 7f22cbfff640 1 --2- 172.21.15.1:0/2397153369 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22d4103740 0x7f22d41989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:48.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.879+0000 7f22d259c640 1 -- 172.21.15.1:0/2397153369 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22d4103740 msgr2=0x7f22d41989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:48.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.879+0000 7f22d259c640 1 --2- 172.21.15.1:0/2397153369 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22d4103740 0x7f22d41989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.879+0000 7f22d259c640 1 -- 172.21.15.1:0/2397153369 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22d4108290 msgr2=0x7f22d419cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:48.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.879+0000 7f22d259c640 1 --2- 172.21.15.1:0/2397153369 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22d4108290 0x7f22d419cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.879+0000 7f22d259c640 1 -- 172.21.15.1:0/2397153369 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d419d450 con 0x7f22d4102d90 2024-09-19T09:36:48.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.879+0000 7f22d259c640 1 --2- 172.21.15.1:0/2397153369 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22d4102d90 0x7f22d41984a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f22c400c920 tx=0x7f22c400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:48.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.879+0000 7f22cb7fe640 1 -- 172.21.15.1:0/2397153369 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c4007c70 con 0x7f22d4102d90 2024-09-19T09:36:48.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.879+0000 7f22d89fa640 1 -- 172.21.15.1:0/2397153369 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22d419d740 con 0x7f22d4102d90 2024-09-19T09:36:48.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.879+0000 7f22cb7fe640 1 -- 172.21.15.1:0/2397153369 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f22c4007e10 con 0x7f22d4102d90 2024-09-19T09:36:48.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.879+0000 7f22cb7fe640 1 -- 172.21.15.1:0/2397153369 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c4018890 con 0x7f22d4102d90 2024-09-19T09:36:48.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.879+0000 7f22d89fa640 1 -- 172.21.15.1:0/2397153369 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22d41a5020 con 0x7f22d4102d90 2024-09-19T09:36:48.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.880+0000 7f22d89fa640 1 -- 172.21.15.1:0/2397153369 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f22d4107740 con 0x7f22d4102d90 2024-09-19T09:36:48.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.881+0000 7f22cb7fe640 1 -- 172.21.15.1:0/2397153369 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f22c4018a30 con 0x7f22d4102d90 2024-09-19T09:36:48.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.882+0000 7f22cb7fe640 1 --2- 172.21.15.1:0/2397153369 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f22c00a32d0 0x7f22c00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:48.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.882+0000 7f22cbfff640 1 --2- 172.21.15.1:0/2397153369 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f22c00a32d0 0x7f22c00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:48.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.882+0000 7f22cb7fe640 1 -- 172.21.15.1:0/2397153369 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f22c40cff80 con 0x7f22d4102d90 2024-09-19T09:36:48.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.882+0000 7f22cb7fe640 1 --2- 172.21.15.1:0/2397153369 >> [v2:172.21.15.1:6818/3376780798,v1:172.21.15.1:6819/3376780798] conn(0x7f22c00acb20 0x7f22c00aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:48.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.882+0000 7f22cb7fe640 1 -- 172.21.15.1:0/2397153369 --> [v2:172.21.15.1:6818/3376780798,v1:172.21.15.1:6819/3376780798] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f22c00af5f0 con 0x7f22c00acb20 2024-09-19T09:36:48.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.882+0000 7f22cb7fe640 1 -- 172.21.15.1:0/2397153369 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f22c40d0330 con 0x7f22d4102d90 2024-09-19T09:36:48.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.882+0000 7f22d2d9d640 1 --2- 172.21.15.1:0/2397153369 >> [v2:172.21.15.1:6818/3376780798,v1:172.21.15.1:6819/3376780798] conn(0x7f22c00acb20 0x7f22c00aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:48.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.883+0000 7f22cbfff640 1 --2- 172.21.15.1:0/2397153369 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f22c00a32d0 0x7f22c00a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f22bc006010 tx=0x7f22bc031690 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:48.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.883+0000 7f22d2d9d640 1 --2- 172.21.15.1:0/2397153369 >> [v2:172.21.15.1:6818/3376780798,v1:172.21.15.1:6819/3376780798] conn(0x7f22c00acb20 0x7f22c00aef40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:48.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.883+0000 7f22cb7fe640 1 -- 172.21.15.1:0/2397153369 <== osd.6 v2:172.21.15.1:6818/3376780798 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f22c00af5f0 con 0x7f22c00acb20 2024-09-19T09:36:48.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.897+0000 7f22d89fa640 1 -- 172.21.15.1:0/2397153369 --> [v2:172.21.15.1:6818/3376780798,v1:172.21.15.1:6819/3376780798] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f22d406a7f0 con 0x7f22c00acb20 2024-09-19T09:36:48.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.897+0000 7f22cb7fe640 1 -- 172.21.15.1:0/2397153369 <== osd.6 v2:172.21.15.1:6818/3376780798 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f22d406a7f0 con 0x7f22c00acb20 2024-09-19T09:36:48.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.897+0000 7f22d89fa640 1 -- 172.21.15.1:0/2397153369 >> [v2:172.21.15.1:6818/3376780798,v1:172.21.15.1:6819/3376780798] conn(0x7f22c00acb20 msgr2=0x7f22c00aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:48.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.898+0000 7f22d89fa640 1 --2- 172.21.15.1:0/2397153369 >> [v2:172.21.15.1:6818/3376780798,v1:172.21.15.1:6819/3376780798] conn(0x7f22c00acb20 0x7f22c00aef40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.898+0000 7f22d89fa640 1 -- 172.21.15.1:0/2397153369 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f22c00a32d0 msgr2=0x7f22c00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:48.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.898+0000 7f22d89fa640 1 --2- 172.21.15.1:0/2397153369 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f22c00a32d0 0x7f22c00a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f22bc006010 tx=0x7f22bc031690 comp rx=0 tx=0).stop 2024-09-19T09:36:48.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.898+0000 7f22d89fa640 1 -- 172.21.15.1:0/2397153369 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22d4102d90 msgr2=0x7f22d41984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:48.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.898+0000 7f22d89fa640 1 --2- 172.21.15.1:0/2397153369 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22d4102d90 0x7f22d41984a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f22c400c920 tx=0x7f22c400cde0 comp rx=0 tx=0).stop 2024-09-19T09:36:48.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.898+0000 7f22d2d9d640 1 -- 172.21.15.1:0/2397153369 reap_dead start 2024-09-19T09:36:48.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.898+0000 7f22d89fa640 1 -- 172.21.15.1:0/2397153369 shutdown_connections 2024-09-19T09:36:48.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.898+0000 7f22d89fa640 1 -- 172.21.15.1:0/2397153369 >> 172.21.15.1:0/2397153369 conn(0x7f22d40fc7d0 msgr2=0x7f22d4105cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:48.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.898+0000 7f22d89fa640 1 -- 172.21.15.1:0/2397153369 shutdown_connections 2024-09-19T09:36:48.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:48.898+0000 7f22d89fa640 1 -- 172.21.15.1:0/2397153369 wait complete. 2024-09-19T09:36:49.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.778+0000 7f0b7be08640 1 -- 172.21.15.1:0/114548335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b74101280 msgr2=0x7f0b7410df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:49.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.778+0000 7f0b7be08640 1 --2- 172.21.15.1:0/114548335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b74101280 0x7f0b7410df40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0b64009900 tx=0x7f0b6402a410 comp rx=0 tx=0).stop 2024-09-19T09:36:49.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.778+0000 7f0b7be08640 1 -- 172.21.15.1:0/114548335 shutdown_connections 2024-09-19T09:36:49.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.778+0000 7f0b7be08640 1 --2- 172.21.15.1:0/114548335 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b7410e480 0x7f0b74110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:49.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.778+0000 7f0b7be08640 1 --2- 172.21.15.1:0/114548335 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b74101280 0x7f0b7410df40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:49.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.778+0000 7f0b7be08640 1 --2- 172.21.15.1:0/114548335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b741008d0 0x7f0b74100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:49.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.778+0000 7f0b7be08640 1 -- 172.21.15.1:0/114548335 >> 172.21.15.1:0/114548335 conn(0x7f0b740fc7a0 msgr2=0x7f0b740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:49.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.779+0000 7f0b7be08640 1 -- 172.21.15.1:0/114548335 shutdown_connections 2024-09-19T09:36:49.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.779+0000 7f0b7be08640 1 -- 172.21.15.1:0/114548335 wait complete. 2024-09-19T09:36:49.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.779+0000 7f0b7be08640 1 Processor -- start 2024-09-19T09:36:49.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.779+0000 7f0b7be08640 1 -- start start 2024-09-19T09:36:49.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.780+0000 7f0b7be08640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b741008d0 0x7f0b7419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:49.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.780+0000 7f0b7be08640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b74101280 0x7f0b7419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:49.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.780+0000 7f0b7be08640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b7410e480 0x7f0b7419ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:49.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.780+0000 7f0b7be08640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0b74114190 con 0x7f0b74101280 2024-09-19T09:36:49.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.780+0000 7f0b7be08640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0b74114010 con 0x7f0b741008d0 2024-09-19T09:36:49.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.780+0000 7f0b7be08640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0b74114310 con 0x7f0b7410e480 2024-09-19T09:36:49.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.780+0000 7f0b793a3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b74101280 0x7f0b7419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:49.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.780+0000 7f0b793a3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b74101280 0x7f0b7419ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55274/0 (socket says 172.21.15.1:55274) 2024-09-19T09:36:49.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.780+0000 7f0b793a3640 1 -- 172.21.15.1:0/3858068183 learned_addr learned my addr 172.21.15.1:0/3858068183 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:49.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.780+0000 7f0b7a3a5640 1 --2- 172.21.15.1:0/3858068183 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b7410e480 0x7f0b7419ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:49.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.780+0000 7f0b79ba4640 1 --2- 172.21.15.1:0/3858068183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b741008d0 0x7f0b7419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:49.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.780+0000 7f0b793a3640 1 -- 172.21.15.1:0/3858068183 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b7410e480 msgr2=0x7f0b7419ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:49.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.780+0000 7f0b793a3640 1 --2- 172.21.15.1:0/3858068183 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b7410e480 0x7f0b7419ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:49.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.780+0000 7f0b793a3640 1 -- 172.21.15.1:0/3858068183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b741008d0 msgr2=0x7f0b7419a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:49.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.780+0000 7f0b793a3640 1 --2- 172.21.15.1:0/3858068183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b741008d0 0x7f0b7419a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:49.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.780+0000 7f0b793a3640 1 -- 172.21.15.1:0/3858068183 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b7419f600 con 0x7f0b74101280 2024-09-19T09:36:49.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.780+0000 7f0b793a3640 1 --2- 172.21.15.1:0/3858068183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b74101280 0x7f0b7419ab90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0b64006010 tx=0x7f0b640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:49.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.781+0000 7f0b6affd640 1 -- 172.21.15.1:0/3858068183 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b6403f030 con 0x7f0b74101280 2024-09-19T09:36:49.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.781+0000 7f0b6affd640 1 -- 172.21.15.1:0/3858068183 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b64003ce0 con 0x7f0b74101280 2024-09-19T09:36:49.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.781+0000 7f0b7be08640 1 -- 172.21.15.1:0/3858068183 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b7419f890 con 0x7f0b74101280 2024-09-19T09:36:49.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.781+0000 7f0b6affd640 1 -- 172.21.15.1:0/3858068183 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b64035070 con 0x7f0b74101280 2024-09-19T09:36:49.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.781+0000 7f0b7be08640 1 -- 172.21.15.1:0/3858068183 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b741a71d0 con 0x7f0b74101280 2024-09-19T09:36:49.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.781+0000 7f0b7be08640 1 -- 172.21.15.1:0/3858068183 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0b74062980 con 0x7f0b74101280 2024-09-19T09:36:49.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.783+0000 7f0b6affd640 1 -- 172.21.15.1:0/3858068183 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f0b64042030 con 0x7f0b74101280 2024-09-19T09:36:49.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.783+0000 7f0b6affd640 1 --2- 172.21.15.1:0/3858068183 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f0b600a32d0 0x7f0b600a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:49.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.783+0000 7f0b79ba4640 1 --2- 172.21.15.1:0/3858068183 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f0b600a32d0 0x7f0b600a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:49.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.783+0000 7f0b6affd640 1 -- 172.21.15.1:0/3858068183 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f0b640f03f0 con 0x7f0b74101280 2024-09-19T09:36:49.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.784+0000 7f0b6affd640 1 --2- 172.21.15.1:0/3858068183 >> [v2:172.21.15.1:6826/1143859822,v1:172.21.15.1:6827/1143859822] conn(0x7f0b600acb20 0x7f0b600aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:49.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.784+0000 7f0b6affd640 1 -- 172.21.15.1:0/3858068183 --> [v2:172.21.15.1:6826/1143859822,v1:172.21.15.1:6827/1143859822] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0b6403ce50 con 0x7f0b600acb20 2024-09-19T09:36:49.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.784+0000 7f0b6affd640 1 -- 172.21.15.1:0/3858068183 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f0b640f08d0 con 0x7f0b74101280 2024-09-19T09:36:49.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.784+0000 7f0b7a3a5640 1 --2- 172.21.15.1:0/3858068183 >> [v2:172.21.15.1:6826/1143859822,v1:172.21.15.1:6827/1143859822] conn(0x7f0b600acb20 0x7f0b600aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:49.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.784+0000 7f0b79ba4640 1 --2- 172.21.15.1:0/3858068183 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f0b600a32d0 0x7f0b600a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0b70009bd0 tx=0x7f0b70005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:49.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.784+0000 7f0b7a3a5640 1 --2- 172.21.15.1:0/3858068183 >> [v2:172.21.15.1:6826/1143859822,v1:172.21.15.1:6827/1143859822] conn(0x7f0b600acb20 0x7f0b600aef40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:49.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.785+0000 7f0b6affd640 1 -- 172.21.15.1:0/3858068183 <== osd.9 v2:172.21.15.1:6826/1143859822 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0b6403ce50 con 0x7f0b600acb20 2024-09-19T09:36:49.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.798+0000 7f0b7be08640 1 -- 172.21.15.1:0/3858068183 --> [v2:172.21.15.1:6826/1143859822,v1:172.21.15.1:6827/1143859822] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0b74062e00 con 0x7f0b600acb20 2024-09-19T09:36:49.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.799+0000 7f0b6affd640 1 -- 172.21.15.1:0/3858068183 <== osd.9 v2:172.21.15.1:6826/1143859822 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0b74062e00 con 0x7f0b600acb20 2024-09-19T09:36:49.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.799+0000 7f0b7be08640 1 -- 172.21.15.1:0/3858068183 >> [v2:172.21.15.1:6826/1143859822,v1:172.21.15.1:6827/1143859822] conn(0x7f0b600acb20 msgr2=0x7f0b600aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:49.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.799+0000 7f0b7be08640 1 --2- 172.21.15.1:0/3858068183 >> [v2:172.21.15.1:6826/1143859822,v1:172.21.15.1:6827/1143859822] conn(0x7f0b600acb20 0x7f0b600aef40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:49.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.799+0000 7f0b7be08640 1 -- 172.21.15.1:0/3858068183 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f0b600a32d0 msgr2=0x7f0b600a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:49.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.799+0000 7f0b7be08640 1 --2- 172.21.15.1:0/3858068183 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f0b600a32d0 0x7f0b600a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0b70009bd0 tx=0x7f0b70005f90 comp rx=0 tx=0).stop 2024-09-19T09:36:49.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.799+0000 7f0b7be08640 1 -- 172.21.15.1:0/3858068183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b74101280 msgr2=0x7f0b7419ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:49.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.799+0000 7f0b7be08640 1 --2- 172.21.15.1:0/3858068183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0b74101280 0x7f0b7419ab90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0b64006010 tx=0x7f0b640042f0 comp rx=0 tx=0).stop 2024-09-19T09:36:49.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.799+0000 7f0b7a3a5640 1 -- 172.21.15.1:0/3858068183 reap_dead start 2024-09-19T09:36:49.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.799+0000 7f0b7be08640 1 -- 172.21.15.1:0/3858068183 shutdown_connections 2024-09-19T09:36:49.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.799+0000 7f0b7be08640 1 -- 172.21.15.1:0/3858068183 >> 172.21.15.1:0/3858068183 conn(0x7f0b740fc7a0 msgr2=0x7f0b740feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:49.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.799+0000 7f0b7be08640 1 -- 172.21.15.1:0/3858068183 shutdown_connections 2024-09-19T09:36:49.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:49.799+0000 7f0b7be08640 1 -- 172.21.15.1:0/3858068183 wait complete. 2024-09-19T09:36:50.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.267+0000 7fca2b59e640 1 -- 172.21.15.1:0/4087765572 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca2c1008d0 msgr2=0x7fca2c100d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:50.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.267+0000 7fca2b59e640 1 --2- 172.21.15.1:0/4087765572 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca2c1008d0 0x7fca2c100d30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fca14009930 tx=0x7fca1402a420 comp rx=0 tx=0).stop 2024-09-19T09:36:50.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.267+0000 7fca2b59e640 1 -- 172.21.15.1:0/4087765572 shutdown_connections 2024-09-19T09:36:50.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.267+0000 7fca2b59e640 1 --2- 172.21.15.1:0/4087765572 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca2c101270 0x7fca2c10d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:50.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.267+0000 7fca2b59e640 1 --2- 172.21.15.1:0/4087765572 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca2c1008d0 0x7fca2c100d30 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:50.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.267+0000 7fca2b59e640 1 --2- 172.21.15.1:0/4087765572 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca2c1068d0 0x7fca2c106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:50.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.267+0000 7fca2b59e640 1 -- 172.21.15.1:0/4087765572 >> 172.21.15.1:0/4087765572 conn(0x7fca2c0fc610 msgr2=0x7fca2c0fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:50.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.267+0000 7fca2b59e640 1 -- 172.21.15.1:0/4087765572 shutdown_connections 2024-09-19T09:36:50.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.267+0000 7fca2b59e640 1 -- 172.21.15.1:0/4087765572 wait complete. 2024-09-19T09:36:50.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.268+0000 7fca2b59e640 1 Processor -- start 2024-09-19T09:36:50.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.268+0000 7fca2b59e640 1 -- start start 2024-09-19T09:36:50.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.268+0000 7fca2b59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca2c1008d0 0x7fca2c19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:50.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.268+0000 7fca2b59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca2c101270 0x7fca2c19a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:50.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.268+0000 7fca2b59e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca2c1068d0 0x7fca2c19ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:50.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.268+0000 7fca2b59e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c110cd0 con 0x7fca2c1008d0 2024-09-19T09:36:50.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.268+0000 7fca2b59e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c110b50 con 0x7fca2c101270 2024-09-19T09:36:50.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.268+0000 7fca2b59e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c110e50 con 0x7fca2c1068d0 2024-09-19T09:36:50.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.268+0000 7fca2a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca2c1008d0 0x7fca2c19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:50.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.268+0000 7fca2a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca2c1008d0 0x7fca2c19a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55296/0 (socket says 172.21.15.1:55296) 2024-09-19T09:36:50.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.268+0000 7fca2a59c640 1 -- 172.21.15.1:0/3768285045 learned_addr learned my addr 172.21.15.1:0/3768285045 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:50.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.268+0000 7fca2a59c640 1 -- 172.21.15.1:0/3768285045 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca2c1068d0 msgr2=0x7fca2c19ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:50.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.268+0000 7fca2a59c640 1 --2- 172.21.15.1:0/3768285045 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca2c1068d0 0x7fca2c19ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:50.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.268+0000 7fca2a59c640 1 -- 172.21.15.1:0/3768285045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca2c101270 msgr2=0x7fca2c19a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:50.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.268+0000 7fca23fff640 1 --2- 172.21.15.1:0/3768285045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca2c101270 0x7fca2c19a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:50.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.268+0000 7fca2a59c640 1 --2- 172.21.15.1:0/3768285045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca2c101270 0x7fca2c19a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:50.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.268+0000 7fca2a59c640 1 -- 172.21.15.1:0/3768285045 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca2c19f450 con 0x7fca2c1008d0 2024-09-19T09:36:50.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.269+0000 7fca23fff640 1 --2- 172.21.15.1:0/3768285045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca2c101270 0x7fca2c19a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:36:50.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.269+0000 7fca2a59c640 1 --2- 172.21.15.1:0/3768285045 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca2c1008d0 0x7fca2c19a4a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00d770 tx=0x7fca1c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:50.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.269+0000 7fca237fe640 1 -- 172.21.15.1:0/3768285045 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c017070 con 0x7fca2c1008d0 2024-09-19T09:36:50.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.269+0000 7fca2b59e640 1 -- 172.21.15.1:0/3768285045 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca2c19f740 con 0x7fca2c1008d0 2024-09-19T09:36:50.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.269+0000 7fca237fe640 1 -- 172.21.15.1:0/3768285045 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca1c005500 con 0x7fca2c1008d0 2024-09-19T09:36:50.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.269+0000 7fca237fe640 1 -- 172.21.15.1:0/3768285045 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c004e00 con 0x7fca2c1008d0 2024-09-19T09:36:50.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.269+0000 7fca2b59e640 1 -- 172.21.15.1:0/3768285045 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca2c1a7020 con 0x7fca2c1008d0 2024-09-19T09:36:50.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.270+0000 7fca2b59e640 1 -- 172.21.15.1:0/3768285045 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fca2c06aa40 con 0x7fca2c1008d0 2024-09-19T09:36:50.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.271+0000 7fca237fe640 1 -- 172.21.15.1:0/3768285045 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fca1c004fa0 con 0x7fca2c1008d0 2024-09-19T09:36:50.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.272+0000 7fca237fe640 1 --2- 172.21.15.1:0/3768285045 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fca180a32d0 0x7fca180a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:50.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.272+0000 7fca23fff640 1 --2- 172.21.15.1:0/3768285045 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fca180a32d0 0x7fca180a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:50.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.272+0000 7fca237fe640 1 -- 172.21.15.1:0/3768285045 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fca1c0cf880 con 0x7fca2c1008d0 2024-09-19T09:36:50.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.272+0000 7fca237fe640 1 --2- 172.21.15.1:0/3768285045 >> [v2:172.21.15.22:6808/923697266,v1:172.21.15.22:6809/923697266] conn(0x7fca180acb20 0x7fca180aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:50.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.272+0000 7fca237fe640 1 -- 172.21.15.1:0/3768285045 --> [v2:172.21.15.22:6808/923697266,v1:172.21.15.22:6809/923697266] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca1c001d30 con 0x7fca180acb20 2024-09-19T09:36:50.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.272+0000 7fca237fe640 1 -- 172.21.15.1:0/3768285045 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fca1c0cfc30 con 0x7fca2c1008d0 2024-09-19T09:36:50.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.272+0000 7fca23fff640 1 --2- 172.21.15.1:0/3768285045 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fca180a32d0 0x7fca180a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fca14000c00 tx=0x7fca14032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:50.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.272+0000 7fca2ad9d640 1 --2- 172.21.15.1:0/3768285045 >> [v2:172.21.15.22:6808/923697266,v1:172.21.15.22:6809/923697266] conn(0x7fca180acb20 0x7fca180aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:50.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.273+0000 7fca2ad9d640 1 --2- 172.21.15.1:0/3768285045 >> [v2:172.21.15.22:6808/923697266,v1:172.21.15.22:6809/923697266] conn(0x7fca180acb20 0x7fca180aef40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:50.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.274+0000 7fca237fe640 1 -- 172.21.15.1:0/3768285045 <== osd.4 v2:172.21.15.22:6808/923697266 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fca1c001d30 con 0x7fca180acb20 2024-09-19T09:36:50.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.287+0000 7fca2b59e640 1 -- 172.21.15.1:0/3768285045 --> [v2:172.21.15.22:6808/923697266,v1:172.21.15.22:6809/923697266] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fca2c102010 con 0x7fca180acb20 2024-09-19T09:36:50.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.288+0000 7fca237fe640 1 -- 172.21.15.1:0/3768285045 <== osd.4 v2:172.21.15.22:6808/923697266 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fca2c102010 con 0x7fca180acb20 2024-09-19T09:36:50.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.288+0000 7fca2b59e640 1 -- 172.21.15.1:0/3768285045 >> [v2:172.21.15.22:6808/923697266,v1:172.21.15.22:6809/923697266] conn(0x7fca180acb20 msgr2=0x7fca180aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:50.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.288+0000 7fca2b59e640 1 --2- 172.21.15.1:0/3768285045 >> [v2:172.21.15.22:6808/923697266,v1:172.21.15.22:6809/923697266] conn(0x7fca180acb20 0x7fca180aef40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:50.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.288+0000 7fca2b59e640 1 -- 172.21.15.1:0/3768285045 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fca180a32d0 msgr2=0x7fca180a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:50.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.288+0000 7fca2b59e640 1 --2- 172.21.15.1:0/3768285045 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fca180a32d0 0x7fca180a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fca14000c00 tx=0x7fca14032c70 comp rx=0 tx=0).stop 2024-09-19T09:36:50.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.288+0000 7fca2b59e640 1 -- 172.21.15.1:0/3768285045 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca2c1008d0 msgr2=0x7fca2c19a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:50.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.288+0000 7fca2b59e640 1 --2- 172.21.15.1:0/3768285045 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fca2c1008d0 0x7fca2c19a4a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fca1c00d770 tx=0x7fca1c00dc30 comp rx=0 tx=0).stop 2024-09-19T09:36:50.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.288+0000 7fca2ad9d640 1 -- 172.21.15.1:0/3768285045 reap_dead start 2024-09-19T09:36:50.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.288+0000 7fca2b59e640 1 -- 172.21.15.1:0/3768285045 shutdown_connections 2024-09-19T09:36:50.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.288+0000 7fca2b59e640 1 -- 172.21.15.1:0/3768285045 >> 172.21.15.1:0/3768285045 conn(0x7fca2c0fc610 msgr2=0x7fca2c069fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:50.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.288+0000 7fca2b59e640 1 -- 172.21.15.1:0/3768285045 shutdown_connections 2024-09-19T09:36:50.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:50.288+0000 7fca2b59e640 1 -- 172.21.15.1:0/3768285045 wait complete. 2024-09-19T09:36:50.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:50 smithi022 ceph-mon[35583]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-19T09:36:50.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:50 smithi121 ceph-mon[35577]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-19T09:36:50.484 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:50.485 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:50.485 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:50.485 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:36:50.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:50 smithi001 ceph-mon[31225]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-19T09:36:51.058 INFO:teuthology.orchestra.run.smithi001.stdout:137438953529 2024-09-19T09:36:51.059 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-19T09:36:51.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.907+0000 7f3db1b72640 1 -- 172.21.15.1:0/3865098681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dac102790 msgr2=0x7f3dac1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:51.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.908+0000 7f3db1b72640 1 --2- 172.21.15.1:0/3865098681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dac102790 0x7f3dac1067e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3d94009900 tx=0x7f3d9402a410 comp rx=0 tx=0).stop 2024-09-19T09:36:51.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.908+0000 7f3db1b72640 1 -- 172.21.15.1:0/3865098681 shutdown_connections 2024-09-19T09:36:51.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.908+0000 7f3db1b72640 1 --2- 172.21.15.1:0/3865098681 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3dac106f10 0x7f3dac10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:51.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.908+0000 7f3db1b72640 1 --2- 172.21.15.1:0/3865098681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dac102790 0x7f3dac1067e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:51.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.908+0000 7f3db1b72640 1 --2- 172.21.15.1:0/3865098681 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3dac101de0 0x7f3dac1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:51.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.908+0000 7f3db1b72640 1 -- 172.21.15.1:0/3865098681 >> 172.21.15.1:0/3865098681 conn(0x7f3dac0fd8c0 msgr2=0x7f3dac0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:51.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.908+0000 7f3db1b72640 1 -- 172.21.15.1:0/3865098681 shutdown_connections 2024-09-19T09:36:51.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.908+0000 7f3db1b72640 1 -- 172.21.15.1:0/3865098681 wait complete. 2024-09-19T09:36:51.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.908+0000 7f3db1b72640 1 Processor -- start 2024-09-19T09:36:51.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.908+0000 7f3db1b72640 1 -- start start 2024-09-19T09:36:51.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.909+0000 7f3db1b72640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3dac101de0 0x7f3dac198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:51.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.909+0000 7f3db1b72640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dac102790 0x7f3dac198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:51.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.909+0000 7f3db1b72640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3dac106f10 0x7f3dac19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:51.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.909+0000 7f3db1b72640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac111f70 con 0x7f3dac102790 2024-09-19T09:36:51.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.909+0000 7f3db1b72640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac111df0 con 0x7f3dac106f10 2024-09-19T09:36:51.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.909+0000 7f3db1b72640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac1120f0 con 0x7f3dac101de0 2024-09-19T09:36:51.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.909+0000 7f3da2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dac102790 0x7f3dac198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:51.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.909+0000 7f3da2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dac102790 0x7f3dac198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55318/0 (socket says 172.21.15.1:55318) 2024-09-19T09:36:51.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.909+0000 7f3da2ffd640 1 -- 172.21.15.1:0/1800714687 learned_addr learned my addr 172.21.15.1:0/1800714687 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:51.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.909+0000 7f3dabfff640 1 --2- 172.21.15.1:0/1800714687 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3dac106f10 0x7f3dac19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:51.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.909+0000 7f3dab7fe640 1 --2- 172.21.15.1:0/1800714687 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3dac101de0 0x7f3dac198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:51.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.909+0000 7f3da2ffd640 1 -- 172.21.15.1:0/1800714687 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3dac101de0 msgr2=0x7f3dac198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:51.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.909+0000 7f3da2ffd640 1 --2- 172.21.15.1:0/1800714687 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3dac101de0 0x7f3dac198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:51.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.909+0000 7f3da2ffd640 1 -- 172.21.15.1:0/1800714687 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3dac106f10 msgr2=0x7f3dac19cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:51.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.909+0000 7f3da2ffd640 1 --2- 172.21.15.1:0/1800714687 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3dac106f10 0x7f3dac19cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:51.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.909+0000 7f3da2ffd640 1 -- 172.21.15.1:0/1800714687 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dac19d3e0 con 0x7f3dac102790 2024-09-19T09:36:51.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.909+0000 7f3dab7fe640 1 --2- 172.21.15.1:0/1800714687 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3dac101de0 0x7f3dac198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:51.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.909+0000 7f3da2ffd640 1 --2- 172.21.15.1:0/1800714687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dac102790 0x7f3dac198970 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3d94006010 tx=0x7f3d940042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:51.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.910+0000 7f3da97fa640 1 -- 172.21.15.1:0/1800714687 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9403f030 con 0x7f3dac102790 2024-09-19T09:36:51.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.910+0000 7f3db1b72640 1 -- 172.21.15.1:0/1800714687 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dac19d670 con 0x7f3dac102790 2024-09-19T09:36:51.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.910+0000 7f3da97fa640 1 -- 172.21.15.1:0/1800714687 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d94003ce0 con 0x7f3dac102790 2024-09-19T09:36:51.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.910+0000 7f3da97fa640 1 -- 172.21.15.1:0/1800714687 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d94035070 con 0x7f3dac102790 2024-09-19T09:36:51.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.910+0000 7f3db1b72640 1 -- 172.21.15.1:0/1800714687 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dac1a4fb0 con 0x7f3dac102790 2024-09-19T09:36:51.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.910+0000 7f3db1b72640 1 -- 172.21.15.1:0/1800714687 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3dac062940 con 0x7f3dac102790 2024-09-19T09:36:51.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.912+0000 7f3da97fa640 1 -- 172.21.15.1:0/1800714687 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f3d94042030 con 0x7f3dac102790 2024-09-19T09:36:51.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.913+0000 7f3da97fa640 1 --2- 172.21.15.1:0/1800714687 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3d980a32d0 0x7f3d980a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:51.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.913+0000 7f3dab7fe640 1 --2- 172.21.15.1:0/1800714687 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3d980a32d0 0x7f3d980a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:51.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.913+0000 7f3da97fa640 1 -- 172.21.15.1:0/1800714687 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f3d940f0450 con 0x7f3dac102790 2024-09-19T09:36:51.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.913+0000 7f3da97fa640 1 --2- 172.21.15.1:0/1800714687 >> [v2:172.21.15.121:6800/1924970833,v1:172.21.15.121:6801/1924970833] conn(0x7f3d980acb20 0x7f3d980aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:51.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.913+0000 7f3da97fa640 1 -- 172.21.15.1:0/1800714687 --> [v2:172.21.15.121:6800/1924970833,v1:172.21.15.121:6801/1924970833] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d94001d30 con 0x7f3d980acb20 2024-09-19T09:36:51.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.913+0000 7f3da97fa640 1 -- 172.21.15.1:0/1800714687 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f3d940f0930 con 0x7f3dac102790 2024-09-19T09:36:51.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.913+0000 7f3dab7fe640 1 --2- 172.21.15.1:0/1800714687 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3d980a32d0 0x7f3d980a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c005fd0 tx=0x7f3d9c00b5f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:51.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.913+0000 7f3dabfff640 1 --2- 172.21.15.1:0/1800714687 >> [v2:172.21.15.121:6800/1924970833,v1:172.21.15.121:6801/1924970833] conn(0x7f3d980acb20 0x7f3d980aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:51.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.914+0000 7f3dabfff640 1 --2- 172.21.15.1:0/1800714687 >> [v2:172.21.15.121:6800/1924970833,v1:172.21.15.121:6801/1924970833] conn(0x7f3d980acb20 0x7f3d980aef40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:51.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.915+0000 7f3da97fa640 1 -- 172.21.15.1:0/1800714687 <== osd.2 v2:172.21.15.121:6800/1924970833 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3d94001d30 con 0x7f3d980acb20 2024-09-19T09:36:51.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.928+0000 7f3db1b72640 1 -- 172.21.15.1:0/1800714687 --> [v2:172.21.15.121:6800/1924970833,v1:172.21.15.121:6801/1924970833] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3dac062d40 con 0x7f3d980acb20 2024-09-19T09:36:51.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.928+0000 7f3da97fa640 1 -- 172.21.15.1:0/1800714687 <== osd.2 v2:172.21.15.121:6800/1924970833 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3dac062d40 con 0x7f3d980acb20 2024-09-19T09:36:51.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.929+0000 7f3db1b72640 1 -- 172.21.15.1:0/1800714687 >> [v2:172.21.15.121:6800/1924970833,v1:172.21.15.121:6801/1924970833] conn(0x7f3d980acb20 msgr2=0x7f3d980aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:51.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.929+0000 7f3db1b72640 1 --2- 172.21.15.1:0/1800714687 >> [v2:172.21.15.121:6800/1924970833,v1:172.21.15.121:6801/1924970833] conn(0x7f3d980acb20 0x7f3d980aef40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:51.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.929+0000 7f3db1b72640 1 -- 172.21.15.1:0/1800714687 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3d980a32d0 msgr2=0x7f3d980a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:51.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.929+0000 7f3db1b72640 1 --2- 172.21.15.1:0/1800714687 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3d980a32d0 0x7f3d980a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c005fd0 tx=0x7f3d9c00b5f0 comp rx=0 tx=0).stop 2024-09-19T09:36:51.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.929+0000 7f3db1b72640 1 -- 172.21.15.1:0/1800714687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dac102790 msgr2=0x7f3dac198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:51.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.929+0000 7f3db1b72640 1 --2- 172.21.15.1:0/1800714687 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3dac102790 0x7f3dac198970 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3d94006010 tx=0x7f3d940042f0 comp rx=0 tx=0).stop 2024-09-19T09:36:51.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.929+0000 7f3dabfff640 1 -- 172.21.15.1:0/1800714687 reap_dead start 2024-09-19T09:36:51.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.929+0000 7f3db1b72640 1 -- 172.21.15.1:0/1800714687 shutdown_connections 2024-09-19T09:36:51.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.929+0000 7f3db1b72640 1 -- 172.21.15.1:0/1800714687 >> 172.21.15.1:0/1800714687 conn(0x7f3dac0fd8c0 msgr2=0x7f3dac0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:51.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.929+0000 7f3db1b72640 1 -- 172.21.15.1:0/1800714687 shutdown_connections 2024-09-19T09:36:51.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:51.929+0000 7f3db1b72640 1 -- 172.21.15.1:0/1800714687 wait complete. 2024-09-19T09:36:52.245 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:52 smithi001 ceph-mon[31225]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-19T09:36:52.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:52 smithi022 ceph-mon[35583]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-19T09:36:52.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:52 smithi121 ceph-mon[35577]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-19T09:36:52.725 INFO:teuthology.orchestra.run.smithi001.stdout:73014444099 2024-09-19T09:36:52.725 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-19T09:36:53.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.098+0000 7fb515c16640 1 -- 172.21.15.1:0/2455424018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb510101dd0 msgr2=0x7fb5101021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:53.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.098+0000 7fb515c16640 1 --2- 172.21.15.1:0/2455424018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb510101dd0 0x7fb5101021b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb500009900 tx=0x7fb50002a410 comp rx=0 tx=0).stop 2024-09-19T09:36:53.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.098+0000 7fb515c16640 1 -- 172.21.15.1:0/2455424018 shutdown_connections 2024-09-19T09:36:53.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.098+0000 7fb515c16640 1 --2- 172.21.15.1:0/2455424018 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb510106f00 0x7fb51010ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.098+0000 7fb515c16640 1 --2- 172.21.15.1:0/2455424018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb510102780 0x7fb5101067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.098+0000 7fb515c16640 1 --2- 172.21.15.1:0/2455424018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb510101dd0 0x7fb5101021b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.098+0000 7fb515c16640 1 -- 172.21.15.1:0/2455424018 >> 172.21.15.1:0/2455424018 conn(0x7fb5100fd8b0 msgr2=0x7fb5100ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:53.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.098+0000 7fb515c16640 1 -- 172.21.15.1:0/2455424018 shutdown_connections 2024-09-19T09:36:53.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.098+0000 7fb515c16640 1 -- 172.21.15.1:0/2455424018 wait complete. 2024-09-19T09:36:53.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.098+0000 7fb515c16640 1 Processor -- start 2024-09-19T09:36:53.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.099+0000 7fb515c16640 1 -- start start 2024-09-19T09:36:53.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.099+0000 7fb515c16640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb510101dd0 0x7fb510198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.099+0000 7fb515c16640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb510102780 0x7fb5101989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.099+0000 7fb515c16640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb510106f00 0x7fb51019cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.099+0000 7fb515c16640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb510111f20 con 0x7fb510106f00 2024-09-19T09:36:53.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.099+0000 7fb515c16640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb510111da0 con 0x7fb510102780 2024-09-19T09:36:53.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.099+0000 7fb515c16640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb5101120a0 con 0x7fb510101dd0 2024-09-19T09:36:53.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.099+0000 7fb50ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb510106f00 0x7fb51019cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.099+0000 7fb50ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb510106f00 0x7fb51019cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55332/0 (socket says 172.21.15.1:55332) 2024-09-19T09:36:53.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.099+0000 7fb50ffff640 1 -- 172.21.15.1:0/2007155308 learned_addr learned my addr 172.21.15.1:0/2007155308 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:53.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.099+0000 7fb50f7fe640 1 --2- 172.21.15.1:0/2007155308 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb510101dd0 0x7fb510198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.099+0000 7fb50effd640 1 --2- 172.21.15.1:0/2007155308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb510102780 0x7fb5101989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.099+0000 7fb50ffff640 1 -- 172.21.15.1:0/2007155308 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb510101dd0 msgr2=0x7fb510198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:53.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.099+0000 7fb50ffff640 1 --2- 172.21.15.1:0/2007155308 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb510101dd0 0x7fb510198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.099+0000 7fb50ffff640 1 -- 172.21.15.1:0/2007155308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb510102780 msgr2=0x7fb5101989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:53.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.099+0000 7fb50ffff640 1 --2- 172.21.15.1:0/2007155308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb510102780 0x7fb5101989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.099+0000 7fb50ffff640 1 -- 172.21.15.1:0/2007155308 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb51019d410 con 0x7fb510106f00 2024-09-19T09:36:53.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.100+0000 7fb50ffff640 1 --2- 172.21.15.1:0/2007155308 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb510106f00 0x7fb51019cd30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb50800eaa0 tx=0x7fb50800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:53.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.100+0000 7fb50cff9640 1 -- 172.21.15.1:0/2007155308 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50800cdb0 con 0x7fb510106f00 2024-09-19T09:36:53.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.100+0000 7fb50cff9640 1 -- 172.21.15.1:0/2007155308 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb508005020 con 0x7fb510106f00 2024-09-19T09:36:53.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.100+0000 7fb50cff9640 1 -- 172.21.15.1:0/2007155308 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5080116b0 con 0x7fb510106f00 2024-09-19T09:36:53.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.100+0000 7fb515c16640 1 -- 172.21.15.1:0/2007155308 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb51019d700 con 0x7fb510106f00 2024-09-19T09:36:53.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.100+0000 7fb515c16640 1 -- 172.21.15.1:0/2007155308 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb510074420 con 0x7fb510106f00 2024-09-19T09:36:53.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.101+0000 7fb515c16640 1 -- 172.21.15.1:0/2007155308 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb510062980 con 0x7fb510106f00 2024-09-19T09:36:53.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.103+0000 7fb50cff9640 1 -- 172.21.15.1:0/2007155308 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fb508005560 con 0x7fb510106f00 2024-09-19T09:36:53.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.104+0000 7fb50cff9640 1 --2- 172.21.15.1:0/2007155308 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb4f80a3350 0x7fb4f80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.104+0000 7fb50cff9640 1 -- 172.21.15.1:0/2007155308 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fb5080cff30 con 0x7fb510106f00 2024-09-19T09:36:53.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.104+0000 7fb50f7fe640 1 --2- 172.21.15.1:0/2007155308 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb4f80a3350 0x7fb4f80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.104+0000 7fb50cff9640 1 --2- 172.21.15.1:0/2007155308 >> [v2:172.21.15.22:6800/3735826323,v1:172.21.15.22:6801/3735826323] conn(0x7fb4f80acba0 0x7fb4f80aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.104+0000 7fb50cff9640 1 -- 172.21.15.1:0/2007155308 --> [v2:172.21.15.22:6800/3735826323,v1:172.21.15.22:6801/3735826323] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb508014ec0 con 0x7fb4f80acba0 2024-09-19T09:36:53.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.104+0000 7fb50cff9640 1 -- 172.21.15.1:0/2007155308 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fb5080d02e0 con 0x7fb510106f00 2024-09-19T09:36:53.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.105+0000 7fb50effd640 1 --2- 172.21.15.1:0/2007155308 >> [v2:172.21.15.22:6800/3735826323,v1:172.21.15.22:6801/3735826323] conn(0x7fb4f80acba0 0x7fb4f80aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.105+0000 7fb50f7fe640 1 --2- 172.21.15.1:0/2007155308 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb4f80a3350 0x7fb4f80a5810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb500009230 tx=0x7fb5000058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:53.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.105+0000 7fb50effd640 1 --2- 172.21.15.1:0/2007155308 >> [v2:172.21.15.22:6800/3735826323,v1:172.21.15.22:6801/3735826323] conn(0x7fb4f80acba0 0x7fb4f80aefc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:53.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.106+0000 7fb50cff9640 1 -- 172.21.15.1:0/2007155308 <== osd.1 v2:172.21.15.22:6800/3735826323 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb508014ec0 con 0x7fb4f80acba0 2024-09-19T09:36:53.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.120+0000 7fb515c16640 1 -- 172.21.15.1:0/2007155308 --> [v2:172.21.15.22:6800/3735826323,v1:172.21.15.22:6801/3735826323] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb510062e00 con 0x7fb4f80acba0 2024-09-19T09:36:53.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.120+0000 7fb50cff9640 1 -- 172.21.15.1:0/2007155308 <== osd.1 v2:172.21.15.22:6800/3735826323 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb510062e00 con 0x7fb4f80acba0 2024-09-19T09:36:53.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.120+0000 7fb515c16640 1 -- 172.21.15.1:0/2007155308 >> [v2:172.21.15.22:6800/3735826323,v1:172.21.15.22:6801/3735826323] conn(0x7fb4f80acba0 msgr2=0x7fb4f80aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:53.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.120+0000 7fb515c16640 1 --2- 172.21.15.1:0/2007155308 >> [v2:172.21.15.22:6800/3735826323,v1:172.21.15.22:6801/3735826323] conn(0x7fb4f80acba0 0x7fb4f80aefc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.121+0000 7fb515c16640 1 -- 172.21.15.1:0/2007155308 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb4f80a3350 msgr2=0x7fb4f80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:53.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.121+0000 7fb515c16640 1 --2- 172.21.15.1:0/2007155308 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb4f80a3350 0x7fb4f80a5810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb500009230 tx=0x7fb5000058d0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.121+0000 7fb515c16640 1 -- 172.21.15.1:0/2007155308 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb510106f00 msgr2=0x7fb51019cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:53.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.121+0000 7fb515c16640 1 --2- 172.21.15.1:0/2007155308 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb510106f00 0x7fb51019cd30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb50800eaa0 tx=0x7fb50800ef60 comp rx=0 tx=0).stop 2024-09-19T09:36:53.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.121+0000 7fb50ffff640 1 -- 172.21.15.1:0/2007155308 reap_dead start 2024-09-19T09:36:53.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.121+0000 7fb515c16640 1 -- 172.21.15.1:0/2007155308 shutdown_connections 2024-09-19T09:36:53.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.121+0000 7fb515c16640 1 -- 172.21.15.1:0/2007155308 >> 172.21.15.1:0/2007155308 conn(0x7fb5100fd8b0 msgr2=0x7fb5100fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:53.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.121+0000 7fb515c16640 1 -- 172.21.15.1:0/2007155308 shutdown_connections 2024-09-19T09:36:53.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.121+0000 7fb515c16640 1 -- 172.21.15.1:0/2007155308 wait complete. 2024-09-19T09:36:53.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.760+0000 7f1770bd5640 1 -- 172.21.15.1:0/933963779 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f176c102ef0 msgr2=0x7f176c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:53.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.760+0000 7f1770bd5640 1 --2- 172.21.15.1:0/933963779 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f176c102ef0 0x7f176c10da40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1764009ca0 tx=0x7f176402a950 comp rx=0 tx=0).stop 2024-09-19T09:36:53.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.761+0000 7f1770bd5640 1 -- 172.21.15.1:0/933963779 shutdown_connections 2024-09-19T09:36:53.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.761+0000 7f1770bd5640 1 --2- 172.21.15.1:0/933963779 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f176c102ef0 0x7f176c10da40 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.761+0000 7f1770bd5640 1 --2- 172.21.15.1:0/933963779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f176c102570 0x7f176c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.761+0000 7f1770bd5640 1 --2- 172.21.15.1:0/933963779 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f176c100e20 0x7f176c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.761+0000 7f1770bd5640 1 -- 172.21.15.1:0/933963779 >> 172.21.15.1:0/933963779 conn(0x7f176c0fc7d0 msgr2=0x7f176c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:53.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.761+0000 7f1770bd5640 1 -- 172.21.15.1:0/933963779 shutdown_connections 2024-09-19T09:36:53.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.761+0000 7f1770bd5640 1 -- 172.21.15.1:0/933963779 wait complete. 2024-09-19T09:36:53.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.761+0000 7f1770bd5640 1 Processor -- start 2024-09-19T09:36:53.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.762+0000 7f1770bd5640 1 -- start start 2024-09-19T09:36:53.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.762+0000 7f1770bd5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f176c100e20 0x7f176c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.762+0000 7f1770bd5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f176c102570 0x7f176c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.762+0000 7f1770bd5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f176c102ef0 0x7f176c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.762+0000 7f1770bd5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f176c110f80 con 0x7f176c100e20 2024-09-19T09:36:53.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.762+0000 7f1770bd5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f176c110e00 con 0x7f176c102570 2024-09-19T09:36:53.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.762+0000 7f1770bd5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f176c111100 con 0x7f176c102ef0 2024-09-19T09:36:53.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.762+0000 7f176a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f176c100e20 0x7f176c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.762+0000 7f176a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f176c100e20 0x7f176c0fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55354/0 (socket says 172.21.15.1:55354) 2024-09-19T09:36:53.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.762+0000 7f176a59c640 1 -- 172.21.15.1:0/3899198905 learned_addr learned my addr 172.21.15.1:0/3899198905 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:53.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.762+0000 7f1769d9b640 1 --2- 172.21.15.1:0/3899198905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f176c102570 0x7f176c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.762+0000 7f176ad9d640 1 --2- 172.21.15.1:0/3899198905 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f176c102ef0 0x7f176c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.762+0000 7f176a59c640 1 -- 172.21.15.1:0/3899198905 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f176c102ef0 msgr2=0x7f176c0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:53.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.762+0000 7f176a59c640 1 --2- 172.21.15.1:0/3899198905 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f176c102ef0 0x7f176c0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.762+0000 7f176a59c640 1 -- 172.21.15.1:0/3899198905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f176c102570 msgr2=0x7f176c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:53.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.762+0000 7f176a59c640 1 --2- 172.21.15.1:0/3899198905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f176c102570 0x7f176c0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.762+0000 7f176a59c640 1 -- 172.21.15.1:0/3899198905 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f176c1a6920 con 0x7f176c100e20 2024-09-19T09:36:53.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.762+0000 7f176ad9d640 1 --2- 172.21.15.1:0/3899198905 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f176c102ef0 0x7f176c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:53.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.762+0000 7f176a59c640 1 --2- 172.21.15.1:0/3899198905 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f176c100e20 0x7f176c0fcc80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f175c00d950 tx=0x7f175c00dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:53.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.763+0000 7f175b7fe640 1 -- 172.21.15.1:0/3899198905 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f175c017070 con 0x7f176c100e20 2024-09-19T09:36:53.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.763+0000 7f175b7fe640 1 -- 172.21.15.1:0/3899198905 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f175c00de80 con 0x7f176c100e20 2024-09-19T09:36:53.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.763+0000 7f1770bd5640 1 -- 172.21.15.1:0/3899198905 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f176c1a6c10 con 0x7f176c100e20 2024-09-19T09:36:53.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.763+0000 7f175b7fe640 1 -- 172.21.15.1:0/3899198905 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f175c00f620 con 0x7f176c100e20 2024-09-19T09:36:53.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.763+0000 7f1770bd5640 1 -- 172.21.15.1:0/3899198905 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f176c1a7150 con 0x7f176c100e20 2024-09-19T09:36:53.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.764+0000 7f1770bd5640 1 -- 172.21.15.1:0/3899198905 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f176c0628c0 con 0x7f176c100e20 2024-09-19T09:36:53.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.766+0000 7f175b7fe640 1 -- 172.21.15.1:0/3899198905 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f175c009c30 con 0x7f176c100e20 2024-09-19T09:36:53.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.766+0000 7f175b7fe640 1 --2- 172.21.15.1:0/3899198905 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f17540a32d0 0x7f17540a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.766+0000 7f1769d9b640 1 --2- 172.21.15.1:0/3899198905 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f17540a32d0 0x7f17540a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.766+0000 7f175b7fe640 1 -- 172.21.15.1:0/3899198905 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f175c0cf9d0 con 0x7f176c100e20 2024-09-19T09:36:53.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.767+0000 7f175b7fe640 1 --2- 172.21.15.1:0/3899198905 >> [v2:172.21.15.22:6816/2920985295,v1:172.21.15.22:6817/2920985295] conn(0x7f17540acb20 0x7f17540aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:53.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.767+0000 7f175b7fe640 1 -- 172.21.15.1:0/3899198905 --> [v2:172.21.15.22:6816/2920985295,v1:172.21.15.22:6817/2920985295] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f175c014ec0 con 0x7f17540acb20 2024-09-19T09:36:53.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.767+0000 7f175b7fe640 1 -- 172.21.15.1:0/3899198905 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f175c0cfeb0 con 0x7f176c100e20 2024-09-19T09:36:53.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.767+0000 7f1769d9b640 1 --2- 172.21.15.1:0/3899198905 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f17540a32d0 0x7f17540a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f176c0fe710 tx=0x7f176000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:53.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.767+0000 7f176ad9d640 1 --2- 172.21.15.1:0/3899198905 >> [v2:172.21.15.22:6816/2920985295,v1:172.21.15.22:6817/2920985295] conn(0x7f17540acb20 0x7f17540aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:53.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.767+0000 7f176ad9d640 1 --2- 172.21.15.1:0/3899198905 >> [v2:172.21.15.22:6816/2920985295,v1:172.21.15.22:6817/2920985295] conn(0x7f17540acb20 0x7f17540aef40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:53.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.768+0000 7f175b7fe640 1 -- 172.21.15.1:0/3899198905 <== osd.7 v2:172.21.15.22:6816/2920985295 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f175c014ec0 con 0x7f17540acb20 2024-09-19T09:36:53.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.782+0000 7f1770bd5640 1 -- 172.21.15.1:0/3899198905 --> [v2:172.21.15.22:6816/2920985295,v1:172.21.15.22:6817/2920985295] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f176c062cc0 con 0x7f17540acb20 2024-09-19T09:36:53.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.782+0000 7f175b7fe640 1 -- 172.21.15.1:0/3899198905 <== osd.7 v2:172.21.15.22:6816/2920985295 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f176c062cc0 con 0x7f17540acb20 2024-09-19T09:36:53.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.783+0000 7f1770bd5640 1 -- 172.21.15.1:0/3899198905 >> [v2:172.21.15.22:6816/2920985295,v1:172.21.15.22:6817/2920985295] conn(0x7f17540acb20 msgr2=0x7f17540aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:53.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.783+0000 7f1770bd5640 1 --2- 172.21.15.1:0/3899198905 >> [v2:172.21.15.22:6816/2920985295,v1:172.21.15.22:6817/2920985295] conn(0x7f17540acb20 0x7f17540aef40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.783+0000 7f1770bd5640 1 -- 172.21.15.1:0/3899198905 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f17540a32d0 msgr2=0x7f17540a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:53.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.783+0000 7f1770bd5640 1 --2- 172.21.15.1:0/3899198905 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f17540a32d0 0x7f17540a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f176c0fe710 tx=0x7f176000a2d0 comp rx=0 tx=0).stop 2024-09-19T09:36:53.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.783+0000 7f1770bd5640 1 -- 172.21.15.1:0/3899198905 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f176c100e20 msgr2=0x7f176c0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:53.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.783+0000 7f1770bd5640 1 --2- 172.21.15.1:0/3899198905 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f176c100e20 0x7f176c0fcc80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f175c00d950 tx=0x7f175c00dd50 comp rx=0 tx=0).stop 2024-09-19T09:36:53.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.783+0000 7f176ad9d640 1 -- 172.21.15.1:0/3899198905 reap_dead start 2024-09-19T09:36:53.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.783+0000 7f1770bd5640 1 -- 172.21.15.1:0/3899198905 shutdown_connections 2024-09-19T09:36:53.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.783+0000 7f1770bd5640 1 -- 172.21.15.1:0/3899198905 >> 172.21.15.1:0/3899198905 conn(0x7f176c0fc7d0 msgr2=0x7f176c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:53.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.783+0000 7f1770bd5640 1 -- 172.21.15.1:0/3899198905 shutdown_connections 2024-09-19T09:36:53.796 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:53.783+0000 7f1770bd5640 1 -- 172.21.15.1:0/3899198905 wait complete. 2024-09-19T09:36:54.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.214+0000 7faf3bb5e640 1 -- 172.21.15.1:0/1440194793 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf34101420 msgr2=0x7faf3410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:54.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.214+0000 7faf3bb5e640 1 --2- 172.21.15.1:0/1440194793 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf34101420 0x7faf3410d950 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7faf2c009cd0 tx=0x7faf2c02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:36:54.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.214+0000 7faf3bb5e640 1 -- 172.21.15.1:0/1440194793 shutdown_connections 2024-09-19T09:36:54.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.214+0000 7faf3bb5e640 1 --2- 172.21.15.1:0/1440194793 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf34101420 0x7faf3410d950 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:54.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.214+0000 7faf3bb5e640 1 --2- 172.21.15.1:0/1440194793 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf34100a80 0x7faf34100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:54.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.214+0000 7faf3bb5e640 1 --2- 172.21.15.1:0/1440194793 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf34106a80 0x7faf34106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:54.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.214+0000 7faf3bb5e640 1 -- 172.21.15.1:0/1440194793 >> 172.21.15.1:0/1440194793 conn(0x7faf340fc7a0 msgr2=0x7faf340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:54.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.214+0000 7faf3bb5e640 1 -- 172.21.15.1:0/1440194793 shutdown_connections 2024-09-19T09:36:54.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.214+0000 7faf3bb5e640 1 -- 172.21.15.1:0/1440194793 wait complete. 2024-09-19T09:36:54.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.215+0000 7faf3bb5e640 1 Processor -- start 2024-09-19T09:36:54.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.215+0000 7faf3bb5e640 1 -- start start 2024-09-19T09:36:54.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.215+0000 7faf3bb5e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf34100a80 0x7faf34198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:54.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.215+0000 7faf3bb5e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf34101420 0x7faf341989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:54.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.215+0000 7faf3bb5e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf34106a80 0x7faf3419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:54.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.215+0000 7faf3bb5e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faf34110e80 con 0x7faf34101420 2024-09-19T09:36:54.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.215+0000 7faf3bb5e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faf34110d00 con 0x7faf34100a80 2024-09-19T09:36:54.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.215+0000 7faf3bb5e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7faf34111000 con 0x7faf34106a80 2024-09-19T09:36:54.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.215+0000 7faf390f9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf34101420 0x7faf341989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:54.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.215+0000 7faf390f9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf34101420 0x7faf341989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55366/0 (socket says 172.21.15.1:55366) 2024-09-19T09:36:54.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.215+0000 7faf390f9640 1 -- 172.21.15.1:0/546092974 learned_addr learned my addr 172.21.15.1:0/546092974 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:54.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.215+0000 7faf3a0fb640 1 --2- 172.21.15.1:0/546092974 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf34106a80 0x7faf3419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:54.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.215+0000 7faf398fa640 1 --2- 172.21.15.1:0/546092974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf34100a80 0x7faf34198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:54.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.215+0000 7faf390f9640 1 -- 172.21.15.1:0/546092974 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf34106a80 msgr2=0x7faf3419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:54.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.215+0000 7faf390f9640 1 --2- 172.21.15.1:0/546092974 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf34106a80 0x7faf3419cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:54.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.215+0000 7faf390f9640 1 -- 172.21.15.1:0/546092974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf34100a80 msgr2=0x7faf34198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:54.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.215+0000 7faf390f9640 1 --2- 172.21.15.1:0/546092974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf34100a80 0x7faf34198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:54.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.215+0000 7faf390f9640 1 -- 172.21.15.1:0/546092974 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf3419d420 con 0x7faf34101420 2024-09-19T09:36:54.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.216+0000 7faf390f9640 1 --2- 172.21.15.1:0/546092974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf34101420 0x7faf341989b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faf2400d950 tx=0x7faf2400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:54.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.216+0000 7faf2affd640 1 -- 172.21.15.1:0/546092974 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf24017070 con 0x7faf34101420 2024-09-19T09:36:54.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.216+0000 7faf2affd640 1 -- 172.21.15.1:0/546092974 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf24009c30 con 0x7faf34101420 2024-09-19T09:36:54.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.216+0000 7faf3bb5e640 1 -- 172.21.15.1:0/546092974 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf3419d710 con 0x7faf34101420 2024-09-19T09:36:54.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.216+0000 7faf2affd640 1 -- 172.21.15.1:0/546092974 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2400f6b0 con 0x7faf34101420 2024-09-19T09:36:54.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.216+0000 7faf3bb5e640 1 -- 172.21.15.1:0/546092974 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf341a4ff0 con 0x7faf34101420 2024-09-19T09:36:54.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.217+0000 7faf3bb5e640 1 -- 172.21.15.1:0/546092974 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faf34062900 con 0x7faf34101420 2024-09-19T09:36:54.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.218+0000 7faf2affd640 1 -- 172.21.15.1:0/546092974 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7faf240109d0 con 0x7faf34101420 2024-09-19T09:36:54.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.219+0000 7faf2affd640 1 --2- 172.21.15.1:0/546092974 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7faf200a3350 0x7faf200a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:54.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.219+0000 7faf398fa640 1 --2- 172.21.15.1:0/546092974 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7faf200a3350 0x7faf200a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:54.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.219+0000 7faf2affd640 1 -- 172.21.15.1:0/546092974 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7faf240cf8c0 con 0x7faf34101420 2024-09-19T09:36:54.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.219+0000 7faf2affd640 1 --2- 172.21.15.1:0/546092974 >> [v2:172.21.15.121:6816/3589985967,v1:172.21.15.121:6817/3589985967] conn(0x7faf200acba0 0x7faf200aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:54.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.219+0000 7faf2affd640 1 -- 172.21.15.1:0/546092974 --> [v2:172.21.15.121:6816/3589985967,v1:172.21.15.121:6817/3589985967] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faf2401de50 con 0x7faf200acba0 2024-09-19T09:36:54.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.219+0000 7faf2affd640 1 -- 172.21.15.1:0/546092974 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7faf240cfda0 con 0x7faf34101420 2024-09-19T09:36:54.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.219+0000 7faf3a0fb640 1 --2- 172.21.15.1:0/546092974 >> [v2:172.21.15.121:6816/3589985967,v1:172.21.15.121:6817/3589985967] conn(0x7faf200acba0 0x7faf200aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:54.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.219+0000 7faf398fa640 1 --2- 172.21.15.1:0/546092974 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7faf200a3350 0x7faf200a5810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faf30009ae0 tx=0x7faf30005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:54.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.220+0000 7faf3a0fb640 1 --2- 172.21.15.1:0/546092974 >> [v2:172.21.15.121:6816/3589985967,v1:172.21.15.121:6817/3589985967] conn(0x7faf200acba0 0x7faf200aefc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:54.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.220+0000 7faf2affd640 1 -- 172.21.15.1:0/546092974 <== osd.8 v2:172.21.15.121:6816/3589985967 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faf2401de50 con 0x7faf200acba0 2024-09-19T09:36:54.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.234+0000 7faf3bb5e640 1 -- 172.21.15.1:0/546092974 --> [v2:172.21.15.121:6816/3589985967,v1:172.21.15.121:6817/3589985967] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faf34062d30 con 0x7faf200acba0 2024-09-19T09:36:54.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.234+0000 7faf2affd640 1 -- 172.21.15.1:0/546092974 <== osd.8 v2:172.21.15.121:6816/3589985967 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7faf34062d30 con 0x7faf200acba0 2024-09-19T09:36:54.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.235+0000 7faf3bb5e640 1 -- 172.21.15.1:0/546092974 >> [v2:172.21.15.121:6816/3589985967,v1:172.21.15.121:6817/3589985967] conn(0x7faf200acba0 msgr2=0x7faf200aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:54.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.235+0000 7faf3bb5e640 1 --2- 172.21.15.1:0/546092974 >> [v2:172.21.15.121:6816/3589985967,v1:172.21.15.121:6817/3589985967] conn(0x7faf200acba0 0x7faf200aefc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:54.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.235+0000 7faf3bb5e640 1 -- 172.21.15.1:0/546092974 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7faf200a3350 msgr2=0x7faf200a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:54.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.235+0000 7faf3bb5e640 1 --2- 172.21.15.1:0/546092974 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7faf200a3350 0x7faf200a5810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faf30009ae0 tx=0x7faf30005f90 comp rx=0 tx=0).stop 2024-09-19T09:36:54.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.235+0000 7faf3bb5e640 1 -- 172.21.15.1:0/546092974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf34101420 msgr2=0x7faf341989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:54.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.235+0000 7faf3bb5e640 1 --2- 172.21.15.1:0/546092974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf34101420 0x7faf341989b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faf2400d950 tx=0x7faf2400de10 comp rx=0 tx=0).stop 2024-09-19T09:36:54.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.235+0000 7faf3a0fb640 1 -- 172.21.15.1:0/546092974 reap_dead start 2024-09-19T09:36:54.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.235+0000 7faf3bb5e640 1 -- 172.21.15.1:0/546092974 shutdown_connections 2024-09-19T09:36:54.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.235+0000 7faf3bb5e640 1 -- 172.21.15.1:0/546092974 >> 172.21.15.1:0/546092974 conn(0x7faf340fc7a0 msgr2=0x7faf3406aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:54.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.235+0000 7faf3bb5e640 1 -- 172.21.15.1:0/546092974 shutdown_connections 2024-09-19T09:36:54.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.235+0000 7faf3bb5e640 1 -- 172.21.15.1:0/546092974 wait complete. 2024-09-19T09:36:54.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:54 smithi022 ceph-mon[35583]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-19T09:36:54.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:54 smithi121 ceph-mon[35577]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-19T09:36:54.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:54 smithi001 ceph-mon[31225]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-19T09:36:54.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.639+0000 7f34cd237640 1 -- 172.21.15.1:0/2351750423 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34c8106f10 msgr2=0x7f34c810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:54.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.639+0000 7f34cd237640 1 --2- 172.21.15.1:0/2351750423 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34c8106f10 0x7f34c810ea90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f34c0009ca0 tx=0x7f34c002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:36:54.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.639+0000 7f34cd237640 1 -- 172.21.15.1:0/2351750423 shutdown_connections 2024-09-19T09:36:54.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.639+0000 7f34cd237640 1 --2- 172.21.15.1:0/2351750423 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34c8106f10 0x7f34c810ea90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:54.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.639+0000 7f34cd237640 1 --2- 172.21.15.1:0/2351750423 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34c8102790 0x7f34c81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:54.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.639+0000 7f34cd237640 1 --2- 172.21.15.1:0/2351750423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f34c8101de0 0x7f34c81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:54.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.639+0000 7f34cd237640 1 -- 172.21.15.1:0/2351750423 >> 172.21.15.1:0/2351750423 conn(0x7f34c80fd8c0 msgr2=0x7f34c80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:54.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.639+0000 7f34cd237640 1 -- 172.21.15.1:0/2351750423 shutdown_connections 2024-09-19T09:36:54.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.639+0000 7f34cd237640 1 -- 172.21.15.1:0/2351750423 wait complete. 2024-09-19T09:36:54.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.640+0000 7f34cd237640 1 Processor -- start 2024-09-19T09:36:54.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.640+0000 7f34cd237640 1 -- start start 2024-09-19T09:36:54.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.640+0000 7f34cd237640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34c8101de0 0x7f34c81983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:54.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.640+0000 7f34cd237640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34c8102790 0x7f34c8198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:54.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.640+0000 7f34cd237640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f34c8106f10 0x7f34c819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:54.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.640+0000 7f34cd237640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f34c8111f70 con 0x7f34c8101de0 2024-09-19T09:36:54.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.640+0000 7f34cd237640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f34c8111df0 con 0x7f34c8106f10 2024-09-19T09:36:54.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.641+0000 7f34cd237640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f34c81120f0 con 0x7f34c8102790 2024-09-19T09:36:54.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.641+0000 7f34c6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34c8101de0 0x7f34c81983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:54.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.641+0000 7f34c6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34c8101de0 0x7f34c81983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55378/0 (socket says 172.21.15.1:55378) 2024-09-19T09:36:54.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.641+0000 7f34c6d9d640 1 -- 172.21.15.1:0/1726541260 learned_addr learned my addr 172.21.15.1:0/1726541260 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:54.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.641+0000 7f34c659c640 1 --2- 172.21.15.1:0/1726541260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34c8102790 0x7f34c8198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:54.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.641+0000 7f34c759e640 1 --2- 172.21.15.1:0/1726541260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f34c8106f10 0x7f34c819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:54.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.641+0000 7f34c6d9d640 1 -- 172.21.15.1:0/1726541260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34c8102790 msgr2=0x7f34c8198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:54.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.641+0000 7f34c6d9d640 1 --2- 172.21.15.1:0/1726541260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f34c8102790 0x7f34c8198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:54.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.641+0000 7f34c6d9d640 1 -- 172.21.15.1:0/1726541260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f34c8106f10 msgr2=0x7f34c819cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:54.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.641+0000 7f34c6d9d640 1 --2- 172.21.15.1:0/1726541260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f34c8106f10 0x7f34c819cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:54.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.641+0000 7f34c6d9d640 1 -- 172.21.15.1:0/1726541260 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c819d380 con 0x7f34c8101de0 2024-09-19T09:36:54.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.641+0000 7f34c6d9d640 1 --2- 172.21.15.1:0/1726541260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34c8101de0 0x7f34c81983d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f34b800d950 tx=0x7f34b800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:54.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.641+0000 7f34affff640 1 -- 172.21.15.1:0/1726541260 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b8017070 con 0x7f34c8101de0 2024-09-19T09:36:54.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.641+0000 7f34affff640 1 -- 172.21.15.1:0/1726541260 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34b8009c30 con 0x7f34c8101de0 2024-09-19T09:36:54.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.641+0000 7f34cd237640 1 -- 172.21.15.1:0/1726541260 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34c819d670 con 0x7f34c8101de0 2024-09-19T09:36:54.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.641+0000 7f34affff640 1 -- 172.21.15.1:0/1726541260 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b800f6b0 con 0x7f34c8101de0 2024-09-19T09:36:54.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.641+0000 7f34cd237640 1 -- 172.21.15.1:0/1726541260 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34c81a4f50 con 0x7f34c8101de0 2024-09-19T09:36:54.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.642+0000 7f34cd237640 1 -- 172.21.15.1:0/1726541260 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f34c8062980 con 0x7f34c8101de0 2024-09-19T09:36:54.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.644+0000 7f34affff640 1 -- 172.21.15.1:0/1726541260 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f34b80109d0 con 0x7f34c8101de0 2024-09-19T09:36:54.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.644+0000 7f34affff640 1 --2- 172.21.15.1:0/1726541260 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f34b00a32d0 0x7f34b00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:54.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.645+0000 7f34c659c640 1 --2- 172.21.15.1:0/1726541260 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f34b00a32d0 0x7f34b00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:54.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.645+0000 7f34affff640 1 -- 172.21.15.1:0/1726541260 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f34b80cf900 con 0x7f34c8101de0 2024-09-19T09:36:54.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.645+0000 7f34affff640 1 --2- 172.21.15.1:0/1726541260 >> [v2:172.21.15.22:6824/343155547,v1:172.21.15.22:6825/343155547] conn(0x7f34b00acb20 0x7f34b00aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:54.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.645+0000 7f34affff640 1 -- 172.21.15.1:0/1726541260 --> [v2:172.21.15.22:6824/343155547,v1:172.21.15.22:6825/343155547] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f34b8016ec0 con 0x7f34b00acb20 2024-09-19T09:36:54.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.645+0000 7f34affff640 1 -- 172.21.15.1:0/1726541260 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f34b80cfde0 con 0x7f34c8101de0 2024-09-19T09:36:54.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.645+0000 7f34c659c640 1 --2- 172.21.15.1:0/1726541260 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f34b00a32d0 0x7f34b00a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f34c81088e0 tx=0x7f34bc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:54.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.645+0000 7f34c759e640 1 --2- 172.21.15.1:0/1726541260 >> [v2:172.21.15.22:6824/343155547,v1:172.21.15.22:6825/343155547] conn(0x7f34b00acb20 0x7f34b00aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:54.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.645+0000 7f34c759e640 1 --2- 172.21.15.1:0/1726541260 >> [v2:172.21.15.22:6824/343155547,v1:172.21.15.22:6825/343155547] conn(0x7f34b00acb20 0x7f34b00aef40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:54.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.646+0000 7f34affff640 1 -- 172.21.15.1:0/1726541260 <== osd.10 v2:172.21.15.22:6824/343155547 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f34b8016ec0 con 0x7f34b00acb20 2024-09-19T09:36:54.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.660+0000 7f34cd237640 1 -- 172.21.15.1:0/1726541260 --> [v2:172.21.15.22:6824/343155547,v1:172.21.15.22:6825/343155547] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f34c8062e00 con 0x7f34b00acb20 2024-09-19T09:36:54.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.660+0000 7f34affff640 1 -- 172.21.15.1:0/1726541260 <== osd.10 v2:172.21.15.22:6824/343155547 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f34c8062e00 con 0x7f34b00acb20 2024-09-19T09:36:54.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.661+0000 7f34cd237640 1 -- 172.21.15.1:0/1726541260 >> [v2:172.21.15.22:6824/343155547,v1:172.21.15.22:6825/343155547] conn(0x7f34b00acb20 msgr2=0x7f34b00aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:54.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.661+0000 7f34cd237640 1 --2- 172.21.15.1:0/1726541260 >> [v2:172.21.15.22:6824/343155547,v1:172.21.15.22:6825/343155547] conn(0x7f34b00acb20 0x7f34b00aef40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:54.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.661+0000 7f34cd237640 1 -- 172.21.15.1:0/1726541260 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f34b00a32d0 msgr2=0x7f34b00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:54.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.661+0000 7f34cd237640 1 --2- 172.21.15.1:0/1726541260 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f34b00a32d0 0x7f34b00a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f34c81088e0 tx=0x7f34bc00b410 comp rx=0 tx=0).stop 2024-09-19T09:36:54.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.661+0000 7f34cd237640 1 -- 172.21.15.1:0/1726541260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34c8101de0 msgr2=0x7f34c81983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:54.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.661+0000 7f34cd237640 1 --2- 172.21.15.1:0/1726541260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34c8101de0 0x7f34c81983d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f34b800d950 tx=0x7f34b800de10 comp rx=0 tx=0).stop 2024-09-19T09:36:54.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.661+0000 7f34c759e640 1 -- 172.21.15.1:0/1726541260 reap_dead start 2024-09-19T09:36:54.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.661+0000 7f34cd237640 1 -- 172.21.15.1:0/1726541260 shutdown_connections 2024-09-19T09:36:54.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.661+0000 7f34cd237640 1 -- 172.21.15.1:0/1726541260 >> 172.21.15.1:0/1726541260 conn(0x7f34c80fd8c0 msgr2=0x7f34c80fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:54.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.661+0000 7f34cd237640 1 -- 172.21.15.1:0/1726541260 shutdown_connections 2024-09-19T09:36:54.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:54.661+0000 7f34cd237640 1 -- 172.21.15.1:0/1726541260 wait complete. 2024-09-19T09:36:55.864 INFO:teuthology.orchestra.run.smithi001.stdout:236223201316 2024-09-19T09:36:55.865 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-19T09:36:56.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:56 smithi022 ceph-mon[35583]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-19T09:36:56.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:56 smithi121 ceph-mon[35577]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-19T09:36:56.487 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:56 smithi001 ceph-mon[31225]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-09-19T09:36:56.517 INFO:teuthology.orchestra.run.smithi001.stdout:206158430250 2024-09-19T09:36:56.517 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-19T09:36:56.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.671+0000 7f55ec37f640 1 -- 172.21.15.1:0/325004030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55e41036e0 msgr2=0x7f55e4107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:56.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.671+0000 7f55ec37f640 1 --2- 172.21.15.1:0/325004030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55e41036e0 0x7f55e4107b90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009930 tx=0x7f55d402a420 comp rx=0 tx=0).stop 2024-09-19T09:36:56.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.671+0000 7f55ec37f640 1 -- 172.21.15.1:0/325004030 shutdown_connections 2024-09-19T09:36:56.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.671+0000 7f55ec37f640 1 --2- 172.21.15.1:0/325004030 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55e41082a0 0x7f55e410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:56.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.671+0000 7f55ec37f640 1 --2- 172.21.15.1:0/325004030 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55e41036e0 0x7f55e4107b90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:56.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.671+0000 7f55ec37f640 1 --2- 172.21.15.1:0/325004030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55e4102d30 0x7f55e4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:56.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.671+0000 7f55ec37f640 1 -- 172.21.15.1:0/325004030 >> 172.21.15.1:0/325004030 conn(0x7f55e40fc7d0 msgr2=0x7f55e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:56.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.672+0000 7f55ec37f640 1 -- 172.21.15.1:0/325004030 shutdown_connections 2024-09-19T09:36:56.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.672+0000 7f55ec37f640 1 -- 172.21.15.1:0/325004030 wait complete. 2024-09-19T09:36:56.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.672+0000 7f55ec37f640 1 Processor -- start 2024-09-19T09:36:56.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.672+0000 7f55ec37f640 1 -- start start 2024-09-19T09:36:56.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.672+0000 7f55ec37f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55e4102d30 0x7f55e41a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:56.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.672+0000 7f55ec37f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55e41036e0 0x7f55e41a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:56.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.672+0000 7f55ec37f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55e41082a0 0x7f55e419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:56.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.672+0000 7f55ec37f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f55e41120a0 con 0x7f55e41082a0 2024-09-19T09:36:56.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.672+0000 7f55ec37f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f55e4111f20 con 0x7f55e41036e0 2024-09-19T09:36:56.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.672+0000 7f55ec37f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f55e4112220 con 0x7f55e4102d30 2024-09-19T09:36:56.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.673+0000 7f55ea91c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55e41082a0 0x7f55e419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:56.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.673+0000 7f55ea91c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55e41082a0 0x7f55e419a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59924/0 (socket says 172.21.15.1:59924) 2024-09-19T09:36:56.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.673+0000 7f55ea91c640 1 -- 172.21.15.1:0/611920500 learned_addr learned my addr 172.21.15.1:0/611920500 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:56.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.673+0000 7f55e991a640 1 --2- 172.21.15.1:0/611920500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55e41036e0 0x7f55e41a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:56.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.673+0000 7f55ea11b640 1 --2- 172.21.15.1:0/611920500 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55e4102d30 0x7f55e41a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:56.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.673+0000 7f55ea91c640 1 -- 172.21.15.1:0/611920500 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55e4102d30 msgr2=0x7f55e41a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:56.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.673+0000 7f55ea91c640 1 --2- 172.21.15.1:0/611920500 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55e4102d30 0x7f55e41a0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:56.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.673+0000 7f55ea91c640 1 -- 172.21.15.1:0/611920500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55e41036e0 msgr2=0x7f55e41a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:56.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.673+0000 7f55ea91c640 1 --2- 172.21.15.1:0/611920500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55e41036e0 0x7f55e41a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:56.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.673+0000 7f55ea91c640 1 -- 172.21.15.1:0/611920500 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e419ad00 con 0x7f55e41082a0 2024-09-19T09:36:56.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.673+0000 7f55ea11b640 1 --2- 172.21.15.1:0/611920500 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55e4102d30 0x7f55e41a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:36:56.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.673+0000 7f55ea91c640 1 --2- 172.21.15.1:0/611920500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55e41082a0 0x7f55e419a5d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f55dc00cad0 tx=0x7f55dc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:56.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.673+0000 7f55db7fe640 1 -- 172.21.15.1:0/611920500 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc00ae20 con 0x7f55e41082a0 2024-09-19T09:36:56.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.673+0000 7f55ec37f640 1 -- 172.21.15.1:0/611920500 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e419aff0 con 0x7f55e41082a0 2024-09-19T09:36:56.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.673+0000 7f55db7fe640 1 -- 172.21.15.1:0/611920500 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55dc005020 con 0x7f55e41082a0 2024-09-19T09:36:56.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.673+0000 7f55db7fe640 1 -- 172.21.15.1:0/611920500 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc00f6f0 con 0x7f55e41082a0 2024-09-19T09:36:56.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.673+0000 7f55ec37f640 1 -- 172.21.15.1:0/611920500 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e41a72e0 con 0x7f55e41082a0 2024-09-19T09:36:56.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.674+0000 7f55ec37f640 1 -- 172.21.15.1:0/611920500 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f55e4062980 con 0x7f55e41082a0 2024-09-19T09:36:56.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.676+0000 7f55db7fe640 1 -- 172.21.15.1:0/611920500 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f55dc0051d0 con 0x7f55e41082a0 2024-09-19T09:36:56.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.676+0000 7f55db7fe640 1 --2- 172.21.15.1:0/611920500 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f55d00a32d0 0x7f55d00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:56.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.676+0000 7f55ea11b640 1 --2- 172.21.15.1:0/611920500 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f55d00a32d0 0x7f55d00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:56.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.676+0000 7f55db7fe640 1 -- 172.21.15.1:0/611920500 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f55dc0cfcc0 con 0x7f55e41082a0 2024-09-19T09:36:56.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.677+0000 7f55db7fe640 1 --2- 172.21.15.1:0/611920500 >> [v2:172.21.15.121:6824/3202514460,v1:172.21.15.121:6825/3202514460] conn(0x7f55d00acb20 0x7f55d00aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:56.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.677+0000 7f55db7fe640 1 -- 172.21.15.1:0/611920500 --> [v2:172.21.15.121:6824/3202514460,v1:172.21.15.121:6825/3202514460] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f55dc012ec0 con 0x7f55d00acb20 2024-09-19T09:36:56.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.677+0000 7f55db7fe640 1 -- 172.21.15.1:0/611920500 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f55dc0d01a0 con 0x7f55e41082a0 2024-09-19T09:36:56.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.677+0000 7f55e991a640 1 --2- 172.21.15.1:0/611920500 >> [v2:172.21.15.121:6824/3202514460,v1:172.21.15.121:6825/3202514460] conn(0x7f55d00acb20 0x7f55d00aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:56.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.677+0000 7f55ea11b640 1 --2- 172.21.15.1:0/611920500 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f55d00a32d0 0x7f55d00a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f55e00058c0 tx=0x7f55e0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:56.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.677+0000 7f55e991a640 1 --2- 172.21.15.1:0/611920500 >> [v2:172.21.15.121:6824/3202514460,v1:172.21.15.121:6825/3202514460] conn(0x7f55d00acb20 0x7f55d00aef40 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:56.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.678+0000 7f55db7fe640 1 -- 172.21.15.1:0/611920500 <== osd.11 v2:172.21.15.121:6824/3202514460 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f55dc012ec0 con 0x7f55d00acb20 2024-09-19T09:36:56.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.692+0000 7f55ec37f640 1 -- 172.21.15.1:0/611920500 --> [v2:172.21.15.121:6824/3202514460,v1:172.21.15.121:6825/3202514460] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f55e4062e00 con 0x7f55d00acb20 2024-09-19T09:36:56.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.692+0000 7f55db7fe640 1 -- 172.21.15.1:0/611920500 <== osd.11 v2:172.21.15.121:6824/3202514460 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f55e4062e00 con 0x7f55d00acb20 2024-09-19T09:36:56.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.693+0000 7f55ec37f640 1 -- 172.21.15.1:0/611920500 >> [v2:172.21.15.121:6824/3202514460,v1:172.21.15.121:6825/3202514460] conn(0x7f55d00acb20 msgr2=0x7f55d00aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:56.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.693+0000 7f55ec37f640 1 --2- 172.21.15.1:0/611920500 >> [v2:172.21.15.121:6824/3202514460,v1:172.21.15.121:6825/3202514460] conn(0x7f55d00acb20 0x7f55d00aef40 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:56.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.693+0000 7f55ec37f640 1 -- 172.21.15.1:0/611920500 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f55d00a32d0 msgr2=0x7f55d00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:56.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.693+0000 7f55ec37f640 1 --2- 172.21.15.1:0/611920500 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f55d00a32d0 0x7f55d00a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f55e00058c0 tx=0x7f55e0005850 comp rx=0 tx=0).stop 2024-09-19T09:36:56.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.693+0000 7f55ec37f640 1 -- 172.21.15.1:0/611920500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55e41082a0 msgr2=0x7f55e419a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:56.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.693+0000 7f55ec37f640 1 --2- 172.21.15.1:0/611920500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f55e41082a0 0x7f55e419a5d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f55dc00cad0 tx=0x7f55dc00cf90 comp rx=0 tx=0).stop 2024-09-19T09:36:56.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.693+0000 7f55ea91c640 1 -- 172.21.15.1:0/611920500 reap_dead start 2024-09-19T09:36:56.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.693+0000 7f55ec37f640 1 -- 172.21.15.1:0/611920500 shutdown_connections 2024-09-19T09:36:56.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.693+0000 7f55ec37f640 1 -- 172.21.15.1:0/611920500 >> 172.21.15.1:0/611920500 conn(0x7f55e40fc7d0 msgr2=0x7f55e4100cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:56.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.693+0000 7f55ec37f640 1 -- 172.21.15.1:0/611920500 shutdown_connections 2024-09-19T09:36:56.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:56.693+0000 7f55ec37f640 1 -- 172.21.15.1:0/611920500 wait complete. 2024-09-19T09:36:57.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.156+0000 7f907de4a640 1 -- 172.21.15.1:0/121957015 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90781036e0 msgr2=0x7f9078107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:57.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.156+0000 7f907de4a640 1 --2- 172.21.15.1:0/121957015 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90781036e0 0x7f9078107b90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9060009930 tx=0x7f906002a420 comp rx=0 tx=0).stop 2024-09-19T09:36:57.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.156+0000 7f907de4a640 1 -- 172.21.15.1:0/121957015 shutdown_connections 2024-09-19T09:36:57.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.156+0000 7f907de4a640 1 --2- 172.21.15.1:0/121957015 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90781082a0 0x7f907810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.156+0000 7f907de4a640 1 --2- 172.21.15.1:0/121957015 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90781036e0 0x7f9078107b90 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.156+0000 7f907de4a640 1 --2- 172.21.15.1:0/121957015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9078102d30 0x7f9078103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.156+0000 7f907de4a640 1 -- 172.21.15.1:0/121957015 >> 172.21.15.1:0/121957015 conn(0x7f90780fc7d0 msgr2=0x7f90780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:57.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.156+0000 7f907de4a640 1 -- 172.21.15.1:0/121957015 shutdown_connections 2024-09-19T09:36:57.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.156+0000 7f907de4a640 1 -- 172.21.15.1:0/121957015 wait complete. 2024-09-19T09:36:57.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.156+0000 7f907de4a640 1 Processor -- start 2024-09-19T09:36:57.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.156+0000 7f907de4a640 1 -- start start 2024-09-19T09:36:57.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.157+0000 7f907de4a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9078102d30 0x7f9078198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:57.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.157+0000 7f907de4a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90781036e0 0x7f9078198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:57.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.157+0000 7f907de4a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90781082a0 0x7f907819cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:57.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.157+0000 7f907de4a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f90781120a0 con 0x7f90781082a0 2024-09-19T09:36:57.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.157+0000 7f907de4a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9078111f20 con 0x7f90781036e0 2024-09-19T09:36:57.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.157+0000 7f907de4a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9078112220 con 0x7f9078102d30 2024-09-19T09:36:57.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.157+0000 7f9077fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90781082a0 0x7f907819cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:57.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.157+0000 7f9077fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90781082a0 0x7f907819cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59930/0 (socket says 172.21.15.1:59930) 2024-09-19T09:36:57.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.157+0000 7f9077fff640 1 -- 172.21.15.1:0/2221668457 learned_addr learned my addr 172.21.15.1:0/2221668457 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:57.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.157+0000 7f9076ffd640 1 --2- 172.21.15.1:0/2221668457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90781036e0 0x7f9078198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:57.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.157+0000 7f90777fe640 1 --2- 172.21.15.1:0/2221668457 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9078102d30 0x7f9078198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:57.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.157+0000 7f9077fff640 1 -- 172.21.15.1:0/2221668457 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9078102d30 msgr2=0x7f9078198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:57.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.157+0000 7f9077fff640 1 --2- 172.21.15.1:0/2221668457 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9078102d30 0x7f9078198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.157+0000 7f9077fff640 1 -- 172.21.15.1:0/2221668457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90781036e0 msgr2=0x7f9078198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:57.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.157+0000 7f9077fff640 1 --2- 172.21.15.1:0/2221668457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90781036e0 0x7f9078198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.157+0000 7f9077fff640 1 -- 172.21.15.1:0/2221668457 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f907819d5d0 con 0x7f90781082a0 2024-09-19T09:36:57.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.157+0000 7f9077fff640 1 --2- 172.21.15.1:0/2221668457 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90781082a0 0x7f907819cef0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f907000c970 tx=0x7f907000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:57.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.158+0000 7f9074ff9640 1 -- 172.21.15.1:0/2221668457 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9070007bb0 con 0x7f90781082a0 2024-09-19T09:36:57.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.158+0000 7f9074ff9640 1 -- 172.21.15.1:0/2221668457 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9070007d50 con 0x7f90781082a0 2024-09-19T09:36:57.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.158+0000 7f907de4a640 1 -- 172.21.15.1:0/2221668457 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f907819d8c0 con 0x7f90781082a0 2024-09-19T09:36:57.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.158+0000 7f9074ff9640 1 -- 172.21.15.1:0/2221668457 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907000f450 con 0x7f90781082a0 2024-09-19T09:36:57.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.158+0000 7f907de4a640 1 -- 172.21.15.1:0/2221668457 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90781a51a0 con 0x7f90781082a0 2024-09-19T09:36:57.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.159+0000 7f907de4a640 1 -- 172.21.15.1:0/2221668457 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9078062940 con 0x7f90781082a0 2024-09-19T09:36:57.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.160+0000 7f9074ff9640 1 -- 172.21.15.1:0/2221668457 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f9070004ee0 con 0x7f90781082a0 2024-09-19T09:36:57.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.161+0000 7f9074ff9640 1 --2- 172.21.15.1:0/2221668457 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f90640a32d0 0x7f90640a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:57.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.161+0000 7f90777fe640 1 --2- 172.21.15.1:0/2221668457 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f90640a32d0 0x7f90640a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:57.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.161+0000 7f9074ff9640 1 -- 172.21.15.1:0/2221668457 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f90700cf990 con 0x7f90781082a0 2024-09-19T09:36:57.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.161+0000 7f9074ff9640 1 --2- 172.21.15.1:0/2221668457 >> [v2:172.21.15.1:6810/1515009793,v1:172.21.15.1:6811/1515009793] conn(0x7f90640acb20 0x7f90640aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:57.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.161+0000 7f9074ff9640 1 -- 172.21.15.1:0/2221668457 --> [v2:172.21.15.1:6810/1515009793,v1:172.21.15.1:6811/1515009793] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9070012ec0 con 0x7f90640acb20 2024-09-19T09:36:57.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.161+0000 7f9074ff9640 1 -- 172.21.15.1:0/2221668457 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f90700cfd40 con 0x7f90781082a0 2024-09-19T09:36:57.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.161+0000 7f9076ffd640 1 --2- 172.21.15.1:0/2221668457 >> [v2:172.21.15.1:6810/1515009793,v1:172.21.15.1:6811/1515009793] conn(0x7f90640acb20 0x7f90640aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:57.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.161+0000 7f90777fe640 1 --2- 172.21.15.1:0/2221668457 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f90640a32d0 0x7f90640a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9068005fd0 tx=0x7f9068009760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:57.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.162+0000 7f9076ffd640 1 --2- 172.21.15.1:0/2221668457 >> [v2:172.21.15.1:6810/1515009793,v1:172.21.15.1:6811/1515009793] conn(0x7f90640acb20 0x7f90640aef40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:57.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.162+0000 7f9074ff9640 1 -- 172.21.15.1:0/2221668457 <== osd.3 v2:172.21.15.1:6810/1515009793 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9070012ec0 con 0x7f90640acb20 2024-09-19T09:36:57.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.176+0000 7f907de4a640 1 -- 172.21.15.1:0/2221668457 --> [v2:172.21.15.1:6810/1515009793,v1:172.21.15.1:6811/1515009793] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9078062d40 con 0x7f90640acb20 2024-09-19T09:36:57.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.176+0000 7f9074ff9640 1 -- 172.21.15.1:0/2221668457 <== osd.3 v2:172.21.15.1:6810/1515009793 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9078062d40 con 0x7f90640acb20 2024-09-19T09:36:57.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.177+0000 7f907de4a640 1 -- 172.21.15.1:0/2221668457 >> [v2:172.21.15.1:6810/1515009793,v1:172.21.15.1:6811/1515009793] conn(0x7f90640acb20 msgr2=0x7f90640aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:57.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.177+0000 7f907de4a640 1 --2- 172.21.15.1:0/2221668457 >> [v2:172.21.15.1:6810/1515009793,v1:172.21.15.1:6811/1515009793] conn(0x7f90640acb20 0x7f90640aef40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.177+0000 7f907de4a640 1 -- 172.21.15.1:0/2221668457 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f90640a32d0 msgr2=0x7f90640a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:57.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.177+0000 7f907de4a640 1 --2- 172.21.15.1:0/2221668457 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f90640a32d0 0x7f90640a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9068005fd0 tx=0x7f9068009760 comp rx=0 tx=0).stop 2024-09-19T09:36:57.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.177+0000 7f907de4a640 1 -- 172.21.15.1:0/2221668457 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90781082a0 msgr2=0x7f907819cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:57.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.177+0000 7f907de4a640 1 --2- 172.21.15.1:0/2221668457 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f90781082a0 0x7f907819cef0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f907000c970 tx=0x7f907000ce30 comp rx=0 tx=0).stop 2024-09-19T09:36:57.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.177+0000 7f9077fff640 1 -- 172.21.15.1:0/2221668457 reap_dead start 2024-09-19T09:36:57.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.177+0000 7f907de4a640 1 -- 172.21.15.1:0/2221668457 shutdown_connections 2024-09-19T09:36:57.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.177+0000 7f907de4a640 1 -- 172.21.15.1:0/2221668457 >> 172.21.15.1:0/2221668457 conn(0x7f90780fc7d0 msgr2=0x7f9078105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:57.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.177+0000 7f907de4a640 1 -- 172.21.15.1:0/2221668457 shutdown_connections 2024-09-19T09:36:57.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.177+0000 7f907de4a640 1 -- 172.21.15.1:0/2221668457 wait complete. 2024-09-19T09:36:57.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.373+0000 7fb5343b0640 1 -- 172.21.15.1:0/3884337772 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb52c101de0 msgr2=0x7fb52c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:57.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.373+0000 7fb5343b0640 1 --2- 172.21.15.1:0/3884337772 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb52c101de0 0x7fb52c1021c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb528009900 tx=0x7fb52802a410 comp rx=0 tx=0).stop 2024-09-19T09:36:57.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.373+0000 7fb5343b0640 1 -- 172.21.15.1:0/3884337772 shutdown_connections 2024-09-19T09:36:57.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.373+0000 7fb5343b0640 1 --2- 172.21.15.1:0/3884337772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb52c106f10 0x7fb52c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.373+0000 7fb5343b0640 1 --2- 172.21.15.1:0/3884337772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb52c102790 0x7fb52c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.373+0000 7fb5343b0640 1 --2- 172.21.15.1:0/3884337772 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb52c101de0 0x7fb52c1021c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.373+0000 7fb5343b0640 1 -- 172.21.15.1:0/3884337772 >> 172.21.15.1:0/3884337772 conn(0x7fb52c0fd8c0 msgr2=0x7fb52c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:57.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.373+0000 7fb5343b0640 1 -- 172.21.15.1:0/3884337772 shutdown_connections 2024-09-19T09:36:57.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.373+0000 7fb5343b0640 1 -- 172.21.15.1:0/3884337772 wait complete. 2024-09-19T09:36:57.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.374+0000 7fb5343b0640 1 Processor -- start 2024-09-19T09:36:57.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.374+0000 7fb5343b0640 1 -- start start 2024-09-19T09:36:57.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.374+0000 7fb5343b0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb52c101de0 0x7fb52c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:57.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.374+0000 7fb5343b0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb52c102790 0x7fb52c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:57.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.374+0000 7fb5343b0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb52c106f10 0x7fb52c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:57.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.374+0000 7fb5343b0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb52c111f90 con 0x7fb52c101de0 2024-09-19T09:36:57.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.374+0000 7fb5343b0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb52c111e10 con 0x7fb52c102790 2024-09-19T09:36:57.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.374+0000 7fb5343b0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb52c112110 con 0x7fb52c106f10 2024-09-19T09:36:57.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.374+0000 7fb53214c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb52c101de0 0x7fb52c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:57.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.374+0000 7fb53214c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb52c101de0 0x7fb52c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59954/0 (socket says 172.21.15.1:59954) 2024-09-19T09:36:57.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.374+0000 7fb53214c640 1 -- 172.21.15.1:0/938794520 learned_addr learned my addr 172.21.15.1:0/938794520 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:36:57.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.374+0000 7fb53194b640 1 --2- 172.21.15.1:0/938794520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb52c102790 0x7fb52c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:57.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.374+0000 7fb53294d640 1 --2- 172.21.15.1:0/938794520 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb52c106f10 0x7fb52c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:57.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.375+0000 7fb53214c640 1 -- 172.21.15.1:0/938794520 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb52c106f10 msgr2=0x7fb52c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:57.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.375+0000 7fb53214c640 1 --2- 172.21.15.1:0/938794520 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb52c106f10 0x7fb52c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.375+0000 7fb53214c640 1 -- 172.21.15.1:0/938794520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb52c102790 msgr2=0x7fb52c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:57.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.375+0000 7fb53214c640 1 --2- 172.21.15.1:0/938794520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb52c102790 0x7fb52c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.375+0000 7fb53214c640 1 -- 172.21.15.1:0/938794520 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb52c1a69d0 con 0x7fb52c101de0 2024-09-19T09:36:57.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.375+0000 7fb53214c640 1 --2- 172.21.15.1:0/938794520 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb52c101de0 0x7fb52c0744f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb528006010 tx=0x7fb5280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:57.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.375+0000 7fb5237fe640 1 -- 172.21.15.1:0/938794520 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb52803f030 con 0x7fb52c101de0 2024-09-19T09:36:57.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.375+0000 7fb5237fe640 1 -- 172.21.15.1:0/938794520 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb528003ce0 con 0x7fb52c101de0 2024-09-19T09:36:57.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.375+0000 7fb5343b0640 1 -- 172.21.15.1:0/938794520 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb52c1a6c60 con 0x7fb52c101de0 2024-09-19T09:36:57.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.375+0000 7fb5237fe640 1 -- 172.21.15.1:0/938794520 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb528035070 con 0x7fb52c101de0 2024-09-19T09:36:57.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.375+0000 7fb5343b0640 1 -- 172.21.15.1:0/938794520 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb52c1a7190 con 0x7fb52c101de0 2024-09-19T09:36:57.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.376+0000 7fb5343b0640 1 -- 172.21.15.1:0/938794520 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb52c062880 con 0x7fb52c101de0 2024-09-19T09:36:57.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.377+0000 7fb5237fe640 1 -- 172.21.15.1:0/938794520 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fb528042030 con 0x7fb52c101de0 2024-09-19T09:36:57.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.378+0000 7fb5237fe640 1 --2- 172.21.15.1:0/938794520 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb5180a3350 0x7fb5180a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:57.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.378+0000 7fb53194b640 1 --2- 172.21.15.1:0/938794520 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb5180a3350 0x7fb5180a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:57.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.378+0000 7fb5237fe640 1 -- 172.21.15.1:0/938794520 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fb5280f02c0 con 0x7fb52c101de0 2024-09-19T09:36:57.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.378+0000 7fb5237fe640 1 --2- 172.21.15.1:0/938794520 >> [v2:172.21.15.1:6802/502676986,v1:172.21.15.1:6803/502676986] conn(0x7fb5180acba0 0x7fb5180aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:36:57.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.378+0000 7fb5237fe640 1 -- 172.21.15.1:0/938794520 --> [v2:172.21.15.1:6802/502676986,v1:172.21.15.1:6803/502676986] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb528001d30 con 0x7fb5180acba0 2024-09-19T09:36:57.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.378+0000 7fb5237fe640 1 -- 172.21.15.1:0/938794520 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7fb5280f07a0 con 0x7fb52c101de0 2024-09-19T09:36:57.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.378+0000 7fb53294d640 1 --2- 172.21.15.1:0/938794520 >> [v2:172.21.15.1:6802/502676986,v1:172.21.15.1:6803/502676986] conn(0x7fb5180acba0 0x7fb5180aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:36:57.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.379+0000 7fb53194b640 1 --2- 172.21.15.1:0/938794520 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb5180a3350 0x7fb5180a5810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb52c075f80 tx=0x7fb51c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:57.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.379+0000 7fb53294d640 1 --2- 172.21.15.1:0/938794520 >> [v2:172.21.15.1:6802/502676986,v1:172.21.15.1:6803/502676986] conn(0x7fb5180acba0 0x7fb5180aefc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:36:57.407 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.380+0000 7fb5237fe640 1 -- 172.21.15.1:0/938794520 <== osd.0 v2:172.21.15.1:6802/502676986 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb528001d30 con 0x7fb5180acba0 2024-09-19T09:36:57.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.393+0000 7fb5343b0640 1 -- 172.21.15.1:0/938794520 --> [v2:172.21.15.1:6802/502676986,v1:172.21.15.1:6803/502676986] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb52c062c80 con 0x7fb5180acba0 2024-09-19T09:36:57.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.393+0000 7fb5237fe640 1 -- 172.21.15.1:0/938794520 <== osd.0 v2:172.21.15.1:6802/502676986 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb52c062c80 con 0x7fb5180acba0 2024-09-19T09:36:57.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.394+0000 7fb5343b0640 1 -- 172.21.15.1:0/938794520 >> [v2:172.21.15.1:6802/502676986,v1:172.21.15.1:6803/502676986] conn(0x7fb5180acba0 msgr2=0x7fb5180aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:57.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.394+0000 7fb5343b0640 1 --2- 172.21.15.1:0/938794520 >> [v2:172.21.15.1:6802/502676986,v1:172.21.15.1:6803/502676986] conn(0x7fb5180acba0 0x7fb5180aefc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.394+0000 7fb5343b0640 1 -- 172.21.15.1:0/938794520 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb5180a3350 msgr2=0x7fb5180a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:57.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.394+0000 7fb5343b0640 1 --2- 172.21.15.1:0/938794520 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb5180a3350 0x7fb5180a5810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb52c075f80 tx=0x7fb51c009110 comp rx=0 tx=0).stop 2024-09-19T09:36:57.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.394+0000 7fb5343b0640 1 -- 172.21.15.1:0/938794520 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb52c101de0 msgr2=0x7fb52c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:36:57.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.394+0000 7fb5343b0640 1 --2- 172.21.15.1:0/938794520 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb52c101de0 0x7fb52c0744f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb528006010 tx=0x7fb5280042f0 comp rx=0 tx=0).stop 2024-09-19T09:36:57.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.394+0000 7fb53294d640 1 -- 172.21.15.1:0/938794520 reap_dead start 2024-09-19T09:36:57.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.394+0000 7fb5343b0640 1 -- 172.21.15.1:0/938794520 shutdown_connections 2024-09-19T09:36:57.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.394+0000 7fb5343b0640 1 -- 172.21.15.1:0/938794520 >> 172.21.15.1:0/938794520 conn(0x7fb52c0fd8c0 msgr2=0x7fb52c0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:36:57.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.394+0000 7fb5343b0640 1 -- 172.21.15.1:0/938794520 shutdown_connections 2024-09-19T09:36:57.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:57.394+0000 7fb5343b0640 1 -- 172.21.15.1:0/938794520 wait complete. 2024-09-19T09:36:58.242 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:36:58 smithi001 ceph-mon[31225]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-19T09:36:58.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:36:58 smithi022 ceph-mon[35583]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-19T09:36:58.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:36:58 smithi121 ceph-mon[35577]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-19T09:36:58.745 INFO:teuthology.orchestra.run.smithi001.stdout:292057776155 2024-09-19T09:36:58.745 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-19T09:36:59.388 INFO:teuthology.orchestra.run.smithi001.stdout:103079215168 2024-09-19T09:36:59.389 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-19T09:36:59.994 INFO:teuthology.orchestra.run.smithi001.stdout:266287972383 2024-09-19T09:36:59.995 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-19T09:37:00.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:00 smithi001 ceph-mon[31225]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:00.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:00 smithi022 ceph-mon[35583]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:00.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:00 smithi121 ceph-mon[35577]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:00.419 INFO:teuthology.orchestra.run.smithi001.stdout:184683593774 2024-09-19T09:37:00.420 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-19T09:37:00.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.611+0000 7f3994741640 1 -- 172.21.15.1:0/1472688376 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f398c102ef0 msgr2=0x7f398c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:00.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.611+0000 7f3994741640 1 --2- 172.21.15.1:0/1472688376 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f398c102ef0 0x7f398c10da40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3984009900 tx=0x7f398402a480 comp rx=0 tx=0).stop 2024-09-19T09:37:00.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.611+0000 7f3994741640 1 -- 172.21.15.1:0/1472688376 shutdown_connections 2024-09-19T09:37:00.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.611+0000 7f3994741640 1 --2- 172.21.15.1:0/1472688376 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f398c102ef0 0x7f398c10da40 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:00.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.611+0000 7f3994741640 1 --2- 172.21.15.1:0/1472688376 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f398c102570 0x7f398c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:00.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.611+0000 7f3994741640 1 --2- 172.21.15.1:0/1472688376 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f398c100e20 0x7f398c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:00.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.611+0000 7f3994741640 1 -- 172.21.15.1:0/1472688376 >> 172.21.15.1:0/1472688376 conn(0x7f398c0fc7d0 msgr2=0x7f398c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:00.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.611+0000 7f3994741640 1 -- 172.21.15.1:0/1472688376 shutdown_connections 2024-09-19T09:37:00.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.611+0000 7f3994741640 1 -- 172.21.15.1:0/1472688376 wait complete. 2024-09-19T09:37:00.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.612+0000 7f3994741640 1 Processor -- start 2024-09-19T09:37:00.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.612+0000 7f3994741640 1 -- start start 2024-09-19T09:37:00.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.612+0000 7f3994741640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f398c100e20 0x7f398c198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:00.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.612+0000 7f3994741640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f398c102570 0x7f398c198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:00.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.612+0000 7f3994741640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f398c102ef0 0x7f398c19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:00.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.612+0000 7f3994741640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f398c110fa0 con 0x7f398c100e20 2024-09-19T09:37:00.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.612+0000 7f3994741640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f398c110e20 con 0x7f398c102570 2024-09-19T09:37:00.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.612+0000 7f3994741640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f398c111120 con 0x7f398c102ef0 2024-09-19T09:37:00.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.612+0000 7f39924dd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f398c100e20 0x7f398c198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:00.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.612+0000 7f39924dd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f398c100e20 0x7f398c198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59974/0 (socket says 172.21.15.1:59974) 2024-09-19T09:37:00.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.612+0000 7f39924dd640 1 -- 172.21.15.1:0/2185045405 learned_addr learned my addr 172.21.15.1:0/2185045405 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:00.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.612+0000 7f3991cdc640 1 --2- 172.21.15.1:0/2185045405 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f398c102570 0x7f398c198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:00.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.613+0000 7f3992cde640 1 --2- 172.21.15.1:0/2185045405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f398c102ef0 0x7f398c19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:00.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.613+0000 7f39924dd640 1 -- 172.21.15.1:0/2185045405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f398c102ef0 msgr2=0x7f398c19cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:00.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.613+0000 7f39924dd640 1 --2- 172.21.15.1:0/2185045405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f398c102ef0 0x7f398c19cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:00.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.613+0000 7f39924dd640 1 -- 172.21.15.1:0/2185045405 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f398c102570 msgr2=0x7f398c198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:00.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.613+0000 7f39924dd640 1 --2- 172.21.15.1:0/2185045405 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f398c102570 0x7f398c198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:00.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.613+0000 7f39924dd640 1 -- 172.21.15.1:0/2185045405 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f398c19d400 con 0x7f398c100e20 2024-09-19T09:37:00.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.613+0000 7f3992cde640 1 --2- 172.21.15.1:0/2185045405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f398c102ef0 0x7f398c19cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:00.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.613+0000 7f3991cdc640 1 --2- 172.21.15.1:0/2185045405 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f398c102570 0x7f398c198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:00.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.613+0000 7f39924dd640 1 --2- 172.21.15.1:0/2185045405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f398c100e20 0x7f398c198450 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f397c00cce0 tx=0x7f397c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:00.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.613+0000 7f398b7fe640 1 -- 172.21.15.1:0/2185045405 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c00f650 con 0x7f398c100e20 2024-09-19T09:37:00.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.613+0000 7f398b7fe640 1 -- 172.21.15.1:0/2185045405 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f397c00fcd0 con 0x7f398c100e20 2024-09-19T09:37:00.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.613+0000 7f3994741640 1 -- 172.21.15.1:0/2185045405 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f398c19d6f0 con 0x7f398c100e20 2024-09-19T09:37:00.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.613+0000 7f398b7fe640 1 -- 172.21.15.1:0/2185045405 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c018c70 con 0x7f398c100e20 2024-09-19T09:37:00.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.613+0000 7f3994741640 1 -- 172.21.15.1:0/2185045405 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f398c1a4fd0 con 0x7f398c100e20 2024-09-19T09:37:00.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.614+0000 7f3994741640 1 -- 172.21.15.1:0/2185045405 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f398c062940 con 0x7f398c100e20 2024-09-19T09:37:00.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.615+0000 7f398b7fe640 1 -- 172.21.15.1:0/2185045405 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f397c00f7f0 con 0x7f398c100e20 2024-09-19T09:37:00.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.616+0000 7f398b7fe640 1 --2- 172.21.15.1:0/2185045405 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f39740a3350 0x7f39740a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:00.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.616+0000 7f3991cdc640 1 --2- 172.21.15.1:0/2185045405 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f39740a3350 0x7f39740a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:00.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.616+0000 7f398b7fe640 1 -- 172.21.15.1:0/2185045405 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f397c0d0260 con 0x7f398c100e20 2024-09-19T09:37:00.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.616+0000 7f398b7fe640 1 --2- 172.21.15.1:0/2185045405 >> [v2:172.21.15.121:6808/3137245658,v1:172.21.15.121:6809/3137245658] conn(0x7f39740acba0 0x7f39740aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:00.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.616+0000 7f398b7fe640 1 -- 172.21.15.1:0/2185045405 --> [v2:172.21.15.121:6808/3137245658,v1:172.21.15.121:6809/3137245658] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f39740af670 con 0x7f39740acba0 2024-09-19T09:37:00.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.616+0000 7f398b7fe640 1 -- 172.21.15.1:0/2185045405 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f397c0d0740 con 0x7f398c100e20 2024-09-19T09:37:00.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.616+0000 7f3991cdc640 1 --2- 172.21.15.1:0/2185045405 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f39740a3350 0x7f39740a5810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f398c1051a0 tx=0x7f3980008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:00.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.617+0000 7f3992cde640 1 --2- 172.21.15.1:0/2185045405 >> [v2:172.21.15.121:6808/3137245658,v1:172.21.15.121:6809/3137245658] conn(0x7f39740acba0 0x7f39740aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:00.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.617+0000 7f3992cde640 1 --2- 172.21.15.1:0/2185045405 >> [v2:172.21.15.121:6808/3137245658,v1:172.21.15.121:6809/3137245658] conn(0x7f39740acba0 0x7f39740aefc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:00.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.618+0000 7f398b7fe640 1 -- 172.21.15.1:0/2185045405 <== osd.5 v2:172.21.15.121:6808/3137245658 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f39740af670 con 0x7f39740acba0 2024-09-19T09:37:00.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.632+0000 7f3994741640 1 -- 172.21.15.1:0/2185045405 --> [v2:172.21.15.121:6808/3137245658,v1:172.21.15.121:6809/3137245658] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f398c062d40 con 0x7f39740acba0 2024-09-19T09:37:00.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.632+0000 7f398b7fe640 1 -- 172.21.15.1:0/2185045405 <== osd.5 v2:172.21.15.121:6808/3137245658 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f398c062d40 con 0x7f39740acba0 2024-09-19T09:37:00.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.633+0000 7f3994741640 1 -- 172.21.15.1:0/2185045405 >> [v2:172.21.15.121:6808/3137245658,v1:172.21.15.121:6809/3137245658] conn(0x7f39740acba0 msgr2=0x7f39740aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:00.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.633+0000 7f3994741640 1 --2- 172.21.15.1:0/2185045405 >> [v2:172.21.15.121:6808/3137245658,v1:172.21.15.121:6809/3137245658] conn(0x7f39740acba0 0x7f39740aefc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:00.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.633+0000 7f3994741640 1 -- 172.21.15.1:0/2185045405 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f39740a3350 msgr2=0x7f39740a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:00.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.633+0000 7f3994741640 1 --2- 172.21.15.1:0/2185045405 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f39740a3350 0x7f39740a5810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f398c1051a0 tx=0x7f3980008040 comp rx=0 tx=0).stop 2024-09-19T09:37:00.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.633+0000 7f3994741640 1 -- 172.21.15.1:0/2185045405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f398c100e20 msgr2=0x7f398c198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:00.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.633+0000 7f3994741640 1 --2- 172.21.15.1:0/2185045405 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f398c100e20 0x7f398c198450 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f397c00cce0 tx=0x7f397c00a620 comp rx=0 tx=0).stop 2024-09-19T09:37:00.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.633+0000 7f3992cde640 1 -- 172.21.15.1:0/2185045405 reap_dead start 2024-09-19T09:37:00.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.633+0000 7f3994741640 1 -- 172.21.15.1:0/2185045405 shutdown_connections 2024-09-19T09:37:00.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.633+0000 7f3994741640 1 -- 172.21.15.1:0/2185045405 >> 172.21.15.1:0/2185045405 conn(0x7f398c0fc7d0 msgr2=0x7f398c06a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:00.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.633+0000 7f3994741640 1 -- 172.21.15.1:0/2185045405 shutdown_connections 2024-09-19T09:37:00.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:36:59.633+0000 7f3994741640 1 -- 172.21.15.1:0/2185045405 wait complete. 2024-09-19T09:37:01.231 INFO:teuthology.orchestra.run.smithi001.stdout:154618822710 2024-09-19T09:37:01.231 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-19T09:37:01.404 INFO:teuthology.orchestra.run.smithi001.stdout:55834574920 2024-09-19T09:37:01.404 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-19T09:37:01.822 INFO:teuthology.orchestra.run.smithi001.stdout:34359738447 2024-09-19T09:37:01.823 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-19T09:37:02.302 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:02.309 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:02.357 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:02 smithi001 ceph-mon[31225]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:02.358 INFO:teuthology.orchestra.run.smithi001.stdout:322122547222 2024-09-19T09:37:02.358 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-19T09:37:02.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:02 smithi022 ceph-mon[35583]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:02.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:02 smithi121 ceph-mon[35577]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:03.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.045+0000 7fe912ddf640 1 -- 172.21.15.1:0/116924744 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe90c106f20 msgr2=0x7fe90c10eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:03.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.045+0000 7fe912ddf640 1 --2- 172.21.15.1:0/116924744 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe90c106f20 0x7fe90c10eaa0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe904009ca0 tx=0x7fe90402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:37:03.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.045+0000 7fe912ddf640 1 -- 172.21.15.1:0/116924744 shutdown_connections 2024-09-19T09:37:03.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.045+0000 7fe912ddf640 1 --2- 172.21.15.1:0/116924744 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe90c106f20 0x7fe90c10eaa0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:03.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.045+0000 7fe912ddf640 1 --2- 172.21.15.1:0/116924744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe90c1027a0 0x7fe90c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:03.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.045+0000 7fe912ddf640 1 --2- 172.21.15.1:0/116924744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe90c101df0 0x7fe90c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:03.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.045+0000 7fe912ddf640 1 -- 172.21.15.1:0/116924744 >> 172.21.15.1:0/116924744 conn(0x7fe90c0fd8f0 msgr2=0x7fe90c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:03.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.046+0000 7fe912ddf640 1 -- 172.21.15.1:0/116924744 shutdown_connections 2024-09-19T09:37:03.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.046+0000 7fe912ddf640 1 -- 172.21.15.1:0/116924744 wait complete. 2024-09-19T09:37:03.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.046+0000 7fe912ddf640 1 Processor -- start 2024-09-19T09:37:03.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.046+0000 7fe912ddf640 1 -- start start 2024-09-19T09:37:03.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.046+0000 7fe912ddf640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe90c101df0 0x7fe90c198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:03.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.046+0000 7fe912ddf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe90c1027a0 0x7fe90c1988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:03.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.046+0000 7fe912ddf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe90c106f20 0x7fe90c19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:03.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.046+0000 7fe912ddf640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe90c111f80 con 0x7fe90c101df0 2024-09-19T09:37:03.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.046+0000 7fe912ddf640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe90c111e00 con 0x7fe90c1027a0 2024-09-19T09:37:03.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.046+0000 7fe912ddf640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe90c112100 con 0x7fe90c106f20 2024-09-19T09:37:03.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.046+0000 7fe910b7b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe90c101df0 0x7fe90c198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:03.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.046+0000 7fe910b7b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe90c101df0 0x7fe90c198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60004/0 (socket says 172.21.15.1:60004) 2024-09-19T09:37:03.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.046+0000 7fe910b7b640 1 -- 172.21.15.1:0/2538688434 learned_addr learned my addr 172.21.15.1:0/2538688434 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:03.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.047+0000 7fe90bfff640 1 --2- 172.21.15.1:0/2538688434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe90c1027a0 0x7fe90c1988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:03.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.047+0000 7fe91137c640 1 --2- 172.21.15.1:0/2538688434 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe90c106f20 0x7fe90c19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:03.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.047+0000 7fe910b7b640 1 -- 172.21.15.1:0/2538688434 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe90c106f20 msgr2=0x7fe90c19cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:03.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.047+0000 7fe910b7b640 1 --2- 172.21.15.1:0/2538688434 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe90c106f20 0x7fe90c19cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:03.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.047+0000 7fe910b7b640 1 -- 172.21.15.1:0/2538688434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe90c1027a0 msgr2=0x7fe90c1988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:03.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.047+0000 7fe910b7b640 1 --2- 172.21.15.1:0/2538688434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe90c1027a0 0x7fe90c1988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:03.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.047+0000 7fe910b7b640 1 -- 172.21.15.1:0/2538688434 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe90c19d330 con 0x7fe90c101df0 2024-09-19T09:37:03.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.047+0000 7fe910b7b640 1 --2- 172.21.15.1:0/2538688434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe90c101df0 0x7fe90c198380 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc00c920 tx=0x7fe8fc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:03.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.047+0000 7fe909ffb640 1 -- 172.21.15.1:0/2538688434 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc007c70 con 0x7fe90c101df0 2024-09-19T09:37:03.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.047+0000 7fe909ffb640 1 -- 172.21.15.1:0/2538688434 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8fc007e10 con 0x7fe90c101df0 2024-09-19T09:37:03.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.047+0000 7fe912ddf640 1 -- 172.21.15.1:0/2538688434 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe90c19d620 con 0x7fe90c101df0 2024-09-19T09:37:03.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.047+0000 7fe909ffb640 1 -- 172.21.15.1:0/2538688434 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc018890 con 0x7fe90c101df0 2024-09-19T09:37:03.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.047+0000 7fe912ddf640 1 -- 172.21.15.1:0/2538688434 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe90c1a4f00 con 0x7fe90c101df0 2024-09-19T09:37:03.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.048+0000 7fe912ddf640 1 -- 172.21.15.1:0/2538688434 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe90c1021d0 con 0x7fe90c101df0 2024-09-19T09:37:03.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.049+0000 7fe909ffb640 1 -- 172.21.15.1:0/2538688434 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fe8fc018a70 con 0x7fe90c101df0 2024-09-19T09:37:03.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.050+0000 7fe909ffb640 1 --2- 172.21.15.1:0/2538688434 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe8f40a32d0 0x7fe8f40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:03.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.050+0000 7fe909ffb640 1 -- 172.21.15.1:0/2538688434 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fe8fc0cfa40 con 0x7fe90c101df0 2024-09-19T09:37:03.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.050+0000 7fe90bfff640 1 --2- 172.21.15.1:0/2538688434 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe8f40a32d0 0x7fe8f40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:03.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.050+0000 7fe90bfff640 1 --2- 172.21.15.1:0/2538688434 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe8f40a32d0 0x7fe8f40a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe90c1083b0 tx=0x7fe90000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:03.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.054+0000 7fe909ffb640 1 -- 172.21.15.1:0/2538688434 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe8fc014030 con 0x7fe90c101df0 2024-09-19T09:37:03.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.234+0000 7fe912ddf640 1 -- 172.21.15.1:0/2538688434 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fe90c109b70 con 0x7fe90c101df0 2024-09-19T09:37:03.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.234+0000 7fe909ffb640 1 -- 172.21.15.1:0/2538688434 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe8fc09c7b0 con 0x7fe90c101df0 2024-09-19T09:37:03.236 INFO:teuthology.orchestra.run.smithi001.stdout:137438953531 2024-09-19T09:37:03.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.237+0000 7fe912ddf640 1 -- 172.21.15.1:0/2538688434 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe8f40a32d0 msgr2=0x7fe8f40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:03.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.237+0000 7fe912ddf640 1 --2- 172.21.15.1:0/2538688434 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe8f40a32d0 0x7fe8f40a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe90c1083b0 tx=0x7fe90000b390 comp rx=0 tx=0).stop 2024-09-19T09:37:03.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.237+0000 7fe912ddf640 1 -- 172.21.15.1:0/2538688434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe90c101df0 msgr2=0x7fe90c198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:03.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.237+0000 7fe912ddf640 1 --2- 172.21.15.1:0/2538688434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe90c101df0 0x7fe90c198380 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc00c920 tx=0x7fe8fc00cde0 comp rx=0 tx=0).stop 2024-09-19T09:37:03.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.237+0000 7fe912ddf640 1 -- 172.21.15.1:0/2538688434 shutdown_connections 2024-09-19T09:37:03.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.237+0000 7fe912ddf640 1 --2- 172.21.15.1:0/2538688434 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe90c106f20 0x7fe90c19cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:03.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.237+0000 7fe912ddf640 1 --2- 172.21.15.1:0/2538688434 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe8f40a32d0 0x7fe8f40a5790 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:03.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.237+0000 7fe912ddf640 1 --2- 172.21.15.1:0/2538688434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe90c1027a0 0x7fe90c1988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:03.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.237+0000 7fe912ddf640 1 --2- 172.21.15.1:0/2538688434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe90c101df0 0x7fe90c198380 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:03.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.237+0000 7fe912ddf640 1 -- 172.21.15.1:0/2538688434 >> 172.21.15.1:0/2538688434 conn(0x7fe90c0fd8f0 msgr2=0x7fe90c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:03.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.237+0000 7fe912ddf640 1 -- 172.21.15.1:0/2538688434 shutdown_connections 2024-09-19T09:37:03.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.237+0000 7fe912ddf640 1 -- 172.21.15.1:0/2538688434 wait complete. 2024-09-19T09:37:03.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.257+0000 7f82cacd0640 1 -- 172.21.15.1:0/3741078126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82c4102570 msgr2=0x7f82c41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:03.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.257+0000 7f82cacd0640 1 --2- 172.21.15.1:0/3741078126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82c4102570 0x7f82c41029b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f82b0009900 tx=0x7f82b002a480 comp rx=0 tx=0).stop 2024-09-19T09:37:03.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.257+0000 7f82cacd0640 1 -- 172.21.15.1:0/3741078126 shutdown_connections 2024-09-19T09:37:03.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.257+0000 7f82cacd0640 1 --2- 172.21.15.1:0/3741078126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82c4102ef0 0x7f82c410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:03.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.257+0000 7f82cacd0640 1 --2- 172.21.15.1:0/3741078126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82c4102570 0x7f82c41029b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:03.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.257+0000 7f82cacd0640 1 --2- 172.21.15.1:0/3741078126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82c4100e20 0x7f82c4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:03.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.257+0000 7f82cacd0640 1 -- 172.21.15.1:0/3741078126 >> 172.21.15.1:0/3741078126 conn(0x7f82c40fc7d0 msgr2=0x7f82c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:03.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.257+0000 7f82cacd0640 1 -- 172.21.15.1:0/3741078126 shutdown_connections 2024-09-19T09:37:03.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.257+0000 7f82cacd0640 1 -- 172.21.15.1:0/3741078126 wait complete. 2024-09-19T09:37:03.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.258+0000 7f82cacd0640 1 Processor -- start 2024-09-19T09:37:03.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.258+0000 7f82cacd0640 1 -- start start 2024-09-19T09:37:03.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.258+0000 7f82cacd0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82c4100e20 0x7f82c41973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:03.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.258+0000 7f82cacd0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82c4102570 0x7f82c4197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:03.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.258+0000 7f82cacd0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82c4102ef0 0x7f82c419bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:03.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.258+0000 7f82cacd0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f82c4110f80 con 0x7f82c4102570 2024-09-19T09:37:03.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.258+0000 7f82cacd0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f82c4110e00 con 0x7f82c4102ef0 2024-09-19T09:37:03.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.258+0000 7f82cacd0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f82c4111100 con 0x7f82c4100e20 2024-09-19T09:37:03.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.258+0000 7f82c3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82c4102570 0x7f82c4197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:03.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.258+0000 7f82c3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82c4102570 0x7f82c4197920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60028/0 (socket says 172.21.15.1:60028) 2024-09-19T09:37:03.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.258+0000 7f82c3fff640 1 -- 172.21.15.1:0/995968257 learned_addr learned my addr 172.21.15.1:0/995968257 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:03.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.258+0000 7f82c8a6c640 1 --2- 172.21.15.1:0/995968257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82c4100e20 0x7f82c41973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:03.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.258+0000 7f82c926d640 1 --2- 172.21.15.1:0/995968257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82c4102ef0 0x7f82c419bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:03.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.259+0000 7f82c3fff640 1 -- 172.21.15.1:0/995968257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82c4100e20 msgr2=0x7f82c41973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:03.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.259+0000 7f82c3fff640 1 --2- 172.21.15.1:0/995968257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82c4100e20 0x7f82c41973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:03.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.259+0000 7f82c3fff640 1 -- 172.21.15.1:0/995968257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82c4102ef0 msgr2=0x7f82c419bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:03.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.259+0000 7f82c3fff640 1 --2- 172.21.15.1:0/995968257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82c4102ef0 0x7f82c419bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:03.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.259+0000 7f82c3fff640 1 -- 172.21.15.1:0/995968257 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c419c390 con 0x7f82c4102570 2024-09-19T09:37:03.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.259+0000 7f82c926d640 1 --2- 172.21.15.1:0/995968257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82c4102ef0 0x7f82c419bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:03.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.259+0000 7f82c3fff640 1 --2- 172.21.15.1:0/995968257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82c4102570 0x7f82c4197920 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f82b0006010 tx=0x7f82b0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:03.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.259+0000 7f82c1ffb640 1 -- 172.21.15.1:0/995968257 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b003f070 con 0x7f82c4102570 2024-09-19T09:37:03.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.259+0000 7f82cacd0640 1 -- 172.21.15.1:0/995968257 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82c419c620 con 0x7f82c4102570 2024-09-19T09:37:03.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.259+0000 7f82c1ffb640 1 -- 172.21.15.1:0/995968257 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82b0031c30 con 0x7f82c4102570 2024-09-19T09:37:03.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.259+0000 7f82c1ffb640 1 -- 172.21.15.1:0/995968257 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b0035030 con 0x7f82c4102570 2024-09-19T09:37:03.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.259+0000 7f82cacd0640 1 -- 172.21.15.1:0/995968257 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82c4069f70 con 0x7f82c4102570 2024-09-19T09:37:03.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.260+0000 7f82cacd0640 1 -- 172.21.15.1:0/995968257 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82c41021b0 con 0x7f82c4102570 2024-09-19T09:37:03.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.262+0000 7f82c1ffb640 1 -- 172.21.15.1:0/995968257 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f82b0042070 con 0x7f82c4102570 2024-09-19T09:37:03.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.263+0000 7f82c1ffb640 1 --2- 172.21.15.1:0/995968257 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f82b40a54e0 0x7f82b40a79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:03.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.263+0000 7f82c8a6c640 1 --2- 172.21.15.1:0/995968257 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f82b40a54e0 0x7f82b40a79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:03.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.263+0000 7f82c1ffb640 1 -- 172.21.15.1:0/995968257 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f82b00f0570 con 0x7f82c4102570 2024-09-19T09:37:03.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.263+0000 7f82c8a6c640 1 --2- 172.21.15.1:0/995968257 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f82b40a54e0 0x7f82b40a79a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f82b8005d00 tx=0x7f82b8005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:03.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.266+0000 7f82c1ffb640 1 -- 172.21.15.1:0/995968257 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f82b00bd2e0 con 0x7f82c4102570 2024-09-19T09:37:03.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.443+0000 7f82cacd0640 1 -- 172.21.15.1:0/995968257 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f82c4101200 con 0x7f82c4102570 2024-09-19T09:37:03.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.443+0000 7f82c1ffb640 1 -- 172.21.15.1:0/995968257 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f82c4101200 con 0x7f82c4102570 2024-09-19T09:37:03.445 INFO:teuthology.orchestra.run.smithi001.stdout:73014444101 2024-09-19T09:37:03.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.445+0000 7f82cacd0640 1 -- 172.21.15.1:0/995968257 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f82b40a54e0 msgr2=0x7f82b40a79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:03.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.445+0000 7f82cacd0640 1 --2- 172.21.15.1:0/995968257 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f82b40a54e0 0x7f82b40a79a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f82b8005d00 tx=0x7f82b8005c50 comp rx=0 tx=0).stop 2024-09-19T09:37:03.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.445+0000 7f82cacd0640 1 -- 172.21.15.1:0/995968257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82c4102570 msgr2=0x7f82c4197920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:03.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.445+0000 7f82cacd0640 1 --2- 172.21.15.1:0/995968257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82c4102570 0x7f82c4197920 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f82b0006010 tx=0x7f82b0003c10 comp rx=0 tx=0).stop 2024-09-19T09:37:03.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.445+0000 7f82cacd0640 1 -- 172.21.15.1:0/995968257 shutdown_connections 2024-09-19T09:37:03.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.445+0000 7f82cacd0640 1 --2- 172.21.15.1:0/995968257 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f82b40a54e0 0x7f82b40a79a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:03.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.445+0000 7f82cacd0640 1 --2- 172.21.15.1:0/995968257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82c4102ef0 0x7f82c419bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:03.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.445+0000 7f82cacd0640 1 --2- 172.21.15.1:0/995968257 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f82c4102570 0x7f82c4197920 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:03.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.445+0000 7f82cacd0640 1 --2- 172.21.15.1:0/995968257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82c4100e20 0x7f82c41973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:03.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.445+0000 7f82cacd0640 1 -- 172.21.15.1:0/995968257 >> 172.21.15.1:0/995968257 conn(0x7f82c40fc7d0 msgr2=0x7f82c41068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:03.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.446+0000 7f82cacd0640 1 -- 172.21.15.1:0/995968257 shutdown_connections 2024-09-19T09:37:03.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:03.446+0000 7f82cacd0640 1 -- 172.21.15.1:0/995968257 wait complete. 2024-09-19T09:37:04.167 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953529 got 137438953531 for osd.4 2024-09-19T09:37:04.167 DEBUG:teuthology.parallel:result is None 2024-09-19T09:37:04.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:04 smithi022 ceph-mon[35583]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:04.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:04 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/2538688434' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T09:37:04.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:04 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/995968257' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T09:37:04.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:04 smithi121 ceph-mon[35577]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:04.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:04 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/2538688434' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T09:37:04.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:04 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/995968257' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T09:37:04.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:04 smithi001 ceph-mon[31225]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:04.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:04 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/2538688434' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T09:37:04.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:04 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/995968257' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T09:37:04.605 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444099 got 73014444101 for osd.2 2024-09-19T09:37:04.606 DEBUG:teuthology.parallel:result is None 2024-09-19T09:37:04.628 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:04.630 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:04.630 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:04.630 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:04.736 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:05.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.675+0000 7f0ed56ca640 1 -- 172.21.15.1:0/326370400 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ed0101de0 msgr2=0x7f0ed01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:05.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.675+0000 7f0ed56ca640 1 --2- 172.21.15.1:0/326370400 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ed0101de0 0x7f0ed01021c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0009900 tx=0x7f0ec002a410 comp rx=0 tx=0).stop 2024-09-19T09:37:05.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.675+0000 7f0ed56ca640 1 -- 172.21.15.1:0/326370400 shutdown_connections 2024-09-19T09:37:05.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.675+0000 7f0ed56ca640 1 --2- 172.21.15.1:0/326370400 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ed0106f10 0x7f0ed010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.675+0000 7f0ed56ca640 1 --2- 172.21.15.1:0/326370400 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ed0102790 0x7f0ed01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.675+0000 7f0ed56ca640 1 --2- 172.21.15.1:0/326370400 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ed0101de0 0x7f0ed01021c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.675+0000 7f0ed56ca640 1 -- 172.21.15.1:0/326370400 >> 172.21.15.1:0/326370400 conn(0x7f0ed00fd8c0 msgr2=0x7f0ed00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:05.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.675+0000 7f0ed56ca640 1 -- 172.21.15.1:0/326370400 shutdown_connections 2024-09-19T09:37:05.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.675+0000 7f0ed56ca640 1 -- 172.21.15.1:0/326370400 wait complete. 2024-09-19T09:37:05.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.676+0000 7f0ed56ca640 1 Processor -- start 2024-09-19T09:37:05.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.676+0000 7f0ed56ca640 1 -- start start 2024-09-19T09:37:05.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.676+0000 7f0ed56ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ed0101de0 0x7f0ed01985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:05.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.676+0000 7f0ed56ca640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ed0102790 0x7f0ed0198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:05.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.676+0000 7f0ed56ca640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ed0106f10 0x7f0ed019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:05.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.676+0000 7f0ed56ca640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed0112010 con 0x7f0ed0106f10 2024-09-19T09:37:05.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.676+0000 7f0ed56ca640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed0111e90 con 0x7f0ed0101de0 2024-09-19T09:37:05.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.676+0000 7f0ed56ca640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed0112190 con 0x7f0ed0102790 2024-09-19T09:37:05.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.676+0000 7f0ecf7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ed0106f10 0x7f0ed019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:05.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.676+0000 7f0ecf7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ed0106f10 0x7f0ed019ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51974/0 (socket says 172.21.15.1:51974) 2024-09-19T09:37:05.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.676+0000 7f0ecf7fe640 1 -- 172.21.15.1:0/1980760139 learned_addr learned my addr 172.21.15.1:0/1980760139 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:05.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.676+0000 7f0eceffd640 1 --2- 172.21.15.1:0/1980760139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ed0101de0 0x7f0ed01985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:05.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.676+0000 7f0ece7fc640 1 --2- 172.21.15.1:0/1980760139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ed0102790 0x7f0ed0198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:05.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.677+0000 7f0ecf7fe640 1 -- 172.21.15.1:0/1980760139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ed0102790 msgr2=0x7f0ed0198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:05.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.677+0000 7f0ecf7fe640 1 --2- 172.21.15.1:0/1980760139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ed0102790 0x7f0ed0198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.677+0000 7f0ecf7fe640 1 -- 172.21.15.1:0/1980760139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ed0101de0 msgr2=0x7f0ed01985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:05.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.677+0000 7f0ecf7fe640 1 --2- 172.21.15.1:0/1980760139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ed0101de0 0x7f0ed01985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.677+0000 7f0ecf7fe640 1 -- 172.21.15.1:0/1980760139 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed019d560 con 0x7f0ed0106f10 2024-09-19T09:37:05.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.677+0000 7f0ece7fc640 1 --2- 172.21.15.1:0/1980760139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ed0102790 0x7f0ed0198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:05.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.677+0000 7f0ecf7fe640 1 --2- 172.21.15.1:0/1980760139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ed0106f10 0x7f0ed019ce80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0ec800b970 tx=0x7f0ec800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:05.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.677+0000 7f0eb7fff640 1 -- 172.21.15.1:0/1980760139 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8019070 con 0x7f0ed0106f10 2024-09-19T09:37:05.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.677+0000 7f0ed56ca640 1 -- 172.21.15.1:0/1980760139 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ed019d850 con 0x7f0ed0106f10 2024-09-19T09:37:05.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.677+0000 7f0eb7fff640 1 -- 172.21.15.1:0/1980760139 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ec800cb40 con 0x7f0ed0106f10 2024-09-19T09:37:05.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.677+0000 7f0eb7fff640 1 -- 172.21.15.1:0/1980760139 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8007650 con 0x7f0ed0106f10 2024-09-19T09:37:05.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.677+0000 7f0ed56ca640 1 -- 172.21.15.1:0/1980760139 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ed01a5130 con 0x7f0ed0106f10 2024-09-19T09:37:05.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.678+0000 7f0ed56ca640 1 -- 172.21.15.1:0/1980760139 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ed0102240 con 0x7f0ed0106f10 2024-09-19T09:37:05.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.679+0000 7f0eb7fff640 1 -- 172.21.15.1:0/1980760139 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f0ec801c070 con 0x7f0ed0106f10 2024-09-19T09:37:05.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.680+0000 7f0eb7fff640 1 --2- 172.21.15.1:0/1980760139 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f0eb80a32d0 0x7f0eb80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:05.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.680+0000 7f0eceffd640 1 --2- 172.21.15.1:0/1980760139 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f0eb80a32d0 0x7f0eb80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:05.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.680+0000 7f0eb7fff640 1 -- 172.21.15.1:0/1980760139 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f0ec80ceed0 con 0x7f0ed0106f10 2024-09-19T09:37:05.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.680+0000 7f0eceffd640 1 --2- 172.21.15.1:0/1980760139 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f0eb80a32d0 0x7f0eb80a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0000c00 tx=0x7f0ec00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:05.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.684+0000 7f0eb7fff640 1 -- 172.21.15.1:0/1980760139 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0ec809b600 con 0x7f0ed0106f10 2024-09-19T09:37:05.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.861+0000 7f0ed56ca640 1 -- 172.21.15.1:0/1980760139 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f0ed010a150 con 0x7f0ed0106f10 2024-09-19T09:37:05.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.861+0000 7f0eb7fff640 1 -- 172.21.15.1:0/1980760139 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f0ec809f900 con 0x7f0ed0106f10 2024-09-19T09:37:05.863 INFO:teuthology.orchestra.run.smithi001.stdout:236223201318 2024-09-19T09:37:05.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.863+0000 7f0ed56ca640 1 -- 172.21.15.1:0/1980760139 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f0eb80a32d0 msgr2=0x7f0eb80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:05.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.863+0000 7f0ed56ca640 1 --2- 172.21.15.1:0/1980760139 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f0eb80a32d0 0x7f0eb80a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0000c00 tx=0x7f0ec00058d0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.863+0000 7f0ed56ca640 1 -- 172.21.15.1:0/1980760139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ed0106f10 msgr2=0x7f0ed019ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:05.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.863+0000 7f0ed56ca640 1 --2- 172.21.15.1:0/1980760139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ed0106f10 0x7f0ed019ce80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0ec800b970 tx=0x7f0ec800be30 comp rx=0 tx=0).stop 2024-09-19T09:37:05.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.864+0000 7f0ed56ca640 1 -- 172.21.15.1:0/1980760139 shutdown_connections 2024-09-19T09:37:05.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.864+0000 7f0ed56ca640 1 --2- 172.21.15.1:0/1980760139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0ed0106f10 0x7f0ed019ce80 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.864+0000 7f0ed56ca640 1 --2- 172.21.15.1:0/1980760139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0ed0102790 0x7f0ed0198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.864+0000 7f0ed56ca640 1 --2- 172.21.15.1:0/1980760139 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f0eb80a32d0 0x7f0eb80a5790 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.864+0000 7f0ed56ca640 1 --2- 172.21.15.1:0/1980760139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ed0101de0 0x7f0ed01985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.864+0000 7f0ed56ca640 1 -- 172.21.15.1:0/1980760139 >> 172.21.15.1:0/1980760139 conn(0x7f0ed00fd8c0 msgr2=0x7f0ed00fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:05.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.864+0000 7f0ed56ca640 1 -- 172.21.15.1:0/1980760139 shutdown_connections 2024-09-19T09:37:05.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.864+0000 7f0ed56ca640 1 -- 172.21.15.1:0/1980760139 wait complete. 2024-09-19T09:37:05.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.920+0000 7f664e73a640 1 -- 172.21.15.1:0/2744842351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6648106a80 msgr2=0x7f6648106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:05.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.920+0000 7f664e73a640 1 --2- 172.21.15.1:0/2744842351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6648106a80 0x7f6648106e60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6638009930 tx=0x7f663802a420 comp rx=0 tx=0).stop 2024-09-19T09:37:05.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.920+0000 7f664e73a640 1 -- 172.21.15.1:0/2744842351 shutdown_connections 2024-09-19T09:37:05.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.920+0000 7f664e73a640 1 --2- 172.21.15.1:0/2744842351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6648101420 0x7f664810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.920+0000 7f664e73a640 1 --2- 172.21.15.1:0/2744842351 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6648100a80 0x7f6648100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.920+0000 7f664e73a640 1 --2- 172.21.15.1:0/2744842351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6648106a80 0x7f6648106e60 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.920+0000 7f664e73a640 1 -- 172.21.15.1:0/2744842351 >> 172.21.15.1:0/2744842351 conn(0x7f66480fc7a0 msgr2=0x7f66480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:05.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.921+0000 7f664e73a640 1 -- 172.21.15.1:0/2744842351 shutdown_connections 2024-09-19T09:37:05.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.921+0000 7f664e73a640 1 -- 172.21.15.1:0/2744842351 wait complete. 2024-09-19T09:37:05.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.921+0000 7f664e73a640 1 Processor -- start 2024-09-19T09:37:05.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.921+0000 7f664e73a640 1 -- start start 2024-09-19T09:37:05.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.922+0000 7f664e73a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6648100a80 0x7f664819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:05.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.922+0000 7f664e73a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6648101420 0x7f664819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:05.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.922+0000 7f664e73a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6648106a80 0x7f664819eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:05.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.922+0000 7f664e73a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6648110e80 con 0x7f6648100a80 2024-09-19T09:37:05.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.922+0000 7f664e73a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6648110d00 con 0x7f6648101420 2024-09-19T09:37:05.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.922+0000 7f664e73a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6648111000 con 0x7f6648106a80 2024-09-19T09:37:05.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.922+0000 7f6647fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6648100a80 0x7f664819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:05.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.922+0000 7f6647fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6648100a80 0x7f664819a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51998/0 (socket says 172.21.15.1:51998) 2024-09-19T09:37:05.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.922+0000 7f6647fff640 1 -- 172.21.15.1:0/1578639969 learned_addr learned my addr 172.21.15.1:0/1578639969 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:05.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.922+0000 7f664ccd7640 1 --2- 172.21.15.1:0/1578639969 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6648106a80 0x7f664819eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:05.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.922+0000 7f6647fff640 1 -- 172.21.15.1:0/1578639969 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6648106a80 msgr2=0x7f664819eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:05.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.922+0000 7f66477fe640 1 --2- 172.21.15.1:0/1578639969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6648101420 0x7f664819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:05.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.922+0000 7f6647fff640 1 --2- 172.21.15.1:0/1578639969 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6648106a80 0x7f664819eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.922+0000 7f6647fff640 1 -- 172.21.15.1:0/1578639969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6648101420 msgr2=0x7f664819ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:05.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.922+0000 7f6647fff640 1 --2- 172.21.15.1:0/1578639969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6648101420 0x7f664819ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:05.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.922+0000 7f6647fff640 1 -- 172.21.15.1:0/1578639969 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f664819f5a0 con 0x7f6648100a80 2024-09-19T09:37:05.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.922+0000 7f664ccd7640 1 --2- 172.21.15.1:0/1578639969 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6648106a80 0x7f664819eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:05.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.922+0000 7f6647fff640 1 --2- 172.21.15.1:0/1578639969 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6648100a80 0x7f664819a5f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6638009230 tx=0x7f6638004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:05.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.923+0000 7f66457fa640 1 -- 172.21.15.1:0/1578639969 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663803f030 con 0x7f6648100a80 2024-09-19T09:37:05.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.923+0000 7f664e73a640 1 -- 172.21.15.1:0/1578639969 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f664819f830 con 0x7f6648100a80 2024-09-19T09:37:05.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.923+0000 7f66457fa640 1 -- 172.21.15.1:0/1578639969 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6638003ad0 con 0x7f6648100a80 2024-09-19T09:37:05.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.923+0000 7f664e73a640 1 -- 172.21.15.1:0/1578639969 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66481a7170 con 0x7f6648100a80 2024-09-19T09:37:05.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.923+0000 7f66457fa640 1 -- 172.21.15.1:0/1578639969 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6638035070 con 0x7f6648100a80 2024-09-19T09:37:05.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.924+0000 7f664e73a640 1 -- 172.21.15.1:0/1578639969 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6648100ee0 con 0x7f6648100a80 2024-09-19T09:37:05.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.925+0000 7f66457fa640 1 -- 172.21.15.1:0/1578639969 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f6638042030 con 0x7f6648100a80 2024-09-19T09:37:05.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.926+0000 7f66457fa640 1 --2- 172.21.15.1:0/1578639969 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f66300a32d0 0x7f66300a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:05.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.926+0000 7f66477fe640 1 --2- 172.21.15.1:0/1578639969 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f66300a32d0 0x7f66300a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:05.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.926+0000 7f66457fa640 1 -- 172.21.15.1:0/1578639969 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f66380f0000 con 0x7f6648100a80 2024-09-19T09:37:05.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.926+0000 7f66477fe640 1 --2- 172.21.15.1:0/1578639969 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f66300a32d0 0x7f66300a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f663c005fd0 tx=0x7f663c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:05.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:05.929+0000 7f66457fa640 1 -- 172.21.15.1:0/1578639969 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f66380bcc70 con 0x7f6648100a80 2024-09-19T09:37:06.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:06.112+0000 7f664e73a640 1 -- 172.21.15.1:0/1578639969 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f66481a7340 con 0x7f6648100a80 2024-09-19T09:37:06.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:06.113+0000 7f66457fa640 1 -- 172.21.15.1:0/1578639969 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f66380dc090 con 0x7f6648100a80 2024-09-19T09:37:06.114 INFO:teuthology.orchestra.run.smithi001.stdout:103079215169 2024-09-19T09:37:06.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:06.115+0000 7f664e73a640 1 -- 172.21.15.1:0/1578639969 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f66300a32d0 msgr2=0x7f66300a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:06.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:06.115+0000 7f664e73a640 1 --2- 172.21.15.1:0/1578639969 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f66300a32d0 0x7f66300a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f663c005fd0 tx=0x7f663c005850 comp rx=0 tx=0).stop 2024-09-19T09:37:06.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:06.115+0000 7f664e73a640 1 -- 172.21.15.1:0/1578639969 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6648100a80 msgr2=0x7f664819a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:06.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:06.115+0000 7f664e73a640 1 --2- 172.21.15.1:0/1578639969 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6648100a80 0x7f664819a5f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6638009230 tx=0x7f6638004270 comp rx=0 tx=0).stop 2024-09-19T09:37:06.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:06.115+0000 7f664e73a640 1 -- 172.21.15.1:0/1578639969 shutdown_connections 2024-09-19T09:37:06.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:06.115+0000 7f664e73a640 1 --2- 172.21.15.1:0/1578639969 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6648106a80 0x7f664819eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:06.115+0000 7f664e73a640 1 --2- 172.21.15.1:0/1578639969 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f66300a32d0 0x7f66300a5790 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:06.115+0000 7f664e73a640 1 --2- 172.21.15.1:0/1578639969 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6648101420 0x7f664819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:06.115+0000 7f664e73a640 1 --2- 172.21.15.1:0/1578639969 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6648100a80 0x7f664819a5f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:06.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:06.115+0000 7f664e73a640 1 -- 172.21.15.1:0/1578639969 >> 172.21.15.1:0/1578639969 conn(0x7f66480fc7a0 msgr2=0x7f664806a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:06.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:06.115+0000 7f664e73a640 1 -- 172.21.15.1:0/1578639969 shutdown_connections 2024-09-19T09:37:06.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:06.115+0000 7f664e73a640 1 -- 172.21.15.1:0/1578639969 wait complete. 2024-09-19T09:37:06.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:06 smithi022 ceph-mon[35583]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:06.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:06 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1980760139' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T09:37:06.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:06 smithi121 ceph-mon[35577]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:06.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:06 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1980760139' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T09:37:06.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:06 smithi001 ceph-mon[31225]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:06.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:06 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1980760139' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T09:37:07.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.336+0000 7f866655f640 1 -- 172.21.15.1:0/798308207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8660100c10 msgr2=0x7f8660110840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:07.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.336+0000 7f866655f640 1 --2- 172.21.15.1:0/798308207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8660100c10 0x7f8660110840 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8658009ca0 tx=0x7f865802a950 comp rx=0 tx=0).stop 2024-09-19T09:37:07.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.336+0000 7f866655f640 1 -- 172.21.15.1:0/798308207 shutdown_connections 2024-09-19T09:37:07.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.336+0000 7f866655f640 1 --2- 172.21.15.1:0/798308207 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8660100c10 0x7f8660110840 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.336+0000 7f866655f640 1 --2- 172.21.15.1:0/798308207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8660102ea0 0x7f86601005f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.336+0000 7f866655f640 1 --2- 172.21.15.1:0/798308207 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8660102ac0 0x7f86601000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.336+0000 7f866655f640 1 -- 172.21.15.1:0/798308207 >> 172.21.15.1:0/798308207 conn(0x7f8660077210 msgr2=0x7f86600fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:07.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.336+0000 7f866655f640 1 -- 172.21.15.1:0/798308207 shutdown_connections 2024-09-19T09:37:07.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.336+0000 7f866655f640 1 -- 172.21.15.1:0/798308207 wait complete. 2024-09-19T09:37:07.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.337+0000 7f866655f640 1 Processor -- start 2024-09-19T09:37:07.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.337+0000 7f866655f640 1 -- start start 2024-09-19T09:37:07.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.338+0000 7f866655f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8660100c10 0x7f866019a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:07.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.338+0000 7f866655f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8660102ac0 0x7f866019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:07.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.338+0000 7f866655f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8660102ea0 0x7f866019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:07.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.338+0000 7f866655f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f86601141d0 con 0x7f8660100c10 2024-09-19T09:37:07.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.338+0000 7f866655f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8660114050 con 0x7f8660102ac0 2024-09-19T09:37:07.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.338+0000 7f866655f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8660114350 con 0x7f8660102ea0 2024-09-19T09:37:07.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.338+0000 7f865ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8660100c10 0x7f866019a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:07.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.338+0000 7f865ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8660100c10 0x7f866019a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52012/0 (socket says 172.21.15.1:52012) 2024-09-19T09:37:07.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.338+0000 7f865ffff640 1 -- 172.21.15.1:0/869990857 learned_addr learned my addr 172.21.15.1:0/869990857 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:07.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.338+0000 7f8664afc640 1 --2- 172.21.15.1:0/869990857 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8660102ea0 0x7f866019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:07.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.338+0000 7f865f7fe640 1 --2- 172.21.15.1:0/869990857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8660102ac0 0x7f866019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:07.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.338+0000 7f865ffff640 1 -- 172.21.15.1:0/869990857 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8660102ea0 msgr2=0x7f866019ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:07.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.338+0000 7f865ffff640 1 --2- 172.21.15.1:0/869990857 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8660102ea0 0x7f866019ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.338+0000 7f865ffff640 1 -- 172.21.15.1:0/869990857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8660102ac0 msgr2=0x7f866019abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:07.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.338+0000 7f865ffff640 1 --2- 172.21.15.1:0/869990857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8660102ac0 0x7f866019abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.338+0000 7f865ffff640 1 -- 172.21.15.1:0/869990857 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f866019f620 con 0x7f8660100c10 2024-09-19T09:37:07.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.338+0000 7f865ffff640 1 --2- 172.21.15.1:0/869990857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8660100c10 0x7f866019a670 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f865000b4a0 tx=0x7f865000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:07.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.339+0000 7f865d7fa640 1 -- 172.21.15.1:0/869990857 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8650014070 con 0x7f8660100c10 2024-09-19T09:37:07.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.339+0000 7f866655f640 1 -- 172.21.15.1:0/869990857 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f866019f910 con 0x7f8660100c10 2024-09-19T09:37:07.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.339+0000 7f865d7fa640 1 -- 172.21.15.1:0/869990857 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8650010af0 con 0x7f8660100c10 2024-09-19T09:37:07.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.339+0000 7f865d7fa640 1 -- 172.21.15.1:0/869990857 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8650017d10 con 0x7f8660100c10 2024-09-19T09:37:07.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.339+0000 7f866655f640 1 -- 172.21.15.1:0/869990857 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86601a71f0 con 0x7f8660100c10 2024-09-19T09:37:07.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.340+0000 7f866655f640 1 -- 172.21.15.1:0/869990857 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86601000b0 con 0x7f8660100c10 2024-09-19T09:37:07.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.341+0000 7f865d7fa640 1 -- 172.21.15.1:0/869990857 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f8650017070 con 0x7f8660100c10 2024-09-19T09:37:07.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.342+0000 7f865d7fa640 1 --2- 172.21.15.1:0/869990857 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f86480a32d0 0x7f86480a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:07.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.342+0000 7f865f7fe640 1 --2- 172.21.15.1:0/869990857 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f86480a32d0 0x7f86480a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:07.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.342+0000 7f865d7fa640 1 -- 172.21.15.1:0/869990857 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f86500ced60 con 0x7f8660100c10 2024-09-19T09:37:07.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.342+0000 7f865f7fe640 1 --2- 172.21.15.1:0/869990857 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f86480a32d0 0x7f86480a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f86600fd040 tx=0x7f865400a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:07.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.346+0000 7f865d7fa640 1 -- 172.21.15.1:0/869990857 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f865009bae0 con 0x7f8660100c10 2024-09-19T09:37:07.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:07 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1578639969' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T09:37:07.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:07 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1578639969' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T09:37:07.409 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:07 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1578639969' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T09:37:07.438 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215168 got 103079215169 for osd.3 2024-09-19T09:37:07.438 DEBUG:teuthology.parallel:result is None 2024-09-19T09:37:07.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.528+0000 7f866655f640 1 -- 172.21.15.1:0/869990857 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f86601a7480 con 0x7f8660100c10 2024-09-19T09:37:07.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.528+0000 7f865d7fa640 1 -- 172.21.15.1:0/869990857 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f865009b3e0 con 0x7f8660100c10 2024-09-19T09:37:07.530 INFO:teuthology.orchestra.run.smithi001.stdout:206158430253 2024-09-19T09:37:07.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.530+0000 7f866655f640 1 -- 172.21.15.1:0/869990857 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f86480a32d0 msgr2=0x7f86480a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:07.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.530+0000 7f866655f640 1 --2- 172.21.15.1:0/869990857 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f86480a32d0 0x7f86480a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f86600fd040 tx=0x7f865400a4c0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.530+0000 7f866655f640 1 -- 172.21.15.1:0/869990857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8660100c10 msgr2=0x7f866019a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:07.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.530+0000 7f866655f640 1 --2- 172.21.15.1:0/869990857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8660100c10 0x7f866019a670 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f865000b4a0 tx=0x7f865000b960 comp rx=0 tx=0).stop 2024-09-19T09:37:07.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.530+0000 7f866655f640 1 -- 172.21.15.1:0/869990857 shutdown_connections 2024-09-19T09:37:07.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.530+0000 7f866655f640 1 --2- 172.21.15.1:0/869990857 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8660102ea0 0x7f866019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.530+0000 7f866655f640 1 --2- 172.21.15.1:0/869990857 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f86480a32d0 0x7f86480a5790 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.530+0000 7f866655f640 1 --2- 172.21.15.1:0/869990857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8660102ac0 0x7f866019abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.530+0000 7f866655f640 1 --2- 172.21.15.1:0/869990857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8660100c10 0x7f866019a670 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.530+0000 7f866655f640 1 -- 172.21.15.1:0/869990857 >> 172.21.15.1:0/869990857 conn(0x7f8660077210 msgr2=0x7f86600fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:07.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.530+0000 7f866655f640 1 -- 172.21.15.1:0/869990857 shutdown_connections 2024-09-19T09:37:07.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.530+0000 7f866655f640 1 -- 172.21.15.1:0/869990857 wait complete. 2024-09-19T09:37:07.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.616+0000 7fc50abfa640 1 -- 172.21.15.1:0/4037656157 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc504108290 msgr2=0x7fc50410ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:07.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.616+0000 7fc50abfa640 1 --2- 172.21.15.1:0/4037656157 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc504108290 0x7fc50410ec30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc009cd0 tx=0x7fc4fc02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.616+0000 7fc50abfa640 1 -- 172.21.15.1:0/4037656157 shutdown_connections 2024-09-19T09:37:07.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.616+0000 7fc50abfa640 1 --2- 172.21.15.1:0/4037656157 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc504108290 0x7fc50410ec30 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.616+0000 7fc50abfa640 1 --2- 172.21.15.1:0/4037656157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc504103740 0x7fc504107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.616+0000 7fc50abfa640 1 --2- 172.21.15.1:0/4037656157 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc504102d90 0x7fc504103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.616+0000 7fc50abfa640 1 -- 172.21.15.1:0/4037656157 >> 172.21.15.1:0/4037656157 conn(0x7fc5040fc7d0 msgr2=0x7fc5040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:07.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.616+0000 7fc50abfa640 1 -- 172.21.15.1:0/4037656157 shutdown_connections 2024-09-19T09:37:07.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.616+0000 7fc50abfa640 1 -- 172.21.15.1:0/4037656157 wait complete. 2024-09-19T09:37:07.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.616+0000 7fc50abfa640 1 Processor -- start 2024-09-19T09:37:07.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.616+0000 7fc50abfa640 1 -- start start 2024-09-19T09:37:07.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.617+0000 7fc50abfa640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc504102d90 0x7fc5041009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:07.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.617+0000 7fc50abfa640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc504103740 0x7fc504100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:07.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.617+0000 7fc50abfa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc504108290 0x7fc504101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:07.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.617+0000 7fc50abfa640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc504112090 con 0x7fc504102d90 2024-09-19T09:37:07.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.617+0000 7fc50abfa640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc504111f10 con 0x7fc504108290 2024-09-19T09:37:07.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.617+0000 7fc50abfa640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc504112210 con 0x7fc504103740 2024-09-19T09:37:07.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.617+0000 7fc508996640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc504102d90 0x7fc5041009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:07.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.617+0000 7fc508996640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc504102d90 0x7fc5041009f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52030/0 (socket says 172.21.15.1:52030) 2024-09-19T09:37:07.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.617+0000 7fc508996640 1 -- 172.21.15.1:0/2992770233 learned_addr learned my addr 172.21.15.1:0/2992770233 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:07.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.617+0000 7fc503fff640 1 --2- 172.21.15.1:0/2992770233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc504103740 0x7fc504100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:07.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.617+0000 7fc509197640 1 --2- 172.21.15.1:0/2992770233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc504108290 0x7fc504101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:07.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.617+0000 7fc508996640 1 -- 172.21.15.1:0/2992770233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc504103740 msgr2=0x7fc504100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:07.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.617+0000 7fc508996640 1 --2- 172.21.15.1:0/2992770233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc504103740 0x7fc504100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.617+0000 7fc508996640 1 -- 172.21.15.1:0/2992770233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc504108290 msgr2=0x7fc504101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:07.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.617+0000 7fc508996640 1 --2- 172.21.15.1:0/2992770233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc504108290 0x7fc504101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.617+0000 7fc508996640 1 -- 172.21.15.1:0/2992770233 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5041a6a30 con 0x7fc504102d90 2024-09-19T09:37:07.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.617+0000 7fc509197640 1 --2- 172.21.15.1:0/2992770233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc504108290 0x7fc504101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:07.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.617+0000 7fc503fff640 1 --2- 172.21.15.1:0/2992770233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc504103740 0x7fc504100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:07.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.617+0000 7fc508996640 1 --2- 172.21.15.1:0/2992770233 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc504102d90 0x7fc5041009f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc4f400d770 tx=0x7fc4f400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:07.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.617+0000 7fc501ffb640 1 -- 172.21.15.1:0/2992770233 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4017070 con 0x7fc504102d90 2024-09-19T09:37:07.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.617+0000 7fc50abfa640 1 -- 172.21.15.1:0/2992770233 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5041a6d20 con 0x7fc504102d90 2024-09-19T09:37:07.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.617+0000 7fc501ffb640 1 -- 172.21.15.1:0/2992770233 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4f4005500 con 0x7fc504102d90 2024-09-19T09:37:07.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.617+0000 7fc501ffb640 1 -- 172.21.15.1:0/2992770233 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4004e00 con 0x7fc504102d90 2024-09-19T09:37:07.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.618+0000 7fc50abfa640 1 -- 172.21.15.1:0/2992770233 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5041a7200 con 0x7fc504102d90 2024-09-19T09:37:07.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.619+0000 7fc50abfa640 1 -- 172.21.15.1:0/2992770233 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc504103170 con 0x7fc504102d90 2024-09-19T09:37:07.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.620+0000 7fc501ffb640 1 -- 172.21.15.1:0/2992770233 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fc4f4004fa0 con 0x7fc504102d90 2024-09-19T09:37:07.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.620+0000 7fc501ffb640 1 --2- 172.21.15.1:0/2992770233 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc4f00a32d0 0x7fc4f00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:07.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.621+0000 7fc501ffb640 1 -- 172.21.15.1:0/2992770233 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fc4f40cf3d0 con 0x7fc504102d90 2024-09-19T09:37:07.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.621+0000 7fc503fff640 1 --2- 172.21.15.1:0/2992770233 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc4f00a32d0 0x7fc4f00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:07.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.621+0000 7fc503fff640 1 --2- 172.21.15.1:0/2992770233 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc4f00a32d0 0x7fc4f00a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec005e00 tx=0x7fc4ec005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:07.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.625+0000 7fc501ffb640 1 -- 172.21.15.1:0/2992770233 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc4f409c140 con 0x7fc504102d90 2024-09-19T09:37:07.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.804+0000 7fc50abfa640 1 -- 172.21.15.1:0/2992770233 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fc50410a2a0 con 0x7fc504102d90 2024-09-19T09:37:07.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.804+0000 7fc501ffb640 1 -- 172.21.15.1:0/2992770233 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc4f409ba40 con 0x7fc504102d90 2024-09-19T09:37:07.806 INFO:teuthology.orchestra.run.smithi001.stdout:266287972387 2024-09-19T09:37:07.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.807+0000 7fc50abfa640 1 -- 172.21.15.1:0/2992770233 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc4f00a32d0 msgr2=0x7fc4f00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:07.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.807+0000 7fc50abfa640 1 --2- 172.21.15.1:0/2992770233 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc4f00a32d0 0x7fc4f00a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec005e00 tx=0x7fc4ec005c70 comp rx=0 tx=0).stop 2024-09-19T09:37:07.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.807+0000 7fc50abfa640 1 -- 172.21.15.1:0/2992770233 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc504102d90 msgr2=0x7fc5041009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:07.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.807+0000 7fc50abfa640 1 --2- 172.21.15.1:0/2992770233 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc504102d90 0x7fc5041009f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc4f400d770 tx=0x7fc4f400dc30 comp rx=0 tx=0).stop 2024-09-19T09:37:07.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.807+0000 7fc50abfa640 1 -- 172.21.15.1:0/2992770233 shutdown_connections 2024-09-19T09:37:07.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.807+0000 7fc50abfa640 1 --2- 172.21.15.1:0/2992770233 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc4f00a32d0 0x7fc4f00a5790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.807+0000 7fc50abfa640 1 --2- 172.21.15.1:0/2992770233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc504108290 0x7fc504101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.807+0000 7fc50abfa640 1 --2- 172.21.15.1:0/2992770233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc504103740 0x7fc504100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.807+0000 7fc50abfa640 1 --2- 172.21.15.1:0/2992770233 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc504102d90 0x7fc5041009f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:07.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.807+0000 7fc50abfa640 1 -- 172.21.15.1:0/2992770233 >> 172.21.15.1:0/2992770233 conn(0x7fc5040fc7d0 msgr2=0x7fc504105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:07.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.807+0000 7fc50abfa640 1 -- 172.21.15.1:0/2992770233 shutdown_connections 2024-09-19T09:37:07.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:07.807+0000 7fc50abfa640 1 -- 172.21.15.1:0/2992770233 wait complete. 2024-09-19T09:37:08.156 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201316 got 236223201318 for osd.8 2024-09-19T09:37:08.156 DEBUG:teuthology.parallel:result is None 2024-09-19T09:37:08.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:08 smithi022 ceph-mon[35583]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:08.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:08 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/869990857' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T09:37:08.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:08 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/2992770233' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T09:37:08.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:08 smithi121 ceph-mon[35577]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:08.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:08 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/869990857' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T09:37:08.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:08 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/2992770233' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T09:37:08.373 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:08 smithi001 ceph-mon[31225]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:08.373 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:08 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/869990857' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T09:37:08.373 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:08 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/2992770233' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T09:37:08.377 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:08.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.750+0000 7f3f44744640 1 -- 172.21.15.1:0/1810789972 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f3c103660 msgr2=0x7f3f3c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:08.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.750+0000 7f3f44744640 1 --2- 172.21.15.1:0/1810789972 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f3c103660 0x7f3f3c10bb50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009900 tx=0x7f3f3802a480 comp rx=0 tx=0).stop 2024-09-19T09:37:08.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.750+0000 7f3f44744640 1 -- 172.21.15.1:0/1810789972 shutdown_connections 2024-09-19T09:37:08.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.750+0000 7f3f44744640 1 --2- 172.21.15.1:0/1810789972 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f3c10c170 0x7f3f3c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.750+0000 7f3f44744640 1 --2- 172.21.15.1:0/1810789972 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f3c103660 0x7f3f3c10bb50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.750+0000 7f3f44744640 1 --2- 172.21.15.1:0/1810789972 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f3c102d40 0x7f3f3c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.750+0000 7f3f44744640 1 -- 172.21.15.1:0/1810789972 >> 172.21.15.1:0/1810789972 conn(0x7f3f3c0fc7a0 msgr2=0x7f3f3c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:08.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.750+0000 7f3f44744640 1 -- 172.21.15.1:0/1810789972 shutdown_connections 2024-09-19T09:37:08.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.750+0000 7f3f44744640 1 -- 172.21.15.1:0/1810789972 wait complete. 2024-09-19T09:37:08.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.751+0000 7f3f44744640 1 Processor -- start 2024-09-19T09:37:08.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.751+0000 7f3f44744640 1 -- start start 2024-09-19T09:37:08.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.751+0000 7f3f44744640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f3c102d40 0x7f3f3c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:08.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.751+0000 7f3f44744640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f3c103660 0x7f3f3c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:08.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.751+0000 7f3f44744640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f3c10c170 0x7f3f3c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:08.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.751+0000 7f3f44744640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3c111f70 con 0x7f3f3c102d40 2024-09-19T09:37:08.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.751+0000 7f3f44744640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3c111df0 con 0x7f3f3c103660 2024-09-19T09:37:08.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.751+0000 7f3f44744640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3c1120f0 con 0x7f3f3c10c170 2024-09-19T09:37:08.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.751+0000 7f3f424e0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f3c102d40 0x7f3f3c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:08.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.751+0000 7f3f424e0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f3c102d40 0x7f3f3c1009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52054/0 (socket says 172.21.15.1:52054) 2024-09-19T09:37:08.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.751+0000 7f3f424e0640 1 -- 172.21.15.1:0/3411120759 learned_addr learned my addr 172.21.15.1:0/3411120759 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:08.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.751+0000 7f3f41cdf640 1 --2- 172.21.15.1:0/3411120759 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f3c103660 0x7f3f3c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:08.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.751+0000 7f3f42ce1640 1 --2- 172.21.15.1:0/3411120759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f3c10c170 0x7f3f3c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:08.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.751+0000 7f3f424e0640 1 -- 172.21.15.1:0/3411120759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f3c10c170 msgr2=0x7f3f3c101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:08.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.751+0000 7f3f424e0640 1 --2- 172.21.15.1:0/3411120759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f3c10c170 0x7f3f3c101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.751+0000 7f3f424e0640 1 -- 172.21.15.1:0/3411120759 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f3c103660 msgr2=0x7f3f3c100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:08.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.751+0000 7f3f424e0640 1 --2- 172.21.15.1:0/3411120759 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f3c103660 0x7f3f3c100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.752+0000 7f3f424e0640 1 -- 172.21.15.1:0/3411120759 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f3c1a6910 con 0x7f3f3c102d40 2024-09-19T09:37:08.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.752+0000 7f3f41cdf640 1 --2- 172.21.15.1:0/3411120759 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f3c103660 0x7f3f3c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:37:08.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.752+0000 7f3f424e0640 1 --2- 172.21.15.1:0/3411120759 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f3c102d40 0x7f3f3c1009a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000d950 tx=0x7f3f3000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:08.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.752+0000 7f3f2f7fe640 1 -- 172.21.15.1:0/3411120759 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f30017030 con 0x7f3f3c102d40 2024-09-19T09:37:08.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.752+0000 7f3f2f7fe640 1 -- 172.21.15.1:0/3411120759 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f30004020 con 0x7f3f3c102d40 2024-09-19T09:37:08.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.752+0000 7f3f2f7fe640 1 -- 172.21.15.1:0/3411120759 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f300047a0 con 0x7f3f3c102d40 2024-09-19T09:37:08.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.752+0000 7f3f44744640 1 -- 172.21.15.1:0/3411120759 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f3c1a6c00 con 0x7f3f3c102d40 2024-09-19T09:37:08.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.752+0000 7f3f44744640 1 -- 172.21.15.1:0/3411120759 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f3c1a7110 con 0x7f3f3c102d40 2024-09-19T09:37:08.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.753+0000 7f3f44744640 1 -- 172.21.15.1:0/3411120759 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f3c06b070 con 0x7f3f3c102d40 2024-09-19T09:37:08.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.754+0000 7f3f2f7fe640 1 -- 172.21.15.1:0/3411120759 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f3f300041d0 con 0x7f3f3c102d40 2024-09-19T09:37:08.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.755+0000 7f3f2f7fe640 1 --2- 172.21.15.1:0/3411120759 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3f280a32d0 0x7f3f280a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:08.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.755+0000 7f3f41cdf640 1 --2- 172.21.15.1:0/3411120759 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3f280a32d0 0x7f3f280a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:08.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.755+0000 7f3f2f7fe640 1 -- 172.21.15.1:0/3411120759 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f3f300cf8c0 con 0x7f3f3c102d40 2024-09-19T09:37:08.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.755+0000 7f3f41cdf640 1 --2- 172.21.15.1:0/3411120759 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3f280a32d0 0x7f3f280a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009230 tx=0x7f3f380058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:08.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.758+0000 7f3f2f7fe640 1 -- 172.21.15.1:0/3411120759 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3f3009c630 con 0x7f3f3c102d40 2024-09-19T09:37:08.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.935+0000 7f3f44744640 1 -- 172.21.15.1:0/3411120759 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f3f3c103120 con 0x7f3f3c102d40 2024-09-19T09:37:08.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.935+0000 7f3f2f7fe640 1 -- 172.21.15.1:0/3411120759 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f3f3c103120 con 0x7f3f3c102d40 2024-09-19T09:37:08.937 INFO:teuthology.orchestra.run.smithi001.stdout:292057776158 2024-09-19T09:37:08.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.938+0000 7f3f44744640 1 -- 172.21.15.1:0/3411120759 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3f280a32d0 msgr2=0x7f3f280a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:08.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.938+0000 7f3f44744640 1 --2- 172.21.15.1:0/3411120759 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3f280a32d0 0x7f3f280a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009230 tx=0x7f3f380058d0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.938+0000 7f3f44744640 1 -- 172.21.15.1:0/3411120759 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f3c102d40 msgr2=0x7f3f3c1009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:08.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.938+0000 7f3f44744640 1 --2- 172.21.15.1:0/3411120759 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f3c102d40 0x7f3f3c1009a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000d950 tx=0x7f3f3000de10 comp rx=0 tx=0).stop 2024-09-19T09:37:08.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.938+0000 7f3f44744640 1 -- 172.21.15.1:0/3411120759 shutdown_connections 2024-09-19T09:37:08.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.938+0000 7f3f44744640 1 --2- 172.21.15.1:0/3411120759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f3c10c170 0x7f3f3c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.938+0000 7f3f44744640 1 --2- 172.21.15.1:0/3411120759 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3f280a32d0 0x7f3f280a5790 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.938+0000 7f3f44744640 1 --2- 172.21.15.1:0/3411120759 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3f3c103660 0x7f3f3c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.938+0000 7f3f44744640 1 --2- 172.21.15.1:0/3411120759 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3f3c102d40 0x7f3f3c1009a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:08.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.938+0000 7f3f44744640 1 -- 172.21.15.1:0/3411120759 >> 172.21.15.1:0/3411120759 conn(0x7f3f3c0fc7a0 msgr2=0x7f3f3c0fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:08.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.938+0000 7f3f44744640 1 -- 172.21.15.1:0/3411120759 shutdown_connections 2024-09-19T09:37:08.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:08.938+0000 7f3f44744640 1 -- 172.21.15.1:0/3411120759 wait complete. 2024-09-19T09:37:09.190 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:09 smithi001 ceph-mon[31225]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:09.190 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:09 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:37:09.190 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:09 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/3411120759' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T09:37:09.191 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430250 got 206158430253 for osd.7 2024-09-19T09:37:09.191 DEBUG:teuthology.parallel:result is None 2024-09-19T09:37:09.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:09 smithi022 ceph-mon[35583]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:09.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:09 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:37:09.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:09 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/3411120759' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T09:37:09.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:09 smithi121 ceph-mon[35577]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:09.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:09 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:37:09.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:09 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/3411120759' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T09:37:09.409 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:09.828 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776155 got 292057776158 for osd.10 2024-09-19T09:37:09.828 DEBUG:teuthology.parallel:result is None 2024-09-19T09:37:10.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.286+0000 7fd7da0d0640 1 -- 172.21.15.1:0/776765249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7d4103660 msgr2=0x7fd7d410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:10.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.286+0000 7fd7da0d0640 1 --2- 172.21.15.1:0/776765249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7d4103660 0x7fd7d410bb50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8009900 tx=0x7fd7c802a480 comp rx=0 tx=0).stop 2024-09-19T09:37:10.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.286+0000 7fd7da0d0640 1 -- 172.21.15.1:0/776765249 shutdown_connections 2024-09-19T09:37:10.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.286+0000 7fd7da0d0640 1 --2- 172.21.15.1:0/776765249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7d410c170 0x7fd7d410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:10.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.286+0000 7fd7da0d0640 1 --2- 172.21.15.1:0/776765249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7d4103660 0x7fd7d410bb50 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:10.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.286+0000 7fd7da0d0640 1 --2- 172.21.15.1:0/776765249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7d4102d40 0x7fd7d4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:10.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.286+0000 7fd7da0d0640 1 -- 172.21.15.1:0/776765249 >> 172.21.15.1:0/776765249 conn(0x7fd7d40fc7a0 msgr2=0x7fd7d40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:10.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.286+0000 7fd7da0d0640 1 -- 172.21.15.1:0/776765249 shutdown_connections 2024-09-19T09:37:10.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.286+0000 7fd7da0d0640 1 -- 172.21.15.1:0/776765249 wait complete. 2024-09-19T09:37:10.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.286+0000 7fd7da0d0640 1 Processor -- start 2024-09-19T09:37:10.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.287+0000 7fd7da0d0640 1 -- start start 2024-09-19T09:37:10.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.287+0000 7fd7da0d0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7d4102d40 0x7fd7d41009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:10.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.287+0000 7fd7da0d0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7d4103660 0x7fd7d4100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:10.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.287+0000 7fd7da0d0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7d410c170 0x7fd7d4101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:10.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.287+0000 7fd7da0d0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d4111fd0 con 0x7fd7d410c170 2024-09-19T09:37:10.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.287+0000 7fd7da0d0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d4111e50 con 0x7fd7d4102d40 2024-09-19T09:37:10.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.287+0000 7fd7da0d0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d4112150 con 0x7fd7d4103660 2024-09-19T09:37:10.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.287+0000 7fd7d3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7d410c170 0x7fd7d4101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:10.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.287+0000 7fd7d3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7d410c170 0x7fd7d4101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52074/0 (socket says 172.21.15.1:52074) 2024-09-19T09:37:10.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.287+0000 7fd7d3fff640 1 -- 172.21.15.1:0/3569280399 learned_addr learned my addr 172.21.15.1:0/3569280399 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:10.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.287+0000 7fd7d2ffd640 1 --2- 172.21.15.1:0/3569280399 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7d4103660 0x7fd7d4100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:10.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.287+0000 7fd7d37fe640 1 --2- 172.21.15.1:0/3569280399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7d4102d40 0x7fd7d41009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:10.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.287+0000 7fd7d3fff640 1 -- 172.21.15.1:0/3569280399 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7d4103660 msgr2=0x7fd7d4100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:10.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.287+0000 7fd7d3fff640 1 --2- 172.21.15.1:0/3569280399 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7d4103660 0x7fd7d4100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:10.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.287+0000 7fd7d3fff640 1 -- 172.21.15.1:0/3569280399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7d4102d40 msgr2=0x7fd7d41009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:10.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.287+0000 7fd7d3fff640 1 --2- 172.21.15.1:0/3569280399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7d4102d40 0x7fd7d41009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:10.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.287+0000 7fd7d3fff640 1 -- 172.21.15.1:0/3569280399 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d41a6990 con 0x7fd7d410c170 2024-09-19T09:37:10.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.287+0000 7fd7d37fe640 1 --2- 172.21.15.1:0/3569280399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7d4102d40 0x7fd7d41009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:10.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.288+0000 7fd7d3fff640 1 --2- 172.21.15.1:0/3569280399 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7d410c170 0x7fd7d4101420 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc00eaa0 tx=0x7fd7cc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:10.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.288+0000 7fd7d0ff9640 1 -- 172.21.15.1:0/3569280399 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc00cdb0 con 0x7fd7d410c170 2024-09-19T09:37:10.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.288+0000 7fd7d0ff9640 1 -- 172.21.15.1:0/3569280399 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7cc005020 con 0x7fd7d410c170 2024-09-19T09:37:10.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.288+0000 7fd7da0d0640 1 -- 172.21.15.1:0/3569280399 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7d41a6c80 con 0x7fd7d410c170 2024-09-19T09:37:10.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.288+0000 7fd7d0ff9640 1 -- 172.21.15.1:0/3569280399 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc0116b0 con 0x7fd7d410c170 2024-09-19T09:37:10.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.288+0000 7fd7da0d0640 1 -- 172.21.15.1:0/3569280399 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7d41a7190 con 0x7fd7d410c170 2024-09-19T09:37:10.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.289+0000 7fd7da0d0640 1 -- 172.21.15.1:0/3569280399 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7d4103120 con 0x7fd7d410c170 2024-09-19T09:37:10.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.291+0000 7fd7d0ff9640 1 -- 172.21.15.1:0/3569280399 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fd7cc005560 con 0x7fd7d410c170 2024-09-19T09:37:10.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.292+0000 7fd7d0ff9640 1 --2- 172.21.15.1:0/3569280399 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd7bc0a32d0 0x7fd7bc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:10.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.292+0000 7fd7d37fe640 1 --2- 172.21.15.1:0/3569280399 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd7bc0a32d0 0x7fd7bc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:10.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.292+0000 7fd7d0ff9640 1 -- 172.21.15.1:0/3569280399 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fd7cc0cffa0 con 0x7fd7d410c170 2024-09-19T09:37:10.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.292+0000 7fd7d37fe640 1 --2- 172.21.15.1:0/3569280399 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd7bc0a32d0 0x7fd7bc0a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4009930 tx=0x7fd7c4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:10.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.295+0000 7fd7d0ff9640 1 -- 172.21.15.1:0/3569280399 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd7cc016030 con 0x7fd7d410c170 2024-09-19T09:37:10.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.473+0000 7fd7da0d0640 1 -- 172.21.15.1:0/3569280399 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fd7d402d7c0 con 0x7fd7d410c170 2024-09-19T09:37:10.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.474+0000 7fd7d0ff9640 1 -- 172.21.15.1:0/3569280399 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd7cc09cc10 con 0x7fd7d410c170 2024-09-19T09:37:10.475 INFO:teuthology.orchestra.run.smithi001.stdout:184683593778 2024-09-19T09:37:10.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.476+0000 7fd7da0d0640 1 -- 172.21.15.1:0/3569280399 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd7bc0a32d0 msgr2=0x7fd7bc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:10.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.476+0000 7fd7da0d0640 1 --2- 172.21.15.1:0/3569280399 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd7bc0a32d0 0x7fd7bc0a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4009930 tx=0x7fd7c4008040 comp rx=0 tx=0).stop 2024-09-19T09:37:10.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.476+0000 7fd7da0d0640 1 -- 172.21.15.1:0/3569280399 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7d410c170 msgr2=0x7fd7d4101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:10.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.476+0000 7fd7da0d0640 1 --2- 172.21.15.1:0/3569280399 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7d410c170 0x7fd7d4101420 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc00eaa0 tx=0x7fd7cc00ef60 comp rx=0 tx=0).stop 2024-09-19T09:37:10.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.476+0000 7fd7da0d0640 1 -- 172.21.15.1:0/3569280399 shutdown_connections 2024-09-19T09:37:10.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.476+0000 7fd7da0d0640 1 --2- 172.21.15.1:0/3569280399 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7d410c170 0x7fd7d4101420 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:10.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.476+0000 7fd7da0d0640 1 --2- 172.21.15.1:0/3569280399 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7d4103660 0x7fd7d4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:10.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.476+0000 7fd7da0d0640 1 --2- 172.21.15.1:0/3569280399 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd7bc0a32d0 0x7fd7bc0a5790 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:10.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.476+0000 7fd7da0d0640 1 --2- 172.21.15.1:0/3569280399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7d4102d40 0x7fd7d41009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:10.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.476+0000 7fd7da0d0640 1 -- 172.21.15.1:0/3569280399 >> 172.21.15.1:0/3569280399 conn(0x7fd7d40fc7a0 msgr2=0x7fd7d40fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:10.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.476+0000 7fd7da0d0640 1 -- 172.21.15.1:0/3569280399 shutdown_connections 2024-09-19T09:37:10.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.476+0000 7fd7da0d0640 1 -- 172.21.15.1:0/3569280399 wait complete. 2024-09-19T09:37:10.854 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:10 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:37:10.854 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:10 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:37:10.854 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:10 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:37:10.854 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:10 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:37:10.854 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:10 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/3569280399' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T09:37:11.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:10 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:37:11.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:10 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:37:11.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:10 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:37:11.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:10 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:37:11.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:10 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/3569280399' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T09:37:11.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:10 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:37:11.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:10 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:37:11.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:10 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:37:11.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:10 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:37:11.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:10 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/3569280399' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T09:37:11.334 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593774 got 184683593778 for osd.6 2024-09-19T09:37:11.844 DEBUG:teuthology.parallel:result is None 2024-09-19T09:37:11.845 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:11.845 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:11.845 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:11.846 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972383 got 266287972387 for osd.9 2024-09-19T09:37:11.846 DEBUG:teuthology.parallel:result is None 2024-09-19T09:37:11.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.934+0000 7f4eef939640 1 -- 172.21.15.1:0/3485832538 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ee81036e0 msgr2=0x7f4ee8107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:11.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.934+0000 7f4eef939640 1 --2- 172.21.15.1:0/3485832538 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ee81036e0 0x7f4ee8107b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4edc009930 tx=0x7f4edc02a420 comp rx=0 tx=0).stop 2024-09-19T09:37:11.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.935+0000 7f4eef939640 1 -- 172.21.15.1:0/3485832538 shutdown_connections 2024-09-19T09:37:11.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.935+0000 7f4eef939640 1 --2- 172.21.15.1:0/3485832538 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ee81082a0 0x7f4ee810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.935+0000 7f4eef939640 1 --2- 172.21.15.1:0/3485832538 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ee81036e0 0x7f4ee8107b90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.935+0000 7f4eef939640 1 --2- 172.21.15.1:0/3485832538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ee8102d30 0x7f4ee8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.935+0000 7f4eef939640 1 -- 172.21.15.1:0/3485832538 >> 172.21.15.1:0/3485832538 conn(0x7f4ee80fc7d0 msgr2=0x7f4ee80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:11.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.935+0000 7f4eef939640 1 -- 172.21.15.1:0/3485832538 shutdown_connections 2024-09-19T09:37:11.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.935+0000 7f4eef939640 1 -- 172.21.15.1:0/3485832538 wait complete. 2024-09-19T09:37:11.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.935+0000 7f4eef939640 1 Processor -- start 2024-09-19T09:37:11.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.935+0000 7f4eef939640 1 -- start start 2024-09-19T09:37:11.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.935+0000 7f4eef939640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ee8102d30 0x7f4ee8198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:11.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.935+0000 7f4eef939640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ee81036e0 0x7f4ee8198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:11.889 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.935+0000 7f4eef939640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ee81082a0 0x7f4ee819cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:11.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.935+0000 7f4eef939640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee81120a0 con 0x7f4ee8102d30 2024-09-19T09:37:11.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.935+0000 7f4eef939640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee8111f20 con 0x7f4ee81082a0 2024-09-19T09:37:11.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.935+0000 7f4eef939640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee8112220 con 0x7f4ee81036e0 2024-09-19T09:37:11.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.936+0000 7f4eed6d5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ee8102d30 0x7f4ee8198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:11.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.936+0000 7f4eed6d5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ee8102d30 0x7f4ee8198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52102/0 (socket says 172.21.15.1:52102) 2024-09-19T09:37:11.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.936+0000 7f4eed6d5640 1 -- 172.21.15.1:0/3611556111 learned_addr learned my addr 172.21.15.1:0/3611556111 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:11.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.936+0000 7f4eeced4640 1 --2- 172.21.15.1:0/3611556111 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ee81036e0 0x7f4ee8198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:11.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.936+0000 7f4eeded6640 1 --2- 172.21.15.1:0/3611556111 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ee81082a0 0x7f4ee819cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:11.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.936+0000 7f4eed6d5640 1 -- 172.21.15.1:0/3611556111 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ee81036e0 msgr2=0x7f4ee8198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:11.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.936+0000 7f4eed6d5640 1 --2- 172.21.15.1:0/3611556111 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ee81036e0 0x7f4ee8198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.936+0000 7f4eed6d5640 1 -- 172.21.15.1:0/3611556111 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ee81082a0 msgr2=0x7f4ee819cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:11.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.936+0000 7f4eed6d5640 1 --2- 172.21.15.1:0/3611556111 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ee81082a0 0x7f4ee819cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.936+0000 7f4eed6d5640 1 -- 172.21.15.1:0/3611556111 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee819d5d0 con 0x7f4ee8102d30 2024-09-19T09:37:11.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.936+0000 7f4eeded6640 1 --2- 172.21.15.1:0/3611556111 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ee81082a0 0x7f4ee819cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:11.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.936+0000 7f4eed6d5640 1 --2- 172.21.15.1:0/3611556111 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ee8102d30 0x7f4ee8198620 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4ed800ea80 tx=0x7f4ed800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:11.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.936+0000 7f4ee67fc640 1 -- 172.21.15.1:0/3611556111 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed800ce40 con 0x7f4ee8102d30 2024-09-19T09:37:11.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.936+0000 7f4eef939640 1 -- 172.21.15.1:0/3611556111 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ee819d8c0 con 0x7f4ee8102d30 2024-09-19T09:37:11.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.936+0000 7f4ee67fc640 1 -- 172.21.15.1:0/3611556111 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ed8005020 con 0x7f4ee8102d30 2024-09-19T09:37:11.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.936+0000 7f4ee67fc640 1 -- 172.21.15.1:0/3611556111 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8011760 con 0x7f4ee8102d30 2024-09-19T09:37:11.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.936+0000 7f4eef939640 1 -- 172.21.15.1:0/3611556111 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ee81a51a0 con 0x7f4ee8102d30 2024-09-19T09:37:11.891 INFO:teuthology.orchestra.run.smithi001.stdout:55834574924 2024-09-19T09:37:11.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.937+0000 7f4eef939640 1 -- 172.21.15.1:0/3611556111 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ee8103110 con 0x7f4ee8102d30 2024-09-19T09:37:11.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.938+0000 7f4ee67fc640 1 -- 172.21.15.1:0/3611556111 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f4ed80051d0 con 0x7f4ee8102d30 2024-09-19T09:37:11.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.939+0000 7f4ee67fc640 1 --2- 172.21.15.1:0/3611556111 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4ed00a32d0 0x7f4ed00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:11.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.940+0000 7f4eeced4640 1 --2- 172.21.15.1:0/3611556111 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4ed00a32d0 0x7f4ed00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:11.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.940+0000 7f4ee67fc640 1 -- 172.21.15.1:0/3611556111 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f4ed80d0080 con 0x7f4ee8102d30 2024-09-19T09:37:11.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.940+0000 7f4eeced4640 1 --2- 172.21.15.1:0/3611556111 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4ed00a32d0 0x7f4ed00a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4edc005940 tx=0x7f4edc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:11.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:10.944+0000 7f4ee67fc640 1 -- 172.21.15.1:0/3611556111 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4ed8016030 con 0x7f4ee8102d30 2024-09-19T09:37:11.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:11.120+0000 7f4eef939640 1 -- 172.21.15.1:0/3611556111 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f4ee810a2b0 con 0x7f4ee8102d30 2024-09-19T09:37:11.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:11.120+0000 7f4ee67fc640 1 -- 172.21.15.1:0/3611556111 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4ed809ccf0 con 0x7f4ee8102d30 2024-09-19T09:37:11.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:11.122+0000 7f4eef939640 1 -- 172.21.15.1:0/3611556111 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4ed00a32d0 msgr2=0x7f4ed00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:11.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:11.122+0000 7f4eef939640 1 --2- 172.21.15.1:0/3611556111 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4ed00a32d0 0x7f4ed00a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4edc005940 tx=0x7f4edc0058d0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:11.122+0000 7f4eef939640 1 -- 172.21.15.1:0/3611556111 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ee8102d30 msgr2=0x7f4ee8198620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:11.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:11.122+0000 7f4eef939640 1 --2- 172.21.15.1:0/3611556111 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ee8102d30 0x7f4ee8198620 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4ed800ea80 tx=0x7f4ed800ef40 comp rx=0 tx=0).stop 2024-09-19T09:37:11.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:11.122+0000 7f4eef939640 1 -- 172.21.15.1:0/3611556111 shutdown_connections 2024-09-19T09:37:11.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:11.122+0000 7f4eef939640 1 --2- 172.21.15.1:0/3611556111 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4ed00a32d0 0x7f4ed00a5790 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:11.122+0000 7f4eef939640 1 --2- 172.21.15.1:0/3611556111 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ee81082a0 0x7f4ee819cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:11.122+0000 7f4eef939640 1 --2- 172.21.15.1:0/3611556111 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ee81036e0 0x7f4ee8198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:11.122+0000 7f4eef939640 1 --2- 172.21.15.1:0/3611556111 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ee8102d30 0x7f4ee8198620 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:11.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:11.122+0000 7f4eef939640 1 -- 172.21.15.1:0/3611556111 >> 172.21.15.1:0/3611556111 conn(0x7f4ee80fc7d0 msgr2=0x7f4ee8105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:11.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:11.122+0000 7f4eef939640 1 -- 172.21.15.1:0/3611556111 shutdown_connections 2024-09-19T09:37:11.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:11.123+0000 7f4eef939640 1 -- 172.21.15.1:0/3611556111 wait complete. 2024-09-19T09:37:12.200 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:12 smithi001 ceph-mon[31225]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:12.200 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:12 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/3611556111' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T09:37:12.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:12 smithi022 ceph-mon[35583]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:12.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:12 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/3611556111' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T09:37:12.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:12 smithi121 ceph-mon[35577]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:12.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:12 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/3611556111' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T09:37:12.511 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574920 got 55834574924 for osd.1 2024-09-19T09:37:12.511 DEBUG:teuthology.parallel:result is None 2024-09-19T09:37:13.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.264+0000 7f30adc06640 1 -- 172.21.15.1:0/237003505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30a8102790 msgr2=0x7f30a81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:13.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.264+0000 7f30adc06640 1 --2- 172.21.15.1:0/237003505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30a8102790 0x7f30a81067e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3090009900 tx=0x7f309002a410 comp rx=0 tx=0).stop 2024-09-19T09:37:13.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.264+0000 7f30adc06640 1 -- 172.21.15.1:0/237003505 shutdown_connections 2024-09-19T09:37:13.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.264+0000 7f30adc06640 1 --2- 172.21.15.1:0/237003505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30a8106f10 0x7f30a810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:13.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.264+0000 7f30adc06640 1 --2- 172.21.15.1:0/237003505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30a8102790 0x7f30a81067e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:13.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.264+0000 7f30adc06640 1 --2- 172.21.15.1:0/237003505 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30a8101de0 0x7f30a81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:13.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.264+0000 7f30adc06640 1 -- 172.21.15.1:0/237003505 >> 172.21.15.1:0/237003505 conn(0x7f30a80fd8c0 msgr2=0x7f30a80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:13.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.264+0000 7f30adc06640 1 -- 172.21.15.1:0/237003505 shutdown_connections 2024-09-19T09:37:13.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.264+0000 7f30adc06640 1 -- 172.21.15.1:0/237003505 wait complete. 2024-09-19T09:37:13.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.264+0000 7f30adc06640 1 Processor -- start 2024-09-19T09:37:13.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.264+0000 7f30adc06640 1 -- start start 2024-09-19T09:37:13.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.265+0000 7f30adc06640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30a8101de0 0x7f30a81985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:13.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.265+0000 7f30adc06640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30a8102790 0x7f30a8198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:13.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.265+0000 7f30adc06640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30a8106f10 0x7f30a819ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:13.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.265+0000 7f30adc06640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f30a8112010 con 0x7f30a8101de0 2024-09-19T09:37:13.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.265+0000 7f30adc06640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f30a8111e90 con 0x7f30a8102790 2024-09-19T09:37:13.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.265+0000 7f30adc06640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f30a8112190 con 0x7f30a8106f10 2024-09-19T09:37:13.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.265+0000 7f30a77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30a8101de0 0x7f30a81985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:13.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.265+0000 7f30a77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30a8101de0 0x7f30a81985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52124/0 (socket says 172.21.15.1:52124) 2024-09-19T09:37:13.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.265+0000 7f30a77fe640 1 -- 172.21.15.1:0/527564846 learned_addr learned my addr 172.21.15.1:0/527564846 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:13.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.265+0000 7f30a7fff640 1 --2- 172.21.15.1:0/527564846 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30a8106f10 0x7f30a819ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:13.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.265+0000 7f309effd640 1 --2- 172.21.15.1:0/527564846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30a8102790 0x7f30a8198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:13.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.265+0000 7f30a77fe640 1 -- 172.21.15.1:0/527564846 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30a8106f10 msgr2=0x7f30a819ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:13.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.265+0000 7f30a77fe640 1 --2- 172.21.15.1:0/527564846 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30a8106f10 0x7f30a819ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:13.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.265+0000 7f30a77fe640 1 -- 172.21.15.1:0/527564846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30a8102790 msgr2=0x7f30a8198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:13.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.265+0000 7f30a77fe640 1 --2- 172.21.15.1:0/527564846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30a8102790 0x7f30a8198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:13.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.265+0000 7f30a77fe640 1 -- 172.21.15.1:0/527564846 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a819d560 con 0x7f30a8101de0 2024-09-19T09:37:13.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.265+0000 7f309effd640 1 --2- 172.21.15.1:0/527564846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30a8102790 0x7f30a8198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:13.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.265+0000 7f30a77fe640 1 --2- 172.21.15.1:0/527564846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30a8101de0 0x7f30a81985b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f309800b4a0 tx=0x7f309800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:13.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.266+0000 7f30a57fa640 1 -- 172.21.15.1:0/527564846 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3098014070 con 0x7f30a8101de0 2024-09-19T09:37:13.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.266+0000 7f30a57fa640 1 -- 172.21.15.1:0/527564846 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3098010af0 con 0x7f30a8101de0 2024-09-19T09:37:13.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.266+0000 7f30adc06640 1 -- 172.21.15.1:0/527564846 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a819d850 con 0x7f30a8101de0 2024-09-19T09:37:13.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.266+0000 7f30a57fa640 1 -- 172.21.15.1:0/527564846 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3098017d10 con 0x7f30a8101de0 2024-09-19T09:37:13.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.266+0000 7f30adc06640 1 -- 172.21.15.1:0/527564846 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a81a5130 con 0x7f30a8101de0 2024-09-19T09:37:13.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.267+0000 7f30adc06640 1 -- 172.21.15.1:0/527564846 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30a8102240 con 0x7f30a8101de0 2024-09-19T09:37:13.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.268+0000 7f30a57fa640 1 -- 172.21.15.1:0/527564846 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f3098017070 con 0x7f30a8101de0 2024-09-19T09:37:13.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.269+0000 7f30a57fa640 1 --2- 172.21.15.1:0/527564846 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f30940a32d0 0x7f30940a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:13.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.269+0000 7f309effd640 1 --2- 172.21.15.1:0/527564846 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f30940a32d0 0x7f30940a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:13.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.269+0000 7f30a57fa640 1 -- 172.21.15.1:0/527564846 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f30980cec20 con 0x7f30a8101de0 2024-09-19T09:37:13.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.270+0000 7f309effd640 1 --2- 172.21.15.1:0/527564846 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f30940a32d0 0x7f30940a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3090000c00 tx=0x7f3090032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:13.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.274+0000 7f30a57fa640 1 -- 172.21.15.1:0/527564846 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f309809baa0 con 0x7f30a8101de0 2024-09-19T09:37:13.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.458+0000 7f30adc06640 1 -- 172.21.15.1:0/527564846 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f30a8199910 con 0x7f30a8101de0 2024-09-19T09:37:13.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.459+0000 7f30a57fa640 1 -- 172.21.15.1:0/527564846 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f309809b3a0 con 0x7f30a8101de0 2024-09-19T09:37:13.460 INFO:teuthology.orchestra.run.smithi001.stdout:322122547226 2024-09-19T09:37:13.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.461+0000 7f30adc06640 1 -- 172.21.15.1:0/527564846 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f30940a32d0 msgr2=0x7f30940a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:13.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.461+0000 7f30adc06640 1 --2- 172.21.15.1:0/527564846 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f30940a32d0 0x7f30940a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3090000c00 tx=0x7f3090032d50 comp rx=0 tx=0).stop 2024-09-19T09:37:13.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.461+0000 7f30adc06640 1 -- 172.21.15.1:0/527564846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30a8101de0 msgr2=0x7f30a81985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:13.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.461+0000 7f30adc06640 1 --2- 172.21.15.1:0/527564846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30a8101de0 0x7f30a81985b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f309800b4a0 tx=0x7f309800b960 comp rx=0 tx=0).stop 2024-09-19T09:37:13.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.461+0000 7f30adc06640 1 -- 172.21.15.1:0/527564846 shutdown_connections 2024-09-19T09:37:13.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.461+0000 7f30adc06640 1 --2- 172.21.15.1:0/527564846 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f30a8106f10 0x7f30a819ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:13.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.461+0000 7f30adc06640 1 --2- 172.21.15.1:0/527564846 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f30940a32d0 0x7f30940a5790 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:13.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.461+0000 7f30adc06640 1 --2- 172.21.15.1:0/527564846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30a8102790 0x7f30a8198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:13.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.461+0000 7f30adc06640 1 --2- 172.21.15.1:0/527564846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30a8101de0 0x7f30a81985b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:13.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.461+0000 7f30adc06640 1 -- 172.21.15.1:0/527564846 >> 172.21.15.1:0/527564846 conn(0x7f30a80fd8c0 msgr2=0x7f30a80fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:13.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.461+0000 7f30adc06640 1 -- 172.21.15.1:0/527564846 shutdown_connections 2024-09-19T09:37:13.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.461+0000 7f30adc06640 1 -- 172.21.15.1:0/527564846 wait complete. 2024-09-19T09:37:13.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.465+0000 7f9830583640 1 -- 172.21.15.1:0/4153286657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9828100a70 msgr2=0x7f9828100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:13.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.465+0000 7f9830583640 1 --2- 172.21.15.1:0/4153286657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9828100a70 0x7f9828100ed0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9818009930 tx=0x7f981802a420 comp rx=0 tx=0).stop 2024-09-19T09:37:13.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.465+0000 7f9830583640 1 -- 172.21.15.1:0/4153286657 shutdown_connections 2024-09-19T09:37:13.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.466+0000 7f9830583640 1 --2- 172.21.15.1:0/4153286657 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9828101410 0x7f982810d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:13.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.466+0000 7f9830583640 1 --2- 172.21.15.1:0/4153286657 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9828100a70 0x7f9828100ed0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:13.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.466+0000 7f9830583640 1 --2- 172.21.15.1:0/4153286657 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9828106a70 0x7f9828106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:13.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.466+0000 7f9830583640 1 -- 172.21.15.1:0/4153286657 >> 172.21.15.1:0/4153286657 conn(0x7f98280fc790 msgr2=0x7f98280febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:13.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.466+0000 7f9830583640 1 -- 172.21.15.1:0/4153286657 shutdown_connections 2024-09-19T09:37:13.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.466+0000 7f9830583640 1 -- 172.21.15.1:0/4153286657 wait complete. 2024-09-19T09:37:13.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.466+0000 7f9830583640 1 Processor -- start 2024-09-19T09:37:13.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.466+0000 7f9830583640 1 -- start start 2024-09-19T09:37:13.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.466+0000 7f9830583640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9828100a70 0x7f98280fce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:13.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.466+0000 7f9830583640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9828101410 0x7f98280fd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:13.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.467+0000 7f9830583640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9828106a70 0x7f98280fd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:13.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.467+0000 7f9830583640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9828110e70 con 0x7f9828100a70 2024-09-19T09:37:13.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.467+0000 7f9830583640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9828110cf0 con 0x7f9828101410 2024-09-19T09:37:13.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.467+0000 7f9830583640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9828110ff0 con 0x7f9828106a70 2024-09-19T09:37:13.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.467+0000 7f982e31f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9828100a70 0x7f98280fce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:13.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.467+0000 7f982db1e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9828101410 0x7f98280fd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:13.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.467+0000 7f982db1e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9828101410 0x7f98280fd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:48682/0 (socket says 172.21.15.1:48682) 2024-09-19T09:37:13.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.467+0000 7f982e31f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9828100a70 0x7f98280fce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52146/0 (socket says 172.21.15.1:52146) 2024-09-19T09:37:13.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.467+0000 7f982db1e640 1 -- 172.21.15.1:0/1210222120 learned_addr learned my addr 172.21.15.1:0/1210222120 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:13.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.467+0000 7f982eb20640 1 --2- 172.21.15.1:0/1210222120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9828106a70 0x7f98280fd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:13.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.467+0000 7f982db1e640 1 -- 172.21.15.1:0/1210222120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9828106a70 msgr2=0x7f98280fd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:13.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.467+0000 7f982db1e640 1 --2- 172.21.15.1:0/1210222120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9828106a70 0x7f98280fd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:13.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.467+0000 7f982db1e640 1 -- 172.21.15.1:0/1210222120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9828100a70 msgr2=0x7f98280fce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:13.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.467+0000 7f982db1e640 1 --2- 172.21.15.1:0/1210222120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9828100a70 0x7f98280fce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:13.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.467+0000 7f982db1e640 1 -- 172.21.15.1:0/1210222120 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98281a6980 con 0x7f9828101410 2024-09-19T09:37:13.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.467+0000 7f982e31f640 1 --2- 172.21.15.1:0/1210222120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9828100a70 0x7f98280fce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:37:13.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.467+0000 7f982db1e640 1 --2- 172.21.15.1:0/1210222120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9828101410 0x7f98280fd380 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9818009230 tx=0x7f9818004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:13.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.468+0000 7f981f7fe640 1 -- 172.21.15.1:0/1210222120 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981803f030 con 0x7f9828101410 2024-09-19T09:37:13.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.468+0000 7f9830583640 1 -- 172.21.15.1:0/1210222120 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98281a6c10 con 0x7f9828101410 2024-09-19T09:37:13.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.468+0000 7f981f7fe640 1 -- 172.21.15.1:0/1210222120 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9818003ad0 con 0x7f9828101410 2024-09-19T09:37:13.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.468+0000 7f981f7fe640 1 -- 172.21.15.1:0/1210222120 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9818035070 con 0x7f9828101410 2024-09-19T09:37:13.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.468+0000 7f9830583640 1 -- 172.21.15.1:0/1210222120 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98281a7140 con 0x7f9828101410 2024-09-19T09:37:13.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.469+0000 7f9830583640 1 -- 172.21.15.1:0/1210222120 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9828100ed0 con 0x7f9828101410 2024-09-19T09:37:13.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.470+0000 7f981f7fe640 1 -- 172.21.15.1:0/1210222120 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f9818042030 con 0x7f9828101410 2024-09-19T09:37:13.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.471+0000 7f981f7fe640 1 --2- 172.21.15.1:0/1210222120 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f98140a32d0 0x7f98140a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:13.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.471+0000 7f982e31f640 1 --2- 172.21.15.1:0/1210222120 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f98140a32d0 0x7f98140a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:13.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.471+0000 7f981f7fe640 1 -- 172.21.15.1:0/1210222120 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f98180efd10 con 0x7f9828101410 2024-09-19T09:37:13.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.471+0000 7f982e31f640 1 --2- 172.21.15.1:0/1210222120 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f98140a32d0 0x7f98140a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9824009f40 tx=0x7f9824005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:13.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.476+0000 7f981f7fe640 1 -- 172.21.15.1:0/1210222120 <== mon.2 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f98180bc3b0 con 0x7f9828101410 2024-09-19T09:37:13.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.655+0000 7f9830583640 1 -- 172.21.15.1:0/1210222120 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f9828109ff0 con 0x7f9828101410 2024-09-19T09:37:13.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.656+0000 7f981f7fe640 1 -- 172.21.15.1:0/1210222120 <== mon.2 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f98180c06b0 con 0x7f9828101410 2024-09-19T09:37:13.657 INFO:teuthology.orchestra.run.smithi001.stdout:154618822712 2024-09-19T09:37:13.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.658+0000 7f9830583640 1 -- 172.21.15.1:0/1210222120 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f98140a32d0 msgr2=0x7f98140a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:13.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.658+0000 7f9830583640 1 --2- 172.21.15.1:0/1210222120 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f98140a32d0 0x7f98140a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9824009f40 tx=0x7f9824005f90 comp rx=0 tx=0).stop 2024-09-19T09:37:13.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.658+0000 7f9830583640 1 -- 172.21.15.1:0/1210222120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9828101410 msgr2=0x7f98280fd380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:13.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.658+0000 7f9830583640 1 --2- 172.21.15.1:0/1210222120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9828101410 0x7f98280fd380 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9818009230 tx=0x7f9818004270 comp rx=0 tx=0).stop 2024-09-19T09:37:13.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.658+0000 7f9830583640 1 -- 172.21.15.1:0/1210222120 shutdown_connections 2024-09-19T09:37:13.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.658+0000 7f9830583640 1 --2- 172.21.15.1:0/1210222120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9828106a70 0x7f98280fd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:13.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.658+0000 7f9830583640 1 --2- 172.21.15.1:0/1210222120 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f98140a32d0 0x7f98140a5790 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:13.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.658+0000 7f9830583640 1 --2- 172.21.15.1:0/1210222120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9828101410 0x7f98280fd380 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:13.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.658+0000 7f9830583640 1 --2- 172.21.15.1:0/1210222120 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9828100a70 0x7f98280fce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:13.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.658+0000 7f9830583640 1 -- 172.21.15.1:0/1210222120 >> 172.21.15.1:0/1210222120 conn(0x7f98280fc790 msgr2=0x7f982806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:13.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.658+0000 7f9830583640 1 -- 172.21.15.1:0/1210222120 shutdown_connections 2024-09-19T09:37:13.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:13.658+0000 7f9830583640 1 -- 172.21.15.1:0/1210222120 wait complete. 2024-09-19T09:37:14.316 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:14 smithi001 ceph-mon[31225]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:14.316 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:14 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/527564846' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T09:37:14.316 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:14 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1210222120' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T09:37:14.352 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822710 got 154618822712 for osd.5 2024-09-19T09:37:14.352 DEBUG:teuthology.parallel:result is None 2024-09-19T09:37:14.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:14 smithi022 ceph-mon[35583]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:14.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:14 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/527564846' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T09:37:14.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:14 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1210222120' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T09:37:14.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:14 smithi121 ceph-mon[35577]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:14.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:14 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/527564846' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T09:37:14.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:14 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1210222120' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T09:37:15.067 INFO:tasks.cephadm.ceph_manager.ceph:need seq 322122547222 got 322122547226 for osd.11 2024-09-19T09:37:15.067 DEBUG:teuthology.parallel:result is None 2024-09-19T09:37:15.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.194+0000 7f3fb3478640 1 -- 172.21.15.1:0/899191671 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fac10c170 msgr2=0x7f3fac10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:15.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.194+0000 7f3fb3478640 1 --2- 172.21.15.1:0/899191671 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fac10c170 0x7f3fac10e610 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4009ca0 tx=0x7f3fa402a950 comp rx=0 tx=0).stop 2024-09-19T09:37:15.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.194+0000 7f3fb3478640 1 -- 172.21.15.1:0/899191671 shutdown_connections 2024-09-19T09:37:15.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.194+0000 7f3fb3478640 1 --2- 172.21.15.1:0/899191671 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fac10c170 0x7f3fac10e610 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:15.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.194+0000 7f3fb3478640 1 --2- 172.21.15.1:0/899191671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fac103660 0x7f3fac10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:15.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.194+0000 7f3fb3478640 1 --2- 172.21.15.1:0/899191671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fac102d40 0x7f3fac103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:15.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.194+0000 7f3fb3478640 1 -- 172.21.15.1:0/899191671 >> 172.21.15.1:0/899191671 conn(0x7f3fac0fc7a0 msgr2=0x7f3fac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:15.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.194+0000 7f3fb3478640 1 -- 172.21.15.1:0/899191671 shutdown_connections 2024-09-19T09:37:15.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.194+0000 7f3fb3478640 1 -- 172.21.15.1:0/899191671 wait complete. 2024-09-19T09:37:15.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.194+0000 7f3fb3478640 1 Processor -- start 2024-09-19T09:37:15.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.194+0000 7f3fb3478640 1 -- start start 2024-09-19T09:37:15.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.195+0000 7f3fb3478640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fac102d40 0x7f3fac198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:15.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.195+0000 7f3fb3478640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fac103660 0x7f3fac198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:15.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.195+0000 7f3fb3478640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fac10c170 0x7f3fac19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:15.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.195+0000 7f3fb3478640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3fac111f70 con 0x7f3fac10c170 2024-09-19T09:37:15.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.195+0000 7f3fb3478640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3fac111df0 con 0x7f3fac102d40 2024-09-19T09:37:15.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.195+0000 7f3fb3478640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3fac1120f0 con 0x7f3fac103660 2024-09-19T09:37:15.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.195+0000 7f3fb1a15640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fac10c170 0x7f3fac19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:15.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.195+0000 7f3fb1a15640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fac10c170 0x7f3fac19cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52170/0 (socket says 172.21.15.1:52170) 2024-09-19T09:37:15.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.195+0000 7f3fb1a15640 1 -- 172.21.15.1:0/3800691025 learned_addr learned my addr 172.21.15.1:0/3800691025 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:15.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.195+0000 7f3fb0a13640 1 --2- 172.21.15.1:0/3800691025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fac103660 0x7f3fac198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:15.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.195+0000 7f3fb1214640 1 --2- 172.21.15.1:0/3800691025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fac102d40 0x7f3fac198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:15.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.195+0000 7f3fb1a15640 1 -- 172.21.15.1:0/3800691025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fac103660 msgr2=0x7f3fac198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:15.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.195+0000 7f3fb1a15640 1 --2- 172.21.15.1:0/3800691025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fac103660 0x7f3fac198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:15.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.195+0000 7f3fb1a15640 1 -- 172.21.15.1:0/3800691025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fac102d40 msgr2=0x7f3fac198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:15.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.195+0000 7f3fb1a15640 1 --2- 172.21.15.1:0/3800691025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fac102d40 0x7f3fac198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:15.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.195+0000 7f3fb1a15640 1 -- 172.21.15.1:0/3800691025 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fac19d2e0 con 0x7f3fac10c170 2024-09-19T09:37:15.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.195+0000 7f3fb1a15640 1 --2- 172.21.15.1:0/3800691025 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fac10c170 0x7f3fac19cc00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3fa402ae70 tx=0x7f3fa402f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:15.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.195+0000 7f3fa27fc640 1 -- 172.21.15.1:0/3800691025 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa4034040 con 0x7f3fac10c170 2024-09-19T09:37:15.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.195+0000 7f3fb3478640 1 -- 172.21.15.1:0/3800691025 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fac19d570 con 0x7f3fac10c170 2024-09-19T09:37:15.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.195+0000 7f3fa27fc640 1 -- 172.21.15.1:0/3800691025 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3fa4030920 con 0x7f3fac10c170 2024-09-19T09:37:15.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.196+0000 7f3fa27fc640 1 -- 172.21.15.1:0/3800691025 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa4045480 con 0x7f3fac10c170 2024-09-19T09:37:15.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.196+0000 7f3fb3478640 1 -- 172.21.15.1:0/3800691025 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fac1a4eb0 con 0x7f3fac10c170 2024-09-19T09:37:15.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.197+0000 7f3fb3478640 1 -- 172.21.15.1:0/3800691025 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fac06b070 con 0x7f3fac10c170 2024-09-19T09:37:15.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.198+0000 7f3fa27fc640 1 -- 172.21.15.1:0/3800691025 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f3fa4037020 con 0x7f3fac10c170 2024-09-19T09:37:15.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.198+0000 7f3fa27fc640 1 --2- 172.21.15.1:0/3800691025 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3f980a32d0 0x7f3f980a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:15.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.199+0000 7f3fb1214640 1 --2- 172.21.15.1:0/3800691025 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3f980a32d0 0x7f3f980a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:15.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.199+0000 7f3fa27fc640 1 -- 172.21.15.1:0/3800691025 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7f3fa40f0a50 con 0x7f3fac10c170 2024-09-19T09:37:15.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.199+0000 7f3fb1214640 1 --2- 172.21.15.1:0/3800691025 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3f980a32d0 0x7f3f980a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c005fd0 tx=0x7f3f9c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:15.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.202+0000 7f3fa27fc640 1 -- 172.21.15.1:0/3800691025 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3fa4081210 con 0x7f3fac10c170 2024-09-19T09:37:15.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:15 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T09:37:15.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:15 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-09-19T09:37:15.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:15 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-09-19T09:37:15.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:15 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-09-19T09:37:15.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:15 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-19T09:37:15.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:15 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]: dispatch 2024-09-19T09:37:15.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:15 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-19T09:37:15.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:15 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-09-19T09:37:15.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:15 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-09-19T09:37:15.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:15 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T09:37:15.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:15 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-09-19T09:37:15.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:15 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-09-19T09:37:15.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:15 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-09-19T09:37:15.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:15 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-19T09:37:15.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:15 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]: dispatch 2024-09-19T09:37:15.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:15 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-19T09:37:15.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:15 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-09-19T09:37:15.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:15 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-09-19T09:37:15.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.383+0000 7f3fb3478640 1 -- 172.21.15.1:0/3800691025 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f3fac1a5110 con 0x7f3fac10c170 2024-09-19T09:37:15.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.383+0000 7f3fa27fc640 1 -- 172.21.15.1:0/3800691025 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3fa40bd720 con 0x7f3fac10c170 2024-09-19T09:37:15.385 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:15 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T09:37:15.385 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:15 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-09-19T09:37:15.385 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:15 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-09-19T09:37:15.385 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:15 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-09-19T09:37:15.385 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:15 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-19T09:37:15.385 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:15 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]: dispatch 2024-09-19T09:37:15.385 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:15 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-19T09:37:15.385 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:15 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-09-19T09:37:15.386 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:15 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-09-19T09:37:15.386 INFO:teuthology.orchestra.run.smithi001.stdout:34359738450 2024-09-19T09:37:15.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.385+0000 7f3fb3478640 1 -- 172.21.15.1:0/3800691025 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3f980a32d0 msgr2=0x7f3f980a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:15.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.385+0000 7f3fb3478640 1 --2- 172.21.15.1:0/3800691025 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3f980a32d0 0x7f3f980a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c005fd0 tx=0x7f3f9c005850 comp rx=0 tx=0).stop 2024-09-19T09:37:15.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.385+0000 7f3fb3478640 1 -- 172.21.15.1:0/3800691025 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fac10c170 msgr2=0x7f3fac19cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:15.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.385+0000 7f3fb3478640 1 --2- 172.21.15.1:0/3800691025 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fac10c170 0x7f3fac19cc00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3fa402ae70 tx=0x7f3fa402f5b0 comp rx=0 tx=0).stop 2024-09-19T09:37:15.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.385+0000 7f3fb3478640 1 -- 172.21.15.1:0/3800691025 shutdown_connections 2024-09-19T09:37:15.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.385+0000 7f3fb3478640 1 --2- 172.21.15.1:0/3800691025 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3fac10c170 0x7f3fac19cc00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:15.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.385+0000 7f3fb3478640 1 --2- 172.21.15.1:0/3800691025 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fac103660 0x7f3fac198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:15.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.385+0000 7f3fb3478640 1 --2- 172.21.15.1:0/3800691025 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3f980a32d0 0x7f3f980a5790 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:15.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.385+0000 7f3fb3478640 1 --2- 172.21.15.1:0/3800691025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3fac102d40 0x7f3fac198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:15.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.386+0000 7f3fb3478640 1 -- 172.21.15.1:0/3800691025 >> 172.21.15.1:0/3800691025 conn(0x7f3fac0fc7a0 msgr2=0x7f3fac0fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:15.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.386+0000 7f3fb3478640 1 -- 172.21.15.1:0/3800691025 shutdown_connections 2024-09-19T09:37:15.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:15.386+0000 7f3fb3478640 1 -- 172.21.15.1:0/3800691025 wait complete. 2024-09-19T09:37:16.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:16 smithi001 ceph-mon[31225]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:16.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:16 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T09:37:16.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:16 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-19T09:37:16.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:16 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-19T09:37:16.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:16 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-19T09:37:16.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:16 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-19T09:37:16.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:16 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-09-19T09:37:16.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:16 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-19T09:37:16.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:16 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-09-19T09:37:16.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:16 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-09-19T09:37:16.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:16 smithi001 ceph-mon[31225]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T09:37:16.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:16 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/3800691025' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T09:37:16.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:16 smithi022 ceph-mon[35583]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:16.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:16 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T09:37:16.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:16 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-19T09:37:16.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:16 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-19T09:37:16.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:16 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-19T09:37:16.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:16 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-19T09:37:16.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:16 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-09-19T09:37:16.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:16 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-19T09:37:16.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:16 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-09-19T09:37:16.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:16 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-09-19T09:37:16.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:16 smithi022 ceph-mon[35583]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T09:37:16.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:16 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/3800691025' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T09:37:16.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:16 smithi121 ceph-mon[35577]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:16.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:16 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T09:37:16.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:16 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-19T09:37:16.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:16 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-19T09:37:16.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:16 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-19T09:37:16.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:16 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-19T09:37:16.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:16 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-09-19T09:37:16.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:16 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-19T09:37:16.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:16 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-09-19T09:37:16.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:16 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-09-19T09:37:16.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:16 smithi121 ceph-mon[35577]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T09:37:16.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:16 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/3800691025' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T09:37:16.696 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738447 got 34359738450 for osd.0 2024-09-19T09:37:16.696 DEBUG:teuthology.parallel:result is None 2024-09-19T09:37:16.697 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T09:37:16.697 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:37:16.999 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:17.300 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:17 smithi001 ceph-mon[31225]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T09:37:17.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:17 smithi022 ceph-mon[35583]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T09:37:17.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:17 smithi121 ceph-mon[35577]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T09:37:17.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.537+0000 7efd309f3640 1 -- 172.21.15.1:0/3116003197 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd2c102ef0 msgr2=0x7efd2c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:17.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.537+0000 7efd309f3640 1 --2- 172.21.15.1:0/3116003197 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd2c102ef0 0x7efd2c10da40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7efd1c009900 tx=0x7efd1c02a480 comp rx=0 tx=0).stop 2024-09-19T09:37:17.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.537+0000 7efd309f3640 1 -- 172.21.15.1:0/3116003197 shutdown_connections 2024-09-19T09:37:17.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.537+0000 7efd309f3640 1 --2- 172.21.15.1:0/3116003197 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd2c102ef0 0x7efd2c10da40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:17.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.537+0000 7efd309f3640 1 --2- 172.21.15.1:0/3116003197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd2c102570 0x7efd2c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:17.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.537+0000 7efd309f3640 1 --2- 172.21.15.1:0/3116003197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd2c100e20 0x7efd2c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:17.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.537+0000 7efd309f3640 1 -- 172.21.15.1:0/3116003197 >> 172.21.15.1:0/3116003197 conn(0x7efd2c0fc7d0 msgr2=0x7efd2c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:17.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.537+0000 7efd309f3640 1 -- 172.21.15.1:0/3116003197 shutdown_connections 2024-09-19T09:37:17.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.537+0000 7efd309f3640 1 -- 172.21.15.1:0/3116003197 wait complete. 2024-09-19T09:37:17.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.538+0000 7efd309f3640 1 Processor -- start 2024-09-19T09:37:17.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.538+0000 7efd309f3640 1 -- start start 2024-09-19T09:37:17.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.538+0000 7efd309f3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd2c100e20 0x7efd2c199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:17.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.538+0000 7efd309f3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd2c102570 0x7efd2c199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:17.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.538+0000 7efd309f3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd2c102ef0 0x7efd2c1a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:17.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.538+0000 7efd309f3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c110f80 con 0x7efd2c102570 2024-09-19T09:37:17.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.538+0000 7efd309f3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c110e00 con 0x7efd2c100e20 2024-09-19T09:37:17.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.538+0000 7efd309f3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efd2c111100 con 0x7efd2c102ef0 2024-09-19T09:37:17.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.538+0000 7efd29d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd2c102570 0x7efd2c199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:17.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.538+0000 7efd29d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd2c102570 0x7efd2c199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43936/0 (socket says 172.21.15.1:43936) 2024-09-19T09:37:17.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.538+0000 7efd29d9b640 1 -- 172.21.15.1:0/370951359 learned_addr learned my addr 172.21.15.1:0/370951359 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:17.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.538+0000 7efd2ad9d640 1 --2- 172.21.15.1:0/370951359 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd2c102ef0 0x7efd2c1a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:17.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.538+0000 7efd2a59c640 1 --2- 172.21.15.1:0/370951359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd2c100e20 0x7efd2c199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:17.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.539+0000 7efd29d9b640 1 -- 172.21.15.1:0/370951359 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd2c102ef0 msgr2=0x7efd2c1a43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:17.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.539+0000 7efd29d9b640 1 --2- 172.21.15.1:0/370951359 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd2c102ef0 0x7efd2c1a43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:17.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.539+0000 7efd29d9b640 1 -- 172.21.15.1:0/370951359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd2c100e20 msgr2=0x7efd2c199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:17.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.539+0000 7efd29d9b640 1 --2- 172.21.15.1:0/370951359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd2c100e20 0x7efd2c199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:17.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.539+0000 7efd29d9b640 1 -- 172.21.15.1:0/370951359 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd2c1a48f0 con 0x7efd2c102570 2024-09-19T09:37:17.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.539+0000 7efd2ad9d640 1 --2- 172.21.15.1:0/370951359 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd2c102ef0 0x7efd2c1a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:17.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.539+0000 7efd2a59c640 1 --2- 172.21.15.1:0/370951359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd2c100e20 0x7efd2c199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:17.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.539+0000 7efd29d9b640 1 --2- 172.21.15.1:0/370951359 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd2c102570 0x7efd2c199870 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7efd1400e9f0 tx=0x7efd1400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:17.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.539+0000 7efd237fe640 1 -- 172.21.15.1:0/370951359 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1400cd80 con 0x7efd2c102570 2024-09-19T09:37:17.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.539+0000 7efd309f3640 1 -- 172.21.15.1:0/370951359 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd2c1a4ac0 con 0x7efd2c102570 2024-09-19T09:37:17.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.539+0000 7efd237fe640 1 -- 172.21.15.1:0/370951359 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd14010910 con 0x7efd2c102570 2024-09-19T09:37:17.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.539+0000 7efd237fe640 1 -- 172.21.15.1:0/370951359 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd140188f0 con 0x7efd2c102570 2024-09-19T09:37:17.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.539+0000 7efd309f3640 1 -- 172.21.15.1:0/370951359 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd2c1a5000 con 0x7efd2c102570 2024-09-19T09:37:17.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.540+0000 7efd309f3640 1 -- 172.21.15.1:0/370951359 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd2c101200 con 0x7efd2c102570 2024-09-19T09:37:17.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.542+0000 7efd237fe640 1 -- 172.21.15.1:0/370951359 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7efd14010ac0 con 0x7efd2c102570 2024-09-19T09:37:17.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.542+0000 7efd237fe640 1 --2- 172.21.15.1:0/370951359 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7efd180a32d0 0x7efd180a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:17.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.542+0000 7efd2a59c640 1 --2- 172.21.15.1:0/370951359 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7efd180a32d0 0x7efd180a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:17.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.542+0000 7efd237fe640 1 -- 172.21.15.1:0/370951359 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7efd140d0350 con 0x7efd2c102570 2024-09-19T09:37:17.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.543+0000 7efd2a59c640 1 --2- 172.21.15.1:0/370951359 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7efd180a32d0 0x7efd180a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7efd24005fd0 tx=0x7efd24009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:17.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.545+0000 7efd237fe640 1 -- 172.21.15.1:0/370951359 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efd1409ced0 con 0x7efd2c102570 2024-09-19T09:37:17.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.720+0000 7efd309f3640 1 -- 172.21.15.1:0/370951359 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efd2c106f90 con 0x7efd180a32d0 2024-09-19T09:37:17.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.726+0000 7efd237fe640 1 -- 172.21.15.1:0/370951359 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258680 (secure 0 0 0) 0x7efd2c106f90 con 0x7efd180a32d0 2024-09-19T09:37:17.730 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:37:17.731 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-19T09:37:17.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.730+0000 7efd309f3640 1 -- 172.21.15.1:0/370951359 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7efd180a32d0 msgr2=0x7efd180a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:17.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.730+0000 7efd309f3640 1 --2- 172.21.15.1:0/370951359 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7efd180a32d0 0x7efd180a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7efd24005fd0 tx=0x7efd24009500 comp rx=0 tx=0).stop 2024-09-19T09:37:17.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.730+0000 7efd309f3640 1 -- 172.21.15.1:0/370951359 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd2c102570 msgr2=0x7efd2c199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:17.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.730+0000 7efd309f3640 1 --2- 172.21.15.1:0/370951359 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd2c102570 0x7efd2c199870 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7efd1400e9f0 tx=0x7efd1400eeb0 comp rx=0 tx=0).stop 2024-09-19T09:37:17.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.731+0000 7efd309f3640 1 -- 172.21.15.1:0/370951359 shutdown_connections 2024-09-19T09:37:17.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.731+0000 7efd309f3640 1 --2- 172.21.15.1:0/370951359 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efd2c102ef0 0x7efd2c1a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:17.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.731+0000 7efd309f3640 1 --2- 172.21.15.1:0/370951359 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efd2c102570 0x7efd2c199870 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:17.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.731+0000 7efd309f3640 1 --2- 172.21.15.1:0/370951359 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7efd180a32d0 0x7efd180a5790 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:17.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.731+0000 7efd309f3640 1 --2- 172.21.15.1:0/370951359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efd2c100e20 0x7efd2c199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:17.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.731+0000 7efd309f3640 1 -- 172.21.15.1:0/370951359 >> 172.21.15.1:0/370951359 conn(0x7efd2c0fc7d0 msgr2=0x7efd2c106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:17.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.731+0000 7efd309f3640 1 -- 172.21.15.1:0/370951359 shutdown_connections 2024-09-19T09:37:17.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:17.731+0000 7efd309f3640 1 -- 172.21.15.1:0/370951359 wait complete. 2024-09-19T09:37:18.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:18 smithi022 ceph-mon[35583]: pgmap v314: 97 pgs: 1 activating, 2 peering, 94 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-19T09:37:18.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:18 smithi022 ceph-mon[35583]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-09-19T09:37:18.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:18 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:37:18.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:18 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:37:18.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:18 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:37:18.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:18 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:37:18.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:18 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:37:18.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:18 smithi121 ceph-mon[35577]: pgmap v314: 97 pgs: 1 activating, 2 peering, 94 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-19T09:37:18.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:18 smithi121 ceph-mon[35577]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-09-19T09:37:18.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:18 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:37:18.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:18 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:37:18.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:18 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:37:18.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:18 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:37:18.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:18 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:37:18.393 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:18 smithi001 ceph-mon[31225]: pgmap v314: 97 pgs: 1 activating, 2 peering, 94 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-19T09:37:18.393 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:18 smithi001 ceph-mon[31225]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-09-19T09:37:18.393 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:18 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:37:18.393 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:18 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:37:18.393 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:18 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:37:18.393 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:18 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:37:18.393 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:18 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:37:18.429 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2024-09-19T09:37:16.145686+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654219,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":249,"num_read_kb":234,"num_write":267,"num_write_kb":3027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":405732,"kb_used_data":10692,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124536092,"statfs":{"total":1151940427776,"available":1151524958208,"internally_reserved":0,"allocated":10948608,"data_stored":7067087,"data_compressed":113809,"data_compressed_allocated":143360,"data_compressed_original":1785856,"omap_allocated":19141,"internal_metadata":404272443},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002186"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971317+0000","last_change":"2024-09-19T09:36:12.985228+0000","last_active":"2024-09-19T09:36:13.971317+0000","last_peered":"2024-09-19T09:36:13.971317+0000","last_clean":"2024-09-19T09:36:13.971317+0000","last_became_active":"2024-09-19T09:36:12.984306+0000","last_became_peered":"2024-09-19T09:36:12.984306+0000","last_unstale":"2024-09-19T09:36:13.971317+0000","last_undegraded":"2024-09-19T09:36:13.971317+0000","last_fullsized":"2024-09-19T09:36:13.971317+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:45.988859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979575+0000","last_change":"2024-09-19T09:36:12.987631+0000","last_active":"2024-09-19T09:36:13.979575+0000","last_peered":"2024-09-19T09:36:13.979575+0000","last_clean":"2024-09-19T09:36:13.979575+0000","last_became_active":"2024-09-19T09:36:12.987298+0000","last_became_peered":"2024-09-19T09:36:12.987298+0000","last_unstale":"2024-09-19T09:36:13.979575+0000","last_undegraded":"2024-09-19T09:36:13.979575+0000","last_fullsized":"2024-09-19T09:36:13.979575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:47.397162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979729+0000","last_change":"2024-09-19T09:36:12.991466+0000","last_active":"2024-09-19T09:36:13.979729+0000","last_peered":"2024-09-19T09:36:13.979729+0000","last_clean":"2024-09-19T09:36:13.979729+0000","last_became_active":"2024-09-19T09:36:12.990903+0000","last_became_peered":"2024-09-19T09:36:12.990903+0000","last_unstale":"2024-09-19T09:36:13.979729+0000","last_undegraded":"2024-09-19T09:36:13.979729+0000","last_fullsized":"2024-09-19T09:36:13.979729+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:04.128768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980669+0000","last_change":"2024-09-19T09:36:12.986686+0000","last_active":"2024-09-19T09:36:13.980669+0000","last_peered":"2024-09-19T09:36:13.980669+0000","last_clean":"2024-09-19T09:36:13.980669+0000","last_became_active":"2024-09-19T09:36:12.986334+0000","last_became_peered":"2024-09-19T09:36:12.986334+0000","last_unstale":"2024-09-19T09:36:13.980669+0000","last_undegraded":"2024-09-19T09:36:13.980669+0000","last_fullsized":"2024-09-19T09:36:13.980669+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:39.926343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979886+0000","last_change":"2024-09-19T09:36:12.981964+0000","last_active":"2024-09-19T09:36:13.979886+0000","last_peered":"2024-09-19T09:36:13.979886+0000","last_clean":"2024-09-19T09:36:13.979886+0000","last_became_active":"2024-09-19T09:36:12.981558+0000","last_became_peered":"2024-09-19T09:36:12.981558+0000","last_unstale":"2024-09-19T09:36:13.979886+0000","last_undegraded":"2024-09-19T09:36:13.979886+0000","last_fullsized":"2024-09-19T09:36:13.979886+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:33.706451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031212+0000","last_change":"2024-09-19T09:36:12.992598+0000","last_active":"2024-09-19T09:37:16.031212+0000","last_peered":"2024-09-19T09:37:16.031212+0000","last_clean":"2024-09-19T09:37:16.031212+0000","last_became_active":"2024-09-19T09:36:12.992281+0000","last_became_peered":"2024-09-19T09:36:12.992281+0000","last_unstale":"2024-09-19T09:37:16.031212+0000","last_undegraded":"2024-09-19T09:37:16.031212+0000","last_fullsized":"2024-09-19T09:37:16.031212+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:26.107432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983518+0000","last_change":"2024-09-19T09:36:12.988583+0000","last_active":"2024-09-19T09:36:13.983518+0000","last_peered":"2024-09-19T09:36:13.983518+0000","last_clean":"2024-09-19T09:36:13.983518+0000","last_became_active":"2024-09-19T09:36:12.987895+0000","last_became_peered":"2024-09-19T09:36:12.987895+0000","last_unstale":"2024-09-19T09:36:13.983518+0000","last_undegraded":"2024-09-19T09:36:13.983518+0000","last_fullsized":"2024-09-19T09:36:13.983518+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:47.617324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.035118+0000","last_change":"2024-09-19T09:36:12.988526+0000","last_active":"2024-09-19T09:37:15.035118+0000","last_peered":"2024-09-19T09:37:15.035118+0000","last_clean":"2024-09-19T09:37:15.035118+0000","last_became_active":"2024-09-19T09:36:12.988093+0000","last_became_peered":"2024-09-19T09:36:12.988093+0000","last_unstale":"2024-09-19T09:37:15.035118+0000","last_undegraded":"2024-09-19T09:37:15.035118+0000","last_fullsized":"2024-09-19T09:37:15.035118+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:48.949397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977695+0000","last_change":"2024-09-19T09:36:12.992360+0000","last_active":"2024-09-19T09:36:13.977695+0000","last_peered":"2024-09-19T09:36:13.977695+0000","last_clean":"2024-09-19T09:36:13.977695+0000","last_became_active":"2024-09-19T09:36:12.991833+0000","last_became_peered":"2024-09-19T09:36:12.991833+0000","last_unstale":"2024-09-19T09:36:13.977695+0000","last_undegraded":"2024-09-19T09:36:13.977695+0000","last_fullsized":"2024-09-19T09:36:13.977695+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:47.715012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031904+0000","last_change":"2024-09-19T09:36:12.993435+0000","last_active":"2024-09-19T09:37:16.031904+0000","last_peered":"2024-09-19T09:37:16.031904+0000","last_clean":"2024-09-19T09:37:16.031904+0000","last_became_active":"2024-09-19T09:36:12.993108+0000","last_became_peered":"2024-09-19T09:36:12.993108+0000","last_unstale":"2024-09-19T09:37:16.031904+0000","last_undegraded":"2024-09-19T09:37:16.031904+0000","last_fullsized":"2024-09-19T09:37:16.031904+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:54.453593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983462+0000","last_change":"2024-09-19T09:36:12.991044+0000","last_active":"2024-09-19T09:36:13.983462+0000","last_peered":"2024-09-19T09:36:13.983462+0000","last_clean":"2024-09-19T09:36:13.983462+0000","last_became_active":"2024-09-19T09:36:12.989955+0000","last_became_peered":"2024-09-19T09:36:12.989955+0000","last_unstale":"2024-09-19T09:36:13.983462+0000","last_undegraded":"2024-09-19T09:36:13.983462+0000","last_fullsized":"2024-09-19T09:36:13.983462+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:21.034023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980631+0000","last_change":"2024-09-19T09:36:12.989679+0000","last_active":"2024-09-19T09:36:13.980631+0000","last_peered":"2024-09-19T09:36:13.980631+0000","last_clean":"2024-09-19T09:36:13.980631+0000","last_became_active":"2024-09-19T09:36:12.988463+0000","last_became_peered":"2024-09-19T09:36:12.988463+0000","last_unstale":"2024-09-19T09:36:13.980631+0000","last_undegraded":"2024-09-19T09:36:13.980631+0000","last_fullsized":"2024-09-19T09:36:13.980631+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:28.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971006+0000","last_change":"2024-09-19T09:36:12.983494+0000","last_active":"2024-09-19T09:36:13.971006+0000","last_peered":"2024-09-19T09:36:13.971006+0000","last_clean":"2024-09-19T09:36:13.971006+0000","last_became_active":"2024-09-19T09:36:12.983143+0000","last_became_peered":"2024-09-19T09:36:12.983143+0000","last_unstale":"2024-09-19T09:36:13.971006+0000","last_undegraded":"2024-09-19T09:36:13.971006+0000","last_fullsized":"2024-09-19T09:36:13.971006+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:23.378183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980072+0000","last_change":"2024-09-19T09:36:12.987512+0000","last_active":"2024-09-19T09:36:13.980072+0000","last_peered":"2024-09-19T09:36:13.980072+0000","last_clean":"2024-09-19T09:36:13.980072+0000","last_became_active":"2024-09-19T09:36:12.987288+0000","last_became_peered":"2024-09-19T09:36:12.987288+0000","last_unstale":"2024-09-19T09:36:13.980072+0000","last_undegraded":"2024-09-19T09:36:13.980072+0000","last_fullsized":"2024-09-19T09:36:13.980072+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:14.614333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979944+0000","last_change":"2024-09-19T09:36:12.989725+0000","last_active":"2024-09-19T09:36:13.979944+0000","last_peered":"2024-09-19T09:36:13.979944+0000","last_clean":"2024-09-19T09:36:13.979944+0000","last_became_active":"2024-09-19T09:36:12.989229+0000","last_became_peered":"2024-09-19T09:36:12.989229+0000","last_unstale":"2024-09-19T09:36:13.979944+0000","last_undegraded":"2024-09-19T09:36:13.979944+0000","last_fullsized":"2024-09-19T09:36:13.979944+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:07.896864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977084+0000","last_change":"2024-09-19T09:36:12.988210+0000","last_active":"2024-09-19T09:36:13.977084+0000","last_peered":"2024-09-19T09:36:13.977084+0000","last_clean":"2024-09-19T09:36:13.977084+0000","last_became_active":"2024-09-19T09:36:12.987904+0000","last_became_peered":"2024-09-19T09:36:12.987904+0000","last_unstale":"2024-09-19T09:36:13.977084+0000","last_undegraded":"2024-09-19T09:36:13.977084+0000","last_fullsized":"2024-09-19T09:36:13.977084+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:13.588237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971389+0000","last_change":"2024-09-19T09:36:12.984028+0000","last_active":"2024-09-19T09:36:13.971389+0000","last_peered":"2024-09-19T09:36:13.971389+0000","last_clean":"2024-09-19T09:36:13.971389+0000","last_became_active":"2024-09-19T09:36:12.982062+0000","last_became_peered":"2024-09-19T09:36:12.982062+0000","last_unstale":"2024-09-19T09:36:13.971389+0000","last_undegraded":"2024-09-19T09:36:13.971389+0000","last_fullsized":"2024-09-19T09:36:13.971389+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:26.610287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.034452+0000","last_change":"2024-09-19T09:36:12.979277+0000","last_active":"2024-09-19T09:37:15.034452+0000","last_peered":"2024-09-19T09:37:15.034452+0000","last_clean":"2024-09-19T09:37:15.034452+0000","last_became_active":"2024-09-19T09:36:12.978970+0000","last_became_peered":"2024-09-19T09:36:12.978970+0000","last_unstale":"2024-09-19T09:37:15.034452+0000","last_undegraded":"2024-09-19T09:37:15.034452+0000","last_fullsized":"2024-09-19T09:37:15.034452+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:00.424728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979950+0000","last_change":"2024-09-19T09:36:12.981021+0000","last_active":"2024-09-19T09:36:13.979950+0000","last_peered":"2024-09-19T09:36:13.979950+0000","last_clean":"2024-09-19T09:36:13.979950+0000","last_became_active":"2024-09-19T09:36:12.980580+0000","last_became_peered":"2024-09-19T09:36:12.980580+0000","last_unstale":"2024-09-19T09:36:13.979950+0000","last_undegraded":"2024-09-19T09:36:13.979950+0000","last_fullsized":"2024-09-19T09:36:13.979950+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:17.464873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971081+0000","last_change":"2024-09-19T09:36:12.986090+0000","last_active":"2024-09-19T09:36:13.971081+0000","last_peered":"2024-09-19T09:36:13.971081+0000","last_clean":"2024-09-19T09:36:13.971081+0000","last_became_active":"2024-09-19T09:36:12.985740+0000","last_became_peered":"2024-09-19T09:36:12.985740+0000","last_unstale":"2024-09-19T09:36:13.971081+0000","last_undegraded":"2024-09-19T09:36:13.971081+0000","last_fullsized":"2024-09-19T09:36:13.971081+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:35.252834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971039+0000","last_change":"2024-09-19T09:36:12.981257+0000","last_active":"2024-09-19T09:36:13.971039+0000","last_peered":"2024-09-19T09:36:13.971039+0000","last_clean":"2024-09-19T09:36:13.971039+0000","last_became_active":"2024-09-19T09:36:12.980911+0000","last_became_peered":"2024-09-19T09:36:12.980911+0000","last_unstale":"2024-09-19T09:36:13.971039+0000","last_undegraded":"2024-09-19T09:36:13.971039+0000","last_fullsized":"2024-09-19T09:36:13.971039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:41.470514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977617+0000","last_change":"2024-09-19T09:36:12.982585+0000","last_active":"2024-09-19T09:36:13.977617+0000","last_peered":"2024-09-19T09:36:13.977617+0000","last_clean":"2024-09-19T09:36:13.977617+0000","last_became_active":"2024-09-19T09:36:12.982193+0000","last_became_peered":"2024-09-19T09:36:12.982193+0000","last_unstale":"2024-09-19T09:36:13.977617+0000","last_undegraded":"2024-09-19T09:36:13.977617+0000","last_fullsized":"2024-09-19T09:36:13.977617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:30.057088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.034505+0000","last_change":"2024-09-19T09:36:12.985236+0000","last_active":"2024-09-19T09:37:15.034505+0000","last_peered":"2024-09-19T09:37:15.034505+0000","last_clean":"2024-09-19T09:37:15.034505+0000","last_became_active":"2024-09-19T09:36:12.984751+0000","last_became_peered":"2024-09-19T09:36:12.984751+0000","last_unstale":"2024-09-19T09:37:15.034505+0000","last_undegraded":"2024-09-19T09:37:15.034505+0000","last_fullsized":"2024-09-19T09:37:15.034505+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:52.784216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983846+0000","last_change":"2024-09-19T09:36:12.985856+0000","last_active":"2024-09-19T09:36:13.983846+0000","last_peered":"2024-09-19T09:36:13.983846+0000","last_clean":"2024-09-19T09:36:13.983846+0000","last_became_active":"2024-09-19T09:36:12.985312+0000","last_became_peered":"2024-09-19T09:36:12.985312+0000","last_unstale":"2024-09-19T09:36:13.983846+0000","last_undegraded":"2024-09-19T09:36:13.983846+0000","last_fullsized":"2024-09-19T09:36:13.983846+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:25.235945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.035794+0000","last_change":"2024-09-19T09:36:12.982443+0000","last_active":"2024-09-19T09:37:15.035794+0000","last_peered":"2024-09-19T09:37:15.035794+0000","last_clean":"2024-09-19T09:37:15.035794+0000","last_became_active":"2024-09-19T09:36:12.982130+0000","last_became_peered":"2024-09-19T09:36:12.982130+0000","last_unstale":"2024-09-19T09:37:15.035794+0000","last_undegraded":"2024-09-19T09:37:15.035794+0000","last_fullsized":"2024-09-19T09:37:15.035794+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:17.177563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980374+0000","last_change":"2024-09-19T09:36:12.990439+0000","last_active":"2024-09-19T09:36:13.980374+0000","last_peered":"2024-09-19T09:36:13.980374+0000","last_clean":"2024-09-19T09:36:13.980374+0000","last_became_active":"2024-09-19T09:36:12.990135+0000","last_became_peered":"2024-09-19T09:36:12.990135+0000","last_unstale":"2024-09-19T09:36:13.980374+0000","last_undegraded":"2024-09-19T09:36:13.980374+0000","last_fullsized":"2024-09-19T09:36:13.980374+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:51.685192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971233+0000","last_change":"2024-09-19T09:36:12.987261+0000","last_active":"2024-09-19T09:36:13.971233+0000","last_peered":"2024-09-19T09:36:13.971233+0000","last_clean":"2024-09-19T09:36:13.971233+0000","last_became_active":"2024-09-19T09:36:12.986192+0000","last_became_peered":"2024-09-19T09:36:12.986192+0000","last_unstale":"2024-09-19T09:36:13.971233+0000","last_undegraded":"2024-09-19T09:36:13.971233+0000","last_fullsized":"2024-09-19T09:36:13.971233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:58.435605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971115+0000","last_change":"2024-09-19T09:36:12.981248+0000","last_active":"2024-09-19T09:36:13.971115+0000","last_peered":"2024-09-19T09:36:13.971115+0000","last_clean":"2024-09-19T09:36:13.971115+0000","last_became_active":"2024-09-19T09:36:12.980754+0000","last_became_peered":"2024-09-19T09:36:12.980754+0000","last_unstale":"2024-09-19T09:36:13.971115+0000","last_undegraded":"2024-09-19T09:36:13.971115+0000","last_fullsized":"2024-09-19T09:36:13.971115+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:03.970402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980069+0000","last_change":"2024-09-19T09:36:12.990841+0000","last_active":"2024-09-19T09:36:13.980069+0000","last_peered":"2024-09-19T09:36:13.980069+0000","last_clean":"2024-09-19T09:36:13.980069+0000","last_became_active":"2024-09-19T09:36:12.989667+0000","last_became_peered":"2024-09-19T09:36:12.989667+0000","last_unstale":"2024-09-19T09:36:13.980069+0000","last_undegraded":"2024-09-19T09:36:13.980069+0000","last_fullsized":"2024-09-19T09:36:13.980069+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:46:00.314590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979717+0000","last_change":"2024-09-19T09:36:12.984007+0000","last_active":"2024-09-19T09:36:13.979717+0000","last_peered":"2024-09-19T09:36:13.979717+0000","last_clean":"2024-09-19T09:36:13.979717+0000","last_became_active":"2024-09-19T09:36:12.983627+0000","last_became_peered":"2024-09-19T09:36:12.983627+0000","last_unstale":"2024-09-19T09:36:13.979717+0000","last_undegraded":"2024-09-19T09:36:13.979717+0000","last_fullsized":"2024-09-19T09:36:13.979717+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:42.038673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980949+0000","last_change":"2024-09-19T09:36:12.988032+0000","last_active":"2024-09-19T09:36:13.980949+0000","last_peered":"2024-09-19T09:36:13.980949+0000","last_clean":"2024-09-19T09:36:13.980949+0000","last_became_active":"2024-09-19T09:36:12.987588+0000","last_became_peered":"2024-09-19T09:36:12.987588+0000","last_unstale":"2024-09-19T09:36:13.980949+0000","last_undegraded":"2024-09-19T09:36:13.980949+0000","last_fullsized":"2024-09-19T09:36:13.980949+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:01.518543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.970969+0000","last_change":"2024-09-19T09:36:12.991186+0000","last_active":"2024-09-19T09:36:13.970969+0000","last_peered":"2024-09-19T09:36:13.970969+0000","last_clean":"2024-09-19T09:36:13.970969+0000","last_became_active":"2024-09-19T09:36:12.987125+0000","last_became_peered":"2024-09-19T09:36:12.987125+0000","last_unstale":"2024-09-19T09:36:13.970969+0000","last_undegraded":"2024-09-19T09:36:13.970969+0000","last_fullsized":"2024-09-19T09:36:13.970969+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:35.316046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979987+0000","last_change":"2024-09-19T09:36:12.989709+0000","last_active":"2024-09-19T09:36:13.979987+0000","last_peered":"2024-09-19T09:36:13.979987+0000","last_clean":"2024-09-19T09:36:13.979987+0000","last_became_active":"2024-09-19T09:36:12.989324+0000","last_became_peered":"2024-09-19T09:36:12.989324+0000","last_unstale":"2024-09-19T09:36:13.979987+0000","last_undegraded":"2024-09-19T09:36:13.979987+0000","last_fullsized":"2024-09-19T09:36:13.979987+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:09.843175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983299+0000","last_change":"2024-09-19T09:36:10.843617+0000","last_active":"2024-09-19T09:36:13.983299+0000","last_peered":"2024-09-19T09:36:13.983299+0000","last_clean":"2024-09-19T09:36:13.983299+0000","last_became_active":"2024-09-19T09:36:10.843211+0000","last_became_peered":"2024-09-19T09:36:10.843211+0000","last_unstale":"2024-09-19T09:36:13.983299+0000","last_undegraded":"2024-09-19T09:36:13.983299+0000","last_fullsized":"2024-09-19T09:36:13.983299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:10.137291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983051+0000","last_change":"2024-09-19T09:36:12.992456+0000","last_active":"2024-09-19T09:36:13.983051+0000","last_peered":"2024-09-19T09:36:13.983051+0000","last_clean":"2024-09-19T09:36:13.983051+0000","last_became_active":"2024-09-19T09:36:12.992119+0000","last_became_peered":"2024-09-19T09:36:12.992119+0000","last_unstale":"2024-09-19T09:36:13.983051+0000","last_undegraded":"2024-09-19T09:36:13.983051+0000","last_fullsized":"2024-09-19T09:36:13.983051+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:20.850631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"activating","last_fresh":"2024-09-19T09:37:16.032079+0000","last_change":"2024-09-19T09:37:16.032079+0000","last_active":"2024-09-19T09:37:15.027769+0000","last_peered":"2024-09-19T09:36:13.976634+0000","last_clean":"2024-09-19T09:36:13.976634+0000","last_became_active":"2024-09-19T09:36:10.839074+0000","last_became_peered":"2024-09-19T09:36:10.839074+0000","last_unstale":"2024-09-19T09:37:16.032079+0000","last_undegraded":"2024-09-19T09:37:16.032079+0000","last_fullsized":"2024-09-19T09:37:16.032079+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":["10","1","6","8"],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.970682+0000","last_change":"2024-09-19T09:36:10.837287+0000","last_active":"2024-09-19T09:36:13.970682+0000","last_peered":"2024-09-19T09:36:13.970682+0000","last_clean":"2024-09-19T09:36:13.970682+0000","last_became_active":"2024-09-19T09:36:10.836890+0000","last_became_peered":"2024-09-19T09:36:10.836890+0000","last_unstale":"2024-09-19T09:36:13.970682+0000","last_undegraded":"2024-09-19T09:36:13.970682+0000","last_fullsized":"2024-09-19T09:36:13.970682+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:09.676728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.035236+0000","last_change":"2024-09-19T09:36:12.975690+0000","last_active":"2024-09-19T09:37:15.035236+0000","last_peered":"2024-09-19T09:37:15.035236+0000","last_clean":"2024-09-19T09:37:15.035236+0000","last_became_active":"2024-09-19T09:36:12.975370+0000","last_became_peered":"2024-09-19T09:36:12.975370+0000","last_unstale":"2024-09-19T09:37:15.035236+0000","last_undegraded":"2024-09-19T09:37:15.035236+0000","last_fullsized":"2024-09-19T09:37:15.035236+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:05.650917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.984270+0000","last_change":"2024-09-19T09:36:10.843736+0000","last_active":"2024-09-19T09:36:13.984270+0000","last_peered":"2024-09-19T09:36:13.984270+0000","last_clean":"2024-09-19T09:36:13.984270+0000","last_became_active":"2024-09-19T09:36:10.843353+0000","last_became_peered":"2024-09-19T09:36:10.843353+0000","last_unstale":"2024-09-19T09:36:13.984270+0000","last_undegraded":"2024-09-19T09:36:13.984270+0000","last_fullsized":"2024-09-19T09:36:13.984270+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:29.818642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.031869+0000","last_change":"2024-09-19T09:36:12.978841+0000","last_active":"2024-09-19T09:37:15.031869+0000","last_peered":"2024-09-19T09:37:15.031869+0000","last_clean":"2024-09-19T09:37:15.031869+0000","last_became_active":"2024-09-19T09:36:12.978501+0000","last_became_peered":"2024-09-19T09:36:12.978501+0000","last_unstale":"2024-09-19T09:37:15.031869+0000","last_undegraded":"2024-09-19T09:37:15.031869+0000","last_fullsized":"2024-09-19T09:37:15.031869+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:07.974576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.032030+0000","last_change":"2024-09-19T09:36:10.841997+0000","last_active":"2024-09-19T09:37:16.032030+0000","last_peered":"2024-09-19T09:37:16.032030+0000","last_clean":"2024-09-19T09:37:16.032030+0000","last_became_active":"2024-09-19T09:36:10.841641+0000","last_became_peered":"2024-09-19T09:36:10.841641+0000","last_unstale":"2024-09-19T09:37:16.032030+0000","last_undegraded":"2024-09-19T09:37:16.032030+0000","last_fullsized":"2024-09-19T09:37:16.032030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:10.477879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.978167+0000","last_change":"2024-09-19T09:36:12.981486+0000","last_active":"2024-09-19T09:36:13.978167+0000","last_peered":"2024-09-19T09:36:13.978167+0000","last_clean":"2024-09-19T09:36:13.978167+0000","last_became_active":"2024-09-19T09:36:12.981165+0000","last_became_peered":"2024-09-19T09:36:12.981165+0000","last_unstale":"2024-09-19T09:36:13.978167+0000","last_undegraded":"2024-09-19T09:36:13.978167+0000","last_fullsized":"2024-09-19T09:36:13.978167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:21.986132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.982877+0000","last_change":"2024-09-19T09:36:10.845362+0000","last_active":"2024-09-19T09:36:13.982877+0000","last_peered":"2024-09-19T09:36:13.982877+0000","last_clean":"2024-09-19T09:36:13.982877+0000","last_became_active":"2024-09-19T09:36:10.844992+0000","last_became_peered":"2024-09-19T09:36:10.844992+0000","last_unstale":"2024-09-19T09:36:13.982877+0000","last_undegraded":"2024-09-19T09:36:13.982877+0000","last_fullsized":"2024-09-19T09:36:13.982877+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:52.854333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980323+0000","last_change":"2024-09-19T09:36:12.988924+0000","last_active":"2024-09-19T09:36:13.980323+0000","last_peered":"2024-09-19T09:36:13.980323+0000","last_clean":"2024-09-19T09:36:13.980323+0000","last_became_active":"2024-09-19T09:36:12.988331+0000","last_became_peered":"2024-09-19T09:36:12.988331+0000","last_unstale":"2024-09-19T09:36:13.980323+0000","last_undegraded":"2024-09-19T09:36:13.980323+0000","last_fullsized":"2024-09-19T09:36:13.980323+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:24.754252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.986823+0000","last_change":"2024-09-19T09:36:10.860003+0000","last_active":"2024-09-19T09:36:13.986823+0000","last_peered":"2024-09-19T09:36:13.986823+0000","last_clean":"2024-09-19T09:36:13.986823+0000","last_became_active":"2024-09-19T09:36:10.859584+0000","last_became_peered":"2024-09-19T09:36:10.859584+0000","last_unstale":"2024-09-19T09:36:13.986823+0000","last_undegraded":"2024-09-19T09:36:13.986823+0000","last_fullsized":"2024-09-19T09:36:13.986823+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:44.837960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977224+0000","last_change":"2024-09-19T09:36:12.985446+0000","last_active":"2024-09-19T09:36:13.977224+0000","last_peered":"2024-09-19T09:36:13.977224+0000","last_clean":"2024-09-19T09:36:13.977224+0000","last_became_active":"2024-09-19T09:36:12.984671+0000","last_became_peered":"2024-09-19T09:36:12.984671+0000","last_unstale":"2024-09-19T09:36:13.977224+0000","last_undegraded":"2024-09-19T09:36:13.977224+0000","last_fullsized":"2024-09-19T09:36:13.977224+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:54.800151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'27","reported_seq":166,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.032261+0000","last_change":"2024-09-19T09:36:10.841056+0000","last_active":"2024-09-19T09:37:16.032261+0000","last_peered":"2024-09-19T09:37:16.032261+0000","last_clean":"2024-09-19T09:37:16.032261+0000","last_became_active":"2024-09-19T09:36:10.840731+0000","last_became_peered":"2024-09-19T09:36:10.840731+0000","last_unstale":"2024-09-19T09:37:16.032261+0000","last_undegraded":"2024-09-19T09:37:16.032261+0000","last_fullsized":"2024-09-19T09:37:16.032261+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:13.676188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62819,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":119,"num_write":27,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.981591+0000","last_change":"2024-09-19T09:36:12.990223+0000","last_active":"2024-09-19T09:36:13.981591+0000","last_peered":"2024-09-19T09:36:13.981591+0000","last_clean":"2024-09-19T09:36:13.981591+0000","last_became_active":"2024-09-19T09:36:12.989720+0000","last_became_peered":"2024-09-19T09:36:12.989720+0000","last_unstale":"2024-09-19T09:36:13.981591+0000","last_undegraded":"2024-09-19T09:36:13.981591+0000","last_fullsized":"2024-09-19T09:36:13.981591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:37.003075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:14.496063+0000","last_change":"2024-09-19T09:36:10.843288+0000","last_active":"2024-09-19T09:36:14.496063+0000","last_peered":"2024-09-19T09:36:14.496063+0000","last_clean":"2024-09-19T09:36:14.496063+0000","last_became_active":"2024-09-19T09:36:10.842844+0000","last_became_peered":"2024-09-19T09:36:10.842844+0000","last_unstale":"2024-09-19T09:36:14.496063+0000","last_undegraded":"2024-09-19T09:36:14.496063+0000","last_fullsized":"2024-09-19T09:36:14.496063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:38.695411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.970737+0000","last_change":"2024-09-19T09:36:12.981251+0000","last_active":"2024-09-19T09:36:13.970737+0000","last_peered":"2024-09-19T09:36:13.970737+0000","last_clean":"2024-09-19T09:36:13.970737+0000","last_became_active":"2024-09-19T09:36:12.980861+0000","last_became_peered":"2024-09-19T09:36:12.980861+0000","last_unstale":"2024-09-19T09:36:13.970737+0000","last_undegraded":"2024-09-19T09:36:13.970737+0000","last_fullsized":"2024-09-19T09:36:13.970737+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:09.633644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.982414+0000","last_change":"2024-09-19T09:36:10.843448+0000","last_active":"2024-09-19T09:36:13.982414+0000","last_peered":"2024-09-19T09:36:13.982414+0000","last_clean":"2024-09-19T09:36:13.982414+0000","last_became_active":"2024-09-19T09:36:10.843087+0000","last_became_peered":"2024-09-19T09:36:10.843087+0000","last_unstale":"2024-09-19T09:36:13.982414+0000","last_undegraded":"2024-09-19T09:36:13.982414+0000","last_fullsized":"2024-09-19T09:36:13.982414+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:20.623613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.982971+0000","last_change":"2024-09-19T09:36:12.981160+0000","last_active":"2024-09-19T09:36:13.982971+0000","last_peered":"2024-09-19T09:36:13.982971+0000","last_clean":"2024-09-19T09:36:13.982971+0000","last_became_active":"2024-09-19T09:36:12.980823+0000","last_became_peered":"2024-09-19T09:36:12.980823+0000","last_unstale":"2024-09-19T09:36:13.982971+0000","last_undegraded":"2024-09-19T09:36:13.982971+0000","last_fullsized":"2024-09-19T09:36:13.982971+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:39.323439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980537+0000","last_change":"2024-09-19T09:36:10.842536+0000","last_active":"2024-09-19T09:36:13.980537+0000","last_peered":"2024-09-19T09:36:13.980537+0000","last_clean":"2024-09-19T09:36:13.980537+0000","last_became_active":"2024-09-19T09:36:10.842176+0000","last_became_peered":"2024-09-19T09:36:10.842176+0000","last_unstale":"2024-09-19T09:36:13.980537+0000","last_undegraded":"2024-09-19T09:36:13.980537+0000","last_fullsized":"2024-09-19T09:36:13.980537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:37.871299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.982395+0000","last_change":"2024-09-19T09:36:12.987271+0000","last_active":"2024-09-19T09:36:13.982395+0000","last_peered":"2024-09-19T09:36:13.982395+0000","last_clean":"2024-09-19T09:36:13.982395+0000","last_became_active":"2024-09-19T09:36:12.986918+0000","last_became_peered":"2024-09-19T09:36:12.986918+0000","last_unstale":"2024-09-19T09:36:13.982395+0000","last_undegraded":"2024-09-19T09:36:13.982395+0000","last_fullsized":"2024-09-19T09:36:13.982395+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:07.608541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.989197+0000","last_change":"2024-09-19T09:36:10.860370+0000","last_active":"2024-09-19T09:36:13.989197+0000","last_peered":"2024-09-19T09:36:13.989197+0000","last_clean":"2024-09-19T09:36:13.989197+0000","last_became_active":"2024-09-19T09:36:10.859820+0000","last_became_peered":"2024-09-19T09:36:10.859820+0000","last_unstale":"2024-09-19T09:36:13.989197+0000","last_undegraded":"2024-09-19T09:36:13.989197+0000","last_fullsized":"2024-09-19T09:36:13.989197+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:12.121038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.984738+0000","last_change":"2024-09-19T09:36:12.994449+0000","last_active":"2024-09-19T09:36:13.984738+0000","last_peered":"2024-09-19T09:36:13.984738+0000","last_clean":"2024-09-19T09:36:13.984738+0000","last_became_active":"2024-09-19T09:36:12.994141+0000","last_became_peered":"2024-09-19T09:36:12.994141+0000","last_unstale":"2024-09-19T09:36:13.984738+0000","last_undegraded":"2024-09-19T09:36:13.984738+0000","last_fullsized":"2024-09-19T09:36:13.984738+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:21.416453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:14.710833+0000","last_change":"2024-09-19T09:36:10.839609+0000","last_active":"2024-09-19T09:36:14.710833+0000","last_peered":"2024-09-19T09:36:14.710833+0000","last_clean":"2024-09-19T09:36:14.710833+0000","last_became_active":"2024-09-19T09:36:10.839227+0000","last_became_peered":"2024-09-19T09:36:10.839227+0000","last_unstale":"2024-09-19T09:36:14.710833+0000","last_undegraded":"2024-09-19T09:36:14.710833+0000","last_fullsized":"2024-09-19T09:36:14.710833+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:00.734924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971232+0000","last_change":"2024-09-19T09:36:12.983573+0000","last_active":"2024-09-19T09:36:13.971232+0000","last_peered":"2024-09-19T09:36:13.971232+0000","last_clean":"2024-09-19T09:36:13.971232+0000","last_became_active":"2024-09-19T09:36:12.983241+0000","last_became_peered":"2024-09-19T09:36:12.983241+0000","last_unstale":"2024-09-19T09:36:13.971232+0000","last_undegraded":"2024-09-19T09:36:13.971232+0000","last_fullsized":"2024-09-19T09:36:13.971232+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:44.050271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.981922+0000","last_change":"2024-09-19T09:36:10.839789+0000","last_active":"2024-09-19T09:36:13.981922+0000","last_peered":"2024-09-19T09:36:13.981922+0000","last_clean":"2024-09-19T09:36:13.981922+0000","last_became_active":"2024-09-19T09:36:10.839445+0000","last_became_peered":"2024-09-19T09:36:10.839445+0000","last_unstale":"2024-09-19T09:36:13.981922+0000","last_undegraded":"2024-09-19T09:36:13.981922+0000","last_fullsized":"2024-09-19T09:36:13.981922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:16.040249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.984009+0000","last_change":"2024-09-19T09:36:12.993420+0000","last_active":"2024-09-19T09:36:13.984009+0000","last_peered":"2024-09-19T09:36:13.984009+0000","last_clean":"2024-09-19T09:36:13.984009+0000","last_became_active":"2024-09-19T09:36:12.992334+0000","last_became_peered":"2024-09-19T09:36:12.992334+0000","last_unstale":"2024-09-19T09:36:13.984009+0000","last_undegraded":"2024-09-19T09:36:13.984009+0000","last_fullsized":"2024-09-19T09:36:13.984009+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:21.693164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.987081+0000","last_change":"2024-09-19T09:36:10.839461+0000","last_active":"2024-09-19T09:36:13.987081+0000","last_peered":"2024-09-19T09:36:13.987081+0000","last_clean":"2024-09-19T09:36:13.987081+0000","last_became_active":"2024-09-19T09:36:10.839092+0000","last_became_peered":"2024-09-19T09:36:10.839092+0000","last_unstale":"2024-09-19T09:36:13.987081+0000","last_undegraded":"2024-09-19T09:36:13.987081+0000","last_fullsized":"2024-09-19T09:36:13.987081+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:02.367267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:14.080586+0000","last_change":"2024-09-19T09:36:12.988234+0000","last_active":"2024-09-19T09:36:14.080586+0000","last_peered":"2024-09-19T09:36:14.080586+0000","last_clean":"2024-09-19T09:36:14.080586+0000","last_became_active":"2024-09-19T09:36:12.987813+0000","last_became_peered":"2024-09-19T09:36:12.987813+0000","last_unstale":"2024-09-19T09:36:14.080586+0000","last_undegraded":"2024-09-19T09:36:14.080586+0000","last_fullsized":"2024-09-19T09:36:14.080586+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:56.024428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.981458+0000","last_change":"2024-09-19T09:36:10.945705+0000","last_active":"2024-09-19T09:36:13.981458+0000","last_peered":"2024-09-19T09:36:13.981458+0000","last_clean":"2024-09-19T09:36:13.981458+0000","last_became_active":"2024-09-19T09:36:10.945323+0000","last_became_peered":"2024-09-19T09:36:10.945323+0000","last_unstale":"2024-09-19T09:36:13.981458+0000","last_undegraded":"2024-09-19T09:36:13.981458+0000","last_fullsized":"2024-09-19T09:36:13.981458+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:24.211909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983646+0000","last_change":"2024-09-19T09:36:12.990517+0000","last_active":"2024-09-19T09:36:13.983646+0000","last_peered":"2024-09-19T09:36:13.983646+0000","last_clean":"2024-09-19T09:36:13.983646+0000","last_became_active":"2024-09-19T09:36:12.989291+0000","last_became_peered":"2024-09-19T09:36:12.989291+0000","last_unstale":"2024-09-19T09:36:13.983646+0000","last_undegraded":"2024-09-19T09:36:13.983646+0000","last_fullsized":"2024-09-19T09:36:13.983646+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:31.087798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":334,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.982963+0000","last_change":"2024-09-19T09:34:59.337025+0000","last_active":"2024-09-19T09:36:13.982963+0000","last_peered":"2024-09-19T09:36:13.982963+0000","last_clean":"2024-09-19T09:36:13.982963+0000","last_became_active":"2024-09-19T09:34:59.336556+0000","last_became_peered":"2024-09-19T09:34:59.336556+0000","last_unstale":"2024-09-19T09:36:13.982963+0000","last_undegraded":"2024-09-19T09:36:13.982963+0000","last_fullsized":"2024-09-19T09:36:13.982963+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:31:30.566923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:31:30.566923+0000","last_clean_scrub_stamp":"2024-09-19T09:31:30.566923+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:00.675254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980632+0000","last_change":"2024-09-19T09:36:10.838131+0000","last_active":"2024-09-19T09:36:13.980632+0000","last_peered":"2024-09-19T09:36:13.980632+0000","last_clean":"2024-09-19T09:36:13.980632+0000","last_became_active":"2024-09-19T09:36:10.837725+0000","last_became_peered":"2024-09-19T09:36:10.837725+0000","last_unstale":"2024-09-19T09:36:13.980632+0000","last_undegraded":"2024-09-19T09:36:13.980632+0000","last_fullsized":"2024-09-19T09:36:13.980632+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:57.104726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.035242+0000","last_change":"2024-09-19T09:36:12.981951+0000","last_active":"2024-09-19T09:37:15.035242+0000","last_peered":"2024-09-19T09:37:15.035242+0000","last_clean":"2024-09-19T09:37:15.035242+0000","last_became_active":"2024-09-19T09:36:12.981558+0000","last_became_peered":"2024-09-19T09:36:12.981558+0000","last_unstale":"2024-09-19T09:37:15.035242+0000","last_undegraded":"2024-09-19T09:37:15.035242+0000","last_fullsized":"2024-09-19T09:37:15.035242+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:31.119853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983301+0000","last_change":"2024-09-19T09:36:10.843574+0000","last_active":"2024-09-19T09:36:13.983301+0000","last_peered":"2024-09-19T09:36:13.983301+0000","last_clean":"2024-09-19T09:36:13.983301+0000","last_became_active":"2024-09-19T09:36:10.843252+0000","last_became_peered":"2024-09-19T09:36:10.843252+0000","last_unstale":"2024-09-19T09:36:13.983301+0000","last_undegraded":"2024-09-19T09:36:13.983301+0000","last_fullsized":"2024-09-19T09:36:13.983301+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:10.492812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.970701+0000","last_change":"2024-09-19T09:36:12.984538+0000","last_active":"2024-09-19T09:36:13.970701+0000","last_peered":"2024-09-19T09:36:13.970701+0000","last_clean":"2024-09-19T09:36:13.970701+0000","last_became_active":"2024-09-19T09:36:12.983448+0000","last_became_peered":"2024-09-19T09:36:12.983448+0000","last_unstale":"2024-09-19T09:36:13.970701+0000","last_undegraded":"2024-09-19T09:36:13.970701+0000","last_fullsized":"2024-09-19T09:36:13.970701+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:48.294473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.970841+0000","last_change":"2024-09-19T09:36:10.858959+0000","last_active":"2024-09-19T09:36:13.970841+0000","last_peered":"2024-09-19T09:36:13.970841+0000","last_clean":"2024-09-19T09:36:13.970841+0000","last_became_active":"2024-09-19T09:36:10.858638+0000","last_became_peered":"2024-09-19T09:36:10.858638+0000","last_unstale":"2024-09-19T09:36:13.970841+0000","last_undegraded":"2024-09-19T09:36:13.970841+0000","last_fullsized":"2024-09-19T09:36:13.970841+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:12.646483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.984042+0000","last_change":"2024-09-19T09:36:12.992710+0000","last_active":"2024-09-19T09:36:13.984042+0000","last_peered":"2024-09-19T09:36:13.984042+0000","last_clean":"2024-09-19T09:36:13.984042+0000","last_became_active":"2024-09-19T09:36:12.992436+0000","last_became_peered":"2024-09-19T09:36:12.992436+0000","last_unstale":"2024-09-19T09:36:13.984042+0000","last_undegraded":"2024-09-19T09:36:13.984042+0000","last_fullsized":"2024-09-19T09:36:13.984042+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:51.685516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983385+0000","last_change":"2024-09-19T09:36:10.842031+0000","last_active":"2024-09-19T09:36:13.983385+0000","last_peered":"2024-09-19T09:36:13.983385+0000","last_clean":"2024-09-19T09:36:13.983385+0000","last_became_active":"2024-09-19T09:36:10.841693+0000","last_became_peered":"2024-09-19T09:36:10.841693+0000","last_unstale":"2024-09-19T09:36:13.983385+0000","last_undegraded":"2024-09-19T09:36:13.983385+0000","last_fullsized":"2024-09-19T09:36:13.983385+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:28:51.040551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034026+0000","last_change":"2024-09-19T09:37:16.034026+0000","last_active":"2024-09-19T09:37:16.034026+0000","last_peered":"2024-09-19T09:37:16.034026+0000","last_clean":"2024-09-19T09:37:16.034026+0000","last_became_active":"2024-09-19T09:37:16.033546+0000","last_became_peered":"2024-09-19T09:37:16.033546+0000","last_unstale":"2024-09-19T09:37:16.034026+0000","last_undegraded":"2024-09-19T09:37:16.034026+0000","last_fullsized":"2024-09-19T09:37:16.034026+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:42.673825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.034661+0000","last_change":"2024-09-19T09:36:10.860470+0000","last_active":"2024-09-19T09:37:15.034661+0000","last_peered":"2024-09-19T09:37:15.034661+0000","last_clean":"2024-09-19T09:37:15.034661+0000","last_became_active":"2024-09-19T09:36:10.860097+0000","last_became_peered":"2024-09-19T09:36:10.860097+0000","last_unstale":"2024-09-19T09:37:15.034661+0000","last_undegraded":"2024-09-19T09:37:15.034661+0000","last_fullsized":"2024-09-19T09:37:15.034661+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:14.933378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031415+0000","last_change":"2024-09-19T09:36:12.988489+0000","last_active":"2024-09-19T09:37:16.031415+0000","last_peered":"2024-09-19T09:37:16.031415+0000","last_clean":"2024-09-19T09:37:16.031415+0000","last_became_active":"2024-09-19T09:36:12.988151+0000","last_became_peered":"2024-09-19T09:36:12.988151+0000","last_unstale":"2024-09-19T09:37:16.031415+0000","last_undegraded":"2024-09-19T09:37:16.031415+0000","last_fullsized":"2024-09-19T09:37:16.031415+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:24.088771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.981909+0000","last_change":"2024-09-19T09:36:10.860103+0000","last_active":"2024-09-19T09:36:13.981909+0000","last_peered":"2024-09-19T09:36:13.981909+0000","last_clean":"2024-09-19T09:36:13.981909+0000","last_became_active":"2024-09-19T09:36:10.859526+0000","last_became_peered":"2024-09-19T09:36:10.859526+0000","last_unstale":"2024-09-19T09:36:13.981909+0000","last_undegraded":"2024-09-19T09:36:13.981909+0000","last_fullsized":"2024-09-19T09:36:13.981909+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:25.460372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971039+0000","last_change":"2024-09-19T09:36:12.986286+0000","last_active":"2024-09-19T09:36:13.971039+0000","last_peered":"2024-09-19T09:36:13.971039+0000","last_clean":"2024-09-19T09:36:13.971039+0000","last_became_active":"2024-09-19T09:36:12.985982+0000","last_became_peered":"2024-09-19T09:36:12.985982+0000","last_unstale":"2024-09-19T09:36:13.971039+0000","last_undegraded":"2024-09-19T09:36:13.971039+0000","last_fullsized":"2024-09-19T09:36:13.971039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:19.026134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'10","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.034658+0000","last_change":"2024-09-19T09:36:10.839280+0000","last_active":"2024-09-19T09:37:15.034658+0000","last_peered":"2024-09-19T09:37:15.034658+0000","last_clean":"2024-09-19T09:37:15.034658+0000","last_became_active":"2024-09-19T09:36:10.838979+0000","last_became_peered":"2024-09-19T09:36:10.838979+0000","last_unstale":"2024-09-19T09:37:15.034658+0000","last_undegraded":"2024-09-19T09:37:15.034658+0000","last_fullsized":"2024-09-19T09:37:15.034658+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:06.303175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.035898+0000","last_change":"2024-09-19T09:36:12.979778+0000","last_active":"2024-09-19T09:37:15.035898+0000","last_peered":"2024-09-19T09:37:15.035898+0000","last_clean":"2024-09-19T09:37:15.035898+0000","last_became_active":"2024-09-19T09:36:12.979455+0000","last_became_peered":"2024-09-19T09:36:12.979455+0000","last_unstale":"2024-09-19T09:37:15.035898+0000","last_undegraded":"2024-09-19T09:37:15.035898+0000","last_fullsized":"2024-09-19T09:37:15.035898+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:36.620368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983429+0000","last_change":"2024-09-19T09:36:10.945706+0000","last_active":"2024-09-19T09:36:13.983429+0000","last_peered":"2024-09-19T09:36:13.983429+0000","last_clean":"2024-09-19T09:36:13.983429+0000","last_became_active":"2024-09-19T09:36:10.945314+0000","last_became_peered":"2024-09-19T09:36:10.945314+0000","last_unstale":"2024-09-19T09:36:13.983429+0000","last_undegraded":"2024-09-19T09:36:13.983429+0000","last_fullsized":"2024-09-19T09:36:13.983429+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:49.786913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979575+0000","last_change":"2024-09-19T09:36:12.989412+0000","last_active":"2024-09-19T09:36:13.979575+0000","last_peered":"2024-09-19T09:36:13.979575+0000","last_clean":"2024-09-19T09:36:13.979575+0000","last_became_active":"2024-09-19T09:36:12.989109+0000","last_became_peered":"2024-09-19T09:36:12.989109+0000","last_unstale":"2024-09-19T09:36:13.979575+0000","last_undegraded":"2024-09-19T09:36:13.979575+0000","last_fullsized":"2024-09-19T09:36:13.979575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:33.142592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977297+0000","last_change":"2024-09-19T09:36:10.858581+0000","last_active":"2024-09-19T09:36:13.977297+0000","last_peered":"2024-09-19T09:36:13.977297+0000","last_clean":"2024-09-19T09:36:13.977297+0000","last_became_active":"2024-09-19T09:36:10.858240+0000","last_became_peered":"2024-09-19T09:36:10.858240+0000","last_unstale":"2024-09-19T09:36:13.977297+0000","last_undegraded":"2024-09-19T09:36:13.977297+0000","last_fullsized":"2024-09-19T09:36:13.977297+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:45.285839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979917+0000","last_change":"2024-09-19T09:36:12.989075+0000","last_active":"2024-09-19T09:36:13.979917+0000","last_peered":"2024-09-19T09:36:13.979917+0000","last_clean":"2024-09-19T09:36:13.979917+0000","last_became_active":"2024-09-19T09:36:12.988752+0000","last_became_peered":"2024-09-19T09:36:12.988752+0000","last_unstale":"2024-09-19T09:36:13.979917+0000","last_undegraded":"2024-09-19T09:36:13.979917+0000","last_fullsized":"2024-09-19T09:36:13.979917+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.424032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.034798+0000","last_change":"2024-09-19T09:36:10.838716+0000","last_active":"2024-09-19T09:37:15.034798+0000","last_peered":"2024-09-19T09:37:15.034798+0000","last_clean":"2024-09-19T09:37:15.034798+0000","last_became_active":"2024-09-19T09:36:10.838393+0000","last_became_peered":"2024-09-19T09:36:10.838393+0000","last_unstale":"2024-09-19T09:37:15.034798+0000","last_undegraded":"2024-09-19T09:37:15.034798+0000","last_fullsized":"2024-09-19T09:37:15.034798+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:54.107223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971121+0000","last_change":"2024-09-19T09:36:12.991721+0000","last_active":"2024-09-19T09:36:13.971121+0000","last_peered":"2024-09-19T09:36:13.971121+0000","last_clean":"2024-09-19T09:36:13.971121+0000","last_became_active":"2024-09-19T09:36:12.991398+0000","last_became_peered":"2024-09-19T09:36:12.991398+0000","last_unstale":"2024-09-19T09:36:13.971121+0000","last_undegraded":"2024-09-19T09:36:13.971121+0000","last_fullsized":"2024-09-19T09:36:13.971121+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:19:31.312072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979724+0000","last_change":"2024-09-19T09:36:10.839625+0000","last_active":"2024-09-19T09:36:13.979724+0000","last_peered":"2024-09-19T09:36:13.979724+0000","last_clean":"2024-09-19T09:36:13.979724+0000","last_became_active":"2024-09-19T09:36:10.839255+0000","last_became_peered":"2024-09-19T09:36:10.839255+0000","last_unstale":"2024-09-19T09:36:13.979724+0000","last_undegraded":"2024-09-19T09:36:13.979724+0000","last_fullsized":"2024-09-19T09:36:13.979724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:37.221951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.035663+0000","last_change":"2024-09-19T09:36:12.984180+0000","last_active":"2024-09-19T09:37:15.035663+0000","last_peered":"2024-09-19T09:37:15.035663+0000","last_clean":"2024-09-19T09:37:15.035663+0000","last_became_active":"2024-09-19T09:36:12.983876+0000","last_became_peered":"2024-09-19T09:36:12.983876+0000","last_unstale":"2024-09-19T09:37:15.035663+0000","last_undegraded":"2024-09-19T09:37:15.035663+0000","last_fullsized":"2024-09-19T09:37:15.035663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:45.876771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:14.710787+0000","last_change":"2024-09-19T09:36:10.845391+0000","last_active":"2024-09-19T09:36:14.710787+0000","last_peered":"2024-09-19T09:36:14.710787+0000","last_clean":"2024-09-19T09:36:14.710787+0000","last_became_active":"2024-09-19T09:36:10.844974+0000","last_became_peered":"2024-09-19T09:36:10.844974+0000","last_unstale":"2024-09-19T09:36:14.710787+0000","last_undegraded":"2024-09-19T09:36:14.710787+0000","last_fullsized":"2024-09-19T09:36:14.710787+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:00.318337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983307+0000","last_change":"2024-09-19T09:36:12.991145+0000","last_active":"2024-09-19T09:36:13.983307+0000","last_peered":"2024-09-19T09:36:13.983307+0000","last_clean":"2024-09-19T09:36:13.983307+0000","last_became_active":"2024-09-19T09:36:12.989891+0000","last_became_peered":"2024-09-19T09:36:12.989891+0000","last_unstale":"2024-09-19T09:36:13.983307+0000","last_undegraded":"2024-09-19T09:36:13.983307+0000","last_fullsized":"2024-09-19T09:36:13.983307+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:21.054936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.982316+0000","last_change":"2024-09-19T09:36:12.995378+0000","last_active":"2024-09-19T09:36:13.982316+0000","last_peered":"2024-09-19T09:36:13.982316+0000","last_clean":"2024-09-19T09:36:13.982316+0000","last_became_active":"2024-09-19T09:36:12.995028+0000","last_became_peered":"2024-09-19T09:36:12.995028+0000","last_unstale":"2024-09-19T09:36:13.982316+0000","last_undegraded":"2024-09-19T09:36:13.982316+0000","last_fullsized":"2024-09-19T09:36:13.982316+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:41.102130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.987910+0000","last_change":"2024-09-19T09:36:10.839595+0000","last_active":"2024-09-19T09:36:13.987910+0000","last_peered":"2024-09-19T09:36:13.987910+0000","last_clean":"2024-09-19T09:36:13.987910+0000","last_became_active":"2024-09-19T09:36:10.839196+0000","last_became_peered":"2024-09-19T09:36:10.839196+0000","last_unstale":"2024-09-19T09:36:13.987910+0000","last_undegraded":"2024-09-19T09:36:13.987910+0000","last_fullsized":"2024-09-19T09:36:13.987910+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:02.272731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977120+0000","last_change":"2024-09-19T09:36:12.984485+0000","last_active":"2024-09-19T09:36:13.977120+0000","last_peered":"2024-09-19T09:36:13.977120+0000","last_clean":"2024-09-19T09:36:13.977120+0000","last_became_active":"2024-09-19T09:36:12.984004+0000","last_became_peered":"2024-09-19T09:36:12.984004+0000","last_unstale":"2024-09-19T09:36:13.977120+0000","last_undegraded":"2024-09-19T09:36:13.977120+0000","last_fullsized":"2024-09-19T09:36:13.977120+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:37.646776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.988493+0000","last_change":"2024-09-19T09:36:10.845306+0000","last_active":"2024-09-19T09:36:13.988493+0000","last_peered":"2024-09-19T09:36:13.988493+0000","last_clean":"2024-09-19T09:36:13.988493+0000","last_became_active":"2024-09-19T09:36:10.844952+0000","last_became_peered":"2024-09-19T09:36:10.844952+0000","last_unstale":"2024-09-19T09:36:13.988493+0000","last_undegraded":"2024-09-19T09:36:13.988493+0000","last_fullsized":"2024-09-19T09:36:13.988493+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:09.792482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980247+0000","last_change":"2024-09-19T09:36:12.991260+0000","last_active":"2024-09-19T09:36:13.980247+0000","last_peered":"2024-09-19T09:36:13.980247+0000","last_clean":"2024-09-19T09:36:13.980247+0000","last_became_active":"2024-09-19T09:36:12.989981+0000","last_became_peered":"2024-09-19T09:36:12.989981+0000","last_unstale":"2024-09-19T09:36:13.980247+0000","last_undegraded":"2024-09-19T09:36:13.980247+0000","last_fullsized":"2024-09-19T09:36:13.980247+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:11.301790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.035873+0000","last_change":"2024-09-19T09:36:10.859016+0000","last_active":"2024-09-19T09:37:15.035873+0000","last_peered":"2024-09-19T09:37:15.035873+0000","last_clean":"2024-09-19T09:37:15.035873+0000","last_became_active":"2024-09-19T09:36:10.858661+0000","last_became_peered":"2024-09-19T09:36:10.858661+0000","last_unstale":"2024-09-19T09:37:15.035873+0000","last_undegraded":"2024-09-19T09:37:15.035873+0000","last_fullsized":"2024-09-19T09:37:15.035873+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:54.395977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":2,"reported_epoch":82,"state":"peering","last_fresh":"2024-09-19T09:36:12.968664+0000","last_change":"2024-09-19T09:37:15.103207+0000","last_active":"2024-09-19T09:36:11.954784+0000","last_peered":"2024-09-19T09:36:11.954784+0000","last_clean":"2024-09-19T09:36:11.954784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:36:12.968664+0000","last_undegraded":"2024-09-19T09:36:12.968664+0000","last_fullsized":"2024-09-19T09:36:12.968664+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":24,"reported_epoch":81,"state":"peering","last_fresh":"2024-09-19T09:36:22.011606+0000","last_change":"2024-09-19T09:37:15.033807+0000","last_active":"2024-09-19T09:37:15.033807+0000","last_peered":"2024-09-19T09:36:22.011606+0000","last_clean":"2024-09-19T09:36:22.011606+0000","last_became_active":"2024-09-19T09:36:10.840233+0000","last_became_peered":"2024-09-19T09:36:10.840233+0000","last_unstale":"2024-09-19T09:36:22.011606+0000","last_undegraded":"2024-09-19T09:36:22.011606+0000","last_fullsized":"2024-09-19T09:36:22.011606+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7,8,11],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63617,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":123,"num_read_kb":125,"num_write":84,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":190851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":69,"ondisk_log_size":69,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282954,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547226,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":872448,"data_stored":423919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776160,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1024000,"data_stored":1086118,"data_compressed":38912,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972389,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36200,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708952,"statfs":{"total":95995035648,"available":95957966848,"internally_reserved":0,"allocated":876544,"data_stored":424501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201321,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":424523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430255,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":1014986,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593780,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36200,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708952,"statfs":{"total":95995035648,"available":95957966848,"internally_reserved":0,"allocated":876544,"data_stored":424036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822713,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":937984,"data_stored":1014586,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953534,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":876544,"data_stored":423941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215172,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":901120,"data_stored":432958,"data_compressed":2927,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444104,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36272,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708880,"statfs":{"total":95995035648,"available":95957893120,"internally_reserved":0,"allocated":950272,"data_stored":486772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36268,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708884,"statfs":{"total":95995035648,"available":95957897216,"internally_reserved":0,"allocated":946176,"data_stored":486738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":876544,"data_stored":424009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":62853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:37:18.434 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:37:18.699 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:19.098 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:19 smithi001 ceph-mon[31225]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:37:19.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.177+0000 7f5629335640 1 -- 172.21.15.1:0/1567207053 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5624102ef0 msgr2=0x7f562410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:19.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.177+0000 7f5629335640 1 --2- 172.21.15.1:0/1567207053 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5624102ef0 0x7f562410da40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5614009ca0 tx=0x7f561402a950 comp rx=0 tx=0).stop 2024-09-19T09:37:19.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.177+0000 7f5629335640 1 -- 172.21.15.1:0/1567207053 shutdown_connections 2024-09-19T09:37:19.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.177+0000 7f5629335640 1 --2- 172.21.15.1:0/1567207053 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5624102ef0 0x7f562410da40 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:19.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.177+0000 7f5629335640 1 --2- 172.21.15.1:0/1567207053 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5624102570 0x7f56241029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:19.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.177+0000 7f5629335640 1 --2- 172.21.15.1:0/1567207053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5624100e20 0x7f5624101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:19.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.177+0000 7f5629335640 1 -- 172.21.15.1:0/1567207053 >> 172.21.15.1:0/1567207053 conn(0x7f56240fc7d0 msgr2=0x7f56240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:19.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.177+0000 7f5629335640 1 -- 172.21.15.1:0/1567207053 shutdown_connections 2024-09-19T09:37:19.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.177+0000 7f5629335640 1 -- 172.21.15.1:0/1567207053 wait complete. 2024-09-19T09:37:19.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.178+0000 7f5629335640 1 Processor -- start 2024-09-19T09:37:19.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.178+0000 7f5629335640 1 -- start start 2024-09-19T09:37:19.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.178+0000 7f5629335640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5624100e20 0x7f5624198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:19.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.179+0000 7f5629335640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5624102570 0x7f56241989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:19.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.179+0000 7f5629335640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5624102ef0 0x7f562419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:19.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.179+0000 7f5629335640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5624110f80 con 0x7f5624100e20 2024-09-19T09:37:19.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.179+0000 7f5629335640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5624110e00 con 0x7f5624102ef0 2024-09-19T09:37:19.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.179+0000 7f5629335640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5624111100 con 0x7f5624102570 2024-09-19T09:37:19.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.179+0000 7f5622ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5624100e20 0x7f5624198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:19.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.179+0000 7f5622ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5624100e20 0x7f5624198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43968/0 (socket says 172.21.15.1:43968) 2024-09-19T09:37:19.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.179+0000 7f5622ffd640 1 -- 172.21.15.1:0/1540138489 learned_addr learned my addr 172.21.15.1:0/1540138489 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:19.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.179+0000 7f56227fc640 1 --2- 172.21.15.1:0/1540138489 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5624102570 0x7f56241989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:19.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.179+0000 7f56237fe640 1 --2- 172.21.15.1:0/1540138489 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5624102ef0 0x7f562419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:19.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.179+0000 7f5622ffd640 1 -- 172.21.15.1:0/1540138489 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5624102570 msgr2=0x7f56241989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:19.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.179+0000 7f5622ffd640 1 --2- 172.21.15.1:0/1540138489 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5624102570 0x7f56241989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:19.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.179+0000 7f5622ffd640 1 -- 172.21.15.1:0/1540138489 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5624102ef0 msgr2=0x7f562419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:19.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.179+0000 7f5622ffd640 1 --2- 172.21.15.1:0/1540138489 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5624102ef0 0x7f562419cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:19.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.179+0000 7f5622ffd640 1 -- 172.21.15.1:0/1540138489 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f562419d420 con 0x7f5624100e20 2024-09-19T09:37:19.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.179+0000 7f56227fc640 1 --2- 172.21.15.1:0/1540138489 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5624102570 0x7f56241989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:19.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.179+0000 7f5622ffd640 1 --2- 172.21.15.1:0/1540138489 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5624100e20 0x7f5624198470 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f561c00d950 tx=0x7f561c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:19.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.179+0000 7f561bfff640 1 -- 172.21.15.1:0/1540138489 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561c017070 con 0x7f5624100e20 2024-09-19T09:37:19.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.179+0000 7f5629335640 1 -- 172.21.15.1:0/1540138489 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f562419d710 con 0x7f5624100e20 2024-09-19T09:37:19.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.179+0000 7f561bfff640 1 -- 172.21.15.1:0/1540138489 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f561c009c30 con 0x7f5624100e20 2024-09-19T09:37:19.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.179+0000 7f561bfff640 1 -- 172.21.15.1:0/1540138489 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561c00f6b0 con 0x7f5624100e20 2024-09-19T09:37:19.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.179+0000 7f5629335640 1 -- 172.21.15.1:0/1540138489 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56241a4ff0 con 0x7f5624100e20 2024-09-19T09:37:19.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.180+0000 7f5629335640 1 -- 172.21.15.1:0/1540138489 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5624101200 con 0x7f5624100e20 2024-09-19T09:37:19.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.182+0000 7f561bfff640 1 -- 172.21.15.1:0/1540138489 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f561c0109d0 con 0x7f5624100e20 2024-09-19T09:37:19.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.182+0000 7f561bfff640 1 --2- 172.21.15.1:0/1540138489 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f56100a32d0 0x7f56100a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:19.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.183+0000 7f56227fc640 1 --2- 172.21.15.1:0/1540138489 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f56100a32d0 0x7f56100a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:19.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.183+0000 7f561bfff640 1 -- 172.21.15.1:0/1540138489 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f561c0cfaf0 con 0x7f5624100e20 2024-09-19T09:37:19.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.183+0000 7f56227fc640 1 --2- 172.21.15.1:0/1540138489 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f56100a32d0 0x7f56100a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f560c005fd0 tx=0x7f560c005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:19.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.186+0000 7f561bfff640 1 -- 172.21.15.1:0/1540138489 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f561c009de0 con 0x7f5624100e20 2024-09-19T09:37:19.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.356+0000 7f5629335640 1 -- 172.21.15.1:0/1540138489 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5624062630 con 0x7f56100a32d0 2024-09-19T09:37:19.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.362+0000 7f561bfff640 1 -- 172.21.15.1:0/1540138489 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258709 (secure 0 0 0) 0x7f5624062630 con 0x7f56100a32d0 2024-09-19T09:37:19.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:19 smithi022 ceph-mon[35583]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:37:19.366 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:37:19.367 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-19T09:37:19.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.366+0000 7f5629335640 1 -- 172.21.15.1:0/1540138489 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f56100a32d0 msgr2=0x7f56100a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:19.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.366+0000 7f5629335640 1 --2- 172.21.15.1:0/1540138489 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f56100a32d0 0x7f56100a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f560c005fd0 tx=0x7f560c005ea0 comp rx=0 tx=0).stop 2024-09-19T09:37:19.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.366+0000 7f5629335640 1 -- 172.21.15.1:0/1540138489 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5624100e20 msgr2=0x7f5624198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:19.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.366+0000 7f5629335640 1 --2- 172.21.15.1:0/1540138489 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5624100e20 0x7f5624198470 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f561c00d950 tx=0x7f561c00de10 comp rx=0 tx=0).stop 2024-09-19T09:37:19.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.366+0000 7f5629335640 1 -- 172.21.15.1:0/1540138489 shutdown_connections 2024-09-19T09:37:19.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.366+0000 7f5629335640 1 --2- 172.21.15.1:0/1540138489 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f56100a32d0 0x7f56100a5790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:19.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.366+0000 7f5629335640 1 --2- 172.21.15.1:0/1540138489 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5624102ef0 0x7f562419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:19.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.366+0000 7f5629335640 1 --2- 172.21.15.1:0/1540138489 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5624102570 0x7f56241989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:19.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.366+0000 7f5629335640 1 --2- 172.21.15.1:0/1540138489 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5624100e20 0x7f5624198470 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:19.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.366+0000 7f5629335640 1 -- 172.21.15.1:0/1540138489 >> 172.21.15.1:0/1540138489 conn(0x7f56240fc7d0 msgr2=0x7f562406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:19.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.366+0000 7f5629335640 1 -- 172.21.15.1:0/1540138489 shutdown_connections 2024-09-19T09:37:19.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:19.366+0000 7f5629335640 1 -- 172.21.15.1:0/1540138489 wait complete. 2024-09-19T09:37:19.370 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:19 smithi121 ceph-mon[35577]: from='client.14904 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:37:19.996 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":315,"stamp":"2024-09-19T09:37:18.146131+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654219,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":249,"num_read_kb":234,"num_write":267,"num_write_kb":3027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":293,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":405808,"kb_used_data":10768,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124536016,"statfs":{"total":1151940427776,"available":1151524880384,"internally_reserved":0,"allocated":11026432,"data_stored":7119212,"data_compressed":131410,"data_compressed_allocated":167936,"data_compressed_original":1835008,"omap_allocated":19141,"internal_metadata":404272443},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002192"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.033174+0000","last_change":"2024-09-19T09:36:12.985228+0000","last_active":"2024-09-19T09:37:16.033174+0000","last_peered":"2024-09-19T09:37:16.033174+0000","last_clean":"2024-09-19T09:37:16.033174+0000","last_became_active":"2024-09-19T09:36:12.984306+0000","last_became_peered":"2024-09-19T09:36:12.984306+0000","last_unstale":"2024-09-19T09:37:16.033174+0000","last_undegraded":"2024-09-19T09:37:16.033174+0000","last_fullsized":"2024-09-19T09:37:16.033174+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:45.988859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979575+0000","last_change":"2024-09-19T09:36:12.987631+0000","last_active":"2024-09-19T09:36:13.979575+0000","last_peered":"2024-09-19T09:36:13.979575+0000","last_clean":"2024-09-19T09:36:13.979575+0000","last_became_active":"2024-09-19T09:36:12.987298+0000","last_became_peered":"2024-09-19T09:36:12.987298+0000","last_unstale":"2024-09-19T09:36:13.979575+0000","last_undegraded":"2024-09-19T09:36:13.979575+0000","last_fullsized":"2024-09-19T09:36:13.979575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:47.397162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979729+0000","last_change":"2024-09-19T09:36:12.991466+0000","last_active":"2024-09-19T09:36:13.979729+0000","last_peered":"2024-09-19T09:36:13.979729+0000","last_clean":"2024-09-19T09:36:13.979729+0000","last_became_active":"2024-09-19T09:36:12.990903+0000","last_became_peered":"2024-09-19T09:36:12.990903+0000","last_unstale":"2024-09-19T09:36:13.979729+0000","last_undegraded":"2024-09-19T09:36:13.979729+0000","last_fullsized":"2024-09-19T09:36:13.979729+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:04.128768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028715+0000","last_change":"2024-09-19T09:36:12.986686+0000","last_active":"2024-09-19T09:37:16.028715+0000","last_peered":"2024-09-19T09:37:16.028715+0000","last_clean":"2024-09-19T09:37:16.028715+0000","last_became_active":"2024-09-19T09:36:12.986334+0000","last_became_peered":"2024-09-19T09:36:12.986334+0000","last_unstale":"2024-09-19T09:37:16.028715+0000","last_undegraded":"2024-09-19T09:37:16.028715+0000","last_fullsized":"2024-09-19T09:37:16.028715+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:39.926343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979886+0000","last_change":"2024-09-19T09:36:12.981964+0000","last_active":"2024-09-19T09:36:13.979886+0000","last_peered":"2024-09-19T09:36:13.979886+0000","last_clean":"2024-09-19T09:36:13.979886+0000","last_became_active":"2024-09-19T09:36:12.981558+0000","last_became_peered":"2024-09-19T09:36:12.981558+0000","last_unstale":"2024-09-19T09:36:13.979886+0000","last_undegraded":"2024-09-19T09:36:13.979886+0000","last_fullsized":"2024-09-19T09:36:13.979886+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:33.706451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031212+0000","last_change":"2024-09-19T09:36:12.992598+0000","last_active":"2024-09-19T09:37:16.031212+0000","last_peered":"2024-09-19T09:37:16.031212+0000","last_clean":"2024-09-19T09:37:16.031212+0000","last_became_active":"2024-09-19T09:36:12.992281+0000","last_became_peered":"2024-09-19T09:36:12.992281+0000","last_unstale":"2024-09-19T09:37:16.031212+0000","last_undegraded":"2024-09-19T09:37:16.031212+0000","last_fullsized":"2024-09-19T09:37:16.031212+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:26.107432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983518+0000","last_change":"2024-09-19T09:36:12.988583+0000","last_active":"2024-09-19T09:36:13.983518+0000","last_peered":"2024-09-19T09:36:13.983518+0000","last_clean":"2024-09-19T09:36:13.983518+0000","last_became_active":"2024-09-19T09:36:12.987895+0000","last_became_peered":"2024-09-19T09:36:12.987895+0000","last_unstale":"2024-09-19T09:36:13.983518+0000","last_undegraded":"2024-09-19T09:36:13.983518+0000","last_fullsized":"2024-09-19T09:36:13.983518+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:47.617324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.035118+0000","last_change":"2024-09-19T09:36:12.988526+0000","last_active":"2024-09-19T09:37:15.035118+0000","last_peered":"2024-09-19T09:37:15.035118+0000","last_clean":"2024-09-19T09:37:15.035118+0000","last_became_active":"2024-09-19T09:36:12.988093+0000","last_became_peered":"2024-09-19T09:36:12.988093+0000","last_unstale":"2024-09-19T09:37:15.035118+0000","last_undegraded":"2024-09-19T09:37:15.035118+0000","last_fullsized":"2024-09-19T09:37:15.035118+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:48.949397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977695+0000","last_change":"2024-09-19T09:36:12.992360+0000","last_active":"2024-09-19T09:36:13.977695+0000","last_peered":"2024-09-19T09:36:13.977695+0000","last_clean":"2024-09-19T09:36:13.977695+0000","last_became_active":"2024-09-19T09:36:12.991833+0000","last_became_peered":"2024-09-19T09:36:12.991833+0000","last_unstale":"2024-09-19T09:36:13.977695+0000","last_undegraded":"2024-09-19T09:36:13.977695+0000","last_fullsized":"2024-09-19T09:36:13.977695+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:47.715012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031904+0000","last_change":"2024-09-19T09:36:12.993435+0000","last_active":"2024-09-19T09:37:16.031904+0000","last_peered":"2024-09-19T09:37:16.031904+0000","last_clean":"2024-09-19T09:37:16.031904+0000","last_became_active":"2024-09-19T09:36:12.993108+0000","last_became_peered":"2024-09-19T09:36:12.993108+0000","last_unstale":"2024-09-19T09:37:16.031904+0000","last_undegraded":"2024-09-19T09:37:16.031904+0000","last_fullsized":"2024-09-19T09:37:16.031904+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:54.453593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983462+0000","last_change":"2024-09-19T09:36:12.991044+0000","last_active":"2024-09-19T09:36:13.983462+0000","last_peered":"2024-09-19T09:36:13.983462+0000","last_clean":"2024-09-19T09:36:13.983462+0000","last_became_active":"2024-09-19T09:36:12.989955+0000","last_became_peered":"2024-09-19T09:36:12.989955+0000","last_unstale":"2024-09-19T09:36:13.983462+0000","last_undegraded":"2024-09-19T09:36:13.983462+0000","last_fullsized":"2024-09-19T09:36:13.983462+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:21.034023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028894+0000","last_change":"2024-09-19T09:36:12.989679+0000","last_active":"2024-09-19T09:37:16.028894+0000","last_peered":"2024-09-19T09:37:16.028894+0000","last_clean":"2024-09-19T09:37:16.028894+0000","last_became_active":"2024-09-19T09:36:12.988463+0000","last_became_peered":"2024-09-19T09:36:12.988463+0000","last_unstale":"2024-09-19T09:37:16.028894+0000","last_undegraded":"2024-09-19T09:37:16.028894+0000","last_fullsized":"2024-09-19T09:37:16.028894+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:28.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971006+0000","last_change":"2024-09-19T09:36:12.983494+0000","last_active":"2024-09-19T09:36:13.971006+0000","last_peered":"2024-09-19T09:36:13.971006+0000","last_clean":"2024-09-19T09:36:13.971006+0000","last_became_active":"2024-09-19T09:36:12.983143+0000","last_became_peered":"2024-09-19T09:36:12.983143+0000","last_unstale":"2024-09-19T09:36:13.971006+0000","last_undegraded":"2024-09-19T09:36:13.971006+0000","last_fullsized":"2024-09-19T09:36:13.971006+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:23.378183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980072+0000","last_change":"2024-09-19T09:36:12.987512+0000","last_active":"2024-09-19T09:36:13.980072+0000","last_peered":"2024-09-19T09:36:13.980072+0000","last_clean":"2024-09-19T09:36:13.980072+0000","last_became_active":"2024-09-19T09:36:12.987288+0000","last_became_peered":"2024-09-19T09:36:12.987288+0000","last_unstale":"2024-09-19T09:36:13.980072+0000","last_undegraded":"2024-09-19T09:36:13.980072+0000","last_fullsized":"2024-09-19T09:36:13.980072+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:14.614333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979944+0000","last_change":"2024-09-19T09:36:12.989725+0000","last_active":"2024-09-19T09:36:13.979944+0000","last_peered":"2024-09-19T09:36:13.979944+0000","last_clean":"2024-09-19T09:36:13.979944+0000","last_became_active":"2024-09-19T09:36:12.989229+0000","last_became_peered":"2024-09-19T09:36:12.989229+0000","last_unstale":"2024-09-19T09:36:13.979944+0000","last_undegraded":"2024-09-19T09:36:13.979944+0000","last_fullsized":"2024-09-19T09:36:13.979944+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:07.896864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977084+0000","last_change":"2024-09-19T09:36:12.988210+0000","last_active":"2024-09-19T09:36:13.977084+0000","last_peered":"2024-09-19T09:36:13.977084+0000","last_clean":"2024-09-19T09:36:13.977084+0000","last_became_active":"2024-09-19T09:36:12.987904+0000","last_became_peered":"2024-09-19T09:36:12.987904+0000","last_unstale":"2024-09-19T09:36:13.977084+0000","last_undegraded":"2024-09-19T09:36:13.977084+0000","last_fullsized":"2024-09-19T09:36:13.977084+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:13.588237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.033392+0000","last_change":"2024-09-19T09:36:12.984028+0000","last_active":"2024-09-19T09:37:16.033392+0000","last_peered":"2024-09-19T09:37:16.033392+0000","last_clean":"2024-09-19T09:37:16.033392+0000","last_became_active":"2024-09-19T09:36:12.982062+0000","last_became_peered":"2024-09-19T09:36:12.982062+0000","last_unstale":"2024-09-19T09:37:16.033392+0000","last_undegraded":"2024-09-19T09:37:16.033392+0000","last_fullsized":"2024-09-19T09:37:16.033392+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:26.610287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.034452+0000","last_change":"2024-09-19T09:36:12.979277+0000","last_active":"2024-09-19T09:37:15.034452+0000","last_peered":"2024-09-19T09:37:15.034452+0000","last_clean":"2024-09-19T09:37:15.034452+0000","last_became_active":"2024-09-19T09:36:12.978970+0000","last_became_peered":"2024-09-19T09:36:12.978970+0000","last_unstale":"2024-09-19T09:37:15.034452+0000","last_undegraded":"2024-09-19T09:37:15.034452+0000","last_fullsized":"2024-09-19T09:37:15.034452+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:00.424728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979950+0000","last_change":"2024-09-19T09:36:12.981021+0000","last_active":"2024-09-19T09:36:13.979950+0000","last_peered":"2024-09-19T09:36:13.979950+0000","last_clean":"2024-09-19T09:36:13.979950+0000","last_became_active":"2024-09-19T09:36:12.980580+0000","last_became_peered":"2024-09-19T09:36:12.980580+0000","last_unstale":"2024-09-19T09:36:13.979950+0000","last_undegraded":"2024-09-19T09:36:13.979950+0000","last_fullsized":"2024-09-19T09:36:13.979950+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:17.464873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.032578+0000","last_change":"2024-09-19T09:36:12.986090+0000","last_active":"2024-09-19T09:37:16.032578+0000","last_peered":"2024-09-19T09:37:16.032578+0000","last_clean":"2024-09-19T09:37:16.032578+0000","last_became_active":"2024-09-19T09:36:12.985740+0000","last_became_peered":"2024-09-19T09:36:12.985740+0000","last_unstale":"2024-09-19T09:37:16.032578+0000","last_undegraded":"2024-09-19T09:37:16.032578+0000","last_fullsized":"2024-09-19T09:37:16.032578+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:35.252834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971039+0000","last_change":"2024-09-19T09:36:12.981257+0000","last_active":"2024-09-19T09:36:13.971039+0000","last_peered":"2024-09-19T09:36:13.971039+0000","last_clean":"2024-09-19T09:36:13.971039+0000","last_became_active":"2024-09-19T09:36:12.980911+0000","last_became_peered":"2024-09-19T09:36:12.980911+0000","last_unstale":"2024-09-19T09:36:13.971039+0000","last_undegraded":"2024-09-19T09:36:13.971039+0000","last_fullsized":"2024-09-19T09:36:13.971039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:41.470514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977617+0000","last_change":"2024-09-19T09:36:12.982585+0000","last_active":"2024-09-19T09:36:13.977617+0000","last_peered":"2024-09-19T09:36:13.977617+0000","last_clean":"2024-09-19T09:36:13.977617+0000","last_became_active":"2024-09-19T09:36:12.982193+0000","last_became_peered":"2024-09-19T09:36:12.982193+0000","last_unstale":"2024-09-19T09:36:13.977617+0000","last_undegraded":"2024-09-19T09:36:13.977617+0000","last_fullsized":"2024-09-19T09:36:13.977617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:30.057088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.034505+0000","last_change":"2024-09-19T09:36:12.985236+0000","last_active":"2024-09-19T09:37:15.034505+0000","last_peered":"2024-09-19T09:37:15.034505+0000","last_clean":"2024-09-19T09:37:15.034505+0000","last_became_active":"2024-09-19T09:36:12.984751+0000","last_became_peered":"2024-09-19T09:36:12.984751+0000","last_unstale":"2024-09-19T09:37:15.034505+0000","last_undegraded":"2024-09-19T09:37:15.034505+0000","last_fullsized":"2024-09-19T09:37:15.034505+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:52.784216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029585+0000","last_change":"2024-09-19T09:36:12.985856+0000","last_active":"2024-09-19T09:37:16.029585+0000","last_peered":"2024-09-19T09:37:16.029585+0000","last_clean":"2024-09-19T09:37:16.029585+0000","last_became_active":"2024-09-19T09:36:12.985312+0000","last_became_peered":"2024-09-19T09:36:12.985312+0000","last_unstale":"2024-09-19T09:37:16.029585+0000","last_undegraded":"2024-09-19T09:37:16.029585+0000","last_fullsized":"2024-09-19T09:37:16.029585+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:25.235945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.035794+0000","last_change":"2024-09-19T09:36:12.982443+0000","last_active":"2024-09-19T09:37:15.035794+0000","last_peered":"2024-09-19T09:37:15.035794+0000","last_clean":"2024-09-19T09:37:15.035794+0000","last_became_active":"2024-09-19T09:36:12.982130+0000","last_became_peered":"2024-09-19T09:36:12.982130+0000","last_unstale":"2024-09-19T09:37:15.035794+0000","last_undegraded":"2024-09-19T09:37:15.035794+0000","last_fullsized":"2024-09-19T09:37:15.035794+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:17.177563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980374+0000","last_change":"2024-09-19T09:36:12.990439+0000","last_active":"2024-09-19T09:36:13.980374+0000","last_peered":"2024-09-19T09:36:13.980374+0000","last_clean":"2024-09-19T09:36:13.980374+0000","last_became_active":"2024-09-19T09:36:12.990135+0000","last_became_peered":"2024-09-19T09:36:12.990135+0000","last_unstale":"2024-09-19T09:36:13.980374+0000","last_undegraded":"2024-09-19T09:36:13.980374+0000","last_fullsized":"2024-09-19T09:36:13.980374+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:51.685192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.032815+0000","last_change":"2024-09-19T09:36:12.987261+0000","last_active":"2024-09-19T09:37:16.032815+0000","last_peered":"2024-09-19T09:37:16.032815+0000","last_clean":"2024-09-19T09:37:16.032815+0000","last_became_active":"2024-09-19T09:36:12.986192+0000","last_became_peered":"2024-09-19T09:36:12.986192+0000","last_unstale":"2024-09-19T09:37:16.032815+0000","last_undegraded":"2024-09-19T09:37:16.032815+0000","last_fullsized":"2024-09-19T09:37:16.032815+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:58.435605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971115+0000","last_change":"2024-09-19T09:36:12.981248+0000","last_active":"2024-09-19T09:36:13.971115+0000","last_peered":"2024-09-19T09:36:13.971115+0000","last_clean":"2024-09-19T09:36:13.971115+0000","last_became_active":"2024-09-19T09:36:12.980754+0000","last_became_peered":"2024-09-19T09:36:12.980754+0000","last_unstale":"2024-09-19T09:36:13.971115+0000","last_undegraded":"2024-09-19T09:36:13.971115+0000","last_fullsized":"2024-09-19T09:36:13.971115+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:03.970402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980069+0000","last_change":"2024-09-19T09:36:12.990841+0000","last_active":"2024-09-19T09:36:13.980069+0000","last_peered":"2024-09-19T09:36:13.980069+0000","last_clean":"2024-09-19T09:36:13.980069+0000","last_became_active":"2024-09-19T09:36:12.989667+0000","last_became_peered":"2024-09-19T09:36:12.989667+0000","last_unstale":"2024-09-19T09:36:13.980069+0000","last_undegraded":"2024-09-19T09:36:13.980069+0000","last_fullsized":"2024-09-19T09:36:13.980069+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:46:00.314590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979717+0000","last_change":"2024-09-19T09:36:12.984007+0000","last_active":"2024-09-19T09:36:13.979717+0000","last_peered":"2024-09-19T09:36:13.979717+0000","last_clean":"2024-09-19T09:36:13.979717+0000","last_became_active":"2024-09-19T09:36:12.983627+0000","last_became_peered":"2024-09-19T09:36:12.983627+0000","last_unstale":"2024-09-19T09:36:13.979717+0000","last_undegraded":"2024-09-19T09:36:13.979717+0000","last_fullsized":"2024-09-19T09:36:13.979717+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:42.038673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980949+0000","last_change":"2024-09-19T09:36:12.988032+0000","last_active":"2024-09-19T09:36:13.980949+0000","last_peered":"2024-09-19T09:36:13.980949+0000","last_clean":"2024-09-19T09:36:13.980949+0000","last_became_active":"2024-09-19T09:36:12.987588+0000","last_became_peered":"2024-09-19T09:36:12.987588+0000","last_unstale":"2024-09-19T09:36:13.980949+0000","last_undegraded":"2024-09-19T09:36:13.980949+0000","last_fullsized":"2024-09-19T09:36:13.980949+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:01.518543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.131565+0000","last_change":"2024-09-19T09:37:16.131565+0000","last_active":"2024-09-19T09:37:16.131565+0000","last_peered":"2024-09-19T09:37:16.131565+0000","last_clean":"2024-09-19T09:37:16.131565+0000","last_became_active":"2024-09-19T09:37:16.131171+0000","last_became_peered":"2024-09-19T09:37:16.131171+0000","last_unstale":"2024-09-19T09:37:16.131565+0000","last_undegraded":"2024-09-19T09:37:16.131565+0000","last_fullsized":"2024-09-19T09:37:16.131565+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:18.195074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979987+0000","last_change":"2024-09-19T09:36:12.989709+0000","last_active":"2024-09-19T09:36:13.979987+0000","last_peered":"2024-09-19T09:36:13.979987+0000","last_clean":"2024-09-19T09:36:13.979987+0000","last_became_active":"2024-09-19T09:36:12.989324+0000","last_became_peered":"2024-09-19T09:36:12.989324+0000","last_unstale":"2024-09-19T09:36:13.979987+0000","last_undegraded":"2024-09-19T09:36:13.979987+0000","last_fullsized":"2024-09-19T09:36:13.979987+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:09.843175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.033713+0000","last_change":"2024-09-19T09:37:16.033713+0000","last_active":"2024-09-19T09:37:16.033713+0000","last_peered":"2024-09-19T09:37:16.033713+0000","last_clean":"2024-09-19T09:37:16.033713+0000","last_became_active":"2024-09-19T09:37:16.033230+0000","last_became_peered":"2024-09-19T09:37:16.033230+0000","last_unstale":"2024-09-19T09:37:16.033713+0000","last_undegraded":"2024-09-19T09:37:16.033713+0000","last_fullsized":"2024-09-19T09:37:16.033713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:12.262115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.484760+0000","last_change":"2024-09-19T09:37:16.484760+0000","last_active":"2024-09-19T09:37:16.484760+0000","last_peered":"2024-09-19T09:37:16.484760+0000","last_clean":"2024-09-19T09:37:16.484760+0000","last_became_active":"2024-09-19T09:37:16.484316+0000","last_became_peered":"2024-09-19T09:37:16.484316+0000","last_unstale":"2024-09-19T09:37:16.484760+0000","last_undegraded":"2024-09-19T09:37:16.484760+0000","last_fullsized":"2024-09-19T09:37:16.484760+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:14.897601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"activating","last_fresh":"2024-09-19T09:37:16.032079+0000","last_change":"2024-09-19T09:37:16.032079+0000","last_active":"2024-09-19T09:37:15.027769+0000","last_peered":"2024-09-19T09:36:13.976634+0000","last_clean":"2024-09-19T09:36:13.976634+0000","last_became_active":"2024-09-19T09:36:10.839074+0000","last_became_peered":"2024-09-19T09:36:10.839074+0000","last_unstale":"2024-09-19T09:37:16.032079+0000","last_undegraded":"2024-09-19T09:37:16.032079+0000","last_fullsized":"2024-09-19T09:37:16.032079+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":["10","1","6","8"],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.970682+0000","last_change":"2024-09-19T09:36:10.837287+0000","last_active":"2024-09-19T09:36:13.970682+0000","last_peered":"2024-09-19T09:36:13.970682+0000","last_clean":"2024-09-19T09:36:13.970682+0000","last_became_active":"2024-09-19T09:36:10.836890+0000","last_became_peered":"2024-09-19T09:36:10.836890+0000","last_unstale":"2024-09-19T09:36:13.970682+0000","last_undegraded":"2024-09-19T09:36:13.970682+0000","last_fullsized":"2024-09-19T09:36:13.970682+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:09.676728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.035236+0000","last_change":"2024-09-19T09:36:12.975690+0000","last_active":"2024-09-19T09:37:15.035236+0000","last_peered":"2024-09-19T09:37:15.035236+0000","last_clean":"2024-09-19T09:37:15.035236+0000","last_became_active":"2024-09-19T09:36:12.975370+0000","last_became_peered":"2024-09-19T09:36:12.975370+0000","last_unstale":"2024-09-19T09:37:15.035236+0000","last_undegraded":"2024-09-19T09:37:15.035236+0000","last_fullsized":"2024-09-19T09:37:15.035236+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:05.650917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030234+0000","last_change":"2024-09-19T09:36:10.843736+0000","last_active":"2024-09-19T09:37:16.030234+0000","last_peered":"2024-09-19T09:37:16.030234+0000","last_clean":"2024-09-19T09:37:16.030234+0000","last_became_active":"2024-09-19T09:36:10.843353+0000","last_became_peered":"2024-09-19T09:36:10.843353+0000","last_unstale":"2024-09-19T09:37:16.030234+0000","last_undegraded":"2024-09-19T09:37:16.030234+0000","last_fullsized":"2024-09-19T09:37:16.030234+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:29.818642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.031869+0000","last_change":"2024-09-19T09:36:12.978841+0000","last_active":"2024-09-19T09:37:15.031869+0000","last_peered":"2024-09-19T09:37:15.031869+0000","last_clean":"2024-09-19T09:37:15.031869+0000","last_became_active":"2024-09-19T09:36:12.978501+0000","last_became_peered":"2024-09-19T09:36:12.978501+0000","last_unstale":"2024-09-19T09:37:15.031869+0000","last_undegraded":"2024-09-19T09:37:15.031869+0000","last_fullsized":"2024-09-19T09:37:15.031869+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:07.974576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.032030+0000","last_change":"2024-09-19T09:36:10.841997+0000","last_active":"2024-09-19T09:37:16.032030+0000","last_peered":"2024-09-19T09:37:16.032030+0000","last_clean":"2024-09-19T09:37:16.032030+0000","last_became_active":"2024-09-19T09:36:10.841641+0000","last_became_peered":"2024-09-19T09:36:10.841641+0000","last_unstale":"2024-09-19T09:37:16.032030+0000","last_undegraded":"2024-09-19T09:37:16.032030+0000","last_fullsized":"2024-09-19T09:37:16.032030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:10.477879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.978167+0000","last_change":"2024-09-19T09:36:12.981486+0000","last_active":"2024-09-19T09:36:13.978167+0000","last_peered":"2024-09-19T09:36:13.978167+0000","last_clean":"2024-09-19T09:36:13.978167+0000","last_became_active":"2024-09-19T09:36:12.981165+0000","last_became_peered":"2024-09-19T09:36:12.981165+0000","last_unstale":"2024-09-19T09:36:13.978167+0000","last_undegraded":"2024-09-19T09:36:13.978167+0000","last_fullsized":"2024-09-19T09:36:13.978167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:21.986132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.982877+0000","last_change":"2024-09-19T09:36:10.845362+0000","last_active":"2024-09-19T09:36:13.982877+0000","last_peered":"2024-09-19T09:36:13.982877+0000","last_clean":"2024-09-19T09:36:13.982877+0000","last_became_active":"2024-09-19T09:36:10.844992+0000","last_became_peered":"2024-09-19T09:36:10.844992+0000","last_unstale":"2024-09-19T09:36:13.982877+0000","last_undegraded":"2024-09-19T09:36:13.982877+0000","last_fullsized":"2024-09-19T09:36:13.982877+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:52.854333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980323+0000","last_change":"2024-09-19T09:36:12.988924+0000","last_active":"2024-09-19T09:36:13.980323+0000","last_peered":"2024-09-19T09:36:13.980323+0000","last_clean":"2024-09-19T09:36:13.980323+0000","last_became_active":"2024-09-19T09:36:12.988331+0000","last_became_peered":"2024-09-19T09:36:12.988331+0000","last_unstale":"2024-09-19T09:36:13.980323+0000","last_undegraded":"2024-09-19T09:36:13.980323+0000","last_fullsized":"2024-09-19T09:36:13.980323+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:24.754252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029903+0000","last_change":"2024-09-19T09:36:10.860003+0000","last_active":"2024-09-19T09:37:16.029903+0000","last_peered":"2024-09-19T09:37:16.029903+0000","last_clean":"2024-09-19T09:37:16.029903+0000","last_became_active":"2024-09-19T09:36:10.859584+0000","last_became_peered":"2024-09-19T09:36:10.859584+0000","last_unstale":"2024-09-19T09:37:16.029903+0000","last_undegraded":"2024-09-19T09:37:16.029903+0000","last_fullsized":"2024-09-19T09:37:16.029903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:44.837960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977224+0000","last_change":"2024-09-19T09:36:12.985446+0000","last_active":"2024-09-19T09:36:13.977224+0000","last_peered":"2024-09-19T09:36:13.977224+0000","last_clean":"2024-09-19T09:36:13.977224+0000","last_became_active":"2024-09-19T09:36:12.984671+0000","last_became_peered":"2024-09-19T09:36:12.984671+0000","last_unstale":"2024-09-19T09:36:13.977224+0000","last_undegraded":"2024-09-19T09:36:13.977224+0000","last_fullsized":"2024-09-19T09:36:13.977224+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:54.800151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'27","reported_seq":166,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.032261+0000","last_change":"2024-09-19T09:36:10.841056+0000","last_active":"2024-09-19T09:37:16.032261+0000","last_peered":"2024-09-19T09:37:16.032261+0000","last_clean":"2024-09-19T09:37:16.032261+0000","last_became_active":"2024-09-19T09:36:10.840731+0000","last_became_peered":"2024-09-19T09:36:10.840731+0000","last_unstale":"2024-09-19T09:37:16.032261+0000","last_undegraded":"2024-09-19T09:37:16.032261+0000","last_fullsized":"2024-09-19T09:37:16.032261+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:13.676188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62819,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":119,"num_write":27,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.981591+0000","last_change":"2024-09-19T09:36:12.990223+0000","last_active":"2024-09-19T09:36:13.981591+0000","last_peered":"2024-09-19T09:36:13.981591+0000","last_clean":"2024-09-19T09:36:13.981591+0000","last_became_active":"2024-09-19T09:36:12.989720+0000","last_became_peered":"2024-09-19T09:36:12.989720+0000","last_unstale":"2024-09-19T09:36:13.981591+0000","last_undegraded":"2024-09-19T09:36:13.981591+0000","last_fullsized":"2024-09-19T09:36:13.981591+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:37.003075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:14.496063+0000","last_change":"2024-09-19T09:36:10.843288+0000","last_active":"2024-09-19T09:36:14.496063+0000","last_peered":"2024-09-19T09:36:14.496063+0000","last_clean":"2024-09-19T09:36:14.496063+0000","last_became_active":"2024-09-19T09:36:10.842844+0000","last_became_peered":"2024-09-19T09:36:10.842844+0000","last_unstale":"2024-09-19T09:36:14.496063+0000","last_undegraded":"2024-09-19T09:36:14.496063+0000","last_fullsized":"2024-09-19T09:36:14.496063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:38.695411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.970737+0000","last_change":"2024-09-19T09:36:12.981251+0000","last_active":"2024-09-19T09:36:13.970737+0000","last_peered":"2024-09-19T09:36:13.970737+0000","last_clean":"2024-09-19T09:36:13.970737+0000","last_became_active":"2024-09-19T09:36:12.980861+0000","last_became_peered":"2024-09-19T09:36:12.980861+0000","last_unstale":"2024-09-19T09:36:13.970737+0000","last_undegraded":"2024-09-19T09:36:13.970737+0000","last_fullsized":"2024-09-19T09:36:13.970737+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:09.633644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030128+0000","last_change":"2024-09-19T09:36:10.843448+0000","last_active":"2024-09-19T09:37:16.030128+0000","last_peered":"2024-09-19T09:37:16.030128+0000","last_clean":"2024-09-19T09:37:16.030128+0000","last_became_active":"2024-09-19T09:36:10.843087+0000","last_became_peered":"2024-09-19T09:36:10.843087+0000","last_unstale":"2024-09-19T09:37:16.030128+0000","last_undegraded":"2024-09-19T09:37:16.030128+0000","last_fullsized":"2024-09-19T09:37:16.030128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:20.623613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.982971+0000","last_change":"2024-09-19T09:36:12.981160+0000","last_active":"2024-09-19T09:36:13.982971+0000","last_peered":"2024-09-19T09:36:13.982971+0000","last_clean":"2024-09-19T09:36:13.982971+0000","last_became_active":"2024-09-19T09:36:12.980823+0000","last_became_peered":"2024-09-19T09:36:12.980823+0000","last_unstale":"2024-09-19T09:36:13.982971+0000","last_undegraded":"2024-09-19T09:36:13.982971+0000","last_fullsized":"2024-09-19T09:36:13.982971+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:39.323439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028480+0000","last_change":"2024-09-19T09:36:10.842536+0000","last_active":"2024-09-19T09:37:16.028480+0000","last_peered":"2024-09-19T09:37:16.028480+0000","last_clean":"2024-09-19T09:37:16.028480+0000","last_became_active":"2024-09-19T09:36:10.842176+0000","last_became_peered":"2024-09-19T09:36:10.842176+0000","last_unstale":"2024-09-19T09:37:16.028480+0000","last_undegraded":"2024-09-19T09:37:16.028480+0000","last_fullsized":"2024-09-19T09:37:16.028480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:37.871299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.982395+0000","last_change":"2024-09-19T09:36:12.987271+0000","last_active":"2024-09-19T09:36:13.982395+0000","last_peered":"2024-09-19T09:36:13.982395+0000","last_clean":"2024-09-19T09:36:13.982395+0000","last_became_active":"2024-09-19T09:36:12.986918+0000","last_became_peered":"2024-09-19T09:36:12.986918+0000","last_unstale":"2024-09-19T09:36:13.982395+0000","last_undegraded":"2024-09-19T09:36:13.982395+0000","last_fullsized":"2024-09-19T09:36:13.982395+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:07.608541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.989197+0000","last_change":"2024-09-19T09:36:10.860370+0000","last_active":"2024-09-19T09:36:13.989197+0000","last_peered":"2024-09-19T09:36:13.989197+0000","last_clean":"2024-09-19T09:36:13.989197+0000","last_became_active":"2024-09-19T09:36:10.859820+0000","last_became_peered":"2024-09-19T09:36:10.859820+0000","last_unstale":"2024-09-19T09:36:13.989197+0000","last_undegraded":"2024-09-19T09:36:13.989197+0000","last_fullsized":"2024-09-19T09:36:13.989197+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:12.121038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029793+0000","last_change":"2024-09-19T09:36:12.994449+0000","last_active":"2024-09-19T09:37:16.029793+0000","last_peered":"2024-09-19T09:37:16.029793+0000","last_clean":"2024-09-19T09:37:16.029793+0000","last_became_active":"2024-09-19T09:36:12.994141+0000","last_became_peered":"2024-09-19T09:36:12.994141+0000","last_unstale":"2024-09-19T09:37:16.029793+0000","last_undegraded":"2024-09-19T09:37:16.029793+0000","last_fullsized":"2024-09-19T09:37:16.029793+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:21.416453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:14.710833+0000","last_change":"2024-09-19T09:36:10.839609+0000","last_active":"2024-09-19T09:36:14.710833+0000","last_peered":"2024-09-19T09:36:14.710833+0000","last_clean":"2024-09-19T09:36:14.710833+0000","last_became_active":"2024-09-19T09:36:10.839227+0000","last_became_peered":"2024-09-19T09:36:10.839227+0000","last_unstale":"2024-09-19T09:36:14.710833+0000","last_undegraded":"2024-09-19T09:36:14.710833+0000","last_fullsized":"2024-09-19T09:36:14.710833+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:00.734924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.032825+0000","last_change":"2024-09-19T09:36:12.983573+0000","last_active":"2024-09-19T09:37:16.032825+0000","last_peered":"2024-09-19T09:37:16.032825+0000","last_clean":"2024-09-19T09:37:16.032825+0000","last_became_active":"2024-09-19T09:36:12.983241+0000","last_became_peered":"2024-09-19T09:36:12.983241+0000","last_unstale":"2024-09-19T09:37:16.032825+0000","last_undegraded":"2024-09-19T09:37:16.032825+0000","last_fullsized":"2024-09-19T09:37:16.032825+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:44.050271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.981922+0000","last_change":"2024-09-19T09:36:10.839789+0000","last_active":"2024-09-19T09:36:13.981922+0000","last_peered":"2024-09-19T09:36:13.981922+0000","last_clean":"2024-09-19T09:36:13.981922+0000","last_became_active":"2024-09-19T09:36:10.839445+0000","last_became_peered":"2024-09-19T09:36:10.839445+0000","last_unstale":"2024-09-19T09:36:13.981922+0000","last_undegraded":"2024-09-19T09:36:13.981922+0000","last_fullsized":"2024-09-19T09:36:13.981922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:16.040249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.984009+0000","last_change":"2024-09-19T09:36:12.993420+0000","last_active":"2024-09-19T09:36:13.984009+0000","last_peered":"2024-09-19T09:36:13.984009+0000","last_clean":"2024-09-19T09:36:13.984009+0000","last_became_active":"2024-09-19T09:36:12.992334+0000","last_became_peered":"2024-09-19T09:36:12.992334+0000","last_unstale":"2024-09-19T09:36:13.984009+0000","last_undegraded":"2024-09-19T09:36:13.984009+0000","last_fullsized":"2024-09-19T09:36:13.984009+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:21.693164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030247+0000","last_change":"2024-09-19T09:36:10.839461+0000","last_active":"2024-09-19T09:37:16.030247+0000","last_peered":"2024-09-19T09:37:16.030247+0000","last_clean":"2024-09-19T09:37:16.030247+0000","last_became_active":"2024-09-19T09:36:10.839092+0000","last_became_peered":"2024-09-19T09:36:10.839092+0000","last_unstale":"2024-09-19T09:37:16.030247+0000","last_undegraded":"2024-09-19T09:37:16.030247+0000","last_fullsized":"2024-09-19T09:37:16.030247+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:02.367267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:14.080586+0000","last_change":"2024-09-19T09:36:12.988234+0000","last_active":"2024-09-19T09:36:14.080586+0000","last_peered":"2024-09-19T09:36:14.080586+0000","last_clean":"2024-09-19T09:36:14.080586+0000","last_became_active":"2024-09-19T09:36:12.987813+0000","last_became_peered":"2024-09-19T09:36:12.987813+0000","last_unstale":"2024-09-19T09:36:14.080586+0000","last_undegraded":"2024-09-19T09:36:14.080586+0000","last_fullsized":"2024-09-19T09:36:14.080586+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:56.024428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.981458+0000","last_change":"2024-09-19T09:36:10.945705+0000","last_active":"2024-09-19T09:36:13.981458+0000","last_peered":"2024-09-19T09:36:13.981458+0000","last_clean":"2024-09-19T09:36:13.981458+0000","last_became_active":"2024-09-19T09:36:10.945323+0000","last_became_peered":"2024-09-19T09:36:10.945323+0000","last_unstale":"2024-09-19T09:36:13.981458+0000","last_undegraded":"2024-09-19T09:36:13.981458+0000","last_fullsized":"2024-09-19T09:36:13.981458+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:24.211909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983646+0000","last_change":"2024-09-19T09:36:12.990517+0000","last_active":"2024-09-19T09:36:13.983646+0000","last_peered":"2024-09-19T09:36:13.983646+0000","last_clean":"2024-09-19T09:36:13.983646+0000","last_became_active":"2024-09-19T09:36:12.989291+0000","last_became_peered":"2024-09-19T09:36:12.989291+0000","last_unstale":"2024-09-19T09:36:13.983646+0000","last_undegraded":"2024-09-19T09:36:13.983646+0000","last_fullsized":"2024-09-19T09:36:13.983646+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:31.087798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":334,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.982963+0000","last_change":"2024-09-19T09:34:59.337025+0000","last_active":"2024-09-19T09:36:13.982963+0000","last_peered":"2024-09-19T09:36:13.982963+0000","last_clean":"2024-09-19T09:36:13.982963+0000","last_became_active":"2024-09-19T09:34:59.336556+0000","last_became_peered":"2024-09-19T09:34:59.336556+0000","last_unstale":"2024-09-19T09:36:13.982963+0000","last_undegraded":"2024-09-19T09:36:13.982963+0000","last_fullsized":"2024-09-19T09:36:13.982963+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:31:30.566923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:31:30.566923+0000","last_clean_scrub_stamp":"2024-09-19T09:31:30.566923+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:00.675254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028715+0000","last_change":"2024-09-19T09:36:10.838131+0000","last_active":"2024-09-19T09:37:16.028715+0000","last_peered":"2024-09-19T09:37:16.028715+0000","last_clean":"2024-09-19T09:37:16.028715+0000","last_became_active":"2024-09-19T09:36:10.837725+0000","last_became_peered":"2024-09-19T09:36:10.837725+0000","last_unstale":"2024-09-19T09:37:16.028715+0000","last_undegraded":"2024-09-19T09:37:16.028715+0000","last_fullsized":"2024-09-19T09:37:16.028715+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:57.104726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.035242+0000","last_change":"2024-09-19T09:36:12.981951+0000","last_active":"2024-09-19T09:37:15.035242+0000","last_peered":"2024-09-19T09:37:15.035242+0000","last_clean":"2024-09-19T09:37:15.035242+0000","last_became_active":"2024-09-19T09:36:12.981558+0000","last_became_peered":"2024-09-19T09:36:12.981558+0000","last_unstale":"2024-09-19T09:37:15.035242+0000","last_undegraded":"2024-09-19T09:37:15.035242+0000","last_fullsized":"2024-09-19T09:37:15.035242+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:31.119853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983301+0000","last_change":"2024-09-19T09:36:10.843574+0000","last_active":"2024-09-19T09:36:13.983301+0000","last_peered":"2024-09-19T09:36:13.983301+0000","last_clean":"2024-09-19T09:36:13.983301+0000","last_became_active":"2024-09-19T09:36:10.843252+0000","last_became_peered":"2024-09-19T09:36:10.843252+0000","last_unstale":"2024-09-19T09:36:13.983301+0000","last_undegraded":"2024-09-19T09:36:13.983301+0000","last_fullsized":"2024-09-19T09:36:13.983301+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:10.492812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.970701+0000","last_change":"2024-09-19T09:36:12.984538+0000","last_active":"2024-09-19T09:36:13.970701+0000","last_peered":"2024-09-19T09:36:13.970701+0000","last_clean":"2024-09-19T09:36:13.970701+0000","last_became_active":"2024-09-19T09:36:12.983448+0000","last_became_peered":"2024-09-19T09:36:12.983448+0000","last_unstale":"2024-09-19T09:36:13.970701+0000","last_undegraded":"2024-09-19T09:36:13.970701+0000","last_fullsized":"2024-09-19T09:36:13.970701+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:48.294473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.970841+0000","last_change":"2024-09-19T09:36:10.858959+0000","last_active":"2024-09-19T09:36:13.970841+0000","last_peered":"2024-09-19T09:36:13.970841+0000","last_clean":"2024-09-19T09:36:13.970841+0000","last_became_active":"2024-09-19T09:36:10.858638+0000","last_became_peered":"2024-09-19T09:36:10.858638+0000","last_unstale":"2024-09-19T09:36:13.970841+0000","last_undegraded":"2024-09-19T09:36:13.970841+0000","last_fullsized":"2024-09-19T09:36:13.970841+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:12.646483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029679+0000","last_change":"2024-09-19T09:36:12.992710+0000","last_active":"2024-09-19T09:37:16.029679+0000","last_peered":"2024-09-19T09:37:16.029679+0000","last_clean":"2024-09-19T09:37:16.029679+0000","last_became_active":"2024-09-19T09:36:12.992436+0000","last_became_peered":"2024-09-19T09:36:12.992436+0000","last_unstale":"2024-09-19T09:37:16.029679+0000","last_undegraded":"2024-09-19T09:37:16.029679+0000","last_fullsized":"2024-09-19T09:37:16.029679+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:51.685516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983385+0000","last_change":"2024-09-19T09:36:10.842031+0000","last_active":"2024-09-19T09:36:13.983385+0000","last_peered":"2024-09-19T09:36:13.983385+0000","last_clean":"2024-09-19T09:36:13.983385+0000","last_became_active":"2024-09-19T09:36:10.841693+0000","last_became_peered":"2024-09-19T09:36:10.841693+0000","last_unstale":"2024-09-19T09:36:13.983385+0000","last_undegraded":"2024-09-19T09:36:13.983385+0000","last_fullsized":"2024-09-19T09:36:13.983385+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:28:51.040551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034026+0000","last_change":"2024-09-19T09:37:16.034026+0000","last_active":"2024-09-19T09:37:16.034026+0000","last_peered":"2024-09-19T09:37:16.034026+0000","last_clean":"2024-09-19T09:37:16.034026+0000","last_became_active":"2024-09-19T09:37:16.033546+0000","last_became_peered":"2024-09-19T09:37:16.033546+0000","last_unstale":"2024-09-19T09:37:16.034026+0000","last_undegraded":"2024-09-19T09:37:16.034026+0000","last_fullsized":"2024-09-19T09:37:16.034026+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:42.673825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.034661+0000","last_change":"2024-09-19T09:36:10.860470+0000","last_active":"2024-09-19T09:37:15.034661+0000","last_peered":"2024-09-19T09:37:15.034661+0000","last_clean":"2024-09-19T09:37:15.034661+0000","last_became_active":"2024-09-19T09:36:10.860097+0000","last_became_peered":"2024-09-19T09:36:10.860097+0000","last_unstale":"2024-09-19T09:37:15.034661+0000","last_undegraded":"2024-09-19T09:37:15.034661+0000","last_fullsized":"2024-09-19T09:37:15.034661+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:14.933378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031415+0000","last_change":"2024-09-19T09:36:12.988489+0000","last_active":"2024-09-19T09:37:16.031415+0000","last_peered":"2024-09-19T09:37:16.031415+0000","last_clean":"2024-09-19T09:37:16.031415+0000","last_became_active":"2024-09-19T09:36:12.988151+0000","last_became_peered":"2024-09-19T09:36:12.988151+0000","last_unstale":"2024-09-19T09:37:16.031415+0000","last_undegraded":"2024-09-19T09:37:16.031415+0000","last_fullsized":"2024-09-19T09:37:16.031415+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:24.088771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.981909+0000","last_change":"2024-09-19T09:36:10.860103+0000","last_active":"2024-09-19T09:36:13.981909+0000","last_peered":"2024-09-19T09:36:13.981909+0000","last_clean":"2024-09-19T09:36:13.981909+0000","last_became_active":"2024-09-19T09:36:10.859526+0000","last_became_peered":"2024-09-19T09:36:10.859526+0000","last_unstale":"2024-09-19T09:36:13.981909+0000","last_undegraded":"2024-09-19T09:36:13.981909+0000","last_fullsized":"2024-09-19T09:36:13.981909+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:25.460372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.971039+0000","last_change":"2024-09-19T09:36:12.986286+0000","last_active":"2024-09-19T09:36:13.971039+0000","last_peered":"2024-09-19T09:36:13.971039+0000","last_clean":"2024-09-19T09:36:13.971039+0000","last_became_active":"2024-09-19T09:36:12.985982+0000","last_became_peered":"2024-09-19T09:36:12.985982+0000","last_unstale":"2024-09-19T09:36:13.971039+0000","last_undegraded":"2024-09-19T09:36:13.971039+0000","last_fullsized":"2024-09-19T09:36:13.971039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:19.026134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'10","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.034658+0000","last_change":"2024-09-19T09:36:10.839280+0000","last_active":"2024-09-19T09:37:15.034658+0000","last_peered":"2024-09-19T09:37:15.034658+0000","last_clean":"2024-09-19T09:37:15.034658+0000","last_became_active":"2024-09-19T09:36:10.838979+0000","last_became_peered":"2024-09-19T09:36:10.838979+0000","last_unstale":"2024-09-19T09:37:15.034658+0000","last_undegraded":"2024-09-19T09:37:15.034658+0000","last_fullsized":"2024-09-19T09:37:15.034658+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:06.303175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.035898+0000","last_change":"2024-09-19T09:36:12.979778+0000","last_active":"2024-09-19T09:37:15.035898+0000","last_peered":"2024-09-19T09:37:15.035898+0000","last_clean":"2024-09-19T09:37:15.035898+0000","last_became_active":"2024-09-19T09:36:12.979455+0000","last_became_peered":"2024-09-19T09:36:12.979455+0000","last_unstale":"2024-09-19T09:37:15.035898+0000","last_undegraded":"2024-09-19T09:37:15.035898+0000","last_fullsized":"2024-09-19T09:37:15.035898+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:36.620368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029063+0000","last_change":"2024-09-19T09:36:10.945706+0000","last_active":"2024-09-19T09:37:16.029063+0000","last_peered":"2024-09-19T09:37:16.029063+0000","last_clean":"2024-09-19T09:37:16.029063+0000","last_became_active":"2024-09-19T09:36:10.945314+0000","last_became_peered":"2024-09-19T09:36:10.945314+0000","last_unstale":"2024-09-19T09:37:16.029063+0000","last_undegraded":"2024-09-19T09:37:16.029063+0000","last_fullsized":"2024-09-19T09:37:16.029063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:49.786913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979575+0000","last_change":"2024-09-19T09:36:12.989412+0000","last_active":"2024-09-19T09:36:13.979575+0000","last_peered":"2024-09-19T09:36:13.979575+0000","last_clean":"2024-09-19T09:36:13.979575+0000","last_became_active":"2024-09-19T09:36:12.989109+0000","last_became_peered":"2024-09-19T09:36:12.989109+0000","last_unstale":"2024-09-19T09:36:13.979575+0000","last_undegraded":"2024-09-19T09:36:13.979575+0000","last_fullsized":"2024-09-19T09:36:13.979575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:33.142592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977297+0000","last_change":"2024-09-19T09:36:10.858581+0000","last_active":"2024-09-19T09:36:13.977297+0000","last_peered":"2024-09-19T09:36:13.977297+0000","last_clean":"2024-09-19T09:36:13.977297+0000","last_became_active":"2024-09-19T09:36:10.858240+0000","last_became_peered":"2024-09-19T09:36:10.858240+0000","last_unstale":"2024-09-19T09:36:13.977297+0000","last_undegraded":"2024-09-19T09:36:13.977297+0000","last_fullsized":"2024-09-19T09:36:13.977297+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:45.285839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.979917+0000","last_change":"2024-09-19T09:36:12.989075+0000","last_active":"2024-09-19T09:36:13.979917+0000","last_peered":"2024-09-19T09:36:13.979917+0000","last_clean":"2024-09-19T09:36:13.979917+0000","last_became_active":"2024-09-19T09:36:12.988752+0000","last_became_peered":"2024-09-19T09:36:12.988752+0000","last_unstale":"2024-09-19T09:36:13.979917+0000","last_undegraded":"2024-09-19T09:36:13.979917+0000","last_fullsized":"2024-09-19T09:36:13.979917+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.424032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.034798+0000","last_change":"2024-09-19T09:36:10.838716+0000","last_active":"2024-09-19T09:37:15.034798+0000","last_peered":"2024-09-19T09:37:15.034798+0000","last_clean":"2024-09-19T09:37:15.034798+0000","last_became_active":"2024-09-19T09:36:10.838393+0000","last_became_peered":"2024-09-19T09:36:10.838393+0000","last_unstale":"2024-09-19T09:37:15.034798+0000","last_undegraded":"2024-09-19T09:37:15.034798+0000","last_fullsized":"2024-09-19T09:37:15.034798+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:54.107223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.033298+0000","last_change":"2024-09-19T09:36:12.991721+0000","last_active":"2024-09-19T09:37:16.033298+0000","last_peered":"2024-09-19T09:37:16.033298+0000","last_clean":"2024-09-19T09:37:16.033298+0000","last_became_active":"2024-09-19T09:36:12.991398+0000","last_became_peered":"2024-09-19T09:36:12.991398+0000","last_unstale":"2024-09-19T09:37:16.033298+0000","last_undegraded":"2024-09-19T09:37:16.033298+0000","last_fullsized":"2024-09-19T09:37:16.033298+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:19:31.312072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.485156+0000","last_change":"2024-09-19T09:37:16.484541+0000","last_active":"2024-09-19T09:37:16.485156+0000","last_peered":"2024-09-19T09:37:16.485156+0000","last_clean":"2024-09-19T09:37:16.485156+0000","last_became_active":"2024-09-19T09:37:16.484035+0000","last_became_peered":"2024-09-19T09:37:16.484035+0000","last_unstale":"2024-09-19T09:37:16.485156+0000","last_undegraded":"2024-09-19T09:37:16.485156+0000","last_fullsized":"2024-09-19T09:37:16.485156+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:36.332699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.035663+0000","last_change":"2024-09-19T09:36:12.984180+0000","last_active":"2024-09-19T09:37:15.035663+0000","last_peered":"2024-09-19T09:37:15.035663+0000","last_clean":"2024-09-19T09:37:15.035663+0000","last_became_active":"2024-09-19T09:36:12.983876+0000","last_became_peered":"2024-09-19T09:36:12.983876+0000","last_unstale":"2024-09-19T09:37:15.035663+0000","last_undegraded":"2024-09-19T09:37:15.035663+0000","last_fullsized":"2024-09-19T09:37:15.035663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:45.876771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:14.710787+0000","last_change":"2024-09-19T09:36:10.845391+0000","last_active":"2024-09-19T09:36:14.710787+0000","last_peered":"2024-09-19T09:36:14.710787+0000","last_clean":"2024-09-19T09:36:14.710787+0000","last_became_active":"2024-09-19T09:36:10.844974+0000","last_became_peered":"2024-09-19T09:36:10.844974+0000","last_unstale":"2024-09-19T09:36:14.710787+0000","last_undegraded":"2024-09-19T09:36:14.710787+0000","last_fullsized":"2024-09-19T09:36:14.710787+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:00.318337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.983307+0000","last_change":"2024-09-19T09:36:12.991145+0000","last_active":"2024-09-19T09:36:13.983307+0000","last_peered":"2024-09-19T09:36:13.983307+0000","last_clean":"2024-09-19T09:36:13.983307+0000","last_became_active":"2024-09-19T09:36:12.989891+0000","last_became_peered":"2024-09-19T09:36:12.989891+0000","last_unstale":"2024-09-19T09:36:13.983307+0000","last_undegraded":"2024-09-19T09:36:13.983307+0000","last_fullsized":"2024-09-19T09:36:13.983307+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:21.054936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029799+0000","last_change":"2024-09-19T09:36:12.995378+0000","last_active":"2024-09-19T09:37:16.029799+0000","last_peered":"2024-09-19T09:37:16.029799+0000","last_clean":"2024-09-19T09:37:16.029799+0000","last_became_active":"2024-09-19T09:36:12.995028+0000","last_became_peered":"2024-09-19T09:36:12.995028+0000","last_unstale":"2024-09-19T09:37:16.029799+0000","last_undegraded":"2024-09-19T09:37:16.029799+0000","last_fullsized":"2024-09-19T09:37:16.029799+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:41.102130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.987910+0000","last_change":"2024-09-19T09:36:10.839595+0000","last_active":"2024-09-19T09:36:13.987910+0000","last_peered":"2024-09-19T09:36:13.987910+0000","last_clean":"2024-09-19T09:36:13.987910+0000","last_became_active":"2024-09-19T09:36:10.839196+0000","last_became_peered":"2024-09-19T09:36:10.839196+0000","last_unstale":"2024-09-19T09:36:13.987910+0000","last_undegraded":"2024-09-19T09:36:13.987910+0000","last_fullsized":"2024-09-19T09:36:13.987910+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:02.272731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.977120+0000","last_change":"2024-09-19T09:36:12.984485+0000","last_active":"2024-09-19T09:36:13.977120+0000","last_peered":"2024-09-19T09:36:13.977120+0000","last_clean":"2024-09-19T09:36:13.977120+0000","last_became_active":"2024-09-19T09:36:12.984004+0000","last_became_peered":"2024-09-19T09:36:12.984004+0000","last_unstale":"2024-09-19T09:36:13.977120+0000","last_undegraded":"2024-09-19T09:36:13.977120+0000","last_fullsized":"2024-09-19T09:36:13.977120+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:37.646776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.988493+0000","last_change":"2024-09-19T09:36:10.845306+0000","last_active":"2024-09-19T09:36:13.988493+0000","last_peered":"2024-09-19T09:36:13.988493+0000","last_clean":"2024-09-19T09:36:13.988493+0000","last_became_active":"2024-09-19T09:36:10.844952+0000","last_became_peered":"2024-09-19T09:36:10.844952+0000","last_unstale":"2024-09-19T09:36:13.988493+0000","last_undegraded":"2024-09-19T09:36:13.988493+0000","last_fullsized":"2024-09-19T09:36:13.988493+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:09.792482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T09:36:13.980247+0000","last_change":"2024-09-19T09:36:12.991260+0000","last_active":"2024-09-19T09:36:13.980247+0000","last_peered":"2024-09-19T09:36:13.980247+0000","last_clean":"2024-09-19T09:36:13.980247+0000","last_became_active":"2024-09-19T09:36:12.989981+0000","last_became_peered":"2024-09-19T09:36:12.989981+0000","last_unstale":"2024-09-19T09:36:13.980247+0000","last_undegraded":"2024-09-19T09:36:13.980247+0000","last_fullsized":"2024-09-19T09:36:13.980247+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:11.301790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.035873+0000","last_change":"2024-09-19T09:36:10.859016+0000","last_active":"2024-09-19T09:37:15.035873+0000","last_peered":"2024-09-19T09:37:15.035873+0000","last_clean":"2024-09-19T09:37:15.035873+0000","last_became_active":"2024-09-19T09:36:10.858661+0000","last_became_peered":"2024-09-19T09:36:10.858661+0000","last_unstale":"2024-09-19T09:37:15.035873+0000","last_undegraded":"2024-09-19T09:37:15.035873+0000","last_fullsized":"2024-09-19T09:37:15.035873+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:54.395977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":2,"reported_epoch":82,"state":"peering","last_fresh":"2024-09-19T09:36:12.968664+0000","last_change":"2024-09-19T09:37:15.103207+0000","last_active":"2024-09-19T09:36:11.954784+0000","last_peered":"2024-09-19T09:36:11.954784+0000","last_clean":"2024-09-19T09:36:11.954784+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:36:12.968664+0000","last_undegraded":"2024-09-19T09:36:12.968664+0000","last_fullsized":"2024-09-19T09:36:12.968664+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":24,"reported_epoch":81,"state":"peering","last_fresh":"2024-09-19T09:36:22.011606+0000","last_change":"2024-09-19T09:37:15.033807+0000","last_active":"2024-09-19T09:37:15.033807+0000","last_peered":"2024-09-19T09:36:22.011606+0000","last_clean":"2024-09-19T09:36:22.011606+0000","last_became_active":"2024-09-19T09:36:10.840233+0000","last_became_peered":"2024-09-19T09:36:10.840233+0000","last_unstale":"2024-09-19T09:36:22.011606+0000","last_undegraded":"2024-09-19T09:36:22.011606+0000","last_fullsized":"2024-09-19T09:36:22.011606+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7,8,11],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63617,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":123,"num_read_kb":125,"num_write":84,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":191433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":69,"ondisk_log_size":69,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282954,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547227,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":901120,"data_stored":441682,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776160,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1024000,"data_stored":1086118,"data_compressed":38912,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972389,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36200,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708952,"statfs":{"total":95995035648,"available":95957966848,"internally_reserved":0,"allocated":876544,"data_stored":424501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201321,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":424523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430255,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":1014986,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593780,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36200,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708952,"statfs":{"total":95995035648,"available":95957966848,"internally_reserved":0,"allocated":876544,"data_stored":424036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822714,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":962560,"data_stored":1031767,"data_compressed":41852,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953535,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":441122,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215172,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":901120,"data_stored":432958,"data_compressed":2927,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444104,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36272,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708880,"statfs":{"total":95995035648,"available":95957893120,"internally_reserved":0,"allocated":950272,"data_stored":486772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36268,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708884,"statfs":{"total":95995035648,"available":95957897216,"internally_reserved":0,"allocated":946176,"data_stored":486738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":876544,"data_stored":424009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":62853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:37:20.001 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:37:20.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:20 smithi001 ceph-mon[31225]: pgmap v315: 97 pgs: 1 activating, 2 peering, 94 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-19T09:37:20.264 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:20.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:20 smithi022 ceph-mon[35583]: pgmap v315: 97 pgs: 1 activating, 2 peering, 94 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-19T09:37:20.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:20 smithi121 ceph-mon[35577]: pgmap v315: 97 pgs: 1 activating, 2 peering, 94 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-19T09:37:20.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.763+0000 7f46e5af0640 1 -- 172.21.15.1:0/3821569463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46e0100a80 msgr2=0x7f46e0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:20.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.763+0000 7f46e5af0640 1 --2- 172.21.15.1:0/3821569463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46e0100a80 0x7f46e0100ee0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f46d4009930 tx=0x7f46d402a420 comp rx=0 tx=0).stop 2024-09-19T09:37:20.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.763+0000 7f46e5af0640 1 -- 172.21.15.1:0/3821569463 shutdown_connections 2024-09-19T09:37:20.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.763+0000 7f46e5af0640 1 --2- 172.21.15.1:0/3821569463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46e0101420 0x7f46e010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.763+0000 7f46e5af0640 1 --2- 172.21.15.1:0/3821569463 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46e0100a80 0x7f46e0100ee0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.763+0000 7f46e5af0640 1 --2- 172.21.15.1:0/3821569463 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46e0106a80 0x7f46e0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.763+0000 7f46e5af0640 1 -- 172.21.15.1:0/3821569463 >> 172.21.15.1:0/3821569463 conn(0x7f46e00fc7a0 msgr2=0x7f46e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:20.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.763+0000 7f46e5af0640 1 -- 172.21.15.1:0/3821569463 shutdown_connections 2024-09-19T09:37:20.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.763+0000 7f46e5af0640 1 -- 172.21.15.1:0/3821569463 wait complete. 2024-09-19T09:37:20.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.764+0000 7f46e5af0640 1 Processor -- start 2024-09-19T09:37:20.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.764+0000 7f46e5af0640 1 -- start start 2024-09-19T09:37:20.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.764+0000 7f46e5af0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46e0100a80 0x7f46e0198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:20.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.764+0000 7f46e5af0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46e0101420 0x7f46e01989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:20.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.764+0000 7f46e5af0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46e0106a80 0x7f46e019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:20.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.764+0000 7f46e5af0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f46e0110e40 con 0x7f46e0100a80 2024-09-19T09:37:20.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.764+0000 7f46e5af0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f46e0110cc0 con 0x7f46e0101420 2024-09-19T09:37:20.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.764+0000 7f46e5af0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f46e0110fc0 con 0x7f46e0106a80 2024-09-19T09:37:20.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.764+0000 7f46df7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46e0100a80 0x7f46e0198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:20.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.764+0000 7f46df7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46e0100a80 0x7f46e0198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43988/0 (socket says 172.21.15.1:43988) 2024-09-19T09:37:20.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.764+0000 7f46df7fe640 1 -- 172.21.15.1:0/2772680477 learned_addr learned my addr 172.21.15.1:0/2772680477 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:20.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.765+0000 7f46deffd640 1 --2- 172.21.15.1:0/2772680477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46e0101420 0x7f46e01989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:20.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.765+0000 7f46dffff640 1 --2- 172.21.15.1:0/2772680477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46e0106a80 0x7f46e019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:20.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.765+0000 7f46df7fe640 1 -- 172.21.15.1:0/2772680477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46e0106a80 msgr2=0x7f46e019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:20.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.765+0000 7f46df7fe640 1 --2- 172.21.15.1:0/2772680477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46e0106a80 0x7f46e019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.765+0000 7f46df7fe640 1 -- 172.21.15.1:0/2772680477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46e0101420 msgr2=0x7f46e01989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:20.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.765+0000 7f46df7fe640 1 --2- 172.21.15.1:0/2772680477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46e0101420 0x7f46e01989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.777 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.765+0000 7f46df7fe640 1 -- 172.21.15.1:0/2772680477 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e019d440 con 0x7f46e0100a80 2024-09-19T09:37:20.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.765+0000 7f46df7fe640 1 --2- 172.21.15.1:0/2772680477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46e0100a80 0x7f46e0198490 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f46d000d950 tx=0x7f46d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:20.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.765+0000 7f46dcff9640 1 -- 172.21.15.1:0/2772680477 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d0017070 con 0x7f46e0100a80 2024-09-19T09:37:20.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.765+0000 7f46dcff9640 1 -- 172.21.15.1:0/2772680477 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46d0009c30 con 0x7f46e0100a80 2024-09-19T09:37:20.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.765+0000 7f46e5af0640 1 -- 172.21.15.1:0/2772680477 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46e019d730 con 0x7f46e0100a80 2024-09-19T09:37:20.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.765+0000 7f46dcff9640 1 -- 172.21.15.1:0/2772680477 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d000f6b0 con 0x7f46e0100a80 2024-09-19T09:37:20.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.765+0000 7f46e5af0640 1 -- 172.21.15.1:0/2772680477 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46e01a5010 con 0x7f46e0100a80 2024-09-19T09:37:20.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.766+0000 7f46e5af0640 1 -- 172.21.15.1:0/2772680477 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46e0100ee0 con 0x7f46e0100a80 2024-09-19T09:37:20.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.767+0000 7f46dcff9640 1 -- 172.21.15.1:0/2772680477 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f46d00109d0 con 0x7f46e0100a80 2024-09-19T09:37:20.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.768+0000 7f46dcff9640 1 --2- 172.21.15.1:0/2772680477 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f46c80a3350 0x7f46c80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:20.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.768+0000 7f46dcff9640 1 -- 172.21.15.1:0/2772680477 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f46d00cf4e0 con 0x7f46e0100a80 2024-09-19T09:37:20.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.768+0000 7f46deffd640 1 --2- 172.21.15.1:0/2772680477 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f46c80a3350 0x7f46c80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:20.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.769+0000 7f46deffd640 1 --2- 172.21.15.1:0/2772680477 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f46c80a3350 0x7f46c80a5810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f46d4009900 tx=0x7f46d40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:20.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.771+0000 7f46dcff9640 1 -- 172.21.15.1:0/2772680477 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f46d0009de0 con 0x7f46e0100a80 2024-09-19T09:37:20.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.943+0000 7f46e5af0640 1 -- 172.21.15.1:0/2772680477 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f46e00fce60 con 0x7f46c80a3350 2024-09-19T09:37:20.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.952+0000 7f46dcff9640 1 -- 172.21.15.1:0/2772680477 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258871 (secure 0 0 0) 0x7f46e00fce60 con 0x7f46c80a3350 2024-09-19T09:37:20.956 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:37:20.956 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-19T09:37:20.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.954+0000 7f46e5af0640 1 -- 172.21.15.1:0/2772680477 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f46c80a3350 msgr2=0x7f46c80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:20.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.954+0000 7f46e5af0640 1 --2- 172.21.15.1:0/2772680477 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f46c80a3350 0x7f46c80a5810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f46d4009900 tx=0x7f46d40058d0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.955+0000 7f46e5af0640 1 -- 172.21.15.1:0/2772680477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46e0100a80 msgr2=0x7f46e0198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:20.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.955+0000 7f46e5af0640 1 --2- 172.21.15.1:0/2772680477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46e0100a80 0x7f46e0198490 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f46d000d950 tx=0x7f46d000de10 comp rx=0 tx=0).stop 2024-09-19T09:37:20.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.955+0000 7f46e5af0640 1 -- 172.21.15.1:0/2772680477 shutdown_connections 2024-09-19T09:37:20.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.955+0000 7f46e5af0640 1 --2- 172.21.15.1:0/2772680477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f46e0106a80 0x7f46e019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.955+0000 7f46e5af0640 1 --2- 172.21.15.1:0/2772680477 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f46c80a3350 0x7f46c80a5810 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.955+0000 7f46e5af0640 1 --2- 172.21.15.1:0/2772680477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46e0101420 0x7f46e01989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.955+0000 7f46e5af0640 1 --2- 172.21.15.1:0/2772680477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46e0100a80 0x7f46e0198490 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:20.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.955+0000 7f46e5af0640 1 -- 172.21.15.1:0/2772680477 >> 172.21.15.1:0/2772680477 conn(0x7f46e00fc7a0 msgr2=0x7f46e0104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:20.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.955+0000 7f46e5af0640 1 -- 172.21.15.1:0/2772680477 shutdown_connections 2024-09-19T09:37:20.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:20.955+0000 7f46e5af0640 1 -- 172.21.15.1:0/2772680477 wait complete. 2024-09-19T09:37:21.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:21 smithi001 ceph-mon[31225]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:37:21.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:21 smithi022 ceph-mon[35583]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:37:21.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:21 smithi121 ceph-mon[35577]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:37:21.703 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":316,"stamp":"2024-09-19T09:37:20.146778+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654219,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":249,"num_read_kb":234,"num_write":267,"num_write_kb":3027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":295,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":405992,"kb_used_data":10932,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124535832,"statfs":{"total":1151940427776,"available":1151524691968,"internally_reserved":0,"allocated":11194368,"data_stored":7238897,"data_compressed":172479,"data_compressed_allocated":225280,"data_compressed_original":1949696,"omap_allocated":19141,"internal_metadata":404272443},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002308"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.033174+0000","last_change":"2024-09-19T09:36:12.985228+0000","last_active":"2024-09-19T09:37:16.033174+0000","last_peered":"2024-09-19T09:37:16.033174+0000","last_clean":"2024-09-19T09:37:16.033174+0000","last_became_active":"2024-09-19T09:36:12.984306+0000","last_became_peered":"2024-09-19T09:36:12.984306+0000","last_unstale":"2024-09-19T09:37:16.033174+0000","last_undegraded":"2024-09-19T09:37:16.033174+0000","last_fullsized":"2024-09-19T09:37:16.033174+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:45.988859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030264+0000","last_change":"2024-09-19T09:36:12.987631+0000","last_active":"2024-09-19T09:37:16.030264+0000","last_peered":"2024-09-19T09:37:16.030264+0000","last_clean":"2024-09-19T09:37:16.030264+0000","last_became_active":"2024-09-19T09:36:12.987298+0000","last_became_peered":"2024-09-19T09:36:12.987298+0000","last_unstale":"2024-09-19T09:37:16.030264+0000","last_undegraded":"2024-09-19T09:37:16.030264+0000","last_fullsized":"2024-09-19T09:37:16.030264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:47.397162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030230+0000","last_change":"2024-09-19T09:36:12.991466+0000","last_active":"2024-09-19T09:37:16.030230+0000","last_peered":"2024-09-19T09:37:16.030230+0000","last_clean":"2024-09-19T09:37:16.030230+0000","last_became_active":"2024-09-19T09:36:12.990903+0000","last_became_peered":"2024-09-19T09:36:12.990903+0000","last_unstale":"2024-09-19T09:37:16.030230+0000","last_undegraded":"2024-09-19T09:37:16.030230+0000","last_fullsized":"2024-09-19T09:37:16.030230+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:04.128768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028715+0000","last_change":"2024-09-19T09:36:12.986686+0000","last_active":"2024-09-19T09:37:16.028715+0000","last_peered":"2024-09-19T09:37:16.028715+0000","last_clean":"2024-09-19T09:37:16.028715+0000","last_became_active":"2024-09-19T09:36:12.986334+0000","last_became_peered":"2024-09-19T09:36:12.986334+0000","last_unstale":"2024-09-19T09:37:16.028715+0000","last_undegraded":"2024-09-19T09:37:16.028715+0000","last_fullsized":"2024-09-19T09:37:16.028715+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:39.926343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031575+0000","last_change":"2024-09-19T09:36:12.981964+0000","last_active":"2024-09-19T09:37:16.031575+0000","last_peered":"2024-09-19T09:37:16.031575+0000","last_clean":"2024-09-19T09:37:16.031575+0000","last_became_active":"2024-09-19T09:36:12.981558+0000","last_became_peered":"2024-09-19T09:36:12.981558+0000","last_unstale":"2024-09-19T09:37:16.031575+0000","last_undegraded":"2024-09-19T09:37:16.031575+0000","last_fullsized":"2024-09-19T09:37:16.031575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:33.706451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031212+0000","last_change":"2024-09-19T09:36:12.992598+0000","last_active":"2024-09-19T09:37:16.031212+0000","last_peered":"2024-09-19T09:37:16.031212+0000","last_clean":"2024-09-19T09:37:16.031212+0000","last_became_active":"2024-09-19T09:36:12.992281+0000","last_became_peered":"2024-09-19T09:36:12.992281+0000","last_unstale":"2024-09-19T09:37:16.031212+0000","last_undegraded":"2024-09-19T09:37:16.031212+0000","last_fullsized":"2024-09-19T09:37:16.031212+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:26.107432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030075+0000","last_change":"2024-09-19T09:36:12.988583+0000","last_active":"2024-09-19T09:37:16.030075+0000","last_peered":"2024-09-19T09:37:16.030075+0000","last_clean":"2024-09-19T09:37:16.030075+0000","last_became_active":"2024-09-19T09:36:12.987895+0000","last_became_peered":"2024-09-19T09:36:12.987895+0000","last_unstale":"2024-09-19T09:37:16.030075+0000","last_undegraded":"2024-09-19T09:37:16.030075+0000","last_fullsized":"2024-09-19T09:37:16.030075+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:47.617324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.035118+0000","last_change":"2024-09-19T09:36:12.988526+0000","last_active":"2024-09-19T09:37:15.035118+0000","last_peered":"2024-09-19T09:37:15.035118+0000","last_clean":"2024-09-19T09:37:15.035118+0000","last_became_active":"2024-09-19T09:36:12.988093+0000","last_became_peered":"2024-09-19T09:36:12.988093+0000","last_unstale":"2024-09-19T09:37:15.035118+0000","last_undegraded":"2024-09-19T09:37:15.035118+0000","last_fullsized":"2024-09-19T09:37:15.035118+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:48.949397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.123768+0000","last_change":"2024-09-19T09:36:12.992360+0000","last_active":"2024-09-19T09:37:16.123768+0000","last_peered":"2024-09-19T09:37:16.123768+0000","last_clean":"2024-09-19T09:37:16.123768+0000","last_became_active":"2024-09-19T09:36:12.991833+0000","last_became_peered":"2024-09-19T09:36:12.991833+0000","last_unstale":"2024-09-19T09:37:16.123768+0000","last_undegraded":"2024-09-19T09:37:16.123768+0000","last_fullsized":"2024-09-19T09:37:16.123768+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:47.715012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031904+0000","last_change":"2024-09-19T09:36:12.993435+0000","last_active":"2024-09-19T09:37:16.031904+0000","last_peered":"2024-09-19T09:37:16.031904+0000","last_clean":"2024-09-19T09:37:16.031904+0000","last_became_active":"2024-09-19T09:36:12.993108+0000","last_became_peered":"2024-09-19T09:36:12.993108+0000","last_unstale":"2024-09-19T09:37:16.031904+0000","last_undegraded":"2024-09-19T09:37:16.031904+0000","last_fullsized":"2024-09-19T09:37:16.031904+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:54.453593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030726+0000","last_change":"2024-09-19T09:36:12.991044+0000","last_active":"2024-09-19T09:37:16.030726+0000","last_peered":"2024-09-19T09:37:16.030726+0000","last_clean":"2024-09-19T09:37:16.030726+0000","last_became_active":"2024-09-19T09:36:12.989955+0000","last_became_peered":"2024-09-19T09:36:12.989955+0000","last_unstale":"2024-09-19T09:37:16.030726+0000","last_undegraded":"2024-09-19T09:37:16.030726+0000","last_fullsized":"2024-09-19T09:37:16.030726+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:21.034023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028894+0000","last_change":"2024-09-19T09:36:12.989679+0000","last_active":"2024-09-19T09:37:16.028894+0000","last_peered":"2024-09-19T09:37:16.028894+0000","last_clean":"2024-09-19T09:37:16.028894+0000","last_became_active":"2024-09-19T09:36:12.988463+0000","last_became_peered":"2024-09-19T09:36:12.988463+0000","last_unstale":"2024-09-19T09:37:16.028894+0000","last_undegraded":"2024-09-19T09:37:16.028894+0000","last_fullsized":"2024-09-19T09:37:16.028894+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:28.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034644+0000","last_change":"2024-09-19T09:36:12.983494+0000","last_active":"2024-09-19T09:37:16.034644+0000","last_peered":"2024-09-19T09:37:16.034644+0000","last_clean":"2024-09-19T09:37:16.034644+0000","last_became_active":"2024-09-19T09:36:12.983143+0000","last_became_peered":"2024-09-19T09:36:12.983143+0000","last_unstale":"2024-09-19T09:37:16.034644+0000","last_undegraded":"2024-09-19T09:37:16.034644+0000","last_fullsized":"2024-09-19T09:37:16.034644+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:23.378183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030018+0000","last_change":"2024-09-19T09:36:12.987512+0000","last_active":"2024-09-19T09:37:16.030018+0000","last_peered":"2024-09-19T09:37:16.030018+0000","last_clean":"2024-09-19T09:37:16.030018+0000","last_became_active":"2024-09-19T09:36:12.987288+0000","last_became_peered":"2024-09-19T09:36:12.987288+0000","last_unstale":"2024-09-19T09:37:16.030018+0000","last_undegraded":"2024-09-19T09:37:16.030018+0000","last_fullsized":"2024-09-19T09:37:16.030018+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:14.614333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.131000+0000","last_change":"2024-09-19T09:37:16.131000+0000","last_active":"2024-09-19T09:37:16.131000+0000","last_peered":"2024-09-19T09:37:16.131000+0000","last_clean":"2024-09-19T09:37:16.131000+0000","last_became_active":"2024-09-19T09:37:16.130647+0000","last_became_peered":"2024-09-19T09:37:16.130647+0000","last_unstale":"2024-09-19T09:37:16.131000+0000","last_undegraded":"2024-09-19T09:37:16.131000+0000","last_fullsized":"2024-09-19T09:37:16.131000+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:22.498318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.123244+0000","last_change":"2024-09-19T09:36:12.988210+0000","last_active":"2024-09-19T09:37:16.123244+0000","last_peered":"2024-09-19T09:37:16.123244+0000","last_clean":"2024-09-19T09:37:16.123244+0000","last_became_active":"2024-09-19T09:36:12.987904+0000","last_became_peered":"2024-09-19T09:36:12.987904+0000","last_unstale":"2024-09-19T09:37:16.123244+0000","last_undegraded":"2024-09-19T09:37:16.123244+0000","last_fullsized":"2024-09-19T09:37:16.123244+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:13.588237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.033392+0000","last_change":"2024-09-19T09:36:12.984028+0000","last_active":"2024-09-19T09:37:16.033392+0000","last_peered":"2024-09-19T09:37:16.033392+0000","last_clean":"2024-09-19T09:37:16.033392+0000","last_became_active":"2024-09-19T09:36:12.982062+0000","last_became_peered":"2024-09-19T09:36:12.982062+0000","last_unstale":"2024-09-19T09:37:16.033392+0000","last_undegraded":"2024-09-19T09:37:16.033392+0000","last_fullsized":"2024-09-19T09:37:16.033392+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:26.610287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.027961+0000","last_change":"2024-09-19T09:36:12.979277+0000","last_active":"2024-09-19T09:37:16.027961+0000","last_peered":"2024-09-19T09:37:16.027961+0000","last_clean":"2024-09-19T09:37:16.027961+0000","last_became_active":"2024-09-19T09:36:12.978970+0000","last_became_peered":"2024-09-19T09:36:12.978970+0000","last_unstale":"2024-09-19T09:37:16.027961+0000","last_undegraded":"2024-09-19T09:37:16.027961+0000","last_fullsized":"2024-09-19T09:37:16.027961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:00.424728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.130307+0000","last_change":"2024-09-19T09:36:12.981021+0000","last_active":"2024-09-19T09:37:16.130307+0000","last_peered":"2024-09-19T09:37:16.130307+0000","last_clean":"2024-09-19T09:37:16.130307+0000","last_became_active":"2024-09-19T09:36:12.980580+0000","last_became_peered":"2024-09-19T09:36:12.980580+0000","last_unstale":"2024-09-19T09:37:16.130307+0000","last_undegraded":"2024-09-19T09:37:16.130307+0000","last_fullsized":"2024-09-19T09:37:16.130307+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:17.464873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.032578+0000","last_change":"2024-09-19T09:36:12.986090+0000","last_active":"2024-09-19T09:37:16.032578+0000","last_peered":"2024-09-19T09:37:16.032578+0000","last_clean":"2024-09-19T09:37:16.032578+0000","last_became_active":"2024-09-19T09:36:12.985740+0000","last_became_peered":"2024-09-19T09:36:12.985740+0000","last_unstale":"2024-09-19T09:37:16.032578+0000","last_undegraded":"2024-09-19T09:37:16.032578+0000","last_fullsized":"2024-09-19T09:37:16.032578+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:35.252834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034672+0000","last_change":"2024-09-19T09:36:12.981257+0000","last_active":"2024-09-19T09:37:16.034672+0000","last_peered":"2024-09-19T09:37:16.034672+0000","last_clean":"2024-09-19T09:37:16.034672+0000","last_became_active":"2024-09-19T09:36:12.980911+0000","last_became_peered":"2024-09-19T09:36:12.980911+0000","last_unstale":"2024-09-19T09:37:16.034672+0000","last_undegraded":"2024-09-19T09:37:16.034672+0000","last_fullsized":"2024-09-19T09:37:16.034672+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:41.470514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.123641+0000","last_change":"2024-09-19T09:36:12.982585+0000","last_active":"2024-09-19T09:37:16.123641+0000","last_peered":"2024-09-19T09:37:16.123641+0000","last_clean":"2024-09-19T09:37:16.123641+0000","last_became_active":"2024-09-19T09:36:12.982193+0000","last_became_peered":"2024-09-19T09:36:12.982193+0000","last_unstale":"2024-09-19T09:37:16.123641+0000","last_undegraded":"2024-09-19T09:37:16.123641+0000","last_fullsized":"2024-09-19T09:37:16.123641+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:30.057088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.034505+0000","last_change":"2024-09-19T09:36:12.985236+0000","last_active":"2024-09-19T09:37:15.034505+0000","last_peered":"2024-09-19T09:37:15.034505+0000","last_clean":"2024-09-19T09:37:15.034505+0000","last_became_active":"2024-09-19T09:36:12.984751+0000","last_became_peered":"2024-09-19T09:36:12.984751+0000","last_unstale":"2024-09-19T09:37:15.034505+0000","last_undegraded":"2024-09-19T09:37:15.034505+0000","last_fullsized":"2024-09-19T09:37:15.034505+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:52.784216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029585+0000","last_change":"2024-09-19T09:36:12.985856+0000","last_active":"2024-09-19T09:37:16.029585+0000","last_peered":"2024-09-19T09:37:16.029585+0000","last_clean":"2024-09-19T09:37:16.029585+0000","last_became_active":"2024-09-19T09:36:12.985312+0000","last_became_peered":"2024-09-19T09:36:12.985312+0000","last_unstale":"2024-09-19T09:37:16.029585+0000","last_undegraded":"2024-09-19T09:37:16.029585+0000","last_fullsized":"2024-09-19T09:37:16.029585+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:25.235945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.035794+0000","last_change":"2024-09-19T09:36:12.982443+0000","last_active":"2024-09-19T09:37:15.035794+0000","last_peered":"2024-09-19T09:37:15.035794+0000","last_clean":"2024-09-19T09:37:15.035794+0000","last_became_active":"2024-09-19T09:36:12.982130+0000","last_became_peered":"2024-09-19T09:36:12.982130+0000","last_unstale":"2024-09-19T09:37:15.035794+0000","last_undegraded":"2024-09-19T09:37:15.035794+0000","last_fullsized":"2024-09-19T09:37:15.035794+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:17.177563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.130468+0000","last_change":"2024-09-19T09:36:12.990439+0000","last_active":"2024-09-19T09:37:16.130468+0000","last_peered":"2024-09-19T09:37:16.130468+0000","last_clean":"2024-09-19T09:37:16.130468+0000","last_became_active":"2024-09-19T09:36:12.990135+0000","last_became_peered":"2024-09-19T09:36:12.990135+0000","last_unstale":"2024-09-19T09:37:16.130468+0000","last_undegraded":"2024-09-19T09:37:16.130468+0000","last_fullsized":"2024-09-19T09:37:16.130468+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:51.685192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.032815+0000","last_change":"2024-09-19T09:36:12.987261+0000","last_active":"2024-09-19T09:37:16.032815+0000","last_peered":"2024-09-19T09:37:16.032815+0000","last_clean":"2024-09-19T09:37:16.032815+0000","last_became_active":"2024-09-19T09:36:12.986192+0000","last_became_peered":"2024-09-19T09:36:12.986192+0000","last_unstale":"2024-09-19T09:37:16.032815+0000","last_undegraded":"2024-09-19T09:37:16.032815+0000","last_fullsized":"2024-09-19T09:37:16.032815+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:58.435605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034502+0000","last_change":"2024-09-19T09:36:12.981248+0000","last_active":"2024-09-19T09:37:16.034502+0000","last_peered":"2024-09-19T09:37:16.034502+0000","last_clean":"2024-09-19T09:37:16.034502+0000","last_became_active":"2024-09-19T09:36:12.980754+0000","last_became_peered":"2024-09-19T09:36:12.980754+0000","last_unstale":"2024-09-19T09:37:16.034502+0000","last_undegraded":"2024-09-19T09:37:16.034502+0000","last_fullsized":"2024-09-19T09:37:16.034502+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:03.970402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030143+0000","last_change":"2024-09-19T09:36:12.990841+0000","last_active":"2024-09-19T09:37:16.030143+0000","last_peered":"2024-09-19T09:37:16.030143+0000","last_clean":"2024-09-19T09:37:16.030143+0000","last_became_active":"2024-09-19T09:36:12.989667+0000","last_became_peered":"2024-09-19T09:36:12.989667+0000","last_unstale":"2024-09-19T09:37:16.030143+0000","last_undegraded":"2024-09-19T09:37:16.030143+0000","last_fullsized":"2024-09-19T09:37:16.030143+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:46:00.314590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.129743+0000","last_change":"2024-09-19T09:36:12.984007+0000","last_active":"2024-09-19T09:37:16.129743+0000","last_peered":"2024-09-19T09:37:16.129743+0000","last_clean":"2024-09-19T09:37:16.129743+0000","last_became_active":"2024-09-19T09:36:12.983627+0000","last_became_peered":"2024-09-19T09:36:12.983627+0000","last_unstale":"2024-09-19T09:37:16.129743+0000","last_undegraded":"2024-09-19T09:37:16.129743+0000","last_fullsized":"2024-09-19T09:37:16.129743+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:42.038673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.129893+0000","last_change":"2024-09-19T09:36:12.988032+0000","last_active":"2024-09-19T09:37:16.129893+0000","last_peered":"2024-09-19T09:37:16.129893+0000","last_clean":"2024-09-19T09:37:16.129893+0000","last_became_active":"2024-09-19T09:36:12.987588+0000","last_became_peered":"2024-09-19T09:36:12.987588+0000","last_unstale":"2024-09-19T09:37:16.129893+0000","last_undegraded":"2024-09-19T09:37:16.129893+0000","last_fullsized":"2024-09-19T09:37:16.129893+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:01.518543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.131565+0000","last_change":"2024-09-19T09:37:16.131565+0000","last_active":"2024-09-19T09:37:16.131565+0000","last_peered":"2024-09-19T09:37:16.131565+0000","last_clean":"2024-09-19T09:37:16.131565+0000","last_became_active":"2024-09-19T09:37:16.131171+0000","last_became_peered":"2024-09-19T09:37:16.131171+0000","last_unstale":"2024-09-19T09:37:16.131565+0000","last_undegraded":"2024-09-19T09:37:16.131565+0000","last_fullsized":"2024-09-19T09:37:16.131565+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:18.195074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031827+0000","last_change":"2024-09-19T09:36:12.989709+0000","last_active":"2024-09-19T09:37:16.031827+0000","last_peered":"2024-09-19T09:37:16.031827+0000","last_clean":"2024-09-19T09:37:16.031827+0000","last_became_active":"2024-09-19T09:36:12.989324+0000","last_became_peered":"2024-09-19T09:36:12.989324+0000","last_unstale":"2024-09-19T09:37:16.031827+0000","last_undegraded":"2024-09-19T09:37:16.031827+0000","last_fullsized":"2024-09-19T09:37:16.031827+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:09.843175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.033713+0000","last_change":"2024-09-19T09:37:16.033713+0000","last_active":"2024-09-19T09:37:16.033713+0000","last_peered":"2024-09-19T09:37:16.033713+0000","last_clean":"2024-09-19T09:37:16.033713+0000","last_became_active":"2024-09-19T09:37:16.033230+0000","last_became_peered":"2024-09-19T09:37:16.033230+0000","last_unstale":"2024-09-19T09:37:16.033713+0000","last_undegraded":"2024-09-19T09:37:16.033713+0000","last_fullsized":"2024-09-19T09:37:16.033713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:12.262115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.484760+0000","last_change":"2024-09-19T09:37:16.484760+0000","last_active":"2024-09-19T09:37:16.484760+0000","last_peered":"2024-09-19T09:37:16.484760+0000","last_clean":"2024-09-19T09:37:16.484760+0000","last_became_active":"2024-09-19T09:37:16.484316+0000","last_became_peered":"2024-09-19T09:37:16.484316+0000","last_unstale":"2024-09-19T09:37:16.484760+0000","last_undegraded":"2024-09-19T09:37:16.484760+0000","last_fullsized":"2024-09-19T09:37:16.484760+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:14.897601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"activating","last_fresh":"2024-09-19T09:37:16.032079+0000","last_change":"2024-09-19T09:37:16.032079+0000","last_active":"2024-09-19T09:37:15.027769+0000","last_peered":"2024-09-19T09:36:13.976634+0000","last_clean":"2024-09-19T09:36:13.976634+0000","last_became_active":"2024-09-19T09:36:10.839074+0000","last_became_peered":"2024-09-19T09:36:10.839074+0000","last_unstale":"2024-09-19T09:37:16.032079+0000","last_undegraded":"2024-09-19T09:37:16.032079+0000","last_fullsized":"2024-09-19T09:37:16.032079+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":["10","1","6","8"],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034105+0000","last_change":"2024-09-19T09:36:10.837287+0000","last_active":"2024-09-19T09:37:16.034105+0000","last_peered":"2024-09-19T09:37:16.034105+0000","last_clean":"2024-09-19T09:37:16.034105+0000","last_became_active":"2024-09-19T09:36:10.836890+0000","last_became_peered":"2024-09-19T09:36:10.836890+0000","last_unstale":"2024-09-19T09:37:16.034105+0000","last_undegraded":"2024-09-19T09:37:16.034105+0000","last_fullsized":"2024-09-19T09:37:16.034105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:09.676728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.035236+0000","last_change":"2024-09-19T09:36:12.975690+0000","last_active":"2024-09-19T09:37:15.035236+0000","last_peered":"2024-09-19T09:37:15.035236+0000","last_clean":"2024-09-19T09:37:15.035236+0000","last_became_active":"2024-09-19T09:36:12.975370+0000","last_became_peered":"2024-09-19T09:36:12.975370+0000","last_unstale":"2024-09-19T09:37:15.035236+0000","last_undegraded":"2024-09-19T09:37:15.035236+0000","last_fullsized":"2024-09-19T09:37:15.035236+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:05.650917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030234+0000","last_change":"2024-09-19T09:36:10.843736+0000","last_active":"2024-09-19T09:37:16.030234+0000","last_peered":"2024-09-19T09:37:16.030234+0000","last_clean":"2024-09-19T09:37:16.030234+0000","last_became_active":"2024-09-19T09:36:10.843353+0000","last_became_peered":"2024-09-19T09:36:10.843353+0000","last_unstale":"2024-09-19T09:37:16.030234+0000","last_undegraded":"2024-09-19T09:37:16.030234+0000","last_fullsized":"2024-09-19T09:37:16.030234+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:29.818642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.027711+0000","last_change":"2024-09-19T09:36:12.978841+0000","last_active":"2024-09-19T09:37:16.027711+0000","last_peered":"2024-09-19T09:37:16.027711+0000","last_clean":"2024-09-19T09:37:16.027711+0000","last_became_active":"2024-09-19T09:36:12.978501+0000","last_became_peered":"2024-09-19T09:36:12.978501+0000","last_unstale":"2024-09-19T09:37:16.027711+0000","last_undegraded":"2024-09-19T09:37:16.027711+0000","last_fullsized":"2024-09-19T09:37:16.027711+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:07.974576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.032030+0000","last_change":"2024-09-19T09:36:10.841997+0000","last_active":"2024-09-19T09:37:16.032030+0000","last_peered":"2024-09-19T09:37:16.032030+0000","last_clean":"2024-09-19T09:37:16.032030+0000","last_became_active":"2024-09-19T09:36:10.841641+0000","last_became_peered":"2024-09-19T09:36:10.841641+0000","last_unstale":"2024-09-19T09:37:16.032030+0000","last_undegraded":"2024-09-19T09:37:16.032030+0000","last_fullsized":"2024-09-19T09:37:16.032030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:10.477879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.123718+0000","last_change":"2024-09-19T09:36:12.981486+0000","last_active":"2024-09-19T09:37:16.123718+0000","last_peered":"2024-09-19T09:37:16.123718+0000","last_clean":"2024-09-19T09:37:16.123718+0000","last_became_active":"2024-09-19T09:36:12.981165+0000","last_became_peered":"2024-09-19T09:36:12.981165+0000","last_unstale":"2024-09-19T09:37:16.123718+0000","last_undegraded":"2024-09-19T09:37:16.123718+0000","last_fullsized":"2024-09-19T09:37:16.123718+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:21.986132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030755+0000","last_change":"2024-09-19T09:36:10.845362+0000","last_active":"2024-09-19T09:37:16.030755+0000","last_peered":"2024-09-19T09:37:16.030755+0000","last_clean":"2024-09-19T09:37:16.030755+0000","last_became_active":"2024-09-19T09:36:10.844992+0000","last_became_peered":"2024-09-19T09:36:10.844992+0000","last_unstale":"2024-09-19T09:37:16.030755+0000","last_undegraded":"2024-09-19T09:37:16.030755+0000","last_fullsized":"2024-09-19T09:37:16.030755+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:52.854333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030434+0000","last_change":"2024-09-19T09:36:12.988924+0000","last_active":"2024-09-19T09:37:16.030434+0000","last_peered":"2024-09-19T09:37:16.030434+0000","last_clean":"2024-09-19T09:37:16.030434+0000","last_became_active":"2024-09-19T09:36:12.988331+0000","last_became_peered":"2024-09-19T09:36:12.988331+0000","last_unstale":"2024-09-19T09:37:16.030434+0000","last_undegraded":"2024-09-19T09:37:16.030434+0000","last_fullsized":"2024-09-19T09:37:16.030434+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:24.754252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029903+0000","last_change":"2024-09-19T09:36:10.860003+0000","last_active":"2024-09-19T09:37:16.029903+0000","last_peered":"2024-09-19T09:37:16.029903+0000","last_clean":"2024-09-19T09:37:16.029903+0000","last_became_active":"2024-09-19T09:36:10.859584+0000","last_became_peered":"2024-09-19T09:36:10.859584+0000","last_unstale":"2024-09-19T09:37:16.029903+0000","last_undegraded":"2024-09-19T09:37:16.029903+0000","last_fullsized":"2024-09-19T09:37:16.029903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:44.837960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.123413+0000","last_change":"2024-09-19T09:36:12.985446+0000","last_active":"2024-09-19T09:37:16.123413+0000","last_peered":"2024-09-19T09:37:16.123413+0000","last_clean":"2024-09-19T09:37:16.123413+0000","last_became_active":"2024-09-19T09:36:12.984671+0000","last_became_peered":"2024-09-19T09:36:12.984671+0000","last_unstale":"2024-09-19T09:37:16.123413+0000","last_undegraded":"2024-09-19T09:37:16.123413+0000","last_fullsized":"2024-09-19T09:37:16.123413+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:54.800151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'27","reported_seq":166,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.032261+0000","last_change":"2024-09-19T09:36:10.841056+0000","last_active":"2024-09-19T09:37:16.032261+0000","last_peered":"2024-09-19T09:37:16.032261+0000","last_clean":"2024-09-19T09:37:16.032261+0000","last_became_active":"2024-09-19T09:36:10.840731+0000","last_became_peered":"2024-09-19T09:36:10.840731+0000","last_unstale":"2024-09-19T09:37:16.032261+0000","last_undegraded":"2024-09-19T09:37:16.032261+0000","last_fullsized":"2024-09-19T09:37:16.032261+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:13.676188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62819,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":117,"num_read_kb":119,"num_write":27,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030607+0000","last_change":"2024-09-19T09:36:12.990223+0000","last_active":"2024-09-19T09:37:16.030607+0000","last_peered":"2024-09-19T09:37:16.030607+0000","last_clean":"2024-09-19T09:37:16.030607+0000","last_became_active":"2024-09-19T09:36:12.989720+0000","last_became_peered":"2024-09-19T09:36:12.989720+0000","last_unstale":"2024-09-19T09:37:16.030607+0000","last_undegraded":"2024-09-19T09:37:16.030607+0000","last_fullsized":"2024-09-19T09:37:16.030607+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:37.003075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.129753+0000","last_change":"2024-09-19T09:36:10.843288+0000","last_active":"2024-09-19T09:37:16.129753+0000","last_peered":"2024-09-19T09:37:16.129753+0000","last_clean":"2024-09-19T09:37:16.129753+0000","last_became_active":"2024-09-19T09:36:10.842844+0000","last_became_peered":"2024-09-19T09:36:10.842844+0000","last_unstale":"2024-09-19T09:37:16.129753+0000","last_undegraded":"2024-09-19T09:37:16.129753+0000","last_fullsized":"2024-09-19T09:37:16.129753+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:38.695411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034196+0000","last_change":"2024-09-19T09:36:12.981251+0000","last_active":"2024-09-19T09:37:16.034196+0000","last_peered":"2024-09-19T09:37:16.034196+0000","last_clean":"2024-09-19T09:37:16.034196+0000","last_became_active":"2024-09-19T09:36:12.980861+0000","last_became_peered":"2024-09-19T09:36:12.980861+0000","last_unstale":"2024-09-19T09:37:16.034196+0000","last_undegraded":"2024-09-19T09:37:16.034196+0000","last_fullsized":"2024-09-19T09:37:16.034196+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:09.633644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030128+0000","last_change":"2024-09-19T09:36:10.843448+0000","last_active":"2024-09-19T09:37:16.030128+0000","last_peered":"2024-09-19T09:37:16.030128+0000","last_clean":"2024-09-19T09:37:16.030128+0000","last_became_active":"2024-09-19T09:36:10.843087+0000","last_became_peered":"2024-09-19T09:36:10.843087+0000","last_unstale":"2024-09-19T09:37:16.030128+0000","last_undegraded":"2024-09-19T09:37:16.030128+0000","last_fullsized":"2024-09-19T09:37:16.030128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:20.623613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030593+0000","last_change":"2024-09-19T09:36:12.981160+0000","last_active":"2024-09-19T09:37:16.030593+0000","last_peered":"2024-09-19T09:37:16.030593+0000","last_clean":"2024-09-19T09:37:16.030593+0000","last_became_active":"2024-09-19T09:36:12.980823+0000","last_became_peered":"2024-09-19T09:36:12.980823+0000","last_unstale":"2024-09-19T09:37:16.030593+0000","last_undegraded":"2024-09-19T09:37:16.030593+0000","last_fullsized":"2024-09-19T09:37:16.030593+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:39.323439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028480+0000","last_change":"2024-09-19T09:36:10.842536+0000","last_active":"2024-09-19T09:37:16.028480+0000","last_peered":"2024-09-19T09:37:16.028480+0000","last_clean":"2024-09-19T09:37:16.028480+0000","last_became_active":"2024-09-19T09:36:10.842176+0000","last_became_peered":"2024-09-19T09:36:10.842176+0000","last_unstale":"2024-09-19T09:37:16.028480+0000","last_undegraded":"2024-09-19T09:37:16.028480+0000","last_fullsized":"2024-09-19T09:37:16.028480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:37.871299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030057+0000","last_change":"2024-09-19T09:36:12.987271+0000","last_active":"2024-09-19T09:37:16.030057+0000","last_peered":"2024-09-19T09:37:16.030057+0000","last_clean":"2024-09-19T09:37:16.030057+0000","last_became_active":"2024-09-19T09:36:12.986918+0000","last_became_peered":"2024-09-19T09:36:12.986918+0000","last_unstale":"2024-09-19T09:37:16.030057+0000","last_undegraded":"2024-09-19T09:37:16.030057+0000","last_fullsized":"2024-09-19T09:37:16.030057+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:07.608541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030337+0000","last_change":"2024-09-19T09:36:10.860370+0000","last_active":"2024-09-19T09:37:16.030337+0000","last_peered":"2024-09-19T09:37:16.030337+0000","last_clean":"2024-09-19T09:37:16.030337+0000","last_became_active":"2024-09-19T09:36:10.859820+0000","last_became_peered":"2024-09-19T09:36:10.859820+0000","last_unstale":"2024-09-19T09:37:16.030337+0000","last_undegraded":"2024-09-19T09:37:16.030337+0000","last_fullsized":"2024-09-19T09:37:16.030337+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:12.121038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029793+0000","last_change":"2024-09-19T09:36:12.994449+0000","last_active":"2024-09-19T09:37:16.029793+0000","last_peered":"2024-09-19T09:37:16.029793+0000","last_clean":"2024-09-19T09:37:16.029793+0000","last_became_active":"2024-09-19T09:36:12.994141+0000","last_became_peered":"2024-09-19T09:36:12.994141+0000","last_unstale":"2024-09-19T09:37:16.029793+0000","last_undegraded":"2024-09-19T09:37:16.029793+0000","last_fullsized":"2024-09-19T09:37:16.029793+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:21.416453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031764+0000","last_change":"2024-09-19T09:36:10.839609+0000","last_active":"2024-09-19T09:37:16.031764+0000","last_peered":"2024-09-19T09:37:16.031764+0000","last_clean":"2024-09-19T09:37:16.031764+0000","last_became_active":"2024-09-19T09:36:10.839227+0000","last_became_peered":"2024-09-19T09:36:10.839227+0000","last_unstale":"2024-09-19T09:37:16.031764+0000","last_undegraded":"2024-09-19T09:37:16.031764+0000","last_fullsized":"2024-09-19T09:37:16.031764+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:00.734924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.032825+0000","last_change":"2024-09-19T09:36:12.983573+0000","last_active":"2024-09-19T09:37:16.032825+0000","last_peered":"2024-09-19T09:37:16.032825+0000","last_clean":"2024-09-19T09:37:16.032825+0000","last_became_active":"2024-09-19T09:36:12.983241+0000","last_became_peered":"2024-09-19T09:36:12.983241+0000","last_unstale":"2024-09-19T09:37:16.032825+0000","last_undegraded":"2024-09-19T09:37:16.032825+0000","last_fullsized":"2024-09-19T09:37:16.032825+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:44.050271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034765+0000","last_change":"2024-09-19T09:36:10.839789+0000","last_active":"2024-09-19T09:37:16.034765+0000","last_peered":"2024-09-19T09:37:16.034765+0000","last_clean":"2024-09-19T09:37:16.034765+0000","last_became_active":"2024-09-19T09:36:10.839445+0000","last_became_peered":"2024-09-19T09:36:10.839445+0000","last_unstale":"2024-09-19T09:37:16.034765+0000","last_undegraded":"2024-09-19T09:37:16.034765+0000","last_fullsized":"2024-09-19T09:37:16.034765+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:16.040249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031041+0000","last_change":"2024-09-19T09:36:12.993420+0000","last_active":"2024-09-19T09:37:16.031041+0000","last_peered":"2024-09-19T09:37:16.031041+0000","last_clean":"2024-09-19T09:37:16.031041+0000","last_became_active":"2024-09-19T09:36:12.992334+0000","last_became_peered":"2024-09-19T09:36:12.992334+0000","last_unstale":"2024-09-19T09:37:16.031041+0000","last_undegraded":"2024-09-19T09:37:16.031041+0000","last_fullsized":"2024-09-19T09:37:16.031041+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:21.693164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030247+0000","last_change":"2024-09-19T09:36:10.839461+0000","last_active":"2024-09-19T09:37:16.030247+0000","last_peered":"2024-09-19T09:37:16.030247+0000","last_clean":"2024-09-19T09:37:16.030247+0000","last_became_active":"2024-09-19T09:36:10.839092+0000","last_became_peered":"2024-09-19T09:36:10.839092+0000","last_unstale":"2024-09-19T09:37:16.030247+0000","last_undegraded":"2024-09-19T09:37:16.030247+0000","last_fullsized":"2024-09-19T09:37:16.030247+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:02.367267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030632+0000","last_change":"2024-09-19T09:36:12.988234+0000","last_active":"2024-09-19T09:37:16.030632+0000","last_peered":"2024-09-19T09:37:16.030632+0000","last_clean":"2024-09-19T09:37:16.030632+0000","last_became_active":"2024-09-19T09:36:12.987813+0000","last_became_peered":"2024-09-19T09:36:12.987813+0000","last_unstale":"2024-09-19T09:37:16.030632+0000","last_undegraded":"2024-09-19T09:37:16.030632+0000","last_fullsized":"2024-09-19T09:37:16.030632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:56.024428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.130482+0000","last_change":"2024-09-19T09:36:10.945705+0000","last_active":"2024-09-19T09:37:16.130482+0000","last_peered":"2024-09-19T09:37:16.130482+0000","last_clean":"2024-09-19T09:37:16.130482+0000","last_became_active":"2024-09-19T09:36:10.945323+0000","last_became_peered":"2024-09-19T09:36:10.945323+0000","last_unstale":"2024-09-19T09:37:16.130482+0000","last_undegraded":"2024-09-19T09:37:16.130482+0000","last_fullsized":"2024-09-19T09:37:16.130482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:24.211909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030856+0000","last_change":"2024-09-19T09:36:12.990517+0000","last_active":"2024-09-19T09:37:16.030856+0000","last_peered":"2024-09-19T09:37:16.030856+0000","last_clean":"2024-09-19T09:37:16.030856+0000","last_became_active":"2024-09-19T09:36:12.989291+0000","last_became_peered":"2024-09-19T09:36:12.989291+0000","last_unstale":"2024-09-19T09:37:16.030856+0000","last_undegraded":"2024-09-19T09:37:16.030856+0000","last_fullsized":"2024-09-19T09:37:16.030856+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:31.087798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":338,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030324+0000","last_change":"2024-09-19T09:34:59.337025+0000","last_active":"2024-09-19T09:37:16.030324+0000","last_peered":"2024-09-19T09:37:16.030324+0000","last_clean":"2024-09-19T09:37:16.030324+0000","last_became_active":"2024-09-19T09:34:59.336556+0000","last_became_peered":"2024-09-19T09:34:59.336556+0000","last_unstale":"2024-09-19T09:37:16.030324+0000","last_undegraded":"2024-09-19T09:37:16.030324+0000","last_fullsized":"2024-09-19T09:37:16.030324+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:31:30.566923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:31:30.566923+0000","last_clean_scrub_stamp":"2024-09-19T09:31:30.566923+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:00.675254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028715+0000","last_change":"2024-09-19T09:36:10.838131+0000","last_active":"2024-09-19T09:37:16.028715+0000","last_peered":"2024-09-19T09:37:16.028715+0000","last_clean":"2024-09-19T09:37:16.028715+0000","last_became_active":"2024-09-19T09:36:10.837725+0000","last_became_peered":"2024-09-19T09:36:10.837725+0000","last_unstale":"2024-09-19T09:37:16.028715+0000","last_undegraded":"2024-09-19T09:37:16.028715+0000","last_fullsized":"2024-09-19T09:37:16.028715+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:57.104726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.035242+0000","last_change":"2024-09-19T09:36:12.981951+0000","last_active":"2024-09-19T09:37:15.035242+0000","last_peered":"2024-09-19T09:37:15.035242+0000","last_clean":"2024-09-19T09:37:15.035242+0000","last_became_active":"2024-09-19T09:36:12.981558+0000","last_became_peered":"2024-09-19T09:36:12.981558+0000","last_unstale":"2024-09-19T09:37:15.035242+0000","last_undegraded":"2024-09-19T09:37:15.035242+0000","last_fullsized":"2024-09-19T09:37:15.035242+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:31.119853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030184+0000","last_change":"2024-09-19T09:36:10.843574+0000","last_active":"2024-09-19T09:37:16.030184+0000","last_peered":"2024-09-19T09:37:16.030184+0000","last_clean":"2024-09-19T09:37:16.030184+0000","last_became_active":"2024-09-19T09:36:10.843252+0000","last_became_peered":"2024-09-19T09:36:10.843252+0000","last_unstale":"2024-09-19T09:37:16.030184+0000","last_undegraded":"2024-09-19T09:37:16.030184+0000","last_fullsized":"2024-09-19T09:37:16.030184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:10.492812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.033999+0000","last_change":"2024-09-19T09:36:12.984538+0000","last_active":"2024-09-19T09:37:16.033999+0000","last_peered":"2024-09-19T09:37:16.033999+0000","last_clean":"2024-09-19T09:37:16.033999+0000","last_became_active":"2024-09-19T09:36:12.983448+0000","last_became_peered":"2024-09-19T09:36:12.983448+0000","last_unstale":"2024-09-19T09:37:16.033999+0000","last_undegraded":"2024-09-19T09:37:16.033999+0000","last_fullsized":"2024-09-19T09:37:16.033999+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:48.294473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034208+0000","last_change":"2024-09-19T09:36:10.858959+0000","last_active":"2024-09-19T09:37:16.034208+0000","last_peered":"2024-09-19T09:37:16.034208+0000","last_clean":"2024-09-19T09:37:16.034208+0000","last_became_active":"2024-09-19T09:36:10.858638+0000","last_became_peered":"2024-09-19T09:36:10.858638+0000","last_unstale":"2024-09-19T09:37:16.034208+0000","last_undegraded":"2024-09-19T09:37:16.034208+0000","last_fullsized":"2024-09-19T09:37:16.034208+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:12.646483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029679+0000","last_change":"2024-09-19T09:36:12.992710+0000","last_active":"2024-09-19T09:37:16.029679+0000","last_peered":"2024-09-19T09:37:16.029679+0000","last_clean":"2024-09-19T09:37:16.029679+0000","last_became_active":"2024-09-19T09:36:12.992436+0000","last_became_peered":"2024-09-19T09:36:12.992436+0000","last_unstale":"2024-09-19T09:37:16.029679+0000","last_undegraded":"2024-09-19T09:37:16.029679+0000","last_fullsized":"2024-09-19T09:37:16.029679+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:51.685516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030475+0000","last_change":"2024-09-19T09:36:10.842031+0000","last_active":"2024-09-19T09:37:16.030475+0000","last_peered":"2024-09-19T09:37:16.030475+0000","last_clean":"2024-09-19T09:37:16.030475+0000","last_became_active":"2024-09-19T09:36:10.841693+0000","last_became_peered":"2024-09-19T09:36:10.841693+0000","last_unstale":"2024-09-19T09:37:16.030475+0000","last_undegraded":"2024-09-19T09:37:16.030475+0000","last_fullsized":"2024-09-19T09:37:16.030475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:28:51.040551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034026+0000","last_change":"2024-09-19T09:37:16.034026+0000","last_active":"2024-09-19T09:37:16.034026+0000","last_peered":"2024-09-19T09:37:16.034026+0000","last_clean":"2024-09-19T09:37:16.034026+0000","last_became_active":"2024-09-19T09:37:16.033546+0000","last_became_peered":"2024-09-19T09:37:16.033546+0000","last_unstale":"2024-09-19T09:37:16.034026+0000","last_undegraded":"2024-09-19T09:37:16.034026+0000","last_fullsized":"2024-09-19T09:37:16.034026+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:42.673825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.027885+0000","last_change":"2024-09-19T09:36:10.860470+0000","last_active":"2024-09-19T09:37:16.027885+0000","last_peered":"2024-09-19T09:37:16.027885+0000","last_clean":"2024-09-19T09:37:16.027885+0000","last_became_active":"2024-09-19T09:36:10.860097+0000","last_became_peered":"2024-09-19T09:36:10.860097+0000","last_unstale":"2024-09-19T09:37:16.027885+0000","last_undegraded":"2024-09-19T09:37:16.027885+0000","last_fullsized":"2024-09-19T09:37:16.027885+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:14.933378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031415+0000","last_change":"2024-09-19T09:36:12.988489+0000","last_active":"2024-09-19T09:37:16.031415+0000","last_peered":"2024-09-19T09:37:16.031415+0000","last_clean":"2024-09-19T09:37:16.031415+0000","last_became_active":"2024-09-19T09:36:12.988151+0000","last_became_peered":"2024-09-19T09:36:12.988151+0000","last_unstale":"2024-09-19T09:37:16.031415+0000","last_undegraded":"2024-09-19T09:37:16.031415+0000","last_fullsized":"2024-09-19T09:37:16.031415+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:24.088771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030844+0000","last_change":"2024-09-19T09:36:10.860103+0000","last_active":"2024-09-19T09:37:16.030844+0000","last_peered":"2024-09-19T09:37:16.030844+0000","last_clean":"2024-09-19T09:37:16.030844+0000","last_became_active":"2024-09-19T09:36:10.859526+0000","last_became_peered":"2024-09-19T09:36:10.859526+0000","last_unstale":"2024-09-19T09:37:16.030844+0000","last_undegraded":"2024-09-19T09:37:16.030844+0000","last_fullsized":"2024-09-19T09:37:16.030844+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:25.460372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034672+0000","last_change":"2024-09-19T09:36:12.986286+0000","last_active":"2024-09-19T09:37:16.034672+0000","last_peered":"2024-09-19T09:37:16.034672+0000","last_clean":"2024-09-19T09:37:16.034672+0000","last_became_active":"2024-09-19T09:36:12.985982+0000","last_became_peered":"2024-09-19T09:36:12.985982+0000","last_unstale":"2024-09-19T09:37:16.034672+0000","last_undegraded":"2024-09-19T09:37:16.034672+0000","last_fullsized":"2024-09-19T09:37:16.034672+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:19.026134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'10","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028122+0000","last_change":"2024-09-19T09:36:10.839280+0000","last_active":"2024-09-19T09:37:16.028122+0000","last_peered":"2024-09-19T09:37:16.028122+0000","last_clean":"2024-09-19T09:37:16.028122+0000","last_became_active":"2024-09-19T09:36:10.838979+0000","last_became_peered":"2024-09-19T09:36:10.838979+0000","last_unstale":"2024-09-19T09:37:16.028122+0000","last_undegraded":"2024-09-19T09:37:16.028122+0000","last_fullsized":"2024-09-19T09:37:16.028122+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:06.303175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.035898+0000","last_change":"2024-09-19T09:36:12.979778+0000","last_active":"2024-09-19T09:37:15.035898+0000","last_peered":"2024-09-19T09:37:15.035898+0000","last_clean":"2024-09-19T09:37:15.035898+0000","last_became_active":"2024-09-19T09:36:12.979455+0000","last_became_peered":"2024-09-19T09:36:12.979455+0000","last_unstale":"2024-09-19T09:37:15.035898+0000","last_undegraded":"2024-09-19T09:37:15.035898+0000","last_fullsized":"2024-09-19T09:37:15.035898+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:36.620368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029063+0000","last_change":"2024-09-19T09:36:10.945706+0000","last_active":"2024-09-19T09:37:16.029063+0000","last_peered":"2024-09-19T09:37:16.029063+0000","last_clean":"2024-09-19T09:37:16.029063+0000","last_became_active":"2024-09-19T09:36:10.945314+0000","last_became_peered":"2024-09-19T09:36:10.945314+0000","last_unstale":"2024-09-19T09:37:16.029063+0000","last_undegraded":"2024-09-19T09:37:16.029063+0000","last_fullsized":"2024-09-19T09:37:16.029063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:49.786913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030308+0000","last_change":"2024-09-19T09:36:12.989412+0000","last_active":"2024-09-19T09:37:16.030308+0000","last_peered":"2024-09-19T09:37:16.030308+0000","last_clean":"2024-09-19T09:37:16.030308+0000","last_became_active":"2024-09-19T09:36:12.989109+0000","last_became_peered":"2024-09-19T09:36:12.989109+0000","last_unstale":"2024-09-19T09:37:16.030308+0000","last_undegraded":"2024-09-19T09:37:16.030308+0000","last_fullsized":"2024-09-19T09:37:16.030308+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:33.142592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.123342+0000","last_change":"2024-09-19T09:36:10.858581+0000","last_active":"2024-09-19T09:37:16.123342+0000","last_peered":"2024-09-19T09:37:16.123342+0000","last_clean":"2024-09-19T09:37:16.123342+0000","last_became_active":"2024-09-19T09:36:10.858240+0000","last_became_peered":"2024-09-19T09:36:10.858240+0000","last_unstale":"2024-09-19T09:37:16.123342+0000","last_undegraded":"2024-09-19T09:37:16.123342+0000","last_fullsized":"2024-09-19T09:37:16.123342+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:45.285839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030769+0000","last_change":"2024-09-19T09:36:12.989075+0000","last_active":"2024-09-19T09:37:16.030769+0000","last_peered":"2024-09-19T09:37:16.030769+0000","last_clean":"2024-09-19T09:37:16.030769+0000","last_became_active":"2024-09-19T09:36:12.988752+0000","last_became_peered":"2024-09-19T09:36:12.988752+0000","last_unstale":"2024-09-19T09:37:16.030769+0000","last_undegraded":"2024-09-19T09:37:16.030769+0000","last_fullsized":"2024-09-19T09:37:16.030769+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.424032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.034798+0000","last_change":"2024-09-19T09:36:10.838716+0000","last_active":"2024-09-19T09:37:15.034798+0000","last_peered":"2024-09-19T09:37:15.034798+0000","last_clean":"2024-09-19T09:37:15.034798+0000","last_became_active":"2024-09-19T09:36:10.838393+0000","last_became_peered":"2024-09-19T09:36:10.838393+0000","last_unstale":"2024-09-19T09:37:15.034798+0000","last_undegraded":"2024-09-19T09:37:15.034798+0000","last_fullsized":"2024-09-19T09:37:15.034798+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:54.107223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.033298+0000","last_change":"2024-09-19T09:36:12.991721+0000","last_active":"2024-09-19T09:37:16.033298+0000","last_peered":"2024-09-19T09:37:16.033298+0000","last_clean":"2024-09-19T09:37:16.033298+0000","last_became_active":"2024-09-19T09:36:12.991398+0000","last_became_peered":"2024-09-19T09:36:12.991398+0000","last_unstale":"2024-09-19T09:37:16.033298+0000","last_undegraded":"2024-09-19T09:37:16.033298+0000","last_fullsized":"2024-09-19T09:37:16.033298+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:19:31.312072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.485156+0000","last_change":"2024-09-19T09:37:16.484541+0000","last_active":"2024-09-19T09:37:16.485156+0000","last_peered":"2024-09-19T09:37:16.485156+0000","last_clean":"2024-09-19T09:37:16.485156+0000","last_became_active":"2024-09-19T09:37:16.484035+0000","last_became_peered":"2024-09-19T09:37:16.484035+0000","last_unstale":"2024-09-19T09:37:16.485156+0000","last_undegraded":"2024-09-19T09:37:16.485156+0000","last_fullsized":"2024-09-19T09:37:16.485156+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:36.332699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.035663+0000","last_change":"2024-09-19T09:36:12.984180+0000","last_active":"2024-09-19T09:37:15.035663+0000","last_peered":"2024-09-19T09:37:15.035663+0000","last_clean":"2024-09-19T09:37:15.035663+0000","last_became_active":"2024-09-19T09:36:12.983876+0000","last_became_peered":"2024-09-19T09:36:12.983876+0000","last_unstale":"2024-09-19T09:37:15.035663+0000","last_undegraded":"2024-09-19T09:37:15.035663+0000","last_fullsized":"2024-09-19T09:37:15.035663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:45.876771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031127+0000","last_change":"2024-09-19T09:36:10.845391+0000","last_active":"2024-09-19T09:37:16.031127+0000","last_peered":"2024-09-19T09:37:16.031127+0000","last_clean":"2024-09-19T09:37:16.031127+0000","last_became_active":"2024-09-19T09:36:10.844974+0000","last_became_peered":"2024-09-19T09:36:10.844974+0000","last_unstale":"2024-09-19T09:37:16.031127+0000","last_undegraded":"2024-09-19T09:37:16.031127+0000","last_fullsized":"2024-09-19T09:37:16.031127+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:00.318337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030370+0000","last_change":"2024-09-19T09:36:12.991145+0000","last_active":"2024-09-19T09:37:16.030370+0000","last_peered":"2024-09-19T09:37:16.030370+0000","last_clean":"2024-09-19T09:37:16.030370+0000","last_became_active":"2024-09-19T09:36:12.989891+0000","last_became_peered":"2024-09-19T09:36:12.989891+0000","last_unstale":"2024-09-19T09:37:16.030370+0000","last_undegraded":"2024-09-19T09:37:16.030370+0000","last_fullsized":"2024-09-19T09:37:16.030370+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:21.054936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029799+0000","last_change":"2024-09-19T09:36:12.995378+0000","last_active":"2024-09-19T09:37:16.029799+0000","last_peered":"2024-09-19T09:37:16.029799+0000","last_clean":"2024-09-19T09:37:16.029799+0000","last_became_active":"2024-09-19T09:36:12.995028+0000","last_became_peered":"2024-09-19T09:36:12.995028+0000","last_unstale":"2024-09-19T09:37:16.029799+0000","last_undegraded":"2024-09-19T09:37:16.029799+0000","last_fullsized":"2024-09-19T09:37:16.029799+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:41.102130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031259+0000","last_change":"2024-09-19T09:36:10.839595+0000","last_active":"2024-09-19T09:37:16.031259+0000","last_peered":"2024-09-19T09:37:16.031259+0000","last_clean":"2024-09-19T09:37:16.031259+0000","last_became_active":"2024-09-19T09:36:10.839196+0000","last_became_peered":"2024-09-19T09:36:10.839196+0000","last_unstale":"2024-09-19T09:37:16.031259+0000","last_undegraded":"2024-09-19T09:37:16.031259+0000","last_fullsized":"2024-09-19T09:37:16.031259+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:02.272731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.123303+0000","last_change":"2024-09-19T09:36:12.984485+0000","last_active":"2024-09-19T09:37:16.123303+0000","last_peered":"2024-09-19T09:37:16.123303+0000","last_clean":"2024-09-19T09:37:16.123303+0000","last_became_active":"2024-09-19T09:36:12.984004+0000","last_became_peered":"2024-09-19T09:36:12.984004+0000","last_unstale":"2024-09-19T09:37:16.123303+0000","last_undegraded":"2024-09-19T09:37:16.123303+0000","last_fullsized":"2024-09-19T09:37:16.123303+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:37.646776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030731+0000","last_change":"2024-09-19T09:36:10.845306+0000","last_active":"2024-09-19T09:37:16.030731+0000","last_peered":"2024-09-19T09:37:16.030731+0000","last_clean":"2024-09-19T09:37:16.030731+0000","last_became_active":"2024-09-19T09:36:10.844952+0000","last_became_peered":"2024-09-19T09:36:10.844952+0000","last_unstale":"2024-09-19T09:37:16.030731+0000","last_undegraded":"2024-09-19T09:37:16.030731+0000","last_fullsized":"2024-09-19T09:37:16.030731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:09.792482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030436+0000","last_change":"2024-09-19T09:36:12.991260+0000","last_active":"2024-09-19T09:37:16.030436+0000","last_peered":"2024-09-19T09:37:16.030436+0000","last_clean":"2024-09-19T09:37:16.030436+0000","last_became_active":"2024-09-19T09:36:12.989981+0000","last_became_peered":"2024-09-19T09:36:12.989981+0000","last_unstale":"2024-09-19T09:37:16.030436+0000","last_undegraded":"2024-09-19T09:37:16.030436+0000","last_fullsized":"2024-09-19T09:37:16.030436+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:11.301790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T09:37:15.035873+0000","last_change":"2024-09-19T09:36:10.859016+0000","last_active":"2024-09-19T09:37:15.035873+0000","last_peered":"2024-09-19T09:37:15.035873+0000","last_clean":"2024-09-19T09:37:15.035873+0000","last_became_active":"2024-09-19T09:36:10.858661+0000","last_became_peered":"2024-09-19T09:36:10.858661+0000","last_unstale":"2024-09-19T09:37:15.035873+0000","last_undegraded":"2024-09-19T09:37:15.035873+0000","last_fullsized":"2024-09-19T09:37:15.035873+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:54.395977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.131601+0000","last_change":"2024-09-19T09:37:16.131601+0000","last_active":"2024-09-19T09:37:16.131601+0000","last_peered":"2024-09-19T09:37:16.131601+0000","last_clean":"2024-09-19T09:37:16.131601+0000","last_became_active":"2024-09-19T09:37:16.131199+0000","last_became_peered":"2024-09-19T09:37:16.131199+0000","last_unstale":"2024-09-19T09:37:16.131601+0000","last_undegraded":"2024-09-19T09:37:16.131601+0000","last_fullsized":"2024-09-19T09:37:16.131601+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:27.358544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.039032+0000","last_change":"2024-09-19T09:37:16.039032+0000","last_active":"2024-09-19T09:37:16.039032+0000","last_peered":"2024-09-19T09:37:16.039032+0000","last_clean":"2024-09-19T09:37:16.039032+0000","last_became_active":"2024-09-19T09:37:16.035315+0000","last_became_peered":"2024-09-19T09:37:16.035315+0000","last_unstale":"2024-09-19T09:37:16.039032+0000","last_undegraded":"2024-09-19T09:37:16.039032+0000","last_fullsized":"2024-09-19T09:37:16.039032+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:58.795064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63617,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":123,"num_read_kb":125,"num_write":84,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":190851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":69,"ondisk_log_size":69,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282954,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547227,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":901120,"data_stored":441682,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776160,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1024000,"data_stored":1086118,"data_compressed":38912,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972390,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":901120,"data_stored":441682,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201322,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":441704,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430256,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":950272,"data_stored":1031585,"data_compressed":41852,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593781,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":441217,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822714,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":962560,"data_stored":1031767,"data_compressed":41852,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953535,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":441122,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215172,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":901120,"data_stored":432958,"data_compressed":2927,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444105,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":974848,"data_stored":503953,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":970752,"data_stored":503919,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738452,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":901120,"data_stored":441190,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":62853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:37:21.707 INFO:tasks.cephadm.ceph_manager.ceph:PG 2.1a is not active+clean 2024-09-19T09:37:21.707 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '2.1a', 'version': "81'1", 'reported_seq': 23, 'reported_epoch': 83, 'state': 'activating', 'last_fresh': '2024-09-19T09:37:16.032079+0000', 'last_change': '2024-09-19T09:37:16.032079+0000', 'last_active': '2024-09-19T09:37:15.027769+0000', 'last_peered': '2024-09-19T09:36:13.976634+0000', 'last_clean': '2024-09-19T09:36:13.976634+0000', 'last_became_active': '2024-09-19T09:36:10.839074+0000', 'last_became_peered': '2024-09-19T09:36:10.839074+0000', 'last_unstale': '2024-09-19T09:37:16.032079+0000', 'last_undegraded': '2024-09-19T09:37:16.032079+0000', 'last_fullsized': '2024-09-19T09:37:16.032079+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 77, 'last_epoch_clean': 78, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:36:09.822259+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:36:09.822259+0000', 'last_clean_scrub_stamp': '2024-09-19T09:36:09.822259+0000', 'objects_scrubbed': 0, 'log_size': 1, 'log_dups_size': 0, 'ondisk_log_size': 1, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [10, 1, 6], 'acting': [10, 1, 6], 'avail_no_missing': ['10', '1', '6', '8'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 10, 'acting_primary': 10, 'purged_snaps': []} 2024-09-19T09:37:21.708 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph status --format=json 2024-09-19T09:37:21.966 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:22.344 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:22 smithi001 ceph-mon[31225]: pgmap v316: 97 pgs: 1 activating, 96 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 0 op/s; 72 B/s, 0 objects/s recovering 2024-09-19T09:37:22.344 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:22 smithi001 ceph-mon[31225]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:37:22.344 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:22 smithi001 ceph-mon[31225]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-09-19T09:37:22.344 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:22 smithi001 ceph-mon[31225]: Cluster is now healthy 2024-09-19T09:37:22.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:22 smithi022 ceph-mon[35583]: pgmap v316: 97 pgs: 1 activating, 96 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 0 op/s; 72 B/s, 0 objects/s recovering 2024-09-19T09:37:22.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:22 smithi022 ceph-mon[35583]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:37:22.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:22 smithi022 ceph-mon[35583]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-09-19T09:37:22.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:22 smithi022 ceph-mon[35583]: Cluster is now healthy 2024-09-19T09:37:22.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:22 smithi121 ceph-mon[35577]: pgmap v316: 97 pgs: 1 activating, 96 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s rd, 0 op/s; 72 B/s, 0 objects/s recovering 2024-09-19T09:37:22.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:22 smithi121 ceph-mon[35577]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:37:22.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:22 smithi121 ceph-mon[35577]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-09-19T09:37:22.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:22 smithi121 ceph-mon[35577]: Cluster is now healthy 2024-09-19T09:37:22.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.424+0000 7f0564295640 1 -- 172.21.15.1:0/250256648 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f055c103760 msgr2=0x7f055c107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:22.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.424+0000 7f0564295640 1 --2- 172.21.15.1:0/250256648 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f055c103760 0x7f055c107ba0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0550009cd0 tx=0x7f055002a8e0 comp rx=0 tx=0).stop 2024-09-19T09:37:22.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.424+0000 7f0564295640 1 -- 172.21.15.1:0/250256648 shutdown_connections 2024-09-19T09:37:22.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.424+0000 7f0564295640 1 --2- 172.21.15.1:0/250256648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f055c1082e0 0x7f055c10ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:22.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.424+0000 7f0564295640 1 --2- 172.21.15.1:0/250256648 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f055c103760 0x7f055c107ba0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:22.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.424+0000 7f0564295640 1 --2- 172.21.15.1:0/250256648 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f055c102db0 0x7f055c103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:22.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.424+0000 7f0564295640 1 -- 172.21.15.1:0/250256648 >> 172.21.15.1:0/250256648 conn(0x7f055c0fc7d0 msgr2=0x7f055c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:22.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.424+0000 7f0564295640 1 -- 172.21.15.1:0/250256648 shutdown_connections 2024-09-19T09:37:22.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.424+0000 7f0564295640 1 -- 172.21.15.1:0/250256648 wait complete. 2024-09-19T09:37:22.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.424+0000 7f0564295640 1 Processor -- start 2024-09-19T09:37:22.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.425+0000 7f0564295640 1 -- start start 2024-09-19T09:37:22.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.425+0000 7f0564295640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f055c102db0 0x7f055c1985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:22.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.425+0000 7f0564295640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f055c103760 0x7f055c198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:22.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.425+0000 7f0564295640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f055c1082e0 0x7f055c19ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:22.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.425+0000 7f0564295640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f055c112070 con 0x7f055c102db0 2024-09-19T09:37:22.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.425+0000 7f0564295640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f055c111ef0 con 0x7f055c103760 2024-09-19T09:37:22.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.425+0000 7f0564295640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f055c1121f0 con 0x7f055c1082e0 2024-09-19T09:37:22.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.425+0000 7f0562031640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f055c102db0 0x7f055c1985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:22.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.425+0000 7f0562031640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f055c102db0 0x7f055c1985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43996/0 (socket says 172.21.15.1:43996) 2024-09-19T09:37:22.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.425+0000 7f0562031640 1 -- 172.21.15.1:0/832973904 learned_addr learned my addr 172.21.15.1:0/832973904 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:22.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.425+0000 7f0562832640 1 --2- 172.21.15.1:0/832973904 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f055c1082e0 0x7f055c19ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:22.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.425+0000 7f0562031640 1 -- 172.21.15.1:0/832973904 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f055c1082e0 msgr2=0x7f055c19ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:22.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.425+0000 7f0562031640 1 --2- 172.21.15.1:0/832973904 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f055c1082e0 0x7f055c19ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:22.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.425+0000 7f0562031640 1 -- 172.21.15.1:0/832973904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f055c103760 msgr2=0x7f055c198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:22.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.425+0000 7f0562031640 1 --2- 172.21.15.1:0/832973904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f055c103760 0x7f055c198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:22.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.425+0000 7f0562031640 1 -- 172.21.15.1:0/832973904 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055c19d590 con 0x7f055c102db0 2024-09-19T09:37:22.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.425+0000 7f0562031640 1 --2- 172.21.15.1:0/832973904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f055c102db0 0x7f055c1985e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f055800e9f0 tx=0x7f055800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:22.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.425+0000 7f054f7fe640 1 -- 172.21.15.1:0/832973904 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055800cd80 con 0x7f055c102db0 2024-09-19T09:37:22.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.425+0000 7f054f7fe640 1 -- 172.21.15.1:0/832973904 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0558005500 con 0x7f055c102db0 2024-09-19T09:37:22.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.425+0000 7f0564295640 1 -- 172.21.15.1:0/832973904 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f055c19d880 con 0x7f055c102db0 2024-09-19T09:37:22.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.426+0000 7f054f7fe640 1 -- 172.21.15.1:0/832973904 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0558010690 con 0x7f055c102db0 2024-09-19T09:37:22.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.426+0000 7f0564295640 1 -- 172.21.15.1:0/832973904 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f055c1a5160 con 0x7f055c102db0 2024-09-19T09:37:22.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.426+0000 7f0564295640 1 -- 172.21.15.1:0/832973904 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f055c103190 con 0x7f055c102db0 2024-09-19T09:37:22.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.428+0000 7f054f7fe640 1 -- 172.21.15.1:0/832973904 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f05580046c0 con 0x7f055c102db0 2024-09-19T09:37:22.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.428+0000 7f054f7fe640 1 --2- 172.21.15.1:0/832973904 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f05480a3350 0x7f05480a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:22.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.429+0000 7f0561830640 1 --2- 172.21.15.1:0/832973904 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f05480a3350 0x7f05480a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:22.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.429+0000 7f054f7fe640 1 -- 172.21.15.1:0/832973904 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f05580d01a0 con 0x7f055c102db0 2024-09-19T09:37:22.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.429+0000 7f0561830640 1 --2- 172.21.15.1:0/832973904 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f05480a3350 0x7f05480a5810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0550006010 tx=0x7f0550009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:22.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.432+0000 7f054f7fe640 1 -- 172.21.15.1:0/832973904 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0558054210 con 0x7f055c102db0 2024-09-19T09:37:22.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.676+0000 7f0564295640 1 -- 172.21.15.1:0/832973904 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f055c10a2f0 con 0x7f055c102db0 2024-09-19T09:37:22.678 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:37:22.678 INFO:teuthology.orchestra.run.smithi001.stdout:{"fsid":"57238232-7669-11ef-bceb-c7b262605968","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_age":440,"monmap":{"epoch":3,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":83,"num_osds":12,"num_up_osds":12,"osd_up_since":1726738521,"num_in_osds":12,"osd_in_since":1726738497,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":96},{"state_name":"activating","count":1}],"num_pgs":97,"num_pools":3,"num_objects":26,"data_bytes":654219,"bytes_used":415735808,"bytes_avail":1151524691968,"bytes_total":1151940427776,"inactive_pgs_ratio":0.010309278033673763,"recovering_objects_per_sec":0,"recovering_bytes_per_sec":72,"recovering_keys_per_sec":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"read_bytes_sec":511,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":19,"btime":"2024-09-19T09:36:24:006349+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"i","status":"up:standby-replay","gid":24490},{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":24497}],"up:standby":10},"mgrmap":{"available":true,"num_standbys":2,"modules":["cephadm","dashboard","iostat","nfs","restful"],"services":{"dashboard":"https://172.21.15.1:8443/"}},"servicemap":{"epoch":29,"modified":"2024-09-19T09:37:20.146971+0000","services":{"mds":{"daemons":{"summary":"","i":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T09:37:22.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.677+0000 7f054f7fe640 1 -- 172.21.15.1:0/832973904 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1609 (secure 0 0 0) 0x7f055801f340 con 0x7f055c102db0 2024-09-19T09:37:22.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.679+0000 7f0564295640 1 -- 172.21.15.1:0/832973904 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f05480a3350 msgr2=0x7f05480a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:22.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.679+0000 7f0564295640 1 --2- 172.21.15.1:0/832973904 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f05480a3350 0x7f05480a5810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0550006010 tx=0x7f0550009360 comp rx=0 tx=0).stop 2024-09-19T09:37:22.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.679+0000 7f0564295640 1 -- 172.21.15.1:0/832973904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f055c102db0 msgr2=0x7f055c1985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:22.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.679+0000 7f0564295640 1 --2- 172.21.15.1:0/832973904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f055c102db0 0x7f055c1985e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f055800e9f0 tx=0x7f055800edf0 comp rx=0 tx=0).stop 2024-09-19T09:37:22.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.679+0000 7f0564295640 1 -- 172.21.15.1:0/832973904 shutdown_connections 2024-09-19T09:37:22.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.679+0000 7f0564295640 1 --2- 172.21.15.1:0/832973904 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f055c1082e0 0x7f055c19ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:22.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.679+0000 7f0564295640 1 --2- 172.21.15.1:0/832973904 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f05480a3350 0x7f05480a5810 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:22.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.679+0000 7f0564295640 1 --2- 172.21.15.1:0/832973904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f055c103760 0x7f055c198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:22.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.679+0000 7f0564295640 1 --2- 172.21.15.1:0/832973904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f055c102db0 0x7f055c1985e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:22.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.679+0000 7f0564295640 1 -- 172.21.15.1:0/832973904 >> 172.21.15.1:0/832973904 conn(0x7f055c0fc7d0 msgr2=0x7f055c105df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:22.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.679+0000 7f0564295640 1 -- 172.21.15.1:0/832973904 shutdown_connections 2024-09-19T09:37:22.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:22.679+0000 7f0564295640 1 -- 172.21.15.1:0/832973904 wait complete. 2024-09-19T09:37:23.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:23 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/832973904' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-09-19T09:37:23.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:23 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/832973904' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-09-19T09:37:23.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:23 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/832973904' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2024-09-19T09:37:23.382 INFO:tasks.cephadm.ceph_manager.ceph:making progress, resetting timeout 2024-09-19T09:37:23.382 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:37:23.643 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:24.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.151+0000 7fdfb37d1640 1 -- 172.21.15.1:0/1086717011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfac101420 msgr2=0x7fdfac10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:24.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.152+0000 7fdfb37d1640 1 --2- 172.21.15.1:0/1086717011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfac101420 0x7fdfac10d950 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4009cd0 tx=0x7fdfa402a8e0 comp rx=0 tx=0).stop 2024-09-19T09:37:24.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.152+0000 7fdfb37d1640 1 -- 172.21.15.1:0/1086717011 shutdown_connections 2024-09-19T09:37:24.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.152+0000 7fdfb37d1640 1 --2- 172.21.15.1:0/1086717011 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfac101420 0x7fdfac10d950 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:24.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.152+0000 7fdfb37d1640 1 --2- 172.21.15.1:0/1086717011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfac100a80 0x7fdfac100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:24.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.152+0000 7fdfb37d1640 1 --2- 172.21.15.1:0/1086717011 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdfac106a80 0x7fdfac106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:24.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.152+0000 7fdfb37d1640 1 -- 172.21.15.1:0/1086717011 >> 172.21.15.1:0/1086717011 conn(0x7fdfac0fc7a0 msgr2=0x7fdfac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:24.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.152+0000 7fdfb37d1640 1 -- 172.21.15.1:0/1086717011 shutdown_connections 2024-09-19T09:37:24.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.152+0000 7fdfb37d1640 1 -- 172.21.15.1:0/1086717011 wait complete. 2024-09-19T09:37:24.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.152+0000 7fdfb37d1640 1 Processor -- start 2024-09-19T09:37:24.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.152+0000 7fdfb37d1640 1 -- start start 2024-09-19T09:37:24.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.153+0000 7fdfb37d1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfac100a80 0x7fdfac197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:24.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.153+0000 7fdfb37d1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdfac101420 0x7fdfac197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:24.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.153+0000 7fdfb37d1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfac106a80 0x7fdfac19bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:24.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.153+0000 7fdfb37d1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdfac110e80 con 0x7fdfac100a80 2024-09-19T09:37:24.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.153+0000 7fdfb37d1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdfac110d00 con 0x7fdfac106a80 2024-09-19T09:37:24.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.153+0000 7fdfb37d1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdfac111000 con 0x7fdfac101420 2024-09-19T09:37:24.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.153+0000 7fdfb156d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfac100a80 0x7fdfac197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:24.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.153+0000 7fdfb156d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfac100a80 0x7fdfac197320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44016/0 (socket says 172.21.15.1:44016) 2024-09-19T09:37:24.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.153+0000 7fdfb156d640 1 -- 172.21.15.1:0/1975298259 learned_addr learned my addr 172.21.15.1:0/1975298259 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:24.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.153+0000 7fdfb0d6c640 1 --2- 172.21.15.1:0/1975298259 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdfac101420 0x7fdfac197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:24.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.153+0000 7fdfb1d6e640 1 --2- 172.21.15.1:0/1975298259 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfac106a80 0x7fdfac19bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:24.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.153+0000 7fdfb156d640 1 -- 172.21.15.1:0/1975298259 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdfac101420 msgr2=0x7fdfac197860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:24.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.153+0000 7fdfb156d640 1 --2- 172.21.15.1:0/1975298259 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdfac101420 0x7fdfac197860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:24.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.153+0000 7fdfb156d640 1 -- 172.21.15.1:0/1975298259 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfac106a80 msgr2=0x7fdfac19bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:24.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.153+0000 7fdfb156d640 1 --2- 172.21.15.1:0/1975298259 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfac106a80 0x7fdfac19bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:24.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.153+0000 7fdfb156d640 1 -- 172.21.15.1:0/1975298259 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfac19c2d0 con 0x7fdfac100a80 2024-09-19T09:37:24.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.153+0000 7fdfb1d6e640 1 --2- 172.21.15.1:0/1975298259 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfac106a80 0x7fdfac19bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:24.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.153+0000 7fdfb156d640 1 --2- 172.21.15.1:0/1975298259 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfac100a80 0x7fdfac197320 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdfa80078f0 tx=0x7fdfa8007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:24.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.153+0000 7fdf9e7fc640 1 -- 172.21.15.1:0/1975298259 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8019020 con 0x7fdfac100a80 2024-09-19T09:37:24.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.153+0000 7fdf9e7fc640 1 -- 172.21.15.1:0/1975298259 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfa8005500 con 0x7fdfac100a80 2024-09-19T09:37:24.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.153+0000 7fdfb37d1640 1 -- 172.21.15.1:0/1975298259 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfac19c5c0 con 0x7fdfac100a80 2024-09-19T09:37:24.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.153+0000 7fdf9e7fc640 1 -- 172.21.15.1:0/1975298259 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa800e890 con 0x7fdfac100a80 2024-09-19T09:37:24.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.153+0000 7fdfb37d1640 1 -- 172.21.15.1:0/1975298259 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfac06a790 con 0x7fdfac100a80 2024-09-19T09:37:24.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.154+0000 7fdfb37d1640 1 -- 172.21.15.1:0/1975298259 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfac1021c0 con 0x7fdfac100a80 2024-09-19T09:37:24.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.156+0000 7fdf9e7fc640 1 -- 172.21.15.1:0/1975298259 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fdfa80046c0 con 0x7fdfac100a80 2024-09-19T09:37:24.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.156+0000 7fdf9e7fc640 1 --2- 172.21.15.1:0/1975298259 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fdf980a32d0 0x7fdf980a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:24.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.157+0000 7fdfb0d6c640 1 --2- 172.21.15.1:0/1975298259 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fdf980a32d0 0x7fdf980a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:24.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.157+0000 7fdf9e7fc640 1 -- 172.21.15.1:0/1975298259 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fdfa80d0fd0 con 0x7fdfac100a80 2024-09-19T09:37:24.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.157+0000 7fdfb0d6c640 1 --2- 172.21.15.1:0/1975298259 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fdf980a32d0 0x7fdf980a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdfac0fed60 tx=0x7fdfa000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:24.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.161+0000 7fdf9e7fc640 1 -- 172.21.15.1:0/1975298259 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdfa8023020 con 0x7fdfac100a80 2024-09-19T09:37:24.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.333+0000 7fdfb37d1640 1 -- 172.21.15.1:0/1975298259 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdfac06b220 con 0x7fdf980a32d0 2024-09-19T09:37:24.335 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:24 smithi001 ceph-mon[31225]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s; 72 B/s, 0 objects/s recovering 2024-09-19T09:37:24.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.340+0000 7fdf9e7fc640 1 -- 172.21.15.1:0/1975298259 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258896 (secure 0 0 0) 0x7fdfac06b220 con 0x7fdf980a32d0 2024-09-19T09:37:24.343 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:37:24.344 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-19T09:37:24.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.342+0000 7fdfb37d1640 1 -- 172.21.15.1:0/1975298259 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fdf980a32d0 msgr2=0x7fdf980a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:24.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.342+0000 7fdfb37d1640 1 --2- 172.21.15.1:0/1975298259 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fdf980a32d0 0x7fdf980a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdfac0fed60 tx=0x7fdfa000b390 comp rx=0 tx=0).stop 2024-09-19T09:37:24.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.342+0000 7fdfb37d1640 1 -- 172.21.15.1:0/1975298259 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfac100a80 msgr2=0x7fdfac197320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:24.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.342+0000 7fdfb37d1640 1 --2- 172.21.15.1:0/1975298259 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfac100a80 0x7fdfac197320 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdfa80078f0 tx=0x7fdfa8007db0 comp rx=0 tx=0).stop 2024-09-19T09:37:24.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.342+0000 7fdfb37d1640 1 -- 172.21.15.1:0/1975298259 shutdown_connections 2024-09-19T09:37:24.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.342+0000 7fdfb37d1640 1 --2- 172.21.15.1:0/1975298259 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fdf980a32d0 0x7fdf980a5790 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:24.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.342+0000 7fdfb37d1640 1 --2- 172.21.15.1:0/1975298259 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfac106a80 0x7fdfac19bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:24.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.342+0000 7fdfb37d1640 1 --2- 172.21.15.1:0/1975298259 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdfac101420 0x7fdfac197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:24.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.342+0000 7fdfb37d1640 1 --2- 172.21.15.1:0/1975298259 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdfac100a80 0x7fdfac197320 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:24.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.342+0000 7fdfb37d1640 1 -- 172.21.15.1:0/1975298259 >> 172.21.15.1:0/1975298259 conn(0x7fdfac0fc7a0 msgr2=0x7fdfac0fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:24.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.343+0000 7fdfb37d1640 1 -- 172.21.15.1:0/1975298259 shutdown_connections 2024-09-19T09:37:24.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:24.343+0000 7fdfb37d1640 1 -- 172.21.15.1:0/1975298259 wait complete. 2024-09-19T09:37:24.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:24 smithi022 ceph-mon[35583]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s; 72 B/s, 0 objects/s recovering 2024-09-19T09:37:24.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:24 smithi121 ceph-mon[35577]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s; 72 B/s, 0 objects/s recovering 2024-09-19T09:37:25.080 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":318,"stamp":"2024-09-19T09:37:24.147833+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654219,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":259,"num_read_kb":239,"num_write":267,"num_write_kb":3027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":406016,"kb_used_data":10956,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124535808,"statfs":{"total":1151940427776,"available":1151524667392,"internally_reserved":0,"allocated":11218944,"data_stored":7255857,"data_compressed":178359,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19141,"internal_metadata":404272443},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.121807"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.033174+0000","last_change":"2024-09-19T09:36:12.985228+0000","last_active":"2024-09-19T09:37:16.033174+0000","last_peered":"2024-09-19T09:37:16.033174+0000","last_clean":"2024-09-19T09:37:16.033174+0000","last_became_active":"2024-09-19T09:36:12.984306+0000","last_became_peered":"2024-09-19T09:36:12.984306+0000","last_unstale":"2024-09-19T09:37:16.033174+0000","last_undegraded":"2024-09-19T09:37:16.033174+0000","last_fullsized":"2024-09-19T09:37:16.033174+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:45.988859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030264+0000","last_change":"2024-09-19T09:36:12.987631+0000","last_active":"2024-09-19T09:37:16.030264+0000","last_peered":"2024-09-19T09:37:16.030264+0000","last_clean":"2024-09-19T09:37:16.030264+0000","last_became_active":"2024-09-19T09:36:12.987298+0000","last_became_peered":"2024-09-19T09:36:12.987298+0000","last_unstale":"2024-09-19T09:37:16.030264+0000","last_undegraded":"2024-09-19T09:37:16.030264+0000","last_fullsized":"2024-09-19T09:37:16.030264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:47.397162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030230+0000","last_change":"2024-09-19T09:36:12.991466+0000","last_active":"2024-09-19T09:37:16.030230+0000","last_peered":"2024-09-19T09:37:16.030230+0000","last_clean":"2024-09-19T09:37:16.030230+0000","last_became_active":"2024-09-19T09:36:12.990903+0000","last_became_peered":"2024-09-19T09:36:12.990903+0000","last_unstale":"2024-09-19T09:37:16.030230+0000","last_undegraded":"2024-09-19T09:37:16.030230+0000","last_fullsized":"2024-09-19T09:37:16.030230+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:04.128768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028715+0000","last_change":"2024-09-19T09:36:12.986686+0000","last_active":"2024-09-19T09:37:16.028715+0000","last_peered":"2024-09-19T09:37:16.028715+0000","last_clean":"2024-09-19T09:37:16.028715+0000","last_became_active":"2024-09-19T09:36:12.986334+0000","last_became_peered":"2024-09-19T09:36:12.986334+0000","last_unstale":"2024-09-19T09:37:16.028715+0000","last_undegraded":"2024-09-19T09:37:16.028715+0000","last_fullsized":"2024-09-19T09:37:16.028715+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:39.926343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031575+0000","last_change":"2024-09-19T09:36:12.981964+0000","last_active":"2024-09-19T09:37:16.031575+0000","last_peered":"2024-09-19T09:37:16.031575+0000","last_clean":"2024-09-19T09:37:16.031575+0000","last_became_active":"2024-09-19T09:36:12.981558+0000","last_became_peered":"2024-09-19T09:36:12.981558+0000","last_unstale":"2024-09-19T09:37:16.031575+0000","last_undegraded":"2024-09-19T09:37:16.031575+0000","last_fullsized":"2024-09-19T09:37:16.031575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:33.706451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031212+0000","last_change":"2024-09-19T09:36:12.992598+0000","last_active":"2024-09-19T09:37:16.031212+0000","last_peered":"2024-09-19T09:37:16.031212+0000","last_clean":"2024-09-19T09:37:16.031212+0000","last_became_active":"2024-09-19T09:36:12.992281+0000","last_became_peered":"2024-09-19T09:36:12.992281+0000","last_unstale":"2024-09-19T09:37:16.031212+0000","last_undegraded":"2024-09-19T09:37:16.031212+0000","last_fullsized":"2024-09-19T09:37:16.031212+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:26.107432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030075+0000","last_change":"2024-09-19T09:36:12.988583+0000","last_active":"2024-09-19T09:37:16.030075+0000","last_peered":"2024-09-19T09:37:16.030075+0000","last_clean":"2024-09-19T09:37:16.030075+0000","last_became_active":"2024-09-19T09:36:12.987895+0000","last_became_peered":"2024-09-19T09:36:12.987895+0000","last_unstale":"2024-09-19T09:37:16.030075+0000","last_undegraded":"2024-09-19T09:37:16.030075+0000","last_fullsized":"2024-09-19T09:37:16.030075+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:47.617324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.483091+0000","last_change":"2024-09-19T09:36:12.988526+0000","last_active":"2024-09-19T09:37:16.483091+0000","last_peered":"2024-09-19T09:37:16.483091+0000","last_clean":"2024-09-19T09:37:16.483091+0000","last_became_active":"2024-09-19T09:36:12.988093+0000","last_became_peered":"2024-09-19T09:36:12.988093+0000","last_unstale":"2024-09-19T09:37:16.483091+0000","last_undegraded":"2024-09-19T09:37:16.483091+0000","last_fullsized":"2024-09-19T09:37:16.483091+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:48.949397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.123768+0000","last_change":"2024-09-19T09:36:12.992360+0000","last_active":"2024-09-19T09:37:16.123768+0000","last_peered":"2024-09-19T09:37:16.123768+0000","last_clean":"2024-09-19T09:37:16.123768+0000","last_became_active":"2024-09-19T09:36:12.991833+0000","last_became_peered":"2024-09-19T09:36:12.991833+0000","last_unstale":"2024-09-19T09:37:16.123768+0000","last_undegraded":"2024-09-19T09:37:16.123768+0000","last_fullsized":"2024-09-19T09:37:16.123768+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:47.715012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031904+0000","last_change":"2024-09-19T09:36:12.993435+0000","last_active":"2024-09-19T09:37:16.031904+0000","last_peered":"2024-09-19T09:37:16.031904+0000","last_clean":"2024-09-19T09:37:16.031904+0000","last_became_active":"2024-09-19T09:36:12.993108+0000","last_became_peered":"2024-09-19T09:36:12.993108+0000","last_unstale":"2024-09-19T09:37:16.031904+0000","last_undegraded":"2024-09-19T09:37:16.031904+0000","last_fullsized":"2024-09-19T09:37:16.031904+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:54.453593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030726+0000","last_change":"2024-09-19T09:36:12.991044+0000","last_active":"2024-09-19T09:37:16.030726+0000","last_peered":"2024-09-19T09:37:16.030726+0000","last_clean":"2024-09-19T09:37:16.030726+0000","last_became_active":"2024-09-19T09:36:12.989955+0000","last_became_peered":"2024-09-19T09:36:12.989955+0000","last_unstale":"2024-09-19T09:37:16.030726+0000","last_undegraded":"2024-09-19T09:37:16.030726+0000","last_fullsized":"2024-09-19T09:37:16.030726+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:21.034023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028894+0000","last_change":"2024-09-19T09:36:12.989679+0000","last_active":"2024-09-19T09:37:16.028894+0000","last_peered":"2024-09-19T09:37:16.028894+0000","last_clean":"2024-09-19T09:37:16.028894+0000","last_became_active":"2024-09-19T09:36:12.988463+0000","last_became_peered":"2024-09-19T09:36:12.988463+0000","last_unstale":"2024-09-19T09:37:16.028894+0000","last_undegraded":"2024-09-19T09:37:16.028894+0000","last_fullsized":"2024-09-19T09:37:16.028894+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:28.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034644+0000","last_change":"2024-09-19T09:36:12.983494+0000","last_active":"2024-09-19T09:37:16.034644+0000","last_peered":"2024-09-19T09:37:16.034644+0000","last_clean":"2024-09-19T09:37:16.034644+0000","last_became_active":"2024-09-19T09:36:12.983143+0000","last_became_peered":"2024-09-19T09:36:12.983143+0000","last_unstale":"2024-09-19T09:37:16.034644+0000","last_undegraded":"2024-09-19T09:37:16.034644+0000","last_fullsized":"2024-09-19T09:37:16.034644+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:23.378183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030018+0000","last_change":"2024-09-19T09:36:12.987512+0000","last_active":"2024-09-19T09:37:16.030018+0000","last_peered":"2024-09-19T09:37:16.030018+0000","last_clean":"2024-09-19T09:37:16.030018+0000","last_became_active":"2024-09-19T09:36:12.987288+0000","last_became_peered":"2024-09-19T09:36:12.987288+0000","last_unstale":"2024-09-19T09:37:16.030018+0000","last_undegraded":"2024-09-19T09:37:16.030018+0000","last_fullsized":"2024-09-19T09:37:16.030018+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:14.614333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.131000+0000","last_change":"2024-09-19T09:37:16.131000+0000","last_active":"2024-09-19T09:37:16.131000+0000","last_peered":"2024-09-19T09:37:16.131000+0000","last_clean":"2024-09-19T09:37:16.131000+0000","last_became_active":"2024-09-19T09:37:16.130647+0000","last_became_peered":"2024-09-19T09:37:16.130647+0000","last_unstale":"2024-09-19T09:37:16.131000+0000","last_undegraded":"2024-09-19T09:37:16.131000+0000","last_fullsized":"2024-09-19T09:37:16.131000+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:22.498318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.123244+0000","last_change":"2024-09-19T09:36:12.988210+0000","last_active":"2024-09-19T09:37:16.123244+0000","last_peered":"2024-09-19T09:37:16.123244+0000","last_clean":"2024-09-19T09:37:16.123244+0000","last_became_active":"2024-09-19T09:36:12.987904+0000","last_became_peered":"2024-09-19T09:36:12.987904+0000","last_unstale":"2024-09-19T09:37:16.123244+0000","last_undegraded":"2024-09-19T09:37:16.123244+0000","last_fullsized":"2024-09-19T09:37:16.123244+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:13.588237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.033392+0000","last_change":"2024-09-19T09:36:12.984028+0000","last_active":"2024-09-19T09:37:16.033392+0000","last_peered":"2024-09-19T09:37:16.033392+0000","last_clean":"2024-09-19T09:37:16.033392+0000","last_became_active":"2024-09-19T09:36:12.982062+0000","last_became_peered":"2024-09-19T09:36:12.982062+0000","last_unstale":"2024-09-19T09:37:16.033392+0000","last_undegraded":"2024-09-19T09:37:16.033392+0000","last_fullsized":"2024-09-19T09:37:16.033392+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:26.610287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.027961+0000","last_change":"2024-09-19T09:36:12.979277+0000","last_active":"2024-09-19T09:37:16.027961+0000","last_peered":"2024-09-19T09:37:16.027961+0000","last_clean":"2024-09-19T09:37:16.027961+0000","last_became_active":"2024-09-19T09:36:12.978970+0000","last_became_peered":"2024-09-19T09:36:12.978970+0000","last_unstale":"2024-09-19T09:37:16.027961+0000","last_undegraded":"2024-09-19T09:37:16.027961+0000","last_fullsized":"2024-09-19T09:37:16.027961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:00.424728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.130307+0000","last_change":"2024-09-19T09:36:12.981021+0000","last_active":"2024-09-19T09:37:16.130307+0000","last_peered":"2024-09-19T09:37:16.130307+0000","last_clean":"2024-09-19T09:37:16.130307+0000","last_became_active":"2024-09-19T09:36:12.980580+0000","last_became_peered":"2024-09-19T09:36:12.980580+0000","last_unstale":"2024-09-19T09:37:16.130307+0000","last_undegraded":"2024-09-19T09:37:16.130307+0000","last_fullsized":"2024-09-19T09:37:16.130307+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:17.464873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.032578+0000","last_change":"2024-09-19T09:36:12.986090+0000","last_active":"2024-09-19T09:37:16.032578+0000","last_peered":"2024-09-19T09:37:16.032578+0000","last_clean":"2024-09-19T09:37:16.032578+0000","last_became_active":"2024-09-19T09:36:12.985740+0000","last_became_peered":"2024-09-19T09:36:12.985740+0000","last_unstale":"2024-09-19T09:37:16.032578+0000","last_undegraded":"2024-09-19T09:37:16.032578+0000","last_fullsized":"2024-09-19T09:37:16.032578+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:35.252834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034672+0000","last_change":"2024-09-19T09:36:12.981257+0000","last_active":"2024-09-19T09:37:16.034672+0000","last_peered":"2024-09-19T09:37:16.034672+0000","last_clean":"2024-09-19T09:37:16.034672+0000","last_became_active":"2024-09-19T09:36:12.980911+0000","last_became_peered":"2024-09-19T09:36:12.980911+0000","last_unstale":"2024-09-19T09:37:16.034672+0000","last_undegraded":"2024-09-19T09:37:16.034672+0000","last_fullsized":"2024-09-19T09:37:16.034672+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:41.470514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.123641+0000","last_change":"2024-09-19T09:36:12.982585+0000","last_active":"2024-09-19T09:37:16.123641+0000","last_peered":"2024-09-19T09:37:16.123641+0000","last_clean":"2024-09-19T09:37:16.123641+0000","last_became_active":"2024-09-19T09:36:12.982193+0000","last_became_peered":"2024-09-19T09:36:12.982193+0000","last_unstale":"2024-09-19T09:37:16.123641+0000","last_undegraded":"2024-09-19T09:37:16.123641+0000","last_fullsized":"2024-09-19T09:37:16.123641+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:30.057088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.483144+0000","last_change":"2024-09-19T09:36:12.985236+0000","last_active":"2024-09-19T09:37:16.483144+0000","last_peered":"2024-09-19T09:37:16.483144+0000","last_clean":"2024-09-19T09:37:16.483144+0000","last_became_active":"2024-09-19T09:36:12.984751+0000","last_became_peered":"2024-09-19T09:36:12.984751+0000","last_unstale":"2024-09-19T09:37:16.483144+0000","last_undegraded":"2024-09-19T09:37:16.483144+0000","last_fullsized":"2024-09-19T09:37:16.483144+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:52.784216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029585+0000","last_change":"2024-09-19T09:36:12.985856+0000","last_active":"2024-09-19T09:37:16.029585+0000","last_peered":"2024-09-19T09:37:16.029585+0000","last_clean":"2024-09-19T09:37:16.029585+0000","last_became_active":"2024-09-19T09:36:12.985312+0000","last_became_peered":"2024-09-19T09:36:12.985312+0000","last_unstale":"2024-09-19T09:37:16.029585+0000","last_undegraded":"2024-09-19T09:37:16.029585+0000","last_fullsized":"2024-09-19T09:37:16.029585+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:25.235945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.483729+0000","last_change":"2024-09-19T09:36:12.982443+0000","last_active":"2024-09-19T09:37:16.483729+0000","last_peered":"2024-09-19T09:37:16.483729+0000","last_clean":"2024-09-19T09:37:16.483729+0000","last_became_active":"2024-09-19T09:36:12.982130+0000","last_became_peered":"2024-09-19T09:36:12.982130+0000","last_unstale":"2024-09-19T09:37:16.483729+0000","last_undegraded":"2024-09-19T09:37:16.483729+0000","last_fullsized":"2024-09-19T09:37:16.483729+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:17.177563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.130468+0000","last_change":"2024-09-19T09:36:12.990439+0000","last_active":"2024-09-19T09:37:16.130468+0000","last_peered":"2024-09-19T09:37:16.130468+0000","last_clean":"2024-09-19T09:37:16.130468+0000","last_became_active":"2024-09-19T09:36:12.990135+0000","last_became_peered":"2024-09-19T09:36:12.990135+0000","last_unstale":"2024-09-19T09:37:16.130468+0000","last_undegraded":"2024-09-19T09:37:16.130468+0000","last_fullsized":"2024-09-19T09:37:16.130468+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:51.685192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.032815+0000","last_change":"2024-09-19T09:36:12.987261+0000","last_active":"2024-09-19T09:37:16.032815+0000","last_peered":"2024-09-19T09:37:16.032815+0000","last_clean":"2024-09-19T09:37:16.032815+0000","last_became_active":"2024-09-19T09:36:12.986192+0000","last_became_peered":"2024-09-19T09:36:12.986192+0000","last_unstale":"2024-09-19T09:37:16.032815+0000","last_undegraded":"2024-09-19T09:37:16.032815+0000","last_fullsized":"2024-09-19T09:37:16.032815+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:58.435605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034502+0000","last_change":"2024-09-19T09:36:12.981248+0000","last_active":"2024-09-19T09:37:16.034502+0000","last_peered":"2024-09-19T09:37:16.034502+0000","last_clean":"2024-09-19T09:37:16.034502+0000","last_became_active":"2024-09-19T09:36:12.980754+0000","last_became_peered":"2024-09-19T09:36:12.980754+0000","last_unstale":"2024-09-19T09:37:16.034502+0000","last_undegraded":"2024-09-19T09:37:16.034502+0000","last_fullsized":"2024-09-19T09:37:16.034502+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:03.970402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030143+0000","last_change":"2024-09-19T09:36:12.990841+0000","last_active":"2024-09-19T09:37:16.030143+0000","last_peered":"2024-09-19T09:37:16.030143+0000","last_clean":"2024-09-19T09:37:16.030143+0000","last_became_active":"2024-09-19T09:36:12.989667+0000","last_became_peered":"2024-09-19T09:36:12.989667+0000","last_unstale":"2024-09-19T09:37:16.030143+0000","last_undegraded":"2024-09-19T09:37:16.030143+0000","last_fullsized":"2024-09-19T09:37:16.030143+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:46:00.314590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.129743+0000","last_change":"2024-09-19T09:36:12.984007+0000","last_active":"2024-09-19T09:37:16.129743+0000","last_peered":"2024-09-19T09:37:16.129743+0000","last_clean":"2024-09-19T09:37:16.129743+0000","last_became_active":"2024-09-19T09:36:12.983627+0000","last_became_peered":"2024-09-19T09:36:12.983627+0000","last_unstale":"2024-09-19T09:37:16.129743+0000","last_undegraded":"2024-09-19T09:37:16.129743+0000","last_fullsized":"2024-09-19T09:37:16.129743+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:42.038673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.129893+0000","last_change":"2024-09-19T09:36:12.988032+0000","last_active":"2024-09-19T09:37:16.129893+0000","last_peered":"2024-09-19T09:37:16.129893+0000","last_clean":"2024-09-19T09:37:16.129893+0000","last_became_active":"2024-09-19T09:36:12.987588+0000","last_became_peered":"2024-09-19T09:36:12.987588+0000","last_unstale":"2024-09-19T09:37:16.129893+0000","last_undegraded":"2024-09-19T09:37:16.129893+0000","last_fullsized":"2024-09-19T09:37:16.129893+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:01.518543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.131565+0000","last_change":"2024-09-19T09:37:16.131565+0000","last_active":"2024-09-19T09:37:16.131565+0000","last_peered":"2024-09-19T09:37:16.131565+0000","last_clean":"2024-09-19T09:37:16.131565+0000","last_became_active":"2024-09-19T09:37:16.131171+0000","last_became_peered":"2024-09-19T09:37:16.131171+0000","last_unstale":"2024-09-19T09:37:16.131565+0000","last_undegraded":"2024-09-19T09:37:16.131565+0000","last_fullsized":"2024-09-19T09:37:16.131565+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:18.195074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031827+0000","last_change":"2024-09-19T09:36:12.989709+0000","last_active":"2024-09-19T09:37:16.031827+0000","last_peered":"2024-09-19T09:37:16.031827+0000","last_clean":"2024-09-19T09:37:16.031827+0000","last_became_active":"2024-09-19T09:36:12.989324+0000","last_became_peered":"2024-09-19T09:36:12.989324+0000","last_unstale":"2024-09-19T09:37:16.031827+0000","last_undegraded":"2024-09-19T09:37:16.031827+0000","last_fullsized":"2024-09-19T09:37:16.031827+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:09.843175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.033713+0000","last_change":"2024-09-19T09:37:16.033713+0000","last_active":"2024-09-19T09:37:16.033713+0000","last_peered":"2024-09-19T09:37:16.033713+0000","last_clean":"2024-09-19T09:37:16.033713+0000","last_became_active":"2024-09-19T09:37:16.033230+0000","last_became_peered":"2024-09-19T09:37:16.033230+0000","last_unstale":"2024-09-19T09:37:16.033713+0000","last_undegraded":"2024-09-19T09:37:16.033713+0000","last_fullsized":"2024-09-19T09:37:16.033713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:12.262115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.484760+0000","last_change":"2024-09-19T09:37:16.484760+0000","last_active":"2024-09-19T09:37:16.484760+0000","last_peered":"2024-09-19T09:37:16.484760+0000","last_clean":"2024-09-19T09:37:16.484760+0000","last_became_active":"2024-09-19T09:37:16.484316+0000","last_became_peered":"2024-09-19T09:37:16.484316+0000","last_unstale":"2024-09-19T09:37:16.484760+0000","last_undegraded":"2024-09-19T09:37:16.484760+0000","last_fullsized":"2024-09-19T09:37:16.484760+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:14.897601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.124818+0000","last_change":"2024-09-19T09:37:16.124818+0000","last_active":"2024-09-19T09:37:16.124818+0000","last_peered":"2024-09-19T09:37:16.124818+0000","last_clean":"2024-09-19T09:37:16.124818+0000","last_became_active":"2024-09-19T09:37:16.124391+0000","last_became_peered":"2024-09-19T09:37:16.124391+0000","last_unstale":"2024-09-19T09:37:16.124818+0000","last_undegraded":"2024-09-19T09:37:16.124818+0000","last_fullsized":"2024-09-19T09:37:16.124818+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:25.443666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034105+0000","last_change":"2024-09-19T09:36:10.837287+0000","last_active":"2024-09-19T09:37:16.034105+0000","last_peered":"2024-09-19T09:37:16.034105+0000","last_clean":"2024-09-19T09:37:16.034105+0000","last_became_active":"2024-09-19T09:36:10.836890+0000","last_became_peered":"2024-09-19T09:36:10.836890+0000","last_unstale":"2024-09-19T09:37:16.034105+0000","last_undegraded":"2024-09-19T09:37:16.034105+0000","last_fullsized":"2024-09-19T09:37:16.034105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:09.676728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.483176+0000","last_change":"2024-09-19T09:36:12.975690+0000","last_active":"2024-09-19T09:37:16.483176+0000","last_peered":"2024-09-19T09:37:16.483176+0000","last_clean":"2024-09-19T09:37:16.483176+0000","last_became_active":"2024-09-19T09:36:12.975370+0000","last_became_peered":"2024-09-19T09:36:12.975370+0000","last_unstale":"2024-09-19T09:37:16.483176+0000","last_undegraded":"2024-09-19T09:37:16.483176+0000","last_fullsized":"2024-09-19T09:37:16.483176+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:05.650917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030234+0000","last_change":"2024-09-19T09:36:10.843736+0000","last_active":"2024-09-19T09:37:16.030234+0000","last_peered":"2024-09-19T09:37:16.030234+0000","last_clean":"2024-09-19T09:37:16.030234+0000","last_became_active":"2024-09-19T09:36:10.843353+0000","last_became_peered":"2024-09-19T09:36:10.843353+0000","last_unstale":"2024-09-19T09:37:16.030234+0000","last_undegraded":"2024-09-19T09:37:16.030234+0000","last_fullsized":"2024-09-19T09:37:16.030234+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:29.818642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.027711+0000","last_change":"2024-09-19T09:36:12.978841+0000","last_active":"2024-09-19T09:37:16.027711+0000","last_peered":"2024-09-19T09:37:16.027711+0000","last_clean":"2024-09-19T09:37:16.027711+0000","last_became_active":"2024-09-19T09:36:12.978501+0000","last_became_peered":"2024-09-19T09:36:12.978501+0000","last_unstale":"2024-09-19T09:37:16.027711+0000","last_undegraded":"2024-09-19T09:37:16.027711+0000","last_fullsized":"2024-09-19T09:37:16.027711+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:07.974576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.032030+0000","last_change":"2024-09-19T09:36:10.841997+0000","last_active":"2024-09-19T09:37:16.032030+0000","last_peered":"2024-09-19T09:37:16.032030+0000","last_clean":"2024-09-19T09:37:16.032030+0000","last_became_active":"2024-09-19T09:36:10.841641+0000","last_became_peered":"2024-09-19T09:36:10.841641+0000","last_unstale":"2024-09-19T09:37:16.032030+0000","last_undegraded":"2024-09-19T09:37:16.032030+0000","last_fullsized":"2024-09-19T09:37:16.032030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:10.477879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.123718+0000","last_change":"2024-09-19T09:36:12.981486+0000","last_active":"2024-09-19T09:37:16.123718+0000","last_peered":"2024-09-19T09:37:16.123718+0000","last_clean":"2024-09-19T09:37:16.123718+0000","last_became_active":"2024-09-19T09:36:12.981165+0000","last_became_peered":"2024-09-19T09:36:12.981165+0000","last_unstale":"2024-09-19T09:37:16.123718+0000","last_undegraded":"2024-09-19T09:37:16.123718+0000","last_fullsized":"2024-09-19T09:37:16.123718+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:21.986132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030755+0000","last_change":"2024-09-19T09:36:10.845362+0000","last_active":"2024-09-19T09:37:16.030755+0000","last_peered":"2024-09-19T09:37:16.030755+0000","last_clean":"2024-09-19T09:37:16.030755+0000","last_became_active":"2024-09-19T09:36:10.844992+0000","last_became_peered":"2024-09-19T09:36:10.844992+0000","last_unstale":"2024-09-19T09:37:16.030755+0000","last_undegraded":"2024-09-19T09:37:16.030755+0000","last_fullsized":"2024-09-19T09:37:16.030755+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:52.854333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030434+0000","last_change":"2024-09-19T09:36:12.988924+0000","last_active":"2024-09-19T09:37:16.030434+0000","last_peered":"2024-09-19T09:37:16.030434+0000","last_clean":"2024-09-19T09:37:16.030434+0000","last_became_active":"2024-09-19T09:36:12.988331+0000","last_became_peered":"2024-09-19T09:36:12.988331+0000","last_unstale":"2024-09-19T09:37:16.030434+0000","last_undegraded":"2024-09-19T09:37:16.030434+0000","last_fullsized":"2024-09-19T09:37:16.030434+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:24.754252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029903+0000","last_change":"2024-09-19T09:36:10.860003+0000","last_active":"2024-09-19T09:37:16.029903+0000","last_peered":"2024-09-19T09:37:16.029903+0000","last_clean":"2024-09-19T09:37:16.029903+0000","last_became_active":"2024-09-19T09:36:10.859584+0000","last_became_peered":"2024-09-19T09:36:10.859584+0000","last_unstale":"2024-09-19T09:37:16.029903+0000","last_undegraded":"2024-09-19T09:37:16.029903+0000","last_fullsized":"2024-09-19T09:37:16.029903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:44.837960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.123413+0000","last_change":"2024-09-19T09:36:12.985446+0000","last_active":"2024-09-19T09:37:16.123413+0000","last_peered":"2024-09-19T09:37:16.123413+0000","last_clean":"2024-09-19T09:37:16.123413+0000","last_became_active":"2024-09-19T09:36:12.984671+0000","last_became_peered":"2024-09-19T09:36:12.984671+0000","last_unstale":"2024-09-19T09:37:16.123413+0000","last_undegraded":"2024-09-19T09:37:16.123413+0000","last_fullsized":"2024-09-19T09:37:16.123413+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:54.800151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'27","reported_seq":176,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:21.040522+0000","last_change":"2024-09-19T09:36:10.841056+0000","last_active":"2024-09-19T09:37:21.040522+0000","last_peered":"2024-09-19T09:37:21.040522+0000","last_clean":"2024-09-19T09:37:21.040522+0000","last_became_active":"2024-09-19T09:36:10.840731+0000","last_became_peered":"2024-09-19T09:36:10.840731+0000","last_unstale":"2024-09-19T09:37:21.040522+0000","last_undegraded":"2024-09-19T09:37:21.040522+0000","last_fullsized":"2024-09-19T09:37:21.040522+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:13.676188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62819,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":127,"num_read_kb":124,"num_write":27,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030607+0000","last_change":"2024-09-19T09:36:12.990223+0000","last_active":"2024-09-19T09:37:16.030607+0000","last_peered":"2024-09-19T09:37:16.030607+0000","last_clean":"2024-09-19T09:37:16.030607+0000","last_became_active":"2024-09-19T09:36:12.989720+0000","last_became_peered":"2024-09-19T09:36:12.989720+0000","last_unstale":"2024-09-19T09:37:16.030607+0000","last_undegraded":"2024-09-19T09:37:16.030607+0000","last_fullsized":"2024-09-19T09:37:16.030607+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:37.003075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.129753+0000","last_change":"2024-09-19T09:36:10.843288+0000","last_active":"2024-09-19T09:37:16.129753+0000","last_peered":"2024-09-19T09:37:16.129753+0000","last_clean":"2024-09-19T09:37:16.129753+0000","last_became_active":"2024-09-19T09:36:10.842844+0000","last_became_peered":"2024-09-19T09:36:10.842844+0000","last_unstale":"2024-09-19T09:37:16.129753+0000","last_undegraded":"2024-09-19T09:37:16.129753+0000","last_fullsized":"2024-09-19T09:37:16.129753+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:38.695411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034196+0000","last_change":"2024-09-19T09:36:12.981251+0000","last_active":"2024-09-19T09:37:16.034196+0000","last_peered":"2024-09-19T09:37:16.034196+0000","last_clean":"2024-09-19T09:37:16.034196+0000","last_became_active":"2024-09-19T09:36:12.980861+0000","last_became_peered":"2024-09-19T09:36:12.980861+0000","last_unstale":"2024-09-19T09:37:16.034196+0000","last_undegraded":"2024-09-19T09:37:16.034196+0000","last_fullsized":"2024-09-19T09:37:16.034196+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:09.633644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030128+0000","last_change":"2024-09-19T09:36:10.843448+0000","last_active":"2024-09-19T09:37:16.030128+0000","last_peered":"2024-09-19T09:37:16.030128+0000","last_clean":"2024-09-19T09:37:16.030128+0000","last_became_active":"2024-09-19T09:36:10.843087+0000","last_became_peered":"2024-09-19T09:36:10.843087+0000","last_unstale":"2024-09-19T09:37:16.030128+0000","last_undegraded":"2024-09-19T09:37:16.030128+0000","last_fullsized":"2024-09-19T09:37:16.030128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:20.623613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030593+0000","last_change":"2024-09-19T09:36:12.981160+0000","last_active":"2024-09-19T09:37:16.030593+0000","last_peered":"2024-09-19T09:37:16.030593+0000","last_clean":"2024-09-19T09:37:16.030593+0000","last_became_active":"2024-09-19T09:36:12.980823+0000","last_became_peered":"2024-09-19T09:36:12.980823+0000","last_unstale":"2024-09-19T09:37:16.030593+0000","last_undegraded":"2024-09-19T09:37:16.030593+0000","last_fullsized":"2024-09-19T09:37:16.030593+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:39.323439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028480+0000","last_change":"2024-09-19T09:36:10.842536+0000","last_active":"2024-09-19T09:37:16.028480+0000","last_peered":"2024-09-19T09:37:16.028480+0000","last_clean":"2024-09-19T09:37:16.028480+0000","last_became_active":"2024-09-19T09:36:10.842176+0000","last_became_peered":"2024-09-19T09:36:10.842176+0000","last_unstale":"2024-09-19T09:37:16.028480+0000","last_undegraded":"2024-09-19T09:37:16.028480+0000","last_fullsized":"2024-09-19T09:37:16.028480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:37.871299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030057+0000","last_change":"2024-09-19T09:36:12.987271+0000","last_active":"2024-09-19T09:37:16.030057+0000","last_peered":"2024-09-19T09:37:16.030057+0000","last_clean":"2024-09-19T09:37:16.030057+0000","last_became_active":"2024-09-19T09:36:12.986918+0000","last_became_peered":"2024-09-19T09:36:12.986918+0000","last_unstale":"2024-09-19T09:37:16.030057+0000","last_undegraded":"2024-09-19T09:37:16.030057+0000","last_fullsized":"2024-09-19T09:37:16.030057+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:07.608541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030337+0000","last_change":"2024-09-19T09:36:10.860370+0000","last_active":"2024-09-19T09:37:16.030337+0000","last_peered":"2024-09-19T09:37:16.030337+0000","last_clean":"2024-09-19T09:37:16.030337+0000","last_became_active":"2024-09-19T09:36:10.859820+0000","last_became_peered":"2024-09-19T09:36:10.859820+0000","last_unstale":"2024-09-19T09:37:16.030337+0000","last_undegraded":"2024-09-19T09:37:16.030337+0000","last_fullsized":"2024-09-19T09:37:16.030337+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:12.121038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029793+0000","last_change":"2024-09-19T09:36:12.994449+0000","last_active":"2024-09-19T09:37:16.029793+0000","last_peered":"2024-09-19T09:37:16.029793+0000","last_clean":"2024-09-19T09:37:16.029793+0000","last_became_active":"2024-09-19T09:36:12.994141+0000","last_became_peered":"2024-09-19T09:36:12.994141+0000","last_unstale":"2024-09-19T09:37:16.029793+0000","last_undegraded":"2024-09-19T09:37:16.029793+0000","last_fullsized":"2024-09-19T09:37:16.029793+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:21.416453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031764+0000","last_change":"2024-09-19T09:36:10.839609+0000","last_active":"2024-09-19T09:37:16.031764+0000","last_peered":"2024-09-19T09:37:16.031764+0000","last_clean":"2024-09-19T09:37:16.031764+0000","last_became_active":"2024-09-19T09:36:10.839227+0000","last_became_peered":"2024-09-19T09:36:10.839227+0000","last_unstale":"2024-09-19T09:37:16.031764+0000","last_undegraded":"2024-09-19T09:37:16.031764+0000","last_fullsized":"2024-09-19T09:37:16.031764+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:00.734924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.032825+0000","last_change":"2024-09-19T09:36:12.983573+0000","last_active":"2024-09-19T09:37:16.032825+0000","last_peered":"2024-09-19T09:37:16.032825+0000","last_clean":"2024-09-19T09:37:16.032825+0000","last_became_active":"2024-09-19T09:36:12.983241+0000","last_became_peered":"2024-09-19T09:36:12.983241+0000","last_unstale":"2024-09-19T09:37:16.032825+0000","last_undegraded":"2024-09-19T09:37:16.032825+0000","last_fullsized":"2024-09-19T09:37:16.032825+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:44.050271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034765+0000","last_change":"2024-09-19T09:36:10.839789+0000","last_active":"2024-09-19T09:37:16.034765+0000","last_peered":"2024-09-19T09:37:16.034765+0000","last_clean":"2024-09-19T09:37:16.034765+0000","last_became_active":"2024-09-19T09:36:10.839445+0000","last_became_peered":"2024-09-19T09:36:10.839445+0000","last_unstale":"2024-09-19T09:37:16.034765+0000","last_undegraded":"2024-09-19T09:37:16.034765+0000","last_fullsized":"2024-09-19T09:37:16.034765+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:16.040249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031041+0000","last_change":"2024-09-19T09:36:12.993420+0000","last_active":"2024-09-19T09:37:16.031041+0000","last_peered":"2024-09-19T09:37:16.031041+0000","last_clean":"2024-09-19T09:37:16.031041+0000","last_became_active":"2024-09-19T09:36:12.992334+0000","last_became_peered":"2024-09-19T09:36:12.992334+0000","last_unstale":"2024-09-19T09:37:16.031041+0000","last_undegraded":"2024-09-19T09:37:16.031041+0000","last_fullsized":"2024-09-19T09:37:16.031041+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:21.693164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030247+0000","last_change":"2024-09-19T09:36:10.839461+0000","last_active":"2024-09-19T09:37:16.030247+0000","last_peered":"2024-09-19T09:37:16.030247+0000","last_clean":"2024-09-19T09:37:16.030247+0000","last_became_active":"2024-09-19T09:36:10.839092+0000","last_became_peered":"2024-09-19T09:36:10.839092+0000","last_unstale":"2024-09-19T09:37:16.030247+0000","last_undegraded":"2024-09-19T09:37:16.030247+0000","last_fullsized":"2024-09-19T09:37:16.030247+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:02.367267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030632+0000","last_change":"2024-09-19T09:36:12.988234+0000","last_active":"2024-09-19T09:37:16.030632+0000","last_peered":"2024-09-19T09:37:16.030632+0000","last_clean":"2024-09-19T09:37:16.030632+0000","last_became_active":"2024-09-19T09:36:12.987813+0000","last_became_peered":"2024-09-19T09:36:12.987813+0000","last_unstale":"2024-09-19T09:37:16.030632+0000","last_undegraded":"2024-09-19T09:37:16.030632+0000","last_fullsized":"2024-09-19T09:37:16.030632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:56.024428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.130482+0000","last_change":"2024-09-19T09:36:10.945705+0000","last_active":"2024-09-19T09:37:16.130482+0000","last_peered":"2024-09-19T09:37:16.130482+0000","last_clean":"2024-09-19T09:37:16.130482+0000","last_became_active":"2024-09-19T09:36:10.945323+0000","last_became_peered":"2024-09-19T09:36:10.945323+0000","last_unstale":"2024-09-19T09:37:16.130482+0000","last_undegraded":"2024-09-19T09:37:16.130482+0000","last_fullsized":"2024-09-19T09:37:16.130482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:24.211909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030856+0000","last_change":"2024-09-19T09:36:12.990517+0000","last_active":"2024-09-19T09:37:16.030856+0000","last_peered":"2024-09-19T09:37:16.030856+0000","last_clean":"2024-09-19T09:37:16.030856+0000","last_became_active":"2024-09-19T09:36:12.989291+0000","last_became_peered":"2024-09-19T09:36:12.989291+0000","last_unstale":"2024-09-19T09:37:16.030856+0000","last_undegraded":"2024-09-19T09:37:16.030856+0000","last_fullsized":"2024-09-19T09:37:16.030856+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:31.087798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":338,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030324+0000","last_change":"2024-09-19T09:34:59.337025+0000","last_active":"2024-09-19T09:37:16.030324+0000","last_peered":"2024-09-19T09:37:16.030324+0000","last_clean":"2024-09-19T09:37:16.030324+0000","last_became_active":"2024-09-19T09:34:59.336556+0000","last_became_peered":"2024-09-19T09:34:59.336556+0000","last_unstale":"2024-09-19T09:37:16.030324+0000","last_undegraded":"2024-09-19T09:37:16.030324+0000","last_fullsized":"2024-09-19T09:37:16.030324+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:31:30.566923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:31:30.566923+0000","last_clean_scrub_stamp":"2024-09-19T09:31:30.566923+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:00.675254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028715+0000","last_change":"2024-09-19T09:36:10.838131+0000","last_active":"2024-09-19T09:37:16.028715+0000","last_peered":"2024-09-19T09:37:16.028715+0000","last_clean":"2024-09-19T09:37:16.028715+0000","last_became_active":"2024-09-19T09:36:10.837725+0000","last_became_peered":"2024-09-19T09:36:10.837725+0000","last_unstale":"2024-09-19T09:37:16.028715+0000","last_undegraded":"2024-09-19T09:37:16.028715+0000","last_fullsized":"2024-09-19T09:37:16.028715+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:57.104726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.483429+0000","last_change":"2024-09-19T09:36:12.981951+0000","last_active":"2024-09-19T09:37:16.483429+0000","last_peered":"2024-09-19T09:37:16.483429+0000","last_clean":"2024-09-19T09:37:16.483429+0000","last_became_active":"2024-09-19T09:36:12.981558+0000","last_became_peered":"2024-09-19T09:36:12.981558+0000","last_unstale":"2024-09-19T09:37:16.483429+0000","last_undegraded":"2024-09-19T09:37:16.483429+0000","last_fullsized":"2024-09-19T09:37:16.483429+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:31.119853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030184+0000","last_change":"2024-09-19T09:36:10.843574+0000","last_active":"2024-09-19T09:37:16.030184+0000","last_peered":"2024-09-19T09:37:16.030184+0000","last_clean":"2024-09-19T09:37:16.030184+0000","last_became_active":"2024-09-19T09:36:10.843252+0000","last_became_peered":"2024-09-19T09:36:10.843252+0000","last_unstale":"2024-09-19T09:37:16.030184+0000","last_undegraded":"2024-09-19T09:37:16.030184+0000","last_fullsized":"2024-09-19T09:37:16.030184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:10.492812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.033999+0000","last_change":"2024-09-19T09:36:12.984538+0000","last_active":"2024-09-19T09:37:16.033999+0000","last_peered":"2024-09-19T09:37:16.033999+0000","last_clean":"2024-09-19T09:37:16.033999+0000","last_became_active":"2024-09-19T09:36:12.983448+0000","last_became_peered":"2024-09-19T09:36:12.983448+0000","last_unstale":"2024-09-19T09:37:16.033999+0000","last_undegraded":"2024-09-19T09:37:16.033999+0000","last_fullsized":"2024-09-19T09:37:16.033999+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:48.294473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034208+0000","last_change":"2024-09-19T09:36:10.858959+0000","last_active":"2024-09-19T09:37:16.034208+0000","last_peered":"2024-09-19T09:37:16.034208+0000","last_clean":"2024-09-19T09:37:16.034208+0000","last_became_active":"2024-09-19T09:36:10.858638+0000","last_became_peered":"2024-09-19T09:36:10.858638+0000","last_unstale":"2024-09-19T09:37:16.034208+0000","last_undegraded":"2024-09-19T09:37:16.034208+0000","last_fullsized":"2024-09-19T09:37:16.034208+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:12.646483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029679+0000","last_change":"2024-09-19T09:36:12.992710+0000","last_active":"2024-09-19T09:37:16.029679+0000","last_peered":"2024-09-19T09:37:16.029679+0000","last_clean":"2024-09-19T09:37:16.029679+0000","last_became_active":"2024-09-19T09:36:12.992436+0000","last_became_peered":"2024-09-19T09:36:12.992436+0000","last_unstale":"2024-09-19T09:37:16.029679+0000","last_undegraded":"2024-09-19T09:37:16.029679+0000","last_fullsized":"2024-09-19T09:37:16.029679+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:51.685516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030475+0000","last_change":"2024-09-19T09:36:10.842031+0000","last_active":"2024-09-19T09:37:16.030475+0000","last_peered":"2024-09-19T09:37:16.030475+0000","last_clean":"2024-09-19T09:37:16.030475+0000","last_became_active":"2024-09-19T09:36:10.841693+0000","last_became_peered":"2024-09-19T09:36:10.841693+0000","last_unstale":"2024-09-19T09:37:16.030475+0000","last_undegraded":"2024-09-19T09:37:16.030475+0000","last_fullsized":"2024-09-19T09:37:16.030475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:28:51.040551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034026+0000","last_change":"2024-09-19T09:37:16.034026+0000","last_active":"2024-09-19T09:37:16.034026+0000","last_peered":"2024-09-19T09:37:16.034026+0000","last_clean":"2024-09-19T09:37:16.034026+0000","last_became_active":"2024-09-19T09:37:16.033546+0000","last_became_peered":"2024-09-19T09:37:16.033546+0000","last_unstale":"2024-09-19T09:37:16.034026+0000","last_undegraded":"2024-09-19T09:37:16.034026+0000","last_fullsized":"2024-09-19T09:37:16.034026+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:42.673825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.027885+0000","last_change":"2024-09-19T09:36:10.860470+0000","last_active":"2024-09-19T09:37:16.027885+0000","last_peered":"2024-09-19T09:37:16.027885+0000","last_clean":"2024-09-19T09:37:16.027885+0000","last_became_active":"2024-09-19T09:36:10.860097+0000","last_became_peered":"2024-09-19T09:36:10.860097+0000","last_unstale":"2024-09-19T09:37:16.027885+0000","last_undegraded":"2024-09-19T09:37:16.027885+0000","last_fullsized":"2024-09-19T09:37:16.027885+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:14.933378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031415+0000","last_change":"2024-09-19T09:36:12.988489+0000","last_active":"2024-09-19T09:37:16.031415+0000","last_peered":"2024-09-19T09:37:16.031415+0000","last_clean":"2024-09-19T09:37:16.031415+0000","last_became_active":"2024-09-19T09:36:12.988151+0000","last_became_peered":"2024-09-19T09:36:12.988151+0000","last_unstale":"2024-09-19T09:37:16.031415+0000","last_undegraded":"2024-09-19T09:37:16.031415+0000","last_fullsized":"2024-09-19T09:37:16.031415+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:24.088771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030844+0000","last_change":"2024-09-19T09:36:10.860103+0000","last_active":"2024-09-19T09:37:16.030844+0000","last_peered":"2024-09-19T09:37:16.030844+0000","last_clean":"2024-09-19T09:37:16.030844+0000","last_became_active":"2024-09-19T09:36:10.859526+0000","last_became_peered":"2024-09-19T09:36:10.859526+0000","last_unstale":"2024-09-19T09:37:16.030844+0000","last_undegraded":"2024-09-19T09:37:16.030844+0000","last_fullsized":"2024-09-19T09:37:16.030844+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:25.460372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034672+0000","last_change":"2024-09-19T09:36:12.986286+0000","last_active":"2024-09-19T09:37:16.034672+0000","last_peered":"2024-09-19T09:37:16.034672+0000","last_clean":"2024-09-19T09:37:16.034672+0000","last_became_active":"2024-09-19T09:36:12.985982+0000","last_became_peered":"2024-09-19T09:36:12.985982+0000","last_unstale":"2024-09-19T09:37:16.034672+0000","last_undegraded":"2024-09-19T09:37:16.034672+0000","last_fullsized":"2024-09-19T09:37:16.034672+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:19.026134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'10","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028122+0000","last_change":"2024-09-19T09:36:10.839280+0000","last_active":"2024-09-19T09:37:16.028122+0000","last_peered":"2024-09-19T09:37:16.028122+0000","last_clean":"2024-09-19T09:37:16.028122+0000","last_became_active":"2024-09-19T09:36:10.838979+0000","last_became_peered":"2024-09-19T09:36:10.838979+0000","last_unstale":"2024-09-19T09:37:16.028122+0000","last_undegraded":"2024-09-19T09:37:16.028122+0000","last_fullsized":"2024-09-19T09:37:16.028122+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:06.303175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.483737+0000","last_change":"2024-09-19T09:36:12.979778+0000","last_active":"2024-09-19T09:37:16.483737+0000","last_peered":"2024-09-19T09:37:16.483737+0000","last_clean":"2024-09-19T09:37:16.483737+0000","last_became_active":"2024-09-19T09:36:12.979455+0000","last_became_peered":"2024-09-19T09:36:12.979455+0000","last_unstale":"2024-09-19T09:37:16.483737+0000","last_undegraded":"2024-09-19T09:37:16.483737+0000","last_fullsized":"2024-09-19T09:37:16.483737+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:36.620368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029063+0000","last_change":"2024-09-19T09:36:10.945706+0000","last_active":"2024-09-19T09:37:16.029063+0000","last_peered":"2024-09-19T09:37:16.029063+0000","last_clean":"2024-09-19T09:37:16.029063+0000","last_became_active":"2024-09-19T09:36:10.945314+0000","last_became_peered":"2024-09-19T09:36:10.945314+0000","last_unstale":"2024-09-19T09:37:16.029063+0000","last_undegraded":"2024-09-19T09:37:16.029063+0000","last_fullsized":"2024-09-19T09:37:16.029063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:49.786913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030308+0000","last_change":"2024-09-19T09:36:12.989412+0000","last_active":"2024-09-19T09:37:16.030308+0000","last_peered":"2024-09-19T09:37:16.030308+0000","last_clean":"2024-09-19T09:37:16.030308+0000","last_became_active":"2024-09-19T09:36:12.989109+0000","last_became_peered":"2024-09-19T09:36:12.989109+0000","last_unstale":"2024-09-19T09:37:16.030308+0000","last_undegraded":"2024-09-19T09:37:16.030308+0000","last_fullsized":"2024-09-19T09:37:16.030308+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:33.142592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.123342+0000","last_change":"2024-09-19T09:36:10.858581+0000","last_active":"2024-09-19T09:37:16.123342+0000","last_peered":"2024-09-19T09:37:16.123342+0000","last_clean":"2024-09-19T09:37:16.123342+0000","last_became_active":"2024-09-19T09:36:10.858240+0000","last_became_peered":"2024-09-19T09:36:10.858240+0000","last_unstale":"2024-09-19T09:37:16.123342+0000","last_undegraded":"2024-09-19T09:37:16.123342+0000","last_fullsized":"2024-09-19T09:37:16.123342+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:45.285839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030769+0000","last_change":"2024-09-19T09:36:12.989075+0000","last_active":"2024-09-19T09:37:16.030769+0000","last_peered":"2024-09-19T09:37:16.030769+0000","last_clean":"2024-09-19T09:37:16.030769+0000","last_became_active":"2024-09-19T09:36:12.988752+0000","last_became_peered":"2024-09-19T09:36:12.988752+0000","last_unstale":"2024-09-19T09:37:16.030769+0000","last_undegraded":"2024-09-19T09:37:16.030769+0000","last_fullsized":"2024-09-19T09:37:16.030769+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.424032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.483353+0000","last_change":"2024-09-19T09:36:10.838716+0000","last_active":"2024-09-19T09:37:16.483353+0000","last_peered":"2024-09-19T09:37:16.483353+0000","last_clean":"2024-09-19T09:37:16.483353+0000","last_became_active":"2024-09-19T09:36:10.838393+0000","last_became_peered":"2024-09-19T09:36:10.838393+0000","last_unstale":"2024-09-19T09:37:16.483353+0000","last_undegraded":"2024-09-19T09:37:16.483353+0000","last_fullsized":"2024-09-19T09:37:16.483353+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:54.107223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.033298+0000","last_change":"2024-09-19T09:36:12.991721+0000","last_active":"2024-09-19T09:37:16.033298+0000","last_peered":"2024-09-19T09:37:16.033298+0000","last_clean":"2024-09-19T09:37:16.033298+0000","last_became_active":"2024-09-19T09:36:12.991398+0000","last_became_peered":"2024-09-19T09:36:12.991398+0000","last_unstale":"2024-09-19T09:37:16.033298+0000","last_undegraded":"2024-09-19T09:37:16.033298+0000","last_fullsized":"2024-09-19T09:37:16.033298+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:19:31.312072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.485156+0000","last_change":"2024-09-19T09:37:16.484541+0000","last_active":"2024-09-19T09:37:16.485156+0000","last_peered":"2024-09-19T09:37:16.485156+0000","last_clean":"2024-09-19T09:37:16.485156+0000","last_became_active":"2024-09-19T09:37:16.484035+0000","last_became_peered":"2024-09-19T09:37:16.484035+0000","last_unstale":"2024-09-19T09:37:16.485156+0000","last_undegraded":"2024-09-19T09:37:16.485156+0000","last_fullsized":"2024-09-19T09:37:16.485156+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:36.332699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.483389+0000","last_change":"2024-09-19T09:36:12.984180+0000","last_active":"2024-09-19T09:37:16.483389+0000","last_peered":"2024-09-19T09:37:16.483389+0000","last_clean":"2024-09-19T09:37:16.483389+0000","last_became_active":"2024-09-19T09:36:12.983876+0000","last_became_peered":"2024-09-19T09:36:12.983876+0000","last_unstale":"2024-09-19T09:37:16.483389+0000","last_undegraded":"2024-09-19T09:37:16.483389+0000","last_fullsized":"2024-09-19T09:37:16.483389+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:45.876771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031127+0000","last_change":"2024-09-19T09:36:10.845391+0000","last_active":"2024-09-19T09:37:16.031127+0000","last_peered":"2024-09-19T09:37:16.031127+0000","last_clean":"2024-09-19T09:37:16.031127+0000","last_became_active":"2024-09-19T09:36:10.844974+0000","last_became_peered":"2024-09-19T09:36:10.844974+0000","last_unstale":"2024-09-19T09:37:16.031127+0000","last_undegraded":"2024-09-19T09:37:16.031127+0000","last_fullsized":"2024-09-19T09:37:16.031127+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:00.318337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030370+0000","last_change":"2024-09-19T09:36:12.991145+0000","last_active":"2024-09-19T09:37:16.030370+0000","last_peered":"2024-09-19T09:37:16.030370+0000","last_clean":"2024-09-19T09:37:16.030370+0000","last_became_active":"2024-09-19T09:36:12.989891+0000","last_became_peered":"2024-09-19T09:36:12.989891+0000","last_unstale":"2024-09-19T09:37:16.030370+0000","last_undegraded":"2024-09-19T09:37:16.030370+0000","last_fullsized":"2024-09-19T09:37:16.030370+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:21.054936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029799+0000","last_change":"2024-09-19T09:36:12.995378+0000","last_active":"2024-09-19T09:37:16.029799+0000","last_peered":"2024-09-19T09:37:16.029799+0000","last_clean":"2024-09-19T09:37:16.029799+0000","last_became_active":"2024-09-19T09:36:12.995028+0000","last_became_peered":"2024-09-19T09:36:12.995028+0000","last_unstale":"2024-09-19T09:37:16.029799+0000","last_undegraded":"2024-09-19T09:37:16.029799+0000","last_fullsized":"2024-09-19T09:37:16.029799+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:41.102130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031259+0000","last_change":"2024-09-19T09:36:10.839595+0000","last_active":"2024-09-19T09:37:16.031259+0000","last_peered":"2024-09-19T09:37:16.031259+0000","last_clean":"2024-09-19T09:37:16.031259+0000","last_became_active":"2024-09-19T09:36:10.839196+0000","last_became_peered":"2024-09-19T09:36:10.839196+0000","last_unstale":"2024-09-19T09:37:16.031259+0000","last_undegraded":"2024-09-19T09:37:16.031259+0000","last_fullsized":"2024-09-19T09:37:16.031259+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:02.272731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.123303+0000","last_change":"2024-09-19T09:36:12.984485+0000","last_active":"2024-09-19T09:37:16.123303+0000","last_peered":"2024-09-19T09:37:16.123303+0000","last_clean":"2024-09-19T09:37:16.123303+0000","last_became_active":"2024-09-19T09:36:12.984004+0000","last_became_peered":"2024-09-19T09:36:12.984004+0000","last_unstale":"2024-09-19T09:37:16.123303+0000","last_undegraded":"2024-09-19T09:37:16.123303+0000","last_fullsized":"2024-09-19T09:37:16.123303+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:37.646776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030731+0000","last_change":"2024-09-19T09:36:10.845306+0000","last_active":"2024-09-19T09:37:16.030731+0000","last_peered":"2024-09-19T09:37:16.030731+0000","last_clean":"2024-09-19T09:37:16.030731+0000","last_became_active":"2024-09-19T09:36:10.844952+0000","last_became_peered":"2024-09-19T09:36:10.844952+0000","last_unstale":"2024-09-19T09:37:16.030731+0000","last_undegraded":"2024-09-19T09:37:16.030731+0000","last_fullsized":"2024-09-19T09:37:16.030731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:09.792482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030436+0000","last_change":"2024-09-19T09:36:12.991260+0000","last_active":"2024-09-19T09:37:16.030436+0000","last_peered":"2024-09-19T09:37:16.030436+0000","last_clean":"2024-09-19T09:37:16.030436+0000","last_became_active":"2024-09-19T09:36:12.989981+0000","last_became_peered":"2024-09-19T09:36:12.989981+0000","last_unstale":"2024-09-19T09:37:16.030436+0000","last_undegraded":"2024-09-19T09:37:16.030436+0000","last_fullsized":"2024-09-19T09:37:16.030436+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:11.301790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.483876+0000","last_change":"2024-09-19T09:36:10.859016+0000","last_active":"2024-09-19T09:37:16.483876+0000","last_peered":"2024-09-19T09:37:16.483876+0000","last_clean":"2024-09-19T09:37:16.483876+0000","last_became_active":"2024-09-19T09:36:10.858661+0000","last_became_peered":"2024-09-19T09:36:10.858661+0000","last_unstale":"2024-09-19T09:37:16.483876+0000","last_undegraded":"2024-09-19T09:37:16.483876+0000","last_fullsized":"2024-09-19T09:37:16.483876+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:54.395977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.131601+0000","last_change":"2024-09-19T09:37:16.131601+0000","last_active":"2024-09-19T09:37:16.131601+0000","last_peered":"2024-09-19T09:37:16.131601+0000","last_clean":"2024-09-19T09:37:16.131601+0000","last_became_active":"2024-09-19T09:37:16.131199+0000","last_became_peered":"2024-09-19T09:37:16.131199+0000","last_unstale":"2024-09-19T09:37:16.131601+0000","last_undegraded":"2024-09-19T09:37:16.131601+0000","last_fullsized":"2024-09-19T09:37:16.131601+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:27.358544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.039032+0000","last_change":"2024-09-19T09:37:16.039032+0000","last_active":"2024-09-19T09:37:16.039032+0000","last_peered":"2024-09-19T09:37:16.039032+0000","last_clean":"2024-09-19T09:37:16.039032+0000","last_became_active":"2024-09-19T09:37:16.035315+0000","last_became_peered":"2024-09-19T09:37:16.035315+0000","last_unstale":"2024-09-19T09:37:16.039032+0000","last_undegraded":"2024-09-19T09:37:16.039032+0000","last_fullsized":"2024-09-19T09:37:16.039032+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:58.795064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63617,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":133,"num_read_kb":130,"num_write":84,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":190851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":69,"ondisk_log_size":69,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282954,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547228,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":901120,"data_stored":441682,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776161,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1036288,"data_stored":1094598,"data_compressed":41852,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972390,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":901120,"data_stored":441682,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201322,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":441704,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430257,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":950272,"data_stored":1031585,"data_compressed":41852,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593782,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":441217,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822715,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":962560,"data_stored":1031767,"data_compressed":41852,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953536,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":441122,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215173,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":913408,"data_stored":441438,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444105,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":974848,"data_stored":503953,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":970752,"data_stored":503919,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738452,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":901120,"data_stored":441190,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":62853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:37:26.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:26 smithi022 ceph-mon[35583]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1010 B/s rd, 1 op/s; 63 B/s, 0 objects/s recovering 2024-09-19T09:37:26.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:26 smithi022 ceph-mon[35583]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:37:26.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:26 smithi121 ceph-mon[35577]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1010 B/s rd, 1 op/s; 63 B/s, 0 objects/s recovering 2024-09-19T09:37:26.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:26 smithi121 ceph-mon[35577]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:37:26.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:26 smithi001 ceph-mon[31225]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1010 B/s rd, 1 op/s; 63 B/s, 0 objects/s recovering 2024-09-19T09:37:26.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:26 smithi001 ceph-mon[31225]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:37:28.085 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:37:28.355 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:28.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:28 smithi022 ceph-mon[35583]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s; 57 B/s, 0 objects/s recovering 2024-09-19T09:37:28.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:28 smithi121 ceph-mon[35577]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s; 57 B/s, 0 objects/s recovering 2024-09-19T09:37:28.476 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:28 smithi001 ceph-mon[31225]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s; 57 B/s, 0 objects/s recovering 2024-09-19T09:37:28.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.845+0000 7f3be264a640 1 -- 172.21.15.1:0/2620447827 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bdc100b20 msgr2=0x7f3bdc100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:28.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.845+0000 7f3be264a640 1 --2- 172.21.15.1:0/2620447827 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bdc100b20 0x7f3bdc100f00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc009900 tx=0x7f3bcc02a410 comp rx=0 tx=0).stop 2024-09-19T09:37:28.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.845+0000 7f3be264a640 1 -- 172.21.15.1:0/2620447827 shutdown_connections 2024-09-19T09:37:28.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.845+0000 7f3be264a640 1 --2- 172.21.15.1:0/2620447827 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3bdc10e500 0x7f3bdc110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:28.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.845+0000 7f3be264a640 1 --2- 172.21.15.1:0/2620447827 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bdc101440 0x7f3bdc10df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:28.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.845+0000 7f3be264a640 1 --2- 172.21.15.1:0/2620447827 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bdc100b20 0x7f3bdc100f00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:28.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.846+0000 7f3be264a640 1 -- 172.21.15.1:0/2620447827 >> 172.21.15.1:0/2620447827 conn(0x7f3bdc0fc7d0 msgr2=0x7f3bdc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:28.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.846+0000 7f3be264a640 1 -- 172.21.15.1:0/2620447827 shutdown_connections 2024-09-19T09:37:28.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.846+0000 7f3be264a640 1 -- 172.21.15.1:0/2620447827 wait complete. 2024-09-19T09:37:28.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.846+0000 7f3be264a640 1 Processor -- start 2024-09-19T09:37:28.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.846+0000 7f3be264a640 1 -- start start 2024-09-19T09:37:28.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.847+0000 7f3be264a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3bdc100b20 0x7f3bdc19a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:28.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.847+0000 7f3be264a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bdc101440 0x7f3bdc19ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:28.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.847+0000 7f3be264a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bdc10e500 0x7f3bdc19efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:28.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.847+0000 7f3be264a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3bdc1142d0 con 0x7f3bdc10e500 2024-09-19T09:37:28.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.847+0000 7f3be264a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3bdc114150 con 0x7f3bdc101440 2024-09-19T09:37:28.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.847+0000 7f3be264a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3bdc114450 con 0x7f3bdc100b20 2024-09-19T09:37:28.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.847+0000 7f3be0be7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bdc10e500 0x7f3bdc19efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:28.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.847+0000 7f3be0be7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bdc10e500 0x7f3bdc19efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49442/0 (socket says 172.21.15.1:49442) 2024-09-19T09:37:28.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.847+0000 7f3be0be7640 1 -- 172.21.15.1:0/700879469 learned_addr learned my addr 172.21.15.1:0/700879469 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:28.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.847+0000 7f3bdb7fe640 1 --2- 172.21.15.1:0/700879469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bdc101440 0x7f3bdc19ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:28.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.847+0000 7f3bdbfff640 1 --2- 172.21.15.1:0/700879469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3bdc100b20 0x7f3bdc19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:28.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.847+0000 7f3be0be7640 1 -- 172.21.15.1:0/700879469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3bdc100b20 msgr2=0x7f3bdc19a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:28.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.847+0000 7f3be0be7640 1 --2- 172.21.15.1:0/700879469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3bdc100b20 0x7f3bdc19a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:28.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.847+0000 7f3be0be7640 1 -- 172.21.15.1:0/700879469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bdc101440 msgr2=0x7f3bdc19ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:28.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.847+0000 7f3be0be7640 1 --2- 172.21.15.1:0/700879469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bdc101440 0x7f3bdc19ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:28.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.847+0000 7f3be0be7640 1 -- 172.21.15.1:0/700879469 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bdc19f6c0 con 0x7f3bdc10e500 2024-09-19T09:37:28.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.847+0000 7f3bdbfff640 1 --2- 172.21.15.1:0/700879469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3bdc100b20 0x7f3bdc19a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:28.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.847+0000 7f3be0be7640 1 --2- 172.21.15.1:0/700879469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bdc10e500 0x7f3bdc19efe0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3bd400b9e0 tx=0x7f3bd400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:28.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.848+0000 7f3bd97fa640 1 -- 172.21.15.1:0/700879469 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd4019070 con 0x7f3bdc10e500 2024-09-19T09:37:28.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.848+0000 7f3be264a640 1 -- 172.21.15.1:0/700879469 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bdc19f9b0 con 0x7f3bdc10e500 2024-09-19T09:37:28.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.848+0000 7f3bd97fa640 1 -- 172.21.15.1:0/700879469 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3bd4014440 con 0x7f3bdc10e500 2024-09-19T09:37:28.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.848+0000 7f3bd97fa640 1 -- 172.21.15.1:0/700879469 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd40125e0 con 0x7f3bdc10e500 2024-09-19T09:37:28.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.848+0000 7f3be264a640 1 -- 172.21.15.1:0/700879469 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bdc1a7290 con 0x7f3bdc10e500 2024-09-19T09:37:28.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.849+0000 7f3be264a640 1 -- 172.21.15.1:0/700879469 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bdc06a850 con 0x7f3bdc10e500 2024-09-19T09:37:28.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.850+0000 7f3bd97fa640 1 -- 172.21.15.1:0/700879469 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f3bd401c070 con 0x7f3bdc10e500 2024-09-19T09:37:28.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.851+0000 7f3bd97fa640 1 --2- 172.21.15.1:0/700879469 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3bc40a32d0 0x7f3bc40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:28.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.851+0000 7f3bdbfff640 1 --2- 172.21.15.1:0/700879469 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3bc40a32d0 0x7f3bc40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:28.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.851+0000 7f3bd97fa640 1 -- 172.21.15.1:0/700879469 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f3bd40cefa0 con 0x7f3bdc10e500 2024-09-19T09:37:28.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.852+0000 7f3bdbfff640 1 --2- 172.21.15.1:0/700879469 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3bc40a32d0 0x7f3bc40a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc005ab0 tx=0x7f3bcc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:28.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:28.856+0000 7f3bd97fa640 1 -- 172.21.15.1:0/700879469 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3bd409b620 con 0x7f3bdc10e500 2024-09-19T09:37:29.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:29.028+0000 7f3be264a640 1 -- 172.21.15.1:0/700879469 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3bdc10f820 con 0x7f3bc40a32d0 2024-09-19T09:37:29.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:29.035+0000 7f3bd97fa640 1 -- 172.21.15.1:0/700879469 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258898 (secure 0 0 0) 0x7f3bdc10f820 con 0x7f3bc40a32d0 2024-09-19T09:37:29.039 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:37:29.040 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-19T09:37:29.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:29.038+0000 7f3be264a640 1 -- 172.21.15.1:0/700879469 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3bc40a32d0 msgr2=0x7f3bc40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:29.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:29.038+0000 7f3be264a640 1 --2- 172.21.15.1:0/700879469 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3bc40a32d0 0x7f3bc40a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc005ab0 tx=0x7f3bcc005a20 comp rx=0 tx=0).stop 2024-09-19T09:37:29.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:29.038+0000 7f3be264a640 1 -- 172.21.15.1:0/700879469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bdc10e500 msgr2=0x7f3bdc19efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:29.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:29.038+0000 7f3be264a640 1 --2- 172.21.15.1:0/700879469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bdc10e500 0x7f3bdc19efe0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3bd400b9e0 tx=0x7f3bd400bea0 comp rx=0 tx=0).stop 2024-09-19T09:37:29.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:29.038+0000 7f3be264a640 1 -- 172.21.15.1:0/700879469 shutdown_connections 2024-09-19T09:37:29.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:29.038+0000 7f3be264a640 1 --2- 172.21.15.1:0/700879469 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bdc10e500 0x7f3bdc19efe0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:29.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:29.038+0000 7f3be264a640 1 --2- 172.21.15.1:0/700879469 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3bc40a32d0 0x7f3bc40a5790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:29.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:29.038+0000 7f3be264a640 1 --2- 172.21.15.1:0/700879469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bdc101440 0x7f3bdc19ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:29.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:29.038+0000 7f3be264a640 1 --2- 172.21.15.1:0/700879469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3bdc100b20 0x7f3bdc19a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:29.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:29.038+0000 7f3be264a640 1 -- 172.21.15.1:0/700879469 >> 172.21.15.1:0/700879469 conn(0x7f3bdc0fc7d0 msgr2=0x7f3bdc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:29.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:29.038+0000 7f3be264a640 1 -- 172.21.15.1:0/700879469 shutdown_connections 2024-09-19T09:37:29.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:29.038+0000 7f3be264a640 1 -- 172.21.15.1:0/700879469 wait complete. 2024-09-19T09:37:29.737 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":320,"stamp":"2024-09-19T09:37:28.148910+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654219,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":269,"num_read_kb":244,"num_write":267,"num_write_kb":3027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":208,"ondisk_log_size":208,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":406016,"kb_used_data":10956,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124535808,"statfs":{"total":1151940427776,"available":1151524667392,"internally_reserved":0,"allocated":11218944,"data_stored":7255857,"data_compressed":178359,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19141,"internal_metadata":404272443},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003223"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.033174+0000","last_change":"2024-09-19T09:36:12.985228+0000","last_active":"2024-09-19T09:37:16.033174+0000","last_peered":"2024-09-19T09:37:16.033174+0000","last_clean":"2024-09-19T09:37:16.033174+0000","last_became_active":"2024-09-19T09:36:12.984306+0000","last_became_peered":"2024-09-19T09:36:12.984306+0000","last_unstale":"2024-09-19T09:37:16.033174+0000","last_undegraded":"2024-09-19T09:37:16.033174+0000","last_fullsized":"2024-09-19T09:37:16.033174+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:45.988859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030264+0000","last_change":"2024-09-19T09:36:12.987631+0000","last_active":"2024-09-19T09:37:16.030264+0000","last_peered":"2024-09-19T09:37:16.030264+0000","last_clean":"2024-09-19T09:37:16.030264+0000","last_became_active":"2024-09-19T09:36:12.987298+0000","last_became_peered":"2024-09-19T09:36:12.987298+0000","last_unstale":"2024-09-19T09:37:16.030264+0000","last_undegraded":"2024-09-19T09:37:16.030264+0000","last_fullsized":"2024-09-19T09:37:16.030264+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:47.397162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030230+0000","last_change":"2024-09-19T09:36:12.991466+0000","last_active":"2024-09-19T09:37:16.030230+0000","last_peered":"2024-09-19T09:37:16.030230+0000","last_clean":"2024-09-19T09:37:16.030230+0000","last_became_active":"2024-09-19T09:36:12.990903+0000","last_became_peered":"2024-09-19T09:36:12.990903+0000","last_unstale":"2024-09-19T09:37:16.030230+0000","last_undegraded":"2024-09-19T09:37:16.030230+0000","last_fullsized":"2024-09-19T09:37:16.030230+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:04.128768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028715+0000","last_change":"2024-09-19T09:36:12.986686+0000","last_active":"2024-09-19T09:37:16.028715+0000","last_peered":"2024-09-19T09:37:16.028715+0000","last_clean":"2024-09-19T09:37:16.028715+0000","last_became_active":"2024-09-19T09:36:12.986334+0000","last_became_peered":"2024-09-19T09:36:12.986334+0000","last_unstale":"2024-09-19T09:37:16.028715+0000","last_undegraded":"2024-09-19T09:37:16.028715+0000","last_fullsized":"2024-09-19T09:37:16.028715+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:39.926343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031575+0000","last_change":"2024-09-19T09:36:12.981964+0000","last_active":"2024-09-19T09:37:16.031575+0000","last_peered":"2024-09-19T09:37:16.031575+0000","last_clean":"2024-09-19T09:37:16.031575+0000","last_became_active":"2024-09-19T09:36:12.981558+0000","last_became_peered":"2024-09-19T09:36:12.981558+0000","last_unstale":"2024-09-19T09:37:16.031575+0000","last_undegraded":"2024-09-19T09:37:16.031575+0000","last_fullsized":"2024-09-19T09:37:16.031575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:33.706451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031212+0000","last_change":"2024-09-19T09:36:12.992598+0000","last_active":"2024-09-19T09:37:16.031212+0000","last_peered":"2024-09-19T09:37:16.031212+0000","last_clean":"2024-09-19T09:37:16.031212+0000","last_became_active":"2024-09-19T09:36:12.992281+0000","last_became_peered":"2024-09-19T09:36:12.992281+0000","last_unstale":"2024-09-19T09:37:16.031212+0000","last_undegraded":"2024-09-19T09:37:16.031212+0000","last_fullsized":"2024-09-19T09:37:16.031212+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:26.107432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030075+0000","last_change":"2024-09-19T09:36:12.988583+0000","last_active":"2024-09-19T09:37:16.030075+0000","last_peered":"2024-09-19T09:37:16.030075+0000","last_clean":"2024-09-19T09:37:16.030075+0000","last_became_active":"2024-09-19T09:36:12.987895+0000","last_became_peered":"2024-09-19T09:36:12.987895+0000","last_unstale":"2024-09-19T09:37:16.030075+0000","last_undegraded":"2024-09-19T09:37:16.030075+0000","last_fullsized":"2024-09-19T09:37:16.030075+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:47.617324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.483091+0000","last_change":"2024-09-19T09:36:12.988526+0000","last_active":"2024-09-19T09:37:16.483091+0000","last_peered":"2024-09-19T09:37:16.483091+0000","last_clean":"2024-09-19T09:37:16.483091+0000","last_became_active":"2024-09-19T09:36:12.988093+0000","last_became_peered":"2024-09-19T09:36:12.988093+0000","last_unstale":"2024-09-19T09:37:16.483091+0000","last_undegraded":"2024-09-19T09:37:16.483091+0000","last_fullsized":"2024-09-19T09:37:16.483091+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:48.949397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.123768+0000","last_change":"2024-09-19T09:36:12.992360+0000","last_active":"2024-09-19T09:37:16.123768+0000","last_peered":"2024-09-19T09:37:16.123768+0000","last_clean":"2024-09-19T09:37:16.123768+0000","last_became_active":"2024-09-19T09:36:12.991833+0000","last_became_peered":"2024-09-19T09:36:12.991833+0000","last_unstale":"2024-09-19T09:37:16.123768+0000","last_undegraded":"2024-09-19T09:37:16.123768+0000","last_fullsized":"2024-09-19T09:37:16.123768+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:47.715012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031904+0000","last_change":"2024-09-19T09:36:12.993435+0000","last_active":"2024-09-19T09:37:16.031904+0000","last_peered":"2024-09-19T09:37:16.031904+0000","last_clean":"2024-09-19T09:37:16.031904+0000","last_became_active":"2024-09-19T09:36:12.993108+0000","last_became_peered":"2024-09-19T09:36:12.993108+0000","last_unstale":"2024-09-19T09:37:16.031904+0000","last_undegraded":"2024-09-19T09:37:16.031904+0000","last_fullsized":"2024-09-19T09:37:16.031904+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:54.453593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030726+0000","last_change":"2024-09-19T09:36:12.991044+0000","last_active":"2024-09-19T09:37:16.030726+0000","last_peered":"2024-09-19T09:37:16.030726+0000","last_clean":"2024-09-19T09:37:16.030726+0000","last_became_active":"2024-09-19T09:36:12.989955+0000","last_became_peered":"2024-09-19T09:36:12.989955+0000","last_unstale":"2024-09-19T09:37:16.030726+0000","last_undegraded":"2024-09-19T09:37:16.030726+0000","last_fullsized":"2024-09-19T09:37:16.030726+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:21.034023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028894+0000","last_change":"2024-09-19T09:36:12.989679+0000","last_active":"2024-09-19T09:37:16.028894+0000","last_peered":"2024-09-19T09:37:16.028894+0000","last_clean":"2024-09-19T09:37:16.028894+0000","last_became_active":"2024-09-19T09:36:12.988463+0000","last_became_peered":"2024-09-19T09:36:12.988463+0000","last_unstale":"2024-09-19T09:37:16.028894+0000","last_undegraded":"2024-09-19T09:37:16.028894+0000","last_fullsized":"2024-09-19T09:37:16.028894+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:28.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034644+0000","last_change":"2024-09-19T09:36:12.983494+0000","last_active":"2024-09-19T09:37:16.034644+0000","last_peered":"2024-09-19T09:37:16.034644+0000","last_clean":"2024-09-19T09:37:16.034644+0000","last_became_active":"2024-09-19T09:36:12.983143+0000","last_became_peered":"2024-09-19T09:36:12.983143+0000","last_unstale":"2024-09-19T09:37:16.034644+0000","last_undegraded":"2024-09-19T09:37:16.034644+0000","last_fullsized":"2024-09-19T09:37:16.034644+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:23.378183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030018+0000","last_change":"2024-09-19T09:36:12.987512+0000","last_active":"2024-09-19T09:37:16.030018+0000","last_peered":"2024-09-19T09:37:16.030018+0000","last_clean":"2024-09-19T09:37:16.030018+0000","last_became_active":"2024-09-19T09:36:12.987288+0000","last_became_peered":"2024-09-19T09:36:12.987288+0000","last_unstale":"2024-09-19T09:37:16.030018+0000","last_undegraded":"2024-09-19T09:37:16.030018+0000","last_fullsized":"2024-09-19T09:37:16.030018+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:14.614333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.131000+0000","last_change":"2024-09-19T09:37:16.131000+0000","last_active":"2024-09-19T09:37:16.131000+0000","last_peered":"2024-09-19T09:37:16.131000+0000","last_clean":"2024-09-19T09:37:16.131000+0000","last_became_active":"2024-09-19T09:37:16.130647+0000","last_became_peered":"2024-09-19T09:37:16.130647+0000","last_unstale":"2024-09-19T09:37:16.131000+0000","last_undegraded":"2024-09-19T09:37:16.131000+0000","last_fullsized":"2024-09-19T09:37:16.131000+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:22.498318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.123244+0000","last_change":"2024-09-19T09:36:12.988210+0000","last_active":"2024-09-19T09:37:16.123244+0000","last_peered":"2024-09-19T09:37:16.123244+0000","last_clean":"2024-09-19T09:37:16.123244+0000","last_became_active":"2024-09-19T09:36:12.987904+0000","last_became_peered":"2024-09-19T09:36:12.987904+0000","last_unstale":"2024-09-19T09:37:16.123244+0000","last_undegraded":"2024-09-19T09:37:16.123244+0000","last_fullsized":"2024-09-19T09:37:16.123244+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:13.588237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.033392+0000","last_change":"2024-09-19T09:36:12.984028+0000","last_active":"2024-09-19T09:37:16.033392+0000","last_peered":"2024-09-19T09:37:16.033392+0000","last_clean":"2024-09-19T09:37:16.033392+0000","last_became_active":"2024-09-19T09:36:12.982062+0000","last_became_peered":"2024-09-19T09:36:12.982062+0000","last_unstale":"2024-09-19T09:37:16.033392+0000","last_undegraded":"2024-09-19T09:37:16.033392+0000","last_fullsized":"2024-09-19T09:37:16.033392+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:26.610287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.027961+0000","last_change":"2024-09-19T09:36:12.979277+0000","last_active":"2024-09-19T09:37:16.027961+0000","last_peered":"2024-09-19T09:37:16.027961+0000","last_clean":"2024-09-19T09:37:16.027961+0000","last_became_active":"2024-09-19T09:36:12.978970+0000","last_became_peered":"2024-09-19T09:36:12.978970+0000","last_unstale":"2024-09-19T09:37:16.027961+0000","last_undegraded":"2024-09-19T09:37:16.027961+0000","last_fullsized":"2024-09-19T09:37:16.027961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:00.424728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.130307+0000","last_change":"2024-09-19T09:36:12.981021+0000","last_active":"2024-09-19T09:37:16.130307+0000","last_peered":"2024-09-19T09:37:16.130307+0000","last_clean":"2024-09-19T09:37:16.130307+0000","last_became_active":"2024-09-19T09:36:12.980580+0000","last_became_peered":"2024-09-19T09:36:12.980580+0000","last_unstale":"2024-09-19T09:37:16.130307+0000","last_undegraded":"2024-09-19T09:37:16.130307+0000","last_fullsized":"2024-09-19T09:37:16.130307+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:17.464873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.032578+0000","last_change":"2024-09-19T09:36:12.986090+0000","last_active":"2024-09-19T09:37:16.032578+0000","last_peered":"2024-09-19T09:37:16.032578+0000","last_clean":"2024-09-19T09:37:16.032578+0000","last_became_active":"2024-09-19T09:36:12.985740+0000","last_became_peered":"2024-09-19T09:36:12.985740+0000","last_unstale":"2024-09-19T09:37:16.032578+0000","last_undegraded":"2024-09-19T09:37:16.032578+0000","last_fullsized":"2024-09-19T09:37:16.032578+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:35.252834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034672+0000","last_change":"2024-09-19T09:36:12.981257+0000","last_active":"2024-09-19T09:37:16.034672+0000","last_peered":"2024-09-19T09:37:16.034672+0000","last_clean":"2024-09-19T09:37:16.034672+0000","last_became_active":"2024-09-19T09:36:12.980911+0000","last_became_peered":"2024-09-19T09:36:12.980911+0000","last_unstale":"2024-09-19T09:37:16.034672+0000","last_undegraded":"2024-09-19T09:37:16.034672+0000","last_fullsized":"2024-09-19T09:37:16.034672+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:41.470514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.123641+0000","last_change":"2024-09-19T09:36:12.982585+0000","last_active":"2024-09-19T09:37:16.123641+0000","last_peered":"2024-09-19T09:37:16.123641+0000","last_clean":"2024-09-19T09:37:16.123641+0000","last_became_active":"2024-09-19T09:36:12.982193+0000","last_became_peered":"2024-09-19T09:36:12.982193+0000","last_unstale":"2024-09-19T09:37:16.123641+0000","last_undegraded":"2024-09-19T09:37:16.123641+0000","last_fullsized":"2024-09-19T09:37:16.123641+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:30.057088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.483144+0000","last_change":"2024-09-19T09:36:12.985236+0000","last_active":"2024-09-19T09:37:16.483144+0000","last_peered":"2024-09-19T09:37:16.483144+0000","last_clean":"2024-09-19T09:37:16.483144+0000","last_became_active":"2024-09-19T09:36:12.984751+0000","last_became_peered":"2024-09-19T09:36:12.984751+0000","last_unstale":"2024-09-19T09:37:16.483144+0000","last_undegraded":"2024-09-19T09:37:16.483144+0000","last_fullsized":"2024-09-19T09:37:16.483144+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:52.784216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029585+0000","last_change":"2024-09-19T09:36:12.985856+0000","last_active":"2024-09-19T09:37:16.029585+0000","last_peered":"2024-09-19T09:37:16.029585+0000","last_clean":"2024-09-19T09:37:16.029585+0000","last_became_active":"2024-09-19T09:36:12.985312+0000","last_became_peered":"2024-09-19T09:36:12.985312+0000","last_unstale":"2024-09-19T09:37:16.029585+0000","last_undegraded":"2024-09-19T09:37:16.029585+0000","last_fullsized":"2024-09-19T09:37:16.029585+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:25.235945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.483729+0000","last_change":"2024-09-19T09:36:12.982443+0000","last_active":"2024-09-19T09:37:16.483729+0000","last_peered":"2024-09-19T09:37:16.483729+0000","last_clean":"2024-09-19T09:37:16.483729+0000","last_became_active":"2024-09-19T09:36:12.982130+0000","last_became_peered":"2024-09-19T09:36:12.982130+0000","last_unstale":"2024-09-19T09:37:16.483729+0000","last_undegraded":"2024-09-19T09:37:16.483729+0000","last_fullsized":"2024-09-19T09:37:16.483729+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:17.177563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.130468+0000","last_change":"2024-09-19T09:36:12.990439+0000","last_active":"2024-09-19T09:37:16.130468+0000","last_peered":"2024-09-19T09:37:16.130468+0000","last_clean":"2024-09-19T09:37:16.130468+0000","last_became_active":"2024-09-19T09:36:12.990135+0000","last_became_peered":"2024-09-19T09:36:12.990135+0000","last_unstale":"2024-09-19T09:37:16.130468+0000","last_undegraded":"2024-09-19T09:37:16.130468+0000","last_fullsized":"2024-09-19T09:37:16.130468+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:51.685192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.032815+0000","last_change":"2024-09-19T09:36:12.987261+0000","last_active":"2024-09-19T09:37:16.032815+0000","last_peered":"2024-09-19T09:37:16.032815+0000","last_clean":"2024-09-19T09:37:16.032815+0000","last_became_active":"2024-09-19T09:36:12.986192+0000","last_became_peered":"2024-09-19T09:36:12.986192+0000","last_unstale":"2024-09-19T09:37:16.032815+0000","last_undegraded":"2024-09-19T09:37:16.032815+0000","last_fullsized":"2024-09-19T09:37:16.032815+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:58.435605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034502+0000","last_change":"2024-09-19T09:36:12.981248+0000","last_active":"2024-09-19T09:37:16.034502+0000","last_peered":"2024-09-19T09:37:16.034502+0000","last_clean":"2024-09-19T09:37:16.034502+0000","last_became_active":"2024-09-19T09:36:12.980754+0000","last_became_peered":"2024-09-19T09:36:12.980754+0000","last_unstale":"2024-09-19T09:37:16.034502+0000","last_undegraded":"2024-09-19T09:37:16.034502+0000","last_fullsized":"2024-09-19T09:37:16.034502+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:03.970402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030143+0000","last_change":"2024-09-19T09:36:12.990841+0000","last_active":"2024-09-19T09:37:16.030143+0000","last_peered":"2024-09-19T09:37:16.030143+0000","last_clean":"2024-09-19T09:37:16.030143+0000","last_became_active":"2024-09-19T09:36:12.989667+0000","last_became_peered":"2024-09-19T09:36:12.989667+0000","last_unstale":"2024-09-19T09:37:16.030143+0000","last_undegraded":"2024-09-19T09:37:16.030143+0000","last_fullsized":"2024-09-19T09:37:16.030143+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:46:00.314590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.129743+0000","last_change":"2024-09-19T09:36:12.984007+0000","last_active":"2024-09-19T09:37:16.129743+0000","last_peered":"2024-09-19T09:37:16.129743+0000","last_clean":"2024-09-19T09:37:16.129743+0000","last_became_active":"2024-09-19T09:36:12.983627+0000","last_became_peered":"2024-09-19T09:36:12.983627+0000","last_unstale":"2024-09-19T09:37:16.129743+0000","last_undegraded":"2024-09-19T09:37:16.129743+0000","last_fullsized":"2024-09-19T09:37:16.129743+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:42.038673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.129893+0000","last_change":"2024-09-19T09:36:12.988032+0000","last_active":"2024-09-19T09:37:16.129893+0000","last_peered":"2024-09-19T09:37:16.129893+0000","last_clean":"2024-09-19T09:37:16.129893+0000","last_became_active":"2024-09-19T09:36:12.987588+0000","last_became_peered":"2024-09-19T09:36:12.987588+0000","last_unstale":"2024-09-19T09:37:16.129893+0000","last_undegraded":"2024-09-19T09:37:16.129893+0000","last_fullsized":"2024-09-19T09:37:16.129893+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:01.518543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.131565+0000","last_change":"2024-09-19T09:37:16.131565+0000","last_active":"2024-09-19T09:37:16.131565+0000","last_peered":"2024-09-19T09:37:16.131565+0000","last_clean":"2024-09-19T09:37:16.131565+0000","last_became_active":"2024-09-19T09:37:16.131171+0000","last_became_peered":"2024-09-19T09:37:16.131171+0000","last_unstale":"2024-09-19T09:37:16.131565+0000","last_undegraded":"2024-09-19T09:37:16.131565+0000","last_fullsized":"2024-09-19T09:37:16.131565+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:18.195074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031827+0000","last_change":"2024-09-19T09:36:12.989709+0000","last_active":"2024-09-19T09:37:16.031827+0000","last_peered":"2024-09-19T09:37:16.031827+0000","last_clean":"2024-09-19T09:37:16.031827+0000","last_became_active":"2024-09-19T09:36:12.989324+0000","last_became_peered":"2024-09-19T09:36:12.989324+0000","last_unstale":"2024-09-19T09:37:16.031827+0000","last_undegraded":"2024-09-19T09:37:16.031827+0000","last_fullsized":"2024-09-19T09:37:16.031827+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:09.843175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.033713+0000","last_change":"2024-09-19T09:37:16.033713+0000","last_active":"2024-09-19T09:37:16.033713+0000","last_peered":"2024-09-19T09:37:16.033713+0000","last_clean":"2024-09-19T09:37:16.033713+0000","last_became_active":"2024-09-19T09:37:16.033230+0000","last_became_peered":"2024-09-19T09:37:16.033230+0000","last_unstale":"2024-09-19T09:37:16.033713+0000","last_undegraded":"2024-09-19T09:37:16.033713+0000","last_fullsized":"2024-09-19T09:37:16.033713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:12.262115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.484760+0000","last_change":"2024-09-19T09:37:16.484760+0000","last_active":"2024-09-19T09:37:16.484760+0000","last_peered":"2024-09-19T09:37:16.484760+0000","last_clean":"2024-09-19T09:37:16.484760+0000","last_became_active":"2024-09-19T09:37:16.484316+0000","last_became_peered":"2024-09-19T09:37:16.484316+0000","last_unstale":"2024-09-19T09:37:16.484760+0000","last_undegraded":"2024-09-19T09:37:16.484760+0000","last_fullsized":"2024-09-19T09:37:16.484760+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:14.897601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.124818+0000","last_change":"2024-09-19T09:37:16.124818+0000","last_active":"2024-09-19T09:37:16.124818+0000","last_peered":"2024-09-19T09:37:16.124818+0000","last_clean":"2024-09-19T09:37:16.124818+0000","last_became_active":"2024-09-19T09:37:16.124391+0000","last_became_peered":"2024-09-19T09:37:16.124391+0000","last_unstale":"2024-09-19T09:37:16.124818+0000","last_undegraded":"2024-09-19T09:37:16.124818+0000","last_fullsized":"2024-09-19T09:37:16.124818+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:25.443666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034105+0000","last_change":"2024-09-19T09:36:10.837287+0000","last_active":"2024-09-19T09:37:16.034105+0000","last_peered":"2024-09-19T09:37:16.034105+0000","last_clean":"2024-09-19T09:37:16.034105+0000","last_became_active":"2024-09-19T09:36:10.836890+0000","last_became_peered":"2024-09-19T09:36:10.836890+0000","last_unstale":"2024-09-19T09:37:16.034105+0000","last_undegraded":"2024-09-19T09:37:16.034105+0000","last_fullsized":"2024-09-19T09:37:16.034105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:09.676728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.483176+0000","last_change":"2024-09-19T09:36:12.975690+0000","last_active":"2024-09-19T09:37:16.483176+0000","last_peered":"2024-09-19T09:37:16.483176+0000","last_clean":"2024-09-19T09:37:16.483176+0000","last_became_active":"2024-09-19T09:36:12.975370+0000","last_became_peered":"2024-09-19T09:36:12.975370+0000","last_unstale":"2024-09-19T09:37:16.483176+0000","last_undegraded":"2024-09-19T09:37:16.483176+0000","last_fullsized":"2024-09-19T09:37:16.483176+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:05.650917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030234+0000","last_change":"2024-09-19T09:36:10.843736+0000","last_active":"2024-09-19T09:37:16.030234+0000","last_peered":"2024-09-19T09:37:16.030234+0000","last_clean":"2024-09-19T09:37:16.030234+0000","last_became_active":"2024-09-19T09:36:10.843353+0000","last_became_peered":"2024-09-19T09:36:10.843353+0000","last_unstale":"2024-09-19T09:37:16.030234+0000","last_undegraded":"2024-09-19T09:37:16.030234+0000","last_fullsized":"2024-09-19T09:37:16.030234+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:29.818642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.027711+0000","last_change":"2024-09-19T09:36:12.978841+0000","last_active":"2024-09-19T09:37:16.027711+0000","last_peered":"2024-09-19T09:37:16.027711+0000","last_clean":"2024-09-19T09:37:16.027711+0000","last_became_active":"2024-09-19T09:36:12.978501+0000","last_became_peered":"2024-09-19T09:36:12.978501+0000","last_unstale":"2024-09-19T09:37:16.027711+0000","last_undegraded":"2024-09-19T09:37:16.027711+0000","last_fullsized":"2024-09-19T09:37:16.027711+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:07.974576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.032030+0000","last_change":"2024-09-19T09:36:10.841997+0000","last_active":"2024-09-19T09:37:16.032030+0000","last_peered":"2024-09-19T09:37:16.032030+0000","last_clean":"2024-09-19T09:37:16.032030+0000","last_became_active":"2024-09-19T09:36:10.841641+0000","last_became_peered":"2024-09-19T09:36:10.841641+0000","last_unstale":"2024-09-19T09:37:16.032030+0000","last_undegraded":"2024-09-19T09:37:16.032030+0000","last_fullsized":"2024-09-19T09:37:16.032030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:10.477879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.123718+0000","last_change":"2024-09-19T09:36:12.981486+0000","last_active":"2024-09-19T09:37:16.123718+0000","last_peered":"2024-09-19T09:37:16.123718+0000","last_clean":"2024-09-19T09:37:16.123718+0000","last_became_active":"2024-09-19T09:36:12.981165+0000","last_became_peered":"2024-09-19T09:36:12.981165+0000","last_unstale":"2024-09-19T09:37:16.123718+0000","last_undegraded":"2024-09-19T09:37:16.123718+0000","last_fullsized":"2024-09-19T09:37:16.123718+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:21.986132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030755+0000","last_change":"2024-09-19T09:36:10.845362+0000","last_active":"2024-09-19T09:37:16.030755+0000","last_peered":"2024-09-19T09:37:16.030755+0000","last_clean":"2024-09-19T09:37:16.030755+0000","last_became_active":"2024-09-19T09:36:10.844992+0000","last_became_peered":"2024-09-19T09:36:10.844992+0000","last_unstale":"2024-09-19T09:37:16.030755+0000","last_undegraded":"2024-09-19T09:37:16.030755+0000","last_fullsized":"2024-09-19T09:37:16.030755+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:52.854333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030434+0000","last_change":"2024-09-19T09:36:12.988924+0000","last_active":"2024-09-19T09:37:16.030434+0000","last_peered":"2024-09-19T09:37:16.030434+0000","last_clean":"2024-09-19T09:37:16.030434+0000","last_became_active":"2024-09-19T09:36:12.988331+0000","last_became_peered":"2024-09-19T09:36:12.988331+0000","last_unstale":"2024-09-19T09:37:16.030434+0000","last_undegraded":"2024-09-19T09:37:16.030434+0000","last_fullsized":"2024-09-19T09:37:16.030434+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:24.754252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029903+0000","last_change":"2024-09-19T09:36:10.860003+0000","last_active":"2024-09-19T09:37:16.029903+0000","last_peered":"2024-09-19T09:37:16.029903+0000","last_clean":"2024-09-19T09:37:16.029903+0000","last_became_active":"2024-09-19T09:36:10.859584+0000","last_became_peered":"2024-09-19T09:36:10.859584+0000","last_unstale":"2024-09-19T09:37:16.029903+0000","last_undegraded":"2024-09-19T09:37:16.029903+0000","last_fullsized":"2024-09-19T09:37:16.029903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:44.837960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.123413+0000","last_change":"2024-09-19T09:36:12.985446+0000","last_active":"2024-09-19T09:37:16.123413+0000","last_peered":"2024-09-19T09:37:16.123413+0000","last_clean":"2024-09-19T09:37:16.123413+0000","last_became_active":"2024-09-19T09:36:12.984671+0000","last_became_peered":"2024-09-19T09:36:12.984671+0000","last_unstale":"2024-09-19T09:37:16.123413+0000","last_undegraded":"2024-09-19T09:37:16.123413+0000","last_fullsized":"2024-09-19T09:37:16.123413+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:54.800151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'27","reported_seq":186,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:26.048430+0000","last_change":"2024-09-19T09:36:10.841056+0000","last_active":"2024-09-19T09:37:26.048430+0000","last_peered":"2024-09-19T09:37:26.048430+0000","last_clean":"2024-09-19T09:37:26.048430+0000","last_became_active":"2024-09-19T09:36:10.840731+0000","last_became_peered":"2024-09-19T09:36:10.840731+0000","last_unstale":"2024-09-19T09:37:26.048430+0000","last_undegraded":"2024-09-19T09:37:26.048430+0000","last_fullsized":"2024-09-19T09:37:26.048430+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:13.676188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62819,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":129,"num_write":27,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030607+0000","last_change":"2024-09-19T09:36:12.990223+0000","last_active":"2024-09-19T09:37:16.030607+0000","last_peered":"2024-09-19T09:37:16.030607+0000","last_clean":"2024-09-19T09:37:16.030607+0000","last_became_active":"2024-09-19T09:36:12.989720+0000","last_became_peered":"2024-09-19T09:36:12.989720+0000","last_unstale":"2024-09-19T09:37:16.030607+0000","last_undegraded":"2024-09-19T09:37:16.030607+0000","last_fullsized":"2024-09-19T09:37:16.030607+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:37.003075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.129753+0000","last_change":"2024-09-19T09:36:10.843288+0000","last_active":"2024-09-19T09:37:16.129753+0000","last_peered":"2024-09-19T09:37:16.129753+0000","last_clean":"2024-09-19T09:37:16.129753+0000","last_became_active":"2024-09-19T09:36:10.842844+0000","last_became_peered":"2024-09-19T09:36:10.842844+0000","last_unstale":"2024-09-19T09:37:16.129753+0000","last_undegraded":"2024-09-19T09:37:16.129753+0000","last_fullsized":"2024-09-19T09:37:16.129753+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:38.695411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034196+0000","last_change":"2024-09-19T09:36:12.981251+0000","last_active":"2024-09-19T09:37:16.034196+0000","last_peered":"2024-09-19T09:37:16.034196+0000","last_clean":"2024-09-19T09:37:16.034196+0000","last_became_active":"2024-09-19T09:36:12.980861+0000","last_became_peered":"2024-09-19T09:36:12.980861+0000","last_unstale":"2024-09-19T09:37:16.034196+0000","last_undegraded":"2024-09-19T09:37:16.034196+0000","last_fullsized":"2024-09-19T09:37:16.034196+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:09.633644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030128+0000","last_change":"2024-09-19T09:36:10.843448+0000","last_active":"2024-09-19T09:37:16.030128+0000","last_peered":"2024-09-19T09:37:16.030128+0000","last_clean":"2024-09-19T09:37:16.030128+0000","last_became_active":"2024-09-19T09:36:10.843087+0000","last_became_peered":"2024-09-19T09:36:10.843087+0000","last_unstale":"2024-09-19T09:37:16.030128+0000","last_undegraded":"2024-09-19T09:37:16.030128+0000","last_fullsized":"2024-09-19T09:37:16.030128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:20.623613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030593+0000","last_change":"2024-09-19T09:36:12.981160+0000","last_active":"2024-09-19T09:37:16.030593+0000","last_peered":"2024-09-19T09:37:16.030593+0000","last_clean":"2024-09-19T09:37:16.030593+0000","last_became_active":"2024-09-19T09:36:12.980823+0000","last_became_peered":"2024-09-19T09:36:12.980823+0000","last_unstale":"2024-09-19T09:37:16.030593+0000","last_undegraded":"2024-09-19T09:37:16.030593+0000","last_fullsized":"2024-09-19T09:37:16.030593+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:39.323439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028480+0000","last_change":"2024-09-19T09:36:10.842536+0000","last_active":"2024-09-19T09:37:16.028480+0000","last_peered":"2024-09-19T09:37:16.028480+0000","last_clean":"2024-09-19T09:37:16.028480+0000","last_became_active":"2024-09-19T09:36:10.842176+0000","last_became_peered":"2024-09-19T09:36:10.842176+0000","last_unstale":"2024-09-19T09:37:16.028480+0000","last_undegraded":"2024-09-19T09:37:16.028480+0000","last_fullsized":"2024-09-19T09:37:16.028480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:37.871299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030057+0000","last_change":"2024-09-19T09:36:12.987271+0000","last_active":"2024-09-19T09:37:16.030057+0000","last_peered":"2024-09-19T09:37:16.030057+0000","last_clean":"2024-09-19T09:37:16.030057+0000","last_became_active":"2024-09-19T09:36:12.986918+0000","last_became_peered":"2024-09-19T09:36:12.986918+0000","last_unstale":"2024-09-19T09:37:16.030057+0000","last_undegraded":"2024-09-19T09:37:16.030057+0000","last_fullsized":"2024-09-19T09:37:16.030057+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:07.608541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030337+0000","last_change":"2024-09-19T09:36:10.860370+0000","last_active":"2024-09-19T09:37:16.030337+0000","last_peered":"2024-09-19T09:37:16.030337+0000","last_clean":"2024-09-19T09:37:16.030337+0000","last_became_active":"2024-09-19T09:36:10.859820+0000","last_became_peered":"2024-09-19T09:36:10.859820+0000","last_unstale":"2024-09-19T09:37:16.030337+0000","last_undegraded":"2024-09-19T09:37:16.030337+0000","last_fullsized":"2024-09-19T09:37:16.030337+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:12.121038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029793+0000","last_change":"2024-09-19T09:36:12.994449+0000","last_active":"2024-09-19T09:37:16.029793+0000","last_peered":"2024-09-19T09:37:16.029793+0000","last_clean":"2024-09-19T09:37:16.029793+0000","last_became_active":"2024-09-19T09:36:12.994141+0000","last_became_peered":"2024-09-19T09:36:12.994141+0000","last_unstale":"2024-09-19T09:37:16.029793+0000","last_undegraded":"2024-09-19T09:37:16.029793+0000","last_fullsized":"2024-09-19T09:37:16.029793+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:21.416453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031764+0000","last_change":"2024-09-19T09:36:10.839609+0000","last_active":"2024-09-19T09:37:16.031764+0000","last_peered":"2024-09-19T09:37:16.031764+0000","last_clean":"2024-09-19T09:37:16.031764+0000","last_became_active":"2024-09-19T09:36:10.839227+0000","last_became_peered":"2024-09-19T09:36:10.839227+0000","last_unstale":"2024-09-19T09:37:16.031764+0000","last_undegraded":"2024-09-19T09:37:16.031764+0000","last_fullsized":"2024-09-19T09:37:16.031764+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:00.734924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.032825+0000","last_change":"2024-09-19T09:36:12.983573+0000","last_active":"2024-09-19T09:37:16.032825+0000","last_peered":"2024-09-19T09:37:16.032825+0000","last_clean":"2024-09-19T09:37:16.032825+0000","last_became_active":"2024-09-19T09:36:12.983241+0000","last_became_peered":"2024-09-19T09:36:12.983241+0000","last_unstale":"2024-09-19T09:37:16.032825+0000","last_undegraded":"2024-09-19T09:37:16.032825+0000","last_fullsized":"2024-09-19T09:37:16.032825+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:44.050271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034765+0000","last_change":"2024-09-19T09:36:10.839789+0000","last_active":"2024-09-19T09:37:16.034765+0000","last_peered":"2024-09-19T09:37:16.034765+0000","last_clean":"2024-09-19T09:37:16.034765+0000","last_became_active":"2024-09-19T09:36:10.839445+0000","last_became_peered":"2024-09-19T09:36:10.839445+0000","last_unstale":"2024-09-19T09:37:16.034765+0000","last_undegraded":"2024-09-19T09:37:16.034765+0000","last_fullsized":"2024-09-19T09:37:16.034765+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:16.040249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031041+0000","last_change":"2024-09-19T09:36:12.993420+0000","last_active":"2024-09-19T09:37:16.031041+0000","last_peered":"2024-09-19T09:37:16.031041+0000","last_clean":"2024-09-19T09:37:16.031041+0000","last_became_active":"2024-09-19T09:36:12.992334+0000","last_became_peered":"2024-09-19T09:36:12.992334+0000","last_unstale":"2024-09-19T09:37:16.031041+0000","last_undegraded":"2024-09-19T09:37:16.031041+0000","last_fullsized":"2024-09-19T09:37:16.031041+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:21.693164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030247+0000","last_change":"2024-09-19T09:36:10.839461+0000","last_active":"2024-09-19T09:37:16.030247+0000","last_peered":"2024-09-19T09:37:16.030247+0000","last_clean":"2024-09-19T09:37:16.030247+0000","last_became_active":"2024-09-19T09:36:10.839092+0000","last_became_peered":"2024-09-19T09:36:10.839092+0000","last_unstale":"2024-09-19T09:37:16.030247+0000","last_undegraded":"2024-09-19T09:37:16.030247+0000","last_fullsized":"2024-09-19T09:37:16.030247+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:02.367267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030632+0000","last_change":"2024-09-19T09:36:12.988234+0000","last_active":"2024-09-19T09:37:16.030632+0000","last_peered":"2024-09-19T09:37:16.030632+0000","last_clean":"2024-09-19T09:37:16.030632+0000","last_became_active":"2024-09-19T09:36:12.987813+0000","last_became_peered":"2024-09-19T09:36:12.987813+0000","last_unstale":"2024-09-19T09:37:16.030632+0000","last_undegraded":"2024-09-19T09:37:16.030632+0000","last_fullsized":"2024-09-19T09:37:16.030632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:56.024428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.130482+0000","last_change":"2024-09-19T09:36:10.945705+0000","last_active":"2024-09-19T09:37:16.130482+0000","last_peered":"2024-09-19T09:37:16.130482+0000","last_clean":"2024-09-19T09:37:16.130482+0000","last_became_active":"2024-09-19T09:36:10.945323+0000","last_became_peered":"2024-09-19T09:36:10.945323+0000","last_unstale":"2024-09-19T09:37:16.130482+0000","last_undegraded":"2024-09-19T09:37:16.130482+0000","last_fullsized":"2024-09-19T09:37:16.130482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:24.211909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030856+0000","last_change":"2024-09-19T09:36:12.990517+0000","last_active":"2024-09-19T09:37:16.030856+0000","last_peered":"2024-09-19T09:37:16.030856+0000","last_clean":"2024-09-19T09:37:16.030856+0000","last_became_active":"2024-09-19T09:36:12.989291+0000","last_became_peered":"2024-09-19T09:36:12.989291+0000","last_unstale":"2024-09-19T09:37:16.030856+0000","last_undegraded":"2024-09-19T09:37:16.030856+0000","last_fullsized":"2024-09-19T09:37:16.030856+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:31.087798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":338,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030324+0000","last_change":"2024-09-19T09:34:59.337025+0000","last_active":"2024-09-19T09:37:16.030324+0000","last_peered":"2024-09-19T09:37:16.030324+0000","last_clean":"2024-09-19T09:37:16.030324+0000","last_became_active":"2024-09-19T09:34:59.336556+0000","last_became_peered":"2024-09-19T09:34:59.336556+0000","last_unstale":"2024-09-19T09:37:16.030324+0000","last_undegraded":"2024-09-19T09:37:16.030324+0000","last_fullsized":"2024-09-19T09:37:16.030324+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:31:30.566923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:31:30.566923+0000","last_clean_scrub_stamp":"2024-09-19T09:31:30.566923+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:00.675254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028715+0000","last_change":"2024-09-19T09:36:10.838131+0000","last_active":"2024-09-19T09:37:16.028715+0000","last_peered":"2024-09-19T09:37:16.028715+0000","last_clean":"2024-09-19T09:37:16.028715+0000","last_became_active":"2024-09-19T09:36:10.837725+0000","last_became_peered":"2024-09-19T09:36:10.837725+0000","last_unstale":"2024-09-19T09:37:16.028715+0000","last_undegraded":"2024-09-19T09:37:16.028715+0000","last_fullsized":"2024-09-19T09:37:16.028715+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:57.104726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.483429+0000","last_change":"2024-09-19T09:36:12.981951+0000","last_active":"2024-09-19T09:37:16.483429+0000","last_peered":"2024-09-19T09:37:16.483429+0000","last_clean":"2024-09-19T09:37:16.483429+0000","last_became_active":"2024-09-19T09:36:12.981558+0000","last_became_peered":"2024-09-19T09:36:12.981558+0000","last_unstale":"2024-09-19T09:37:16.483429+0000","last_undegraded":"2024-09-19T09:37:16.483429+0000","last_fullsized":"2024-09-19T09:37:16.483429+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:31.119853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030184+0000","last_change":"2024-09-19T09:36:10.843574+0000","last_active":"2024-09-19T09:37:16.030184+0000","last_peered":"2024-09-19T09:37:16.030184+0000","last_clean":"2024-09-19T09:37:16.030184+0000","last_became_active":"2024-09-19T09:36:10.843252+0000","last_became_peered":"2024-09-19T09:36:10.843252+0000","last_unstale":"2024-09-19T09:37:16.030184+0000","last_undegraded":"2024-09-19T09:37:16.030184+0000","last_fullsized":"2024-09-19T09:37:16.030184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:10.492812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.033999+0000","last_change":"2024-09-19T09:36:12.984538+0000","last_active":"2024-09-19T09:37:16.033999+0000","last_peered":"2024-09-19T09:37:16.033999+0000","last_clean":"2024-09-19T09:37:16.033999+0000","last_became_active":"2024-09-19T09:36:12.983448+0000","last_became_peered":"2024-09-19T09:36:12.983448+0000","last_unstale":"2024-09-19T09:37:16.033999+0000","last_undegraded":"2024-09-19T09:37:16.033999+0000","last_fullsized":"2024-09-19T09:37:16.033999+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:48.294473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034208+0000","last_change":"2024-09-19T09:36:10.858959+0000","last_active":"2024-09-19T09:37:16.034208+0000","last_peered":"2024-09-19T09:37:16.034208+0000","last_clean":"2024-09-19T09:37:16.034208+0000","last_became_active":"2024-09-19T09:36:10.858638+0000","last_became_peered":"2024-09-19T09:36:10.858638+0000","last_unstale":"2024-09-19T09:37:16.034208+0000","last_undegraded":"2024-09-19T09:37:16.034208+0000","last_fullsized":"2024-09-19T09:37:16.034208+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:12.646483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029679+0000","last_change":"2024-09-19T09:36:12.992710+0000","last_active":"2024-09-19T09:37:16.029679+0000","last_peered":"2024-09-19T09:37:16.029679+0000","last_clean":"2024-09-19T09:37:16.029679+0000","last_became_active":"2024-09-19T09:36:12.992436+0000","last_became_peered":"2024-09-19T09:36:12.992436+0000","last_unstale":"2024-09-19T09:37:16.029679+0000","last_undegraded":"2024-09-19T09:37:16.029679+0000","last_fullsized":"2024-09-19T09:37:16.029679+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:51.685516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030475+0000","last_change":"2024-09-19T09:36:10.842031+0000","last_active":"2024-09-19T09:37:16.030475+0000","last_peered":"2024-09-19T09:37:16.030475+0000","last_clean":"2024-09-19T09:37:16.030475+0000","last_became_active":"2024-09-19T09:36:10.841693+0000","last_became_peered":"2024-09-19T09:36:10.841693+0000","last_unstale":"2024-09-19T09:37:16.030475+0000","last_undegraded":"2024-09-19T09:37:16.030475+0000","last_fullsized":"2024-09-19T09:37:16.030475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:28:51.040551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034026+0000","last_change":"2024-09-19T09:37:16.034026+0000","last_active":"2024-09-19T09:37:16.034026+0000","last_peered":"2024-09-19T09:37:16.034026+0000","last_clean":"2024-09-19T09:37:16.034026+0000","last_became_active":"2024-09-19T09:37:16.033546+0000","last_became_peered":"2024-09-19T09:37:16.033546+0000","last_unstale":"2024-09-19T09:37:16.034026+0000","last_undegraded":"2024-09-19T09:37:16.034026+0000","last_fullsized":"2024-09-19T09:37:16.034026+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:42.673825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.027885+0000","last_change":"2024-09-19T09:36:10.860470+0000","last_active":"2024-09-19T09:37:16.027885+0000","last_peered":"2024-09-19T09:37:16.027885+0000","last_clean":"2024-09-19T09:37:16.027885+0000","last_became_active":"2024-09-19T09:36:10.860097+0000","last_became_peered":"2024-09-19T09:36:10.860097+0000","last_unstale":"2024-09-19T09:37:16.027885+0000","last_undegraded":"2024-09-19T09:37:16.027885+0000","last_fullsized":"2024-09-19T09:37:16.027885+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:14.933378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031415+0000","last_change":"2024-09-19T09:36:12.988489+0000","last_active":"2024-09-19T09:37:16.031415+0000","last_peered":"2024-09-19T09:37:16.031415+0000","last_clean":"2024-09-19T09:37:16.031415+0000","last_became_active":"2024-09-19T09:36:12.988151+0000","last_became_peered":"2024-09-19T09:36:12.988151+0000","last_unstale":"2024-09-19T09:37:16.031415+0000","last_undegraded":"2024-09-19T09:37:16.031415+0000","last_fullsized":"2024-09-19T09:37:16.031415+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:24.088771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030844+0000","last_change":"2024-09-19T09:36:10.860103+0000","last_active":"2024-09-19T09:37:16.030844+0000","last_peered":"2024-09-19T09:37:16.030844+0000","last_clean":"2024-09-19T09:37:16.030844+0000","last_became_active":"2024-09-19T09:36:10.859526+0000","last_became_peered":"2024-09-19T09:36:10.859526+0000","last_unstale":"2024-09-19T09:37:16.030844+0000","last_undegraded":"2024-09-19T09:37:16.030844+0000","last_fullsized":"2024-09-19T09:37:16.030844+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:25.460372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034672+0000","last_change":"2024-09-19T09:36:12.986286+0000","last_active":"2024-09-19T09:37:16.034672+0000","last_peered":"2024-09-19T09:37:16.034672+0000","last_clean":"2024-09-19T09:37:16.034672+0000","last_became_active":"2024-09-19T09:36:12.985982+0000","last_became_peered":"2024-09-19T09:36:12.985982+0000","last_unstale":"2024-09-19T09:37:16.034672+0000","last_undegraded":"2024-09-19T09:37:16.034672+0000","last_fullsized":"2024-09-19T09:37:16.034672+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:19.026134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'10","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028122+0000","last_change":"2024-09-19T09:36:10.839280+0000","last_active":"2024-09-19T09:37:16.028122+0000","last_peered":"2024-09-19T09:37:16.028122+0000","last_clean":"2024-09-19T09:37:16.028122+0000","last_became_active":"2024-09-19T09:36:10.838979+0000","last_became_peered":"2024-09-19T09:36:10.838979+0000","last_unstale":"2024-09-19T09:37:16.028122+0000","last_undegraded":"2024-09-19T09:37:16.028122+0000","last_fullsized":"2024-09-19T09:37:16.028122+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:06.303175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.483737+0000","last_change":"2024-09-19T09:36:12.979778+0000","last_active":"2024-09-19T09:37:16.483737+0000","last_peered":"2024-09-19T09:37:16.483737+0000","last_clean":"2024-09-19T09:37:16.483737+0000","last_became_active":"2024-09-19T09:36:12.979455+0000","last_became_peered":"2024-09-19T09:36:12.979455+0000","last_unstale":"2024-09-19T09:37:16.483737+0000","last_undegraded":"2024-09-19T09:37:16.483737+0000","last_fullsized":"2024-09-19T09:37:16.483737+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:36.620368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029063+0000","last_change":"2024-09-19T09:36:10.945706+0000","last_active":"2024-09-19T09:37:16.029063+0000","last_peered":"2024-09-19T09:37:16.029063+0000","last_clean":"2024-09-19T09:37:16.029063+0000","last_became_active":"2024-09-19T09:36:10.945314+0000","last_became_peered":"2024-09-19T09:36:10.945314+0000","last_unstale":"2024-09-19T09:37:16.029063+0000","last_undegraded":"2024-09-19T09:37:16.029063+0000","last_fullsized":"2024-09-19T09:37:16.029063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:49.786913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030308+0000","last_change":"2024-09-19T09:36:12.989412+0000","last_active":"2024-09-19T09:37:16.030308+0000","last_peered":"2024-09-19T09:37:16.030308+0000","last_clean":"2024-09-19T09:37:16.030308+0000","last_became_active":"2024-09-19T09:36:12.989109+0000","last_became_peered":"2024-09-19T09:36:12.989109+0000","last_unstale":"2024-09-19T09:37:16.030308+0000","last_undegraded":"2024-09-19T09:37:16.030308+0000","last_fullsized":"2024-09-19T09:37:16.030308+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:33.142592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.123342+0000","last_change":"2024-09-19T09:36:10.858581+0000","last_active":"2024-09-19T09:37:16.123342+0000","last_peered":"2024-09-19T09:37:16.123342+0000","last_clean":"2024-09-19T09:37:16.123342+0000","last_became_active":"2024-09-19T09:36:10.858240+0000","last_became_peered":"2024-09-19T09:36:10.858240+0000","last_unstale":"2024-09-19T09:37:16.123342+0000","last_undegraded":"2024-09-19T09:37:16.123342+0000","last_fullsized":"2024-09-19T09:37:16.123342+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:45.285839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030769+0000","last_change":"2024-09-19T09:36:12.989075+0000","last_active":"2024-09-19T09:37:16.030769+0000","last_peered":"2024-09-19T09:37:16.030769+0000","last_clean":"2024-09-19T09:37:16.030769+0000","last_became_active":"2024-09-19T09:36:12.988752+0000","last_became_peered":"2024-09-19T09:36:12.988752+0000","last_unstale":"2024-09-19T09:37:16.030769+0000","last_undegraded":"2024-09-19T09:37:16.030769+0000","last_fullsized":"2024-09-19T09:37:16.030769+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.424032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.483353+0000","last_change":"2024-09-19T09:36:10.838716+0000","last_active":"2024-09-19T09:37:16.483353+0000","last_peered":"2024-09-19T09:37:16.483353+0000","last_clean":"2024-09-19T09:37:16.483353+0000","last_became_active":"2024-09-19T09:36:10.838393+0000","last_became_peered":"2024-09-19T09:36:10.838393+0000","last_unstale":"2024-09-19T09:37:16.483353+0000","last_undegraded":"2024-09-19T09:37:16.483353+0000","last_fullsized":"2024-09-19T09:37:16.483353+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:54.107223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.033298+0000","last_change":"2024-09-19T09:36:12.991721+0000","last_active":"2024-09-19T09:37:16.033298+0000","last_peered":"2024-09-19T09:37:16.033298+0000","last_clean":"2024-09-19T09:37:16.033298+0000","last_became_active":"2024-09-19T09:36:12.991398+0000","last_became_peered":"2024-09-19T09:36:12.991398+0000","last_unstale":"2024-09-19T09:37:16.033298+0000","last_undegraded":"2024-09-19T09:37:16.033298+0000","last_fullsized":"2024-09-19T09:37:16.033298+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:19:31.312072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.485156+0000","last_change":"2024-09-19T09:37:16.484541+0000","last_active":"2024-09-19T09:37:16.485156+0000","last_peered":"2024-09-19T09:37:16.485156+0000","last_clean":"2024-09-19T09:37:16.485156+0000","last_became_active":"2024-09-19T09:37:16.484035+0000","last_became_peered":"2024-09-19T09:37:16.484035+0000","last_unstale":"2024-09-19T09:37:16.485156+0000","last_undegraded":"2024-09-19T09:37:16.485156+0000","last_fullsized":"2024-09-19T09:37:16.485156+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:36.332699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.483389+0000","last_change":"2024-09-19T09:36:12.984180+0000","last_active":"2024-09-19T09:37:16.483389+0000","last_peered":"2024-09-19T09:37:16.483389+0000","last_clean":"2024-09-19T09:37:16.483389+0000","last_became_active":"2024-09-19T09:36:12.983876+0000","last_became_peered":"2024-09-19T09:36:12.983876+0000","last_unstale":"2024-09-19T09:37:16.483389+0000","last_undegraded":"2024-09-19T09:37:16.483389+0000","last_fullsized":"2024-09-19T09:37:16.483389+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:45.876771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031127+0000","last_change":"2024-09-19T09:36:10.845391+0000","last_active":"2024-09-19T09:37:16.031127+0000","last_peered":"2024-09-19T09:37:16.031127+0000","last_clean":"2024-09-19T09:37:16.031127+0000","last_became_active":"2024-09-19T09:36:10.844974+0000","last_became_peered":"2024-09-19T09:36:10.844974+0000","last_unstale":"2024-09-19T09:37:16.031127+0000","last_undegraded":"2024-09-19T09:37:16.031127+0000","last_fullsized":"2024-09-19T09:37:16.031127+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:00.318337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030370+0000","last_change":"2024-09-19T09:36:12.991145+0000","last_active":"2024-09-19T09:37:16.030370+0000","last_peered":"2024-09-19T09:37:16.030370+0000","last_clean":"2024-09-19T09:37:16.030370+0000","last_became_active":"2024-09-19T09:36:12.989891+0000","last_became_peered":"2024-09-19T09:36:12.989891+0000","last_unstale":"2024-09-19T09:37:16.030370+0000","last_undegraded":"2024-09-19T09:37:16.030370+0000","last_fullsized":"2024-09-19T09:37:16.030370+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:21.054936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029799+0000","last_change":"2024-09-19T09:36:12.995378+0000","last_active":"2024-09-19T09:37:16.029799+0000","last_peered":"2024-09-19T09:37:16.029799+0000","last_clean":"2024-09-19T09:37:16.029799+0000","last_became_active":"2024-09-19T09:36:12.995028+0000","last_became_peered":"2024-09-19T09:36:12.995028+0000","last_unstale":"2024-09-19T09:37:16.029799+0000","last_undegraded":"2024-09-19T09:37:16.029799+0000","last_fullsized":"2024-09-19T09:37:16.029799+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:41.102130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031259+0000","last_change":"2024-09-19T09:36:10.839595+0000","last_active":"2024-09-19T09:37:16.031259+0000","last_peered":"2024-09-19T09:37:16.031259+0000","last_clean":"2024-09-19T09:37:16.031259+0000","last_became_active":"2024-09-19T09:36:10.839196+0000","last_became_peered":"2024-09-19T09:36:10.839196+0000","last_unstale":"2024-09-19T09:37:16.031259+0000","last_undegraded":"2024-09-19T09:37:16.031259+0000","last_fullsized":"2024-09-19T09:37:16.031259+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:02.272731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.123303+0000","last_change":"2024-09-19T09:36:12.984485+0000","last_active":"2024-09-19T09:37:16.123303+0000","last_peered":"2024-09-19T09:37:16.123303+0000","last_clean":"2024-09-19T09:37:16.123303+0000","last_became_active":"2024-09-19T09:36:12.984004+0000","last_became_peered":"2024-09-19T09:36:12.984004+0000","last_unstale":"2024-09-19T09:37:16.123303+0000","last_undegraded":"2024-09-19T09:37:16.123303+0000","last_fullsized":"2024-09-19T09:37:16.123303+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:37.646776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030731+0000","last_change":"2024-09-19T09:36:10.845306+0000","last_active":"2024-09-19T09:37:16.030731+0000","last_peered":"2024-09-19T09:37:16.030731+0000","last_clean":"2024-09-19T09:37:16.030731+0000","last_became_active":"2024-09-19T09:36:10.844952+0000","last_became_peered":"2024-09-19T09:36:10.844952+0000","last_unstale":"2024-09-19T09:37:16.030731+0000","last_undegraded":"2024-09-19T09:37:16.030731+0000","last_fullsized":"2024-09-19T09:37:16.030731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:09.792482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030436+0000","last_change":"2024-09-19T09:36:12.991260+0000","last_active":"2024-09-19T09:37:16.030436+0000","last_peered":"2024-09-19T09:37:16.030436+0000","last_clean":"2024-09-19T09:37:16.030436+0000","last_became_active":"2024-09-19T09:36:12.989981+0000","last_became_peered":"2024-09-19T09:36:12.989981+0000","last_unstale":"2024-09-19T09:37:16.030436+0000","last_undegraded":"2024-09-19T09:37:16.030436+0000","last_fullsized":"2024-09-19T09:37:16.030436+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:11.301790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.483876+0000","last_change":"2024-09-19T09:36:10.859016+0000","last_active":"2024-09-19T09:37:16.483876+0000","last_peered":"2024-09-19T09:37:16.483876+0000","last_clean":"2024-09-19T09:37:16.483876+0000","last_became_active":"2024-09-19T09:36:10.858661+0000","last_became_peered":"2024-09-19T09:36:10.858661+0000","last_unstale":"2024-09-19T09:37:16.483876+0000","last_undegraded":"2024-09-19T09:37:16.483876+0000","last_fullsized":"2024-09-19T09:37:16.483876+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:54.395977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.131601+0000","last_change":"2024-09-19T09:37:16.131601+0000","last_active":"2024-09-19T09:37:16.131601+0000","last_peered":"2024-09-19T09:37:16.131601+0000","last_clean":"2024-09-19T09:37:16.131601+0000","last_became_active":"2024-09-19T09:37:16.131199+0000","last_became_peered":"2024-09-19T09:37:16.131199+0000","last_unstale":"2024-09-19T09:37:16.131601+0000","last_undegraded":"2024-09-19T09:37:16.131601+0000","last_fullsized":"2024-09-19T09:37:16.131601+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:27.358544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.039032+0000","last_change":"2024-09-19T09:37:16.039032+0000","last_active":"2024-09-19T09:37:16.039032+0000","last_peered":"2024-09-19T09:37:16.039032+0000","last_clean":"2024-09-19T09:37:16.039032+0000","last_became_active":"2024-09-19T09:37:16.035315+0000","last_became_peered":"2024-09-19T09:37:16.035315+0000","last_unstale":"2024-09-19T09:37:16.039032+0000","last_undegraded":"2024-09-19T09:37:16.039032+0000","last_fullsized":"2024-09-19T09:37:16.039032+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:58.795064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63617,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":84,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":190851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":69,"ondisk_log_size":69,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282954,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547229,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":901120,"data_stored":441682,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776162,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1036288,"data_stored":1094598,"data_compressed":41852,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972391,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":901120,"data_stored":441682,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201323,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":441704,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430257,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":950272,"data_stored":1031585,"data_compressed":41852,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593782,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":441217,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822716,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":962560,"data_stored":1031767,"data_compressed":41852,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953537,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":441122,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215174,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":913408,"data_stored":441438,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444106,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":974848,"data_stored":503953,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":970752,"data_stored":503919,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738453,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":901120,"data_stored":441190,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":62853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:37:29.742 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T09:37:29.742 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T09:37:29.742 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-19T09:37:29.742 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-19T09:37:30.002 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:30.326 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:30 smithi001 ceph-mon[31225]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 48 B/s, 0 objects/s recovering 2024-09-19T09:37:30.326 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:30 smithi001 ceph-mon[31225]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:37:30.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:30 smithi022 ceph-mon[35583]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 48 B/s, 0 objects/s recovering 2024-09-19T09:37:30.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:30 smithi022 ceph-mon[35583]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:37:30.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:30 smithi121 ceph-mon[35577]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 48 B/s, 0 objects/s recovering 2024-09-19T09:37:30.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:30 smithi121 ceph-mon[35577]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:37:30.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.531+0000 7f5ef7981640 1 -- 172.21.15.1:0/1927064218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ef0103700 msgr2=0x7f5ef010bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:30.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.531+0000 7f5ef7981640 1 --2- 172.21.15.1:0/1927064218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ef0103700 0x7f5ef010bbf0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5eec009900 tx=0x7f5eec02a480 comp rx=0 tx=0).stop 2024-09-19T09:37:30.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.531+0000 7f5ef7981640 1 -- 172.21.15.1:0/1927064218 shutdown_connections 2024-09-19T09:37:30.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.531+0000 7f5ef7981640 1 --2- 172.21.15.1:0/1927064218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ef010c180 0x7f5ef010e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:30.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.531+0000 7f5ef7981640 1 --2- 172.21.15.1:0/1927064218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ef0103700 0x7f5ef010bbf0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:30.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.531+0000 7f5ef7981640 1 --2- 172.21.15.1:0/1927064218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ef0102de0 0x7f5ef01031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:30.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.531+0000 7f5ef7981640 1 -- 172.21.15.1:0/1927064218 >> 172.21.15.1:0/1927064218 conn(0x7f5ef00fc780 msgr2=0x7f5ef00feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:30.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.531+0000 7f5ef7981640 1 -- 172.21.15.1:0/1927064218 shutdown_connections 2024-09-19T09:37:30.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.531+0000 7f5ef7981640 1 -- 172.21.15.1:0/1927064218 wait complete. 2024-09-19T09:37:30.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.531+0000 7f5ef7981640 1 Processor -- start 2024-09-19T09:37:30.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.531+0000 7f5ef7981640 1 -- start start 2024-09-19T09:37:30.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.532+0000 7f5ef7981640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ef0102de0 0x7f5ef0198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:30.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.532+0000 7f5ef7981640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ef0103700 0x7f5ef0198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:30.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.532+0000 7f5ef7981640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ef010c180 0x7f5ef019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:30.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.532+0000 7f5ef7981640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef0111f50 con 0x7f5ef010c180 2024-09-19T09:37:30.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.532+0000 7f5ef7981640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef0111dd0 con 0x7f5ef0103700 2024-09-19T09:37:30.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.532+0000 7f5ef7981640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef01120d0 con 0x7f5ef0102de0 2024-09-19T09:37:30.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.532+0000 7f5ef5f1e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ef010c180 0x7f5ef019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:30.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.532+0000 7f5ef5f1e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ef010c180 0x7f5ef019ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49462/0 (socket says 172.21.15.1:49462) 2024-09-19T09:37:30.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.532+0000 7f5ef5f1e640 1 -- 172.21.15.1:0/3862845947 learned_addr learned my addr 172.21.15.1:0/3862845947 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:30.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.532+0000 7f5ef571d640 1 --2- 172.21.15.1:0/3862845947 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ef0102de0 0x7f5ef0198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:30.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.532+0000 7f5ef4f1c640 1 --2- 172.21.15.1:0/3862845947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ef0103700 0x7f5ef0198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:30.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.532+0000 7f5ef5f1e640 1 -- 172.21.15.1:0/3862845947 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ef0102de0 msgr2=0x7f5ef0198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:30.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.532+0000 7f5ef5f1e640 1 --2- 172.21.15.1:0/3862845947 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ef0102de0 0x7f5ef0198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:30.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.532+0000 7f5ef5f1e640 1 -- 172.21.15.1:0/3862845947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ef0103700 msgr2=0x7f5ef0198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:30.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.532+0000 7f5ef5f1e640 1 --2- 172.21.15.1:0/3862845947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ef0103700 0x7f5ef0198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:30.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.532+0000 7f5ef5f1e640 1 -- 172.21.15.1:0/3862845947 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef019d3b0 con 0x7f5ef010c180 2024-09-19T09:37:30.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.532+0000 7f5ef5f1e640 1 --2- 172.21.15.1:0/3862845947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ef010c180 0x7f5ef019ccd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5ee800cce0 tx=0x7f5ee800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:30.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.533+0000 7f5ee67fc640 1 -- 172.21.15.1:0/3862845947 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee800f450 con 0x7f5ef010c180 2024-09-19T09:37:30.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.533+0000 7f5ee67fc640 1 -- 172.21.15.1:0/3862845947 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ee800fad0 con 0x7f5ef010c180 2024-09-19T09:37:30.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.533+0000 7f5ef7981640 1 -- 172.21.15.1:0/3862845947 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ef019d6a0 con 0x7f5ef010c180 2024-09-19T09:37:30.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.533+0000 7f5ee67fc640 1 -- 172.21.15.1:0/3862845947 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee8018c10 con 0x7f5ef010c180 2024-09-19T09:37:30.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.533+0000 7f5ef7981640 1 -- 172.21.15.1:0/3862845947 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ef01a4f80 con 0x7f5ef010c180 2024-09-19T09:37:30.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.534+0000 7f5ef7981640 1 -- 172.21.15.1:0/3862845947 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ef01031c0 con 0x7f5ef010c180 2024-09-19T09:37:30.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.535+0000 7f5ee67fc640 1 -- 172.21.15.1:0/3862845947 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f5ee800f5f0 con 0x7f5ef010c180 2024-09-19T09:37:30.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.535+0000 7f5ee67fc640 1 --2- 172.21.15.1:0/3862845947 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f5edc0a32d0 0x7f5edc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:30.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.536+0000 7f5ef571d640 1 --2- 172.21.15.1:0/3862845947 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f5edc0a32d0 0x7f5edc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:30.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.536+0000 7f5ee67fc640 1 -- 172.21.15.1:0/3862845947 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f5ee80cffb0 con 0x7f5ef010c180 2024-09-19T09:37:30.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.536+0000 7f5ef571d640 1 --2- 172.21.15.1:0/3862845947 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f5edc0a32d0 0x7f5edc0a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5ee000bbe0 tx=0x7f5ee000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:30.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.539+0000 7f5ee67fc640 1 -- 172.21.15.1:0/3862845947 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5ee8014030 con 0x7f5ef010c180 2024-09-19T09:37:30.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.752+0000 7f5ef7981640 1 -- 172.21.15.1:0/3862845947 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5ef0199760 con 0x7f5ef010c180 2024-09-19T09:37:30.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.753+0000 7f5ee67fc640 1 -- 172.21.15.1:0/3862845947 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f5ef0199760 con 0x7f5ef010c180 2024-09-19T09:37:30.755 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:37:30.755 INFO:teuthology.orchestra.run.smithi001.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T09:37:30.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.755+0000 7f5ef7981640 1 -- 172.21.15.1:0/3862845947 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f5edc0a32d0 msgr2=0x7f5edc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:30.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.755+0000 7f5ef7981640 1 --2- 172.21.15.1:0/3862845947 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f5edc0a32d0 0x7f5edc0a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5ee000bbe0 tx=0x7f5ee000b390 comp rx=0 tx=0).stop 2024-09-19T09:37:30.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.755+0000 7f5ef7981640 1 -- 172.21.15.1:0/3862845947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ef010c180 msgr2=0x7f5ef019ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:30.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.755+0000 7f5ef7981640 1 --2- 172.21.15.1:0/3862845947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ef010c180 0x7f5ef019ccd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5ee800cce0 tx=0x7f5ee800a620 comp rx=0 tx=0).stop 2024-09-19T09:37:30.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.755+0000 7f5ef7981640 1 -- 172.21.15.1:0/3862845947 shutdown_connections 2024-09-19T09:37:30.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.755+0000 7f5ef7981640 1 --2- 172.21.15.1:0/3862845947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5ef010c180 0x7f5ef019ccd0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:30.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.755+0000 7f5ef7981640 1 --2- 172.21.15.1:0/3862845947 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f5edc0a32d0 0x7f5edc0a5790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:30.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.755+0000 7f5ef7981640 1 --2- 172.21.15.1:0/3862845947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ef0103700 0x7f5ef0198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:30.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.755+0000 7f5ef7981640 1 --2- 172.21.15.1:0/3862845947 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ef0102de0 0x7f5ef0198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:30.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.755+0000 7f5ef7981640 1 -- 172.21.15.1:0/3862845947 >> 172.21.15.1:0/3862845947 conn(0x7f5ef00fc780 msgr2=0x7f5ef00fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:30.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.755+0000 7f5ef7981640 1 -- 172.21.15.1:0/3862845947 shutdown_connections 2024-09-19T09:37:30.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:30.755+0000 7f5ef7981640 1 -- 172.21.15.1:0/3862845947 wait complete. 2024-09-19T09:37:31.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:31 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/3862845947' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T09:37:31.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:31 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/3862845947' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T09:37:31.416 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:31 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/3862845947' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T09:37:31.449 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-19T09:37:31.449 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:37:31.706 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:32.128 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:32 smithi001 ceph-mon[31225]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 48 B/s, 0 objects/s recovering 2024-09-19T09:37:32.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.208+0000 7f9df4b5e640 1 -- 172.21.15.1:0/1886016579 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9df0106a90 msgr2=0x7f9df0106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:32.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.208+0000 7f9df4b5e640 1 --2- 172.21.15.1:0/1886016579 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9df0106a90 0x7f9df0106e70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9de0009930 tx=0x7f9de002a420 comp rx=0 tx=0).stop 2024-09-19T09:37:32.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.208+0000 7f9df4b5e640 1 -- 172.21.15.1:0/1886016579 shutdown_connections 2024-09-19T09:37:32.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.208+0000 7f9df4b5e640 1 --2- 172.21.15.1:0/1886016579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df0101430 0x7f9df010d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:32.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.208+0000 7f9df4b5e640 1 --2- 172.21.15.1:0/1886016579 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9df0100a90 0x7f9df0100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:32.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.208+0000 7f9df4b5e640 1 --2- 172.21.15.1:0/1886016579 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9df0106a90 0x7f9df0106e70 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:32.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.208+0000 7f9df4b5e640 1 -- 172.21.15.1:0/1886016579 >> 172.21.15.1:0/1886016579 conn(0x7f9df00fc7d0 msgr2=0x7f9df00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:32.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.208+0000 7f9df4b5e640 1 -- 172.21.15.1:0/1886016579 shutdown_connections 2024-09-19T09:37:32.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.208+0000 7f9df4b5e640 1 -- 172.21.15.1:0/1886016579 wait complete. 2024-09-19T09:37:32.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.209+0000 7f9df4b5e640 1 Processor -- start 2024-09-19T09:37:32.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.210+0000 7f9df4b5e640 1 -- start start 2024-09-19T09:37:32.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.210+0000 7f9df4b5e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df0100a90 0x7f9df019a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:32.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.210+0000 7f9df4b5e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9df0101430 0x7f9df019aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:32.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.210+0000 7f9df4b5e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9df0106a90 0x7f9df019ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:32.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.210+0000 7f9df4b5e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9df0110ee0 con 0x7f9df0106a90 2024-09-19T09:37:32.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.210+0000 7f9df4b5e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9df0110d60 con 0x7f9df0100a90 2024-09-19T09:37:32.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.210+0000 7f9df4b5e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9df0111060 con 0x7f9df0101430 2024-09-19T09:37:32.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.210+0000 7f9deed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9df0106a90 0x7f9df019ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:32.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.210+0000 7f9deed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9df0106a90 0x7f9df019ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49482/0 (socket says 172.21.15.1:49482) 2024-09-19T09:37:32.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.210+0000 7f9deed9d640 1 -- 172.21.15.1:0/2251934867 learned_addr learned my addr 172.21.15.1:0/2251934867 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:32.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.210+0000 7f9dedd9b640 1 --2- 172.21.15.1:0/2251934867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9df0101430 0x7f9df019aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:32.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.210+0000 7f9dee59c640 1 --2- 172.21.15.1:0/2251934867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df0100a90 0x7f9df019a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:32.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.210+0000 7f9deed9d640 1 -- 172.21.15.1:0/2251934867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9df0101430 msgr2=0x7f9df019aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:32.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.210+0000 7f9deed9d640 1 --2- 172.21.15.1:0/2251934867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9df0101430 0x7f9df019aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:32.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.210+0000 7f9deed9d640 1 -- 172.21.15.1:0/2251934867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df0100a90 msgr2=0x7f9df019a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:32.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.210+0000 7f9deed9d640 1 --2- 172.21.15.1:0/2251934867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df0100a90 0x7f9df019a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:32.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.210+0000 7f9deed9d640 1 -- 172.21.15.1:0/2251934867 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df019f550 con 0x7f9df0106a90 2024-09-19T09:37:32.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.210+0000 7f9deed9d640 1 --2- 172.21.15.1:0/2251934867 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9df0106a90 0x7f9df019ee70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9de800c970 tx=0x7f9de800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:32.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.211+0000 7f9ddf7fe640 1 -- 172.21.15.1:0/2251934867 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de8007bb0 con 0x7f9df0106a90 2024-09-19T09:37:32.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.211+0000 7f9df4b5e640 1 -- 172.21.15.1:0/2251934867 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9df019f840 con 0x7f9df0106a90 2024-09-19T09:37:32.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.211+0000 7f9ddf7fe640 1 -- 172.21.15.1:0/2251934867 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9de8007d50 con 0x7f9df0106a90 2024-09-19T09:37:32.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.211+0000 7f9ddf7fe640 1 -- 172.21.15.1:0/2251934867 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de8018800 con 0x7f9df0106a90 2024-09-19T09:37:32.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.211+0000 7f9df4b5e640 1 -- 172.21.15.1:0/2251934867 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9df01a7120 con 0x7f9df0106a90 2024-09-19T09:37:32.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.212+0000 7f9df4b5e640 1 -- 172.21.15.1:0/2251934867 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9df0100ef0 con 0x7f9df0106a90 2024-09-19T09:37:32.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.213+0000 7f9ddf7fe640 1 -- 172.21.15.1:0/2251934867 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f9de800fa50 con 0x7f9df0106a90 2024-09-19T09:37:32.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.214+0000 7f9ddf7fe640 1 --2- 172.21.15.1:0/2251934867 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f9dd80a32d0 0x7f9dd80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:32.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.214+0000 7f9dee59c640 1 --2- 172.21.15.1:0/2251934867 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f9dd80a32d0 0x7f9dd80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:32.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.214+0000 7f9ddf7fe640 1 -- 172.21.15.1:0/2251934867 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f9de80cfa90 con 0x7f9df0106a90 2024-09-19T09:37:32.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.214+0000 7f9dee59c640 1 --2- 172.21.15.1:0/2251934867 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f9dd80a32d0 0x7f9dd80a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9de0006010 tx=0x7f9de0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:32.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.218+0000 7f9ddf7fe640 1 -- 172.21.15.1:0/2251934867 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9de8014030 con 0x7f9df0106a90 2024-09-19T09:37:32.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:32 smithi022 ceph-mon[35583]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 48 B/s, 0 objects/s recovering 2024-09-19T09:37:32.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:32 smithi121 ceph-mon[35577]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 48 B/s, 0 objects/s recovering 2024-09-19T09:37:32.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.434+0000 7f9df4b5e640 1 -- 172.21.15.1:0/2251934867 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9df01a7400 con 0x7f9df0106a90 2024-09-19T09:37:32.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.435+0000 7f9ddf7fe640 1 -- 172.21.15.1:0/2251934867 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11837 (secure 0 0 0) 0x7f9de809c650 con 0x7f9df0106a90 2024-09-19T09:37:32.438 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:37:32.438 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":19,"btime":"2024-09-19T09:36:24:006349+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:36:23.723388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6839/3279971690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3279971690},{"type":"v1","addr":"172.21.15.121:6839","nonce":3279971690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:37:32.438 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 19 2024-09-19T09:37:32.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.437+0000 7f9df4b5e640 1 -- 172.21.15.1:0/2251934867 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f9dd80a32d0 msgr2=0x7f9dd80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:32.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.437+0000 7f9df4b5e640 1 --2- 172.21.15.1:0/2251934867 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f9dd80a32d0 0x7f9dd80a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9de0006010 tx=0x7f9de0000bc0 comp rx=0 tx=0).stop 2024-09-19T09:37:32.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.437+0000 7f9df4b5e640 1 -- 172.21.15.1:0/2251934867 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9df0106a90 msgr2=0x7f9df019ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:32.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.437+0000 7f9df4b5e640 1 --2- 172.21.15.1:0/2251934867 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9df0106a90 0x7f9df019ee70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9de800c970 tx=0x7f9de800ce30 comp rx=0 tx=0).stop 2024-09-19T09:37:32.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.437+0000 7f9df4b5e640 1 -- 172.21.15.1:0/2251934867 shutdown_connections 2024-09-19T09:37:32.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.437+0000 7f9df4b5e640 1 --2- 172.21.15.1:0/2251934867 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9df0106a90 0x7f9df019ee70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:32.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.437+0000 7f9df4b5e640 1 --2- 172.21.15.1:0/2251934867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9df0101430 0x7f9df019aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:32.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.437+0000 7f9df4b5e640 1 --2- 172.21.15.1:0/2251934867 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f9dd80a32d0 0x7f9dd80a5790 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:32.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.437+0000 7f9df4b5e640 1 --2- 172.21.15.1:0/2251934867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df0100a90 0x7f9df019a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:32.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.437+0000 7f9df4b5e640 1 -- 172.21.15.1:0/2251934867 >> 172.21.15.1:0/2251934867 conn(0x7f9df00fc7d0 msgr2=0x7f9df006a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:32.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.437+0000 7f9df4b5e640 1 -- 172.21.15.1:0/2251934867 shutdown_connections 2024-09-19T09:37:32.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:32.437+0000 7f9df4b5e640 1 -- 172.21.15.1:0/2251934867 wait complete. 2024-09-19T09:37:33.087 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:37:33.351 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:33.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:33 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/2251934867' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:33.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:33 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/2251934867' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:33.468 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:33 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/2251934867' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:33.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.852+0000 7f19fbde2640 1 -- 172.21.15.1:0/2535738955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19f41036e0 msgr2=0x7f19f4107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:33.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.852+0000 7f19fbde2640 1 --2- 172.21.15.1:0/2535738955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19f41036e0 0x7f19f4107b90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009930 tx=0x7f19e802a420 comp rx=0 tx=0).stop 2024-09-19T09:37:33.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.852+0000 7f19fbde2640 1 -- 172.21.15.1:0/2535738955 shutdown_connections 2024-09-19T09:37:33.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.852+0000 7f19fbde2640 1 --2- 172.21.15.1:0/2535738955 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19f41082a0 0x7f19f410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.852+0000 7f19fbde2640 1 --2- 172.21.15.1:0/2535738955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19f41036e0 0x7f19f4107b90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.852+0000 7f19fbde2640 1 --2- 172.21.15.1:0/2535738955 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19f4102d30 0x7f19f4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.852+0000 7f19fbde2640 1 -- 172.21.15.1:0/2535738955 >> 172.21.15.1:0/2535738955 conn(0x7f19f40fc7d0 msgr2=0x7f19f40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:33.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.852+0000 7f19fbde2640 1 -- 172.21.15.1:0/2535738955 shutdown_connections 2024-09-19T09:37:33.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.852+0000 7f19fbde2640 1 -- 172.21.15.1:0/2535738955 wait complete. 2024-09-19T09:37:33.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.852+0000 7f19fbde2640 1 Processor -- start 2024-09-19T09:37:33.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.852+0000 7f19fbde2640 1 -- start start 2024-09-19T09:37:33.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.853+0000 7f19fbde2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19f4102d30 0x7f19f4198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:33.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.853+0000 7f19fbde2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19f41036e0 0x7f19f4198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:33.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.853+0000 7f19fbde2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19f41082a0 0x7f19f419d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:33.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.853+0000 7f19fbde2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f19f41120c0 con 0x7f19f41036e0 2024-09-19T09:37:33.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.853+0000 7f19fbde2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f19f4111f40 con 0x7f19f41082a0 2024-09-19T09:37:33.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.853+0000 7f19fbde2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f19f4112240 con 0x7f19f4102d30 2024-09-19T09:37:33.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.853+0000 7f19f937d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19f41036e0 0x7f19f4198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:33.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.853+0000 7f19f937d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19f41036e0 0x7f19f4198c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49510/0 (socket says 172.21.15.1:49510) 2024-09-19T09:37:33.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.853+0000 7f19f937d640 1 -- 172.21.15.1:0/1851694244 learned_addr learned my addr 172.21.15.1:0/1851694244 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:33.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.853+0000 7f19f9b7e640 1 --2- 172.21.15.1:0/1851694244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19f4102d30 0x7f19f4198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:33.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.853+0000 7f19fa37f640 1 --2- 172.21.15.1:0/1851694244 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19f41082a0 0x7f19f419d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:33.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.853+0000 7f19f937d640 1 -- 172.21.15.1:0/1851694244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19f4102d30 msgr2=0x7f19f4198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:33.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.853+0000 7f19f937d640 1 --2- 172.21.15.1:0/1851694244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19f4102d30 0x7f19f4198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.853+0000 7f19f937d640 1 -- 172.21.15.1:0/1851694244 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19f41082a0 msgr2=0x7f19f419d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:33.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.853+0000 7f19f937d640 1 --2- 172.21.15.1:0/1851694244 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19f41082a0 0x7f19f419d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:33.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.853+0000 7f19f937d640 1 -- 172.21.15.1:0/1851694244 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f419d6e0 con 0x7f19f41036e0 2024-09-19T09:37:33.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.853+0000 7f19fa37f640 1 --2- 172.21.15.1:0/1851694244 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19f41082a0 0x7f19f419d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:33.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.853+0000 7f19f937d640 1 --2- 172.21.15.1:0/1851694244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19f41036e0 0x7f19f4198c70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f19e8005940 tx=0x7f19e80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:33.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.853+0000 7f19f2ffd640 1 -- 172.21.15.1:0/1851694244 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e803f030 con 0x7f19f41036e0 2024-09-19T09:37:33.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.853+0000 7f19f2ffd640 1 -- 172.21.15.1:0/1851694244 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19e8003ce0 con 0x7f19f41036e0 2024-09-19T09:37:33.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.853+0000 7f19fbde2640 1 -- 172.21.15.1:0/1851694244 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f419d970 con 0x7f19f41036e0 2024-09-19T09:37:33.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.853+0000 7f19f2ffd640 1 -- 172.21.15.1:0/1851694244 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e8035070 con 0x7f19f41036e0 2024-09-19T09:37:33.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.854+0000 7f19fbde2640 1 -- 172.21.15.1:0/1851694244 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19f41a52b0 con 0x7f19f41036e0 2024-09-19T09:37:33.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.854+0000 7f19fbde2640 1 -- 172.21.15.1:0/1851694244 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19f406a850 con 0x7f19f41036e0 2024-09-19T09:37:33.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.856+0000 7f19f2ffd640 1 -- 172.21.15.1:0/1851694244 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f19e8042030 con 0x7f19f41036e0 2024-09-19T09:37:33.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.856+0000 7f19f2ffd640 1 --2- 172.21.15.1:0/1851694244 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f19dc0a32d0 0x7f19dc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:33.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.856+0000 7f19f9b7e640 1 --2- 172.21.15.1:0/1851694244 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f19dc0a32d0 0x7f19dc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:33.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.856+0000 7f19f2ffd640 1 -- 172.21.15.1:0/1851694244 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f19e80eff20 con 0x7f19f41036e0 2024-09-19T09:37:33.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.857+0000 7f19f9b7e640 1 --2- 172.21.15.1:0/1851694244 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f19dc0a32d0 0x7f19dc0a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f19e4005fd0 tx=0x7f19e4009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:33.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:33.860+0000 7f19f2ffd640 1 -- 172.21.15.1:0/1851694244 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f19e80bcae0 con 0x7f19f41036e0 2024-09-19T09:37:34.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:34.071+0000 7f19fbde2640 1 -- 172.21.15.1:0/1851694244 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19f4199a90 con 0x7f19f41036e0 2024-09-19T09:37:34.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:34.071+0000 7f19f2ffd640 1 -- 172.21.15.1:0/1851694244 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11837 (secure 0 0 0) 0x7f19e80bc3e0 con 0x7f19f41036e0 2024-09-19T09:37:34.074 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:37:34.074 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":19,"btime":"2024-09-19T09:36:24:006349+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:36:23.723388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6839/3279971690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3279971690},{"type":"v1","addr":"172.21.15.121:6839","nonce":3279971690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:37:34.075 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 19 2024-09-19T09:37:34.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:34.073+0000 7f19fbde2640 1 -- 172.21.15.1:0/1851694244 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f19dc0a32d0 msgr2=0x7f19dc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:34.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:34.073+0000 7f19fbde2640 1 --2- 172.21.15.1:0/1851694244 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f19dc0a32d0 0x7f19dc0a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f19e4005fd0 tx=0x7f19e4009680 comp rx=0 tx=0).stop 2024-09-19T09:37:34.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:34.073+0000 7f19fbde2640 1 -- 172.21.15.1:0/1851694244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19f41036e0 msgr2=0x7f19f4198c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:34.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:34.073+0000 7f19fbde2640 1 --2- 172.21.15.1:0/1851694244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19f41036e0 0x7f19f4198c70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f19e8005940 tx=0x7f19e80042f0 comp rx=0 tx=0).stop 2024-09-19T09:37:34.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:34.074+0000 7f19fbde2640 1 -- 172.21.15.1:0/1851694244 shutdown_connections 2024-09-19T09:37:34.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:34.074+0000 7f19fbde2640 1 --2- 172.21.15.1:0/1851694244 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f19dc0a32d0 0x7f19dc0a5790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:34.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:34.074+0000 7f19fbde2640 1 --2- 172.21.15.1:0/1851694244 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f19f41082a0 0x7f19f419d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:34.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:34.074+0000 7f19fbde2640 1 --2- 172.21.15.1:0/1851694244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19f41036e0 0x7f19f4198c70 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:34.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:34.074+0000 7f19fbde2640 1 --2- 172.21.15.1:0/1851694244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19f4102d30 0x7f19f4198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:34.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:34.074+0000 7f19fbde2640 1 -- 172.21.15.1:0/1851694244 >> 172.21.15.1:0/1851694244 conn(0x7f19f40fc7d0 msgr2=0x7f19f4106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:34.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:34.074+0000 7f19fbde2640 1 -- 172.21.15.1:0/1851694244 shutdown_connections 2024-09-19T09:37:34.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:34.074+0000 7f19fbde2640 1 -- 172.21.15.1:0/1851694244 wait complete. 2024-09-19T09:37:34.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:34 smithi022 ceph-mon[35583]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:34.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:34 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1851694244' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:34.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:34 smithi121 ceph-mon[35577]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:34.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:34 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1851694244' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:34.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:34 smithi001 ceph-mon[31225]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:34.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:34 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1851694244' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:34.734 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:37:34.994 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:35.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.469+0000 7f4a24348640 1 -- 172.21.15.1:0/4097615673 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a1c100a80 msgr2=0x7f4a1c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:35.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.469+0000 7f4a24348640 1 --2- 172.21.15.1:0/4097615673 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a1c100a80 0x7f4a1c100ee0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c009930 tx=0x7f4a0c02a420 comp rx=0 tx=0).stop 2024-09-19T09:37:35.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.469+0000 7f4a24348640 1 -- 172.21.15.1:0/4097615673 shutdown_connections 2024-09-19T09:37:35.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.469+0000 7f4a24348640 1 --2- 172.21.15.1:0/4097615673 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a1c101420 0x7f4a1c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:35.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.469+0000 7f4a24348640 1 --2- 172.21.15.1:0/4097615673 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a1c100a80 0x7f4a1c100ee0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:35.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.469+0000 7f4a24348640 1 --2- 172.21.15.1:0/4097615673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a1c106a80 0x7f4a1c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:35.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.469+0000 7f4a24348640 1 -- 172.21.15.1:0/4097615673 >> 172.21.15.1:0/4097615673 conn(0x7f4a1c0fc7a0 msgr2=0x7f4a1c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:35.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.469+0000 7f4a24348640 1 -- 172.21.15.1:0/4097615673 shutdown_connections 2024-09-19T09:37:35.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.469+0000 7f4a24348640 1 -- 172.21.15.1:0/4097615673 wait complete. 2024-09-19T09:37:35.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.470+0000 7f4a24348640 1 Processor -- start 2024-09-19T09:37:35.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.470+0000 7f4a24348640 1 -- start start 2024-09-19T09:37:35.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.470+0000 7f4a24348640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a1c100a80 0x7f4a1c0fcd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:35.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.470+0000 7f4a24348640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a1c101420 0x7f4a1c0fd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:35.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.470+0000 7f4a24348640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a1c106a80 0x7f4a1c0fd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:35.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.470+0000 7f4a24348640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c110e40 con 0x7f4a1c100a80 2024-09-19T09:37:35.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.470+0000 7f4a24348640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c110cc0 con 0x7f4a1c101420 2024-09-19T09:37:35.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.470+0000 7f4a24348640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c110fc0 con 0x7f4a1c106a80 2024-09-19T09:37:35.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.470+0000 7f4a220e4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a1c100a80 0x7f4a1c0fcd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:35.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.470+0000 7f4a220e4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a1c100a80 0x7f4a1c0fcd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35312/0 (socket says 172.21.15.1:35312) 2024-09-19T09:37:35.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.470+0000 7f4a220e4640 1 -- 172.21.15.1:0/3209420943 learned_addr learned my addr 172.21.15.1:0/3209420943 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:35.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.470+0000 7f4a228e5640 1 --2- 172.21.15.1:0/3209420943 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a1c106a80 0x7f4a1c0fd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:35.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.470+0000 7f4a218e3640 1 --2- 172.21.15.1:0/3209420943 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a1c101420 0x7f4a1c0fd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:35.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.470+0000 7f4a220e4640 1 -- 172.21.15.1:0/3209420943 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a1c106a80 msgr2=0x7f4a1c0fd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:35.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.470+0000 7f4a220e4640 1 --2- 172.21.15.1:0/3209420943 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a1c106a80 0x7f4a1c0fd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:35.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.471+0000 7f4a220e4640 1 -- 172.21.15.1:0/3209420943 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a1c101420 msgr2=0x7f4a1c0fd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:35.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.471+0000 7f4a220e4640 1 --2- 172.21.15.1:0/3209420943 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a1c101420 0x7f4a1c0fd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:35.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.471+0000 7f4a220e4640 1 -- 172.21.15.1:0/3209420943 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a1c1a68a0 con 0x7f4a1c100a80 2024-09-19T09:37:35.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.471+0000 7f4a220e4640 1 --2- 172.21.15.1:0/3209420943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a1c100a80 0x7f4a1c0fcd30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800c920 tx=0x7f4a1800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:35.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.471+0000 7f4a137fe640 1 -- 172.21.15.1:0/3209420943 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a18007c70 con 0x7f4a1c100a80 2024-09-19T09:37:35.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.471+0000 7f4a137fe640 1 -- 172.21.15.1:0/3209420943 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a18007e10 con 0x7f4a1c100a80 2024-09-19T09:37:35.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.471+0000 7f4a24348640 1 -- 172.21.15.1:0/3209420943 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a1c1a6b90 con 0x7f4a1c100a80 2024-09-19T09:37:35.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.471+0000 7f4a137fe640 1 -- 172.21.15.1:0/3209420943 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a18018890 con 0x7f4a1c100a80 2024-09-19T09:37:35.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.471+0000 7f4a24348640 1 -- 172.21.15.1:0/3209420943 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a1c1a70a0 con 0x7f4a1c100a80 2024-09-19T09:37:35.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.472+0000 7f4a24348640 1 -- 172.21.15.1:0/3209420943 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a1c1021c0 con 0x7f4a1c100a80 2024-09-19T09:37:35.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.474+0000 7f4a137fe640 1 -- 172.21.15.1:0/3209420943 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f4a18018a50 con 0x7f4a1c100a80 2024-09-19T09:37:35.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.474+0000 7f4a137fe640 1 --2- 172.21.15.1:0/3209420943 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4a080a32d0 0x7f4a080a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:35.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.475+0000 7f4a218e3640 1 --2- 172.21.15.1:0/3209420943 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4a080a32d0 0x7f4a080a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:35.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.475+0000 7f4a137fe640 1 -- 172.21.15.1:0/3209420943 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f4a180cfdf0 con 0x7f4a1c100a80 2024-09-19T09:37:35.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.475+0000 7f4a218e3640 1 --2- 172.21.15.1:0/3209420943 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4a080a32d0 0x7f4a080a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c000c00 tx=0x7f4a0c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:35.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.478+0000 7f4a137fe640 1 -- 172.21.15.1:0/3209420943 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4a18014030 con 0x7f4a1c100a80 2024-09-19T09:37:35.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.654+0000 7f4a24348640 1 -- 172.21.15.1:0/3209420943 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a1c100ee0 con 0x7f4a1c100a80 2024-09-19T09:37:35.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.656+0000 7f4a137fe640 1 -- 172.21.15.1:0/3209420943 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22612 (secure 0 0 0) 0x7f4a1c100ee0 con 0x7f4a1c100a80 2024-09-19T09:37:35.658 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:37:35.659 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":83,"fsid":"57238232-7669-11ef-bceb-c7b262605968","created":"2024-09-19T09:28:28.406983+0000","modified":"2024-09-19T09:37:16.024965+0000","last_up_change":"2024-09-19T09:35:21.422825+0000","last_in_change":"2024-09-19T09:34:57.199184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:31:30.566509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:36:09.521275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:36:11.954337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c165571d-43f1-4c43-ba1e-35872d914f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6803","nonce":502676986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6805","nonce":502676986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6809","nonce":502676986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6807","nonce":502676986}]},"public_addr":"172.21.15.1:6803/502676986","cluster_addr":"172.21.15.1:6805/502676986","heartbeat_back_addr":"172.21.15.1:6809/502676986","heartbeat_front_addr":"172.21.15.1:6807/502676986","state":["exists","up"]},{"osd":1,"uuid":"baf120f8-8ba3-4aa5-a12a-41cdc97ff11b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6801","nonce":3735826323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6803","nonce":3735826323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6807","nonce":3735826323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6805","nonce":3735826323}]},"public_addr":"172.21.15.22:6801/3735826323","cluster_addr":"172.21.15.22:6803/3735826323","heartbeat_back_addr":"172.21.15.22:6807/3735826323","heartbeat_front_addr":"172.21.15.22:6805/3735826323","state":["exists","up"]},{"osd":2,"uuid":"72c520bf-c5cc-44ee-a38c-c9bac0a6280b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6801","nonce":1924970833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6803","nonce":1924970833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6807","nonce":1924970833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6805","nonce":1924970833}]},"public_addr":"172.21.15.121:6801/1924970833","cluster_addr":"172.21.15.121:6803/1924970833","heartbeat_back_addr":"172.21.15.121:6807/1924970833","heartbeat_front_addr":"172.21.15.121:6805/1924970833","state":["exists","up"]},{"osd":3,"uuid":"adad6d17-16d9-4c43-b581-35ac1bb9d807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6811","nonce":1515009793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6813","nonce":1515009793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6817","nonce":1515009793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6815","nonce":1515009793}]},"public_addr":"172.21.15.1:6811/1515009793","cluster_addr":"172.21.15.1:6813/1515009793","heartbeat_back_addr":"172.21.15.1:6817/1515009793","heartbeat_front_addr":"172.21.15.1:6815/1515009793","state":["exists","up"]},{"osd":4,"uuid":"8fb06efe-c3a0-48a3-9730-3e8f3e60922d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6809","nonce":923697266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6811","nonce":923697266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6815","nonce":923697266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6813","nonce":923697266}]},"public_addr":"172.21.15.22:6809/923697266","cluster_addr":"172.21.15.22:6811/923697266","heartbeat_back_addr":"172.21.15.22:6815/923697266","heartbeat_front_addr":"172.21.15.22:6813/923697266","state":["exists","up"]},{"osd":5,"uuid":"3b2f428c-8a5a-49be-9f43-a9f379a1c7e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6809","nonce":3137245658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6811","nonce":3137245658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6815","nonce":3137245658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6813","nonce":3137245658}]},"public_addr":"172.21.15.121:6809/3137245658","cluster_addr":"172.21.15.121:6811/3137245658","heartbeat_back_addr":"172.21.15.121:6815/3137245658","heartbeat_front_addr":"172.21.15.121:6813/3137245658","state":["exists","up"]},{"osd":6,"uuid":"5aecec68-ff7e-440c-bd39-cc35ab89cc91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6819","nonce":3376780798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6821","nonce":3376780798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6825","nonce":3376780798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6823","nonce":3376780798}]},"public_addr":"172.21.15.1:6819/3376780798","cluster_addr":"172.21.15.1:6821/3376780798","heartbeat_back_addr":"172.21.15.1:6825/3376780798","heartbeat_front_addr":"172.21.15.1:6823/3376780798","state":["exists","up"]},{"osd":7,"uuid":"46556bdf-199e-4268-873b-6d87b54e1176","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6817","nonce":2920985295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6819","nonce":2920985295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6823","nonce":2920985295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6821","nonce":2920985295}]},"public_addr":"172.21.15.22:6817/2920985295","cluster_addr":"172.21.15.22:6819/2920985295","heartbeat_back_addr":"172.21.15.22:6823/2920985295","heartbeat_front_addr":"172.21.15.22:6821/2920985295","state":["exists","up"]},{"osd":8,"uuid":"e7c3792a-94a4-4440-be74-d6abdf3d9566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6817","nonce":3589985967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6819","nonce":3589985967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6823","nonce":3589985967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6821","nonce":3589985967}]},"public_addr":"172.21.15.121:6817/3589985967","cluster_addr":"172.21.15.121:6819/3589985967","heartbeat_back_addr":"172.21.15.121:6823/3589985967","heartbeat_front_addr":"172.21.15.121:6821/3589985967","state":["exists","up"]},{"osd":9,"uuid":"8af80ac9-d681-4966-b083-ead5185eff12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6827","nonce":1143859822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6829","nonce":1143859822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6833","nonce":1143859822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6831","nonce":1143859822}]},"public_addr":"172.21.15.1:6827/1143859822","cluster_addr":"172.21.15.1:6829/1143859822","heartbeat_back_addr":"172.21.15.1:6833/1143859822","heartbeat_front_addr":"172.21.15.1:6831/1143859822","state":["exists","up"]},{"osd":10,"uuid":"34edd06a-7f60-4465-bfe1-0c646abd53f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6825","nonce":343155547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6827","nonce":343155547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6831","nonce":343155547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6829","nonce":343155547}]},"public_addr":"172.21.15.22:6825/343155547","cluster_addr":"172.21.15.22:6827/343155547","heartbeat_back_addr":"172.21.15.22:6831/343155547","heartbeat_front_addr":"172.21.15.22:6829/343155547","state":["exists","up"]},{"osd":11,"uuid":"5a831eb6-ad66-4ab6-a30a-b6299ce1f88d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6825","nonce":3202514460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6827","nonce":3202514460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6831","nonce":3202514460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6829","nonce":3202514460}]},"public_addr":"172.21.15.121:6825/3202514460","cluster_addr":"172.21.15.121:6827/3202514460","heartbeat_back_addr":"172.21.15.121:6831/3202514460","heartbeat_front_addr":"172.21.15.121:6829/3202514460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:30:37.582893+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:01.915252+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:26.783477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:53.407014+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:19.407005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:45.022320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:11.377986+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:36.818700+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:01.745428+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:27.928916+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:53.363906+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:19.037551+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6800/1028873727":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/3137949087":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/1951370933":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2008363642":"2024-09-20T09:28:50.074985+0000","172.21.15.1:0/3006931063":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2486161758":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6801/1296304385":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6801/1028873727":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2783823049":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6800/1296304385":"2024-09-20T09:28:50.074985+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:37:35.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.658+0000 7f4a24348640 1 -- 172.21.15.1:0/3209420943 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4a080a32d0 msgr2=0x7f4a080a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:35.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.658+0000 7f4a24348640 1 --2- 172.21.15.1:0/3209420943 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4a080a32d0 0x7f4a080a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c000c00 tx=0x7f4a0c005a20 comp rx=0 tx=0).stop 2024-09-19T09:37:35.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.658+0000 7f4a24348640 1 -- 172.21.15.1:0/3209420943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a1c100a80 msgr2=0x7f4a1c0fcd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:35.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.658+0000 7f4a24348640 1 --2- 172.21.15.1:0/3209420943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a1c100a80 0x7f4a1c0fcd30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800c920 tx=0x7f4a1800cde0 comp rx=0 tx=0).stop 2024-09-19T09:37:35.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.658+0000 7f4a24348640 1 -- 172.21.15.1:0/3209420943 shutdown_connections 2024-09-19T09:37:35.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.658+0000 7f4a24348640 1 --2- 172.21.15.1:0/3209420943 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4a1c106a80 0x7f4a1c0fd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:35.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.658+0000 7f4a24348640 1 --2- 172.21.15.1:0/3209420943 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4a080a32d0 0x7f4a080a5790 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:35.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.658+0000 7f4a24348640 1 --2- 172.21.15.1:0/3209420943 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a1c101420 0x7f4a1c0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:35.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.658+0000 7f4a24348640 1 --2- 172.21.15.1:0/3209420943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4a1c100a80 0x7f4a1c0fcd30 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:35.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.658+0000 7f4a24348640 1 -- 172.21.15.1:0/3209420943 >> 172.21.15.1:0/3209420943 conn(0x7f4a1c0fc7a0 msgr2=0x7f4a1c06a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:35.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.658+0000 7f4a24348640 1 -- 172.21.15.1:0/3209420943 shutdown_connections 2024-09-19T09:37:35.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:35.659+0000 7f4a24348640 1 -- 172.21.15.1:0/3209420943 wait complete. 2024-09-19T09:37:36.356 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:36 smithi001 ceph-mon[31225]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:36.356 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:36 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/3209420943' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:37:36.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:36 smithi022 ceph-mon[35583]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:36.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:36 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/3209420943' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:37:36.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:36 smithi121 ceph-mon[35577]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:36.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:36 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/3209420943' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:37:36.387 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:37:36.645 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:37.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.121+0000 7f2a912c0640 1 -- 172.21.15.1:0/3578594326 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a8c102570 msgr2=0x7f2a8c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:37.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.121+0000 7f2a912c0640 1 --2- 172.21.15.1:0/3578594326 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a8c102570 0x7f2a8c1029b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2a80009900 tx=0x7f2a8002a480 comp rx=0 tx=0).stop 2024-09-19T09:37:37.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.121+0000 7f2a912c0640 1 -- 172.21.15.1:0/3578594326 shutdown_connections 2024-09-19T09:37:37.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.121+0000 7f2a912c0640 1 --2- 172.21.15.1:0/3578594326 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a8c102ef0 0x7f2a8c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.121+0000 7f2a912c0640 1 --2- 172.21.15.1:0/3578594326 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a8c102570 0x7f2a8c1029b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.121+0000 7f2a912c0640 1 --2- 172.21.15.1:0/3578594326 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a8c100e20 0x7f2a8c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.121+0000 7f2a912c0640 1 -- 172.21.15.1:0/3578594326 >> 172.21.15.1:0/3578594326 conn(0x7f2a8c0fc7d0 msgr2=0x7f2a8c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:37.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.121+0000 7f2a912c0640 1 -- 172.21.15.1:0/3578594326 shutdown_connections 2024-09-19T09:37:37.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.121+0000 7f2a912c0640 1 -- 172.21.15.1:0/3578594326 wait complete. 2024-09-19T09:37:37.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.122+0000 7f2a912c0640 1 Processor -- start 2024-09-19T09:37:37.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.122+0000 7f2a912c0640 1 -- start start 2024-09-19T09:37:37.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.122+0000 7f2a912c0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a8c100e20 0x7f2a8c199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:37.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.122+0000 7f2a912c0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a8c102570 0x7f2a8c1998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:37.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.122+0000 7f2a912c0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a8c102ef0 0x7f2a8c1a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:37.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.122+0000 7f2a912c0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2a8c110fa0 con 0x7f2a8c100e20 2024-09-19T09:37:37.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.122+0000 7f2a912c0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2a8c110e20 con 0x7f2a8c102ef0 2024-09-19T09:37:37.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.122+0000 7f2a912c0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2a8c111120 con 0x7f2a8c102570 2024-09-19T09:37:37.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.123+0000 7f2a8affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a8c100e20 0x7f2a8c199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:37.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.123+0000 7f2a8affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a8c100e20 0x7f2a8c199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35322/0 (socket says 172.21.15.1:35322) 2024-09-19T09:37:37.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.123+0000 7f2a8affd640 1 -- 172.21.15.1:0/2558377002 learned_addr learned my addr 172.21.15.1:0/2558377002 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:37.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.123+0000 7f2a8a7fc640 1 --2- 172.21.15.1:0/2558377002 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a8c102570 0x7f2a8c1998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:37.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.123+0000 7f2a8affd640 1 -- 172.21.15.1:0/2558377002 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a8c102570 msgr2=0x7f2a8c1998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:37.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.123+0000 7f2a8b7fe640 1 --2- 172.21.15.1:0/2558377002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a8c102ef0 0x7f2a8c1a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:37.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.123+0000 7f2a8affd640 1 --2- 172.21.15.1:0/2558377002 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a8c102570 0x7f2a8c1998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.123+0000 7f2a8affd640 1 -- 172.21.15.1:0/2558377002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a8c102ef0 msgr2=0x7f2a8c1a4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:37.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.123+0000 7f2a8affd640 1 --2- 172.21.15.1:0/2558377002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a8c102ef0 0x7f2a8c1a4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.123+0000 7f2a8affd640 1 -- 172.21.15.1:0/2558377002 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a8c1a4950 con 0x7f2a8c100e20 2024-09-19T09:37:37.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.123+0000 7f2a8b7fe640 1 --2- 172.21.15.1:0/2558377002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a8c102ef0 0x7f2a8c1a4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:37.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.123+0000 7f2a8affd640 1 --2- 172.21.15.1:0/2558377002 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a8c100e20 0x7f2a8c199390 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c00d950 tx=0x7f2a7c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:37.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.123+0000 7f2a73fff640 1 -- 172.21.15.1:0/2558377002 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c017070 con 0x7f2a8c100e20 2024-09-19T09:37:37.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.123+0000 7f2a912c0640 1 -- 172.21.15.1:0/2558377002 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a8c1a4b20 con 0x7f2a8c100e20 2024-09-19T09:37:37.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.123+0000 7f2a73fff640 1 -- 172.21.15.1:0/2558377002 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a7c009c30 con 0x7f2a8c100e20 2024-09-19T09:37:37.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.123+0000 7f2a73fff640 1 -- 172.21.15.1:0/2558377002 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c00f6b0 con 0x7f2a8c100e20 2024-09-19T09:37:37.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.123+0000 7f2a912c0640 1 -- 172.21.15.1:0/2558377002 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a8c1a5060 con 0x7f2a8c100e20 2024-09-19T09:37:37.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.124+0000 7f2a912c0640 1 -- 172.21.15.1:0/2558377002 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a8c101200 con 0x7f2a8c100e20 2024-09-19T09:37:37.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.126+0000 7f2a73fff640 1 -- 172.21.15.1:0/2558377002 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f2a7c0109d0 con 0x7f2a8c100e20 2024-09-19T09:37:37.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.126+0000 7f2a73fff640 1 --2- 172.21.15.1:0/2558377002 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f2a740a32d0 0x7f2a740a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:37.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.126+0000 7f2a8a7fc640 1 --2- 172.21.15.1:0/2558377002 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f2a740a32d0 0x7f2a740a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:37.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.126+0000 7f2a73fff640 1 -- 172.21.15.1:0/2558377002 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f2a7c0cf770 con 0x7f2a8c100e20 2024-09-19T09:37:37.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.127+0000 7f2a8a7fc640 1 --2- 172.21.15.1:0/2558377002 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f2a740a32d0 0x7f2a740a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c06aac0 tx=0x7f2a80005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:37.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.129+0000 7f2a73fff640 1 -- 172.21.15.1:0/2558377002 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2a7c009de0 con 0x7f2a8c100e20 2024-09-19T09:37:37.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.345+0000 7f2a912c0640 1 -- 172.21.15.1:0/2558377002 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a8c109090 con 0x7f2a8c100e20 2024-09-19T09:37:37.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.346+0000 7f2a73fff640 1 -- 172.21.15.1:0/2558377002 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11837 (secure 0 0 0) 0x7f2a7c09c330 con 0x7f2a8c100e20 2024-09-19T09:37:37.349 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:37:37.349 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":19,"btime":"2024-09-19T09:36:24:006349+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:36:23.723388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6839/3279971690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3279971690},{"type":"v1","addr":"172.21.15.121:6839","nonce":3279971690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:37:37.350 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 19 2024-09-19T09:37:37.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.349+0000 7f2a912c0640 1 -- 172.21.15.1:0/2558377002 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f2a740a32d0 msgr2=0x7f2a740a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:37.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.349+0000 7f2a912c0640 1 --2- 172.21.15.1:0/2558377002 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f2a740a32d0 0x7f2a740a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c06aac0 tx=0x7f2a80005a20 comp rx=0 tx=0).stop 2024-09-19T09:37:37.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.349+0000 7f2a912c0640 1 -- 172.21.15.1:0/2558377002 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a8c100e20 msgr2=0x7f2a8c199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:37.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.349+0000 7f2a912c0640 1 --2- 172.21.15.1:0/2558377002 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a8c100e20 0x7f2a8c199390 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c00d950 tx=0x7f2a7c00de10 comp rx=0 tx=0).stop 2024-09-19T09:37:37.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.349+0000 7f2a912c0640 1 -- 172.21.15.1:0/2558377002 shutdown_connections 2024-09-19T09:37:37.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.349+0000 7f2a912c0640 1 --2- 172.21.15.1:0/2558377002 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f2a740a32d0 0x7f2a740a5790 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.349+0000 7f2a912c0640 1 --2- 172.21.15.1:0/2558377002 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a8c102ef0 0x7f2a8c1a4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.349+0000 7f2a912c0640 1 --2- 172.21.15.1:0/2558377002 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a8c102570 0x7f2a8c1998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.349+0000 7f2a912c0640 1 --2- 172.21.15.1:0/2558377002 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a8c100e20 0x7f2a8c199390 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:37.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.349+0000 7f2a912c0640 1 -- 172.21.15.1:0/2558377002 >> 172.21.15.1:0/2558377002 conn(0x7f2a8c0fc7d0 msgr2=0x7f2a8c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:37.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.349+0000 7f2a912c0640 1 -- 172.21.15.1:0/2558377002 shutdown_connections 2024-09-19T09:37:37.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:37.349+0000 7f2a912c0640 1 -- 172.21.15.1:0/2558377002 wait complete. 2024-09-19T09:37:38.062 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T09:36:13.637508+0000', 'modified': '2024-09-19T09:36:23.723388+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24497}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24490': {'gid': 24490, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.121:6839/3279971690', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6838', 'nonce': 3279971690}, {'type': 'v1', 'addr': '172.21.15.121:6839', 'nonce': 3279971690}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24497': {'gid': 24497, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.22:6839/2513831228', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6838', 'nonce': 2513831228}, {'type': 'v1', 'addr': '172.21.15.22:6839', 'nonce': 2513831228}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24497, 'qdb_cluster': [24497]} 2024-09-19T09:37:38.062 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T09:37:38.062 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T09:37:38.321 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:38.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:38 smithi022 ceph-mon[35583]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:38.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:38 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/2558377002' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:38.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:38 smithi121 ceph-mon[35577]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:38.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:38 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/2558377002' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:38.442 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:38 smithi001 ceph-mon[31225]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:38.442 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:38 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/2558377002' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:38.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.805+0000 7f4625347640 1 -- 172.21.15.1:0/2785772854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4620106f10 msgr2=0x7f462010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:38.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.805+0000 7f4625347640 1 --2- 172.21.15.1:0/2785772854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4620106f10 0x7f462010ea90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4618009ca0 tx=0x7f461802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.805+0000 7f4625347640 1 -- 172.21.15.1:0/2785772854 shutdown_connections 2024-09-19T09:37:38.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.805+0000 7f4625347640 1 --2- 172.21.15.1:0/2785772854 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4620106f10 0x7f462010ea90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.805+0000 7f4625347640 1 --2- 172.21.15.1:0/2785772854 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4620102790 0x7f46201067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.805+0000 7f4625347640 1 --2- 172.21.15.1:0/2785772854 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4620101de0 0x7f46201021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.805+0000 7f4625347640 1 -- 172.21.15.1:0/2785772854 >> 172.21.15.1:0/2785772854 conn(0x7f46200fd8c0 msgr2=0x7f46200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:38.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.805+0000 7f4625347640 1 -- 172.21.15.1:0/2785772854 shutdown_connections 2024-09-19T09:37:38.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.805+0000 7f4625347640 1 -- 172.21.15.1:0/2785772854 wait complete. 2024-09-19T09:37:38.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.806+0000 7f4625347640 1 Processor -- start 2024-09-19T09:37:38.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.806+0000 7f4625347640 1 -- start start 2024-09-19T09:37:38.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.806+0000 7f4625347640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4620101de0 0x7f4620198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:38.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.806+0000 7f4625347640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4620102790 0x7f4620198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:38.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.806+0000 7f4625347640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4620106f10 0x7f462019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:38.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.806+0000 7f4625347640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4620112010 con 0x7f4620101de0 2024-09-19T09:37:38.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.806+0000 7f4625347640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4620111e90 con 0x7f4620102790 2024-09-19T09:37:38.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.806+0000 7f4625347640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4620112190 con 0x7f4620106f10 2024-09-19T09:37:38.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.806+0000 7f461effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4620101de0 0x7f4620198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:38.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.806+0000 7f461effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4620101de0 0x7f4620198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35350/0 (socket says 172.21.15.1:35350) 2024-09-19T09:37:38.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.806+0000 7f461effd640 1 -- 172.21.15.1:0/3429936651 learned_addr learned my addr 172.21.15.1:0/3429936651 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:38.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.806+0000 7f461f7fe640 1 --2- 172.21.15.1:0/3429936651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4620106f10 0x7f462019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:38.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.806+0000 7f461e7fc640 1 --2- 172.21.15.1:0/3429936651 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4620102790 0x7f4620198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:38.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.807+0000 7f461effd640 1 -- 172.21.15.1:0/3429936651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4620106f10 msgr2=0x7f462019ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:38.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.807+0000 7f461effd640 1 --2- 172.21.15.1:0/3429936651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4620106f10 0x7f462019ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.807+0000 7f461effd640 1 -- 172.21.15.1:0/3429936651 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4620102790 msgr2=0x7f4620198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:38.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.807+0000 7f461effd640 1 --2- 172.21.15.1:0/3429936651 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4620102790 0x7f4620198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.807+0000 7f461effd640 1 -- 172.21.15.1:0/3429936651 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f462019d540 con 0x7f4620101de0 2024-09-19T09:37:38.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.807+0000 7f461e7fc640 1 --2- 172.21.15.1:0/3429936651 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4620102790 0x7f4620198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:38.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.807+0000 7f461effd640 1 --2- 172.21.15.1:0/3429936651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4620101de0 0x7f4620198590 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f461000b4a0 tx=0x7f461000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:38.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.807+0000 7f4607fff640 1 -- 172.21.15.1:0/3429936651 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4610014070 con 0x7f4620101de0 2024-09-19T09:37:38.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.807+0000 7f4607fff640 1 -- 172.21.15.1:0/3429936651 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4610010af0 con 0x7f4620101de0 2024-09-19T09:37:38.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.807+0000 7f4625347640 1 -- 172.21.15.1:0/3429936651 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f462019d830 con 0x7f4620101de0 2024-09-19T09:37:38.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.807+0000 7f4607fff640 1 -- 172.21.15.1:0/3429936651 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4610017d10 con 0x7f4620101de0 2024-09-19T09:37:38.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.807+0000 7f4625347640 1 -- 172.21.15.1:0/3429936651 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46201a5110 con 0x7f4620101de0 2024-09-19T09:37:38.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.809+0000 7f4607fff640 1 -- 172.21.15.1:0/3429936651 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f4610017070 con 0x7f4620101de0 2024-09-19T09:37:38.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.810+0000 7f4627720740 1 Processor -- start 2024-09-19T09:37:38.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.810+0000 7f4627720740 1 -- start start 2024-09-19T09:37:38.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.810+0000 7f4627720740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5607389309d0 0x560738930db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:38.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.810+0000 7f4627720740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5607389312f0 0x56073893b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:38.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.810+0000 7f4627720740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56073893bbb0 0x56073893dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:38.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.810+0000 7f4627720740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560738897090 con 0x56073893bbb0 2024-09-19T09:37:38.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.810+0000 7f4627720740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56073883ea70 con 0x5607389309d0 2024-09-19T09:37:38.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.810+0000 7f4627720740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x560738893050 con 0x5607389312f0 2024-09-19T09:37:38.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.810+0000 7f461e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56073893bbb0 0x56073893dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:38.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.810+0000 7f461e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56073893bbb0 0x56073893dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35364/0 (socket says 172.21.15.1:35364) 2024-09-19T09:37:38.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.810+0000 7f461e7fc640 1 -- 172.21.15.1:0/3630600847 learned_addr learned my addr 172.21.15.1:0/3630600847 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:38.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.810+0000 7f4607fff640 1 --2- 172.21.15.1:0/3429936651 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f46080a32d0 0x7f46080a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:38.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.810+0000 7f461effd640 1 --2- 172.21.15.1:0/3630600847 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5607389312f0 0x56073893b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:38.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.810+0000 7f461f7fe640 1 --2- 172.21.15.1:0/3630600847 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5607389309d0 0x560738930db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:38.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.810+0000 7f461f7fe640 1 --2- 172.21.15.1:0/3429936651 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f46080a32d0 0x7f46080a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:38.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.810+0000 7f461e7fc640 1 -- 172.21.15.1:0/3630600847 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5607389312f0 msgr2=0x56073893b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:38.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.810+0000 7f461e7fc640 1 --2- 172.21.15.1:0/3630600847 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5607389312f0 0x56073893b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.810+0000 7f461e7fc640 1 -- 172.21.15.1:0/3630600847 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5607389309d0 msgr2=0x560738930db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:38.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.811+0000 7f461e7fc640 1 --2- 172.21.15.1:0/3630600847 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5607389309d0 0x560738930db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.811+0000 7f461e7fc640 1 -- 172.21.15.1:0/3630600847 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56073884b130 con 0x56073893bbb0 2024-09-19T09:37:38.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.811+0000 7f4607fff640 1 -- 172.21.15.1:0/3429936651 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f46100ceda0 con 0x7f4620101de0 2024-09-19T09:37:38.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.811+0000 7f461e7fc640 1 --2- 172.21.15.1:0/3630600847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56073893bbb0 0x56073893dfa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4614007800 tx=0x7f4614007cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af983c4fa8e0dec9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:38.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.811+0000 7f46057fa640 1 -- 172.21.15.1:0/3630600847 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f461400d950 con 0x56073893bbb0 2024-09-19T09:37:38.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.811+0000 7f46057fa640 1 -- 172.21.15.1:0/3630600847 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4614018070 con 0x56073893bbb0 2024-09-19T09:37:38.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.811+0000 7f461f7fe640 1 --2- 172.21.15.1:0/3429936651 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f46080a32d0 0x7f46080a5790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4618005fe0 tx=0x7f4618009380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:38.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.811+0000 7f46057fa640 1 -- 172.21.15.1:0/3630600847 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46140123e0 con 0x56073893bbb0 2024-09-19T09:37:38.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.812+0000 7f4627720740 1 -- 172.21.15.1:0/3630600847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56073893bbb0 msgr2=0x56073893dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:38.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.812+0000 7f4627720740 1 --2- 172.21.15.1:0/3630600847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56073893bbb0 0x56073893dfa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4614007800 tx=0x7f4614007cc0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.812+0000 7f4627720740 1 -- 172.21.15.1:0/3630600847 shutdown_connections 2024-09-19T09:37:38.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.812+0000 7f4627720740 1 --2- 172.21.15.1:0/3630600847 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56073893bbb0 0x56073893dfa0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.812+0000 7f4627720740 1 --2- 172.21.15.1:0/3630600847 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5607389312f0 0x56073893b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.812+0000 7f4627720740 1 --2- 172.21.15.1:0/3630600847 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5607389309d0 0x560738930db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.812+0000 7f4627720740 1 -- 172.21.15.1:0/3630600847 >> 172.21.15.1:0/3630600847 conn(0x56073892cf60 msgr2=0x56073892d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:38.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.812+0000 7f4627720740 1 -- 172.21.15.1:0/3630600847 shutdown_connections 2024-09-19T09:37:38.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.812+0000 7f4627720740 1 -- 172.21.15.1:0/3630600847 wait complete. 2024-09-19T09:37:38.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.812+0000 7f4627720740 1 -- start start 2024-09-19T09:37:38.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.812+0000 7f4627720740 1 Processor -- start 2024-09-19T09:37:38.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.812+0000 7f4627720740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607389309d0 0x56073893b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:38.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.812+0000 7f4627720740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5607389312f0 0x560738938740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:38.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.812+0000 7f4627720740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56073893bbb0 0x560738938c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:38.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.812+0000 7f4627720740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56073893e780 con 0x5607389309d0 2024-09-19T09:37:38.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.812+0000 7f4627720740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560738851f20 con 0x5607389312f0 2024-09-19T09:37:38.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.812+0000 7f4627720740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56073893e900 con 0x56073893bbb0 2024-09-19T09:37:38.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.812+0000 7f4627720740 10 client.0 _ll_register_callbacks cb 0x56073881b030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:38.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.813+0000 7f461effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607389309d0 0x56073893b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:38.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.813+0000 7f461effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607389309d0 0x56073893b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35366/0 (socket says 172.21.15.1:35366) 2024-09-19T09:37:38.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.813+0000 7f461effd640 1 -- 172.21.15.1:0/3592957045 learned_addr learned my addr 172.21.15.1:0/3592957045 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:38.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.813+0000 7f461e7fc640 1 --2- 172.21.15.1:0/3592957045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5607389312f0 0x560738938740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:38.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.813+0000 7f461effd640 1 -- 172.21.15.1:0/3592957045 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56073893bbb0 msgr2=0x560738938c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:38.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.813+0000 7f461effd640 1 --2- 172.21.15.1:0/3592957045 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56073893bbb0 0x560738938c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.813+0000 7f461effd640 1 -- 172.21.15.1:0/3592957045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5607389312f0 msgr2=0x560738938740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:38.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.813+0000 7f461effd640 1 --2- 172.21.15.1:0/3592957045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5607389312f0 0x560738938740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.813+0000 7f461effd640 1 -- 172.21.15.1:0/3592957045 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607386082b0 con 0x5607389309d0 2024-09-19T09:37:38.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.813+0000 7f461effd640 1 --2- 172.21.15.1:0/3592957045 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607389309d0 0x56073893b3f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4610097790 tx=0x7f461006a070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f00ebb7cf0f77 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:38.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.813+0000 7f4602ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:37:38.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.813+0000 7f4602ff5640 1 -- 172.21.15.1:0/3592957045 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f461001e070 con 0x5607389309d0 2024-09-19T09:37:38.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.813+0000 7f4602ff5640 1 -- 172.21.15.1:0/3592957045 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f46100979a0 con 0x5607389309d0 2024-09-19T09:37:38.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.813+0000 7f4627720740 1 -- 172.21.15.1:0/3592957045 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4614018070 con 0x5607389309d0 2024-09-19T09:37:38.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.813+0000 7f4602ff5640 1 -- 172.21.15.1:0/3592957045 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f461009ba30 con 0x5607389309d0 2024-09-19T09:37:38.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.813+0000 7f4627720740 10 client.14976 fetch_fsmap learned FSMap version 19 2024-09-19T09:37:38.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.813+0000 7f4627720740 1 -- 172.21.15.1:0/3592957045 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56073894a0a0 con 0x5607389309d0 2024-09-19T09:37:38.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.813+0000 7f4602ff5640 1 -- 172.21.15.1:0/3592957045 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4614018070 con 0x5607389309d0 2024-09-19T09:37:38.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.814+0000 7f4602ff5640 1 -- 172.21.15.1:0/3592957045 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f46100cc960 con 0x5607389309d0 2024-09-19T09:37:38.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.814+0000 7f4627720740 10 client.14976 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:37:38.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.814+0000 7f4627720740 10 client.14976 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:37:38.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.814+0000 7f4627720740 20 client.14976 populate_metadata read hostname 'smithi001' 2024-09-19T09:37:38.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.814+0000 7f4627720740 1 --2- 172.21.15.1:0/3592957045 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56073894c710 0x56073894db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:38.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.814+0000 7f4627720740 4 client.14976 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:37:38.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.814+0000 7f4627720740 1 -- 172.21.15.1:0/3592957045 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607388a4600 con 0x56073894c710 2024-09-19T09:37:38.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.814+0000 7f461e7fc640 1 --2- 172.21.15.1:0/3592957045 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56073894c710 0x56073894db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:38.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.815+0000 7f461e7fc640 1 --2- 172.21.15.1:0/3592957045 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56073894c710 0x56073894db80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44b5f0b076c33199 server_cookie=42b190942451d87 in_seq=0 out_seq=0 2024-09-19T09:37:38.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.815+0000 7f4602ff5640 10 client.14976 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:37:38.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.815+0000 7f4602ff5640 1 -- 172.21.15.1:0/3592957045 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5607388a4600 con 0x56073894c710 2024-09-19T09:37:38.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.815+0000 7f4602ff5640 10 client.14976 handle_command_reply: tid=0 2024-09-19T09:37:38.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.815+0000 7f4627720740 1 client.14976 shutdown 2024-09-19T09:37:38.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.815+0000 7f4627720740 1 -- 172.21.15.1:0/3592957045 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607389309d0 msgr2=0x56073893b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:38.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.815+0000 7f4627720740 1 --2- 172.21.15.1:0/3592957045 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607389309d0 0x56073893b3f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4610097790 tx=0x7f461006a070 comp rx=0 tx=0).stop 2024-09-19T09:37:38.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.816+0000 7f4627720740 1 -- 172.21.15.1:0/3592957045 shutdown_connections 2024-09-19T09:37:38.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.816+0000 7f4627720740 1 --2- 172.21.15.1:0/3592957045 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56073894c710 0x56073894db80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.816+0000 7f4627720740 1 --2- 172.21.15.1:0/3592957045 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56073893bbb0 0x560738938c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.816+0000 7f4627720740 1 --2- 172.21.15.1:0/3592957045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5607389312f0 0x560738938740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.816+0000 7f4602ff5640 0 client.14976 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:37:38.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.816+0000 7f4627720740 1 --2- 172.21.15.1:0/3592957045 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607389309d0 0x56073893b3f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.816+0000 7f4627720740 1 -- 172.21.15.1:0/3592957045 >> 172.21.15.1:0/3592957045 conn(0x56073892cf60 msgr2=0x560738932c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:38.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.816+0000 7f4627720740 1 -- 172.21.15.1:0/3592957045 shutdown_connections 2024-09-19T09:37:38.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.816+0000 7f4627720740 1 -- 172.21.15.1:0/3592957045 wait complete. 2024-09-19T09:37:38.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.816+0000 7f4627720740 20 client.14976 trim_cache size 0 max 16384 2024-09-19T09:37:38.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.834+0000 7f4627720740 1 Processor -- start 2024-09-19T09:37:38.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.834+0000 7f4627720740 1 -- start start 2024-09-19T09:37:38.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.834+0000 7f4627720740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5607389309d0 0x56073894db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:38.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.834+0000 7f4627720740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607389312f0 0x560738938000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:38.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.834+0000 7f4627720740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56073893bbb0 0x560738937030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:38.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.834+0000 7f4627720740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56073894bec0 con 0x5607389312f0 2024-09-19T09:37:38.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.834+0000 7f4627720740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56073894c590 con 0x5607389309d0 2024-09-19T09:37:38.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.834+0000 7f4627720740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56073894cc60 con 0x56073893bbb0 2024-09-19T09:37:38.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.834+0000 7f461e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607389312f0 0x560738938000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:38.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.834+0000 7f461e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607389312f0 0x560738938000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35380/0 (socket says 172.21.15.1:35380) 2024-09-19T09:37:38.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.834+0000 7f461e7fc640 1 -- 172.21.15.1:0/2809941460 learned_addr learned my addr 172.21.15.1:0/2809941460 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:38.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.834+0000 7f461effd640 1 --2- 172.21.15.1:0/2809941460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5607389309d0 0x56073894db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:38.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.834+0000 7f461e7fc640 1 -- 172.21.15.1:0/2809941460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56073893bbb0 msgr2=0x560738937030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:38.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.834+0000 7f461e7fc640 1 --2- 172.21.15.1:0/2809941460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56073893bbb0 0x560738937030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.834+0000 7f461e7fc640 1 -- 172.21.15.1:0/2809941460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5607389309d0 msgr2=0x56073894db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:38.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.834+0000 7f461e7fc640 1 --2- 172.21.15.1:0/2809941460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5607389309d0 0x56073894db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.834+0000 7f461e7fc640 1 -- 172.21.15.1:0/2809941460 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560738931120 con 0x5607389312f0 2024-09-19T09:37:38.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.835+0000 7f461e7fc640 1 --2- 172.21.15.1:0/2809941460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607389312f0 0x560738938000 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4614013bd0 tx=0x7f461400f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56568710bc221d13 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:38.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.835+0000 7f4604ff9640 1 -- 172.21.15.1:0/2809941460 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f461402a020 con 0x5607389312f0 2024-09-19T09:37:38.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.835+0000 7f4604ff9640 1 -- 172.21.15.1:0/2809941460 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4614018070 con 0x5607389312f0 2024-09-19T09:37:38.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.835+0000 7f4604ff9640 1 -- 172.21.15.1:0/2809941460 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f461400de60 con 0x5607389312f0 2024-09-19T09:37:38.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.835+0000 7f4627720740 1 -- 172.21.15.1:0/2809941460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607389312f0 msgr2=0x560738938000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:38.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.835+0000 7f4627720740 1 --2- 172.21.15.1:0/2809941460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607389312f0 0x560738938000 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4614013bd0 tx=0x7f461400f040 comp rx=0 tx=0).stop 2024-09-19T09:37:38.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.835+0000 7f4627720740 1 -- 172.21.15.1:0/2809941460 shutdown_connections 2024-09-19T09:37:38.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.835+0000 7f4627720740 1 --2- 172.21.15.1:0/2809941460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56073893bbb0 0x560738937030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.835+0000 7f4627720740 1 --2- 172.21.15.1:0/2809941460 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607389312f0 0x560738938000 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.835+0000 7f4627720740 1 --2- 172.21.15.1:0/2809941460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5607389309d0 0x56073894db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.835+0000 7f4627720740 1 -- 172.21.15.1:0/2809941460 >> 172.21.15.1:0/2809941460 conn(0x56073892cf60 msgr2=0x560738938700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:38.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.836+0000 7f4627720740 1 -- 172.21.15.1:0/2809941460 shutdown_connections 2024-09-19T09:37:38.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.836+0000 7f4627720740 1 -- 172.21.15.1:0/2809941460 wait complete. 2024-09-19T09:37:38.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.836+0000 7f4627720740 1 -- start start 2024-09-19T09:37:38.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.836+0000 7f4627720740 1 Processor -- start 2024-09-19T09:37:38.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.836+0000 7f4627720740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607389309d0 0x560738934a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:38.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.836+0000 7f4627720740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5607389312f0 0x560738934fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:38.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.836+0000 7f4627720740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56073893bbb0 0x5607389354f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:38.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.836+0000 7f4627720740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56073894da00 con 0x5607389309d0 2024-09-19T09:37:38.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.836+0000 7f4627720740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56073894d330 con 0x5607389312f0 2024-09-19T09:37:38.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.836+0000 7f4627720740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56073894e0d0 con 0x56073893bbb0 2024-09-19T09:37:38.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.836+0000 7f4627720740 10 client.0 _ll_register_callbacks cb 0x7f461000b3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:38.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.836+0000 7f461effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607389309d0 0x560738934a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:38.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.836+0000 7f461effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607389309d0 0x560738934a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35386/0 (socket says 172.21.15.1:35386) 2024-09-19T09:37:38.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.836+0000 7f461effd640 1 -- 172.21.15.1:0/3600103542 learned_addr learned my addr 172.21.15.1:0/3600103542 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:38.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.836+0000 7f461e7fc640 1 --2- 172.21.15.1:0/3600103542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5607389312f0 0x560738934fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:38.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.837+0000 7f461effd640 1 -- 172.21.15.1:0/3600103542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56073893bbb0 msgr2=0x5607389354f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:38.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.837+0000 7f461effd640 1 --2- 172.21.15.1:0/3600103542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56073893bbb0 0x5607389354f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.837+0000 7f461effd640 1 -- 172.21.15.1:0/3600103542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5607389312f0 msgr2=0x560738934fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:38.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.837+0000 7f461effd640 1 --2- 172.21.15.1:0/3600103542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5607389312f0 0x560738934fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.837+0000 7f461effd640 1 -- 172.21.15.1:0/3600103542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560738954f80 con 0x5607389309d0 2024-09-19T09:37:38.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.837+0000 7f461effd640 1 --2- 172.21.15.1:0/3600103542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607389309d0 0x560738934a70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4610004700 tx=0x7f46100092b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e195595121e3fdf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:38.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.837+0000 7f4602ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:37:38.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.837+0000 7f4602ff5640 1 -- 172.21.15.1:0/3600103542 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f461001e070 con 0x5607389309d0 2024-09-19T09:37:38.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.837+0000 7f4602ff5640 1 -- 172.21.15.1:0/3600103542 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f461009a980 con 0x5607389309d0 2024-09-19T09:37:38.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.837+0000 7f4627720740 1 -- 172.21.15.1:0/3600103542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4614018070 con 0x5607389309d0 2024-09-19T09:37:38.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.837+0000 7f4602ff5640 1 -- 172.21.15.1:0/3600103542 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f461009f6e0 con 0x5607389309d0 2024-09-19T09:37:38.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.837+0000 7f4627720740 10 client.14982 fetch_fsmap learned FSMap version 19 2024-09-19T09:37:38.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.837+0000 7f4627720740 1 -- 172.21.15.1:0/3600103542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x560738956280 con 0x5607389309d0 2024-09-19T09:37:38.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.837+0000 7f4602ff5640 1 -- 172.21.15.1:0/3600103542 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4614018070 con 0x5607389309d0 2024-09-19T09:37:38.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.837+0000 7f4602ff5640 1 -- 172.21.15.1:0/3600103542 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f461009f2e0 con 0x5607389309d0 2024-09-19T09:37:38.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.837+0000 7f4627720740 10 client.14982 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:37:38.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.838+0000 7f4627720740 10 client.14982 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:37:38.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.838+0000 7f4627720740 20 client.14982 populate_metadata read hostname 'smithi001' 2024-09-19T09:37:38.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.838+0000 7f4627720740 1 --2- 172.21.15.1:0/3600103542 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5607389baff0 0x5607389b9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:38.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.838+0000 7f4627720740 4 client.14982 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:37:38.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.838+0000 7f4627720740 1 -- 172.21.15.1:0/3600103542 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "status"}) -- 0x56073889eb10 con 0x5607389baff0 2024-09-19T09:37:38.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.838+0000 7f461e7fc640 1 --2- 172.21.15.1:0/3600103542 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5607389baff0 0x5607389b9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:38.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.838+0000 7f461e7fc640 1 --2- 172.21.15.1:0/3600103542 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5607389baff0 0x5607389b9d00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33f9420392d5981f server_cookie=7fd28515acf685b8 in_seq=0 out_seq=0 2024-09-19T09:37:38.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.838+0000 7f4602ff5640 10 client.14982 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:37:38.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.839+0000 7f4602ff5640 1 -- 172.21.15.1:0/3600103542 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56073889eb10 con 0x5607389baff0 2024-09-19T09:37:38.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.839+0000 7f4602ff5640 10 client.14982 handle_command_reply: tid=0 2024-09-19T09:37:38.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.839+0000 7f4627720740 1 client.14982 shutdown 2024-09-19T09:37:38.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.839+0000 7f4627720740 1 -- 172.21.15.1:0/3600103542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607389309d0 msgr2=0x560738934a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:38.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.839+0000 7f4627720740 1 --2- 172.21.15.1:0/3600103542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607389309d0 0x560738934a70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4610004700 tx=0x7f46100092b0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.839+0000 7f4627720740 1 -- 172.21.15.1:0/3600103542 shutdown_connections 2024-09-19T09:37:38.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.839+0000 7f4627720740 1 --2- 172.21.15.1:0/3600103542 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5607389baff0 0x5607389b9d00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.839+0000 7f4627720740 1 --2- 172.21.15.1:0/3600103542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56073893bbb0 0x5607389354f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.839+0000 7f4627720740 1 --2- 172.21.15.1:0/3600103542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5607389312f0 0x560738934fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.839+0000 7f4627720740 1 --2- 172.21.15.1:0/3600103542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5607389309d0 0x560738934a70 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.839+0000 7f4627720740 1 -- 172.21.15.1:0/3600103542 >> 172.21.15.1:0/3600103542 conn(0x56073892cf60 msgr2=0x560738933610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:38.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.839+0000 7f4602ff5640 0 client.14982 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:37:38.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.839+0000 7f4627720740 1 -- 172.21.15.1:0/3600103542 shutdown_connections 2024-09-19T09:37:38.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.839+0000 7f4627720740 1 -- 172.21.15.1:0/3600103542 wait complete. 2024-09-19T09:37:38.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.839+0000 7f4627720740 20 client.14982 trim_cache size 0 max 16384 2024-09-19T09:37:38.848 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:37:38.848 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "57238232-7669-11ef-bceb-c7b262605968", 2024-09-19T09:37:38.848 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2024-09-19T09:37:38.848 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24497, 2024-09-19T09:37:38.848 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-19T09:37:38.849 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-19T09:37:38.849 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-19T09:37:38.849 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 84.870851766000001, 2024-09-19T09:37:38.849 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 19, 2024-09-19T09:37:38.849 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 83, 2024-09-19T09:37:38.849 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T09:37:38.849 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 95.755469942000005 2024-09-19T09:37:38.849 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:37:38.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.840+0000 7f4625347640 1 -- 172.21.15.1:0/3429936651 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f46080a32d0 msgr2=0x7f46080a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:38.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.840+0000 7f4625347640 1 --2- 172.21.15.1:0/3429936651 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f46080a32d0 0x7f46080a5790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4618005fe0 tx=0x7f4618009380 comp rx=0 tx=0).stop 2024-09-19T09:37:38.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.840+0000 7f4625347640 1 -- 172.21.15.1:0/3429936651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4620101de0 msgr2=0x7f4620198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:38.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.840+0000 7f4625347640 1 --2- 172.21.15.1:0/3429936651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4620101de0 0x7f4620198590 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f461000b4a0 tx=0x7f461000b960 comp rx=0 tx=0).stop 2024-09-19T09:37:38.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.840+0000 7f4625347640 1 -- 172.21.15.1:0/3429936651 shutdown_connections 2024-09-19T09:37:38.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.840+0000 7f4625347640 1 --2- 172.21.15.1:0/3429936651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4620106f10 0x7f462019ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.840+0000 7f4625347640 1 --2- 172.21.15.1:0/3429936651 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f46080a32d0 0x7f46080a5790 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.840+0000 7f4625347640 1 --2- 172.21.15.1:0/3429936651 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4620102790 0x7f4620198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.840+0000 7f4625347640 1 --2- 172.21.15.1:0/3429936651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4620101de0 0x7f4620198590 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:38.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.840+0000 7f4625347640 1 -- 172.21.15.1:0/3429936651 >> 172.21.15.1:0/3429936651 conn(0x7f46200fd8c0 msgr2=0x7f46200fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:38.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.840+0000 7f4625347640 1 -- 172.21.15.1:0/3429936651 shutdown_connections 2024-09-19T09:37:38.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:38.840+0000 7f4625347640 1 -- 172.21.15.1:0/3429936651 wait complete. 2024-09-19T09:37:39.621 INFO:tasks.cephadm:Setup complete, yielding 2024-09-19T09:37:39.621 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T09:37:39.633 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi001.front.sepia.ceph.com 2024-09-19T09:37:39.633 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-19T09:37:39.892 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:40.311 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:40 smithi001 ceph-mon[31225]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:40.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:40 smithi022 ceph-mon[35583]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:40.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:40 smithi121 ceph-mon[35577]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:40.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.391+0000 7f2ab1856640 1 -- 172.21.15.1:0/1778544224 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2aac101c00 msgr2=0x7f2aac102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:40.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.391+0000 7f2ab1856640 1 --2- 172.21.15.1:0/1778544224 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2aac101c00 0x7f2aac102000 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c009900 tx=0x7f2a9c02a410 comp rx=0 tx=0).stop 2024-09-19T09:37:40.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.391+0000 7f2ab1856640 1 -- 172.21.15.1:0/1778544224 shutdown_connections 2024-09-19T09:37:40.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.391+0000 7f2ab1856640 1 --2- 172.21.15.1:0/1778544224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2aac1037c0 0x7f2aac10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:40.419 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.391+0000 7f2ab1856640 1 --2- 172.21.15.1:0/1778544224 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2aac102e00 0x7f2aac103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:40.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.391+0000 7f2ab1856640 1 --2- 172.21.15.1:0/1778544224 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2aac101c00 0x7f2aac102000 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:40.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.391+0000 7f2ab1856640 1 -- 172.21.15.1:0/1778544224 >> 172.21.15.1:0/1778544224 conn(0x7f2aac0fd390 msgr2=0x7f2aac0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:40.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.391+0000 7f2ab1856640 1 -- 172.21.15.1:0/1778544224 shutdown_connections 2024-09-19T09:37:40.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.391+0000 7f2ab1856640 1 -- 172.21.15.1:0/1778544224 wait complete. 2024-09-19T09:37:40.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.392+0000 7f2ab1856640 1 Processor -- start 2024-09-19T09:37:40.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.392+0000 7f2ab1856640 1 -- start start 2024-09-19T09:37:40.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.392+0000 7f2ab1856640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2aac101c00 0x7f2aac197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:40.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.392+0000 7f2ab1856640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2aac102e00 0x7f2aac198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:40.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.392+0000 7f2ab1856640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2aac1037c0 0x7f2aac19f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:40.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.392+0000 7f2ab1856640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac10d860 con 0x7f2aac102e00 2024-09-19T09:37:40.420 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.392+0000 7f2ab1856640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac10d6e0 con 0x7f2aac1037c0 2024-09-19T09:37:40.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.392+0000 7f2ab1856640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2aac10d9e0 con 0x7f2aac101c00 2024-09-19T09:37:40.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.392+0000 7f2aa3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2aac102e00 0x7f2aac198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:40.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.392+0000 7f2aa3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2aac102e00 0x7f2aac198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35408/0 (socket says 172.21.15.1:35408) 2024-09-19T09:37:40.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.392+0000 7f2aa3fff640 1 -- 172.21.15.1:0/3989127249 learned_addr learned my addr 172.21.15.1:0/3989127249 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:40.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.392+0000 7f2aaaffd640 1 --2- 172.21.15.1:0/3989127249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2aac101c00 0x7f2aac197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:40.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.392+0000 7f2aa3fff640 1 -- 172.21.15.1:0/3989127249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2aac101c00 msgr2=0x7f2aac197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:40.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.392+0000 7f2aa3fff640 1 --2- 172.21.15.1:0/3989127249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2aac101c00 0x7f2aac197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:40.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.392+0000 7f2aa3fff640 1 -- 172.21.15.1:0/3989127249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2aac1037c0 msgr2=0x7f2aac19f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:40.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.392+0000 7f2aa3fff640 1 --2- 172.21.15.1:0/3989127249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2aac1037c0 0x7f2aac19f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:40.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.392+0000 7f2aa3fff640 1 -- 172.21.15.1:0/3989127249 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aac19fb50 con 0x7f2aac102e00 2024-09-19T09:37:40.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.392+0000 7f2aaaffd640 1 --2- 172.21.15.1:0/3989127249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2aac101c00 0x7f2aac197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:40.421 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.393+0000 7f2aa3fff640 1 --2- 172.21.15.1:0/3989127249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2aac102e00 0x7f2aac198460 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2a9400d950 tx=0x7f2a9400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:40.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.393+0000 7f2ab0854640 1 -- 172.21.15.1:0/3989127249 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a94017070 con 0x7f2aac102e00 2024-09-19T09:37:40.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.393+0000 7f2ab0854640 1 -- 172.21.15.1:0/3989127249 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a94009c30 con 0x7f2aac102e00 2024-09-19T09:37:40.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.393+0000 7f2ab1856640 1 -- 172.21.15.1:0/3989127249 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aac19fe40 con 0x7f2aac102e00 2024-09-19T09:37:40.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.393+0000 7f2ab0854640 1 -- 172.21.15.1:0/3989127249 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9400f6b0 con 0x7f2aac102e00 2024-09-19T09:37:40.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.393+0000 7f2ab1856640 1 -- 172.21.15.1:0/3989127249 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aac1a02f0 con 0x7f2aac102e00 2024-09-19T09:37:40.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.394+0000 7f2ab1856640 1 -- 172.21.15.1:0/3989127249 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aac109050 con 0x7f2aac102e00 2024-09-19T09:37:40.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.395+0000 7f2ab0854640 1 -- 172.21.15.1:0/3989127249 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f2a940109d0 con 0x7f2aac102e00 2024-09-19T09:37:40.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.396+0000 7f2ab0854640 1 --2- 172.21.15.1:0/3989127249 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f2a980a3300 0x7f2a980a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:40.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.396+0000 7f2aaaffd640 1 --2- 172.21.15.1:0/3989127249 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f2a980a3300 0x7f2a980a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:40.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.396+0000 7f2ab0854640 1 -- 172.21.15.1:0/3989127249 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f2a940cf710 con 0x7f2aac102e00 2024-09-19T09:37:40.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.397+0000 7f2aaaffd640 1 --2- 172.21.15.1:0/3989127249 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f2a980a3300 0x7f2a980a57c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c000c00 tx=0x7f2a9c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:40.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.400+0000 7f2ab0854640 1 -- 172.21.15.1:0/3989127249 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2a9409c2d0 con 0x7f2aac102e00 2024-09-19T09:37:40.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.597+0000 7f2ab1856640 1 -- 172.21.15.1:0/3989127249 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f2aac062630 con 0x7f2a980a3300 2024-09-19T09:37:40.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.598+0000 7f2ab0854640 1 -- 172.21.15.1:0/3989127249 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f2aac062630 con 0x7f2a980a3300 2024-09-19T09:37:40.601 INFO:teuthology.orchestra.run.smithi001.stdout:Backend: cephadm 2024-09-19T09:37:40.601 INFO:teuthology.orchestra.run.smithi001.stdout:Available: Yes 2024-09-19T09:37:40.601 INFO:teuthology.orchestra.run.smithi001.stdout:Paused: No 2024-09-19T09:37:40.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.600+0000 7f2ab1856640 1 -- 172.21.15.1:0/3989127249 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f2a980a3300 msgr2=0x7f2a980a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:40.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.600+0000 7f2ab1856640 1 --2- 172.21.15.1:0/3989127249 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f2a980a3300 0x7f2a980a57c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c000c00 tx=0x7f2a9c031400 comp rx=0 tx=0).stop 2024-09-19T09:37:40.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.600+0000 7f2ab1856640 1 -- 172.21.15.1:0/3989127249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2aac102e00 msgr2=0x7f2aac198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:40.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.600+0000 7f2ab1856640 1 --2- 172.21.15.1:0/3989127249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2aac102e00 0x7f2aac198460 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2a9400d950 tx=0x7f2a9400de10 comp rx=0 tx=0).stop 2024-09-19T09:37:40.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.600+0000 7f2ab1856640 1 -- 172.21.15.1:0/3989127249 shutdown_connections 2024-09-19T09:37:40.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.600+0000 7f2ab1856640 1 --2- 172.21.15.1:0/3989127249 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f2a980a3300 0x7f2a980a57c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:40.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.600+0000 7f2ab1856640 1 --2- 172.21.15.1:0/3989127249 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2aac1037c0 0x7f2aac19f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:40.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.600+0000 7f2ab1856640 1 --2- 172.21.15.1:0/3989127249 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2aac102e00 0x7f2aac198460 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:40.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.600+0000 7f2ab1856640 1 --2- 172.21.15.1:0/3989127249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2aac101c00 0x7f2aac197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:40.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.600+0000 7f2ab1856640 1 -- 172.21.15.1:0/3989127249 >> 172.21.15.1:0/3989127249 conn(0x7f2aac0fd390 msgr2=0x7f2aac106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:40.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.601+0000 7f2ab1856640 1 -- 172.21.15.1:0/3989127249 shutdown_connections 2024-09-19T09:37:40.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:40.601+0000 7f2ab1856640 1 -- 172.21.15.1:0/3989127249 wait complete. 2024-09-19T09:37:41.245 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-19T09:37:41.501 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:41.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.959+0000 7fbe3ab0e640 1 -- 172.21.15.1:0/2555242983 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe34100b10 msgr2=0x7fbe34100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:41.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.959+0000 7fbe3ab0e640 1 --2- 172.21.15.1:0/2555242983 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe34100b10 0x7fbe34100f10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbe28009900 tx=0x7fbe2802a410 comp rx=0 tx=0).stop 2024-09-19T09:37:41.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.959+0000 7fbe3ab0e640 1 -- 172.21.15.1:0/2555242983 shutdown_connections 2024-09-19T09:37:41.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.959+0000 7fbe3ab0e640 1 --2- 172.21.15.1:0/2555242983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe341026d0 0x7fbe34108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:41.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.959+0000 7fbe3ab0e640 1 --2- 172.21.15.1:0/2555242983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe34101d10 0x7fbe34102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:41.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.959+0000 7fbe3ab0e640 1 --2- 172.21.15.1:0/2555242983 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe34100b10 0x7fbe34100f10 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:41.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.959+0000 7fbe3ab0e640 1 -- 172.21.15.1:0/2555242983 >> 172.21.15.1:0/2555242983 conn(0x7fbe340fc2a0 msgr2=0x7fbe340fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:41.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.959+0000 7fbe3ab0e640 1 -- 172.21.15.1:0/2555242983 shutdown_connections 2024-09-19T09:37:41.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.959+0000 7fbe3ab0e640 1 -- 172.21.15.1:0/2555242983 wait complete. 2024-09-19T09:37:41.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.959+0000 7fbe3ab0e640 1 Processor -- start 2024-09-19T09:37:41.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.959+0000 7fbe3ab0e640 1 -- start start 2024-09-19T09:37:41.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.959+0000 7fbe3ab0e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe34100b10 0x7fbe34198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:41.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.959+0000 7fbe3ab0e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe34101d10 0x7fbe341985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:41.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.959+0000 7fbe3ab0e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe341026d0 0x7fbe3419f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:41.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.959+0000 7fbe3ab0e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbe3410c870 con 0x7fbe341026d0 2024-09-19T09:37:41.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.960+0000 7fbe3ab0e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbe3410c6f0 con 0x7fbe34101d10 2024-09-19T09:37:41.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.960+0000 7fbe3ab0e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbe3410c9f0 con 0x7fbe34100b10 2024-09-19T09:37:41.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.960+0000 7fbe390ab640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe341026d0 0x7fbe3419f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:41.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.960+0000 7fbe390ab640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe341026d0 0x7fbe3419f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35418/0 (socket says 172.21.15.1:35418) 2024-09-19T09:37:41.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.960+0000 7fbe390ab640 1 -- 172.21.15.1:0/3807782838 learned_addr learned my addr 172.21.15.1:0/3807782838 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:41.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.960+0000 7fbe388aa640 1 --2- 172.21.15.1:0/3807782838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe34100b10 0x7fbe34198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:41.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.960+0000 7fbe33fff640 1 --2- 172.21.15.1:0/3807782838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe34101d10 0x7fbe341985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:41.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.960+0000 7fbe390ab640 1 -- 172.21.15.1:0/3807782838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe34100b10 msgr2=0x7fbe34198070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:41.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.960+0000 7fbe390ab640 1 --2- 172.21.15.1:0/3807782838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe34100b10 0x7fbe34198070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:41.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.960+0000 7fbe390ab640 1 -- 172.21.15.1:0/3807782838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe34101d10 msgr2=0x7fbe341985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:41.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.960+0000 7fbe390ab640 1 --2- 172.21.15.1:0/3807782838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe34101d10 0x7fbe341985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:41.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.960+0000 7fbe390ab640 1 -- 172.21.15.1:0/3807782838 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe3419fca0 con 0x7fbe341026d0 2024-09-19T09:37:41.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.960+0000 7fbe33fff640 1 --2- 172.21.15.1:0/3807782838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe34101d10 0x7fbe341985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:41.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.960+0000 7fbe390ab640 1 --2- 172.21.15.1:0/3807782838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe341026d0 0x7fbe3419f630 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c00b970 tx=0x7fbe2c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:41.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.960+0000 7fbe31ffb640 1 -- 172.21.15.1:0/3807782838 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c019070 con 0x7fbe341026d0 2024-09-19T09:37:41.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.960+0000 7fbe3ab0e640 1 -- 172.21.15.1:0/3807782838 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe3419ff90 con 0x7fbe341026d0 2024-09-19T09:37:41.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.960+0000 7fbe31ffb640 1 -- 172.21.15.1:0/3807782838 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe2c00cb40 con 0x7fbe341026d0 2024-09-19T09:37:41.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.960+0000 7fbe31ffb640 1 -- 172.21.15.1:0/3807782838 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c007650 con 0x7fbe341026d0 2024-09-19T09:37:41.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.960+0000 7fbe3ab0e640 1 -- 172.21.15.1:0/3807782838 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe341a04c0 con 0x7fbe341026d0 2024-09-19T09:37:41.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.961+0000 7fbe3ab0e640 1 -- 172.21.15.1:0/3807782838 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe34108af0 con 0x7fbe341026d0 2024-09-19T09:37:41.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.962+0000 7fbe31ffb640 1 -- 172.21.15.1:0/3807782838 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7fbe2c01c070 con 0x7fbe341026d0 2024-09-19T09:37:41.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.963+0000 7fbe31ffb640 1 --2- 172.21.15.1:0/3807782838 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbe240a3300 0x7fbe240a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:41.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.964+0000 7fbe388aa640 1 --2- 172.21.15.1:0/3807782838 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbe240a3300 0x7fbe240a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:41.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.964+0000 7fbe31ffb640 1 -- 172.21.15.1:0/3807782838 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fbe2c0cefd0 con 0x7fbe341026d0 2024-09-19T09:37:41.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.964+0000 7fbe388aa640 1 --2- 172.21.15.1:0/3807782838 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbe240a3300 0x7fbe240a57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbe28031610 tx=0x7fbe28000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:41.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:41.968+0000 7fbe31ffb640 1 -- 172.21.15.1:0/3807782838 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbe2c09bc60 con 0x7fbe341026d0 2024-09-19T09:37:42.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:42.152+0000 7fbe3ab0e640 1 -- 172.21.15.1:0/3807782838 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fbe34062630 con 0x7fbe240a3300 2024-09-19T09:37:42.155 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:42 smithi001 ceph-mon[31225]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:42.156 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:42 smithi001 ceph-mon[31225]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:42.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:42.165+0000 7fbe31ffb640 1 -- 172.21.15.1:0/3807782838 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7fbe34062630 con 0x7fbe240a3300 2024-09-19T09:37:42.167 INFO:teuthology.orchestra.run.smithi001.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T09:37:42.167 INFO:teuthology.orchestra.run.smithi001.stdout:mds.a smithi001 running (102s) 25s ago 101s 14.3M - 19.1.1-361-g2f599a46 d2baa855c067 1c9036e8984a 2024-09-19T09:37:42.168 INFO:teuthology.orchestra.run.smithi001.stdout:mds.b smithi022 running (99s) 32s ago 98s 26.1M - 19.1.1-361-g2f599a46 d2baa855c067 3f7d58492c6e 2024-09-19T09:37:42.168 INFO:teuthology.orchestra.run.smithi001.stdout:mds.c smithi121 running (113s) 32s ago 113s 14.0M - 19.1.1-361-g2f599a46 d2baa855c067 1a89475d9e5c 2024-09-19T09:37:42.168 INFO:teuthology.orchestra.run.smithi001.stdout:mds.d smithi001 running (2m) 25s ago 2m 16.4M - 19.1.1-361-g2f599a46 d2baa855c067 5e8d87397b2c 2024-09-19T09:37:42.168 INFO:teuthology.orchestra.run.smithi001.stdout:mds.e smithi022 running (118s) 32s ago 118s 13.6M - 19.1.1-361-g2f599a46 d2baa855c067 e4de37a7b3cb 2024-09-19T09:37:42.168 INFO:teuthology.orchestra.run.smithi001.stdout:mds.f smithi121 running (116s) 32s ago 115s 13.5M - 19.1.1-361-g2f599a46 d2baa855c067 7f23f6a767fb 2024-09-19T09:37:42.168 INFO:teuthology.orchestra.run.smithi001.stdout:mds.g smithi001 running (105s) 25s ago 105s 15.7M - 19.1.1-361-g2f599a46 d2baa855c067 14008ea33ca1 2024-09-19T09:37:42.168 INFO:teuthology.orchestra.run.smithi001.stdout:mds.h smithi022 running (111s) 32s ago 110s 14.3M - 19.1.1-361-g2f599a46 d2baa855c067 8d4f635f858e 2024-09-19T09:37:42.168 INFO:teuthology.orchestra.run.smithi001.stdout:mds.i smithi121 running (108s) 32s ago 108s 18.0M - 19.1.1-361-g2f599a46 d2baa855c067 c569610bce6a 2024-09-19T09:37:42.168 INFO:teuthology.orchestra.run.smithi001.stdout:mds.j smithi001 running (2m) 25s ago 2m 17.0M - 19.1.1-361-g2f599a46 d2baa855c067 5b9ead5d5375 2024-09-19T09:37:42.168 INFO:teuthology.orchestra.run.smithi001.stdout:mds.k smithi022 running (2m) 32s ago 2m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 7e839c0b40c0 2024-09-19T09:37:42.168 INFO:teuthology.orchestra.run.smithi001.stdout:mds.l smithi121 running (2m) 32s ago 2m 14.5M - 19.1.1-361-g2f599a46 d2baa855c067 77f3a4df8fad 2024-09-19T09:37:42.169 INFO:teuthology.orchestra.run.smithi001.stdout:mgr.x smithi001 *:9283,8765 running (9m) 25s ago 9m 508M - 19.1.1-361-g2f599a46 d2baa855c067 e056032c4e14 2024-09-19T09:37:42.169 INFO:teuthology.orchestra.run.smithi001.stdout:mgr.y smithi022 *:8443,8765 running (7m) 32s ago 7m 442M - 19.1.1-361-g2f599a46 d2baa855c067 370f98ebcb09 2024-09-19T09:37:42.169 INFO:teuthology.orchestra.run.smithi001.stdout:mgr.z smithi121 *:8443,8765 running (7m) 32s ago 7m 444M - 19.1.1-361-g2f599a46 d2baa855c067 6c24a9ea2d76 2024-09-19T09:37:42.169 INFO:teuthology.orchestra.run.smithi001.stdout:mon.a smithi001 running (9m) 25s ago 9m 49.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 d867c9163aff 2024-09-19T09:37:42.169 INFO:teuthology.orchestra.run.smithi001.stdout:mon.b smithi022 running (7m) 32s ago 7m 39.0M 2048M 19.1.1-361-g2f599a46 d2baa855c067 26853768412d 2024-09-19T09:37:42.169 INFO:teuthology.orchestra.run.smithi001.stdout:mon.c smithi121 running (7m) 32s ago 7m 38.7M 2048M 19.1.1-361-g2f599a46 d2baa855c067 30f334dd4683 2024-09-19T09:37:42.169 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0 smithi001 running (7m) 25s ago 7m 57.6M 4273M 19.1.1-361-g2f599a46 d2baa855c067 a1a5dae90caa 2024-09-19T09:37:42.169 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1 smithi022 running (6m) 32s ago 6m 55.7M 4273M 19.1.1-361-g2f599a46 d2baa855c067 d3ae10d59bdd 2024-09-19T09:37:42.169 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2 smithi121 running (6m) 32s ago 6m 55.9M 4271M 19.1.1-361-g2f599a46 d2baa855c067 4abedf36e015 2024-09-19T09:37:42.169 INFO:teuthology.orchestra.run.smithi001.stdout:osd.3 smithi001 running (5m) 25s ago 5m 55.1M 4273M 19.1.1-361-g2f599a46 d2baa855c067 2fa8035e86ca 2024-09-19T09:37:42.169 INFO:teuthology.orchestra.run.smithi001.stdout:osd.4 smithi022 running (5m) 32s ago 5m 55.4M 4273M 19.1.1-361-g2f599a46 d2baa855c067 861916e76af8 2024-09-19T09:37:42.169 INFO:teuthology.orchestra.run.smithi001.stdout:osd.5 smithi121 running (5m) 32s ago 5m 53.5M 4271M 19.1.1-361-g2f599a46 d2baa855c067 7ce7275b0656 2024-09-19T09:37:42.170 INFO:teuthology.orchestra.run.smithi001.stdout:osd.6 smithi001 running (4m) 25s ago 4m 54.0M 4273M 19.1.1-361-g2f599a46 d2baa855c067 49b66c8210fc 2024-09-19T09:37:42.170 INFO:teuthology.orchestra.run.smithi001.stdout:osd.7 smithi022 running (4m) 32s ago 4m 44.3M 4273M 19.1.1-361-g2f599a46 d2baa855c067 28f7760e5600 2024-09-19T09:37:42.170 INFO:teuthology.orchestra.run.smithi001.stdout:osd.8 smithi121 running (3m) 32s ago 3m 43.0M 4271M 19.1.1-361-g2f599a46 d2baa855c067 c34c15a25623 2024-09-19T09:37:42.170 INFO:teuthology.orchestra.run.smithi001.stdout:osd.9 smithi001 running (3m) 25s ago 3m 51.4M 4273M 19.1.1-361-g2f599a46 d2baa855c067 268d93359449 2024-09-19T09:37:42.170 INFO:teuthology.orchestra.run.smithi001.stdout:osd.10 smithi022 running (2m) 32s ago 2m 56.5M 4273M 19.1.1-361-g2f599a46 d2baa855c067 10bcd9485144 2024-09-19T09:37:42.170 INFO:teuthology.orchestra.run.smithi001.stdout:osd.11 smithi121 running (2m) 32s ago 2m 49.8M 4271M 19.1.1-361-g2f599a46 d2baa855c067 a3eb8d92236b 2024-09-19T09:37:42.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:42.167+0000 7fbe3ab0e640 1 -- 172.21.15.1:0/3807782838 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbe240a3300 msgr2=0x7fbe240a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:42.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:42.167+0000 7fbe3ab0e640 1 --2- 172.21.15.1:0/3807782838 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbe240a3300 0x7fbe240a57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbe28031610 tx=0x7fbe28000bc0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:42.167+0000 7fbe3ab0e640 1 -- 172.21.15.1:0/3807782838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe341026d0 msgr2=0x7fbe3419f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:42.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:42.167+0000 7fbe3ab0e640 1 --2- 172.21.15.1:0/3807782838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe341026d0 0x7fbe3419f630 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c00b970 tx=0x7fbe2c00be30 comp rx=0 tx=0).stop 2024-09-19T09:37:42.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:42.167+0000 7fbe3ab0e640 1 -- 172.21.15.1:0/3807782838 shutdown_connections 2024-09-19T09:37:42.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:42.167+0000 7fbe3ab0e640 1 --2- 172.21.15.1:0/3807782838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbe341026d0 0x7fbe3419f630 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:42.167+0000 7fbe3ab0e640 1 --2- 172.21.15.1:0/3807782838 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbe240a3300 0x7fbe240a57c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:42.167+0000 7fbe3ab0e640 1 --2- 172.21.15.1:0/3807782838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe34101d10 0x7fbe341985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:42.167+0000 7fbe3ab0e640 1 --2- 172.21.15.1:0/3807782838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe34100b10 0x7fbe34198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:42.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:42.167+0000 7fbe3ab0e640 1 -- 172.21.15.1:0/3807782838 >> 172.21.15.1:0/3807782838 conn(0x7fbe340fc2a0 msgr2=0x7fbe340fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:42.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:42.167+0000 7fbe3ab0e640 1 -- 172.21.15.1:0/3807782838 shutdown_connections 2024-09-19T09:37:42.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:42.167+0000 7fbe3ab0e640 1 -- 172.21.15.1:0/3807782838 wait complete. 2024-09-19T09:37:42.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:42 smithi022 ceph-mon[35583]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:42.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:42 smithi022 ceph-mon[35583]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:42.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:42 smithi121 ceph-mon[35577]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:42.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:42 smithi121 ceph-mon[35577]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:42.966 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-19T09:37:43.224 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:43.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.684+0000 7f3955bc7640 1 -- 172.21.15.1:0/3194434530 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3950107900 msgr2=0x7f3950109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:43.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.684+0000 7f3955bc7640 1 --2- 172.21.15.1:0/3194434530 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3950107900 0x7f3950109d50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3948009ca0 tx=0x7f394802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:37:43.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.684+0000 7f3955bc7640 1 -- 172.21.15.1:0/3194434530 shutdown_connections 2024-09-19T09:37:43.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.684+0000 7f3955bc7640 1 --2- 172.21.15.1:0/3194434530 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3950107900 0x7f3950109d50 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:43.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.684+0000 7f3955bc7640 1 --2- 172.21.15.1:0/3194434530 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3950104fd0 0x7f39501073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:43.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.684+0000 7f3955bc7640 1 --2- 172.21.15.1:0/3194434530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39501026a0 0x7f3950104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:43.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.684+0000 7f3955bc7640 1 -- 172.21.15.1:0/3194434530 >> 172.21.15.1:0/3194434530 conn(0x7f39500fc2a0 msgr2=0x7f39500fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:43.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.684+0000 7f3955bc7640 1 -- 172.21.15.1:0/3194434530 shutdown_connections 2024-09-19T09:37:43.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.684+0000 7f3955bc7640 1 -- 172.21.15.1:0/3194434530 wait complete. 2024-09-19T09:37:43.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.685+0000 7f3955bc7640 1 Processor -- start 2024-09-19T09:37:43.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.685+0000 7f3955bc7640 1 -- start start 2024-09-19T09:37:43.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.685+0000 7f3955bc7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f39501026a0 0x7f3950197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:43.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.685+0000 7f3955bc7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3950104fd0 0x7f3950198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:43.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.685+0000 7f3955bc7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3950107900 0x7f395019f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:43.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.685+0000 7f3955bc7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f395010d8c0 con 0x7f3950104fd0 2024-09-19T09:37:43.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.685+0000 7f3955bc7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f395010d740 con 0x7f3950107900 2024-09-19T09:37:43.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.685+0000 7f3955bc7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f395010da40 con 0x7f39501026a0 2024-09-19T09:37:43.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.686+0000 7f394effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3950104fd0 0x7f3950198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:43.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.686+0000 7f394effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3950104fd0 0x7f3950198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:35440/0 (socket says 172.21.15.1:35440) 2024-09-19T09:37:43.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.686+0000 7f394effd640 1 -- 172.21.15.1:0/390636691 learned_addr learned my addr 172.21.15.1:0/390636691 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:43.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.686+0000 7f394f7fe640 1 --2- 172.21.15.1:0/390636691 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f39501026a0 0x7f3950197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:43.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.686+0000 7f394ffff640 1 --2- 172.21.15.1:0/390636691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3950107900 0x7f395019f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:43.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.686+0000 7f394effd640 1 -- 172.21.15.1:0/390636691 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f39501026a0 msgr2=0x7f3950197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:43.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.686+0000 7f394effd640 1 --2- 172.21.15.1:0/390636691 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f39501026a0 0x7f3950197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:43.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.686+0000 7f394effd640 1 -- 172.21.15.1:0/390636691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3950107900 msgr2=0x7f395019f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:43.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.686+0000 7f394effd640 1 --2- 172.21.15.1:0/390636691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3950107900 0x7f395019f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:43.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.686+0000 7f394effd640 1 -- 172.21.15.1:0/390636691 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f395019fb20 con 0x7f3950104fd0 2024-09-19T09:37:43.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.686+0000 7f394ffff640 1 --2- 172.21.15.1:0/390636691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3950107900 0x7f395019f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:43.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.686+0000 7f394effd640 1 --2- 172.21.15.1:0/390636691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3950104fd0 0x7f3950198430 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f394400d740 tx=0x7f394400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:43.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.686+0000 7f394cff9640 1 -- 172.21.15.1:0/390636691 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3944017070 con 0x7f3950104fd0 2024-09-19T09:37:43.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.686+0000 7f394cff9640 1 -- 172.21.15.1:0/390636691 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f394400de50 con 0x7f3950104fd0 2024-09-19T09:37:43.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.686+0000 7f3955bc7640 1 -- 172.21.15.1:0/390636691 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f395019fe10 con 0x7f3950104fd0 2024-09-19T09:37:43.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.686+0000 7f394cff9640 1 -- 172.21.15.1:0/390636691 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3944004e00 con 0x7f3950104fd0 2024-09-19T09:37:43.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.686+0000 7f3955bc7640 1 -- 172.21.15.1:0/390636691 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39501a02c0 con 0x7f3950104fd0 2024-09-19T09:37:43.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.687+0000 7f3955bc7640 1 -- 172.21.15.1:0/390636691 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39500fdd90 con 0x7f3950104fd0 2024-09-19T09:37:43.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.688+0000 7f394cff9640 1 -- 172.21.15.1:0/390636691 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 17) ==== 138405+0+0 (secure 0 0 0) 0x7f3944004fa0 con 0x7f3950104fd0 2024-09-19T09:37:43.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.689+0000 7f394cff9640 1 --2- 172.21.15.1:0/390636691 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f39380a3380 0x7f39380a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:43.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.689+0000 7f394f7fe640 1 --2- 172.21.15.1:0/390636691 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f39380a3380 0x7f39380a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:43.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.689+0000 7f394cff9640 1 -- 172.21.15.1:0/390636691 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f39440cf2f0 con 0x7f3950104fd0 2024-09-19T09:37:43.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.690+0000 7f394f7fe640 1 --2- 172.21.15.1:0/390636691 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f39380a3380 0x7f39380a5840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3940005d00 tx=0x7f394000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:43.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.693+0000 7f394cff9640 1 -- 172.21.15.1:0/390636691 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f394409beb0 con 0x7f3950104fd0 2024-09-19T09:37:43.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.875+0000 7f3955bc7640 1 -- 172.21.15.1:0/390636691 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f3950062630 con 0x7f39380a3380 2024-09-19T09:37:43.883 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.881+0000 7f394cff9640 1 -- 172.21.15.1:0/390636691 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f3950062630 con 0x7f39380a3380 2024-09-19T09:37:43.883 INFO:teuthology.orchestra.run.smithi001.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-19T09:37:43.884 INFO:teuthology.orchestra.run.smithi001.stdout:mds.all 12/12 34s ago 2m smithi001=a;smithi001=d;smithi001=g;smithi001=j;smithi022=b;smithi022=e;smithi022=h;smithi022=k;smithi121=c;smithi121=f;smithi121=i;smithi121=l;count:12 2024-09-19T09:37:43.884 INFO:teuthology.orchestra.run.smithi001.stdout:mgr 3/3 34s ago 7m smithi001=x;smithi022=y;smithi121=z;count:3 2024-09-19T09:37:43.884 INFO:teuthology.orchestra.run.smithi001.stdout:mon 3/3 34s ago 8m smithi001:172.21.15.1=a;smithi022:172.21.15.22=b;smithi121:172.21.15.121=c;count:3 2024-09-19T09:37:43.884 INFO:teuthology.orchestra.run.smithi001.stdout:osd 12 34s ago - 2024-09-19T09:37:43.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.883+0000 7f3955bc7640 1 -- 172.21.15.1:0/390636691 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f39380a3380 msgr2=0x7f39380a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:43.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.883+0000 7f3955bc7640 1 --2- 172.21.15.1:0/390636691 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f39380a3380 0x7f39380a5840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3940005d00 tx=0x7f394000b410 comp rx=0 tx=0).stop 2024-09-19T09:37:43.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.883+0000 7f3955bc7640 1 -- 172.21.15.1:0/390636691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3950104fd0 msgr2=0x7f3950198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:43.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.883+0000 7f3955bc7640 1 --2- 172.21.15.1:0/390636691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3950104fd0 0x7f3950198430 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f394400d740 tx=0x7f394400dc00 comp rx=0 tx=0).stop 2024-09-19T09:37:43.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.883+0000 7f3955bc7640 1 -- 172.21.15.1:0/390636691 shutdown_connections 2024-09-19T09:37:43.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.883+0000 7f3955bc7640 1 --2- 172.21.15.1:0/390636691 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f39380a3380 0x7f39380a5840 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:43.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.883+0000 7f3955bc7640 1 --2- 172.21.15.1:0/390636691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3950107900 0x7f395019f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:43.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.883+0000 7f3955bc7640 1 --2- 172.21.15.1:0/390636691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3950104fd0 0x7f3950198430 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:43.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.883+0000 7f3955bc7640 1 --2- 172.21.15.1:0/390636691 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f39501026a0 0x7f3950197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:43.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.883+0000 7f3955bc7640 1 -- 172.21.15.1:0/390636691 >> 172.21.15.1:0/390636691 conn(0x7f39500fc2a0 msgr2=0x7f3950102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:43.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.883+0000 7f3955bc7640 1 -- 172.21.15.1:0/390636691 shutdown_connections 2024-09-19T09:37:43.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:43.883+0000 7f3955bc7640 1 -- 172.21.15.1:0/390636691 wait complete. 2024-09-19T09:37:44.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:44 smithi001 ceph-mon[31225]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:44.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:44 smithi001 ceph-mon[31225]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:44.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:44 smithi022 ceph-mon[35583]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:44.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:44 smithi022 ceph-mon[35583]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:44.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:44 smithi121 ceph-mon[35577]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:37:44.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:44 smithi121 ceph-mon[35577]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:44.716 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-19T09:37:44.972 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:45.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:45 smithi022 ceph-mon[35583]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:45.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:45 smithi121 ceph-mon[35577]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:45.414 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:45 smithi001 ceph-mon[31225]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:45.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.412+0000 7fd158c6d640 1 -- 172.21.15.1:0/3381105871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd154102690 msgr2=0x7fd154108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:45.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.412+0000 7fd158c6d640 1 --2- 172.21.15.1:0/3381105871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd154102690 0x7fd154108f20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd14c009900 tx=0x7fd14c02a410 comp rx=0 tx=0).stop 2024-09-19T09:37:45.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.412+0000 7fd158c6d640 1 -- 172.21.15.1:0/3381105871 shutdown_connections 2024-09-19T09:37:45.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.412+0000 7fd158c6d640 1 --2- 172.21.15.1:0/3381105871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd154102690 0x7fd154108f20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.412+0000 7fd158c6d640 1 --2- 172.21.15.1:0/3381105871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd154101cd0 0x7fd154102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.412+0000 7fd158c6d640 1 --2- 172.21.15.1:0/3381105871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd154100ad0 0x7fd154100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.412+0000 7fd158c6d640 1 -- 172.21.15.1:0/3381105871 >> 172.21.15.1:0/3381105871 conn(0x7fd1540fc280 msgr2=0x7fd1540fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:45.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.412+0000 7fd158c6d640 1 -- 172.21.15.1:0/3381105871 shutdown_connections 2024-09-19T09:37:45.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.412+0000 7fd158c6d640 1 -- 172.21.15.1:0/3381105871 wait complete. 2024-09-19T09:37:45.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.413+0000 7fd158c6d640 1 Processor -- start 2024-09-19T09:37:45.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.413+0000 7fd158c6d640 1 -- start start 2024-09-19T09:37:45.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.413+0000 7fd158c6d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd154100ad0 0x7fd15406aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:45.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.413+0000 7fd158c6d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd154101cd0 0x7fd15419cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:45.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.413+0000 7fd158c6d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd154102690 0x7fd15419f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:45.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.413+0000 7fd158c6d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd15410c730 con 0x7fd154101cd0 2024-09-19T09:37:45.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.413+0000 7fd158c6d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd15410c5b0 con 0x7fd154100ad0 2024-09-19T09:37:45.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.413+0000 7fd158c6d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd15410c8b0 con 0x7fd154102690 2024-09-19T09:37:45.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.413+0000 7fd151d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd154101cd0 0x7fd15419cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:45.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.413+0000 7fd151d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd154101cd0 0x7fd15419cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39222/0 (socket says 172.21.15.1:39222) 2024-09-19T09:37:45.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.413+0000 7fd151d9b640 1 -- 172.21.15.1:0/3170588315 learned_addr learned my addr 172.21.15.1:0/3170588315 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:45.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.413+0000 7fd152d9d640 1 --2- 172.21.15.1:0/3170588315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd154102690 0x7fd15419f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:45.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.413+0000 7fd15259c640 1 --2- 172.21.15.1:0/3170588315 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd154100ad0 0x7fd15406aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:45.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.413+0000 7fd151d9b640 1 -- 172.21.15.1:0/3170588315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd154102690 msgr2=0x7fd15419f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:45.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.413+0000 7fd151d9b640 1 --2- 172.21.15.1:0/3170588315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd154102690 0x7fd15419f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.413+0000 7fd151d9b640 1 -- 172.21.15.1:0/3170588315 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd154100ad0 msgr2=0x7fd15406aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:45.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.413+0000 7fd151d9b640 1 --2- 172.21.15.1:0/3170588315 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd154100ad0 0x7fd15406aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.413+0000 7fd151d9b640 1 -- 172.21.15.1:0/3170588315 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd15419fb10 con 0x7fd154101cd0 2024-09-19T09:37:45.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.413+0000 7fd15259c640 1 --2- 172.21.15.1:0/3170588315 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd154100ad0 0x7fd15406aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:45.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.414+0000 7fd151d9b640 1 --2- 172.21.15.1:0/3170588315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd154101cd0 0x7fd15419cbe0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd14800eab0 tx=0x7fd14800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:45.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.414+0000 7fd1437fe640 1 -- 172.21.15.1:0/3170588315 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14800ce40 con 0x7fd154101cd0 2024-09-19T09:37:45.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.414+0000 7fd158c6d640 1 -- 172.21.15.1:0/3170588315 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd15419fda0 con 0x7fd154101cd0 2024-09-19T09:37:45.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.414+0000 7fd1437fe640 1 -- 172.21.15.1:0/3170588315 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd148011950 con 0x7fd154101cd0 2024-09-19T09:37:45.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.414+0000 7fd1437fe640 1 -- 172.21.15.1:0/3170588315 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd148010ae0 con 0x7fd154101cd0 2024-09-19T09:37:45.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.414+0000 7fd158c6d640 1 -- 172.21.15.1:0/3170588315 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1541a0260 con 0x7fd154101cd0 2024-09-19T09:37:45.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.415+0000 7fd158c6d640 1 -- 172.21.15.1:0/3170588315 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd154107ef0 con 0x7fd154101cd0 2024-09-19T09:37:45.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.416+0000 7fd1437fe640 1 -- 172.21.15.1:0/3170588315 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fd148011b00 con 0x7fd154101cd0 2024-09-19T09:37:45.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.416+0000 7fd1437fe640 1 --2- 172.21.15.1:0/3170588315 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd13c0a3240 0x7fd13c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:45.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.417+0000 7fd15259c640 1 --2- 172.21.15.1:0/3170588315 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd13c0a3240 0x7fd13c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:45.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.417+0000 7fd1437fe640 1 -- 172.21.15.1:0/3170588315 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fd1480d0020 con 0x7fd154101cd0 2024-09-19T09:37:45.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.417+0000 7fd15259c640 1 --2- 172.21.15.1:0/3170588315 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd13c0a3240 0x7fd13c0a5700 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd154101b30 tx=0x7fd144005e70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:45.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.421+0000 7fd1437fe640 1 -- 172.21.15.1:0/3170588315 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd148016030 con 0x7fd154101cd0 2024-09-19T09:37:45.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.603+0000 7fd158c6d640 1 -- 172.21.15.1:0/3170588315 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fd154062630 con 0x7fd13c0a3240 2024-09-19T09:37:45.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.604+0000 7fd1437fe640 1 -- 172.21.15.1:0/3170588315 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fd154062630 con 0x7fd13c0a3240 2024-09-19T09:37:45.607 INFO:teuthology.orchestra.run.smithi001.stdout:HOST ADDR LABELS STATUS 2024-09-19T09:37:45.607 INFO:teuthology.orchestra.run.smithi001.stdout:smithi001 172.21.15.1 2024-09-19T09:37:45.607 INFO:teuthology.orchestra.run.smithi001.stdout:smithi022 172.21.15.22 2024-09-19T09:37:45.607 INFO:teuthology.orchestra.run.smithi001.stdout:smithi121 172.21.15.121 2024-09-19T09:37:45.607 INFO:teuthology.orchestra.run.smithi001.stdout:3 hosts in cluster 2024-09-19T09:37:45.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.606+0000 7fd158c6d640 1 -- 172.21.15.1:0/3170588315 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd13c0a3240 msgr2=0x7fd13c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:45.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.606+0000 7fd158c6d640 1 --2- 172.21.15.1:0/3170588315 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd13c0a3240 0x7fd13c0a5700 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd154101b30 tx=0x7fd144005e70 comp rx=0 tx=0).stop 2024-09-19T09:37:45.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.606+0000 7fd158c6d640 1 -- 172.21.15.1:0/3170588315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd154101cd0 msgr2=0x7fd15419cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:45.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.606+0000 7fd158c6d640 1 --2- 172.21.15.1:0/3170588315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd154101cd0 0x7fd15419cbe0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd14800eab0 tx=0x7fd14800ef70 comp rx=0 tx=0).stop 2024-09-19T09:37:45.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.607+0000 7fd158c6d640 1 -- 172.21.15.1:0/3170588315 shutdown_connections 2024-09-19T09:37:45.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.607+0000 7fd158c6d640 1 --2- 172.21.15.1:0/3170588315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd154102690 0x7fd15419f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.607+0000 7fd158c6d640 1 --2- 172.21.15.1:0/3170588315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd154101cd0 0x7fd15419cbe0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.607+0000 7fd158c6d640 1 --2- 172.21.15.1:0/3170588315 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd13c0a3240 0x7fd13c0a5700 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.607+0000 7fd158c6d640 1 --2- 172.21.15.1:0/3170588315 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd154100ad0 0x7fd15406aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:45.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.607+0000 7fd158c6d640 1 -- 172.21.15.1:0/3170588315 >> 172.21.15.1:0/3170588315 conn(0x7fd1540fc280 msgr2=0x7fd1541050c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:45.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.607+0000 7fd158c6d640 1 -- 172.21.15.1:0/3170588315 shutdown_connections 2024-09-19T09:37:45.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:45.607+0000 7fd158c6d640 1 -- 172.21.15.1:0/3170588315 wait complete. 2024-09-19T09:37:46.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:46 smithi001 ceph-mon[31225]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:46.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:46 smithi001 ceph-mon[31225]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T09:37:46.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:46 smithi022 ceph-mon[35583]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:46.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:46 smithi022 ceph-mon[35583]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T09:37:46.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:46 smithi121 ceph-mon[35577]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:37:46.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:46 smithi121 ceph-mon[35577]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T09:37:46.427 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-19T09:37:46.684 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:47.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.205+0000 7f4363fc2640 1 -- 172.21.15.1:0/429503927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f435c100ad0 msgr2=0x7f435c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:47.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.205+0000 7f4363fc2640 1 --2- 172.21.15.1:0/429503927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f435c100ad0 0x7f435c100ed0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4358009900 tx=0x7f435802a410 comp rx=0 tx=0).stop 2024-09-19T09:37:47.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.205+0000 7f4363fc2640 1 -- 172.21.15.1:0/429503927 shutdown_connections 2024-09-19T09:37:47.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.205+0000 7f4363fc2640 1 --2- 172.21.15.1:0/429503927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f435c102690 0x7f435c108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.205+0000 7f4363fc2640 1 --2- 172.21.15.1:0/429503927 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f435c101cd0 0x7f435c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.205+0000 7f4363fc2640 1 --2- 172.21.15.1:0/429503927 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f435c100ad0 0x7f435c100ed0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.205+0000 7f4363fc2640 1 -- 172.21.15.1:0/429503927 >> 172.21.15.1:0/429503927 conn(0x7f435c0fc280 msgr2=0x7f435c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:47.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.205+0000 7f4363fc2640 1 -- 172.21.15.1:0/429503927 shutdown_connections 2024-09-19T09:37:47.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.205+0000 7f4363fc2640 1 -- 172.21.15.1:0/429503927 wait complete. 2024-09-19T09:37:47.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.205+0000 7f4363fc2640 1 Processor -- start 2024-09-19T09:37:47.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.205+0000 7f4363fc2640 1 -- start start 2024-09-19T09:37:47.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.205+0000 7f4363fc2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f435c100ad0 0x7f435c10b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.206+0000 7f4363fc2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f435c101cd0 0x7f435c109aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.206+0000 7f4363fc2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f435c102690 0x7f435c109fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.206+0000 7f4363fc2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f435c10d8c0 con 0x7f435c100ad0 2024-09-19T09:37:47.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.206+0000 7f4363fc2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f435c10d740 con 0x7f435c102690 2024-09-19T09:37:47.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.206+0000 7f4363fc2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f435c10da40 con 0x7f435c101cd0 2024-09-19T09:37:47.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.206+0000 7f4361d5e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f435c100ad0 0x7f435c10b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:47.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.206+0000 7f4361d5e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f435c100ad0 0x7f435c10b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39246/0 (socket says 172.21.15.1:39246) 2024-09-19T09:37:47.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.206+0000 7f4361d5e640 1 -- 172.21.15.1:0/2838968755 learned_addr learned my addr 172.21.15.1:0/2838968755 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:47.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.206+0000 7f436255f640 1 --2- 172.21.15.1:0/2838968755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f435c102690 0x7f435c109fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:47.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.206+0000 7f436155d640 1 --2- 172.21.15.1:0/2838968755 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f435c101cd0 0x7f435c109aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:47.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.206+0000 7f4361d5e640 1 -- 172.21.15.1:0/2838968755 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f435c101cd0 msgr2=0x7f435c109aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:47.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.206+0000 7f4361d5e640 1 --2- 172.21.15.1:0/2838968755 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f435c101cd0 0x7f435c109aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.206+0000 7f4361d5e640 1 -- 172.21.15.1:0/2838968755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f435c102690 msgr2=0x7f435c109fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:47.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.206+0000 7f4361d5e640 1 --2- 172.21.15.1:0/2838968755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f435c102690 0x7f435c109fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.206+0000 7f4361d5e640 1 -- 172.21.15.1:0/2838968755 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435c10a8a0 con 0x7f435c100ad0 2024-09-19T09:37:47.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.206+0000 7f436255f640 1 --2- 172.21.15.1:0/2838968755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f435c102690 0x7f435c109fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:37:47.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.206+0000 7f4361d5e640 1 --2- 172.21.15.1:0/2838968755 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f435c100ad0 0x7f435c10b450 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4358031610 tx=0x7f43580043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:47.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.206+0000 7f4352ffd640 1 -- 172.21.15.1:0/2838968755 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435803f030 con 0x7f435c100ad0 2024-09-19T09:37:47.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.206+0000 7f4352ffd640 1 -- 172.21.15.1:0/2838968755 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4358003ce0 con 0x7f435c100ad0 2024-09-19T09:37:47.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.206+0000 7f4363fc2640 1 -- 172.21.15.1:0/2838968755 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f435c1a20a0 con 0x7f435c100ad0 2024-09-19T09:37:47.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.206+0000 7f4352ffd640 1 -- 172.21.15.1:0/2838968755 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4358035070 con 0x7f435c100ad0 2024-09-19T09:37:47.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.206+0000 7f4363fc2640 1 -- 172.21.15.1:0/2838968755 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f435c1a25d0 con 0x7f435c100ad0 2024-09-19T09:37:47.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.207+0000 7f4363fc2640 1 -- 172.21.15.1:0/2838968755 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f435c107e70 con 0x7f435c100ad0 2024-09-19T09:37:47.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.208+0000 7f4352ffd640 1 -- 172.21.15.1:0/2838968755 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f4358042030 con 0x7f435c100ad0 2024-09-19T09:37:47.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.209+0000 7f4352ffd640 1 --2- 172.21.15.1:0/2838968755 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f43480a3240 0x7f43480a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:47.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.209+0000 7f4352ffd640 1 -- 172.21.15.1:0/2838968755 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f43580efd10 con 0x7f435c100ad0 2024-09-19T09:37:47.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.209+0000 7f436155d640 1 --2- 172.21.15.1:0/2838968755 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f43480a3240 0x7f43480a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:47.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.210+0000 7f436155d640 1 --2- 172.21.15.1:0/2838968755 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f43480a3240 0x7f43480a5700 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f435c10b1d0 tx=0x7f434c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:47.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.213+0000 7f4352ffd640 1 -- 172.21.15.1:0/2838968755 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f43580bca30 con 0x7f435c100ad0 2024-09-19T09:37:47.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:47 smithi022 ceph-mon[35583]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:47.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:47 smithi121 ceph-mon[35577]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:47.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.398+0000 7f4363fc2640 1 -- 172.21.15.1:0/2838968755 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f435c062630 con 0x7f43480a3240 2024-09-19T09:37:47.400 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:47 smithi001 ceph-mon[31225]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:47.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.400+0000 7f4352ffd640 1 -- 172.21.15.1:0/2838968755 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f435c062630 con 0x7f43480a3240 2024-09-19T09:37:47.402 INFO:teuthology.orchestra.run.smithi001.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-19T09:37:47.402 INFO:teuthology.orchestra.run.smithi001.stdout:smithi001 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513000D480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-19T09:37:47.402 INFO:teuthology.orchestra.run.smithi001.stdout:smithi022 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB747402EC480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-09-19T09:37:47.402 INFO:teuthology.orchestra.run.smithi001.stdout:smithi121 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400ZF400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T09:37:47.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.403+0000 7f4363fc2640 1 -- 172.21.15.1:0/2838968755 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f43480a3240 msgr2=0x7f43480a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:47.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.403+0000 7f4363fc2640 1 --2- 172.21.15.1:0/2838968755 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f43480a3240 0x7f43480a5700 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f435c10b1d0 tx=0x7f434c008040 comp rx=0 tx=0).stop 2024-09-19T09:37:47.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.403+0000 7f4363fc2640 1 -- 172.21.15.1:0/2838968755 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f435c100ad0 msgr2=0x7f435c10b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:47.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.403+0000 7f4363fc2640 1 --2- 172.21.15.1:0/2838968755 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f435c100ad0 0x7f435c10b450 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4358031610 tx=0x7f43580043b0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.403+0000 7f4363fc2640 1 -- 172.21.15.1:0/2838968755 shutdown_connections 2024-09-19T09:37:47.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.403+0000 7f4363fc2640 1 --2- 172.21.15.1:0/2838968755 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f43480a3240 0x7f43480a5700 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.403+0000 7f4363fc2640 1 --2- 172.21.15.1:0/2838968755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f435c102690 0x7f435c109fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.403+0000 7f4363fc2640 1 --2- 172.21.15.1:0/2838968755 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f435c101cd0 0x7f435c109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.403+0000 7f4363fc2640 1 --2- 172.21.15.1:0/2838968755 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f435c100ad0 0x7f435c10b450 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:47.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.403+0000 7f4363fc2640 1 -- 172.21.15.1:0/2838968755 >> 172.21.15.1:0/2838968755 conn(0x7f435c0fc280 msgr2=0x7f435c105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:47.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.403+0000 7f4363fc2640 1 -- 172.21.15.1:0/2838968755 shutdown_connections 2024-09-19T09:37:47.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:47.403+0000 7f4363fc2640 1 -- 172.21.15.1:0/2838968755 wait complete. 2024-09-19T09:37:48.098 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T09:37:48.107 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi001.front.sepia.ceph.com 2024-09-19T09:37:48.107 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T09:37:48.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:48 smithi022 ceph-mon[35583]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:37:48.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:48 smithi121 ceph-mon[35577]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:37:48.371 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:48.492 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:48 smithi001 ceph-mon[31225]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:37:48.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.880+0000 7f244b55a640 1 -- 172.21.15.1:0/1346659632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2444102e00 msgr2=0x7f2444103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:48.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.880+0000 7f244b55a640 1 --2- 172.21.15.1:0/1346659632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2444102e00 0x7f2444103280 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2434009900 tx=0x7f243402a410 comp rx=0 tx=0).stop 2024-09-19T09:37:48.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.880+0000 7f244b55a640 1 -- 172.21.15.1:0/1346659632 shutdown_connections 2024-09-19T09:37:48.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.880+0000 7f244b55a640 1 --2- 172.21.15.1:0/1346659632 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f24441037c0 0x7f244410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.880+0000 7f244b55a640 1 --2- 172.21.15.1:0/1346659632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2444102e00 0x7f2444103280 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.880+0000 7f244b55a640 1 --2- 172.21.15.1:0/1346659632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2444101c00 0x7f2444102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.880+0000 7f244b55a640 1 -- 172.21.15.1:0/1346659632 >> 172.21.15.1:0/1346659632 conn(0x7f24440fd390 msgr2=0x7f24440ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:48.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.880+0000 7f244b55a640 1 -- 172.21.15.1:0/1346659632 shutdown_connections 2024-09-19T09:37:48.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.880+0000 7f244b55a640 1 -- 172.21.15.1:0/1346659632 wait complete. 2024-09-19T09:37:48.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.881+0000 7f244b55a640 1 Processor -- start 2024-09-19T09:37:48.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.881+0000 7f244b55a640 1 -- start start 2024-09-19T09:37:48.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.881+0000 7f244b55a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2444101c00 0x7f244419a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:48.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.881+0000 7f244b55a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2444102e00 0x7f244419a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:48.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.881+0000 7f244b55a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24441037c0 0x7f24441a1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:48.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.881+0000 7f244b55a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f244410d900 con 0x7f24441037c0 2024-09-19T09:37:48.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.881+0000 7f244b55a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f244410d780 con 0x7f2444101c00 2024-09-19T09:37:48.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.881+0000 7f244b55a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f244410da80 con 0x7f2444102e00 2024-09-19T09:37:48.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.881+0000 7f2449af7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24441037c0 0x7f24441a1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:48.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.881+0000 7f2449af7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24441037c0 0x7f24441a1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39270/0 (socket says 172.21.15.1:39270) 2024-09-19T09:37:48.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.881+0000 7f2449af7640 1 -- 172.21.15.1:0/695692320 learned_addr learned my addr 172.21.15.1:0/695692320 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:48.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.881+0000 7f24492f6640 1 --2- 172.21.15.1:0/695692320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2444101c00 0x7f244419a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:48.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.882+0000 7f2448af5640 1 --2- 172.21.15.1:0/695692320 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2444102e00 0x7f244419a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:48.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.882+0000 7f2449af7640 1 -- 172.21.15.1:0/695692320 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2444102e00 msgr2=0x7f244419a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:48.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.882+0000 7f2449af7640 1 --2- 172.21.15.1:0/695692320 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2444102e00 0x7f244419a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.882+0000 7f2449af7640 1 -- 172.21.15.1:0/695692320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2444101c00 msgr2=0x7f244419a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:48.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.882+0000 7f2449af7640 1 --2- 172.21.15.1:0/695692320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2444101c00 0x7f244419a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:48.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.882+0000 7f2449af7640 1 -- 172.21.15.1:0/695692320 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24441a1dd0 con 0x7f24441037c0 2024-09-19T09:37:48.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.882+0000 7f2449af7640 1 --2- 172.21.15.1:0/695692320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24441037c0 0x7f24441a1760 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f243c00eaa0 tx=0x7f243c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:48.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.882+0000 7f243a7fc640 1 -- 172.21.15.1:0/695692320 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c004d20 con 0x7f24441037c0 2024-09-19T09:37:48.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.882+0000 7f243a7fc640 1 -- 172.21.15.1:0/695692320 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f243c005020 con 0x7f24441037c0 2024-09-19T09:37:48.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.882+0000 7f244b55a640 1 -- 172.21.15.1:0/695692320 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24441a20c0 con 0x7f24441037c0 2024-09-19T09:37:48.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.882+0000 7f243a7fc640 1 -- 172.21.15.1:0/695692320 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c0116d0 con 0x7f24441037c0 2024-09-19T09:37:48.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.882+0000 7f244b55a640 1 -- 172.21.15.1:0/695692320 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24441a2650 con 0x7f24441037c0 2024-09-19T09:37:48.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.883+0000 7f244b55a640 1 -- 172.21.15.1:0/695692320 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2444101fe0 con 0x7f24441037c0 2024-09-19T09:37:48.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.884+0000 7f243a7fc640 1 -- 172.21.15.1:0/695692320 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f243c0051d0 con 0x7f24441037c0 2024-09-19T09:37:48.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.885+0000 7f243a7fc640 1 --2- 172.21.15.1:0/695692320 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f24300a32f0 0x7f24300a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:48.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.885+0000 7f24492f6640 1 --2- 172.21.15.1:0/695692320 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f24300a32f0 0x7f24300a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:48.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.885+0000 7f243a7fc640 1 -- 172.21.15.1:0/695692320 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f243c0cfad0 con 0x7f24441037c0 2024-09-19T09:37:48.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.885+0000 7f24492f6640 1 --2- 172.21.15.1:0/695692320 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f24300a32f0 0x7f24300a57b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2444102c60 tx=0x7f2440009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:48.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:48.889+0000 7f243a7fc640 1 -- 172.21.15.1:0/695692320 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f243c016030 con 0x7f24441037c0 2024-09-19T09:37:49.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:49.106+0000 7f244b55a640 1 -- 172.21.15.1:0/695692320 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f24441a3020 con 0x7f24441037c0 2024-09-19T09:37:49.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:49.106+0000 7f243a7fc640 1 -- 172.21.15.1:0/695692320 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) ==== 76+0+3038 (secure 0 0 0) 0x7f243c09c7b0 con 0x7f24441037c0 2024-09-19T09:37:49.108 INFO:teuthology.orchestra.run.smithi001.stdout:e19 2024-09-19T09:37:49.108 INFO:teuthology.orchestra.run.smithi001.stdout:btime 2024-09-19T09:36:24:006349+0000 2024-09-19T09:37:49.108 INFO:teuthology.orchestra.run.smithi001.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T09:37:49.108 INFO:teuthology.orchestra.run.smithi001.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T09:37:49.108 INFO:teuthology.orchestra.run.smithi001.stdout:legacy client fscid: 1 2024-09-19T09:37:49.108 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:37:49.108 INFO:teuthology.orchestra.run.smithi001.stdout:Filesystem 'cephfs' (1) 2024-09-19T09:37:49.109 INFO:teuthology.orchestra.run.smithi001.stdout:fs_name cephfs 2024-09-19T09:37:49.109 INFO:teuthology.orchestra.run.smithi001.stdout:epoch 19 2024-09-19T09:37:49.109 INFO:teuthology.orchestra.run.smithi001.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T09:37:49.109 INFO:teuthology.orchestra.run.smithi001.stdout:created 2024-09-19T09:36:13.637508+0000 2024-09-19T09:37:49.109 INFO:teuthology.orchestra.run.smithi001.stdout:modified 2024-09-19T09:36:23.723388+0000 2024-09-19T09:37:49.109 INFO:teuthology.orchestra.run.smithi001.stdout:tableserver 0 2024-09-19T09:37:49.109 INFO:teuthology.orchestra.run.smithi001.stdout:root 0 2024-09-19T09:37:49.109 INFO:teuthology.orchestra.run.smithi001.stdout:session_timeout 300 2024-09-19T09:37:49.109 INFO:teuthology.orchestra.run.smithi001.stdout:session_autoclose 300 2024-09-19T09:37:49.109 INFO:teuthology.orchestra.run.smithi001.stdout:max_file_size 1099511627776 2024-09-19T09:37:49.109 INFO:teuthology.orchestra.run.smithi001.stdout:max_xattr_size 65536 2024-09-19T09:37:49.109 INFO:teuthology.orchestra.run.smithi001.stdout:required_client_features {} 2024-09-19T09:37:49.109 INFO:teuthology.orchestra.run.smithi001.stdout:last_failure 0 2024-09-19T09:37:49.110 INFO:teuthology.orchestra.run.smithi001.stdout:last_failure_osd_epoch 0 2024-09-19T09:37:49.110 INFO:teuthology.orchestra.run.smithi001.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T09:37:49.110 INFO:teuthology.orchestra.run.smithi001.stdout:max_mds 1 2024-09-19T09:37:49.110 INFO:teuthology.orchestra.run.smithi001.stdout:in 0 2024-09-19T09:37:49.110 INFO:teuthology.orchestra.run.smithi001.stdout:up {0=24497} 2024-09-19T09:37:49.110 INFO:teuthology.orchestra.run.smithi001.stdout:failed 2024-09-19T09:37:49.110 INFO:teuthology.orchestra.run.smithi001.stdout:damaged 2024-09-19T09:37:49.110 INFO:teuthology.orchestra.run.smithi001.stdout:stopped 2024-09-19T09:37:49.110 INFO:teuthology.orchestra.run.smithi001.stdout:data_pools [3] 2024-09-19T09:37:49.110 INFO:teuthology.orchestra.run.smithi001.stdout:metadata_pool 2 2024-09-19T09:37:49.110 INFO:teuthology.orchestra.run.smithi001.stdout:inline_data disabled 2024-09-19T09:37:49.110 INFO:teuthology.orchestra.run.smithi001.stdout:balancer 2024-09-19T09:37:49.110 INFO:teuthology.orchestra.run.smithi001.stdout:bal_rank_mask -1 2024-09-19T09:37:49.110 INFO:teuthology.orchestra.run.smithi001.stdout:standby_count_wanted 0 2024-09-19T09:37:49.110 INFO:teuthology.orchestra.run.smithi001.stdout:qdb_cluster leader: 24497 members: 24497 2024-09-19T09:37:49.111 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.b{0:24497} state up:active seq 4 addr [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:37:49.111 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.i{0:24490} state up:standby-replay seq 1 addr [v2:172.21.15.121:6838/3279971690,v1:172.21.15.121:6839/3279971690] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:37:49.111 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:37:49.111 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:37:49.111 INFO:teuthology.orchestra.run.smithi001.stdout:Standby daemons: 2024-09-19T09:37:49.111 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:37:49.111 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.j{-1:14529} state up:standby seq 1 addr [v2:172.21.15.1:6834/553959571,v1:172.21.15.1:6835/553959571] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:37:49.111 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.d{-1:14541} state up:standby seq 1 addr [v2:172.21.15.1:6836/2692725949,v1:172.21.15.1:6837/2692725949] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:37:49.111 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.g{-1:14589} state up:standby seq 1 addr [v2:172.21.15.1:6838/2581765152,v1:172.21.15.1:6839/2581765152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:37:49.111 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.a{-1:14601} state up:standby seq 1 addr [v2:172.21.15.1:6840/3388580532,v1:172.21.15.1:6841/3388580532] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:37:49.111 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.k{-1:24431} state up:standby seq 1 addr [v2:172.21.15.22:6832/3676626194,v1:172.21.15.22:6833/3676626194] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:37:49.111 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.l{-1:24436} state up:standby seq 1 addr [v2:172.21.15.121:6832/2706759319,v1:172.21.15.121:6833/2706759319] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:37:49.111 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.e{-1:24458} state up:standby seq 1 addr [v2:172.21.15.22:6834/2003930762,v1:172.21.15.22:6835/2003930762] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:37:49.111 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.f{-1:24466} state up:standby seq 1 addr [v2:172.21.15.121:6834/2300524808,v1:172.21.15.121:6835/2300524808] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:37:49.112 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.c{-1:24472} state up:standby seq 1 addr [v2:172.21.15.121:6836/3966150520,v1:172.21.15.121:6837/3966150520] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:37:49.112 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.h{-1:24479} state up:standby seq 1 addr [v2:172.21.15.22:6836/1288432373,v1:172.21.15.22:6837/1288432373] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T09:37:49.112 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 19 2024-09-19T09:37:49.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:49.109+0000 7f244b55a640 1 -- 172.21.15.1:0/695692320 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f24300a32f0 msgr2=0x7f24300a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:49.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:49.109+0000 7f244b55a640 1 --2- 172.21.15.1:0/695692320 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f24300a32f0 0x7f24300a57b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2444102c60 tx=0x7f2440009110 comp rx=0 tx=0).stop 2024-09-19T09:37:49.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:49.109+0000 7f244b55a640 1 -- 172.21.15.1:0/695692320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24441037c0 msgr2=0x7f24441a1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:49.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:49.109+0000 7f244b55a640 1 --2- 172.21.15.1:0/695692320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24441037c0 0x7f24441a1760 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f243c00eaa0 tx=0x7f243c00eea0 comp rx=0 tx=0).stop 2024-09-19T09:37:49.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:49.109+0000 7f244b55a640 1 -- 172.21.15.1:0/695692320 shutdown_connections 2024-09-19T09:37:49.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:49.109+0000 7f244b55a640 1 --2- 172.21.15.1:0/695692320 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f24441037c0 0x7f24441a1760 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:49.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:49.109+0000 7f244b55a640 1 --2- 172.21.15.1:0/695692320 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2444102e00 0x7f244419a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:49.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:49.109+0000 7f244b55a640 1 --2- 172.21.15.1:0/695692320 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f24300a32f0 0x7f24300a57b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:49.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:49.109+0000 7f244b55a640 1 --2- 172.21.15.1:0/695692320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2444101c00 0x7f244419a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:49.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:49.109+0000 7f244b55a640 1 -- 172.21.15.1:0/695692320 >> 172.21.15.1:0/695692320 conn(0x7f24440fd390 msgr2=0x7f2444074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:49.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:49.109+0000 7f244b55a640 1 -- 172.21.15.1:0/695692320 shutdown_connections 2024-09-19T09:37:49.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:49.109+0000 7f244b55a640 1 -- 172.21.15.1:0/695692320 wait complete. 2024-09-19T09:37:49.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:49 smithi022 ceph-mon[35583]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:49.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:49 smithi121 ceph-mon[35577]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:49.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:49 smithi001 ceph-mon[31225]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T09:37:49.733 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57238232-7669-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-19T09:37:49.987 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:50.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:50 smithi022 ceph-mon[35583]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:37:50.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:50 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/695692320' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:37:50.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:50 smithi121 ceph-mon[35577]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:37:50.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:50 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/695692320' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:37:50.400 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:50 smithi001 ceph-mon[31225]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:37:50.400 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:50 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/695692320' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T09:37:50.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.482+0000 7fd6fe185640 1 -- 172.21.15.1:0/1562342314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6f8102e00 msgr2=0x7fd6f8103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:50.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.482+0000 7fd6fe185640 1 --2- 172.21.15.1:0/1562342314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6f8102e00 0x7fd6f8103280 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009900 tx=0x7fd6ec02a3f0 comp rx=0 tx=0).stop 2024-09-19T09:37:50.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.482+0000 7fd6fe185640 1 -- 172.21.15.1:0/1562342314 shutdown_connections 2024-09-19T09:37:50.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.482+0000 7fd6fe185640 1 --2- 172.21.15.1:0/1562342314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6f81037c0 0x7fd6f810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:50.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.482+0000 7fd6fe185640 1 --2- 172.21.15.1:0/1562342314 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6f8102e00 0x7fd6f8103280 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:50.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.482+0000 7fd6fe185640 1 --2- 172.21.15.1:0/1562342314 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6f8101c00 0x7fd6f8102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:50.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.482+0000 7fd6fe185640 1 -- 172.21.15.1:0/1562342314 >> 172.21.15.1:0/1562342314 conn(0x7fd6f80fd390 msgr2=0x7fd6f80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:50.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.482+0000 7fd6fe185640 1 -- 172.21.15.1:0/1562342314 shutdown_connections 2024-09-19T09:37:50.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.482+0000 7fd6fe185640 1 -- 172.21.15.1:0/1562342314 wait complete. 2024-09-19T09:37:50.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.483+0000 7fd6fe185640 1 Processor -- start 2024-09-19T09:37:50.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.483+0000 7fd6fe185640 1 -- start start 2024-09-19T09:37:50.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.483+0000 7fd6fe185640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6f8101c00 0x7fd6f8197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:50.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.483+0000 7fd6fe185640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6f8102e00 0x7fd6f8198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:50.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.483+0000 7fd6fe185640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6f81037c0 0x7fd6f819f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:50.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.483+0000 7fd6fe185640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f810d900 con 0x7fd6f8102e00 2024-09-19T09:37:50.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.483+0000 7fd6fe185640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f810d780 con 0x7fd6f81037c0 2024-09-19T09:37:50.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.483+0000 7fd6fe185640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f810da80 con 0x7fd6f8101c00 2024-09-19T09:37:50.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.483+0000 7fd6f6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6f8102e00 0x7fd6f8198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:50.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.483+0000 7fd6f6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6f8102e00 0x7fd6f8198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39292/0 (socket says 172.21.15.1:39292) 2024-09-19T09:37:50.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.483+0000 7fd6f6ffd640 1 -- 172.21.15.1:0/2132130326 learned_addr learned my addr 172.21.15.1:0/2132130326 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:50.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.483+0000 7fd6f7fff640 1 --2- 172.21.15.1:0/2132130326 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6f81037c0 0x7fd6f819f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:50.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.483+0000 7fd6f77fe640 1 --2- 172.21.15.1:0/2132130326 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6f8101c00 0x7fd6f8197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:50.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.483+0000 7fd6f6ffd640 1 -- 172.21.15.1:0/2132130326 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6f8101c00 msgr2=0x7fd6f8197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:50.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.483+0000 7fd6f6ffd640 1 --2- 172.21.15.1:0/2132130326 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6f8101c00 0x7fd6f8197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:50.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.483+0000 7fd6f6ffd640 1 -- 172.21.15.1:0/2132130326 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6f81037c0 msgr2=0x7fd6f819f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:50.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.483+0000 7fd6f6ffd640 1 --2- 172.21.15.1:0/2132130326 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6f81037c0 0x7fd6f819f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:50.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.483+0000 7fd6f6ffd640 1 -- 172.21.15.1:0/2132130326 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f819fb50 con 0x7fd6f8102e00 2024-09-19T09:37:50.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.484+0000 7fd6f6ffd640 1 --2- 172.21.15.1:0/2132130326 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6f8102e00 0x7fd6f8198460 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009230 tx=0x7fd6ec004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:50.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.484+0000 7fd6f4ff9640 1 -- 172.21.15.1:0/2132130326 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec03f030 con 0x7fd6f8102e00 2024-09-19T09:37:50.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.484+0000 7fd6f4ff9640 1 -- 172.21.15.1:0/2132130326 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6ec003ce0 con 0x7fd6f8102e00 2024-09-19T09:37:50.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.484+0000 7fd6fe185640 1 -- 172.21.15.1:0/2132130326 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6f819fde0 con 0x7fd6f8102e00 2024-09-19T09:37:50.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.484+0000 7fd6f4ff9640 1 -- 172.21.15.1:0/2132130326 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec035070 con 0x7fd6f8102e00 2024-09-19T09:37:50.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.484+0000 7fd6fe185640 1 -- 172.21.15.1:0/2132130326 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6f81a02c0 con 0x7fd6f8102e00 2024-09-19T09:37:50.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.485+0000 7fd6fe185640 1 -- 172.21.15.1:0/2132130326 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6f8108fb0 con 0x7fd6f8102e00 2024-09-19T09:37:50.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.486+0000 7fd6f4ff9640 1 -- 172.21.15.1:0/2132130326 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fd6ec042030 con 0x7fd6f8102e00 2024-09-19T09:37:50.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.487+0000 7fd6f4ff9640 1 --2- 172.21.15.1:0/2132130326 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd6e00a32f0 0x7fd6e00a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:50.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.487+0000 7fd6f4ff9640 1 -- 172.21.15.1:0/2132130326 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fd6ec0eff70 con 0x7fd6f8102e00 2024-09-19T09:37:50.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.487+0000 7fd6f77fe640 1 --2- 172.21.15.1:0/2132130326 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd6e00a32f0 0x7fd6e00a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:50.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.487+0000 7fd6f77fe640 1 --2- 172.21.15.1:0/2132130326 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd6e00a32f0 0x7fd6e00a57b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8102c60 tx=0x7fd6e8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:50.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.491+0000 7fd6f4ff9640 1 -- 172.21.15.1:0/2132130326 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd6ec0bcc90 con 0x7fd6f8102e00 2024-09-19T09:37:50.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.667+0000 7fd6fe185640 1 -- 172.21.15.1:0/2132130326 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fd6f8062df0 con 0x7fd6f8102e00 2024-09-19T09:37:50.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.669+0000 7fd6f4ff9640 1 -- 172.21.15.1:0/2132130326 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v83) ==== 56+0+5270 (secure 0 0 0) 0x7fd6ec0bc590 con 0x7fd6f8102e00 2024-09-19T09:37:50.670 INFO:teuthology.orchestra.run.smithi001.stdout:epoch 83 2024-09-19T09:37:50.670 INFO:teuthology.orchestra.run.smithi001.stdout:fsid 57238232-7669-11ef-bceb-c7b262605968 2024-09-19T09:37:50.670 INFO:teuthology.orchestra.run.smithi001.stdout:created 2024-09-19T09:28:28.406983+0000 2024-09-19T09:37:50.670 INFO:teuthology.orchestra.run.smithi001.stdout:modified 2024-09-19T09:37:16.024965+0000 2024-09-19T09:37:50.670 INFO:teuthology.orchestra.run.smithi001.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-19T09:37:50.671 INFO:teuthology.orchestra.run.smithi001.stdout:crush_version 26 2024-09-19T09:37:50.671 INFO:teuthology.orchestra.run.smithi001.stdout:full_ratio 0.95 2024-09-19T09:37:50.671 INFO:teuthology.orchestra.run.smithi001.stdout:backfillfull_ratio 0.9 2024-09-19T09:37:50.671 INFO:teuthology.orchestra.run.smithi001.stdout:nearfull_ratio 0.85 2024-09-19T09:37:50.671 INFO:teuthology.orchestra.run.smithi001.stdout:require_min_compat_client luminous 2024-09-19T09:37:50.671 INFO:teuthology.orchestra.run.smithi001.stdout:min_compat_client luminous 2024-09-19T09:37:50.671 INFO:teuthology.orchestra.run.smithi001.stdout:require_osd_release squid 2024-09-19T09:37:50.671 INFO:teuthology.orchestra.run.smithi001.stdout:stretch_mode_enabled false 2024-09-19T09:37:50.671 INFO:teuthology.orchestra.run.smithi001.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-19T09:37:50.671 INFO:teuthology.orchestra.run.smithi001.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-19T09:37:50.671 INFO:teuthology.orchestra.run.smithi001.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-19T09:37:50.671 INFO:teuthology.orchestra.run.smithi001.stdout:max_osd 12 2024-09-19T09:37:50.671 INFO:teuthology.orchestra.run.smithi001.stdout:osd.0 up in weight 1 up_from 8 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.1:6802/502676986,v1:172.21.15.1:6803/502676986] [v2:172.21.15.1:6804/502676986,v1:172.21.15.1:6805/502676986] exists,up c165571d-43f1-4c43-ba1e-35872d914f11 2024-09-19T09:37:50.672 INFO:teuthology.orchestra.run.smithi001.stdout:osd.1 up in weight 1 up_from 13 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.22:6800/3735826323,v1:172.21.15.22:6801/3735826323] [v2:172.21.15.22:6802/3735826323,v1:172.21.15.22:6803/3735826323] exists,up baf120f8-8ba3-4aa5-a12a-41cdc97ff11b 2024-09-19T09:37:50.672 INFO:teuthology.orchestra.run.smithi001.stdout:osd.2 up in weight 1 up_from 17 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.121:6800/1924970833,v1:172.21.15.121:6801/1924970833] [v2:172.21.15.121:6802/1924970833,v1:172.21.15.121:6803/1924970833] exists,up 72c520bf-c5cc-44ee-a38c-c9bac0a6280b 2024-09-19T09:37:50.672 INFO:teuthology.orchestra.run.smithi001.stdout:osd.3 up in weight 1 up_from 24 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.1:6810/1515009793,v1:172.21.15.1:6811/1515009793] [v2:172.21.15.1:6812/1515009793,v1:172.21.15.1:6813/1515009793] exists,up adad6d17-16d9-4c43-b581-35ac1bb9d807 2024-09-19T09:37:50.672 INFO:teuthology.orchestra.run.smithi001.stdout:osd.4 up in weight 1 up_from 32 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.22:6808/923697266,v1:172.21.15.22:6809/923697266] [v2:172.21.15.22:6810/923697266,v1:172.21.15.22:6811/923697266] exists,up 8fb06efe-c3a0-48a3-9730-3e8f3e60922d 2024-09-19T09:37:50.672 INFO:teuthology.orchestra.run.smithi001.stdout:osd.5 up in weight 1 up_from 36 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.121:6808/3137245658,v1:172.21.15.121:6809/3137245658] [v2:172.21.15.121:6810/3137245658,v1:172.21.15.121:6811/3137245658] exists,up 3b2f428c-8a5a-49be-9f43-a9f379a1c7e9 2024-09-19T09:37:50.672 INFO:teuthology.orchestra.run.smithi001.stdout:osd.6 up in weight 1 up_from 43 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.1:6818/3376780798,v1:172.21.15.1:6819/3376780798] [v2:172.21.15.1:6820/3376780798,v1:172.21.15.1:6821/3376780798] exists,up 5aecec68-ff7e-440c-bd39-cc35ab89cc91 2024-09-19T09:37:50.672 INFO:teuthology.orchestra.run.smithi001.stdout:osd.7 up in weight 1 up_from 48 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.22:6816/2920985295,v1:172.21.15.22:6817/2920985295] [v2:172.21.15.22:6818/2920985295,v1:172.21.15.22:6819/2920985295] exists,up 46556bdf-199e-4268-873b-6d87b54e1176 2024-09-19T09:37:50.672 INFO:teuthology.orchestra.run.smithi001.stdout:osd.8 up in weight 1 up_from 55 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.121:6816/3589985967,v1:172.21.15.121:6817/3589985967] [v2:172.21.15.121:6818/3589985967,v1:172.21.15.121:6819/3589985967] exists,up e7c3792a-94a4-4440-be74-d6abdf3d9566 2024-09-19T09:37:50.673 INFO:teuthology.orchestra.run.smithi001.stdout:osd.9 up in weight 1 up_from 62 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.1:6826/1143859822,v1:172.21.15.1:6827/1143859822] [v2:172.21.15.1:6828/1143859822,v1:172.21.15.1:6829/1143859822] exists,up 8af80ac9-d681-4966-b083-ead5185eff12 2024-09-19T09:37:50.673 INFO:teuthology.orchestra.run.smithi001.stdout:osd.10 up in weight 1 up_from 68 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.22:6824/343155547,v1:172.21.15.22:6825/343155547] [v2:172.21.15.22:6826/343155547,v1:172.21.15.22:6827/343155547] exists,up 34edd06a-7f60-4465-bfe1-0c646abd53f3 2024-09-19T09:37:50.673 INFO:teuthology.orchestra.run.smithi001.stdout:osd.11 up in weight 1 up_from 75 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.121:6824/3202514460,v1:172.21.15.121:6825/3202514460] [v2:172.21.15.121:6826/3202514460,v1:172.21.15.121:6827/3202514460] exists,up 5a831eb6-ad66-4ab6-a30a-b6299ce1f88d 2024-09-19T09:37:50.673 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 2.a [2,11] 2024-09-19T09:37:50.673 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 2.1a [8,1] 2024-09-19T09:37:50.673 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 2.1b [2,4] 2024-09-19T09:37:50.673 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 2.1f [7,11] 2024-09-19T09:37:50.673 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.3 [4,9] 2024-09-19T09:37:50.673 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.1b [4,6] 2024-09-19T09:37:50.673 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.1e [3,9] 2024-09-19T09:37:50.674 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.20 [5,9] 2024-09-19T09:37:50.674 INFO:teuthology.orchestra.run.smithi001.stdout:pg_upmap_items 3.31 [4,8] 2024-09-19T09:37:50.674 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:6800/1028873727 expires 2024-09-20T09:29:14.046960+0000 2024-09-19T09:37:50.674 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/3137949087 expires 2024-09-20T09:29:14.046960+0000 2024-09-19T09:37:50.674 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/1951370933 expires 2024-09-20T09:29:14.046960+0000 2024-09-19T09:37:50.674 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/2008363642 expires 2024-09-20T09:28:50.074985+0000 2024-09-19T09:37:50.674 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/3006931063 expires 2024-09-20T09:29:14.046960+0000 2024-09-19T09:37:50.674 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/2486161758 expires 2024-09-20T09:28:50.074985+0000 2024-09-19T09:37:50.674 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:6801/1296304385 expires 2024-09-20T09:28:50.074985+0000 2024-09-19T09:37:50.674 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:6801/1028873727 expires 2024-09-20T09:29:14.046960+0000 2024-09-19T09:37:50.674 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:0/2783823049 expires 2024-09-20T09:28:50.074985+0000 2024-09-19T09:37:50.674 INFO:teuthology.orchestra.run.smithi001.stdout:blocklist 172.21.15.1:6800/1296304385 expires 2024-09-20T09:28:50.074985+0000 2024-09-19T09:37:50.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.671+0000 7fd6fe185640 1 -- 172.21.15.1:0/2132130326 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd6e00a32f0 msgr2=0x7fd6e00a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:50.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.671+0000 7fd6fe185640 1 --2- 172.21.15.1:0/2132130326 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd6e00a32f0 0x7fd6e00a57b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8102c60 tx=0x7fd6e8008040 comp rx=0 tx=0).stop 2024-09-19T09:37:50.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.671+0000 7fd6fe185640 1 -- 172.21.15.1:0/2132130326 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6f8102e00 msgr2=0x7fd6f8198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:50.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.671+0000 7fd6fe185640 1 --2- 172.21.15.1:0/2132130326 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6f8102e00 0x7fd6f8198460 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009230 tx=0x7fd6ec004430 comp rx=0 tx=0).stop 2024-09-19T09:37:50.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.671+0000 7fd6fe185640 1 -- 172.21.15.1:0/2132130326 shutdown_connections 2024-09-19T09:37:50.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.671+0000 7fd6fe185640 1 --2- 172.21.15.1:0/2132130326 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd6e00a32f0 0x7fd6e00a57b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:50.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.671+0000 7fd6fe185640 1 --2- 172.21.15.1:0/2132130326 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6f81037c0 0x7fd6f819f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:50.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.671+0000 7fd6fe185640 1 --2- 172.21.15.1:0/2132130326 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd6f8102e00 0x7fd6f8198460 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:50.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.671+0000 7fd6fe185640 1 --2- 172.21.15.1:0/2132130326 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6f8101c00 0x7fd6f8197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:50.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.671+0000 7fd6fe185640 1 -- 172.21.15.1:0/2132130326 >> 172.21.15.1:0/2132130326 conn(0x7fd6f80fd390 msgr2=0x7fd6f8106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:50.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.671+0000 7fd6fe185640 1 -- 172.21.15.1:0/2132130326 shutdown_connections 2024-09-19T09:37:50.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:50.672+0000 7fd6fe185640 1 -- 172.21.15.1:0/2132130326 wait complete. 2024-09-19T09:37:51.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:51 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/2132130326' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T09:37:51.389 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-19T09:37:51.401 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:37:51.616 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:51 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/2132130326' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T09:37:51.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:51 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/2132130326' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T09:37:51.660 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:52.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.176+0000 7f81685c8640 1 -- 172.21.15.1:0/778833039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8160100e20 msgr2=0x7f8160101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:52.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.176+0000 7f81685c8640 1 --2- 172.21.15.1:0/778833039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8160100e20 0x7f8160101200 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f815c009900 tx=0x7f815c02a480 comp rx=0 tx=0).stop 2024-09-19T09:37:52.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.177+0000 7f81685c8640 1 -- 172.21.15.1:0/778833039 shutdown_connections 2024-09-19T09:37:52.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.177+0000 7f81685c8640 1 --2- 172.21.15.1:0/778833039 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8160102ef0 0x7f816010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.177+0000 7f81685c8640 1 --2- 172.21.15.1:0/778833039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8160102570 0x7f81601029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.177+0000 7f81685c8640 1 --2- 172.21.15.1:0/778833039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8160100e20 0x7f8160101200 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.177+0000 7f81685c8640 1 -- 172.21.15.1:0/778833039 >> 172.21.15.1:0/778833039 conn(0x7f81600fc7d0 msgr2=0x7f81600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:52.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.177+0000 7f81685c8640 1 -- 172.21.15.1:0/778833039 shutdown_connections 2024-09-19T09:37:52.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.177+0000 7f81685c8640 1 -- 172.21.15.1:0/778833039 wait complete. 2024-09-19T09:37:52.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.177+0000 7f81685c8640 1 Processor -- start 2024-09-19T09:37:52.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.177+0000 7f81685c8640 1 -- start start 2024-09-19T09:37:52.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.178+0000 7f81685c8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8160100e20 0x7f81601985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.178+0000 7f81685c8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8160102570 0x7f8160198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.178+0000 7f81685c8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8160102ef0 0x7f816019ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.178+0000 7f81685c8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8160110fa0 con 0x7f8160102570 2024-09-19T09:37:52.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.178+0000 7f81685c8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8160110e20 con 0x7f8160102ef0 2024-09-19T09:37:52.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.178+0000 7f81685c8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8160111120 con 0x7f8160100e20 2024-09-19T09:37:52.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.178+0000 7f8165b63640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8160102570 0x7f8160198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.178+0000 7f8165b63640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8160102570 0x7f8160198b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39310/0 (socket says 172.21.15.1:39310) 2024-09-19T09:37:52.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.178+0000 7f8165b63640 1 -- 172.21.15.1:0/3942994620 learned_addr learned my addr 172.21.15.1:0/3942994620 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:52.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.178+0000 7f8166b65640 1 --2- 172.21.15.1:0/3942994620 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8160102ef0 0x7f816019ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.178+0000 7f8166364640 1 --2- 172.21.15.1:0/3942994620 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8160100e20 0x7f81601985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.178+0000 7f8165b63640 1 -- 172.21.15.1:0/3942994620 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8160100e20 msgr2=0x7f81601985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:52.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.178+0000 7f8165b63640 1 --2- 172.21.15.1:0/3942994620 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8160100e20 0x7f81601985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.178+0000 7f8165b63640 1 -- 172.21.15.1:0/3942994620 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8160102ef0 msgr2=0x7f816019ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:52.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.178+0000 7f8165b63640 1 --2- 172.21.15.1:0/3942994620 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8160102ef0 0x7f816019ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.178+0000 7f8165b63640 1 -- 172.21.15.1:0/3942994620 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f816019d590 con 0x7f8160102570 2024-09-19T09:37:52.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.178+0000 7f8166364640 1 --2- 172.21.15.1:0/3942994620 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8160100e20 0x7f81601985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:52.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.178+0000 7f8165b63640 1 --2- 172.21.15.1:0/3942994620 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8160102570 0x7f8160198b20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f815000d950 tx=0x7f815000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:52.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.178+0000 7f81577fe640 1 -- 172.21.15.1:0/3942994620 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8150017070 con 0x7f8160102570 2024-09-19T09:37:52.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.178+0000 7f81685c8640 1 -- 172.21.15.1:0/3942994620 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f816019d880 con 0x7f8160102570 2024-09-19T09:37:52.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.178+0000 7f81577fe640 1 -- 172.21.15.1:0/3942994620 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8150009c30 con 0x7f8160102570 2024-09-19T09:37:52.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.178+0000 7f81577fe640 1 -- 172.21.15.1:0/3942994620 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815000f6b0 con 0x7f8160102570 2024-09-19T09:37:52.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.178+0000 7f81685c8640 1 -- 172.21.15.1:0/3942994620 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81601a5160 con 0x7f8160102570 2024-09-19T09:37:52.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.180+0000 7f81685c8640 1 -- 172.21.15.1:0/3942994620 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8160101200 con 0x7f8160102570 2024-09-19T09:37:52.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.180+0000 7f81577fe640 1 -- 172.21.15.1:0/3942994620 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f81500109d0 con 0x7f8160102570 2024-09-19T09:37:52.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.181+0000 7f81577fe640 1 --2- 172.21.15.1:0/3942994620 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f814c0a32c0 0x7f814c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:52.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.181+0000 7f8166364640 1 --2- 172.21.15.1:0/3942994620 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f814c0a32c0 0x7f814c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:52.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.181+0000 7f81577fe640 1 -- 172.21.15.1:0/3942994620 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f81500cf850 con 0x7f8160102570 2024-09-19T09:37:52.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.182+0000 7f8166364640 1 --2- 172.21.15.1:0/3942994620 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f814c0a32c0 0x7f814c0a5780 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f815c000c00 tx=0x7f815c004100 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:52.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.185+0000 7f81577fe640 1 -- 172.21.15.1:0/3942994620 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8150009de0 con 0x7f8160102570 2024-09-19T09:37:52.373 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:52 smithi001 ceph-mon[31225]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:37:52.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.400+0000 7f81685c8640 1 -- 172.21.15.1:0/3942994620 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f816010a0a0 con 0x7f8160102570 2024-09-19T09:37:52.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.401+0000 7f81577fe640 1 -- 172.21.15.1:0/3942994620 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11837 (secure 0 0 0) 0x7f815009c570 con 0x7f8160102570 2024-09-19T09:37:52.403 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:37:52.403 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":19,"btime":"2024-09-19T09:36:24:006349+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:36:23.723388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6839/3279971690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3279971690},{"type":"v1","addr":"172.21.15.121:6839","nonce":3279971690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:37:52.403 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 19 2024-09-19T09:37:52.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.403+0000 7f81685c8640 1 -- 172.21.15.1:0/3942994620 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f814c0a32c0 msgr2=0x7f814c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:52.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.403+0000 7f81685c8640 1 --2- 172.21.15.1:0/3942994620 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f814c0a32c0 0x7f814c0a5780 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f815c000c00 tx=0x7f815c004100 comp rx=0 tx=0).stop 2024-09-19T09:37:52.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.403+0000 7f81685c8640 1 -- 172.21.15.1:0/3942994620 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8160102570 msgr2=0x7f8160198b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:52.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.403+0000 7f81685c8640 1 --2- 172.21.15.1:0/3942994620 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8160102570 0x7f8160198b20 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f815000d950 tx=0x7f815000de10 comp rx=0 tx=0).stop 2024-09-19T09:37:52.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.403+0000 7f81685c8640 1 -- 172.21.15.1:0/3942994620 shutdown_connections 2024-09-19T09:37:52.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.403+0000 7f81685c8640 1 --2- 172.21.15.1:0/3942994620 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f814c0a32c0 0x7f814c0a5780 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.403+0000 7f81685c8640 1 --2- 172.21.15.1:0/3942994620 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8160102ef0 0x7f816019ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.403+0000 7f81685c8640 1 --2- 172.21.15.1:0/3942994620 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8160102570 0x7f8160198b20 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.403+0000 7f81685c8640 1 --2- 172.21.15.1:0/3942994620 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8160100e20 0x7f81601985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:52.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.403+0000 7f81685c8640 1 -- 172.21.15.1:0/3942994620 >> 172.21.15.1:0/3942994620 conn(0x7f81600fc7d0 msgr2=0x7f816006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:52.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.403+0000 7f81685c8640 1 -- 172.21.15.1:0/3942994620 shutdown_connections 2024-09-19T09:37:52.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:52.403+0000 7f81685c8640 1 -- 172.21.15.1:0/3942994620 wait complete. 2024-09-19T09:37:52.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:52 smithi022 ceph-mon[35583]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:37:52.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:52 smithi121 ceph-mon[35577]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:37:53.037 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:37:53.306 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:53.407 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:53 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/3942994620' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:53.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:53 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/3942994620' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:53.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:53 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/3942994620' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:53.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.800+0000 7f4fe640d640 1 -- 172.21.15.1:0/2478183204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fe0106f10 msgr2=0x7f4fe010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:53.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.800+0000 7f4fe640d640 1 --2- 172.21.15.1:0/2478183204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fe0106f10 0x7f4fe010ea90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8009ca0 tx=0x7f4fd802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:37:53.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.801+0000 7f4fe640d640 1 -- 172.21.15.1:0/2478183204 shutdown_connections 2024-09-19T09:37:53.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.801+0000 7f4fe640d640 1 --2- 172.21.15.1:0/2478183204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fe0106f10 0x7f4fe010ea90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:53.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.801+0000 7f4fe640d640 1 --2- 172.21.15.1:0/2478183204 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fe0102790 0x7f4fe01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:53.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.801+0000 7f4fe640d640 1 --2- 172.21.15.1:0/2478183204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fe0101de0 0x7f4fe01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:53.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.801+0000 7f4fe640d640 1 -- 172.21.15.1:0/2478183204 >> 172.21.15.1:0/2478183204 conn(0x7f4fe00fd8c0 msgr2=0x7f4fe00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:53.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.801+0000 7f4fe640d640 1 -- 172.21.15.1:0/2478183204 shutdown_connections 2024-09-19T09:37:53.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.801+0000 7f4fe640d640 1 -- 172.21.15.1:0/2478183204 wait complete. 2024-09-19T09:37:53.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.801+0000 7f4fe640d640 1 Processor -- start 2024-09-19T09:37:53.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.801+0000 7f4fe640d640 1 -- start start 2024-09-19T09:37:53.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.802+0000 7f4fe640d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fe0101de0 0x7f4fe00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:53.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.802+0000 7f4fe640d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fe0102790 0x7f4fe0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:53.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.802+0000 7f4fe640d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fe0106f10 0x7f4fe0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:53.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.802+0000 7f4fe640d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe0111f90 con 0x7f4fe0102790 2024-09-19T09:37:53.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.802+0000 7f4fe640d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe0111e10 con 0x7f4fe0106f10 2024-09-19T09:37:53.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.802+0000 7f4fe640d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe0112110 con 0x7f4fe0101de0 2024-09-19T09:37:53.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.802+0000 7f4fdf7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fe0102790 0x7f4fe0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:53.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.802+0000 7f4fdf7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fe0102790 0x7f4fe0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39328/0 (socket says 172.21.15.1:39328) 2024-09-19T09:37:53.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.802+0000 7f4fdf7fe640 1 -- 172.21.15.1:0/2635079692 learned_addr learned my addr 172.21.15.1:0/2635079692 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:53.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.802+0000 7f4fdffff640 1 --2- 172.21.15.1:0/2635079692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fe0101de0 0x7f4fe00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:53.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.802+0000 7f4fe49aa640 1 --2- 172.21.15.1:0/2635079692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fe0106f10 0x7f4fe0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:53.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.802+0000 7f4fdf7fe640 1 -- 172.21.15.1:0/2635079692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fe0101de0 msgr2=0x7f4fe00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:53.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.802+0000 7f4fdf7fe640 1 --2- 172.21.15.1:0/2635079692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fe0101de0 0x7f4fe00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:53.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.802+0000 7f4fdf7fe640 1 -- 172.21.15.1:0/2635079692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fe0106f10 msgr2=0x7f4fe0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:53.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.802+0000 7f4fdf7fe640 1 --2- 172.21.15.1:0/2635079692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fe0106f10 0x7f4fe0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:53.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.802+0000 7f4fdf7fe640 1 -- 172.21.15.1:0/2635079692 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe01a68d0 con 0x7f4fe0102790 2024-09-19T09:37:53.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.802+0000 7f4fdffff640 1 --2- 172.21.15.1:0/2635079692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fe0101de0 0x7f4fe00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:53.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.802+0000 7f4fe49aa640 1 --2- 172.21.15.1:0/2635079692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fe0106f10 0x7f4fe0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:37:53.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.802+0000 7f4fdf7fe640 1 --2- 172.21.15.1:0/2635079692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fe0102790 0x7f4fe0074a30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4fd400b4a0 tx=0x7f4fd400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:53.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.802+0000 7f4fdd7fa640 1 -- 172.21.15.1:0/2635079692 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4014070 con 0x7f4fe0102790 2024-09-19T09:37:53.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.802+0000 7f4fe640d640 1 -- 172.21.15.1:0/2635079692 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fe01a6bc0 con 0x7f4fe0102790 2024-09-19T09:37:53.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.802+0000 7f4fdd7fa640 1 -- 172.21.15.1:0/2635079692 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fd4010af0 con 0x7f4fe0102790 2024-09-19T09:37:53.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.802+0000 7f4fdd7fa640 1 -- 172.21.15.1:0/2635079692 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4017d10 con 0x7f4fe0102790 2024-09-19T09:37:53.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.803+0000 7f4fe640d640 1 -- 172.21.15.1:0/2635079692 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fe01a7150 con 0x7f4fe0102790 2024-09-19T09:37:53.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.803+0000 7f4fe640d640 1 -- 172.21.15.1:0/2635079692 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fe01021c0 con 0x7f4fe0102790 2024-09-19T09:37:53.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.805+0000 7f4fdd7fa640 1 -- 172.21.15.1:0/2635079692 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f4fd4017070 con 0x7f4fe0102790 2024-09-19T09:37:53.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.806+0000 7f4fdd7fa640 1 --2- 172.21.15.1:0/2635079692 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4fc80a3240 0x7f4fc80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:53.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.806+0000 7f4fdffff640 1 --2- 172.21.15.1:0/2635079692 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4fc80a3240 0x7f4fc80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:53.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.806+0000 7f4fdd7fa640 1 -- 172.21.15.1:0/2635079692 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f4fd40cf160 con 0x7f4fe0102790 2024-09-19T09:37:53.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.806+0000 7f4fdffff640 1 --2- 172.21.15.1:0/2635079692 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4fc80a3240 0x7f4fc80a5700 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4fd000baa0 tx=0x7f4fd0005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:53.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:53.809+0000 7f4fdd7fa640 1 -- 172.21.15.1:0/2635079692 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4fd409be40 con 0x7f4fe0102790 2024-09-19T09:37:54.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:54.023+0000 7f4fe640d640 1 -- 172.21.15.1:0/2635079692 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4fe01a7380 con 0x7f4fe0102790 2024-09-19T09:37:54.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:54.024+0000 7f4fdd7fa640 1 -- 172.21.15.1:0/2635079692 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11837 (secure 0 0 0) 0x7f4fd409b740 con 0x7f4fe0102790 2024-09-19T09:37:54.025 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:37:54.026 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":19,"btime":"2024-09-19T09:36:24:006349+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:36:23.723388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6839/3279971690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3279971690},{"type":"v1","addr":"172.21.15.121:6839","nonce":3279971690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:37:54.026 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 19 2024-09-19T09:37:54.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:54.026+0000 7f4fe640d640 1 -- 172.21.15.1:0/2635079692 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4fc80a3240 msgr2=0x7f4fc80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:54.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:54.026+0000 7f4fe640d640 1 --2- 172.21.15.1:0/2635079692 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4fc80a3240 0x7f4fc80a5700 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4fd000baa0 tx=0x7f4fd0005d90 comp rx=0 tx=0).stop 2024-09-19T09:37:54.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:54.026+0000 7f4fe640d640 1 -- 172.21.15.1:0/2635079692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fe0102790 msgr2=0x7f4fe0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:54.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:54.026+0000 7f4fe640d640 1 --2- 172.21.15.1:0/2635079692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fe0102790 0x7f4fe0074a30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4fd400b4a0 tx=0x7f4fd400b960 comp rx=0 tx=0).stop 2024-09-19T09:37:54.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:54.026+0000 7f4fe640d640 1 -- 172.21.15.1:0/2635079692 shutdown_connections 2024-09-19T09:37:54.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:54.026+0000 7f4fe640d640 1 --2- 172.21.15.1:0/2635079692 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4fc80a3240 0x7f4fc80a5700 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:54.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:54.026+0000 7f4fe640d640 1 --2- 172.21.15.1:0/2635079692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fe0106f10 0x7f4fe0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:54.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:54.026+0000 7f4fe640d640 1 --2- 172.21.15.1:0/2635079692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fe0102790 0x7f4fe0074a30 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:54.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:54.026+0000 7f4fe640d640 1 --2- 172.21.15.1:0/2635079692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fe0101de0 0x7f4fe00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:54.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:54.026+0000 7f4fe640d640 1 -- 172.21.15.1:0/2635079692 >> 172.21.15.1:0/2635079692 conn(0x7f4fe00fd8c0 msgr2=0x7f4fe00ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:54.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:54.026+0000 7f4fe640d640 1 -- 172.21.15.1:0/2635079692 shutdown_connections 2024-09-19T09:37:54.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:54.026+0000 7f4fe640d640 1 -- 172.21.15.1:0/2635079692 wait complete. 2024-09-19T09:37:54.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:54 smithi001 ceph-mon[31225]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:37:54.478 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:54 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/2635079692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:54.518 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:54 smithi121 ceph-mon[35577]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:37:54.518 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:54 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/2635079692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:54.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:54 smithi022 ceph-mon[35583]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:37:54.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:54 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/2635079692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:37:54.808 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:37:55.070 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:55.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.532+0000 7f86ccd61640 1 -- 172.21.15.1:0/1681526290 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86c8101de0 msgr2=0x7f86c81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:55.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.532+0000 7f86ccd61640 1 --2- 172.21.15.1:0/1681526290 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86c8101de0 0x7f86c81021c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009900 tx=0x7f86b802a410 comp rx=0 tx=0).stop 2024-09-19T09:37:55.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.533+0000 7f86ccd61640 1 -- 172.21.15.1:0/1681526290 shutdown_connections 2024-09-19T09:37:55.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.533+0000 7f86ccd61640 1 --2- 172.21.15.1:0/1681526290 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86c8106f10 0x7f86c810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:55.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.533+0000 7f86ccd61640 1 --2- 172.21.15.1:0/1681526290 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86c8102790 0x7f86c81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:55.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.533+0000 7f86ccd61640 1 --2- 172.21.15.1:0/1681526290 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86c8101de0 0x7f86c81021c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:55.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.533+0000 7f86ccd61640 1 -- 172.21.15.1:0/1681526290 >> 172.21.15.1:0/1681526290 conn(0x7f86c80fd8c0 msgr2=0x7f86c80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:55.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.533+0000 7f86ccd61640 1 -- 172.21.15.1:0/1681526290 shutdown_connections 2024-09-19T09:37:55.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.533+0000 7f86ccd61640 1 -- 172.21.15.1:0/1681526290 wait complete. 2024-09-19T09:37:55.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.533+0000 7f86ccd61640 1 Processor -- start 2024-09-19T09:37:55.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.533+0000 7f86ccd61640 1 -- start start 2024-09-19T09:37:55.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.534+0000 7f86ccd61640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86c8101de0 0x7f86c81984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:55.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.534+0000 7f86ccd61640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86c8102790 0x7f86c81989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:55.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.534+0000 7f86ccd61640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86c8106f10 0x7f86c819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:55.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.534+0000 7f86ccd61640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f86c8111f90 con 0x7f86c8101de0 2024-09-19T09:37:55.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.534+0000 7f86ccd61640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f86c8111e10 con 0x7f86c8102790 2024-09-19T09:37:55.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.534+0000 7f86ccd61640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f86c8112110 con 0x7f86c8106f10 2024-09-19T09:37:55.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.534+0000 7f86c659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86c8101de0 0x7f86c81984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:55.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.534+0000 7f86c659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86c8101de0 0x7f86c81984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48906/0 (socket says 172.21.15.1:48906) 2024-09-19T09:37:55.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.534+0000 7f86c659c640 1 -- 172.21.15.1:0/3438630164 learned_addr learned my addr 172.21.15.1:0/3438630164 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:55.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.534+0000 7f86c5d9b640 1 --2- 172.21.15.1:0/3438630164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86c8102790 0x7f86c81989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:55.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.534+0000 7f86c6d9d640 1 --2- 172.21.15.1:0/3438630164 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86c8106f10 0x7f86c819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:55.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.534+0000 7f86c659c640 1 -- 172.21.15.1:0/3438630164 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86c8106f10 msgr2=0x7f86c819cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:55.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.534+0000 7f86c659c640 1 --2- 172.21.15.1:0/3438630164 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86c8106f10 0x7f86c819cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:55.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.534+0000 7f86c659c640 1 -- 172.21.15.1:0/3438630164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86c8102790 msgr2=0x7f86c81989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:55.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.534+0000 7f86c659c640 1 --2- 172.21.15.1:0/3438630164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86c8102790 0x7f86c81989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:55.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.534+0000 7f86c659c640 1 -- 172.21.15.1:0/3438630164 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c819d460 con 0x7f86c8101de0 2024-09-19T09:37:55.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.534+0000 7f86c659c640 1 --2- 172.21.15.1:0/3438630164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86c8101de0 0x7f86c81984b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f86b8005ab0 tx=0x7f86b80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:55.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.535+0000 7f86b77fe640 1 -- 172.21.15.1:0/3438630164 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b803f030 con 0x7f86c8101de0 2024-09-19T09:37:55.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.535+0000 7f86ccd61640 1 -- 172.21.15.1:0/3438630164 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86c819d6f0 con 0x7f86c8101de0 2024-09-19T09:37:55.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.535+0000 7f86b77fe640 1 -- 172.21.15.1:0/3438630164 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86b8003ce0 con 0x7f86c8101de0 2024-09-19T09:37:55.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.535+0000 7f86b77fe640 1 -- 172.21.15.1:0/3438630164 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b8035070 con 0x7f86c8101de0 2024-09-19T09:37:55.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.535+0000 7f86ccd61640 1 -- 172.21.15.1:0/3438630164 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86c81a5030 con 0x7f86c8101de0 2024-09-19T09:37:55.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.536+0000 7f86ccd61640 1 -- 172.21.15.1:0/3438630164 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86c81021c0 con 0x7f86c8101de0 2024-09-19T09:37:55.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.537+0000 7f86b77fe640 1 -- 172.21.15.1:0/3438630164 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f86b8042030 con 0x7f86c8101de0 2024-09-19T09:37:55.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.537+0000 7f86b77fe640 1 --2- 172.21.15.1:0/3438630164 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f86b00a3240 0x7f86b00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:55.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.538+0000 7f86c5d9b640 1 --2- 172.21.15.1:0/3438630164 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f86b00a3240 0x7f86b00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:55.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.538+0000 7f86b77fe640 1 -- 172.21.15.1:0/3438630164 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f86b80f03a0 con 0x7f86c8101de0 2024-09-19T09:37:55.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.538+0000 7f86c5d9b640 1 --2- 172.21.15.1:0/3438630164 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f86b00a3240 0x7f86b00a5700 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f86c80fdd70 tx=0x7f86bc00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:55.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.541+0000 7f86b77fe640 1 -- 172.21.15.1:0/3438630164 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f86b80bca70 con 0x7f86c8101de0 2024-09-19T09:37:55.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.719+0000 7f86ccd61640 1 -- 172.21.15.1:0/3438630164 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f86c810a0f0 con 0x7f86c8101de0 2024-09-19T09:37:55.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.720+0000 7f86b77fe640 1 -- 172.21.15.1:0/3438630164 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22612 (secure 0 0 0) 0x7f86b80c0d70 con 0x7f86c8101de0 2024-09-19T09:37:55.722 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:37:55.722 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":83,"fsid":"57238232-7669-11ef-bceb-c7b262605968","created":"2024-09-19T09:28:28.406983+0000","modified":"2024-09-19T09:37:16.024965+0000","last_up_change":"2024-09-19T09:35:21.422825+0000","last_in_change":"2024-09-19T09:34:57.199184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:31:30.566509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:36:09.521275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:36:11.954337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c165571d-43f1-4c43-ba1e-35872d914f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6803","nonce":502676986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6805","nonce":502676986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6809","nonce":502676986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6807","nonce":502676986}]},"public_addr":"172.21.15.1:6803/502676986","cluster_addr":"172.21.15.1:6805/502676986","heartbeat_back_addr":"172.21.15.1:6809/502676986","heartbeat_front_addr":"172.21.15.1:6807/502676986","state":["exists","up"]},{"osd":1,"uuid":"baf120f8-8ba3-4aa5-a12a-41cdc97ff11b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6801","nonce":3735826323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6803","nonce":3735826323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6807","nonce":3735826323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6805","nonce":3735826323}]},"public_addr":"172.21.15.22:6801/3735826323","cluster_addr":"172.21.15.22:6803/3735826323","heartbeat_back_addr":"172.21.15.22:6807/3735826323","heartbeat_front_addr":"172.21.15.22:6805/3735826323","state":["exists","up"]},{"osd":2,"uuid":"72c520bf-c5cc-44ee-a38c-c9bac0a6280b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6801","nonce":1924970833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6803","nonce":1924970833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6807","nonce":1924970833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6805","nonce":1924970833}]},"public_addr":"172.21.15.121:6801/1924970833","cluster_addr":"172.21.15.121:6803/1924970833","heartbeat_back_addr":"172.21.15.121:6807/1924970833","heartbeat_front_addr":"172.21.15.121:6805/1924970833","state":["exists","up"]},{"osd":3,"uuid":"adad6d17-16d9-4c43-b581-35ac1bb9d807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6811","nonce":1515009793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6813","nonce":1515009793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6817","nonce":1515009793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6815","nonce":1515009793}]},"public_addr":"172.21.15.1:6811/1515009793","cluster_addr":"172.21.15.1:6813/1515009793","heartbeat_back_addr":"172.21.15.1:6817/1515009793","heartbeat_front_addr":"172.21.15.1:6815/1515009793","state":["exists","up"]},{"osd":4,"uuid":"8fb06efe-c3a0-48a3-9730-3e8f3e60922d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6809","nonce":923697266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6811","nonce":923697266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6815","nonce":923697266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6813","nonce":923697266}]},"public_addr":"172.21.15.22:6809/923697266","cluster_addr":"172.21.15.22:6811/923697266","heartbeat_back_addr":"172.21.15.22:6815/923697266","heartbeat_front_addr":"172.21.15.22:6813/923697266","state":["exists","up"]},{"osd":5,"uuid":"3b2f428c-8a5a-49be-9f43-a9f379a1c7e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6809","nonce":3137245658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6811","nonce":3137245658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6815","nonce":3137245658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6813","nonce":3137245658}]},"public_addr":"172.21.15.121:6809/3137245658","cluster_addr":"172.21.15.121:6811/3137245658","heartbeat_back_addr":"172.21.15.121:6815/3137245658","heartbeat_front_addr":"172.21.15.121:6813/3137245658","state":["exists","up"]},{"osd":6,"uuid":"5aecec68-ff7e-440c-bd39-cc35ab89cc91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6819","nonce":3376780798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6821","nonce":3376780798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6825","nonce":3376780798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6823","nonce":3376780798}]},"public_addr":"172.21.15.1:6819/3376780798","cluster_addr":"172.21.15.1:6821/3376780798","heartbeat_back_addr":"172.21.15.1:6825/3376780798","heartbeat_front_addr":"172.21.15.1:6823/3376780798","state":["exists","up"]},{"osd":7,"uuid":"46556bdf-199e-4268-873b-6d87b54e1176","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6817","nonce":2920985295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6819","nonce":2920985295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6823","nonce":2920985295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6821","nonce":2920985295}]},"public_addr":"172.21.15.22:6817/2920985295","cluster_addr":"172.21.15.22:6819/2920985295","heartbeat_back_addr":"172.21.15.22:6823/2920985295","heartbeat_front_addr":"172.21.15.22:6821/2920985295","state":["exists","up"]},{"osd":8,"uuid":"e7c3792a-94a4-4440-be74-d6abdf3d9566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6817","nonce":3589985967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6819","nonce":3589985967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6823","nonce":3589985967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6821","nonce":3589985967}]},"public_addr":"172.21.15.121:6817/3589985967","cluster_addr":"172.21.15.121:6819/3589985967","heartbeat_back_addr":"172.21.15.121:6823/3589985967","heartbeat_front_addr":"172.21.15.121:6821/3589985967","state":["exists","up"]},{"osd":9,"uuid":"8af80ac9-d681-4966-b083-ead5185eff12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6827","nonce":1143859822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6829","nonce":1143859822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6833","nonce":1143859822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6831","nonce":1143859822}]},"public_addr":"172.21.15.1:6827/1143859822","cluster_addr":"172.21.15.1:6829/1143859822","heartbeat_back_addr":"172.21.15.1:6833/1143859822","heartbeat_front_addr":"172.21.15.1:6831/1143859822","state":["exists","up"]},{"osd":10,"uuid":"34edd06a-7f60-4465-bfe1-0c646abd53f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6825","nonce":343155547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6827","nonce":343155547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6831","nonce":343155547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6829","nonce":343155547}]},"public_addr":"172.21.15.22:6825/343155547","cluster_addr":"172.21.15.22:6827/343155547","heartbeat_back_addr":"172.21.15.22:6831/343155547","heartbeat_front_addr":"172.21.15.22:6829/343155547","state":["exists","up"]},{"osd":11,"uuid":"5a831eb6-ad66-4ab6-a30a-b6299ce1f88d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6825","nonce":3202514460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6827","nonce":3202514460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6831","nonce":3202514460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6829","nonce":3202514460}]},"public_addr":"172.21.15.121:6825/3202514460","cluster_addr":"172.21.15.121:6827/3202514460","heartbeat_back_addr":"172.21.15.121:6831/3202514460","heartbeat_front_addr":"172.21.15.121:6829/3202514460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:30:37.582893+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:01.915252+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:26.783477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:53.407014+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:19.407005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:45.022320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:11.377986+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:36.818700+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:01.745428+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:27.928916+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:53.363906+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:19.037551+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6800/1028873727":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/3137949087":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/1951370933":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2008363642":"2024-09-20T09:28:50.074985+0000","172.21.15.1:0/3006931063":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2486161758":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6801/1296304385":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6801/1028873727":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2783823049":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6800/1296304385":"2024-09-20T09:28:50.074985+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:37:55.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.722+0000 7f86ccd61640 1 -- 172.21.15.1:0/3438630164 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f86b00a3240 msgr2=0x7f86b00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:55.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.722+0000 7f86ccd61640 1 --2- 172.21.15.1:0/3438630164 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f86b00a3240 0x7f86b00a5700 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f86c80fdd70 tx=0x7f86bc00a2d0 comp rx=0 tx=0).stop 2024-09-19T09:37:55.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.722+0000 7f86ccd61640 1 -- 172.21.15.1:0/3438630164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86c8101de0 msgr2=0x7f86c81984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:55.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.722+0000 7f86ccd61640 1 --2- 172.21.15.1:0/3438630164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86c8101de0 0x7f86c81984b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f86b8005ab0 tx=0x7f86b80042f0 comp rx=0 tx=0).stop 2024-09-19T09:37:55.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.722+0000 7f86ccd61640 1 -- 172.21.15.1:0/3438630164 shutdown_connections 2024-09-19T09:37:55.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.722+0000 7f86ccd61640 1 --2- 172.21.15.1:0/3438630164 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86c8106f10 0x7f86c819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:55.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.722+0000 7f86ccd61640 1 --2- 172.21.15.1:0/3438630164 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f86b00a3240 0x7f86b00a5700 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:55.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.722+0000 7f86ccd61640 1 --2- 172.21.15.1:0/3438630164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86c8102790 0x7f86c81989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:55.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.722+0000 7f86ccd61640 1 --2- 172.21.15.1:0/3438630164 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86c8101de0 0x7f86c81984b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:55.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.722+0000 7f86ccd61640 1 -- 172.21.15.1:0/3438630164 >> 172.21.15.1:0/3438630164 conn(0x7f86c80fd8c0 msgr2=0x7f86c80fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:55.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.723+0000 7f86ccd61640 1 -- 172.21.15.1:0/3438630164 shutdown_connections 2024-09-19T09:37:55.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:55.723+0000 7f86ccd61640 1 -- 172.21.15.1:0/3438630164 wait complete. 2024-09-19T09:37:56.416 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:56 smithi022 ceph-mon[35583]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:37:56.416 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:56 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/3438630164' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:37:56.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:56 smithi001 ceph-mon[31225]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:37:56.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:56 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/3438630164' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:37:56.576 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T09:36:13.637508+0000', 'modified': '2024-09-19T09:36:23.723388+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24497}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24490': {'gid': 24490, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.121:6839/3279971690', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6838', 'nonce': 3279971690}, {'type': 'v1', 'addr': '172.21.15.121:6839', 'nonce': 3279971690}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24497': {'gid': 24497, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.22:6839/2513831228', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6838', 'nonce': 2513831228}, {'type': 'v1', 'addr': '172.21.15.22:6839', 'nonce': 2513831228}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24497, 'qdb_cluster': [24497]} 2024-09-19T09:37:56.576 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T09:37:56.576 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T09:37:56.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:56 smithi121 ceph-mon[35577]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:37:56.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:56 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/3438630164' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:37:56.837 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:57.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.295+0000 7f84d4ea9640 1 -- 172.21.15.1:0/3788258205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84d0106f10 msgr2=0x7f84d010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:57.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.295+0000 7f84d4ea9640 1 --2- 172.21.15.1:0/3788258205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84d0106f10 0x7f84d010ea90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f84c8009ca0 tx=0x7f84c802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.295+0000 7f84d4ea9640 1 -- 172.21.15.1:0/3788258205 shutdown_connections 2024-09-19T09:37:57.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.295+0000 7f84d4ea9640 1 --2- 172.21.15.1:0/3788258205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84d0106f10 0x7f84d010ea90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.295+0000 7f84d4ea9640 1 --2- 172.21.15.1:0/3788258205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84d0102790 0x7f84d01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.295+0000 7f84d4ea9640 1 --2- 172.21.15.1:0/3788258205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84d0101de0 0x7f84d01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.295+0000 7f84d4ea9640 1 -- 172.21.15.1:0/3788258205 >> 172.21.15.1:0/3788258205 conn(0x7f84d00fd8c0 msgr2=0x7f84d00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:57.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.295+0000 7f84d4ea9640 1 -- 172.21.15.1:0/3788258205 shutdown_connections 2024-09-19T09:37:57.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.295+0000 7f84d4ea9640 1 -- 172.21.15.1:0/3788258205 wait complete. 2024-09-19T09:37:57.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.296+0000 7f84d4ea9640 1 Processor -- start 2024-09-19T09:37:57.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.296+0000 7f84d4ea9640 1 -- start start 2024-09-19T09:37:57.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.296+0000 7f84d4ea9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84d0101de0 0x7f84d0198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:57.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.296+0000 7f84d4ea9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84d0102790 0x7f84d01988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:57.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.296+0000 7f84d4ea9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84d0106f10 0x7f84d019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:57.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.296+0000 7f84d4ea9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f84d0111f70 con 0x7f84d0102790 2024-09-19T09:37:57.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.296+0000 7f84d4ea9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f84d0111df0 con 0x7f84d0101de0 2024-09-19T09:37:57.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.296+0000 7f84d4ea9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f84d01120f0 con 0x7f84d0106f10 2024-09-19T09:37:57.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.296+0000 7f84cdd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84d0102790 0x7f84d01988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:57.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.296+0000 7f84cdd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84d0102790 0x7f84d01988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48922/0 (socket says 172.21.15.1:48922) 2024-09-19T09:37:57.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.296+0000 7f84cdd9b640 1 -- 172.21.15.1:0/4044852686 learned_addr learned my addr 172.21.15.1:0/4044852686 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:57.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.296+0000 7f84ce59c640 1 --2- 172.21.15.1:0/4044852686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84d0101de0 0x7f84d0198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:57.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.296+0000 7f84ced9d640 1 --2- 172.21.15.1:0/4044852686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84d0106f10 0x7f84d019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:57.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.297+0000 7f84cdd9b640 1 -- 172.21.15.1:0/4044852686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84d0106f10 msgr2=0x7f84d019cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:57.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.297+0000 7f84cdd9b640 1 --2- 172.21.15.1:0/4044852686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84d0106f10 0x7f84d019cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.297+0000 7f84cdd9b640 1 -- 172.21.15.1:0/4044852686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84d0101de0 msgr2=0x7f84d0198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:57.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.297+0000 7f84cdd9b640 1 --2- 172.21.15.1:0/4044852686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84d0101de0 0x7f84d0198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.297+0000 7f84cdd9b640 1 -- 172.21.15.1:0/4044852686 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84d019d340 con 0x7f84d0102790 2024-09-19T09:37:57.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.297+0000 7f84ce59c640 1 --2- 172.21.15.1:0/4044852686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84d0101de0 0x7f84d0198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:37:57.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.297+0000 7f84cdd9b640 1 --2- 172.21.15.1:0/4044852686 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84d0102790 0x7f84d01988d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f84b800d950 tx=0x7f84b800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:57.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.297+0000 7f84c77fe640 1 -- 172.21.15.1:0/4044852686 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b8017070 con 0x7f84d0102790 2024-09-19T09:37:57.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.297+0000 7f84c77fe640 1 -- 172.21.15.1:0/4044852686 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84b8009c30 con 0x7f84d0102790 2024-09-19T09:37:57.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.297+0000 7f84d4ea9640 1 -- 172.21.15.1:0/4044852686 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84d019d630 con 0x7f84d0102790 2024-09-19T09:37:57.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.297+0000 7f84c77fe640 1 -- 172.21.15.1:0/4044852686 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b800f6b0 con 0x7f84d0102790 2024-09-19T09:37:57.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.297+0000 7f84d4ea9640 1 -- 172.21.15.1:0/4044852686 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84d01a4f10 con 0x7f84d0102790 2024-09-19T09:37:57.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.299+0000 7f84c77fe640 1 -- 172.21.15.1:0/4044852686 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f84b80109d0 con 0x7f84d0102790 2024-09-19T09:37:57.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.300+0000 7f84d7282740 1 Processor -- start 2024-09-19T09:37:57.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.300+0000 7f84d7282740 1 -- start start 2024-09-19T09:37:57.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.300+0000 7f84d7282740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635659cb9d0 0x5635659cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:57.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.300+0000 7f84d7282740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5635659cc2f0 0x5635659d6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:57.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.300+0000 7f84d7282740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635659d6bb0 0x5635659d8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:57.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.300+0000 7f84d7282740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563565932090 con 0x5635659cc2f0 2024-09-19T09:37:57.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.300+0000 7f84d7282740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5635658d9a70 con 0x5635659d6bb0 2024-09-19T09:37:57.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.300+0000 7f84d7282740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56356592e050 con 0x5635659cb9d0 2024-09-19T09:37:57.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.300+0000 7f84c77fe640 1 --2- 172.21.15.1:0/4044852686 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f84bc0a3340 0x7f84bc0a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:57.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.300+0000 7f84ce59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5635659cc2f0 0x5635659d6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:57.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.300+0000 7f84ce59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5635659cc2f0 0x5635659d6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48936/0 (socket says 172.21.15.1:48936) 2024-09-19T09:37:57.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.300+0000 7f84ce59c640 1 -- 172.21.15.1:0/1345977676 learned_addr learned my addr 172.21.15.1:0/1345977676 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:57.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.300+0000 7f84cdd9b640 1 --2- 172.21.15.1:0/1345977676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635659d6bb0 0x5635659d8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:57.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.300+0000 7f84ced9d640 1 --2- 172.21.15.1:0/1345977676 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635659cb9d0 0x5635659cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:57.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.301+0000 7f84c77fe640 1 -- 172.21.15.1:0/4044852686 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f84b80cf3f0 con 0x7f84d0102790 2024-09-19T09:37:57.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.301+0000 7f84ced9d640 1 --2- 172.21.15.1:0/4044852686 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f84bc0a3340 0x7f84bc0a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:57.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.301+0000 7f84ce59c640 1 -- 172.21.15.1:0/1345977676 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635659cb9d0 msgr2=0x5635659cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:57.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.301+0000 7f84ce59c640 1 --2- 172.21.15.1:0/1345977676 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635659cb9d0 0x5635659cbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.301+0000 7f84ce59c640 1 -- 172.21.15.1:0/1345977676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635659d6bb0 msgr2=0x5635659d8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:57.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.301+0000 7f84ce59c640 1 --2- 172.21.15.1:0/1345977676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635659d6bb0 0x5635659d8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.301+0000 7f84ce59c640 1 -- 172.21.15.1:0/1345977676 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635658e6130 con 0x5635659cc2f0 2024-09-19T09:37:57.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.301+0000 7f84cdd9b640 1 --2- 172.21.15.1:0/1345977676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635659d6bb0 0x5635659d8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:37:57.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.301+0000 7f84ce59c640 1 --2- 172.21.15.1:0/1345977676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5635659cc2f0 0x5635659d6670 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f84c0010480 tx=0x7f84c0010940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=324e73732fc1ef24 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:57.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.301+0000 7f84ced9d640 1 --2- 172.21.15.1:0/4044852686 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f84bc0a3340 0x7f84bc0a5800 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f84c8004af0 tx=0x7f84c8004a80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:57.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.301+0000 7f84c4ff9640 1 -- 172.21.15.1:0/1345977676 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c0011760 con 0x5635659cc2f0 2024-09-19T09:37:57.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.301+0000 7f84c4ff9640 1 -- 172.21.15.1:0/1345977676 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84c0011de0 con 0x5635659cc2f0 2024-09-19T09:37:57.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.301+0000 7f84c4ff9640 1 -- 172.21.15.1:0/1345977676 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c000e430 con 0x5635659cc2f0 2024-09-19T09:37:57.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.302+0000 7f84d7282740 1 -- 172.21.15.1:0/1345977676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5635659cc2f0 msgr2=0x5635659d6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:57.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.302+0000 7f84d7282740 1 --2- 172.21.15.1:0/1345977676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5635659cc2f0 0x5635659d6670 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f84c0010480 tx=0x7f84c0010940 comp rx=0 tx=0).stop 2024-09-19T09:37:57.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.302+0000 7f84d7282740 1 -- 172.21.15.1:0/1345977676 shutdown_connections 2024-09-19T09:37:57.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.302+0000 7f84d7282740 1 --2- 172.21.15.1:0/1345977676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635659d6bb0 0x5635659d8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.302+0000 7f84d7282740 1 --2- 172.21.15.1:0/1345977676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5635659cc2f0 0x5635659d6670 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.302+0000 7f84d7282740 1 --2- 172.21.15.1:0/1345977676 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635659cb9d0 0x5635659cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.302+0000 7f84d7282740 1 -- 172.21.15.1:0/1345977676 >> 172.21.15.1:0/1345977676 conn(0x5635659c7f60 msgr2=0x5635659c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:57.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.302+0000 7f84d7282740 1 -- 172.21.15.1:0/1345977676 shutdown_connections 2024-09-19T09:37:57.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.302+0000 7f84d7282740 1 -- 172.21.15.1:0/1345977676 wait complete. 2024-09-19T09:37:57.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.302+0000 7f84d7282740 1 -- start start 2024-09-19T09:37:57.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.303+0000 7f84d7282740 1 Processor -- start 2024-09-19T09:37:57.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.303+0000 7f84d7282740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635659cb9d0 0x5635659d6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:57.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.303+0000 7f84d7282740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635659cc2f0 0x5635659d3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:57.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.303+0000 7f84d7282740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5635659d6bb0 0x5635659d3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:57.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.303+0000 7f84d7282740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5635659d9780 con 0x5635659d6bb0 2024-09-19T09:37:57.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.303+0000 7f84d7282740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5635658ecf20 con 0x5635659cb9d0 2024-09-19T09:37:57.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.303+0000 7f84d7282740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5635659d9900 con 0x5635659cc2f0 2024-09-19T09:37:57.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.303+0000 7f84d7282740 10 client.0 _ll_register_callbacks cb 0x5635658b6030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:57.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.303+0000 7f84ced9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5635659d6bb0 0x5635659d3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:57.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.303+0000 7f84ced9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5635659d6bb0 0x5635659d3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48940/0 (socket says 172.21.15.1:48940) 2024-09-19T09:37:57.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.303+0000 7f84ced9d640 1 -- 172.21.15.1:0/64620797 learned_addr learned my addr 172.21.15.1:0/64620797 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:57.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.303+0000 7f84cdd9b640 1 --2- 172.21.15.1:0/64620797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635659cc2f0 0x5635659d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:57.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.303+0000 7f84ce59c640 1 --2- 172.21.15.1:0/64620797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635659cb9d0 0x5635659d6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:57.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.303+0000 7f84ced9d640 1 -- 172.21.15.1:0/64620797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635659cc2f0 msgr2=0x5635659d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:57.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.303+0000 7f84ced9d640 1 --2- 172.21.15.1:0/64620797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635659cc2f0 0x5635659d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.303+0000 7f84ced9d640 1 -- 172.21.15.1:0/64620797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635659cb9d0 msgr2=0x5635659d6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:57.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.303+0000 7f84ced9d640 1 --2- 172.21.15.1:0/64620797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635659cb9d0 0x5635659d6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.303+0000 7f84ced9d640 1 -- 172.21.15.1:0/64620797 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635656a32b0 con 0x5635659d6bb0 2024-09-19T09:37:57.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.303+0000 7f84ced9d640 1 --2- 172.21.15.1:0/64620797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5635659d6bb0 0x5635659d3ca0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f84c8035000 tx=0x7f84c80095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86018dd8080add70 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:57.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.303+0000 7f84b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:37:57.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.304+0000 7f84b5ffb640 1 -- 172.21.15.1:0/64620797 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c80305c0 con 0x5635659d6bb0 2024-09-19T09:37:57.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.304+0000 7f84b5ffb640 1 -- 172.21.15.1:0/64620797 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f84c8030760 con 0x5635659d6bb0 2024-09-19T09:37:57.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.304+0000 7f84d7282740 1 -- 172.21.15.1:0/64620797 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84c0011de0 con 0x5635659d6bb0 2024-09-19T09:37:57.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.304+0000 7f84b5ffb640 1 -- 172.21.15.1:0/64620797 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f84c8030960 con 0x5635659d6bb0 2024-09-19T09:37:57.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.304+0000 7f84d7282740 10 client.15054 fetch_fsmap learned FSMap version 19 2024-09-19T09:37:57.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.304+0000 7f84d7282740 1 -- 172.21.15.1:0/64620797 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5635659e5070 con 0x5635659d6bb0 2024-09-19T09:37:57.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.304+0000 7f84b5ffb640 1 -- 172.21.15.1:0/64620797 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84c0011de0 con 0x5635659d6bb0 2024-09-19T09:37:57.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.304+0000 7f84b5ffb640 1 -- 172.21.15.1:0/64620797 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f84c8048b60 con 0x5635659d6bb0 2024-09-19T09:37:57.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.304+0000 7f84d7282740 10 client.15054 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:37:57.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.304+0000 7f84d7282740 10 client.15054 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:37:57.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.304+0000 7f84d7282740 20 client.15054 populate_metadata read hostname 'smithi001' 2024-09-19T09:37:57.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.304+0000 7f84d7282740 1 --2- 172.21.15.1:0/64620797 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5635659e7730 0x5635659e8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:57.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.304+0000 7f84d7282740 4 client.15054 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:37:57.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.304+0000 7f84d7282740 1 -- 172.21.15.1:0/64620797 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56356593f600 con 0x5635659e7730 2024-09-19T09:37:57.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.305+0000 7f84ce59c640 1 --2- 172.21.15.1:0/64620797 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5635659e7730 0x5635659e8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:57.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.305+0000 7f84ce59c640 1 --2- 172.21.15.1:0/64620797 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5635659e7730 0x5635659e8ba0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b56d586b65fe6d9 server_cookie=c17b01bedf765384 in_seq=0 out_seq=0 2024-09-19T09:37:57.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.305+0000 7f84b5ffb640 10 client.15054 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:37:57.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.306+0000 7f84b5ffb640 1 -- 172.21.15.1:0/64620797 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56356593f600 con 0x5635659e7730 2024-09-19T09:37:57.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.306+0000 7f84b5ffb640 10 client.15054 handle_command_reply: tid=0 2024-09-19T09:37:57.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.306+0000 7f84d7282740 1 client.15054 shutdown 2024-09-19T09:37:57.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.306+0000 7f84d7282740 1 -- 172.21.15.1:0/64620797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5635659d6bb0 msgr2=0x5635659d3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:57.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.306+0000 7f84d7282740 1 --2- 172.21.15.1:0/64620797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5635659d6bb0 0x5635659d3ca0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f84c8035000 tx=0x7f84c80095c0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.306+0000 7f84d7282740 1 -- 172.21.15.1:0/64620797 shutdown_connections 2024-09-19T09:37:57.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.306+0000 7f84d7282740 1 --2- 172.21.15.1:0/64620797 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5635659e7730 0x5635659e8ba0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.306+0000 7f84d7282740 1 --2- 172.21.15.1:0/64620797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5635659d6bb0 0x5635659d3ca0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.306+0000 7f84d7282740 1 --2- 172.21.15.1:0/64620797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635659cc2f0 0x5635659d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.306+0000 7f84b5ffb640 0 client.15054 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:37:57.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.306+0000 7f84d7282740 1 --2- 172.21.15.1:0/64620797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635659cb9d0 0x5635659d6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.306+0000 7f84d7282740 1 -- 172.21.15.1:0/64620797 >> 172.21.15.1:0/64620797 conn(0x5635659c7f60 msgr2=0x5635659cdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:57.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.306+0000 7f84d7282740 1 -- 172.21.15.1:0/64620797 shutdown_connections 2024-09-19T09:37:57.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.306+0000 7f84d7282740 1 -- 172.21.15.1:0/64620797 wait complete. 2024-09-19T09:37:57.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.306+0000 7f84d7282740 20 client.15054 trim_cache size 0 max 16384 2024-09-19T09:37:57.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.324+0000 7f84d7282740 1 Processor -- start 2024-09-19T09:37:57.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.324+0000 7f84d7282740 1 -- start start 2024-09-19T09:37:57.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.324+0000 7f84d7282740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635659cb9d0 0x5635659c8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:57.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.324+0000 7f84d7282740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5635659cc2f0 0x5635659d2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:57.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.324+0000 7f84d7282740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635659d6bb0 0x5635659d2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:57.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.324+0000 7f84d7282740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5635659e6ee0 con 0x5635659cc2f0 2024-09-19T09:37:57.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.324+0000 7f84d7282740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5635659e75b0 con 0x5635659d6bb0 2024-09-19T09:37:57.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.324+0000 7f84d7282740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5635659e7c80 con 0x5635659cb9d0 2024-09-19T09:37:57.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.325+0000 7f84cdd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5635659cc2f0 0x5635659d2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:57.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.325+0000 7f84cdd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5635659cc2f0 0x5635659d2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48952/0 (socket says 172.21.15.1:48952) 2024-09-19T09:37:57.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.325+0000 7f84cdd9b640 1 -- 172.21.15.1:0/2823545114 learned_addr learned my addr 172.21.15.1:0/2823545114 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:57.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.325+0000 7f84ce59c640 1 --2- 172.21.15.1:0/2823545114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635659cb9d0 0x5635659c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:57.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.325+0000 7f84ced9d640 1 --2- 172.21.15.1:0/2823545114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635659d6bb0 0x5635659d2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:57.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.325+0000 7f84cdd9b640 1 -- 172.21.15.1:0/2823545114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635659cb9d0 msgr2=0x5635659c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:57.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.325+0000 7f84cdd9b640 1 --2- 172.21.15.1:0/2823545114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635659cb9d0 0x5635659c8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.325+0000 7f84cdd9b640 1 -- 172.21.15.1:0/2823545114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635659d6bb0 msgr2=0x5635659d2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:57.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.325+0000 7f84cdd9b640 1 --2- 172.21.15.1:0/2823545114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635659d6bb0 0x5635659d2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.325+0000 7f84cdd9b640 1 -- 172.21.15.1:0/2823545114 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635659d6780 con 0x5635659cc2f0 2024-09-19T09:37:57.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.325+0000 7f84cdd9b640 1 --2- 172.21.15.1:0/2823545114 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5635659cc2f0 0x5635659d2030 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f84b8098450 tx=0x7f84b80c67a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e45f2e28b83c5eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:57.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.325+0000 7f84b7fff640 1 -- 172.21.15.1:0/2823545114 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b8020040 con 0x5635659cc2f0 2024-09-19T09:37:57.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.325+0000 7f84b7fff640 1 -- 172.21.15.1:0/2823545114 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84b809fd80 con 0x5635659cc2f0 2024-09-19T09:37:57.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.325+0000 7f84b7fff640 1 -- 172.21.15.1:0/2823545114 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b806a830 con 0x5635659cc2f0 2024-09-19T09:37:57.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.326+0000 7f84d7282740 1 -- 172.21.15.1:0/2823545114 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5635659cc2f0 msgr2=0x5635659d2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:57.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.326+0000 7f84d7282740 1 --2- 172.21.15.1:0/2823545114 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5635659cc2f0 0x5635659d2030 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f84b8098450 tx=0x7f84b80c67a0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.326+0000 7f84d7282740 1 -- 172.21.15.1:0/2823545114 shutdown_connections 2024-09-19T09:37:57.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.326+0000 7f84d7282740 1 --2- 172.21.15.1:0/2823545114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635659d6bb0 0x5635659d2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.326+0000 7f84d7282740 1 --2- 172.21.15.1:0/2823545114 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5635659cc2f0 0x5635659d2030 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.326+0000 7f84d7282740 1 --2- 172.21.15.1:0/2823545114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635659cb9d0 0x5635659c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.326+0000 7f84d7282740 1 -- 172.21.15.1:0/2823545114 >> 172.21.15.1:0/2823545114 conn(0x5635659c7f60 msgr2=0x5635659e63c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:57.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.326+0000 7f84d7282740 1 -- 172.21.15.1:0/2823545114 shutdown_connections 2024-09-19T09:37:57.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.326+0000 7f84d7282740 1 -- 172.21.15.1:0/2823545114 wait complete. 2024-09-19T09:37:57.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.326+0000 7f84d7282740 1 -- start start 2024-09-19T09:37:57.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.327+0000 7f84d7282740 1 Processor -- start 2024-09-19T09:37:57.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.327+0000 7f84d7282740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635659cb9d0 0x5635659ec570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:57.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.327+0000 7f84d7282740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635659cc2f0 0x5635659ecab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:57.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.327+0000 7f84d7282740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5635659d6bb0 0x563565a49e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:57.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.327+0000 7f84d7282740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5635659e8a20 con 0x5635659d6bb0 2024-09-19T09:37:57.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.327+0000 7f84d7282740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5635659e8350 con 0x5635659cb9d0 2024-09-19T09:37:57.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.327+0000 7f84d7282740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5635659e90f0 con 0x5635659cc2f0 2024-09-19T09:37:57.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.327+0000 7f84d7282740 10 client.0 _ll_register_callbacks cb 0x7f84c8031520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:37:57.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.327+0000 7f84ced9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5635659d6bb0 0x563565a49e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:57.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.327+0000 7f84ced9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5635659d6bb0 0x563565a49e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48962/0 (socket says 172.21.15.1:48962) 2024-09-19T09:37:57.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.327+0000 7f84ced9d640 1 -- 172.21.15.1:0/2649927811 learned_addr learned my addr 172.21.15.1:0/2649927811 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:57.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.327+0000 7f84ce59c640 1 --2- 172.21.15.1:0/2649927811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635659cb9d0 0x5635659ec570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:57.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.327+0000 7f84cdd9b640 1 --2- 172.21.15.1:0/2649927811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635659cc2f0 0x5635659ecab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:57.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.327+0000 7f84ced9d640 1 -- 172.21.15.1:0/2649927811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635659cc2f0 msgr2=0x5635659ecab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:57.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.327+0000 7f84ced9d640 1 --2- 172.21.15.1:0/2649927811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635659cc2f0 0x5635659ecab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.327+0000 7f84ced9d640 1 -- 172.21.15.1:0/2649927811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635659cb9d0 msgr2=0x5635659ec570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:37:57.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.327+0000 7f84ced9d640 1 --2- 172.21.15.1:0/2649927811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635659cb9d0 0x5635659ec570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.327+0000 7f84ced9d640 1 -- 172.21.15.1:0/2649927811 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563565a4a510 con 0x5635659d6bb0 2024-09-19T09:37:57.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.328+0000 7f84ced9d640 1 --2- 172.21.15.1:0/2649927811 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5635659d6bb0 0x563565a49e70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f84c8009ca0 tx=0x7f84c8031a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b680429d632ca26b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:57.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.328+0000 7f84b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:37:57.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.328+0000 7f84b5ffb640 1 -- 172.21.15.1:0/2649927811 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84c80527f0 con 0x5635659d6bb0 2024-09-19T09:37:57.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.328+0000 7f84b5ffb640 1 -- 172.21.15.1:0/2649927811 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f84c8004b40 con 0x5635659d6bb0 2024-09-19T09:37:57.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.328+0000 7f84d7282740 1 -- 172.21.15.1:0/2649927811 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84b809fd80 con 0x5635659d6bb0 2024-09-19T09:37:57.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.328+0000 7f84b5ffb640 1 -- 172.21.15.1:0/2649927811 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f84c8004d40 con 0x5635659d6bb0 2024-09-19T09:37:57.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.328+0000 7f84d7282740 10 client.15060 fetch_fsmap learned FSMap version 19 2024-09-19T09:37:57.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.328+0000 7f84d7282740 1 -- 172.21.15.1:0/2649927811 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x563565a51880 con 0x5635659d6bb0 2024-09-19T09:37:57.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.328+0000 7f84b5ffb640 1 -- 172.21.15.1:0/2649927811 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84b809fd80 con 0x5635659d6bb0 2024-09-19T09:37:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.328+0000 7f84b5ffb640 1 -- 172.21.15.1:0/2649927811 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f84c8048430 con 0x5635659d6bb0 2024-09-19T09:37:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.328+0000 7f84d7282740 10 client.15060 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:37:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.328+0000 7f84d7282740 10 client.15060 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:37:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.328+0000 7f84d7282740 20 client.15060 populate_metadata read hostname 'smithi001' 2024-09-19T09:37:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.328+0000 7f84d7282740 1 --2- 172.21.15.1:0/2649927811 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563565a56380 0x563565a55090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.328+0000 7f84d7282740 4 client.15060 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:37:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.328+0000 7f84d7282740 1 -- 172.21.15.1:0/2649927811 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "status"}) -- 0x563565939b10 con 0x563565a56380 2024-09-19T09:37:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.329+0000 7f84ce59c640 1 --2- 172.21.15.1:0/2649927811 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563565a56380 0x563565a55090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.329+0000 7f84ce59c640 1 --2- 172.21.15.1:0/2649927811 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563565a56380 0x563565a55090 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=856cccbdbe3a7bae server_cookie=4b663d2a9cdbc1b9 in_seq=0 out_seq=0 2024-09-19T09:37:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.329+0000 7f84b5ffb640 10 client.15060 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:37:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.329+0000 7f84b5ffb640 1 -- 172.21.15.1:0/2649927811 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x563565939b10 con 0x563565a56380 2024-09-19T09:37:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.329+0000 7f84b5ffb640 10 client.15060 handle_command_reply: tid=0 2024-09-19T09:37:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.329+0000 7f84d7282740 1 client.15060 shutdown 2024-09-19T09:37:57.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.329+0000 7f84d7282740 1 -- 172.21.15.1:0/2649927811 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5635659d6bb0 msgr2=0x563565a49e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:57.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.329+0000 7f84d7282740 1 --2- 172.21.15.1:0/2649927811 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5635659d6bb0 0x563565a49e70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f84c8009ca0 tx=0x7f84c8031a10 comp rx=0 tx=0).stop 2024-09-19T09:37:57.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.329+0000 7f84d7282740 1 -- 172.21.15.1:0/2649927811 shutdown_connections 2024-09-19T09:37:57.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.329+0000 7f84d7282740 1 --2- 172.21.15.1:0/2649927811 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563565a56380 0x563565a55090 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.329+0000 7f84d7282740 1 --2- 172.21.15.1:0/2649927811 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5635659d6bb0 0x563565a49e70 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.329+0000 7f84d7282740 1 --2- 172.21.15.1:0/2649927811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635659cc2f0 0x5635659ecab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.329+0000 7f84d7282740 1 --2- 172.21.15.1:0/2649927811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5635659cb9d0 0x5635659ec570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.329+0000 7f84b5ffb640 0 client.15060 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:37:57.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.329+0000 7f84d7282740 1 -- 172.21.15.1:0/2649927811 >> 172.21.15.1:0/2649927811 conn(0x5635659c7f60 msgr2=0x5635659d1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:57.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.330+0000 7f84d7282740 1 -- 172.21.15.1:0/2649927811 shutdown_connections 2024-09-19T09:37:57.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.330+0000 7f84d7282740 1 -- 172.21.15.1:0/2649927811 wait complete. 2024-09-19T09:37:57.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.330+0000 7f84d7282740 20 client.15060 trim_cache size 0 max 16384 2024-09-19T09:37:57.337 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:37:57.337 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "57238232-7669-11ef-bceb-c7b262605968", 2024-09-19T09:37:57.337 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2024-09-19T09:37:57.337 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24497, 2024-09-19T09:37:57.337 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-19T09:37:57.337 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-19T09:37:57.337 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-19T09:37:57.337 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 103.360401716, 2024-09-19T09:37:57.337 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 19, 2024-09-19T09:37:57.337 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 83, 2024-09-19T09:37:57.337 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T09:37:57.337 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 114.245020298 2024-09-19T09:37:57.337 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:37:57.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.330+0000 7f84d4ea9640 1 -- 172.21.15.1:0/4044852686 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f84bc0a3340 msgr2=0x7f84bc0a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:57.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.330+0000 7f84d4ea9640 1 --2- 172.21.15.1:0/4044852686 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f84bc0a3340 0x7f84bc0a5800 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f84c8004af0 tx=0x7f84c8004a80 comp rx=0 tx=0).stop 2024-09-19T09:37:57.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.330+0000 7f84d4ea9640 1 -- 172.21.15.1:0/4044852686 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84d0102790 msgr2=0x7f84d01988d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:57.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.330+0000 7f84d4ea9640 1 --2- 172.21.15.1:0/4044852686 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84d0102790 0x7f84d01988d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f84b800d950 tx=0x7f84b800de10 comp rx=0 tx=0).stop 2024-09-19T09:37:57.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.330+0000 7f84d4ea9640 1 -- 172.21.15.1:0/4044852686 shutdown_connections 2024-09-19T09:37:57.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.330+0000 7f84d4ea9640 1 --2- 172.21.15.1:0/4044852686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f84d0106f10 0x7f84d019cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.330+0000 7f84d4ea9640 1 --2- 172.21.15.1:0/4044852686 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f84d0102790 0x7f84d01988d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.330+0000 7f84d4ea9640 1 --2- 172.21.15.1:0/4044852686 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f84bc0a3340 0x7f84bc0a5800 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.330+0000 7f84d4ea9640 1 --2- 172.21.15.1:0/4044852686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84d0101de0 0x7f84d0198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:57.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.330+0000 7f84d4ea9640 1 -- 172.21.15.1:0/4044852686 >> 172.21.15.1:0/4044852686 conn(0x7f84d00fd8c0 msgr2=0x7f84d00fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:57.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.330+0000 7f84d4ea9640 1 -- 172.21.15.1:0/4044852686 shutdown_connections 2024-09-19T09:37:57.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:57.330+0000 7f84d4ea9640 1 -- 172.21.15.1:0/4044852686 wait complete. 2024-09-19T09:37:58.039 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T09:37:58.049 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T09:37:58.049 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T09:37:58.050 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T09:37:58.050 INFO:teuthology.run_tasks:Running task kclient... 2024-09-19T09:37:58.104 INFO:tasks.kclient:Mounting kernel clients... 2024-09-19T09:37:58.104 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-19T09:37:58.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:37:58.104 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2024-09-19T09:37:58.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:37:58.123 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link delete ceph-brx 2024-09-19T09:37:58.191 INFO:teuthology.orchestra.run.smithi001.stderr:Cannot find device "ceph-brx" 2024-09-19T09:37:58.192 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:37:58.193 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-19T09:37:58.193 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T09:37:58.193 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:37:58.193 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T09:37:58.488 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:37:58.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:37:58 smithi001 ceph-mon[31225]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:37:58.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:37:58 smithi022 ceph-mon[35583]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:37:58.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:37:58 smithi121 ceph-mon[35577]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:37:59.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.013+0000 7f18aa89d640 1 -- 172.21.15.1:0/1068991845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18a4102790 msgr2=0x7f18a41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:59.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.013+0000 7f18aa89d640 1 --2- 172.21.15.1:0/1068991845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18a4102790 0x7f18a41067e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f188c009900 tx=0x7f188c02a410 comp rx=0 tx=0).stop 2024-09-19T09:37:59.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.013+0000 7f18aa89d640 1 -- 172.21.15.1:0/1068991845 shutdown_connections 2024-09-19T09:37:59.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.013+0000 7f18aa89d640 1 --2- 172.21.15.1:0/1068991845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18a4106f10 0x7f18a410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:59.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.013+0000 7f18aa89d640 1 --2- 172.21.15.1:0/1068991845 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18a4102790 0x7f18a41067e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:59.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.013+0000 7f18aa89d640 1 --2- 172.21.15.1:0/1068991845 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18a4101de0 0x7f18a41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:59.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.013+0000 7f18aa89d640 1 -- 172.21.15.1:0/1068991845 >> 172.21.15.1:0/1068991845 conn(0x7f18a40fd8c0 msgr2=0x7f18a40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:59.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.013+0000 7f18aa89d640 1 -- 172.21.15.1:0/1068991845 shutdown_connections 2024-09-19T09:37:59.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.013+0000 7f18aa89d640 1 -- 172.21.15.1:0/1068991845 wait complete. 2024-09-19T09:37:59.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.014+0000 7f18aa89d640 1 Processor -- start 2024-09-19T09:37:59.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.014+0000 7f18aa89d640 1 -- start start 2024-09-19T09:37:59.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.014+0000 7f18aa89d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18a4101de0 0x7f18a4198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:59.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.014+0000 7f18aa89d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18a4102790 0x7f18a4198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:59.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.014+0000 7f18aa89d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18a4106f10 0x7f18a419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:59.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.014+0000 7f18aa89d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f18a4111f80 con 0x7f18a4106f10 2024-09-19T09:37:59.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.014+0000 7f18aa89d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f18a4111e00 con 0x7f18a4102790 2024-09-19T09:37:59.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.014+0000 7f18aa89d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f18a4112100 con 0x7f18a4101de0 2024-09-19T09:37:59.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.014+0000 7f18a8e3a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18a4106f10 0x7f18a419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:59.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.014+0000 7f18a8e3a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18a4106f10 0x7f18a419cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48984/0 (socket says 172.21.15.1:48984) 2024-09-19T09:37:59.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.014+0000 7f18a8e3a640 1 -- 172.21.15.1:0/1427303794 learned_addr learned my addr 172.21.15.1:0/1427303794 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:37:59.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.014+0000 7f189bfff640 1 --2- 172.21.15.1:0/1427303794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18a4102790 0x7f18a4198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:59.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.015+0000 7f18a3fff640 1 --2- 172.21.15.1:0/1427303794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18a4101de0 0x7f18a4198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:59.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.015+0000 7f18a8e3a640 1 -- 172.21.15.1:0/1427303794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18a4101de0 msgr2=0x7f18a4198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:59.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.015+0000 7f18a8e3a640 1 --2- 172.21.15.1:0/1427303794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18a4101de0 0x7f18a4198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:59.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.015+0000 7f18a8e3a640 1 -- 172.21.15.1:0/1427303794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18a4102790 msgr2=0x7f18a4198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:59.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.015+0000 7f18a8e3a640 1 --2- 172.21.15.1:0/1427303794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18a4102790 0x7f18a4198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:59.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.015+0000 7f18a8e3a640 1 -- 172.21.15.1:0/1427303794 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a419d3e0 con 0x7f18a4106f10 2024-09-19T09:37:59.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.015+0000 7f18a8e3a640 1 --2- 172.21.15.1:0/1427303794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18a4106f10 0x7f18a419cd00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f189c00eb10 tx=0x7f189c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:59.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.015+0000 7f18a1ffb640 1 -- 172.21.15.1:0/1427303794 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f189c004b20 con 0x7f18a4106f10 2024-09-19T09:37:59.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.015+0000 7f18aa89d640 1 -- 172.21.15.1:0/1427303794 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18a419d6d0 con 0x7f18a4106f10 2024-09-19T09:37:59.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.015+0000 7f18a1ffb640 1 -- 172.21.15.1:0/1427303794 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f189c004cc0 con 0x7f18a4106f10 2024-09-19T09:37:59.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.015+0000 7f18a1ffb640 1 -- 172.21.15.1:0/1427303794 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f189c010760 con 0x7f18a4106f10 2024-09-19T09:37:59.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.015+0000 7f18aa89d640 1 -- 172.21.15.1:0/1427303794 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18a41a4fb0 con 0x7f18a4106f10 2024-09-19T09:37:59.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.016+0000 7f18aa89d640 1 -- 172.21.15.1:0/1427303794 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18a41021c0 con 0x7f18a4106f10 2024-09-19T09:37:59.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.017+0000 7f18a1ffb640 1 -- 172.21.15.1:0/1427303794 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f189c005000 con 0x7f18a4106f10 2024-09-19T09:37:59.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.018+0000 7f18a1ffb640 1 --2- 172.21.15.1:0/1427303794 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f18900a3240 0x7f18900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:37:59.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.018+0000 7f18a3fff640 1 --2- 172.21.15.1:0/1427303794 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f18900a3240 0x7f18900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:37:59.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.019+0000 7f18a1ffb640 1 -- 172.21.15.1:0/1427303794 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f189c0d0110 con 0x7f18a4106f10 2024-09-19T09:37:59.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.019+0000 7f18a3fff640 1 --2- 172.21.15.1:0/1427303794 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f18900a3240 0x7f18900a5700 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f189400ba40 tx=0x7f1894005cc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:37:59.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.022+0000 7f18a1ffb640 1 -- 172.21.15.1:0/1427303794 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f189c054210 con 0x7f18a4106f10 2024-09-19T09:37:59.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.234+0000 7f18aa89d640 1 -- 172.21.15.1:0/1427303794 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f18a4199790 con 0x7f18a4106f10 2024-09-19T09:37:59.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.235+0000 7f18a1ffb640 1 -- 172.21.15.1:0/1427303794 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) ==== 53+0+73 (secure 0 0 0) 0x7f18a4199790 con 0x7f18a4106f10 2024-09-19T09:37:59.236 INFO:teuthology.orchestra.run.smithi001.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T09:37:59.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.237+0000 7f18aa89d640 1 -- 172.21.15.1:0/1427303794 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f18900a3240 msgr2=0x7f18900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:59.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.237+0000 7f18aa89d640 1 --2- 172.21.15.1:0/1427303794 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f18900a3240 0x7f18900a5700 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f189400ba40 tx=0x7f1894005cc0 comp rx=0 tx=0).stop 2024-09-19T09:37:59.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.237+0000 7f18aa89d640 1 -- 172.21.15.1:0/1427303794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18a4106f10 msgr2=0x7f18a419cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:37:59.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.237+0000 7f18aa89d640 1 --2- 172.21.15.1:0/1427303794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18a4106f10 0x7f18a419cd00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f189c00eb10 tx=0x7f189c00c2d0 comp rx=0 tx=0).stop 2024-09-19T09:37:59.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.237+0000 7f18aa89d640 1 -- 172.21.15.1:0/1427303794 shutdown_connections 2024-09-19T09:37:59.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.237+0000 7f18aa89d640 1 --2- 172.21.15.1:0/1427303794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f18a4106f10 0x7f18a419cd00 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:59.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.237+0000 7f18aa89d640 1 --2- 172.21.15.1:0/1427303794 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f18900a3240 0x7f18900a5700 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:59.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.237+0000 7f18aa89d640 1 --2- 172.21.15.1:0/1427303794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f18a4102790 0x7f18a4198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:59.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.237+0000 7f18aa89d640 1 --2- 172.21.15.1:0/1427303794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18a4101de0 0x7f18a4198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:37:59.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.237+0000 7f18aa89d640 1 -- 172.21.15.1:0/1427303794 >> 172.21.15.1:0/1427303794 conn(0x7f18a40fd8c0 msgr2=0x7f18a40fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:37:59.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.237+0000 7f18aa89d640 1 -- 172.21.15.1:0/1427303794 shutdown_connections 2024-09-19T09:37:59.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:37:59.237+0000 7f18aa89d640 1 -- 172.21.15.1:0/1427303794 wait complete. 2024-09-19T09:38:00.010 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T09:38:00.011 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:38:00.011 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi001.front.sepia.ceph.com 2024-09-19T09:38:00.011 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T09:38:00.011 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:38:00.011 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T09:38:00.011 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T09:38:00.011 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:38:00.011 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:38:00.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:38:00.011 DEBUG:teuthology.orchestra.run.smithi001:> ip addr 2024-09-19T09:38:00.030 INFO:teuthology.orchestra.run.smithi001.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:38:00.030 INFO:teuthology.orchestra.run.smithi001.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:38:00.030 INFO:teuthology.orchestra.run.smithi001.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:38:00.030 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:38:00.030 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 ::1/128 scope host 2024-09-19T09:38:00.030 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:38:00.030 INFO:teuthology.orchestra.run.smithi001.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:38:00.030 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7a brd ff:ff:ff:ff:ff:ff 2024-09-19T09:38:00.030 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f0 2024-09-19T09:38:00.031 INFO:teuthology.orchestra.run.smithi001.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:38:00.031 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7b brd ff:ff:ff:ff:ff:ff 2024-09-19T09:38:00.031 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f1 2024-09-19T09:38:00.031 INFO:teuthology.orchestra.run.smithi001.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:38:00.031 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e8 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:38:00.031 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f0 2024-09-19T09:38:00.031 INFO:teuthology.orchestra.run.smithi001.stdout: inet 172.21.15.1/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T09:38:00.031 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft 42183sec preferred_lft 42183sec 2024-09-19T09:38:00.031 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::ec4:7aff:febd:15e8/64 scope link 2024-09-19T09:38:00.031 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:38:00.031 INFO:teuthology.orchestra.run.smithi001.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:38:00.031 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e9 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:38:00.031 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f1 2024-09-19T09:38:00.032 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T09:38:00.032 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:38:00.032 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-19T09:38:00.032 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link add name ceph-brx type bridge 2024-09-19T09:38:00.032 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip addr flush dev ceph-brx 2024-09-19T09:38:00.032 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set ceph-brx up 2024-09-19T09:38:00.032 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T09:38:00.033 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-19T09:38:00.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:38:00.229 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:00 smithi001 ceph-mon[31225]: pgmap v335: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:38:00.229 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:00 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1427303794' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:38:00.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:38:00.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:38:00.240 DEBUG:teuthology.orchestra.run.smithi001:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:38:00.266 INFO:teuthology.orchestra.run.smithi001.stdout:1 2024-09-19T09:38:00.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:38:00.267 DEBUG:teuthology.orchestra.run.smithi001:> route 2024-09-19T09:38:00.341 INFO:teuthology.orchestra.run.smithi001.stdout:Kernel IP routing table 2024-09-19T09:38:00.341 INFO:teuthology.orchestra.run.smithi001.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:38:00.342 INFO:teuthology.orchestra.run.smithi001.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T09:38:00.342 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T09:38:00.342 INFO:teuthology.orchestra.run.smithi001.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:38:00.342 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:38:00.342 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-19T09:38:00.342 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T09:38:00.342 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T09:38:00.342 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T09:38:00.343 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-19T09:38:00.431 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:38:00.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:00 smithi022 ceph-mon[35583]: pgmap v335: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:38:00.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:00 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1427303794' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:38:00.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:00 smithi121 ceph-mon[35577]: pgmap v335: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:38:00.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:00 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1427303794' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T09:38:00.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:38:00.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:38:00.658 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2024-09-19T09:38:00.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:38:00.674 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list-id 2024-09-19T09:38:00.730 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:38:00.730 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-19T09:38:00.730 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:38:00.730 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T09:38:00.730 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-19T09:38:00.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:38:00.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:38:00.850 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T09:38:00.850 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:38:00.850 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-19T09:38:00.851 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T09:38:00.851 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T09:38:00.851 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T09:38:00.851 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T09:38:00.851 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T09:38:00.851 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-19T09:38:00.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:38:00.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:38:00.988 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:38:00.988 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-09-19T09:38:00.988 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set brx.0 up 2024-09-19T09:38:00.988 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T09:38:00.988 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-09-19T09:38:01.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:38:01.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:38:01.067 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:38:01.067 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T09:38:01.096 INFO:teuthology.orchestra.run.smithi001.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:38:01.096 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:38:01.097 DEBUG:teuthology.orchestra.run.smithi001:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:38:01.152 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-19T09:38:01.152 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-19T09:38:01.152 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/ce3aacc7-b6a0-43fb-b6d8-210c142b6771 2024-09-19T09:38:01.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:38:01.152 DEBUG:teuthology.orchestra.run.smithi001:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/ce3aacc7-b6a0-43fb-b6d8-210c142b6771 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-19T09:38:01.258 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-19T09:38:01.258 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-09-19T09:38:01.258 INFO:teuthology.orchestra.run.smithi001.stdout:invalid new device string format 2024-09-19T09:38:01.383 INFO:teuthology.orchestra.run.smithi001.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-19T09:38:01.383 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-09-19T09:38:01.383 INFO:teuthology.orchestra.run.smithi001.stdout:invalid new device string format 2024-09-19T09:38:01.383 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: resolved to: "172.21.15.1:3300,172.21.15.22:3300,172.21.15.121:3300" 2024-09-19T09:38:01.383 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.1:3300,172.21.15.22:3300,172.21.15.121:3300:/volumes/qa/sv_1/ce3aacc7-b6a0-43fb-b6d8-210c142b6771 2024-09-19T09:38:01.383 INFO:teuthology.orchestra.run.smithi001.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,key=0,fsid=57238232-7669-11ef-bceb-c7b262605968" will pass to kernel 2024-09-19T09:38:01.384 INFO:teuthology.orchestra.run.smithi001.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-19T09:38:01.384 INFO:teuthology.orchestra.run.smithi001.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:38:01.384 INFO:teuthology.orchestra.run.smithi001.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:38:01.384 INFO:teuthology.orchestra.run.smithi001.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:38:01.384 INFO:teuthology.orchestra.run.smithi001.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:38:01.386 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:38:01.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:38:01.386 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:38:01.413 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:38:01.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:38:01.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:38:01.512 INFO:teuthology.orchestra.run.smithi001.stdout:client24818 2024-09-19T09:38:01.512 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T09:38:01.512 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:38:01.530 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:38:01.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:38:01.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:38:01.627 INFO:teuthology.orchestra.run.smithi001.stdout:client24818 2024-09-19T09:38:01.627 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:38:01.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:38:01.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:38:01.684 INFO:teuthology.orchestra.run.smithi001.stdout:client24818 2024-09-19T09:38:01.684 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/57238232-7669-11ef-bceb-c7b262605968.client24818/status') 2024-09-19T09:38:01.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:38:01.744 INFO:teuthology.orchestra.run.smithi001.stdout:instance: client.24818 (3)172.21.15.1:0/604990219 2024-09-19T09:38:01.745 INFO:teuthology.orchestra.run.smithi001.stdout:blocklisted: false 2024-09-19T09:38:01.745 INFO:teuthology.orchestra.run.smithi001.stderr:0+1 records in 2024-09-19T09:38:01.745 INFO:teuthology.orchestra.run.smithi001.stderr:0+1 records out 2024-09-19T09:38:01.745 INFO:teuthology.orchestra.run.smithi001.stderr:69 bytes copied, 2.4149e-05 s, 2.9 MB/s 2024-09-19T09:38:01.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:38:01.752 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-19T09:38:01.765 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-19T09:38:01.782 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:38:01.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.886+0000 7fd9bb9ef640 1 -- 172.21.15.1:0/4017689834 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9b4102600 msgr2=0x7fd9b4108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:01.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.886+0000 7fd9bb9ef640 1 --2- 172.21.15.1:0/4017689834 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9b4102600 0x7fd9b4108e90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac009ca0 tx=0x7fd9ac02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:38:01.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.886+0000 7fd9bb9ef640 1 -- 172.21.15.1:0/4017689834 shutdown_connections 2024-09-19T09:38:01.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.886+0000 7fd9bb9ef640 1 --2- 172.21.15.1:0/4017689834 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9b4102600 0x7fd9b4108e90 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:01.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.886+0000 7fd9bb9ef640 1 --2- 172.21.15.1:0/4017689834 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd9b4101c40 0x7fd9b41020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:01.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.886+0000 7fd9bb9ef640 1 --2- 172.21.15.1:0/4017689834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9b4100a50 0x7fd9b4100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:01.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.886+0000 7fd9bb9ef640 1 -- 172.21.15.1:0/4017689834 >> 172.21.15.1:0/4017689834 conn(0x7fd9b40fc190 msgr2=0x7fd9b40fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:01.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.886+0000 7fd9bb9ef640 1 -- 172.21.15.1:0/4017689834 shutdown_connections 2024-09-19T09:38:01.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.886+0000 7fd9bb9ef640 1 -- 172.21.15.1:0/4017689834 wait complete. 2024-09-19T09:38:01.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.886+0000 7fd9bb9ef640 1 Processor -- start 2024-09-19T09:38:01.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.886+0000 7fd9bb9ef640 1 -- start start 2024-09-19T09:38:01.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.887+0000 7fd9bb9ef640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd9b4100a50 0x7fd9b406aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:01.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.887+0000 7fd9bb9ef640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9b4101c40 0x7fd9b419ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:01.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.887+0000 7fd9bb9ef640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9b4102600 0x7fd9b419f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:01.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.887+0000 7fd9bb9ef640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b410c700 con 0x7fd9b4102600 2024-09-19T09:38:01.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.887+0000 7fd9bb9ef640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b410c580 con 0x7fd9b4101c40 2024-09-19T09:38:01.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.887+0000 7fd9bb9ef640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b410c880 con 0x7fd9b4100a50 2024-09-19T09:38:01.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.887+0000 7fd9b9f8c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9b4102600 0x7fd9b419f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:01.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.887+0000 7fd9b9f8c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9b4102600 0x7fd9b419f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48996/0 (socket says 172.21.15.1:48996) 2024-09-19T09:38:01.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.887+0000 7fd9b9f8c640 1 -- 172.21.15.1:0/2550396718 learned_addr learned my addr 172.21.15.1:0/2550396718 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:01.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.887+0000 7fd9b978b640 1 --2- 172.21.15.1:0/2550396718 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd9b4100a50 0x7fd9b406aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:01.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.887+0000 7fd9b8f8a640 1 --2- 172.21.15.1:0/2550396718 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9b4101c40 0x7fd9b419ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:01.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.887+0000 7fd9b9f8c640 1 -- 172.21.15.1:0/2550396718 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd9b4100a50 msgr2=0x7fd9b406aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:01.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.887+0000 7fd9b9f8c640 1 --2- 172.21.15.1:0/2550396718 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd9b4100a50 0x7fd9b406aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:01.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.887+0000 7fd9b9f8c640 1 -- 172.21.15.1:0/2550396718 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9b4101c40 msgr2=0x7fd9b419ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:01.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.887+0000 7fd9b9f8c640 1 --2- 172.21.15.1:0/2550396718 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9b4101c40 0x7fd9b419ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:01.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.887+0000 7fd9b9f8c640 1 -- 172.21.15.1:0/2550396718 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9b419f940 con 0x7fd9b4102600 2024-09-19T09:38:01.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.887+0000 7fd9b8f8a640 1 --2- 172.21.15.1:0/2550396718 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9b4101c40 0x7fd9b419ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:01.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.887+0000 7fd9b9f8c640 1 --2- 172.21.15.1:0/2550396718 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9b4102600 0x7fd9b419f030 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac003ba0 tx=0x7fd9ac003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:01.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.887+0000 7fd9aa7fc640 1 -- 172.21.15.1:0/2550396718 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac004040 con 0x7fd9b4102600 2024-09-19T09:38:01.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.887+0000 7fd9aa7fc640 1 -- 172.21.15.1:0/2550396718 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9ac0046c0 con 0x7fd9b4102600 2024-09-19T09:38:01.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.887+0000 7fd9bb9ef640 1 -- 172.21.15.1:0/2550396718 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9b419fb70 con 0x7fd9b4102600 2024-09-19T09:38:01.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.887+0000 7fd9aa7fc640 1 -- 172.21.15.1:0/2550396718 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac02fea0 con 0x7fd9b4102600 2024-09-19T09:38:01.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.888+0000 7fd9bb9ef640 1 -- 172.21.15.1:0/2550396718 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9b41a00c0 con 0x7fd9b4102600 2024-09-19T09:38:01.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.888+0000 7fd9bb9ef640 1 -- 172.21.15.1:0/2550396718 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9b4107ca0 con 0x7fd9b4102600 2024-09-19T09:38:01.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.890+0000 7fd9aa7fc640 1 -- 172.21.15.1:0/2550396718 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fd9ac02f610 con 0x7fd9b4102600 2024-09-19T09:38:01.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.890+0000 7fd9aa7fc640 1 --2- 172.21.15.1:0/2550396718 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd9a00a3250 0x7fd9a00a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:01.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.890+0000 7fd9aa7fc640 1 -- 172.21.15.1:0/2550396718 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fd9ac0f1290 con 0x7fd9b4102600 2024-09-19T09:38:01.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.890+0000 7fd9b978b640 1 --2- 172.21.15.1:0/2550396718 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd9a00a3250 0x7fd9a00a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:01.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.891+0000 7fd9b978b640 1 --2- 172.21.15.1:0/2550396718 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd9a00a3250 0x7fd9a00a5710 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4101aa0 tx=0x7fd9b0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:01.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:01.893+0000 7fd9aa7fc640 1 -- 172.21.15.1:0/2550396718 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd9ac0bdfb0 con 0x7fd9b4102600 2024-09-19T09:38:02.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.074+0000 7fd9bb9ef640 1 -- 172.21.15.1:0/2550396718 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd9b402da10 con 0x7fd9b4102600 2024-09-19T09:38:02.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.076+0000 7fd9aa7fc640 1 -- 172.21.15.1:0/2550396718 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22612 (secure 0 0 0) 0x7fd9ac0bd8b0 con 0x7fd9b4102600 2024-09-19T09:38:02.078 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:38:02.078 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":83,"fsid":"57238232-7669-11ef-bceb-c7b262605968","created":"2024-09-19T09:28:28.406983+0000","modified":"2024-09-19T09:37:16.024965+0000","last_up_change":"2024-09-19T09:35:21.422825+0000","last_in_change":"2024-09-19T09:34:57.199184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:31:30.566509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:36:09.521275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:36:11.954337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c165571d-43f1-4c43-ba1e-35872d914f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6803","nonce":502676986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6805","nonce":502676986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6809","nonce":502676986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6807","nonce":502676986}]},"public_addr":"172.21.15.1:6803/502676986","cluster_addr":"172.21.15.1:6805/502676986","heartbeat_back_addr":"172.21.15.1:6809/502676986","heartbeat_front_addr":"172.21.15.1:6807/502676986","state":["exists","up"]},{"osd":1,"uuid":"baf120f8-8ba3-4aa5-a12a-41cdc97ff11b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6801","nonce":3735826323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6803","nonce":3735826323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6807","nonce":3735826323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6805","nonce":3735826323}]},"public_addr":"172.21.15.22:6801/3735826323","cluster_addr":"172.21.15.22:6803/3735826323","heartbeat_back_addr":"172.21.15.22:6807/3735826323","heartbeat_front_addr":"172.21.15.22:6805/3735826323","state":["exists","up"]},{"osd":2,"uuid":"72c520bf-c5cc-44ee-a38c-c9bac0a6280b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6801","nonce":1924970833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6803","nonce":1924970833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6807","nonce":1924970833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6805","nonce":1924970833}]},"public_addr":"172.21.15.121:6801/1924970833","cluster_addr":"172.21.15.121:6803/1924970833","heartbeat_back_addr":"172.21.15.121:6807/1924970833","heartbeat_front_addr":"172.21.15.121:6805/1924970833","state":["exists","up"]},{"osd":3,"uuid":"adad6d17-16d9-4c43-b581-35ac1bb9d807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6811","nonce":1515009793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6813","nonce":1515009793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6817","nonce":1515009793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6815","nonce":1515009793}]},"public_addr":"172.21.15.1:6811/1515009793","cluster_addr":"172.21.15.1:6813/1515009793","heartbeat_back_addr":"172.21.15.1:6817/1515009793","heartbeat_front_addr":"172.21.15.1:6815/1515009793","state":["exists","up"]},{"osd":4,"uuid":"8fb06efe-c3a0-48a3-9730-3e8f3e60922d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6809","nonce":923697266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6811","nonce":923697266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6815","nonce":923697266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6813","nonce":923697266}]},"public_addr":"172.21.15.22:6809/923697266","cluster_addr":"172.21.15.22:6811/923697266","heartbeat_back_addr":"172.21.15.22:6815/923697266","heartbeat_front_addr":"172.21.15.22:6813/923697266","state":["exists","up"]},{"osd":5,"uuid":"3b2f428c-8a5a-49be-9f43-a9f379a1c7e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6809","nonce":3137245658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6811","nonce":3137245658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6815","nonce":3137245658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6813","nonce":3137245658}]},"public_addr":"172.21.15.121:6809/3137245658","cluster_addr":"172.21.15.121:6811/3137245658","heartbeat_back_addr":"172.21.15.121:6815/3137245658","heartbeat_front_addr":"172.21.15.121:6813/3137245658","state":["exists","up"]},{"osd":6,"uuid":"5aecec68-ff7e-440c-bd39-cc35ab89cc91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6819","nonce":3376780798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6821","nonce":3376780798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6825","nonce":3376780798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6823","nonce":3376780798}]},"public_addr":"172.21.15.1:6819/3376780798","cluster_addr":"172.21.15.1:6821/3376780798","heartbeat_back_addr":"172.21.15.1:6825/3376780798","heartbeat_front_addr":"172.21.15.1:6823/3376780798","state":["exists","up"]},{"osd":7,"uuid":"46556bdf-199e-4268-873b-6d87b54e1176","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6817","nonce":2920985295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6819","nonce":2920985295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6823","nonce":2920985295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6821","nonce":2920985295}]},"public_addr":"172.21.15.22:6817/2920985295","cluster_addr":"172.21.15.22:6819/2920985295","heartbeat_back_addr":"172.21.15.22:6823/2920985295","heartbeat_front_addr":"172.21.15.22:6821/2920985295","state":["exists","up"]},{"osd":8,"uuid":"e7c3792a-94a4-4440-be74-d6abdf3d9566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6817","nonce":3589985967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6819","nonce":3589985967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6823","nonce":3589985967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6821","nonce":3589985967}]},"public_addr":"172.21.15.121:6817/3589985967","cluster_addr":"172.21.15.121:6819/3589985967","heartbeat_back_addr":"172.21.15.121:6823/3589985967","heartbeat_front_addr":"172.21.15.121:6821/3589985967","state":["exists","up"]},{"osd":9,"uuid":"8af80ac9-d681-4966-b083-ead5185eff12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6827","nonce":1143859822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6829","nonce":1143859822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6833","nonce":1143859822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6831","nonce":1143859822}]},"public_addr":"172.21.15.1:6827/1143859822","cluster_addr":"172.21.15.1:6829/1143859822","heartbeat_back_addr":"172.21.15.1:6833/1143859822","heartbeat_front_addr":"172.21.15.1:6831/1143859822","state":["exists","up"]},{"osd":10,"uuid":"34edd06a-7f60-4465-bfe1-0c646abd53f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6825","nonce":343155547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6827","nonce":343155547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6831","nonce":343155547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6829","nonce":343155547}]},"public_addr":"172.21.15.22:6825/343155547","cluster_addr":"172.21.15.22:6827/343155547","heartbeat_back_addr":"172.21.15.22:6831/343155547","heartbeat_front_addr":"172.21.15.22:6829/343155547","state":["exists","up"]},{"osd":11,"uuid":"5a831eb6-ad66-4ab6-a30a-b6299ce1f88d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6825","nonce":3202514460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6827","nonce":3202514460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6831","nonce":3202514460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6829","nonce":3202514460}]},"public_addr":"172.21.15.121:6825/3202514460","cluster_addr":"172.21.15.121:6827/3202514460","heartbeat_back_addr":"172.21.15.121:6831/3202514460","heartbeat_front_addr":"172.21.15.121:6829/3202514460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:30:37.582893+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:01.915252+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:26.783477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:53.407014+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:19.407005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:45.022320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:11.377986+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:36.818700+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:01.745428+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:27.928916+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:53.363906+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:19.037551+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6800/1028873727":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/3137949087":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/1951370933":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2008363642":"2024-09-20T09:28:50.074985+0000","172.21.15.1:0/3006931063":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2486161758":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6801/1296304385":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6801/1028873727":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2783823049":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6800/1296304385":"2024-09-20T09:28:50.074985+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:38:02.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.078+0000 7fd9bb9ef640 1 -- 172.21.15.1:0/2550396718 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd9a00a3250 msgr2=0x7fd9a00a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:02.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.078+0000 7fd9bb9ef640 1 --2- 172.21.15.1:0/2550396718 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd9a00a3250 0x7fd9a00a5710 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4101aa0 tx=0x7fd9b0005f90 comp rx=0 tx=0).stop 2024-09-19T09:38:02.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.078+0000 7fd9bb9ef640 1 -- 172.21.15.1:0/2550396718 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9b4102600 msgr2=0x7fd9b419f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:02.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.078+0000 7fd9bb9ef640 1 --2- 172.21.15.1:0/2550396718 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9b4102600 0x7fd9b419f030 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac003ba0 tx=0x7fd9ac003bd0 comp rx=0 tx=0).stop 2024-09-19T09:38:02.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.078+0000 7fd9bb9ef640 1 -- 172.21.15.1:0/2550396718 shutdown_connections 2024-09-19T09:38:02.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.078+0000 7fd9bb9ef640 1 --2- 172.21.15.1:0/2550396718 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd9b4102600 0x7fd9b419f030 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:02.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.078+0000 7fd9bb9ef640 1 --2- 172.21.15.1:0/2550396718 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd9a00a3250 0x7fd9a00a5710 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:02.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.078+0000 7fd9bb9ef640 1 --2- 172.21.15.1:0/2550396718 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9b4101c40 0x7fd9b419ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:02.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.078+0000 7fd9bb9ef640 1 --2- 172.21.15.1:0/2550396718 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd9b4100a50 0x7fd9b406aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:02.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.078+0000 7fd9bb9ef640 1 -- 172.21.15.1:0/2550396718 >> 172.21.15.1:0/2550396718 conn(0x7fd9b40fc190 msgr2=0x7fd9b4104e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:02.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.078+0000 7fd9bb9ef640 1 -- 172.21.15.1:0/2550396718 shutdown_connections 2024-09-19T09:38:02.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.078+0000 7fd9bb9ef640 1 -- 172.21.15.1:0/2550396718 wait complete. 2024-09-19T09:38:02.091 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T09:31:30.566509+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T09:36:09.521275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T09:36:11.954337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T09:38:02.092 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T09:38:02.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.198+0000 7fa5a76b7640 1 -- 172.21.15.1:0/145294725 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5a01036e0 msgr2=0x7fa5a0109f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:02.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.198+0000 7fa5a76b7640 1 --2- 172.21.15.1:0/145294725 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5a01036e0 0x7fa5a0109f70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa598009ca0 tx=0x7fa59802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:38:02.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.198+0000 7fa5a76b7640 1 -- 172.21.15.1:0/145294725 shutdown_connections 2024-09-19T09:38:02.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.198+0000 7fa5a76b7640 1 --2- 172.21.15.1:0/145294725 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5a01036e0 0x7fa5a0109f70 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:02.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.198+0000 7fa5a76b7640 1 --2- 172.21.15.1:0/145294725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5a0102d20 0x7fa5a01031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:02.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.198+0000 7fa5a76b7640 1 --2- 172.21.15.1:0/145294725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5a0101b30 0x7fa5a0101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:02.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.198+0000 7fa5a76b7640 1 -- 172.21.15.1:0/145294725 >> 172.21.15.1:0/145294725 conn(0x7fa5a00fd270 msgr2=0x7fa5a00ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:02.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.198+0000 7fa5a76b7640 1 -- 172.21.15.1:0/145294725 shutdown_connections 2024-09-19T09:38:02.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.198+0000 7fa5a76b7640 1 -- 172.21.15.1:0/145294725 wait complete. 2024-09-19T09:38:02.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.198+0000 7fa5a76b7640 1 Processor -- start 2024-09-19T09:38:02.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.198+0000 7fa5a76b7640 1 -- start start 2024-09-19T09:38:02.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.199+0000 7fa5a76b7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5a0101b30 0x7fa5a0197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:02.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.199+0000 7fa5a76b7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5a0102d20 0x7fa5a0198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:02.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.199+0000 7fa5a76b7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5a01036e0 0x7fa5a019f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:02.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.199+0000 7fa5a76b7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a010d790 con 0x7fa5a0102d20 2024-09-19T09:38:02.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.199+0000 7fa5a76b7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a010d610 con 0x7fa5a01036e0 2024-09-19T09:38:02.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.199+0000 7fa5a76b7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a010d910 con 0x7fa5a0101b30 2024-09-19T09:38:02.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.199+0000 7fa5a4c52640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5a0102d20 0x7fa5a0198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:02.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.199+0000 7fa5a4c52640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5a0102d20 0x7fa5a0198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49012/0 (socket says 172.21.15.1:49012) 2024-09-19T09:38:02.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.199+0000 7fa5a4c52640 1 -- 172.21.15.1:0/3403707149 learned_addr learned my addr 172.21.15.1:0/3403707149 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:02.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.199+0000 7fa5a5453640 1 --2- 172.21.15.1:0/3403707149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5a0101b30 0x7fa5a0197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:02.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.199+0000 7fa5a5c54640 1 --2- 172.21.15.1:0/3403707149 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5a01036e0 0x7fa5a019f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:02.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.199+0000 7fa5a4c52640 1 -- 172.21.15.1:0/3403707149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5a0101b30 msgr2=0x7fa5a0197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:02.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.199+0000 7fa5a4c52640 1 --2- 172.21.15.1:0/3403707149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5a0101b30 0x7fa5a0197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:02.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.199+0000 7fa5a4c52640 1 -- 172.21.15.1:0/3403707149 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5a01036e0 msgr2=0x7fa5a019f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:02.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.199+0000 7fa5a4c52640 1 --2- 172.21.15.1:0/3403707149 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5a01036e0 0x7fa5a019f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:02.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.199+0000 7fa5a4c52640 1 -- 172.21.15.1:0/3403707149 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a019f950 con 0x7fa5a0102d20 2024-09-19T09:38:02.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.199+0000 7fa5a5c54640 1 --2- 172.21.15.1:0/3403707149 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5a01036e0 0x7fa5a019f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:02.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.199+0000 7fa5a5453640 1 --2- 172.21.15.1:0/3403707149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5a0101b30 0x7fa5a0197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:02.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.199+0000 7fa5a4c52640 1 --2- 172.21.15.1:0/3403707149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5a0102d20 0x7fa5a0198280 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa59000d950 tx=0x7fa59000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:02.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.199+0000 7fa5967fc640 1 -- 172.21.15.1:0/3403707149 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa590017070 con 0x7fa5a0102d20 2024-09-19T09:38:02.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.199+0000 7fa5a76b7640 1 -- 172.21.15.1:0/3403707149 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5a019fc40 con 0x7fa5a0102d20 2024-09-19T09:38:02.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.199+0000 7fa5967fc640 1 -- 172.21.15.1:0/3403707149 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa590009c30 con 0x7fa5a0102d20 2024-09-19T09:38:02.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.199+0000 7fa5967fc640 1 -- 172.21.15.1:0/3403707149 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59000f6b0 con 0x7fa5a0102d20 2024-09-19T09:38:02.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.199+0000 7fa5a76b7640 1 -- 172.21.15.1:0/3403707149 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5a01a0190 con 0x7fa5a0102d20 2024-09-19T09:38:02.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.200+0000 7fa5a76b7640 1 -- 172.21.15.1:0/3403707149 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5a0108e50 con 0x7fa5a0102d20 2024-09-19T09:38:02.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.202+0000 7fa5967fc640 1 -- 172.21.15.1:0/3403707149 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fa5900109d0 con 0x7fa5a0102d20 2024-09-19T09:38:02.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.203+0000 7fa5967fc640 1 --2- 172.21.15.1:0/3403707149 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fa58c0a3250 0x7fa58c0a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:02.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.203+0000 7fa5a5453640 1 --2- 172.21.15.1:0/3403707149 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fa58c0a3250 0x7fa58c0a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:02.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.203+0000 7fa5967fc640 1 -- 172.21.15.1:0/3403707149 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fa5900cf670 con 0x7fa5a0102d20 2024-09-19T09:38:02.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.203+0000 7fa5a5453640 1 --2- 172.21.15.1:0/3403707149 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fa58c0a3250 0x7fa58c0a5710 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa59c0058c0 tx=0x7fa59c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:02.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.206+0000 7fa5967fc640 1 -- 172.21.15.1:0/3403707149 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa590009de0 con 0x7fa5a0102d20 2024-09-19T09:38:02.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.383+0000 7fa5a76b7640 1 -- 172.21.15.1:0/3403707149 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa5a002d7c0 con 0x7fa5a0102d20 2024-09-19T09:38:02.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.383+0000 7fa5967fc640 1 -- 172.21.15.1:0/3403707149 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) ==== 93+0+10 (secure 0 0 0) 0x7fa59009c390 con 0x7fa5a0102d20 2024-09-19T09:38:02.385 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2024-09-19T09:38:02.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.385+0000 7fa5a76b7640 1 -- 172.21.15.1:0/3403707149 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fa58c0a3250 msgr2=0x7fa58c0a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:02.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.385+0000 7fa5a76b7640 1 --2- 172.21.15.1:0/3403707149 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fa58c0a3250 0x7fa58c0a5710 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa59c0058c0 tx=0x7fa59c005850 comp rx=0 tx=0).stop 2024-09-19T09:38:02.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.385+0000 7fa5a76b7640 1 -- 172.21.15.1:0/3403707149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5a0102d20 msgr2=0x7fa5a0198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:02.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.385+0000 7fa5a76b7640 1 --2- 172.21.15.1:0/3403707149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5a0102d20 0x7fa5a0198280 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa59000d950 tx=0x7fa59000de10 comp rx=0 tx=0).stop 2024-09-19T09:38:02.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.385+0000 7fa5a76b7640 1 -- 172.21.15.1:0/3403707149 shutdown_connections 2024-09-19T09:38:02.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.385+0000 7fa5a76b7640 1 --2- 172.21.15.1:0/3403707149 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fa58c0a3250 0x7fa58c0a5710 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:02.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.385+0000 7fa5a76b7640 1 --2- 172.21.15.1:0/3403707149 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5a01036e0 0x7fa5a019f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:02.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.385+0000 7fa5a76b7640 1 --2- 172.21.15.1:0/3403707149 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa5a0102d20 0x7fa5a0198280 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:02.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.385+0000 7fa5a76b7640 1 --2- 172.21.15.1:0/3403707149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5a0101b30 0x7fa5a0197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:02.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.385+0000 7fa5a76b7640 1 -- 172.21.15.1:0/3403707149 >> 172.21.15.1:0/3403707149 conn(0x7fa5a00fd270 msgr2=0x7fa5a0106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:02.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.386+0000 7fa5a76b7640 1 -- 172.21.15.1:0/3403707149 shutdown_connections 2024-09-19T09:38:02.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.386+0000 7fa5a76b7640 1 -- 172.21.15.1:0/3403707149 wait complete. 2024-09-19T09:38:02.397 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:02 smithi001 ceph-mon[31225]: pgmap v336: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:38:02.397 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:02 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/2550396718' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:38:02.398 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T09:38:02.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.503+0000 7f1da81d8640 1 -- 172.21.15.1:0/298095897 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1da0100a50 msgr2=0x7f1da0100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:02.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.503+0000 7f1da81d8640 1 --2- 172.21.15.1:0/298095897 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1da0100a50 0x7f1da0100e50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c009900 tx=0x7f1d9c02a410 comp rx=0 tx=0).stop 2024-09-19T09:38:02.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.503+0000 7f1da81d8640 1 -- 172.21.15.1:0/298095897 shutdown_connections 2024-09-19T09:38:02.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.503+0000 7f1da81d8640 1 --2- 172.21.15.1:0/298095897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1da0102600 0x7f1da0108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:02.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.503+0000 7f1da81d8640 1 --2- 172.21.15.1:0/298095897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1da0101c40 0x7f1da01020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:02.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.503+0000 7f1da81d8640 1 --2- 172.21.15.1:0/298095897 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1da0100a50 0x7f1da0100e50 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:02.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.503+0000 7f1da81d8640 1 -- 172.21.15.1:0/298095897 >> 172.21.15.1:0/298095897 conn(0x7f1da00fc190 msgr2=0x7f1da00fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:02.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.503+0000 7f1da81d8640 1 -- 172.21.15.1:0/298095897 shutdown_connections 2024-09-19T09:38:02.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.503+0000 7f1da81d8640 1 -- 172.21.15.1:0/298095897 wait complete. 2024-09-19T09:38:02.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.504+0000 7f1da81d8640 1 Processor -- start 2024-09-19T09:38:02.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.504+0000 7f1da81d8640 1 -- start start 2024-09-19T09:38:02.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.504+0000 7f1da81d8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1da0100a50 0x7f1da0197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:02.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.504+0000 7f1da81d8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1da0101c40 0x7f1da0198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:02.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.504+0000 7f1da81d8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1da0102600 0x7f1da019f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:02.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.504+0000 7f1da81d8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1da010c6b0 con 0x7f1da0101c40 2024-09-19T09:38:02.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.504+0000 7f1da81d8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1da010c530 con 0x7f1da0102600 2024-09-19T09:38:02.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.504+0000 7f1da81d8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1da010c830 con 0x7f1da0100a50 2024-09-19T09:38:02.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.504+0000 7f1da5773640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1da0101c40 0x7f1da0198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:02.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.504+0000 7f1da5773640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1da0101c40 0x7f1da0198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49024/0 (socket says 172.21.15.1:49024) 2024-09-19T09:38:02.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.504+0000 7f1da5773640 1 -- 172.21.15.1:0/4216847442 learned_addr learned my addr 172.21.15.1:0/4216847442 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:02.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.504+0000 7f1da5f74640 1 --2- 172.21.15.1:0/4216847442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1da0100a50 0x7f1da0197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:02.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.504+0000 7f1da6775640 1 --2- 172.21.15.1:0/4216847442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1da0102600 0x7f1da019f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:02.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.504+0000 7f1da5773640 1 -- 172.21.15.1:0/4216847442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1da0100a50 msgr2=0x7f1da0197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:02.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.504+0000 7f1da5773640 1 --2- 172.21.15.1:0/4216847442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1da0100a50 0x7f1da0197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:02.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.504+0000 7f1da5773640 1 -- 172.21.15.1:0/4216847442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1da0102600 msgr2=0x7f1da019f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:02.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.504+0000 7f1da5773640 1 --2- 172.21.15.1:0/4216847442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1da0102600 0x7f1da019f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:02.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.504+0000 7f1da5773640 1 -- 172.21.15.1:0/4216847442 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da019fb40 con 0x7f1da0101c40 2024-09-19T09:38:02.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.504+0000 7f1da5f74640 1 --2- 172.21.15.1:0/4216847442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1da0100a50 0x7f1da0197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:02.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.504+0000 7f1da6775640 1 --2- 172.21.15.1:0/4216847442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1da0102600 0x7f1da019f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:02.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.504+0000 7f1da5773640 1 --2- 172.21.15.1:0/4216847442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1da0101c40 0x7f1da0198460 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1d9000d950 tx=0x7f1d9000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:02.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.505+0000 7f1d96ffd640 1 -- 172.21.15.1:0/4216847442 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d90017030 con 0x7f1da0101c40 2024-09-19T09:38:02.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.505+0000 7f1d96ffd640 1 -- 172.21.15.1:0/4216847442 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d90004020 con 0x7f1da0101c40 2024-09-19T09:38:02.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.505+0000 7f1da81d8640 1 -- 172.21.15.1:0/4216847442 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1da019fe30 con 0x7f1da0101c40 2024-09-19T09:38:02.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.505+0000 7f1d96ffd640 1 -- 172.21.15.1:0/4216847442 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d900047a0 con 0x7f1da0101c40 2024-09-19T09:38:02.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.505+0000 7f1da81d8640 1 -- 172.21.15.1:0/4216847442 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1da01a02f0 con 0x7f1da0101c40 2024-09-19T09:38:02.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.506+0000 7f1da81d8640 1 -- 172.21.15.1:0/4216847442 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1da01a0580 con 0x7f1da0101c40 2024-09-19T09:38:02.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.508+0000 7f1d96ffd640 1 -- 172.21.15.1:0/4216847442 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f1d900041d0 con 0x7f1da0101c40 2024-09-19T09:38:02.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.509+0000 7f1d96ffd640 1 --2- 172.21.15.1:0/4216847442 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f1d8c0a3250 0x7f1d8c0a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:02.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.509+0000 7f1da5f74640 1 --2- 172.21.15.1:0/4216847442 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f1d8c0a3250 0x7f1d8c0a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:02.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.509+0000 7f1d96ffd640 1 -- 172.21.15.1:0/4216847442 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f1d900cfa90 con 0x7f1da0101c40 2024-09-19T09:38:02.511 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.509+0000 7f1da5f74640 1 --2- 172.21.15.1:0/4216847442 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f1d8c0a3250 0x7f1d8c0a5710 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c000c00 tx=0x7f1d9c009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:02.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.512+0000 7f1d96ffd640 1 -- 172.21.15.1:0/4216847442 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1d9009c770 con 0x7f1da0101c40 2024-09-19T09:38:02.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:02 smithi022 ceph-mon[35583]: pgmap v336: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:38:02.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:02 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/2550396718' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:38:02.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:02 smithi121 ceph-mon[35577]: pgmap v336: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:38:02.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:02 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/2550396718' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:38:02.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.688+0000 7f1da81d8640 1 -- 172.21.15.1:0/4216847442 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1da01a0750 con 0x7f1da0101c40 2024-09-19T09:38:02.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.688+0000 7f1d96ffd640 1 -- 172.21.15.1:0/4216847442 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) ==== 104+0+11 (secure 0 0 0) 0x7f1d9009c070 con 0x7f1da0101c40 2024-09-19T09:38:02.690 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 32 2024-09-19T09:38:02.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.690+0000 7f1da81d8640 1 -- 172.21.15.1:0/4216847442 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f1d8c0a3250 msgr2=0x7f1d8c0a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:02.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.690+0000 7f1da81d8640 1 --2- 172.21.15.1:0/4216847442 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f1d8c0a3250 0x7f1d8c0a5710 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c000c00 tx=0x7f1d9c009560 comp rx=0 tx=0).stop 2024-09-19T09:38:02.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.690+0000 7f1da81d8640 1 -- 172.21.15.1:0/4216847442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1da0101c40 msgr2=0x7f1da0198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:02.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.690+0000 7f1da81d8640 1 --2- 172.21.15.1:0/4216847442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1da0101c40 0x7f1da0198460 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1d9000d950 tx=0x7f1d9000de10 comp rx=0 tx=0).stop 2024-09-19T09:38:02.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.690+0000 7f1da81d8640 1 -- 172.21.15.1:0/4216847442 shutdown_connections 2024-09-19T09:38:02.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.690+0000 7f1da81d8640 1 --2- 172.21.15.1:0/4216847442 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f1d8c0a3250 0x7f1d8c0a5710 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:02.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.690+0000 7f1da81d8640 1 --2- 172.21.15.1:0/4216847442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1da0102600 0x7f1da019f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:02.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.690+0000 7f1da81d8640 1 --2- 172.21.15.1:0/4216847442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1da0101c40 0x7f1da0198460 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:02.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.690+0000 7f1da81d8640 1 --2- 172.21.15.1:0/4216847442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1da0100a50 0x7f1da0197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:02.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.690+0000 7f1da81d8640 1 -- 172.21.15.1:0/4216847442 >> 172.21.15.1:0/4216847442 conn(0x7f1da00fc190 msgr2=0x7f1da006a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:02.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.691+0000 7f1da81d8640 1 -- 172.21.15.1:0/4216847442 shutdown_connections 2024-09-19T09:38:02.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.691+0000 7f1da81d8640 1 -- 172.21.15.1:0/4216847442 wait complete. 2024-09-19T09:38:02.704 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T09:38:02.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.809+0000 7f5336b2a640 1 -- 172.21.15.1:0/53010382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5330102600 msgr2=0x7f5330108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:02.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.809+0000 7f5336b2a640 1 --2- 172.21.15.1:0/53010382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5330102600 0x7f5330108e90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5328009ca0 tx=0x7f532802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:38:02.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.809+0000 7f5336b2a640 1 -- 172.21.15.1:0/53010382 shutdown_connections 2024-09-19T09:38:02.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.809+0000 7f5336b2a640 1 --2- 172.21.15.1:0/53010382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5330102600 0x7f5330108e90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:02.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.809+0000 7f5336b2a640 1 --2- 172.21.15.1:0/53010382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5330101c40 0x7f53301020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:02.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.809+0000 7f5336b2a640 1 --2- 172.21.15.1:0/53010382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5330100a50 0x7f5330100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:02.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.809+0000 7f5336b2a640 1 -- 172.21.15.1:0/53010382 >> 172.21.15.1:0/53010382 conn(0x7f53300fc190 msgr2=0x7f53300fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:02.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.809+0000 7f5336b2a640 1 -- 172.21.15.1:0/53010382 shutdown_connections 2024-09-19T09:38:02.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.809+0000 7f5336b2a640 1 -- 172.21.15.1:0/53010382 wait complete. 2024-09-19T09:38:02.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.810+0000 7f5336b2a640 1 Processor -- start 2024-09-19T09:38:02.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.810+0000 7f5336b2a640 1 -- start start 2024-09-19T09:38:02.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.810+0000 7f5336b2a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5330100a50 0x7f533006ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:02.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.810+0000 7f5336b2a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5330101c40 0x7f533019cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:02.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.810+0000 7f5336b2a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5330102600 0x7f533019f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:02.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.810+0000 7f5336b2a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f533010c700 con 0x7f5330102600 2024-09-19T09:38:02.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.810+0000 7f5336b2a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f533010c580 con 0x7f5330100a50 2024-09-19T09:38:02.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.810+0000 7f5336b2a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f533010c880 con 0x7f5330101c40 2024-09-19T09:38:02.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.810+0000 7f53350c7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5330102600 0x7f533019f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:02.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.810+0000 7f53350c7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5330102600 0x7f533019f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49032/0 (socket says 172.21.15.1:49032) 2024-09-19T09:38:02.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.810+0000 7f53350c7640 1 -- 172.21.15.1:0/3665259178 learned_addr learned my addr 172.21.15.1:0/3665259178 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:02.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.810+0000 7f53348c6640 1 --2- 172.21.15.1:0/3665259178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5330100a50 0x7f533006ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:02.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.810+0000 7f532ffff640 1 --2- 172.21.15.1:0/3665259178 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5330101c40 0x7f533019cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:02.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.810+0000 7f53350c7640 1 -- 172.21.15.1:0/3665259178 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5330101c40 msgr2=0x7f533019cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:02.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.810+0000 7f53350c7640 1 --2- 172.21.15.1:0/3665259178 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5330101c40 0x7f533019cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:02.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.810+0000 7f53350c7640 1 -- 172.21.15.1:0/3665259178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5330100a50 msgr2=0x7f533006ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:02.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.810+0000 7f53350c7640 1 --2- 172.21.15.1:0/3665259178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5330100a50 0x7f533006ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:02.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.810+0000 7f53350c7640 1 -- 172.21.15.1:0/3665259178 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f533019faa0 con 0x7f5330102600 2024-09-19T09:38:02.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.811+0000 7f53350c7640 1 --2- 172.21.15.1:0/3665259178 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5330102600 0x7f533019f190 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5328003f40 tx=0x7f5328003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:02.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.811+0000 7f532dffb640 1 -- 172.21.15.1:0/3665259178 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53280316d0 con 0x7f5330102600 2024-09-19T09:38:02.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.811+0000 7f5336b2a640 1 -- 172.21.15.1:0/3665259178 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f533019fcd0 con 0x7f5330102600 2024-09-19T09:38:02.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.811+0000 7f532dffb640 1 -- 172.21.15.1:0/3665259178 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5328031870 con 0x7f5330102600 2024-09-19T09:38:02.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.811+0000 7f532dffb640 1 -- 172.21.15.1:0/3665259178 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532802fc20 con 0x7f5330102600 2024-09-19T09:38:02.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.811+0000 7f5336b2a640 1 -- 172.21.15.1:0/3665259178 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53301a0210 con 0x7f5330102600 2024-09-19T09:38:02.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.812+0000 7f5336b2a640 1 -- 172.21.15.1:0/3665259178 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5330107d90 con 0x7f5330102600 2024-09-19T09:38:02.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.813+0000 7f532dffb640 1 -- 172.21.15.1:0/3665259178 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f5328004040 con 0x7f5330102600 2024-09-19T09:38:02.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.814+0000 7f532dffb640 1 --2- 172.21.15.1:0/3665259178 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f531c0a3250 0x7f531c0a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:02.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.814+0000 7f53348c6640 1 --2- 172.21.15.1:0/3665259178 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f531c0a3250 0x7f531c0a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:02.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.814+0000 7f532dffb640 1 -- 172.21.15.1:0/3665259178 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f53280f0f20 con 0x7f5330102600 2024-09-19T09:38:02.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.814+0000 7f53348c6640 1 --2- 172.21.15.1:0/3665259178 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f531c0a3250 0x7f531c0a5710 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5330101aa0 tx=0x7f531800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:02.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.818+0000 7f532dffb640 1 -- 172.21.15.1:0/3665259178 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f53280bdc00 con 0x7f5330102600 2024-09-19T09:38:02.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.995+0000 7f5336b2a640 1 -- 172.21.15.1:0/3665259178 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5330062e90 con 0x7f5330102600 2024-09-19T09:38:02.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.995+0000 7f532dffb640 1 -- 172.21.15.1:0/3665259178 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) ==== 100+0+11 (secure 0 0 0) 0x7f53280bd500 con 0x7f5330102600 2024-09-19T09:38:02.997 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2024-09-19T09:38:02.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.997+0000 7f5336b2a640 1 -- 172.21.15.1:0/3665259178 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f531c0a3250 msgr2=0x7f531c0a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:02.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.997+0000 7f5336b2a640 1 --2- 172.21.15.1:0/3665259178 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f531c0a3250 0x7f531c0a5710 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5330101aa0 tx=0x7f531800b390 comp rx=0 tx=0).stop 2024-09-19T09:38:02.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.997+0000 7f5336b2a640 1 -- 172.21.15.1:0/3665259178 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5330102600 msgr2=0x7f533019f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:02.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.997+0000 7f5336b2a640 1 --2- 172.21.15.1:0/3665259178 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5330102600 0x7f533019f190 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5328003f40 tx=0x7f5328003f70 comp rx=0 tx=0).stop 2024-09-19T09:38:02.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.997+0000 7f5336b2a640 1 -- 172.21.15.1:0/3665259178 shutdown_connections 2024-09-19T09:38:02.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.997+0000 7f5336b2a640 1 --2- 172.21.15.1:0/3665259178 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5330102600 0x7f533019f190 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.997+0000 7f5336b2a640 1 --2- 172.21.15.1:0/3665259178 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5330101c40 0x7f533019cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.997+0000 7f5336b2a640 1 --2- 172.21.15.1:0/3665259178 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f531c0a3250 0x7f531c0a5710 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.997+0000 7f5336b2a640 1 --2- 172.21.15.1:0/3665259178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5330100a50 0x7f533006ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.998+0000 7f5336b2a640 1 -- 172.21.15.1:0/3665259178 >> 172.21.15.1:0/3665259178 conn(0x7f53300fc190 msgr2=0x7f5330104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:03.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.998+0000 7f5336b2a640 1 -- 172.21.15.1:0/3665259178 shutdown_connections 2024-09-19T09:38:03.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:02.998+0000 7f5336b2a640 1 -- 172.21.15.1:0/3665259178 wait complete. 2024-09-19T09:38:03.010 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-19T09:38:03.010 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:38:03.268 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:03.390 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:03 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/3403707149' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:38:03.390 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:03 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/4216847442' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:38:03.390 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:03 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/3665259178' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:38:03.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:03 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/3403707149' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:38:03.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:03 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/4216847442' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:38:03.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:03 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/3665259178' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:38:03.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:03 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/3403707149' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:38:03.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:03 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/4216847442' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:38:03.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:03 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/3665259178' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:38:03.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.708+0000 7f481000a640 1 -- 172.21.15.1:0/947766782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4808101de0 msgr2=0x7f48081021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:03.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.708+0000 7f481000a640 1 --2- 172.21.15.1:0/947766782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4808101de0 0x7f48081021c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4804009900 tx=0x7f480402a410 comp rx=0 tx=0).stop 2024-09-19T09:38:03.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.708+0000 7f481000a640 1 -- 172.21.15.1:0/947766782 shutdown_connections 2024-09-19T09:38:03.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.708+0000 7f481000a640 1 --2- 172.21.15.1:0/947766782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4808106f10 0x7f480810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.708+0000 7f481000a640 1 --2- 172.21.15.1:0/947766782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4808102790 0x7f48081067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.708+0000 7f481000a640 1 --2- 172.21.15.1:0/947766782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4808101de0 0x7f48081021c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.708+0000 7f481000a640 1 -- 172.21.15.1:0/947766782 >> 172.21.15.1:0/947766782 conn(0x7f48080fd8c0 msgr2=0x7f48080ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:03.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.708+0000 7f481000a640 1 -- 172.21.15.1:0/947766782 shutdown_connections 2024-09-19T09:38:03.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.708+0000 7f481000a640 1 -- 172.21.15.1:0/947766782 wait complete. 2024-09-19T09:38:03.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.708+0000 7f481000a640 1 Processor -- start 2024-09-19T09:38:03.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.708+0000 7f481000a640 1 -- start start 2024-09-19T09:38:03.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.709+0000 7f481000a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4808101de0 0x7f4808198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:03.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.709+0000 7f481000a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4808102790 0x7f48081988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:03.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.709+0000 7f481000a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4808106f10 0x7f480819cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:03.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.709+0000 7f481000a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4808111f30 con 0x7f4808106f10 2024-09-19T09:38:03.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.709+0000 7f481000a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4808111db0 con 0x7f4808101de0 2024-09-19T09:38:03.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.709+0000 7f481000a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f48081120b0 con 0x7f4808102790 2024-09-19T09:38:03.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.709+0000 7f480e5a7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4808106f10 0x7f480819cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:03.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.709+0000 7f480e5a7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4808106f10 0x7f480819cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49052/0 (socket says 172.21.15.1:49052) 2024-09-19T09:38:03.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.709+0000 7f480e5a7640 1 -- 172.21.15.1:0/1781314623 learned_addr learned my addr 172.21.15.1:0/1781314623 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:03.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.709+0000 7f480dda6640 1 --2- 172.21.15.1:0/1781314623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4808101de0 0x7f4808198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:03.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.709+0000 7f480d5a5640 1 --2- 172.21.15.1:0/1781314623 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4808102790 0x7f48081988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:03.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.709+0000 7f480e5a7640 1 -- 172.21.15.1:0/1781314623 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4808102790 msgr2=0x7f48081988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:03.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.709+0000 7f480e5a7640 1 --2- 172.21.15.1:0/1781314623 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4808102790 0x7f48081988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.709+0000 7f480e5a7640 1 -- 172.21.15.1:0/1781314623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4808101de0 msgr2=0x7f4808198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:03.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.709+0000 7f480e5a7640 1 --2- 172.21.15.1:0/1781314623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4808101de0 0x7f4808198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.709+0000 7f480e5a7640 1 -- 172.21.15.1:0/1781314623 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f480819d340 con 0x7f4808106f10 2024-09-19T09:38:03.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.709+0000 7f480e5a7640 1 --2- 172.21.15.1:0/1781314623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4808106f10 0x7f480819cc60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f480000eb10 tx=0x7f480000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:03.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.710+0000 7f47feffd640 1 -- 172.21.15.1:0/1781314623 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480000ce20 con 0x7f4808106f10 2024-09-19T09:38:03.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.710+0000 7f47feffd640 1 -- 172.21.15.1:0/1781314623 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4800005020 con 0x7f4808106f10 2024-09-19T09:38:03.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.710+0000 7f481000a640 1 -- 172.21.15.1:0/1781314623 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f480819d630 con 0x7f4808106f10 2024-09-19T09:38:03.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.710+0000 7f47feffd640 1 -- 172.21.15.1:0/1781314623 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4800010690 con 0x7f4808106f10 2024-09-19T09:38:03.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.710+0000 7f481000a640 1 -- 172.21.15.1:0/1781314623 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48081a4f10 con 0x7f4808106f10 2024-09-19T09:38:03.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.711+0000 7f481000a640 1 -- 172.21.15.1:0/1781314623 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48081021c0 con 0x7f4808106f10 2024-09-19T09:38:03.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.712+0000 7f47feffd640 1 -- 172.21.15.1:0/1781314623 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f4800005540 con 0x7f4808106f10 2024-09-19T09:38:03.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.713+0000 7f47feffd640 1 --2- 172.21.15.1:0/1781314623 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f47f40a3240 0x7f47f40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:03.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.713+0000 7f480dda6640 1 --2- 172.21.15.1:0/1781314623 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f47f40a3240 0x7f47f40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:03.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.713+0000 7f47feffd640 1 -- 172.21.15.1:0/1781314623 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f48000cfe50 con 0x7f4808106f10 2024-09-19T09:38:03.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.713+0000 7f480dda6640 1 --2- 172.21.15.1:0/1781314623 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f47f40a3240 0x7f47f40a5700 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4804009230 tx=0x7f48040058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:03.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.717+0000 7f47feffd640 1 -- 172.21.15.1:0/1781314623 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f480009cb30 con 0x7f4808106f10 2024-09-19T09:38:03.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.932+0000 7f481000a640 1 -- 172.21.15.1:0/1781314623 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f480802d7c0 con 0x7f4808106f10 2024-09-19T09:38:03.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.933+0000 7f47feffd640 1 -- 172.21.15.1:0/1781314623 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11837 (secure 0 0 0) 0x7f480009c430 con 0x7f4808106f10 2024-09-19T09:38:03.934 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:38:03.935 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":19,"btime":"2024-09-19T09:36:24:006349+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:36:23.723388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6839/3279971690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3279971690},{"type":"v1","addr":"172.21.15.121:6839","nonce":3279971690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:38:03.935 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 19 2024-09-19T09:38:03.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.935+0000 7f481000a640 1 -- 172.21.15.1:0/1781314623 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f47f40a3240 msgr2=0x7f47f40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:03.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.935+0000 7f481000a640 1 --2- 172.21.15.1:0/1781314623 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f47f40a3240 0x7f47f40a5700 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4804009230 tx=0x7f48040058d0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.935+0000 7f481000a640 1 -- 172.21.15.1:0/1781314623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4808106f10 msgr2=0x7f480819cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:03.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.935+0000 7f481000a640 1 --2- 172.21.15.1:0/1781314623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4808106f10 0x7f480819cc60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f480000eb10 tx=0x7f480000ef10 comp rx=0 tx=0).stop 2024-09-19T09:38:03.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.935+0000 7f481000a640 1 -- 172.21.15.1:0/1781314623 shutdown_connections 2024-09-19T09:38:03.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.935+0000 7f481000a640 1 --2- 172.21.15.1:0/1781314623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4808106f10 0x7f480819cc60 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.935+0000 7f481000a640 1 --2- 172.21.15.1:0/1781314623 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4808102790 0x7f48081988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.935+0000 7f481000a640 1 --2- 172.21.15.1:0/1781314623 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f47f40a3240 0x7f47f40a5700 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.935+0000 7f481000a640 1 --2- 172.21.15.1:0/1781314623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4808101de0 0x7f4808198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:03.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.935+0000 7f481000a640 1 -- 172.21.15.1:0/1781314623 >> 172.21.15.1:0/1781314623 conn(0x7f48080fd8c0 msgr2=0x7f48080fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:03.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.935+0000 7f481000a640 1 -- 172.21.15.1:0/1781314623 shutdown_connections 2024-09-19T09:38:03.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:03.935+0000 7f481000a640 1 -- 172.21.15.1:0/1781314623 wait complete. 2024-09-19T09:38:04.306 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:04 smithi001 ceph-mon[31225]: pgmap v337: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:38:04.306 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:04 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1781314623' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:04.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:04 smithi022 ceph-mon[35583]: pgmap v337: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:38:04.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:04 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1781314623' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:04.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:04 smithi121 ceph-mon[35577]: pgmap v337: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:38:04.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:04 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1781314623' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:04.731 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-19T09:38:04.732 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-19T09:38:04.732 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:38:04.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.840+0000 7f33a7b66640 1 -- 172.21.15.1:0/3380319150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33a0100d00 msgr2=0x7f33a0101160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:04.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.840+0000 7f33a7b66640 1 --2- 172.21.15.1:0/3380319150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33a0100d00 0x7f33a0101160 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3390009900 tx=0x7f339002a410 comp rx=0 tx=0).stop 2024-09-19T09:38:04.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.840+0000 7f33a7b66640 1 -- 172.21.15.1:0/3380319150 shutdown_connections 2024-09-19T09:38:04.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.840+0000 7f33a7b66640 1 --2- 172.21.15.1:0/3380319150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33a01016a0 0x7f33a0101b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:04.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.840+0000 7f33a7b66640 1 --2- 172.21.15.1:0/3380319150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33a0100d00 0x7f33a0101160 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:04.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.840+0000 7f33a7b66640 1 --2- 172.21.15.1:0/3380319150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33a01003c0 0x7f33a01007c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:04.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.840+0000 7f33a7b66640 1 -- 172.21.15.1:0/3380319150 >> 172.21.15.1:0/3380319150 conn(0x7f33a00fc190 msgr2=0x7f33a00fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:04.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.841+0000 7f33a7b66640 1 -- 172.21.15.1:0/3380319150 shutdown_connections 2024-09-19T09:38:04.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.841+0000 7f33a7b66640 1 -- 172.21.15.1:0/3380319150 wait complete. 2024-09-19T09:38:04.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.841+0000 7f33a7b66640 1 Processor -- start 2024-09-19T09:38:04.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.841+0000 7f33a7b66640 1 -- start start 2024-09-19T09:38:04.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.841+0000 7f33a7b66640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33a01003c0 0x7f33a019a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:04.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.841+0000 7f33a7b66640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33a0100d00 0x7f33a019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:04.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.841+0000 7f33a7b66640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33a01016a0 0x7f33a01a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:04.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.841+0000 7f33a7b66640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f33a010fa70 con 0x7f33a01003c0 2024-09-19T09:38:04.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.841+0000 7f33a7b66640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f33a010f8f0 con 0x7f33a0100d00 2024-09-19T09:38:04.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.841+0000 7f33a7b66640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f33a010fbf0 con 0x7f33a01016a0 2024-09-19T09:38:04.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.841+0000 7f33a5902640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33a01003c0 0x7f33a019a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:04.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.841+0000 7f33a5902640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33a01003c0 0x7f33a019a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49066/0 (socket says 172.21.15.1:49066) 2024-09-19T09:38:04.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.841+0000 7f33a5902640 1 -- 172.21.15.1:0/2986133971 learned_addr learned my addr 172.21.15.1:0/2986133971 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:04.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.842+0000 7f33a5101640 1 --2- 172.21.15.1:0/2986133971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33a0100d00 0x7f33a019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:04.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.842+0000 7f33a6103640 1 --2- 172.21.15.1:0/2986133971 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33a01016a0 0x7f33a01a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:04.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.842+0000 7f33a5902640 1 -- 172.21.15.1:0/2986133971 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33a01016a0 msgr2=0x7f33a01a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:04.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.842+0000 7f33a5902640 1 --2- 172.21.15.1:0/2986133971 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33a01016a0 0x7f33a01a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:04.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.842+0000 7f33a5902640 1 -- 172.21.15.1:0/2986133971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33a0100d00 msgr2=0x7f33a019a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:04.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.842+0000 7f33a5902640 1 --2- 172.21.15.1:0/2986133971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33a0100d00 0x7f33a019a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:04.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.842+0000 7f33a5902640 1 -- 172.21.15.1:0/2986133971 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a01a1cb0 con 0x7f33a01003c0 2024-09-19T09:38:04.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.842+0000 7f33a6103640 1 --2- 172.21.15.1:0/2986133971 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33a01016a0 0x7f33a01a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:04.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.842+0000 7f33a5101640 1 --2- 172.21.15.1:0/2986133971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33a0100d00 0x7f33a019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:04.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.842+0000 7f33a5902640 1 --2- 172.21.15.1:0/2986133971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33a01003c0 0x7f33a019a090 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f339c00d950 tx=0x7f339c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:04.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.842+0000 7f3396ffd640 1 -- 172.21.15.1:0/2986133971 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c017070 con 0x7f33a01003c0 2024-09-19T09:38:04.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.842+0000 7f3396ffd640 1 -- 172.21.15.1:0/2986133971 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f339c009c30 con 0x7f33a01003c0 2024-09-19T09:38:04.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.842+0000 7f33a7b66640 1 -- 172.21.15.1:0/2986133971 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33a01a1fa0 con 0x7f33a01003c0 2024-09-19T09:38:04.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.842+0000 7f3396ffd640 1 -- 172.21.15.1:0/2986133971 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f339c00f6b0 con 0x7f33a01003c0 2024-09-19T09:38:04.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.842+0000 7f33a7b66640 1 -- 172.21.15.1:0/2986133971 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a01a2480 con 0x7f33a01003c0 2024-09-19T09:38:04.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.843+0000 7f33a7b66640 1 -- 172.21.15.1:0/2986133971 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33a010b220 con 0x7f33a01003c0 2024-09-19T09:38:04.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.844+0000 7f3396ffd640 1 -- 172.21.15.1:0/2986133971 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f339c0109d0 con 0x7f33a01003c0 2024-09-19T09:38:04.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.845+0000 7f3396ffd640 1 --2- 172.21.15.1:0/2986133971 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f338c0a3250 0x7f338c0a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:04.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.845+0000 7f3396ffd640 1 -- 172.21.15.1:0/2986133971 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f339c0cf5d0 con 0x7f33a01003c0 2024-09-19T09:38:04.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.845+0000 7f33a5101640 1 --2- 172.21.15.1:0/2986133971 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f338c0a3250 0x7f338c0a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:04.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.846+0000 7f33a5101640 1 --2- 172.21.15.1:0/2986133971 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f338c0a3250 0x7f338c0a5710 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3390006010 tx=0x7f3390000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:04.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:04.848+0000 7f3396ffd640 1 -- 172.21.15.1:0/2986133971 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f339c009de0 con 0x7f33a01003c0 2024-09-19T09:38:05.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.026+0000 7f33a7b66640 1 -- 172.21.15.1:0/2986133971 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f33a0062630 con 0x7f338c0a3250 2024-09-19T09:38:05.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.032+0000 7f3396ffd640 1 -- 172.21.15.1:0/2986133971 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259001 (secure 0 0 0) 0x7f33a0062630 con 0x7f338c0a3250 2024-09-19T09:38:05.036 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:38:05.038 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-19T09:38:05.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.036+0000 7f33a7b66640 1 -- 172.21.15.1:0/2986133971 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f338c0a3250 msgr2=0x7f338c0a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.036+0000 7f33a7b66640 1 --2- 172.21.15.1:0/2986133971 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f338c0a3250 0x7f338c0a5710 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3390006010 tx=0x7f3390000bc0 comp rx=0 tx=0).stop 2024-09-19T09:38:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.036+0000 7f33a7b66640 1 -- 172.21.15.1:0/2986133971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33a01003c0 msgr2=0x7f33a019a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.036+0000 7f33a7b66640 1 --2- 172.21.15.1:0/2986133971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33a01003c0 0x7f33a019a090 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f339c00d950 tx=0x7f339c00de10 comp rx=0 tx=0).stop 2024-09-19T09:38:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.036+0000 7f33a7b66640 1 -- 172.21.15.1:0/2986133971 shutdown_connections 2024-09-19T09:38:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.036+0000 7f33a7b66640 1 --2- 172.21.15.1:0/2986133971 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33a01016a0 0x7f33a01a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.036+0000 7f33a7b66640 1 --2- 172.21.15.1:0/2986133971 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f338c0a3250 0x7f338c0a5710 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.036+0000 7f33a7b66640 1 --2- 172.21.15.1:0/2986133971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33a0100d00 0x7f33a019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:05.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.036+0000 7f33a7b66640 1 --2- 172.21.15.1:0/2986133971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33a01003c0 0x7f33a019a090 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:05.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.036+0000 7f33a7b66640 1 -- 172.21.15.1:0/2986133971 >> 172.21.15.1:0/2986133971 conn(0x7f33a00fc190 msgr2=0x7f33a00fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:05.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.036+0000 7f33a7b66640 1 -- 172.21.15.1:0/2986133971 shutdown_connections 2024-09-19T09:38:05.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.036+0000 7f33a7b66640 1 -- 172.21.15.1:0/2986133971 wait complete. 2024-09-19T09:38:05.048 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-09-19T09:38:04.157147+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654468,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":340,"num_read_kb":280,"num_write":272,"num_write_kb":3030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":712,"ondisk_log_size":712,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":405964,"kb_used_data":10956,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124535860,"statfs":{"total":1151940427776,"available":1151524720640,"internally_reserved":0,"allocated":11218944,"data_stored":7256604,"data_compressed":178359,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19141,"internal_metadata":404272443},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002802"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147034+0000","last_change":"2024-09-19T09:36:12.985228+0000","last_active":"2024-09-19T09:37:44.147034+0000","last_peered":"2024-09-19T09:37:44.147034+0000","last_clean":"2024-09-19T09:37:44.147034+0000","last_became_active":"2024-09-19T09:36:12.984306+0000","last_became_peered":"2024-09-19T09:36:12.984306+0000","last_unstale":"2024-09-19T09:37:44.147034+0000","last_undegraded":"2024-09-19T09:37:44.147034+0000","last_fullsized":"2024-09-19T09:37:44.147034+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:45.988859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145651+0000","last_change":"2024-09-19T09:36:12.987631+0000","last_active":"2024-09-19T09:37:44.145651+0000","last_peered":"2024-09-19T09:37:44.145651+0000","last_clean":"2024-09-19T09:37:44.145651+0000","last_became_active":"2024-09-19T09:36:12.987298+0000","last_became_peered":"2024-09-19T09:36:12.987298+0000","last_unstale":"2024-09-19T09:37:44.145651+0000","last_undegraded":"2024-09-19T09:37:44.145651+0000","last_fullsized":"2024-09-19T09:37:44.145651+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:47.397162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.161196+0000","last_change":"2024-09-19T09:36:12.991466+0000","last_active":"2024-09-19T09:37:44.161196+0000","last_peered":"2024-09-19T09:37:44.161196+0000","last_clean":"2024-09-19T09:37:44.161196+0000","last_became_active":"2024-09-19T09:36:12.990903+0000","last_became_peered":"2024-09-19T09:36:12.990903+0000","last_unstale":"2024-09-19T09:37:44.161196+0000","last_undegraded":"2024-09-19T09:37:44.161196+0000","last_fullsized":"2024-09-19T09:37:44.161196+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:04.128768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.150215+0000","last_change":"2024-09-19T09:36:12.986686+0000","last_active":"2024-09-19T09:37:44.150215+0000","last_peered":"2024-09-19T09:37:44.150215+0000","last_clean":"2024-09-19T09:37:44.150215+0000","last_became_active":"2024-09-19T09:36:12.986334+0000","last_became_peered":"2024-09-19T09:36:12.986334+0000","last_unstale":"2024-09-19T09:37:44.150215+0000","last_undegraded":"2024-09-19T09:37:44.150215+0000","last_fullsized":"2024-09-19T09:37:44.150215+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:39.926343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.139116+0000","last_change":"2024-09-19T09:36:12.981964+0000","last_active":"2024-09-19T09:37:44.139116+0000","last_peered":"2024-09-19T09:37:44.139116+0000","last_clean":"2024-09-19T09:37:44.139116+0000","last_became_active":"2024-09-19T09:36:12.981558+0000","last_became_peered":"2024-09-19T09:36:12.981558+0000","last_unstale":"2024-09-19T09:37:44.139116+0000","last_undegraded":"2024-09-19T09:37:44.139116+0000","last_fullsized":"2024-09-19T09:37:44.139116+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:33.706451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146524+0000","last_change":"2024-09-19T09:36:12.992598+0000","last_active":"2024-09-19T09:37:44.146524+0000","last_peered":"2024-09-19T09:37:44.146524+0000","last_clean":"2024-09-19T09:37:44.146524+0000","last_became_active":"2024-09-19T09:36:12.992281+0000","last_became_peered":"2024-09-19T09:36:12.992281+0000","last_unstale":"2024-09-19T09:37:44.146524+0000","last_undegraded":"2024-09-19T09:37:44.146524+0000","last_fullsized":"2024-09-19T09:37:44.146524+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:26.107432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146663+0000","last_change":"2024-09-19T09:36:12.988583+0000","last_active":"2024-09-19T09:37:44.146663+0000","last_peered":"2024-09-19T09:37:44.146663+0000","last_clean":"2024-09-19T09:37:44.146663+0000","last_became_active":"2024-09-19T09:36:12.987895+0000","last_became_peered":"2024-09-19T09:36:12.987895+0000","last_unstale":"2024-09-19T09:37:44.146663+0000","last_undegraded":"2024-09-19T09:37:44.146663+0000","last_fullsized":"2024-09-19T09:37:44.146663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:47.617324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.141930+0000","last_change":"2024-09-19T09:36:12.988526+0000","last_active":"2024-09-19T09:37:44.141930+0000","last_peered":"2024-09-19T09:37:44.141930+0000","last_clean":"2024-09-19T09:37:44.141930+0000","last_became_active":"2024-09-19T09:36:12.988093+0000","last_became_peered":"2024-09-19T09:36:12.988093+0000","last_unstale":"2024-09-19T09:37:44.141930+0000","last_undegraded":"2024-09-19T09:37:44.141930+0000","last_fullsized":"2024-09-19T09:37:44.141930+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:48.949397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.157907+0000","last_change":"2024-09-19T09:36:12.992360+0000","last_active":"2024-09-19T09:37:44.157907+0000","last_peered":"2024-09-19T09:37:44.157907+0000","last_clean":"2024-09-19T09:37:44.157907+0000","last_became_active":"2024-09-19T09:36:12.991833+0000","last_became_peered":"2024-09-19T09:36:12.991833+0000","last_unstale":"2024-09-19T09:37:44.157907+0000","last_undegraded":"2024-09-19T09:37:44.157907+0000","last_fullsized":"2024-09-19T09:37:44.157907+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:47.715012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.144515+0000","last_change":"2024-09-19T09:36:12.993435+0000","last_active":"2024-09-19T09:37:44.144515+0000","last_peered":"2024-09-19T09:37:44.144515+0000","last_clean":"2024-09-19T09:37:44.144515+0000","last_became_active":"2024-09-19T09:36:12.993108+0000","last_became_peered":"2024-09-19T09:36:12.993108+0000","last_unstale":"2024-09-19T09:37:44.144515+0000","last_undegraded":"2024-09-19T09:37:44.144515+0000","last_fullsized":"2024-09-19T09:37:44.144515+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:54.453593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.162293+0000","last_change":"2024-09-19T09:36:12.991044+0000","last_active":"2024-09-19T09:37:44.162293+0000","last_peered":"2024-09-19T09:37:44.162293+0000","last_clean":"2024-09-19T09:37:44.162293+0000","last_became_active":"2024-09-19T09:36:12.989955+0000","last_became_peered":"2024-09-19T09:36:12.989955+0000","last_unstale":"2024-09-19T09:37:44.162293+0000","last_undegraded":"2024-09-19T09:37:44.162293+0000","last_fullsized":"2024-09-19T09:37:44.162293+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:21.034023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148886+0000","last_change":"2024-09-19T09:36:12.989679+0000","last_active":"2024-09-19T09:37:44.148886+0000","last_peered":"2024-09-19T09:37:44.148886+0000","last_clean":"2024-09-19T09:37:44.148886+0000","last_became_active":"2024-09-19T09:36:12.988463+0000","last_became_peered":"2024-09-19T09:36:12.988463+0000","last_unstale":"2024-09-19T09:37:44.148886+0000","last_undegraded":"2024-09-19T09:37:44.148886+0000","last_fullsized":"2024-09-19T09:37:44.148886+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:28.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.144722+0000","last_change":"2024-09-19T09:36:12.983494+0000","last_active":"2024-09-19T09:37:44.144722+0000","last_peered":"2024-09-19T09:37:44.144722+0000","last_clean":"2024-09-19T09:37:44.144722+0000","last_became_active":"2024-09-19T09:36:12.983143+0000","last_became_peered":"2024-09-19T09:36:12.983143+0000","last_unstale":"2024-09-19T09:37:44.144722+0000","last_undegraded":"2024-09-19T09:37:44.144722+0000","last_fullsized":"2024-09-19T09:37:44.144722+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:23.378183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.143385+0000","last_change":"2024-09-19T09:36:12.987512+0000","last_active":"2024-09-19T09:37:44.143385+0000","last_peered":"2024-09-19T09:37:44.143385+0000","last_clean":"2024-09-19T09:37:44.143385+0000","last_became_active":"2024-09-19T09:36:12.987288+0000","last_became_peered":"2024-09-19T09:36:12.987288+0000","last_unstale":"2024-09-19T09:37:44.143385+0000","last_undegraded":"2024-09-19T09:37:44.143385+0000","last_fullsized":"2024-09-19T09:37:44.143385+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:14.614333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147801+0000","last_change":"2024-09-19T09:37:16.131000+0000","last_active":"2024-09-19T09:37:44.147801+0000","last_peered":"2024-09-19T09:37:44.147801+0000","last_clean":"2024-09-19T09:37:44.147801+0000","last_became_active":"2024-09-19T09:37:16.130647+0000","last_became_peered":"2024-09-19T09:37:16.130647+0000","last_unstale":"2024-09-19T09:37:44.147801+0000","last_undegraded":"2024-09-19T09:37:44.147801+0000","last_fullsized":"2024-09-19T09:37:44.147801+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:22.498318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.162539+0000","last_change":"2024-09-19T09:36:12.988210+0000","last_active":"2024-09-19T09:37:44.162539+0000","last_peered":"2024-09-19T09:37:44.162539+0000","last_clean":"2024-09-19T09:37:44.162539+0000","last_became_active":"2024-09-19T09:36:12.987904+0000","last_became_peered":"2024-09-19T09:36:12.987904+0000","last_unstale":"2024-09-19T09:37:44.162539+0000","last_undegraded":"2024-09-19T09:37:44.162539+0000","last_fullsized":"2024-09-19T09:37:44.162539+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:13.588237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147356+0000","last_change":"2024-09-19T09:36:12.984028+0000","last_active":"2024-09-19T09:37:44.147356+0000","last_peered":"2024-09-19T09:37:44.147356+0000","last_clean":"2024-09-19T09:37:44.147356+0000","last_became_active":"2024-09-19T09:36:12.982062+0000","last_became_peered":"2024-09-19T09:36:12.982062+0000","last_unstale":"2024-09-19T09:37:44.147356+0000","last_undegraded":"2024-09-19T09:37:44.147356+0000","last_fullsized":"2024-09-19T09:37:44.147356+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:26.610287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.141161+0000","last_change":"2024-09-19T09:36:12.979277+0000","last_active":"2024-09-19T09:37:44.141161+0000","last_peered":"2024-09-19T09:37:44.141161+0000","last_clean":"2024-09-19T09:37:44.141161+0000","last_became_active":"2024-09-19T09:36:12.978970+0000","last_became_peered":"2024-09-19T09:36:12.978970+0000","last_unstale":"2024-09-19T09:37:44.141161+0000","last_undegraded":"2024-09-19T09:37:44.141161+0000","last_fullsized":"2024-09-19T09:37:44.141161+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:00.424728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147432+0000","last_change":"2024-09-19T09:36:12.981021+0000","last_active":"2024-09-19T09:37:44.147432+0000","last_peered":"2024-09-19T09:37:44.147432+0000","last_clean":"2024-09-19T09:37:44.147432+0000","last_became_active":"2024-09-19T09:36:12.980580+0000","last_became_peered":"2024-09-19T09:36:12.980580+0000","last_unstale":"2024-09-19T09:37:44.147432+0000","last_undegraded":"2024-09-19T09:37:44.147432+0000","last_fullsized":"2024-09-19T09:37:44.147432+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:17.464873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.143924+0000","last_change":"2024-09-19T09:36:12.986090+0000","last_active":"2024-09-19T09:37:44.143924+0000","last_peered":"2024-09-19T09:37:44.143924+0000","last_clean":"2024-09-19T09:37:44.143924+0000","last_became_active":"2024-09-19T09:36:12.985740+0000","last_became_peered":"2024-09-19T09:36:12.985740+0000","last_unstale":"2024-09-19T09:37:44.143924+0000","last_undegraded":"2024-09-19T09:37:44.143924+0000","last_fullsized":"2024-09-19T09:37:44.143924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:35.252834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145367+0000","last_change":"2024-09-19T09:36:12.981257+0000","last_active":"2024-09-19T09:37:44.145367+0000","last_peered":"2024-09-19T09:37:44.145367+0000","last_clean":"2024-09-19T09:37:44.145367+0000","last_became_active":"2024-09-19T09:36:12.980911+0000","last_became_peered":"2024-09-19T09:36:12.980911+0000","last_unstale":"2024-09-19T09:37:44.145367+0000","last_undegraded":"2024-09-19T09:37:44.145367+0000","last_fullsized":"2024-09-19T09:37:44.145367+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:41.470514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.161076+0000","last_change":"2024-09-19T09:36:12.982585+0000","last_active":"2024-09-19T09:37:44.161076+0000","last_peered":"2024-09-19T09:37:44.161076+0000","last_clean":"2024-09-19T09:37:44.161076+0000","last_became_active":"2024-09-19T09:36:12.982193+0000","last_became_peered":"2024-09-19T09:36:12.982193+0000","last_unstale":"2024-09-19T09:37:44.161076+0000","last_undegraded":"2024-09-19T09:37:44.161076+0000","last_fullsized":"2024-09-19T09:37:44.161076+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:30.057088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.143208+0000","last_change":"2024-09-19T09:36:12.985236+0000","last_active":"2024-09-19T09:37:44.143208+0000","last_peered":"2024-09-19T09:37:44.143208+0000","last_clean":"2024-09-19T09:37:44.143208+0000","last_became_active":"2024-09-19T09:36:12.984751+0000","last_became_peered":"2024-09-19T09:36:12.984751+0000","last_unstale":"2024-09-19T09:37:44.143208+0000","last_undegraded":"2024-09-19T09:37:44.143208+0000","last_fullsized":"2024-09-19T09:37:44.143208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:52.784216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.138535+0000","last_change":"2024-09-19T09:36:12.985856+0000","last_active":"2024-09-19T09:37:44.138535+0000","last_peered":"2024-09-19T09:37:44.138535+0000","last_clean":"2024-09-19T09:37:44.138535+0000","last_became_active":"2024-09-19T09:36:12.985312+0000","last_became_peered":"2024-09-19T09:36:12.985312+0000","last_unstale":"2024-09-19T09:37:44.138535+0000","last_undegraded":"2024-09-19T09:37:44.138535+0000","last_fullsized":"2024-09-19T09:37:44.138535+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:25.235945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.142807+0000","last_change":"2024-09-19T09:36:12.982443+0000","last_active":"2024-09-19T09:37:44.142807+0000","last_peered":"2024-09-19T09:37:44.142807+0000","last_clean":"2024-09-19T09:37:44.142807+0000","last_became_active":"2024-09-19T09:36:12.982130+0000","last_became_peered":"2024-09-19T09:36:12.982130+0000","last_unstale":"2024-09-19T09:37:44.142807+0000","last_undegraded":"2024-09-19T09:37:44.142807+0000","last_fullsized":"2024-09-19T09:37:44.142807+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:17.177563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145567+0000","last_change":"2024-09-19T09:36:12.990439+0000","last_active":"2024-09-19T09:37:44.145567+0000","last_peered":"2024-09-19T09:37:44.145567+0000","last_clean":"2024-09-19T09:37:44.145567+0000","last_became_active":"2024-09-19T09:36:12.990135+0000","last_became_peered":"2024-09-19T09:36:12.990135+0000","last_unstale":"2024-09-19T09:37:44.145567+0000","last_undegraded":"2024-09-19T09:37:44.145567+0000","last_fullsized":"2024-09-19T09:37:44.145567+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:51.685192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145105+0000","last_change":"2024-09-19T09:36:12.987261+0000","last_active":"2024-09-19T09:37:44.145105+0000","last_peered":"2024-09-19T09:37:44.145105+0000","last_clean":"2024-09-19T09:37:44.145105+0000","last_became_active":"2024-09-19T09:36:12.986192+0000","last_became_peered":"2024-09-19T09:36:12.986192+0000","last_unstale":"2024-09-19T09:37:44.145105+0000","last_undegraded":"2024-09-19T09:37:44.145105+0000","last_fullsized":"2024-09-19T09:37:44.145105+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:58.435605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.141377+0000","last_change":"2024-09-19T09:36:12.981248+0000","last_active":"2024-09-19T09:37:44.141377+0000","last_peered":"2024-09-19T09:37:44.141377+0000","last_clean":"2024-09-19T09:37:44.141377+0000","last_became_active":"2024-09-19T09:36:12.980754+0000","last_became_peered":"2024-09-19T09:36:12.980754+0000","last_unstale":"2024-09-19T09:37:44.141377+0000","last_undegraded":"2024-09-19T09:37:44.141377+0000","last_fullsized":"2024-09-19T09:37:44.141377+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:03.970402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.139500+0000","last_change":"2024-09-19T09:36:12.990841+0000","last_active":"2024-09-19T09:37:44.139500+0000","last_peered":"2024-09-19T09:37:44.139500+0000","last_clean":"2024-09-19T09:37:44.139500+0000","last_became_active":"2024-09-19T09:36:12.989667+0000","last_became_peered":"2024-09-19T09:36:12.989667+0000","last_unstale":"2024-09-19T09:37:44.139500+0000","last_undegraded":"2024-09-19T09:37:44.139500+0000","last_fullsized":"2024-09-19T09:37:44.139500+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:46:00.314590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148537+0000","last_change":"2024-09-19T09:36:12.984007+0000","last_active":"2024-09-19T09:37:44.148537+0000","last_peered":"2024-09-19T09:37:44.148537+0000","last_clean":"2024-09-19T09:37:44.148537+0000","last_became_active":"2024-09-19T09:36:12.983627+0000","last_became_peered":"2024-09-19T09:36:12.983627+0000","last_unstale":"2024-09-19T09:37:44.148537+0000","last_undegraded":"2024-09-19T09:37:44.148537+0000","last_fullsized":"2024-09-19T09:37:44.148537+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:42.038673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146461+0000","last_change":"2024-09-19T09:36:12.988032+0000","last_active":"2024-09-19T09:37:44.146461+0000","last_peered":"2024-09-19T09:37:44.146461+0000","last_clean":"2024-09-19T09:37:44.146461+0000","last_became_active":"2024-09-19T09:36:12.987588+0000","last_became_peered":"2024-09-19T09:36:12.987588+0000","last_unstale":"2024-09-19T09:37:44.146461+0000","last_undegraded":"2024-09-19T09:37:44.146461+0000","last_fullsized":"2024-09-19T09:37:44.146461+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:01.518543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148152+0000","last_change":"2024-09-19T09:37:16.131565+0000","last_active":"2024-09-19T09:37:44.148152+0000","last_peered":"2024-09-19T09:37:44.148152+0000","last_clean":"2024-09-19T09:37:44.148152+0000","last_became_active":"2024-09-19T09:37:16.131171+0000","last_became_peered":"2024-09-19T09:37:16.131171+0000","last_unstale":"2024-09-19T09:37:44.148152+0000","last_undegraded":"2024-09-19T09:37:44.148152+0000","last_fullsized":"2024-09-19T09:37:44.148152+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:18.195074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.141174+0000","last_change":"2024-09-19T09:36:12.989709+0000","last_active":"2024-09-19T09:37:44.141174+0000","last_peered":"2024-09-19T09:37:44.141174+0000","last_clean":"2024-09-19T09:37:44.141174+0000","last_became_active":"2024-09-19T09:36:12.989324+0000","last_became_peered":"2024-09-19T09:36:12.989324+0000","last_unstale":"2024-09-19T09:37:44.141174+0000","last_undegraded":"2024-09-19T09:37:44.141174+0000","last_fullsized":"2024-09-19T09:37:44.141174+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:09.843175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.033713+0000","last_change":"2024-09-19T09:37:16.033713+0000","last_active":"2024-09-19T09:37:16.033713+0000","last_peered":"2024-09-19T09:37:16.033713+0000","last_clean":"2024-09-19T09:37:16.033713+0000","last_became_active":"2024-09-19T09:37:16.033230+0000","last_became_peered":"2024-09-19T09:37:16.033230+0000","last_unstale":"2024-09-19T09:37:16.033713+0000","last_undegraded":"2024-09-19T09:37:16.033713+0000","last_fullsized":"2024-09-19T09:37:16.033713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:12.262115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.143084+0000","last_change":"2024-09-19T09:37:16.484760+0000","last_active":"2024-09-19T09:37:44.143084+0000","last_peered":"2024-09-19T09:37:44.143084+0000","last_clean":"2024-09-19T09:37:44.143084+0000","last_became_active":"2024-09-19T09:37:16.484316+0000","last_became_peered":"2024-09-19T09:37:16.484316+0000","last_unstale":"2024-09-19T09:37:44.143084+0000","last_undegraded":"2024-09-19T09:37:44.143084+0000","last_fullsized":"2024-09-19T09:37:44.143084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:14.897601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.124818+0000","last_change":"2024-09-19T09:37:16.124818+0000","last_active":"2024-09-19T09:37:16.124818+0000","last_peered":"2024-09-19T09:37:16.124818+0000","last_clean":"2024-09-19T09:37:16.124818+0000","last_became_active":"2024-09-19T09:37:16.124391+0000","last_became_peered":"2024-09-19T09:37:16.124391+0000","last_unstale":"2024-09-19T09:37:16.124818+0000","last_undegraded":"2024-09-19T09:37:16.124818+0000","last_fullsized":"2024-09-19T09:37:16.124818+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:25.443666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034105+0000","last_change":"2024-09-19T09:36:10.837287+0000","last_active":"2024-09-19T09:37:16.034105+0000","last_peered":"2024-09-19T09:37:16.034105+0000","last_clean":"2024-09-19T09:37:16.034105+0000","last_became_active":"2024-09-19T09:36:10.836890+0000","last_became_peered":"2024-09-19T09:36:10.836890+0000","last_unstale":"2024-09-19T09:37:16.034105+0000","last_undegraded":"2024-09-19T09:37:16.034105+0000","last_fullsized":"2024-09-19T09:37:16.034105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:09.676728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.139992+0000","last_change":"2024-09-19T09:36:12.975690+0000","last_active":"2024-09-19T09:37:44.139992+0000","last_peered":"2024-09-19T09:37:44.139992+0000","last_clean":"2024-09-19T09:37:44.139992+0000","last_became_active":"2024-09-19T09:36:12.975370+0000","last_became_peered":"2024-09-19T09:36:12.975370+0000","last_unstale":"2024-09-19T09:37:44.139992+0000","last_undegraded":"2024-09-19T09:37:44.139992+0000","last_fullsized":"2024-09-19T09:37:44.139992+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:05.650917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030234+0000","last_change":"2024-09-19T09:36:10.843736+0000","last_active":"2024-09-19T09:37:16.030234+0000","last_peered":"2024-09-19T09:37:16.030234+0000","last_clean":"2024-09-19T09:37:16.030234+0000","last_became_active":"2024-09-19T09:36:10.843353+0000","last_became_peered":"2024-09-19T09:36:10.843353+0000","last_unstale":"2024-09-19T09:37:16.030234+0000","last_undegraded":"2024-09-19T09:37:16.030234+0000","last_fullsized":"2024-09-19T09:37:16.030234+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:29.818642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.140596+0000","last_change":"2024-09-19T09:36:12.978841+0000","last_active":"2024-09-19T09:37:44.140596+0000","last_peered":"2024-09-19T09:37:44.140596+0000","last_clean":"2024-09-19T09:37:44.140596+0000","last_became_active":"2024-09-19T09:36:12.978501+0000","last_became_peered":"2024-09-19T09:36:12.978501+0000","last_unstale":"2024-09-19T09:37:44.140596+0000","last_undegraded":"2024-09-19T09:37:44.140596+0000","last_fullsized":"2024-09-19T09:37:44.140596+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:07.974576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.032030+0000","last_change":"2024-09-19T09:36:10.841997+0000","last_active":"2024-09-19T09:37:16.032030+0000","last_peered":"2024-09-19T09:37:16.032030+0000","last_clean":"2024-09-19T09:37:16.032030+0000","last_became_active":"2024-09-19T09:36:10.841641+0000","last_became_peered":"2024-09-19T09:36:10.841641+0000","last_unstale":"2024-09-19T09:37:16.032030+0000","last_undegraded":"2024-09-19T09:37:16.032030+0000","last_fullsized":"2024-09-19T09:37:16.032030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:10.477879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.156072+0000","last_change":"2024-09-19T09:36:12.981486+0000","last_active":"2024-09-19T09:37:44.156072+0000","last_peered":"2024-09-19T09:37:44.156072+0000","last_clean":"2024-09-19T09:37:44.156072+0000","last_became_active":"2024-09-19T09:36:12.981165+0000","last_became_peered":"2024-09-19T09:36:12.981165+0000","last_unstale":"2024-09-19T09:37:44.156072+0000","last_undegraded":"2024-09-19T09:37:44.156072+0000","last_fullsized":"2024-09-19T09:37:44.156072+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:21.986132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030755+0000","last_change":"2024-09-19T09:36:10.845362+0000","last_active":"2024-09-19T09:37:16.030755+0000","last_peered":"2024-09-19T09:37:16.030755+0000","last_clean":"2024-09-19T09:37:16.030755+0000","last_became_active":"2024-09-19T09:36:10.844992+0000","last_became_peered":"2024-09-19T09:36:10.844992+0000","last_unstale":"2024-09-19T09:37:16.030755+0000","last_undegraded":"2024-09-19T09:37:16.030755+0000","last_fullsized":"2024-09-19T09:37:16.030755+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:52.854333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.137951+0000","last_change":"2024-09-19T09:36:12.988924+0000","last_active":"2024-09-19T09:37:44.137951+0000","last_peered":"2024-09-19T09:37:44.137951+0000","last_clean":"2024-09-19T09:37:44.137951+0000","last_became_active":"2024-09-19T09:36:12.988331+0000","last_became_peered":"2024-09-19T09:36:12.988331+0000","last_unstale":"2024-09-19T09:37:44.137951+0000","last_undegraded":"2024-09-19T09:37:44.137951+0000","last_fullsized":"2024-09-19T09:37:44.137951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:24.754252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029903+0000","last_change":"2024-09-19T09:36:10.860003+0000","last_active":"2024-09-19T09:37:16.029903+0000","last_peered":"2024-09-19T09:37:16.029903+0000","last_clean":"2024-09-19T09:37:16.029903+0000","last_became_active":"2024-09-19T09:36:10.859584+0000","last_became_peered":"2024-09-19T09:36:10.859584+0000","last_unstale":"2024-09-19T09:37:16.029903+0000","last_undegraded":"2024-09-19T09:37:16.029903+0000","last_fullsized":"2024-09-19T09:37:16.029903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:44.837960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.160481+0000","last_change":"2024-09-19T09:36:12.985446+0000","last_active":"2024-09-19T09:37:44.160481+0000","last_peered":"2024-09-19T09:37:44.160481+0000","last_clean":"2024-09-19T09:37:44.160481+0000","last_became_active":"2024-09-19T09:36:12.984671+0000","last_became_peered":"2024-09-19T09:36:12.984671+0000","last_unstale":"2024-09-19T09:37:44.160481+0000","last_undegraded":"2024-09-19T09:37:44.160481+0000","last_fullsized":"2024-09-19T09:37:44.160481+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:54.800151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'30","reported_seq":260,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:38:01.106636+0000","last_change":"2024-09-19T09:36:10.841056+0000","last_active":"2024-09-19T09:38:01.106636+0000","last_peered":"2024-09-19T09:38:01.106636+0000","last_clean":"2024-09-19T09:38:01.106636+0000","last_became_active":"2024-09-19T09:36:10.840731+0000","last_became_peered":"2024-09-19T09:36:10.840731+0000","last_unstale":"2024-09-19T09:38:01.106636+0000","last_undegraded":"2024-09-19T09:38:01.106636+0000","last_fullsized":"2024-09-19T09:38:01.106636+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:13.676188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63068,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":208,"num_read_kb":165,"num_write":30,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146672+0000","last_change":"2024-09-19T09:36:12.990223+0000","last_active":"2024-09-19T09:37:44.146672+0000","last_peered":"2024-09-19T09:37:44.146672+0000","last_clean":"2024-09-19T09:37:44.146672+0000","last_became_active":"2024-09-19T09:36:12.989720+0000","last_became_peered":"2024-09-19T09:36:12.989720+0000","last_unstale":"2024-09-19T09:37:44.146672+0000","last_undegraded":"2024-09-19T09:37:44.146672+0000","last_fullsized":"2024-09-19T09:37:44.146672+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:37.003075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.129753+0000","last_change":"2024-09-19T09:36:10.843288+0000","last_active":"2024-09-19T09:37:16.129753+0000","last_peered":"2024-09-19T09:37:16.129753+0000","last_clean":"2024-09-19T09:37:16.129753+0000","last_became_active":"2024-09-19T09:36:10.842844+0000","last_became_peered":"2024-09-19T09:36:10.842844+0000","last_unstale":"2024-09-19T09:37:16.129753+0000","last_undegraded":"2024-09-19T09:37:16.129753+0000","last_fullsized":"2024-09-19T09:37:16.129753+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:38.695411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145354+0000","last_change":"2024-09-19T09:36:12.981251+0000","last_active":"2024-09-19T09:37:44.145354+0000","last_peered":"2024-09-19T09:37:44.145354+0000","last_clean":"2024-09-19T09:37:44.145354+0000","last_became_active":"2024-09-19T09:36:12.980861+0000","last_became_peered":"2024-09-19T09:36:12.980861+0000","last_unstale":"2024-09-19T09:37:44.145354+0000","last_undegraded":"2024-09-19T09:37:44.145354+0000","last_fullsized":"2024-09-19T09:37:44.145354+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:09.633644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030128+0000","last_change":"2024-09-19T09:36:10.843448+0000","last_active":"2024-09-19T09:37:16.030128+0000","last_peered":"2024-09-19T09:37:16.030128+0000","last_clean":"2024-09-19T09:37:16.030128+0000","last_became_active":"2024-09-19T09:36:10.843087+0000","last_became_peered":"2024-09-19T09:36:10.843087+0000","last_unstale":"2024-09-19T09:37:16.030128+0000","last_undegraded":"2024-09-19T09:37:16.030128+0000","last_fullsized":"2024-09-19T09:37:16.030128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:20.623613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.151910+0000","last_change":"2024-09-19T09:36:12.981160+0000","last_active":"2024-09-19T09:37:44.151910+0000","last_peered":"2024-09-19T09:37:44.151910+0000","last_clean":"2024-09-19T09:37:44.151910+0000","last_became_active":"2024-09-19T09:36:12.980823+0000","last_became_peered":"2024-09-19T09:36:12.980823+0000","last_unstale":"2024-09-19T09:37:44.151910+0000","last_undegraded":"2024-09-19T09:37:44.151910+0000","last_fullsized":"2024-09-19T09:37:44.151910+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:39.323439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028480+0000","last_change":"2024-09-19T09:36:10.842536+0000","last_active":"2024-09-19T09:37:16.028480+0000","last_peered":"2024-09-19T09:37:16.028480+0000","last_clean":"2024-09-19T09:37:16.028480+0000","last_became_active":"2024-09-19T09:36:10.842176+0000","last_became_peered":"2024-09-19T09:36:10.842176+0000","last_unstale":"2024-09-19T09:37:16.028480+0000","last_undegraded":"2024-09-19T09:37:16.028480+0000","last_fullsized":"2024-09-19T09:37:16.028480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:37.871299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145814+0000","last_change":"2024-09-19T09:36:12.987271+0000","last_active":"2024-09-19T09:37:44.145814+0000","last_peered":"2024-09-19T09:37:44.145814+0000","last_clean":"2024-09-19T09:37:44.145814+0000","last_became_active":"2024-09-19T09:36:12.986918+0000","last_became_peered":"2024-09-19T09:36:12.986918+0000","last_unstale":"2024-09-19T09:37:44.145814+0000","last_undegraded":"2024-09-19T09:37:44.145814+0000","last_fullsized":"2024-09-19T09:37:44.145814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:07.608541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030337+0000","last_change":"2024-09-19T09:36:10.860370+0000","last_active":"2024-09-19T09:37:16.030337+0000","last_peered":"2024-09-19T09:37:16.030337+0000","last_clean":"2024-09-19T09:37:16.030337+0000","last_became_active":"2024-09-19T09:36:10.859820+0000","last_became_peered":"2024-09-19T09:36:10.859820+0000","last_unstale":"2024-09-19T09:37:16.030337+0000","last_undegraded":"2024-09-19T09:37:16.030337+0000","last_fullsized":"2024-09-19T09:37:16.030337+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:12.121038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.161919+0000","last_change":"2024-09-19T09:36:12.994449+0000","last_active":"2024-09-19T09:37:44.161919+0000","last_peered":"2024-09-19T09:37:44.161919+0000","last_clean":"2024-09-19T09:37:44.161919+0000","last_became_active":"2024-09-19T09:36:12.994141+0000","last_became_peered":"2024-09-19T09:36:12.994141+0000","last_unstale":"2024-09-19T09:37:44.161919+0000","last_undegraded":"2024-09-19T09:37:44.161919+0000","last_fullsized":"2024-09-19T09:37:44.161919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:21.416453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031764+0000","last_change":"2024-09-19T09:36:10.839609+0000","last_active":"2024-09-19T09:37:16.031764+0000","last_peered":"2024-09-19T09:37:16.031764+0000","last_clean":"2024-09-19T09:37:16.031764+0000","last_became_active":"2024-09-19T09:36:10.839227+0000","last_became_peered":"2024-09-19T09:36:10.839227+0000","last_unstale":"2024-09-19T09:37:16.031764+0000","last_undegraded":"2024-09-19T09:37:16.031764+0000","last_fullsized":"2024-09-19T09:37:16.031764+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:00.734924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.144996+0000","last_change":"2024-09-19T09:36:12.983573+0000","last_active":"2024-09-19T09:37:44.144996+0000","last_peered":"2024-09-19T09:37:44.144996+0000","last_clean":"2024-09-19T09:37:44.144996+0000","last_became_active":"2024-09-19T09:36:12.983241+0000","last_became_peered":"2024-09-19T09:36:12.983241+0000","last_unstale":"2024-09-19T09:37:44.144996+0000","last_undegraded":"2024-09-19T09:37:44.144996+0000","last_fullsized":"2024-09-19T09:37:44.144996+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:44.050271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034765+0000","last_change":"2024-09-19T09:36:10.839789+0000","last_active":"2024-09-19T09:37:16.034765+0000","last_peered":"2024-09-19T09:37:16.034765+0000","last_clean":"2024-09-19T09:37:16.034765+0000","last_became_active":"2024-09-19T09:36:10.839445+0000","last_became_peered":"2024-09-19T09:36:10.839445+0000","last_unstale":"2024-09-19T09:37:16.034765+0000","last_undegraded":"2024-09-19T09:37:16.034765+0000","last_fullsized":"2024-09-19T09:37:16.034765+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:16.040249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148829+0000","last_change":"2024-09-19T09:36:12.993420+0000","last_active":"2024-09-19T09:37:44.148829+0000","last_peered":"2024-09-19T09:37:44.148829+0000","last_clean":"2024-09-19T09:37:44.148829+0000","last_became_active":"2024-09-19T09:36:12.992334+0000","last_became_peered":"2024-09-19T09:36:12.992334+0000","last_unstale":"2024-09-19T09:37:44.148829+0000","last_undegraded":"2024-09-19T09:37:44.148829+0000","last_fullsized":"2024-09-19T09:37:44.148829+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:21.693164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030247+0000","last_change":"2024-09-19T09:36:10.839461+0000","last_active":"2024-09-19T09:37:16.030247+0000","last_peered":"2024-09-19T09:37:16.030247+0000","last_clean":"2024-09-19T09:37:16.030247+0000","last_became_active":"2024-09-19T09:36:10.839092+0000","last_became_peered":"2024-09-19T09:36:10.839092+0000","last_unstale":"2024-09-19T09:37:16.030247+0000","last_undegraded":"2024-09-19T09:37:16.030247+0000","last_fullsized":"2024-09-19T09:37:16.030247+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:02.367267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145214+0000","last_change":"2024-09-19T09:36:12.988234+0000","last_active":"2024-09-19T09:37:44.145214+0000","last_peered":"2024-09-19T09:37:44.145214+0000","last_clean":"2024-09-19T09:37:44.145214+0000","last_became_active":"2024-09-19T09:36:12.987813+0000","last_became_peered":"2024-09-19T09:36:12.987813+0000","last_unstale":"2024-09-19T09:37:44.145214+0000","last_undegraded":"2024-09-19T09:37:44.145214+0000","last_fullsized":"2024-09-19T09:37:44.145214+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:56.024428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.130482+0000","last_change":"2024-09-19T09:36:10.945705+0000","last_active":"2024-09-19T09:37:16.130482+0000","last_peered":"2024-09-19T09:37:16.130482+0000","last_clean":"2024-09-19T09:37:16.130482+0000","last_became_active":"2024-09-19T09:36:10.945323+0000","last_became_peered":"2024-09-19T09:36:10.945323+0000","last_unstale":"2024-09-19T09:37:16.130482+0000","last_undegraded":"2024-09-19T09:37:16.130482+0000","last_fullsized":"2024-09-19T09:37:16.130482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:24.211909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.162179+0000","last_change":"2024-09-19T09:36:12.990517+0000","last_active":"2024-09-19T09:37:44.162179+0000","last_peered":"2024-09-19T09:37:44.162179+0000","last_clean":"2024-09-19T09:37:44.162179+0000","last_became_active":"2024-09-19T09:36:12.989291+0000","last_became_peered":"2024-09-19T09:36:12.989291+0000","last_unstale":"2024-09-19T09:37:44.162179+0000","last_undegraded":"2024-09-19T09:37:44.162179+0000","last_fullsized":"2024-09-19T09:37:44.162179+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:31.087798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":339,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030377+0000","last_change":"2024-09-19T09:34:59.337025+0000","last_active":"2024-09-19T09:37:16.030377+0000","last_peered":"2024-09-19T09:37:16.030377+0000","last_clean":"2024-09-19T09:37:16.030377+0000","last_became_active":"2024-09-19T09:34:59.336556+0000","last_became_peered":"2024-09-19T09:34:59.336556+0000","last_unstale":"2024-09-19T09:37:16.030377+0000","last_undegraded":"2024-09-19T09:37:16.030377+0000","last_fullsized":"2024-09-19T09:37:16.030377+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:31:30.566923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:31:30.566923+0000","last_clean_scrub_stamp":"2024-09-19T09:31:30.566923+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:00.675254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028715+0000","last_change":"2024-09-19T09:36:10.838131+0000","last_active":"2024-09-19T09:37:16.028715+0000","last_peered":"2024-09-19T09:37:16.028715+0000","last_clean":"2024-09-19T09:37:16.028715+0000","last_became_active":"2024-09-19T09:36:10.837725+0000","last_became_peered":"2024-09-19T09:36:10.837725+0000","last_unstale":"2024-09-19T09:37:16.028715+0000","last_undegraded":"2024-09-19T09:37:16.028715+0000","last_fullsized":"2024-09-19T09:37:16.028715+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:57.104726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.139840+0000","last_change":"2024-09-19T09:36:12.981951+0000","last_active":"2024-09-19T09:37:44.139840+0000","last_peered":"2024-09-19T09:37:44.139840+0000","last_clean":"2024-09-19T09:37:44.139840+0000","last_became_active":"2024-09-19T09:36:12.981558+0000","last_became_peered":"2024-09-19T09:36:12.981558+0000","last_unstale":"2024-09-19T09:37:44.139840+0000","last_undegraded":"2024-09-19T09:37:44.139840+0000","last_fullsized":"2024-09-19T09:37:44.139840+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:31.119853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030184+0000","last_change":"2024-09-19T09:36:10.843574+0000","last_active":"2024-09-19T09:37:16.030184+0000","last_peered":"2024-09-19T09:37:16.030184+0000","last_clean":"2024-09-19T09:37:16.030184+0000","last_became_active":"2024-09-19T09:36:10.843252+0000","last_became_peered":"2024-09-19T09:36:10.843252+0000","last_unstale":"2024-09-19T09:37:16.030184+0000","last_undegraded":"2024-09-19T09:37:16.030184+0000","last_fullsized":"2024-09-19T09:37:16.030184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:10.492812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147324+0000","last_change":"2024-09-19T09:36:12.984538+0000","last_active":"2024-09-19T09:37:44.147324+0000","last_peered":"2024-09-19T09:37:44.147324+0000","last_clean":"2024-09-19T09:37:44.147324+0000","last_became_active":"2024-09-19T09:36:12.983448+0000","last_became_peered":"2024-09-19T09:36:12.983448+0000","last_unstale":"2024-09-19T09:37:44.147324+0000","last_undegraded":"2024-09-19T09:37:44.147324+0000","last_fullsized":"2024-09-19T09:37:44.147324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:48.294473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034208+0000","last_change":"2024-09-19T09:36:10.858959+0000","last_active":"2024-09-19T09:37:16.034208+0000","last_peered":"2024-09-19T09:37:16.034208+0000","last_clean":"2024-09-19T09:37:16.034208+0000","last_became_active":"2024-09-19T09:36:10.858638+0000","last_became_peered":"2024-09-19T09:36:10.858638+0000","last_unstale":"2024-09-19T09:37:16.034208+0000","last_undegraded":"2024-09-19T09:37:16.034208+0000","last_fullsized":"2024-09-19T09:37:16.034208+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:12.646483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.142955+0000","last_change":"2024-09-19T09:36:12.992710+0000","last_active":"2024-09-19T09:37:44.142955+0000","last_peered":"2024-09-19T09:37:44.142955+0000","last_clean":"2024-09-19T09:37:44.142955+0000","last_became_active":"2024-09-19T09:36:12.992436+0000","last_became_peered":"2024-09-19T09:36:12.992436+0000","last_unstale":"2024-09-19T09:37:44.142955+0000","last_undegraded":"2024-09-19T09:37:44.142955+0000","last_fullsized":"2024-09-19T09:37:44.142955+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:51.685516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030475+0000","last_change":"2024-09-19T09:36:10.842031+0000","last_active":"2024-09-19T09:37:16.030475+0000","last_peered":"2024-09-19T09:37:16.030475+0000","last_clean":"2024-09-19T09:37:16.030475+0000","last_became_active":"2024-09-19T09:36:10.841693+0000","last_became_peered":"2024-09-19T09:36:10.841693+0000","last_unstale":"2024-09-19T09:37:16.030475+0000","last_undegraded":"2024-09-19T09:37:16.030475+0000","last_fullsized":"2024-09-19T09:37:16.030475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:28:51.040551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.138330+0000","last_change":"2024-09-19T09:37:16.034026+0000","last_active":"2024-09-19T09:37:44.138330+0000","last_peered":"2024-09-19T09:37:44.138330+0000","last_clean":"2024-09-19T09:37:44.138330+0000","last_became_active":"2024-09-19T09:37:16.033546+0000","last_became_peered":"2024-09-19T09:37:16.033546+0000","last_unstale":"2024-09-19T09:37:44.138330+0000","last_undegraded":"2024-09-19T09:37:44.138330+0000","last_fullsized":"2024-09-19T09:37:44.138330+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:42.673825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.027885+0000","last_change":"2024-09-19T09:36:10.860470+0000","last_active":"2024-09-19T09:37:16.027885+0000","last_peered":"2024-09-19T09:37:16.027885+0000","last_clean":"2024-09-19T09:37:16.027885+0000","last_became_active":"2024-09-19T09:36:10.860097+0000","last_became_peered":"2024-09-19T09:36:10.860097+0000","last_unstale":"2024-09-19T09:37:16.027885+0000","last_undegraded":"2024-09-19T09:37:16.027885+0000","last_fullsized":"2024-09-19T09:37:16.027885+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:14.933378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.139200+0000","last_change":"2024-09-19T09:36:12.988489+0000","last_active":"2024-09-19T09:37:44.139200+0000","last_peered":"2024-09-19T09:37:44.139200+0000","last_clean":"2024-09-19T09:37:44.139200+0000","last_became_active":"2024-09-19T09:36:12.988151+0000","last_became_peered":"2024-09-19T09:36:12.988151+0000","last_unstale":"2024-09-19T09:37:44.139200+0000","last_undegraded":"2024-09-19T09:37:44.139200+0000","last_fullsized":"2024-09-19T09:37:44.139200+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:24.088771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030844+0000","last_change":"2024-09-19T09:36:10.860103+0000","last_active":"2024-09-19T09:37:16.030844+0000","last_peered":"2024-09-19T09:37:16.030844+0000","last_clean":"2024-09-19T09:37:16.030844+0000","last_became_active":"2024-09-19T09:36:10.859526+0000","last_became_peered":"2024-09-19T09:36:10.859526+0000","last_unstale":"2024-09-19T09:37:16.030844+0000","last_undegraded":"2024-09-19T09:37:16.030844+0000","last_fullsized":"2024-09-19T09:37:16.030844+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:25.460372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148110+0000","last_change":"2024-09-19T09:36:12.986286+0000","last_active":"2024-09-19T09:37:44.148110+0000","last_peered":"2024-09-19T09:37:44.148110+0000","last_clean":"2024-09-19T09:37:44.148110+0000","last_became_active":"2024-09-19T09:36:12.985982+0000","last_became_peered":"2024-09-19T09:36:12.985982+0000","last_unstale":"2024-09-19T09:37:44.148110+0000","last_undegraded":"2024-09-19T09:37:44.148110+0000","last_fullsized":"2024-09-19T09:37:44.148110+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:19.026134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'11","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028153+0000","last_change":"2024-09-19T09:36:10.839280+0000","last_active":"2024-09-19T09:37:16.028153+0000","last_peered":"2024-09-19T09:37:16.028153+0000","last_clean":"2024-09-19T09:37:16.028153+0000","last_became_active":"2024-09-19T09:36:10.838979+0000","last_became_peered":"2024-09-19T09:36:10.838979+0000","last_unstale":"2024-09-19T09:37:16.028153+0000","last_undegraded":"2024-09-19T09:37:16.028153+0000","last_fullsized":"2024-09-19T09:37:16.028153+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:06.303175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146091+0000","last_change":"2024-09-19T09:36:12.979778+0000","last_active":"2024-09-19T09:37:44.146091+0000","last_peered":"2024-09-19T09:37:44.146091+0000","last_clean":"2024-09-19T09:37:44.146091+0000","last_became_active":"2024-09-19T09:36:12.979455+0000","last_became_peered":"2024-09-19T09:36:12.979455+0000","last_unstale":"2024-09-19T09:37:44.146091+0000","last_undegraded":"2024-09-19T09:37:44.146091+0000","last_fullsized":"2024-09-19T09:37:44.146091+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:36.620368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029063+0000","last_change":"2024-09-19T09:36:10.945706+0000","last_active":"2024-09-19T09:37:16.029063+0000","last_peered":"2024-09-19T09:37:16.029063+0000","last_clean":"2024-09-19T09:37:16.029063+0000","last_became_active":"2024-09-19T09:36:10.945314+0000","last_became_peered":"2024-09-19T09:36:10.945314+0000","last_unstale":"2024-09-19T09:37:16.029063+0000","last_undegraded":"2024-09-19T09:37:16.029063+0000","last_fullsized":"2024-09-19T09:37:16.029063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:49.786913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.141688+0000","last_change":"2024-09-19T09:36:12.989412+0000","last_active":"2024-09-19T09:37:44.141688+0000","last_peered":"2024-09-19T09:37:44.141688+0000","last_clean":"2024-09-19T09:37:44.141688+0000","last_became_active":"2024-09-19T09:36:12.989109+0000","last_became_peered":"2024-09-19T09:36:12.989109+0000","last_unstale":"2024-09-19T09:37:44.141688+0000","last_undegraded":"2024-09-19T09:37:44.141688+0000","last_fullsized":"2024-09-19T09:37:44.141688+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:33.142592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.123342+0000","last_change":"2024-09-19T09:36:10.858581+0000","last_active":"2024-09-19T09:37:16.123342+0000","last_peered":"2024-09-19T09:37:16.123342+0000","last_clean":"2024-09-19T09:37:16.123342+0000","last_became_active":"2024-09-19T09:36:10.858240+0000","last_became_peered":"2024-09-19T09:36:10.858240+0000","last_unstale":"2024-09-19T09:37:16.123342+0000","last_undegraded":"2024-09-19T09:37:16.123342+0000","last_fullsized":"2024-09-19T09:37:16.123342+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:45.285839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.111050+0000","last_change":"2024-09-19T09:36:12.989075+0000","last_active":"2024-09-19T09:37:44.111050+0000","last_peered":"2024-09-19T09:37:44.111050+0000","last_clean":"2024-09-19T09:37:44.111050+0000","last_became_active":"2024-09-19T09:36:12.988752+0000","last_became_peered":"2024-09-19T09:36:12.988752+0000","last_unstale":"2024-09-19T09:37:44.111050+0000","last_undegraded":"2024-09-19T09:37:44.111050+0000","last_fullsized":"2024-09-19T09:37:44.111050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.424032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.483353+0000","last_change":"2024-09-19T09:36:10.838716+0000","last_active":"2024-09-19T09:37:16.483353+0000","last_peered":"2024-09-19T09:37:16.483353+0000","last_clean":"2024-09-19T09:37:16.483353+0000","last_became_active":"2024-09-19T09:36:10.838393+0000","last_became_peered":"2024-09-19T09:36:10.838393+0000","last_unstale":"2024-09-19T09:37:16.483353+0000","last_undegraded":"2024-09-19T09:37:16.483353+0000","last_fullsized":"2024-09-19T09:37:16.483353+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:54.107223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147844+0000","last_change":"2024-09-19T09:36:12.991721+0000","last_active":"2024-09-19T09:37:44.147844+0000","last_peered":"2024-09-19T09:37:44.147844+0000","last_clean":"2024-09-19T09:37:44.147844+0000","last_became_active":"2024-09-19T09:36:12.991398+0000","last_became_peered":"2024-09-19T09:36:12.991398+0000","last_unstale":"2024-09-19T09:37:44.147844+0000","last_undegraded":"2024-09-19T09:37:44.147844+0000","last_fullsized":"2024-09-19T09:37:44.147844+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:19:31.312072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.485156+0000","last_change":"2024-09-19T09:37:16.484541+0000","last_active":"2024-09-19T09:37:16.485156+0000","last_peered":"2024-09-19T09:37:16.485156+0000","last_clean":"2024-09-19T09:37:16.485156+0000","last_became_active":"2024-09-19T09:37:16.484035+0000","last_became_peered":"2024-09-19T09:37:16.484035+0000","last_unstale":"2024-09-19T09:37:16.485156+0000","last_undegraded":"2024-09-19T09:37:16.485156+0000","last_fullsized":"2024-09-19T09:37:16.485156+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:36.332699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146414+0000","last_change":"2024-09-19T09:36:12.984180+0000","last_active":"2024-09-19T09:37:44.146414+0000","last_peered":"2024-09-19T09:37:44.146414+0000","last_clean":"2024-09-19T09:37:44.146414+0000","last_became_active":"2024-09-19T09:36:12.983876+0000","last_became_peered":"2024-09-19T09:36:12.983876+0000","last_unstale":"2024-09-19T09:37:44.146414+0000","last_undegraded":"2024-09-19T09:37:44.146414+0000","last_fullsized":"2024-09-19T09:37:44.146414+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:45.876771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031127+0000","last_change":"2024-09-19T09:36:10.845391+0000","last_active":"2024-09-19T09:37:16.031127+0000","last_peered":"2024-09-19T09:37:16.031127+0000","last_clean":"2024-09-19T09:37:16.031127+0000","last_became_active":"2024-09-19T09:36:10.844974+0000","last_became_peered":"2024-09-19T09:36:10.844974+0000","last_unstale":"2024-09-19T09:37:16.031127+0000","last_undegraded":"2024-09-19T09:37:16.031127+0000","last_fullsized":"2024-09-19T09:37:16.031127+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:00.318337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.162083+0000","last_change":"2024-09-19T09:36:12.991145+0000","last_active":"2024-09-19T09:37:44.162083+0000","last_peered":"2024-09-19T09:37:44.162083+0000","last_clean":"2024-09-19T09:37:44.162083+0000","last_became_active":"2024-09-19T09:36:12.989891+0000","last_became_peered":"2024-09-19T09:36:12.989891+0000","last_unstale":"2024-09-19T09:37:44.162083+0000","last_undegraded":"2024-09-19T09:37:44.162083+0000","last_fullsized":"2024-09-19T09:37:44.162083+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:21.054936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.162240+0000","last_change":"2024-09-19T09:36:12.995378+0000","last_active":"2024-09-19T09:37:44.162240+0000","last_peered":"2024-09-19T09:37:44.162240+0000","last_clean":"2024-09-19T09:37:44.162240+0000","last_became_active":"2024-09-19T09:36:12.995028+0000","last_became_peered":"2024-09-19T09:36:12.995028+0000","last_unstale":"2024-09-19T09:37:44.162240+0000","last_undegraded":"2024-09-19T09:37:44.162240+0000","last_fullsized":"2024-09-19T09:37:44.162240+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:41.102130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031259+0000","last_change":"2024-09-19T09:36:10.839595+0000","last_active":"2024-09-19T09:37:16.031259+0000","last_peered":"2024-09-19T09:37:16.031259+0000","last_clean":"2024-09-19T09:37:16.031259+0000","last_became_active":"2024-09-19T09:36:10.839196+0000","last_became_peered":"2024-09-19T09:36:10.839196+0000","last_unstale":"2024-09-19T09:37:16.031259+0000","last_undegraded":"2024-09-19T09:37:16.031259+0000","last_fullsized":"2024-09-19T09:37:16.031259+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:02.272731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.160402+0000","last_change":"2024-09-19T09:36:12.984485+0000","last_active":"2024-09-19T09:37:44.160402+0000","last_peered":"2024-09-19T09:37:44.160402+0000","last_clean":"2024-09-19T09:37:44.160402+0000","last_became_active":"2024-09-19T09:36:12.984004+0000","last_became_peered":"2024-09-19T09:36:12.984004+0000","last_unstale":"2024-09-19T09:37:44.160402+0000","last_undegraded":"2024-09-19T09:37:44.160402+0000","last_fullsized":"2024-09-19T09:37:44.160402+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:37.646776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030731+0000","last_change":"2024-09-19T09:36:10.845306+0000","last_active":"2024-09-19T09:37:16.030731+0000","last_peered":"2024-09-19T09:37:16.030731+0000","last_clean":"2024-09-19T09:37:16.030731+0000","last_became_active":"2024-09-19T09:36:10.844952+0000","last_became_peered":"2024-09-19T09:36:10.844952+0000","last_unstale":"2024-09-19T09:37:16.030731+0000","last_undegraded":"2024-09-19T09:37:16.030731+0000","last_fullsized":"2024-09-19T09:37:16.030731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:09.792482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.161016+0000","last_change":"2024-09-19T09:36:12.991260+0000","last_active":"2024-09-19T09:37:44.161016+0000","last_peered":"2024-09-19T09:37:44.161016+0000","last_clean":"2024-09-19T09:37:44.161016+0000","last_became_active":"2024-09-19T09:36:12.989981+0000","last_became_peered":"2024-09-19T09:36:12.989981+0000","last_unstale":"2024-09-19T09:37:44.161016+0000","last_undegraded":"2024-09-19T09:37:44.161016+0000","last_fullsized":"2024-09-19T09:37:44.161016+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:11.301790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.483876+0000","last_change":"2024-09-19T09:36:10.859016+0000","last_active":"2024-09-19T09:37:16.483876+0000","last_peered":"2024-09-19T09:37:16.483876+0000","last_clean":"2024-09-19T09:37:16.483876+0000","last_became_active":"2024-09-19T09:36:10.858661+0000","last_became_peered":"2024-09-19T09:36:10.858661+0000","last_unstale":"2024-09-19T09:37:16.483876+0000","last_undegraded":"2024-09-19T09:37:16.483876+0000","last_fullsized":"2024-09-19T09:37:16.483876+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:54.395977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148013+0000","last_change":"2024-09-19T09:37:16.131601+0000","last_active":"2024-09-19T09:37:44.148013+0000","last_peered":"2024-09-19T09:37:44.148013+0000","last_clean":"2024-09-19T09:37:44.148013+0000","last_became_active":"2024-09-19T09:37:16.131199+0000","last_became_peered":"2024-09-19T09:37:16.131199+0000","last_unstale":"2024-09-19T09:37:44.148013+0000","last_undegraded":"2024-09-19T09:37:44.148013+0000","last_fullsized":"2024-09-19T09:37:44.148013+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:27.358544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.039032+0000","last_change":"2024-09-19T09:37:16.039032+0000","last_active":"2024-09-19T09:37:16.039032+0000","last_peered":"2024-09-19T09:37:16.039032+0000","last_clean":"2024-09-19T09:37:16.039032+0000","last_became_active":"2024-09-19T09:37:16.035315+0000","last_became_peered":"2024-09-19T09:37:16.035315+0000","last_unstale":"2024-09-19T09:37:16.039032+0000","last_undegraded":"2024-09-19T09:37:16.039032+0000","last_fullsized":"2024-09-19T09:37:16.039032+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:58.795064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63866,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":214,"num_read_kb":171,"num_write":89,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":191598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282954,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547236,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":441682,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776169,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1036288,"data_stored":1094847,"data_compressed":41852,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972398,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":441682,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201330,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":441704,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430265,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":1031585,"data_compressed":41852,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593790,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":441217,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822723,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":1031767,"data_compressed":41852,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953544,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":441122,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215181,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":913408,"data_stored":441438,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444113,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":974848,"data_stored":504202,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":504168,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":441190,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":63068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":63102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:38:05.054 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:38:05.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.191+0000 7fb2ed19f640 1 -- 172.21.15.1:0/275405403 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2e81024d0 msgr2=0x7fb2e8108d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:05.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.191+0000 7fb2ed19f640 1 --2- 172.21.15.1:0/275405403 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2e81024d0 0x7fb2e8108d60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0009ca0 tx=0x7fb2e002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:38:05.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.191+0000 7fb2ed19f640 1 -- 172.21.15.1:0/275405403 shutdown_connections 2024-09-19T09:38:05.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.191+0000 7fb2ed19f640 1 --2- 172.21.15.1:0/275405403 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2e81024d0 0x7fb2e8108d60 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:05.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.191+0000 7fb2ed19f640 1 --2- 172.21.15.1:0/275405403 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2e8101b10 0x7fb2e8101f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:05.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.191+0000 7fb2ed19f640 1 --2- 172.21.15.1:0/275405403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2e8100920 0x7fb2e8100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:05.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.191+0000 7fb2ed19f640 1 -- 172.21.15.1:0/275405403 >> 172.21.15.1:0/275405403 conn(0x7fb2e80fc080 msgr2=0x7fb2e80fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:05.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.191+0000 7fb2ed19f640 1 -- 172.21.15.1:0/275405403 shutdown_connections 2024-09-19T09:38:05.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.191+0000 7fb2ed19f640 1 -- 172.21.15.1:0/275405403 wait complete. 2024-09-19T09:38:05.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.192+0000 7fb2ed19f640 1 Processor -- start 2024-09-19T09:38:05.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.192+0000 7fb2ed19f640 1 -- start start 2024-09-19T09:38:05.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.192+0000 7fb2ed19f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2e8100920 0x7fb2e810b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:05.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.192+0000 7fb2ed19f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2e8101b10 0x7fb2e81098e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:05.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.192+0000 7fb2ed19f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2e81024d0 0x7fb2e8109e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:05.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.192+0000 7fb2ed19f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e810d710 con 0x7fb2e8101b10 2024-09-19T09:38:05.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.192+0000 7fb2ed19f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e810d590 con 0x7fb2e81024d0 2024-09-19T09:38:05.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.192+0000 7fb2ed19f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e810d890 con 0x7fb2e8100920 2024-09-19T09:38:05.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.193+0000 7fb2e77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2e8101b10 0x7fb2e81098e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:05.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.193+0000 7fb2e77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2e8101b10 0x7fb2e81098e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49090/0 (socket says 172.21.15.1:49090) 2024-09-19T09:38:05.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.193+0000 7fb2e77fe640 1 -- 172.21.15.1:0/852599913 learned_addr learned my addr 172.21.15.1:0/852599913 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:05.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.193+0000 7fb2ec99e640 1 --2- 172.21.15.1:0/852599913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2e81024d0 0x7fb2e8109e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:05.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.193+0000 7fb2e7fff640 1 --2- 172.21.15.1:0/852599913 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2e8100920 0x7fb2e810b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:05.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.193+0000 7fb2e77fe640 1 -- 172.21.15.1:0/852599913 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2e8100920 msgr2=0x7fb2e810b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:05.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.193+0000 7fb2e77fe640 1 --2- 172.21.15.1:0/852599913 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2e8100920 0x7fb2e810b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:05.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.193+0000 7fb2e77fe640 1 -- 172.21.15.1:0/852599913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2e81024d0 msgr2=0x7fb2e8109e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:05.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.193+0000 7fb2e77fe640 1 --2- 172.21.15.1:0/852599913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2e81024d0 0x7fb2e8109e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:05.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.193+0000 7fb2e77fe640 1 -- 172.21.15.1:0/852599913 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e810a6b0 con 0x7fb2e8101b10 2024-09-19T09:38:05.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.193+0000 7fb2e7fff640 1 --2- 172.21.15.1:0/852599913 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2e8100920 0x7fb2e810b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:05.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.193+0000 7fb2e77fe640 1 --2- 172.21.15.1:0/852599913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2e8101b10 0x7fb2e81098e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc00b4a0 tx=0x7fb2dc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:05.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.193+0000 7fb2e57fa640 1 -- 172.21.15.1:0/852599913 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc014070 con 0x7fb2e8101b10 2024-09-19T09:38:05.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.193+0000 7fb2e57fa640 1 -- 172.21.15.1:0/852599913 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2dc010af0 con 0x7fb2e8101b10 2024-09-19T09:38:05.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.193+0000 7fb2e57fa640 1 -- 172.21.15.1:0/852599913 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc017d10 con 0x7fb2e8101b10 2024-09-19T09:38:05.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.193+0000 7fb2ed19f640 1 -- 172.21.15.1:0/852599913 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2e81a1e80 con 0x7fb2e8101b10 2024-09-19T09:38:05.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.193+0000 7fb2ed19f640 1 -- 172.21.15.1:0/852599913 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2e81a2310 con 0x7fb2e8101b10 2024-09-19T09:38:05.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.194+0000 7fb2ed19f640 1 -- 172.21.15.1:0/852599913 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2e8107c90 con 0x7fb2e8101b10 2024-09-19T09:38:05.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.196+0000 7fb2e57fa640 1 -- 172.21.15.1:0/852599913 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fb2dc017070 con 0x7fb2e8101b10 2024-09-19T09:38:05.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.196+0000 7fb2e57fa640 1 --2- 172.21.15.1:0/852599913 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb2d00a32c0 0x7fb2d00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:05.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.196+0000 7fb2e57fa640 1 -- 172.21.15.1:0/852599913 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fb2dc0cefd0 con 0x7fb2e8101b10 2024-09-19T09:38:05.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.196+0000 7fb2e7fff640 1 --2- 172.21.15.1:0/852599913 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb2d00a32c0 0x7fb2d00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:05.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.197+0000 7fb2e7fff640 1 --2- 172.21.15.1:0/852599913 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb2d00a32c0 0x7fb2d00a5780 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8101970 tx=0x7fb2d8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:05.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.199+0000 7fb2e57fa640 1 -- 172.21.15.1:0/852599913 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb2dc09bcf0 con 0x7fb2e8101b10 2024-09-19T09:38:05.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.374+0000 7fb2ed19f640 1 -- 172.21.15.1:0/852599913 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb2e8062630 con 0x7fb2d00a32c0 2024-09-19T09:38:05.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.380+0000 7fb2e57fa640 1 -- 172.21.15.1:0/852599913 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259001 (secure 0 0 0) 0x7fb2e8062630 con 0x7fb2d00a32c0 2024-09-19T09:38:05.384 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:38:05.385 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-19T09:38:05.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.383+0000 7fb2ed19f640 1 -- 172.21.15.1:0/852599913 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb2d00a32c0 msgr2=0x7fb2d00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:05.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.383+0000 7fb2ed19f640 1 --2- 172.21.15.1:0/852599913 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb2d00a32c0 0x7fb2d00a5780 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8101970 tx=0x7fb2d8005f90 comp rx=0 tx=0).stop 2024-09-19T09:38:05.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.383+0000 7fb2ed19f640 1 -- 172.21.15.1:0/852599913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2e8101b10 msgr2=0x7fb2e81098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:05.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.383+0000 7fb2ed19f640 1 --2- 172.21.15.1:0/852599913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2e8101b10 0x7fb2e81098e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc00b4a0 tx=0x7fb2dc00b960 comp rx=0 tx=0).stop 2024-09-19T09:38:05.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.383+0000 7fb2ed19f640 1 -- 172.21.15.1:0/852599913 shutdown_connections 2024-09-19T09:38:05.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.383+0000 7fb2ed19f640 1 --2- 172.21.15.1:0/852599913 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb2d00a32c0 0x7fb2d00a5780 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:05.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.383+0000 7fb2ed19f640 1 --2- 172.21.15.1:0/852599913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2e81024d0 0x7fb2e8109e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:05.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.383+0000 7fb2ed19f640 1 --2- 172.21.15.1:0/852599913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2e8101b10 0x7fb2e81098e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:05.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.383+0000 7fb2ed19f640 1 --2- 172.21.15.1:0/852599913 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2e8100920 0x7fb2e810b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:05.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.383+0000 7fb2ed19f640 1 -- 172.21.15.1:0/852599913 >> 172.21.15.1:0/852599913 conn(0x7fb2e80fc080 msgr2=0x7fb2e8104e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:05.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.383+0000 7fb2ed19f640 1 -- 172.21.15.1:0/852599913 shutdown_connections 2024-09-19T09:38:05.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.383+0000 7fb2ed19f640 1 -- 172.21.15.1:0/852599913 wait complete. 2024-09-19T09:38:05.395 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:05 smithi001 ceph-mon[31225]: pgmap v338: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:38:05.395 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:05 smithi001 ceph-mon[31225]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:38:05.396 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-09-19T09:38:04.157147+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654468,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":340,"num_read_kb":280,"num_write":272,"num_write_kb":3030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":712,"ondisk_log_size":712,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":405964,"kb_used_data":10956,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124535860,"statfs":{"total":1151940427776,"available":1151524720640,"internally_reserved":0,"allocated":11218944,"data_stored":7256604,"data_compressed":178359,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19141,"internal_metadata":404272443},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002802"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147034+0000","last_change":"2024-09-19T09:36:12.985228+0000","last_active":"2024-09-19T09:37:44.147034+0000","last_peered":"2024-09-19T09:37:44.147034+0000","last_clean":"2024-09-19T09:37:44.147034+0000","last_became_active":"2024-09-19T09:36:12.984306+0000","last_became_peered":"2024-09-19T09:36:12.984306+0000","last_unstale":"2024-09-19T09:37:44.147034+0000","last_undegraded":"2024-09-19T09:37:44.147034+0000","last_fullsized":"2024-09-19T09:37:44.147034+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:45.988859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145651+0000","last_change":"2024-09-19T09:36:12.987631+0000","last_active":"2024-09-19T09:37:44.145651+0000","last_peered":"2024-09-19T09:37:44.145651+0000","last_clean":"2024-09-19T09:37:44.145651+0000","last_became_active":"2024-09-19T09:36:12.987298+0000","last_became_peered":"2024-09-19T09:36:12.987298+0000","last_unstale":"2024-09-19T09:37:44.145651+0000","last_undegraded":"2024-09-19T09:37:44.145651+0000","last_fullsized":"2024-09-19T09:37:44.145651+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:47.397162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.161196+0000","last_change":"2024-09-19T09:36:12.991466+0000","last_active":"2024-09-19T09:37:44.161196+0000","last_peered":"2024-09-19T09:37:44.161196+0000","last_clean":"2024-09-19T09:37:44.161196+0000","last_became_active":"2024-09-19T09:36:12.990903+0000","last_became_peered":"2024-09-19T09:36:12.990903+0000","last_unstale":"2024-09-19T09:37:44.161196+0000","last_undegraded":"2024-09-19T09:37:44.161196+0000","last_fullsized":"2024-09-19T09:37:44.161196+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:04.128768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.150215+0000","last_change":"2024-09-19T09:36:12.986686+0000","last_active":"2024-09-19T09:37:44.150215+0000","last_peered":"2024-09-19T09:37:44.150215+0000","last_clean":"2024-09-19T09:37:44.150215+0000","last_became_active":"2024-09-19T09:36:12.986334+0000","last_became_peered":"2024-09-19T09:36:12.986334+0000","last_unstale":"2024-09-19T09:37:44.150215+0000","last_undegraded":"2024-09-19T09:37:44.150215+0000","last_fullsized":"2024-09-19T09:37:44.150215+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:39.926343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.139116+0000","last_change":"2024-09-19T09:36:12.981964+0000","last_active":"2024-09-19T09:37:44.139116+0000","last_peered":"2024-09-19T09:37:44.139116+0000","last_clean":"2024-09-19T09:37:44.139116+0000","last_became_active":"2024-09-19T09:36:12.981558+0000","last_became_peered":"2024-09-19T09:36:12.981558+0000","last_unstale":"2024-09-19T09:37:44.139116+0000","last_undegraded":"2024-09-19T09:37:44.139116+0000","last_fullsized":"2024-09-19T09:37:44.139116+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:33.706451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146524+0000","last_change":"2024-09-19T09:36:12.992598+0000","last_active":"2024-09-19T09:37:44.146524+0000","last_peered":"2024-09-19T09:37:44.146524+0000","last_clean":"2024-09-19T09:37:44.146524+0000","last_became_active":"2024-09-19T09:36:12.992281+0000","last_became_peered":"2024-09-19T09:36:12.992281+0000","last_unstale":"2024-09-19T09:37:44.146524+0000","last_undegraded":"2024-09-19T09:37:44.146524+0000","last_fullsized":"2024-09-19T09:37:44.146524+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:26.107432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146663+0000","last_change":"2024-09-19T09:36:12.988583+0000","last_active":"2024-09-19T09:37:44.146663+0000","last_peered":"2024-09-19T09:37:44.146663+0000","last_clean":"2024-09-19T09:37:44.146663+0000","last_became_active":"2024-09-19T09:36:12.987895+0000","last_became_peered":"2024-09-19T09:36:12.987895+0000","last_unstale":"2024-09-19T09:37:44.146663+0000","last_undegraded":"2024-09-19T09:37:44.146663+0000","last_fullsized":"2024-09-19T09:37:44.146663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:47.617324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.141930+0000","last_change":"2024-09-19T09:36:12.988526+0000","last_active":"2024-09-19T09:37:44.141930+0000","last_peered":"2024-09-19T09:37:44.141930+0000","last_clean":"2024-09-19T09:37:44.141930+0000","last_became_active":"2024-09-19T09:36:12.988093+0000","last_became_peered":"2024-09-19T09:36:12.988093+0000","last_unstale":"2024-09-19T09:37:44.141930+0000","last_undegraded":"2024-09-19T09:37:44.141930+0000","last_fullsized":"2024-09-19T09:37:44.141930+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:48.949397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.157907+0000","last_change":"2024-09-19T09:36:12.992360+0000","last_active":"2024-09-19T09:37:44.157907+0000","last_peered":"2024-09-19T09:37:44.157907+0000","last_clean":"2024-09-19T09:37:44.157907+0000","last_became_active":"2024-09-19T09:36:12.991833+0000","last_became_peered":"2024-09-19T09:36:12.991833+0000","last_unstale":"2024-09-19T09:37:44.157907+0000","last_undegraded":"2024-09-19T09:37:44.157907+0000","last_fullsized":"2024-09-19T09:37:44.157907+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:47.715012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.144515+0000","last_change":"2024-09-19T09:36:12.993435+0000","last_active":"2024-09-19T09:37:44.144515+0000","last_peered":"2024-09-19T09:37:44.144515+0000","last_clean":"2024-09-19T09:37:44.144515+0000","last_became_active":"2024-09-19T09:36:12.993108+0000","last_became_peered":"2024-09-19T09:36:12.993108+0000","last_unstale":"2024-09-19T09:37:44.144515+0000","last_undegraded":"2024-09-19T09:37:44.144515+0000","last_fullsized":"2024-09-19T09:37:44.144515+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:54.453593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.162293+0000","last_change":"2024-09-19T09:36:12.991044+0000","last_active":"2024-09-19T09:37:44.162293+0000","last_peered":"2024-09-19T09:37:44.162293+0000","last_clean":"2024-09-19T09:37:44.162293+0000","last_became_active":"2024-09-19T09:36:12.989955+0000","last_became_peered":"2024-09-19T09:36:12.989955+0000","last_unstale":"2024-09-19T09:37:44.162293+0000","last_undegraded":"2024-09-19T09:37:44.162293+0000","last_fullsized":"2024-09-19T09:37:44.162293+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:21.034023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148886+0000","last_change":"2024-09-19T09:36:12.989679+0000","last_active":"2024-09-19T09:37:44.148886+0000","last_peered":"2024-09-19T09:37:44.148886+0000","last_clean":"2024-09-19T09:37:44.148886+0000","last_became_active":"2024-09-19T09:36:12.988463+0000","last_became_peered":"2024-09-19T09:36:12.988463+0000","last_unstale":"2024-09-19T09:37:44.148886+0000","last_undegraded":"2024-09-19T09:37:44.148886+0000","last_fullsized":"2024-09-19T09:37:44.148886+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:28.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.144722+0000","last_change":"2024-09-19T09:36:12.983494+0000","last_active":"2024-09-19T09:37:44.144722+0000","last_peered":"2024-09-19T09:37:44.144722+0000","last_clean":"2024-09-19T09:37:44.144722+0000","last_became_active":"2024-09-19T09:36:12.983143+0000","last_became_peered":"2024-09-19T09:36:12.983143+0000","last_unstale":"2024-09-19T09:37:44.144722+0000","last_undegraded":"2024-09-19T09:37:44.144722+0000","last_fullsized":"2024-09-19T09:37:44.144722+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:23.378183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.143385+0000","last_change":"2024-09-19T09:36:12.987512+0000","last_active":"2024-09-19T09:37:44.143385+0000","last_peered":"2024-09-19T09:37:44.143385+0000","last_clean":"2024-09-19T09:37:44.143385+0000","last_became_active":"2024-09-19T09:36:12.987288+0000","last_became_peered":"2024-09-19T09:36:12.987288+0000","last_unstale":"2024-09-19T09:37:44.143385+0000","last_undegraded":"2024-09-19T09:37:44.143385+0000","last_fullsized":"2024-09-19T09:37:44.143385+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:14.614333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147801+0000","last_change":"2024-09-19T09:37:16.131000+0000","last_active":"2024-09-19T09:37:44.147801+0000","last_peered":"2024-09-19T09:37:44.147801+0000","last_clean":"2024-09-19T09:37:44.147801+0000","last_became_active":"2024-09-19T09:37:16.130647+0000","last_became_peered":"2024-09-19T09:37:16.130647+0000","last_unstale":"2024-09-19T09:37:44.147801+0000","last_undegraded":"2024-09-19T09:37:44.147801+0000","last_fullsized":"2024-09-19T09:37:44.147801+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:22.498318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.162539+0000","last_change":"2024-09-19T09:36:12.988210+0000","last_active":"2024-09-19T09:37:44.162539+0000","last_peered":"2024-09-19T09:37:44.162539+0000","last_clean":"2024-09-19T09:37:44.162539+0000","last_became_active":"2024-09-19T09:36:12.987904+0000","last_became_peered":"2024-09-19T09:36:12.987904+0000","last_unstale":"2024-09-19T09:37:44.162539+0000","last_undegraded":"2024-09-19T09:37:44.162539+0000","last_fullsized":"2024-09-19T09:37:44.162539+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:13.588237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147356+0000","last_change":"2024-09-19T09:36:12.984028+0000","last_active":"2024-09-19T09:37:44.147356+0000","last_peered":"2024-09-19T09:37:44.147356+0000","last_clean":"2024-09-19T09:37:44.147356+0000","last_became_active":"2024-09-19T09:36:12.982062+0000","last_became_peered":"2024-09-19T09:36:12.982062+0000","last_unstale":"2024-09-19T09:37:44.147356+0000","last_undegraded":"2024-09-19T09:37:44.147356+0000","last_fullsized":"2024-09-19T09:37:44.147356+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:26.610287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.141161+0000","last_change":"2024-09-19T09:36:12.979277+0000","last_active":"2024-09-19T09:37:44.141161+0000","last_peered":"2024-09-19T09:37:44.141161+0000","last_clean":"2024-09-19T09:37:44.141161+0000","last_became_active":"2024-09-19T09:36:12.978970+0000","last_became_peered":"2024-09-19T09:36:12.978970+0000","last_unstale":"2024-09-19T09:37:44.141161+0000","last_undegraded":"2024-09-19T09:37:44.141161+0000","last_fullsized":"2024-09-19T09:37:44.141161+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:00.424728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147432+0000","last_change":"2024-09-19T09:36:12.981021+0000","last_active":"2024-09-19T09:37:44.147432+0000","last_peered":"2024-09-19T09:37:44.147432+0000","last_clean":"2024-09-19T09:37:44.147432+0000","last_became_active":"2024-09-19T09:36:12.980580+0000","last_became_peered":"2024-09-19T09:36:12.980580+0000","last_unstale":"2024-09-19T09:37:44.147432+0000","last_undegraded":"2024-09-19T09:37:44.147432+0000","last_fullsized":"2024-09-19T09:37:44.147432+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:17.464873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.143924+0000","last_change":"2024-09-19T09:36:12.986090+0000","last_active":"2024-09-19T09:37:44.143924+0000","last_peered":"2024-09-19T09:37:44.143924+0000","last_clean":"2024-09-19T09:37:44.143924+0000","last_became_active":"2024-09-19T09:36:12.985740+0000","last_became_peered":"2024-09-19T09:36:12.985740+0000","last_unstale":"2024-09-19T09:37:44.143924+0000","last_undegraded":"2024-09-19T09:37:44.143924+0000","last_fullsized":"2024-09-19T09:37:44.143924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:35.252834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145367+0000","last_change":"2024-09-19T09:36:12.981257+0000","last_active":"2024-09-19T09:37:44.145367+0000","last_peered":"2024-09-19T09:37:44.145367+0000","last_clean":"2024-09-19T09:37:44.145367+0000","last_became_active":"2024-09-19T09:36:12.980911+0000","last_became_peered":"2024-09-19T09:36:12.980911+0000","last_unstale":"2024-09-19T09:37:44.145367+0000","last_undegraded":"2024-09-19T09:37:44.145367+0000","last_fullsized":"2024-09-19T09:37:44.145367+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:41.470514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.161076+0000","last_change":"2024-09-19T09:36:12.982585+0000","last_active":"2024-09-19T09:37:44.161076+0000","last_peered":"2024-09-19T09:37:44.161076+0000","last_clean":"2024-09-19T09:37:44.161076+0000","last_became_active":"2024-09-19T09:36:12.982193+0000","last_became_peered":"2024-09-19T09:36:12.982193+0000","last_unstale":"2024-09-19T09:37:44.161076+0000","last_undegraded":"2024-09-19T09:37:44.161076+0000","last_fullsized":"2024-09-19T09:37:44.161076+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:30.057088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.143208+0000","last_change":"2024-09-19T09:36:12.985236+0000","last_active":"2024-09-19T09:37:44.143208+0000","last_peered":"2024-09-19T09:37:44.143208+0000","last_clean":"2024-09-19T09:37:44.143208+0000","last_became_active":"2024-09-19T09:36:12.984751+0000","last_became_peered":"2024-09-19T09:36:12.984751+0000","last_unstale":"2024-09-19T09:37:44.143208+0000","last_undegraded":"2024-09-19T09:37:44.143208+0000","last_fullsized":"2024-09-19T09:37:44.143208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:52.784216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.138535+0000","last_change":"2024-09-19T09:36:12.985856+0000","last_active":"2024-09-19T09:37:44.138535+0000","last_peered":"2024-09-19T09:37:44.138535+0000","last_clean":"2024-09-19T09:37:44.138535+0000","last_became_active":"2024-09-19T09:36:12.985312+0000","last_became_peered":"2024-09-19T09:36:12.985312+0000","last_unstale":"2024-09-19T09:37:44.138535+0000","last_undegraded":"2024-09-19T09:37:44.138535+0000","last_fullsized":"2024-09-19T09:37:44.138535+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:25.235945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.142807+0000","last_change":"2024-09-19T09:36:12.982443+0000","last_active":"2024-09-19T09:37:44.142807+0000","last_peered":"2024-09-19T09:37:44.142807+0000","last_clean":"2024-09-19T09:37:44.142807+0000","last_became_active":"2024-09-19T09:36:12.982130+0000","last_became_peered":"2024-09-19T09:36:12.982130+0000","last_unstale":"2024-09-19T09:37:44.142807+0000","last_undegraded":"2024-09-19T09:37:44.142807+0000","last_fullsized":"2024-09-19T09:37:44.142807+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:17.177563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145567+0000","last_change":"2024-09-19T09:36:12.990439+0000","last_active":"2024-09-19T09:37:44.145567+0000","last_peered":"2024-09-19T09:37:44.145567+0000","last_clean":"2024-09-19T09:37:44.145567+0000","last_became_active":"2024-09-19T09:36:12.990135+0000","last_became_peered":"2024-09-19T09:36:12.990135+0000","last_unstale":"2024-09-19T09:37:44.145567+0000","last_undegraded":"2024-09-19T09:37:44.145567+0000","last_fullsized":"2024-09-19T09:37:44.145567+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:51.685192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145105+0000","last_change":"2024-09-19T09:36:12.987261+0000","last_active":"2024-09-19T09:37:44.145105+0000","last_peered":"2024-09-19T09:37:44.145105+0000","last_clean":"2024-09-19T09:37:44.145105+0000","last_became_active":"2024-09-19T09:36:12.986192+0000","last_became_peered":"2024-09-19T09:36:12.986192+0000","last_unstale":"2024-09-19T09:37:44.145105+0000","last_undegraded":"2024-09-19T09:37:44.145105+0000","last_fullsized":"2024-09-19T09:37:44.145105+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:58.435605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.141377+0000","last_change":"2024-09-19T09:36:12.981248+0000","last_active":"2024-09-19T09:37:44.141377+0000","last_peered":"2024-09-19T09:37:44.141377+0000","last_clean":"2024-09-19T09:37:44.141377+0000","last_became_active":"2024-09-19T09:36:12.980754+0000","last_became_peered":"2024-09-19T09:36:12.980754+0000","last_unstale":"2024-09-19T09:37:44.141377+0000","last_undegraded":"2024-09-19T09:37:44.141377+0000","last_fullsized":"2024-09-19T09:37:44.141377+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:03.970402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.139500+0000","last_change":"2024-09-19T09:36:12.990841+0000","last_active":"2024-09-19T09:37:44.139500+0000","last_peered":"2024-09-19T09:37:44.139500+0000","last_clean":"2024-09-19T09:37:44.139500+0000","last_became_active":"2024-09-19T09:36:12.989667+0000","last_became_peered":"2024-09-19T09:36:12.989667+0000","last_unstale":"2024-09-19T09:37:44.139500+0000","last_undegraded":"2024-09-19T09:37:44.139500+0000","last_fullsized":"2024-09-19T09:37:44.139500+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:46:00.314590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148537+0000","last_change":"2024-09-19T09:36:12.984007+0000","last_active":"2024-09-19T09:37:44.148537+0000","last_peered":"2024-09-19T09:37:44.148537+0000","last_clean":"2024-09-19T09:37:44.148537+0000","last_became_active":"2024-09-19T09:36:12.983627+0000","last_became_peered":"2024-09-19T09:36:12.983627+0000","last_unstale":"2024-09-19T09:37:44.148537+0000","last_undegraded":"2024-09-19T09:37:44.148537+0000","last_fullsized":"2024-09-19T09:37:44.148537+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:42.038673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146461+0000","last_change":"2024-09-19T09:36:12.988032+0000","last_active":"2024-09-19T09:37:44.146461+0000","last_peered":"2024-09-19T09:37:44.146461+0000","last_clean":"2024-09-19T09:37:44.146461+0000","last_became_active":"2024-09-19T09:36:12.987588+0000","last_became_peered":"2024-09-19T09:36:12.987588+0000","last_unstale":"2024-09-19T09:37:44.146461+0000","last_undegraded":"2024-09-19T09:37:44.146461+0000","last_fullsized":"2024-09-19T09:37:44.146461+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:01.518543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148152+0000","last_change":"2024-09-19T09:37:16.131565+0000","last_active":"2024-09-19T09:37:44.148152+0000","last_peered":"2024-09-19T09:37:44.148152+0000","last_clean":"2024-09-19T09:37:44.148152+0000","last_became_active":"2024-09-19T09:37:16.131171+0000","last_became_peered":"2024-09-19T09:37:16.131171+0000","last_unstale":"2024-09-19T09:37:44.148152+0000","last_undegraded":"2024-09-19T09:37:44.148152+0000","last_fullsized":"2024-09-19T09:37:44.148152+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:18.195074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.141174+0000","last_change":"2024-09-19T09:36:12.989709+0000","last_active":"2024-09-19T09:37:44.141174+0000","last_peered":"2024-09-19T09:37:44.141174+0000","last_clean":"2024-09-19T09:37:44.141174+0000","last_became_active":"2024-09-19T09:36:12.989324+0000","last_became_peered":"2024-09-19T09:36:12.989324+0000","last_unstale":"2024-09-19T09:37:44.141174+0000","last_undegraded":"2024-09-19T09:37:44.141174+0000","last_fullsized":"2024-09-19T09:37:44.141174+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:09.843175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.033713+0000","last_change":"2024-09-19T09:37:16.033713+0000","last_active":"2024-09-19T09:37:16.033713+0000","last_peered":"2024-09-19T09:37:16.033713+0000","last_clean":"2024-09-19T09:37:16.033713+0000","last_became_active":"2024-09-19T09:37:16.033230+0000","last_became_peered":"2024-09-19T09:37:16.033230+0000","last_unstale":"2024-09-19T09:37:16.033713+0000","last_undegraded":"2024-09-19T09:37:16.033713+0000","last_fullsized":"2024-09-19T09:37:16.033713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:12.262115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.143084+0000","last_change":"2024-09-19T09:37:16.484760+0000","last_active":"2024-09-19T09:37:44.143084+0000","last_peered":"2024-09-19T09:37:44.143084+0000","last_clean":"2024-09-19T09:37:44.143084+0000","last_became_active":"2024-09-19T09:37:16.484316+0000","last_became_peered":"2024-09-19T09:37:16.484316+0000","last_unstale":"2024-09-19T09:37:44.143084+0000","last_undegraded":"2024-09-19T09:37:44.143084+0000","last_fullsized":"2024-09-19T09:37:44.143084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:14.897601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.124818+0000","last_change":"2024-09-19T09:37:16.124818+0000","last_active":"2024-09-19T09:37:16.124818+0000","last_peered":"2024-09-19T09:37:16.124818+0000","last_clean":"2024-09-19T09:37:16.124818+0000","last_became_active":"2024-09-19T09:37:16.124391+0000","last_became_peered":"2024-09-19T09:37:16.124391+0000","last_unstale":"2024-09-19T09:37:16.124818+0000","last_undegraded":"2024-09-19T09:37:16.124818+0000","last_fullsized":"2024-09-19T09:37:16.124818+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:25.443666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034105+0000","last_change":"2024-09-19T09:36:10.837287+0000","last_active":"2024-09-19T09:37:16.034105+0000","last_peered":"2024-09-19T09:37:16.034105+0000","last_clean":"2024-09-19T09:37:16.034105+0000","last_became_active":"2024-09-19T09:36:10.836890+0000","last_became_peered":"2024-09-19T09:36:10.836890+0000","last_unstale":"2024-09-19T09:37:16.034105+0000","last_undegraded":"2024-09-19T09:37:16.034105+0000","last_fullsized":"2024-09-19T09:37:16.034105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:09.676728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.139992+0000","last_change":"2024-09-19T09:36:12.975690+0000","last_active":"2024-09-19T09:37:44.139992+0000","last_peered":"2024-09-19T09:37:44.139992+0000","last_clean":"2024-09-19T09:37:44.139992+0000","last_became_active":"2024-09-19T09:36:12.975370+0000","last_became_peered":"2024-09-19T09:36:12.975370+0000","last_unstale":"2024-09-19T09:37:44.139992+0000","last_undegraded":"2024-09-19T09:37:44.139992+0000","last_fullsized":"2024-09-19T09:37:44.139992+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:05.650917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030234+0000","last_change":"2024-09-19T09:36:10.843736+0000","last_active":"2024-09-19T09:37:16.030234+0000","last_peered":"2024-09-19T09:37:16.030234+0000","last_clean":"2024-09-19T09:37:16.030234+0000","last_became_active":"2024-09-19T09:36:10.843353+0000","last_became_peered":"2024-09-19T09:36:10.843353+0000","last_unstale":"2024-09-19T09:37:16.030234+0000","last_undegraded":"2024-09-19T09:37:16.030234+0000","last_fullsized":"2024-09-19T09:37:16.030234+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:29.818642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.140596+0000","last_change":"2024-09-19T09:36:12.978841+0000","last_active":"2024-09-19T09:37:44.140596+0000","last_peered":"2024-09-19T09:37:44.140596+0000","last_clean":"2024-09-19T09:37:44.140596+0000","last_became_active":"2024-09-19T09:36:12.978501+0000","last_became_peered":"2024-09-19T09:36:12.978501+0000","last_unstale":"2024-09-19T09:37:44.140596+0000","last_undegraded":"2024-09-19T09:37:44.140596+0000","last_fullsized":"2024-09-19T09:37:44.140596+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:07.974576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.032030+0000","last_change":"2024-09-19T09:36:10.841997+0000","last_active":"2024-09-19T09:37:16.032030+0000","last_peered":"2024-09-19T09:37:16.032030+0000","last_clean":"2024-09-19T09:37:16.032030+0000","last_became_active":"2024-09-19T09:36:10.841641+0000","last_became_peered":"2024-09-19T09:36:10.841641+0000","last_unstale":"2024-09-19T09:37:16.032030+0000","last_undegraded":"2024-09-19T09:37:16.032030+0000","last_fullsized":"2024-09-19T09:37:16.032030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:10.477879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.156072+0000","last_change":"2024-09-19T09:36:12.981486+0000","last_active":"2024-09-19T09:37:44.156072+0000","last_peered":"2024-09-19T09:37:44.156072+0000","last_clean":"2024-09-19T09:37:44.156072+0000","last_became_active":"2024-09-19T09:36:12.981165+0000","last_became_peered":"2024-09-19T09:36:12.981165+0000","last_unstale":"2024-09-19T09:37:44.156072+0000","last_undegraded":"2024-09-19T09:37:44.156072+0000","last_fullsized":"2024-09-19T09:37:44.156072+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:21.986132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030755+0000","last_change":"2024-09-19T09:36:10.845362+0000","last_active":"2024-09-19T09:37:16.030755+0000","last_peered":"2024-09-19T09:37:16.030755+0000","last_clean":"2024-09-19T09:37:16.030755+0000","last_became_active":"2024-09-19T09:36:10.844992+0000","last_became_peered":"2024-09-19T09:36:10.844992+0000","last_unstale":"2024-09-19T09:37:16.030755+0000","last_undegraded":"2024-09-19T09:37:16.030755+0000","last_fullsized":"2024-09-19T09:37:16.030755+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:52.854333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.137951+0000","last_change":"2024-09-19T09:36:12.988924+0000","last_active":"2024-09-19T09:37:44.137951+0000","last_peered":"2024-09-19T09:37:44.137951+0000","last_clean":"2024-09-19T09:37:44.137951+0000","last_became_active":"2024-09-19T09:36:12.988331+0000","last_became_peered":"2024-09-19T09:36:12.988331+0000","last_unstale":"2024-09-19T09:37:44.137951+0000","last_undegraded":"2024-09-19T09:37:44.137951+0000","last_fullsized":"2024-09-19T09:37:44.137951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:24.754252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029903+0000","last_change":"2024-09-19T09:36:10.860003+0000","last_active":"2024-09-19T09:37:16.029903+0000","last_peered":"2024-09-19T09:37:16.029903+0000","last_clean":"2024-09-19T09:37:16.029903+0000","last_became_active":"2024-09-19T09:36:10.859584+0000","last_became_peered":"2024-09-19T09:36:10.859584+0000","last_unstale":"2024-09-19T09:37:16.029903+0000","last_undegraded":"2024-09-19T09:37:16.029903+0000","last_fullsized":"2024-09-19T09:37:16.029903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:44.837960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.160481+0000","last_change":"2024-09-19T09:36:12.985446+0000","last_active":"2024-09-19T09:37:44.160481+0000","last_peered":"2024-09-19T09:37:44.160481+0000","last_clean":"2024-09-19T09:37:44.160481+0000","last_became_active":"2024-09-19T09:36:12.984671+0000","last_became_peered":"2024-09-19T09:36:12.984671+0000","last_unstale":"2024-09-19T09:37:44.160481+0000","last_undegraded":"2024-09-19T09:37:44.160481+0000","last_fullsized":"2024-09-19T09:37:44.160481+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:54.800151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'30","reported_seq":260,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:38:01.106636+0000","last_change":"2024-09-19T09:36:10.841056+0000","last_active":"2024-09-19T09:38:01.106636+0000","last_peered":"2024-09-19T09:38:01.106636+0000","last_clean":"2024-09-19T09:38:01.106636+0000","last_became_active":"2024-09-19T09:36:10.840731+0000","last_became_peered":"2024-09-19T09:36:10.840731+0000","last_unstale":"2024-09-19T09:38:01.106636+0000","last_undegraded":"2024-09-19T09:38:01.106636+0000","last_fullsized":"2024-09-19T09:38:01.106636+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:13.676188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63068,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":208,"num_read_kb":165,"num_write":30,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146672+0000","last_change":"2024-09-19T09:36:12.990223+0000","last_active":"2024-09-19T09:37:44.146672+0000","last_peered":"2024-09-19T09:37:44.146672+0000","last_clean":"2024-09-19T09:37:44.146672+0000","last_became_active":"2024-09-19T09:36:12.989720+0000","last_became_peered":"2024-09-19T09:36:12.989720+0000","last_unstale":"2024-09-19T09:37:44.146672+0000","last_undegraded":"2024-09-19T09:37:44.146672+0000","last_fullsized":"2024-09-19T09:37:44.146672+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:37.003075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.129753+0000","last_change":"2024-09-19T09:36:10.843288+0000","last_active":"2024-09-19T09:37:16.129753+0000","last_peered":"2024-09-19T09:37:16.129753+0000","last_clean":"2024-09-19T09:37:16.129753+0000","last_became_active":"2024-09-19T09:36:10.842844+0000","last_became_peered":"2024-09-19T09:36:10.842844+0000","last_unstale":"2024-09-19T09:37:16.129753+0000","last_undegraded":"2024-09-19T09:37:16.129753+0000","last_fullsized":"2024-09-19T09:37:16.129753+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:38.695411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145354+0000","last_change":"2024-09-19T09:36:12.981251+0000","last_active":"2024-09-19T09:37:44.145354+0000","last_peered":"2024-09-19T09:37:44.145354+0000","last_clean":"2024-09-19T09:37:44.145354+0000","last_became_active":"2024-09-19T09:36:12.980861+0000","last_became_peered":"2024-09-19T09:36:12.980861+0000","last_unstale":"2024-09-19T09:37:44.145354+0000","last_undegraded":"2024-09-19T09:37:44.145354+0000","last_fullsized":"2024-09-19T09:37:44.145354+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:09.633644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030128+0000","last_change":"2024-09-19T09:36:10.843448+0000","last_active":"2024-09-19T09:37:16.030128+0000","last_peered":"2024-09-19T09:37:16.030128+0000","last_clean":"2024-09-19T09:37:16.030128+0000","last_became_active":"2024-09-19T09:36:10.843087+0000","last_became_peered":"2024-09-19T09:36:10.843087+0000","last_unstale":"2024-09-19T09:37:16.030128+0000","last_undegraded":"2024-09-19T09:37:16.030128+0000","last_fullsized":"2024-09-19T09:37:16.030128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:20.623613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.151910+0000","last_change":"2024-09-19T09:36:12.981160+0000","last_active":"2024-09-19T09:37:44.151910+0000","last_peered":"2024-09-19T09:37:44.151910+0000","last_clean":"2024-09-19T09:37:44.151910+0000","last_became_active":"2024-09-19T09:36:12.980823+0000","last_became_peered":"2024-09-19T09:36:12.980823+0000","last_unstale":"2024-09-19T09:37:44.151910+0000","last_undegraded":"2024-09-19T09:37:44.151910+0000","last_fullsized":"2024-09-19T09:37:44.151910+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:39.323439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028480+0000","last_change":"2024-09-19T09:36:10.842536+0000","last_active":"2024-09-19T09:37:16.028480+0000","last_peered":"2024-09-19T09:37:16.028480+0000","last_clean":"2024-09-19T09:37:16.028480+0000","last_became_active":"2024-09-19T09:36:10.842176+0000","last_became_peered":"2024-09-19T09:36:10.842176+0000","last_unstale":"2024-09-19T09:37:16.028480+0000","last_undegraded":"2024-09-19T09:37:16.028480+0000","last_fullsized":"2024-09-19T09:37:16.028480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:37.871299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145814+0000","last_change":"2024-09-19T09:36:12.987271+0000","last_active":"2024-09-19T09:37:44.145814+0000","last_peered":"2024-09-19T09:37:44.145814+0000","last_clean":"2024-09-19T09:37:44.145814+0000","last_became_active":"2024-09-19T09:36:12.986918+0000","last_became_peered":"2024-09-19T09:36:12.986918+0000","last_unstale":"2024-09-19T09:37:44.145814+0000","last_undegraded":"2024-09-19T09:37:44.145814+0000","last_fullsized":"2024-09-19T09:37:44.145814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:07.608541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030337+0000","last_change":"2024-09-19T09:36:10.860370+0000","last_active":"2024-09-19T09:37:16.030337+0000","last_peered":"2024-09-19T09:37:16.030337+0000","last_clean":"2024-09-19T09:37:16.030337+0000","last_became_active":"2024-09-19T09:36:10.859820+0000","last_became_peered":"2024-09-19T09:36:10.859820+0000","last_unstale":"2024-09-19T09:37:16.030337+0000","last_undegraded":"2024-09-19T09:37:16.030337+0000","last_fullsized":"2024-09-19T09:37:16.030337+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:12.121038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.161919+0000","last_change":"2024-09-19T09:36:12.994449+0000","last_active":"2024-09-19T09:37:44.161919+0000","last_peered":"2024-09-19T09:37:44.161919+0000","last_clean":"2024-09-19T09:37:44.161919+0000","last_became_active":"2024-09-19T09:36:12.994141+0000","last_became_peered":"2024-09-19T09:36:12.994141+0000","last_unstale":"2024-09-19T09:37:44.161919+0000","last_undegraded":"2024-09-19T09:37:44.161919+0000","last_fullsized":"2024-09-19T09:37:44.161919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:21.416453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031764+0000","last_change":"2024-09-19T09:36:10.839609+0000","last_active":"2024-09-19T09:37:16.031764+0000","last_peered":"2024-09-19T09:37:16.031764+0000","last_clean":"2024-09-19T09:37:16.031764+0000","last_became_active":"2024-09-19T09:36:10.839227+0000","last_became_peered":"2024-09-19T09:36:10.839227+0000","last_unstale":"2024-09-19T09:37:16.031764+0000","last_undegraded":"2024-09-19T09:37:16.031764+0000","last_fullsized":"2024-09-19T09:37:16.031764+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:00.734924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.144996+0000","last_change":"2024-09-19T09:36:12.983573+0000","last_active":"2024-09-19T09:37:44.144996+0000","last_peered":"2024-09-19T09:37:44.144996+0000","last_clean":"2024-09-19T09:37:44.144996+0000","last_became_active":"2024-09-19T09:36:12.983241+0000","last_became_peered":"2024-09-19T09:36:12.983241+0000","last_unstale":"2024-09-19T09:37:44.144996+0000","last_undegraded":"2024-09-19T09:37:44.144996+0000","last_fullsized":"2024-09-19T09:37:44.144996+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:44.050271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034765+0000","last_change":"2024-09-19T09:36:10.839789+0000","last_active":"2024-09-19T09:37:16.034765+0000","last_peered":"2024-09-19T09:37:16.034765+0000","last_clean":"2024-09-19T09:37:16.034765+0000","last_became_active":"2024-09-19T09:36:10.839445+0000","last_became_peered":"2024-09-19T09:36:10.839445+0000","last_unstale":"2024-09-19T09:37:16.034765+0000","last_undegraded":"2024-09-19T09:37:16.034765+0000","last_fullsized":"2024-09-19T09:37:16.034765+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:16.040249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148829+0000","last_change":"2024-09-19T09:36:12.993420+0000","last_active":"2024-09-19T09:37:44.148829+0000","last_peered":"2024-09-19T09:37:44.148829+0000","last_clean":"2024-09-19T09:37:44.148829+0000","last_became_active":"2024-09-19T09:36:12.992334+0000","last_became_peered":"2024-09-19T09:36:12.992334+0000","last_unstale":"2024-09-19T09:37:44.148829+0000","last_undegraded":"2024-09-19T09:37:44.148829+0000","last_fullsized":"2024-09-19T09:37:44.148829+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:21.693164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030247+0000","last_change":"2024-09-19T09:36:10.839461+0000","last_active":"2024-09-19T09:37:16.030247+0000","last_peered":"2024-09-19T09:37:16.030247+0000","last_clean":"2024-09-19T09:37:16.030247+0000","last_became_active":"2024-09-19T09:36:10.839092+0000","last_became_peered":"2024-09-19T09:36:10.839092+0000","last_unstale":"2024-09-19T09:37:16.030247+0000","last_undegraded":"2024-09-19T09:37:16.030247+0000","last_fullsized":"2024-09-19T09:37:16.030247+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:02.367267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145214+0000","last_change":"2024-09-19T09:36:12.988234+0000","last_active":"2024-09-19T09:37:44.145214+0000","last_peered":"2024-09-19T09:37:44.145214+0000","last_clean":"2024-09-19T09:37:44.145214+0000","last_became_active":"2024-09-19T09:36:12.987813+0000","last_became_peered":"2024-09-19T09:36:12.987813+0000","last_unstale":"2024-09-19T09:37:44.145214+0000","last_undegraded":"2024-09-19T09:37:44.145214+0000","last_fullsized":"2024-09-19T09:37:44.145214+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:56.024428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.130482+0000","last_change":"2024-09-19T09:36:10.945705+0000","last_active":"2024-09-19T09:37:16.130482+0000","last_peered":"2024-09-19T09:37:16.130482+0000","last_clean":"2024-09-19T09:37:16.130482+0000","last_became_active":"2024-09-19T09:36:10.945323+0000","last_became_peered":"2024-09-19T09:36:10.945323+0000","last_unstale":"2024-09-19T09:37:16.130482+0000","last_undegraded":"2024-09-19T09:37:16.130482+0000","last_fullsized":"2024-09-19T09:37:16.130482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:24.211909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.162179+0000","last_change":"2024-09-19T09:36:12.990517+0000","last_active":"2024-09-19T09:37:44.162179+0000","last_peered":"2024-09-19T09:37:44.162179+0000","last_clean":"2024-09-19T09:37:44.162179+0000","last_became_active":"2024-09-19T09:36:12.989291+0000","last_became_peered":"2024-09-19T09:36:12.989291+0000","last_unstale":"2024-09-19T09:37:44.162179+0000","last_undegraded":"2024-09-19T09:37:44.162179+0000","last_fullsized":"2024-09-19T09:37:44.162179+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:31.087798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":339,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030377+0000","last_change":"2024-09-19T09:34:59.337025+0000","last_active":"2024-09-19T09:37:16.030377+0000","last_peered":"2024-09-19T09:37:16.030377+0000","last_clean":"2024-09-19T09:37:16.030377+0000","last_became_active":"2024-09-19T09:34:59.336556+0000","last_became_peered":"2024-09-19T09:34:59.336556+0000","last_unstale":"2024-09-19T09:37:16.030377+0000","last_undegraded":"2024-09-19T09:37:16.030377+0000","last_fullsized":"2024-09-19T09:37:16.030377+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:31:30.566923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:31:30.566923+0000","last_clean_scrub_stamp":"2024-09-19T09:31:30.566923+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:00.675254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028715+0000","last_change":"2024-09-19T09:36:10.838131+0000","last_active":"2024-09-19T09:37:16.028715+0000","last_peered":"2024-09-19T09:37:16.028715+0000","last_clean":"2024-09-19T09:37:16.028715+0000","last_became_active":"2024-09-19T09:36:10.837725+0000","last_became_peered":"2024-09-19T09:36:10.837725+0000","last_unstale":"2024-09-19T09:37:16.028715+0000","last_undegraded":"2024-09-19T09:37:16.028715+0000","last_fullsized":"2024-09-19T09:37:16.028715+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:57.104726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.139840+0000","last_change":"2024-09-19T09:36:12.981951+0000","last_active":"2024-09-19T09:37:44.139840+0000","last_peered":"2024-09-19T09:37:44.139840+0000","last_clean":"2024-09-19T09:37:44.139840+0000","last_became_active":"2024-09-19T09:36:12.981558+0000","last_became_peered":"2024-09-19T09:36:12.981558+0000","last_unstale":"2024-09-19T09:37:44.139840+0000","last_undegraded":"2024-09-19T09:37:44.139840+0000","last_fullsized":"2024-09-19T09:37:44.139840+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:31.119853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030184+0000","last_change":"2024-09-19T09:36:10.843574+0000","last_active":"2024-09-19T09:37:16.030184+0000","last_peered":"2024-09-19T09:37:16.030184+0000","last_clean":"2024-09-19T09:37:16.030184+0000","last_became_active":"2024-09-19T09:36:10.843252+0000","last_became_peered":"2024-09-19T09:36:10.843252+0000","last_unstale":"2024-09-19T09:37:16.030184+0000","last_undegraded":"2024-09-19T09:37:16.030184+0000","last_fullsized":"2024-09-19T09:37:16.030184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:10.492812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147324+0000","last_change":"2024-09-19T09:36:12.984538+0000","last_active":"2024-09-19T09:37:44.147324+0000","last_peered":"2024-09-19T09:37:44.147324+0000","last_clean":"2024-09-19T09:37:44.147324+0000","last_became_active":"2024-09-19T09:36:12.983448+0000","last_became_peered":"2024-09-19T09:36:12.983448+0000","last_unstale":"2024-09-19T09:37:44.147324+0000","last_undegraded":"2024-09-19T09:37:44.147324+0000","last_fullsized":"2024-09-19T09:37:44.147324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:48.294473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034208+0000","last_change":"2024-09-19T09:36:10.858959+0000","last_active":"2024-09-19T09:37:16.034208+0000","last_peered":"2024-09-19T09:37:16.034208+0000","last_clean":"2024-09-19T09:37:16.034208+0000","last_became_active":"2024-09-19T09:36:10.858638+0000","last_became_peered":"2024-09-19T09:36:10.858638+0000","last_unstale":"2024-09-19T09:37:16.034208+0000","last_undegraded":"2024-09-19T09:37:16.034208+0000","last_fullsized":"2024-09-19T09:37:16.034208+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:12.646483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.142955+0000","last_change":"2024-09-19T09:36:12.992710+0000","last_active":"2024-09-19T09:37:44.142955+0000","last_peered":"2024-09-19T09:37:44.142955+0000","last_clean":"2024-09-19T09:37:44.142955+0000","last_became_active":"2024-09-19T09:36:12.992436+0000","last_became_peered":"2024-09-19T09:36:12.992436+0000","last_unstale":"2024-09-19T09:37:44.142955+0000","last_undegraded":"2024-09-19T09:37:44.142955+0000","last_fullsized":"2024-09-19T09:37:44.142955+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:51.685516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030475+0000","last_change":"2024-09-19T09:36:10.842031+0000","last_active":"2024-09-19T09:37:16.030475+0000","last_peered":"2024-09-19T09:37:16.030475+0000","last_clean":"2024-09-19T09:37:16.030475+0000","last_became_active":"2024-09-19T09:36:10.841693+0000","last_became_peered":"2024-09-19T09:36:10.841693+0000","last_unstale":"2024-09-19T09:37:16.030475+0000","last_undegraded":"2024-09-19T09:37:16.030475+0000","last_fullsized":"2024-09-19T09:37:16.030475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:28:51.040551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.138330+0000","last_change":"2024-09-19T09:37:16.034026+0000","last_active":"2024-09-19T09:37:44.138330+0000","last_peered":"2024-09-19T09:37:44.138330+0000","last_clean":"2024-09-19T09:37:44.138330+0000","last_became_active":"2024-09-19T09:37:16.033546+0000","last_became_peered":"2024-09-19T09:37:16.033546+0000","last_unstale":"2024-09-19T09:37:44.138330+0000","last_undegraded":"2024-09-19T09:37:44.138330+0000","last_fullsized":"2024-09-19T09:37:44.138330+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:42.673825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.027885+0000","last_change":"2024-09-19T09:36:10.860470+0000","last_active":"2024-09-19T09:37:16.027885+0000","last_peered":"2024-09-19T09:37:16.027885+0000","last_clean":"2024-09-19T09:37:16.027885+0000","last_became_active":"2024-09-19T09:36:10.860097+0000","last_became_peered":"2024-09-19T09:36:10.860097+0000","last_unstale":"2024-09-19T09:37:16.027885+0000","last_undegraded":"2024-09-19T09:37:16.027885+0000","last_fullsized":"2024-09-19T09:37:16.027885+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:14.933378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.139200+0000","last_change":"2024-09-19T09:36:12.988489+0000","last_active":"2024-09-19T09:37:44.139200+0000","last_peered":"2024-09-19T09:37:44.139200+0000","last_clean":"2024-09-19T09:37:44.139200+0000","last_became_active":"2024-09-19T09:36:12.988151+0000","last_became_peered":"2024-09-19T09:36:12.988151+0000","last_unstale":"2024-09-19T09:37:44.139200+0000","last_undegraded":"2024-09-19T09:37:44.139200+0000","last_fullsized":"2024-09-19T09:37:44.139200+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:24.088771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030844+0000","last_change":"2024-09-19T09:36:10.860103+0000","last_active":"2024-09-19T09:37:16.030844+0000","last_peered":"2024-09-19T09:37:16.030844+0000","last_clean":"2024-09-19T09:37:16.030844+0000","last_became_active":"2024-09-19T09:36:10.859526+0000","last_became_peered":"2024-09-19T09:36:10.859526+0000","last_unstale":"2024-09-19T09:37:16.030844+0000","last_undegraded":"2024-09-19T09:37:16.030844+0000","last_fullsized":"2024-09-19T09:37:16.030844+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:25.460372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148110+0000","last_change":"2024-09-19T09:36:12.986286+0000","last_active":"2024-09-19T09:37:44.148110+0000","last_peered":"2024-09-19T09:37:44.148110+0000","last_clean":"2024-09-19T09:37:44.148110+0000","last_became_active":"2024-09-19T09:36:12.985982+0000","last_became_peered":"2024-09-19T09:36:12.985982+0000","last_unstale":"2024-09-19T09:37:44.148110+0000","last_undegraded":"2024-09-19T09:37:44.148110+0000","last_fullsized":"2024-09-19T09:37:44.148110+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:19.026134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'11","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028153+0000","last_change":"2024-09-19T09:36:10.839280+0000","last_active":"2024-09-19T09:37:16.028153+0000","last_peered":"2024-09-19T09:37:16.028153+0000","last_clean":"2024-09-19T09:37:16.028153+0000","last_became_active":"2024-09-19T09:36:10.838979+0000","last_became_peered":"2024-09-19T09:36:10.838979+0000","last_unstale":"2024-09-19T09:37:16.028153+0000","last_undegraded":"2024-09-19T09:37:16.028153+0000","last_fullsized":"2024-09-19T09:37:16.028153+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:06.303175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146091+0000","last_change":"2024-09-19T09:36:12.979778+0000","last_active":"2024-09-19T09:37:44.146091+0000","last_peered":"2024-09-19T09:37:44.146091+0000","last_clean":"2024-09-19T09:37:44.146091+0000","last_became_active":"2024-09-19T09:36:12.979455+0000","last_became_peered":"2024-09-19T09:36:12.979455+0000","last_unstale":"2024-09-19T09:37:44.146091+0000","last_undegraded":"2024-09-19T09:37:44.146091+0000","last_fullsized":"2024-09-19T09:37:44.146091+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:36.620368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029063+0000","last_change":"2024-09-19T09:36:10.945706+0000","last_active":"2024-09-19T09:37:16.029063+0000","last_peered":"2024-09-19T09:37:16.029063+0000","last_clean":"2024-09-19T09:37:16.029063+0000","last_became_active":"2024-09-19T09:36:10.945314+0000","last_became_peered":"2024-09-19T09:36:10.945314+0000","last_unstale":"2024-09-19T09:37:16.029063+0000","last_undegraded":"2024-09-19T09:37:16.029063+0000","last_fullsized":"2024-09-19T09:37:16.029063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:49.786913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.141688+0000","last_change":"2024-09-19T09:36:12.989412+0000","last_active":"2024-09-19T09:37:44.141688+0000","last_peered":"2024-09-19T09:37:44.141688+0000","last_clean":"2024-09-19T09:37:44.141688+0000","last_became_active":"2024-09-19T09:36:12.989109+0000","last_became_peered":"2024-09-19T09:36:12.989109+0000","last_unstale":"2024-09-19T09:37:44.141688+0000","last_undegraded":"2024-09-19T09:37:44.141688+0000","last_fullsized":"2024-09-19T09:37:44.141688+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:33.142592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.123342+0000","last_change":"2024-09-19T09:36:10.858581+0000","last_active":"2024-09-19T09:37:16.123342+0000","last_peered":"2024-09-19T09:37:16.123342+0000","last_clean":"2024-09-19T09:37:16.123342+0000","last_became_active":"2024-09-19T09:36:10.858240+0000","last_became_peered":"2024-09-19T09:36:10.858240+0000","last_unstale":"2024-09-19T09:37:16.123342+0000","last_undegraded":"2024-09-19T09:37:16.123342+0000","last_fullsized":"2024-09-19T09:37:16.123342+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:45.285839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.111050+0000","last_change":"2024-09-19T09:36:12.989075+0000","last_active":"2024-09-19T09:37:44.111050+0000","last_peered":"2024-09-19T09:37:44.111050+0000","last_clean":"2024-09-19T09:37:44.111050+0000","last_became_active":"2024-09-19T09:36:12.988752+0000","last_became_peered":"2024-09-19T09:36:12.988752+0000","last_unstale":"2024-09-19T09:37:44.111050+0000","last_undegraded":"2024-09-19T09:37:44.111050+0000","last_fullsized":"2024-09-19T09:37:44.111050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.424032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.483353+0000","last_change":"2024-09-19T09:36:10.838716+0000","last_active":"2024-09-19T09:37:16.483353+0000","last_peered":"2024-09-19T09:37:16.483353+0000","last_clean":"2024-09-19T09:37:16.483353+0000","last_became_active":"2024-09-19T09:36:10.838393+0000","last_became_peered":"2024-09-19T09:36:10.838393+0000","last_unstale":"2024-09-19T09:37:16.483353+0000","last_undegraded":"2024-09-19T09:37:16.483353+0000","last_fullsized":"2024-09-19T09:37:16.483353+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:54.107223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147844+0000","last_change":"2024-09-19T09:36:12.991721+0000","last_active":"2024-09-19T09:37:44.147844+0000","last_peered":"2024-09-19T09:37:44.147844+0000","last_clean":"2024-09-19T09:37:44.147844+0000","last_became_active":"2024-09-19T09:36:12.991398+0000","last_became_peered":"2024-09-19T09:36:12.991398+0000","last_unstale":"2024-09-19T09:37:44.147844+0000","last_undegraded":"2024-09-19T09:37:44.147844+0000","last_fullsized":"2024-09-19T09:37:44.147844+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:19:31.312072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.485156+0000","last_change":"2024-09-19T09:37:16.484541+0000","last_active":"2024-09-19T09:37:16.485156+0000","last_peered":"2024-09-19T09:37:16.485156+0000","last_clean":"2024-09-19T09:37:16.485156+0000","last_became_active":"2024-09-19T09:37:16.484035+0000","last_became_peered":"2024-09-19T09:37:16.484035+0000","last_unstale":"2024-09-19T09:37:16.485156+0000","last_undegraded":"2024-09-19T09:37:16.485156+0000","last_fullsized":"2024-09-19T09:37:16.485156+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:36.332699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146414+0000","last_change":"2024-09-19T09:36:12.984180+0000","last_active":"2024-09-19T09:37:44.146414+0000","last_peered":"2024-09-19T09:37:44.146414+0000","last_clean":"2024-09-19T09:37:44.146414+0000","last_became_active":"2024-09-19T09:36:12.983876+0000","last_became_peered":"2024-09-19T09:36:12.983876+0000","last_unstale":"2024-09-19T09:37:44.146414+0000","last_undegraded":"2024-09-19T09:37:44.146414+0000","last_fullsized":"2024-09-19T09:37:44.146414+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:45.876771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031127+0000","last_change":"2024-09-19T09:36:10.845391+0000","last_active":"2024-09-19T09:37:16.031127+0000","last_peered":"2024-09-19T09:37:16.031127+0000","last_clean":"2024-09-19T09:37:16.031127+0000","last_became_active":"2024-09-19T09:36:10.844974+0000","last_became_peered":"2024-09-19T09:36:10.844974+0000","last_unstale":"2024-09-19T09:37:16.031127+0000","last_undegraded":"2024-09-19T09:37:16.031127+0000","last_fullsized":"2024-09-19T09:37:16.031127+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:00.318337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.162083+0000","last_change":"2024-09-19T09:36:12.991145+0000","last_active":"2024-09-19T09:37:44.162083+0000","last_peered":"2024-09-19T09:37:44.162083+0000","last_clean":"2024-09-19T09:37:44.162083+0000","last_became_active":"2024-09-19T09:36:12.989891+0000","last_became_peered":"2024-09-19T09:36:12.989891+0000","last_unstale":"2024-09-19T09:37:44.162083+0000","last_undegraded":"2024-09-19T09:37:44.162083+0000","last_fullsized":"2024-09-19T09:37:44.162083+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:21.054936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.162240+0000","last_change":"2024-09-19T09:36:12.995378+0000","last_active":"2024-09-19T09:37:44.162240+0000","last_peered":"2024-09-19T09:37:44.162240+0000","last_clean":"2024-09-19T09:37:44.162240+0000","last_became_active":"2024-09-19T09:36:12.995028+0000","last_became_peered":"2024-09-19T09:36:12.995028+0000","last_unstale":"2024-09-19T09:37:44.162240+0000","last_undegraded":"2024-09-19T09:37:44.162240+0000","last_fullsized":"2024-09-19T09:37:44.162240+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:41.102130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031259+0000","last_change":"2024-09-19T09:36:10.839595+0000","last_active":"2024-09-19T09:37:16.031259+0000","last_peered":"2024-09-19T09:37:16.031259+0000","last_clean":"2024-09-19T09:37:16.031259+0000","last_became_active":"2024-09-19T09:36:10.839196+0000","last_became_peered":"2024-09-19T09:36:10.839196+0000","last_unstale":"2024-09-19T09:37:16.031259+0000","last_undegraded":"2024-09-19T09:37:16.031259+0000","last_fullsized":"2024-09-19T09:37:16.031259+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:02.272731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.160402+0000","last_change":"2024-09-19T09:36:12.984485+0000","last_active":"2024-09-19T09:37:44.160402+0000","last_peered":"2024-09-19T09:37:44.160402+0000","last_clean":"2024-09-19T09:37:44.160402+0000","last_became_active":"2024-09-19T09:36:12.984004+0000","last_became_peered":"2024-09-19T09:36:12.984004+0000","last_unstale":"2024-09-19T09:37:44.160402+0000","last_undegraded":"2024-09-19T09:37:44.160402+0000","last_fullsized":"2024-09-19T09:37:44.160402+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:37.646776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030731+0000","last_change":"2024-09-19T09:36:10.845306+0000","last_active":"2024-09-19T09:37:16.030731+0000","last_peered":"2024-09-19T09:37:16.030731+0000","last_clean":"2024-09-19T09:37:16.030731+0000","last_became_active":"2024-09-19T09:36:10.844952+0000","last_became_peered":"2024-09-19T09:36:10.844952+0000","last_unstale":"2024-09-19T09:37:16.030731+0000","last_undegraded":"2024-09-19T09:37:16.030731+0000","last_fullsized":"2024-09-19T09:37:16.030731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:09.792482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.161016+0000","last_change":"2024-09-19T09:36:12.991260+0000","last_active":"2024-09-19T09:37:44.161016+0000","last_peered":"2024-09-19T09:37:44.161016+0000","last_clean":"2024-09-19T09:37:44.161016+0000","last_became_active":"2024-09-19T09:36:12.989981+0000","last_became_peered":"2024-09-19T09:36:12.989981+0000","last_unstale":"2024-09-19T09:37:44.161016+0000","last_undegraded":"2024-09-19T09:37:44.161016+0000","last_fullsized":"2024-09-19T09:37:44.161016+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:11.301790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.483876+0000","last_change":"2024-09-19T09:36:10.859016+0000","last_active":"2024-09-19T09:37:16.483876+0000","last_peered":"2024-09-19T09:37:16.483876+0000","last_clean":"2024-09-19T09:37:16.483876+0000","last_became_active":"2024-09-19T09:36:10.858661+0000","last_became_peered":"2024-09-19T09:36:10.858661+0000","last_unstale":"2024-09-19T09:37:16.483876+0000","last_undegraded":"2024-09-19T09:37:16.483876+0000","last_fullsized":"2024-09-19T09:37:16.483876+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:54.395977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148013+0000","last_change":"2024-09-19T09:37:16.131601+0000","last_active":"2024-09-19T09:37:44.148013+0000","last_peered":"2024-09-19T09:37:44.148013+0000","last_clean":"2024-09-19T09:37:44.148013+0000","last_became_active":"2024-09-19T09:37:16.131199+0000","last_became_peered":"2024-09-19T09:37:16.131199+0000","last_unstale":"2024-09-19T09:37:44.148013+0000","last_undegraded":"2024-09-19T09:37:44.148013+0000","last_fullsized":"2024-09-19T09:37:44.148013+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:27.358544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.039032+0000","last_change":"2024-09-19T09:37:16.039032+0000","last_active":"2024-09-19T09:37:16.039032+0000","last_peered":"2024-09-19T09:37:16.039032+0000","last_clean":"2024-09-19T09:37:16.039032+0000","last_became_active":"2024-09-19T09:37:16.035315+0000","last_became_peered":"2024-09-19T09:37:16.035315+0000","last_unstale":"2024-09-19T09:37:16.039032+0000","last_undegraded":"2024-09-19T09:37:16.039032+0000","last_fullsized":"2024-09-19T09:37:16.039032+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:58.795064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63866,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":214,"num_read_kb":171,"num_write":89,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":191598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282954,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547236,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":441682,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776169,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1036288,"data_stored":1094847,"data_compressed":41852,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972398,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":441682,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201330,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":441704,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430265,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":1031585,"data_compressed":41852,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593790,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":441217,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822723,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":1031767,"data_compressed":41852,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953544,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":441122,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215181,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":913408,"data_stored":441438,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444113,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":974848,"data_stored":504202,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":504168,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":441190,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":63068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":63102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:38:05.400 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-19T09:38:05.401 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:38:05.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.538+0000 7f9460b4b640 1 -- 172.21.15.1:0/2742237353 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f945c104f00 msgr2=0x7f945c1072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:05.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.538+0000 7f9460b4b640 1 --2- 172.21.15.1:0/2742237353 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f945c104f00 0x7f945c1072f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9450009900 tx=0x7f945002a410 comp rx=0 tx=0).stop 2024-09-19T09:38:05.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.538+0000 7f9460b4b640 1 -- 172.21.15.1:0/2742237353 shutdown_connections 2024-09-19T09:38:05.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.538+0000 7f9460b4b640 1 --2- 172.21.15.1:0/2742237353 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f945c107830 0x7f945c109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:05.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.538+0000 7f9460b4b640 1 --2- 172.21.15.1:0/2742237353 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f945c104f00 0x7f945c1072f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:05.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.538+0000 7f9460b4b640 1 --2- 172.21.15.1:0/2742237353 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f945c1025d0 0x7f945c1049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:05.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.538+0000 7f9460b4b640 1 -- 172.21.15.1:0/2742237353 >> 172.21.15.1:0/2742237353 conn(0x7f945c0fc1b0 msgr2=0x7f945c0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:05.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.539+0000 7f9460b4b640 1 -- 172.21.15.1:0/2742237353 shutdown_connections 2024-09-19T09:38:05.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.539+0000 7f9460b4b640 1 -- 172.21.15.1:0/2742237353 wait complete. 2024-09-19T09:38:05.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.539+0000 7f9460b4b640 1 Processor -- start 2024-09-19T09:38:05.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.539+0000 7f9460b4b640 1 -- start start 2024-09-19T09:38:05.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.539+0000 7f9460b4b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f945c1025d0 0x7f945c197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:05.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.539+0000 7f9460b4b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f945c104f00 0x7f945c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:05.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.539+0000 7f9460b4b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f945c107830 0x7f945c19f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:05.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.539+0000 7f9460b4b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f945c10d810 con 0x7f945c1025d0 2024-09-19T09:38:05.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.539+0000 7f9460b4b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f945c10d690 con 0x7f945c107830 2024-09-19T09:38:05.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.539+0000 7f9460b4b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f945c10d990 con 0x7f945c104f00 2024-09-19T09:38:05.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.540+0000 7f945a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f945c1025d0 0x7f945c197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:05.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.540+0000 7f945a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f945c1025d0 0x7f945c197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33630/0 (socket says 172.21.15.1:33630) 2024-09-19T09:38:05.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.540+0000 7f945a59c640 1 -- 172.21.15.1:0/3492664787 learned_addr learned my addr 172.21.15.1:0/3492664787 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:05.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.540+0000 7f945ad9d640 1 --2- 172.21.15.1:0/3492664787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f945c107830 0x7f945c19f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:05.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.540+0000 7f9459d9b640 1 --2- 172.21.15.1:0/3492664787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f945c104f00 0x7f945c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:05.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.540+0000 7f945a59c640 1 -- 172.21.15.1:0/3492664787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f945c104f00 msgr2=0x7f945c198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:05.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.540+0000 7f945a59c640 1 --2- 172.21.15.1:0/3492664787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f945c104f00 0x7f945c198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:05.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.540+0000 7f945a59c640 1 -- 172.21.15.1:0/3492664787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f945c107830 msgr2=0x7f945c19f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:05.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.540+0000 7f945a59c640 1 --2- 172.21.15.1:0/3492664787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f945c107830 0x7f945c19f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:05.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.540+0000 7f945a59c640 1 -- 172.21.15.1:0/3492664787 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f945c19fb70 con 0x7f945c1025d0 2024-09-19T09:38:05.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.540+0000 7f9459d9b640 1 --2- 172.21.15.1:0/3492664787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f945c104f00 0x7f945c198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:05.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.540+0000 7f945a59c640 1 --2- 172.21.15.1:0/3492664787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f945c1025d0 0x7f945c197f50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f944c00e9f0 tx=0x7f944c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:05.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.540+0000 7f944b7fe640 1 -- 172.21.15.1:0/3492664787 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f944c00cd80 con 0x7f945c1025d0 2024-09-19T09:38:05.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.540+0000 7f944b7fe640 1 -- 172.21.15.1:0/3492664787 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f944c010910 con 0x7f945c1025d0 2024-09-19T09:38:05.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.540+0000 7f9460b4b640 1 -- 172.21.15.1:0/3492664787 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f945c19fe60 con 0x7f945c1025d0 2024-09-19T09:38:05.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.540+0000 7f944b7fe640 1 -- 172.21.15.1:0/3492664787 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f944c018990 con 0x7f945c1025d0 2024-09-19T09:38:05.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.540+0000 7f9460b4b640 1 -- 172.21.15.1:0/3492664787 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f945c1a02c0 con 0x7f945c1025d0 2024-09-19T09:38:05.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.541+0000 7f9460b4b640 1 -- 172.21.15.1:0/3492664787 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f945c0fdca0 con 0x7f945c1025d0 2024-09-19T09:38:05.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.542+0000 7f944b7fe640 1 -- 172.21.15.1:0/3492664787 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f944c010ac0 con 0x7f945c1025d0 2024-09-19T09:38:05.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.543+0000 7f944b7fe640 1 --2- 172.21.15.1:0/3492664787 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f94440a3250 0x7f94440a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:05.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.543+0000 7f9459d9b640 1 --2- 172.21.15.1:0/3492664787 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f94440a3250 0x7f94440a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:05.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.543+0000 7f944b7fe640 1 -- 172.21.15.1:0/3492664787 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f944c0cfcb0 con 0x7f945c1025d0 2024-09-19T09:38:05.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.544+0000 7f9459d9b640 1 --2- 172.21.15.1:0/3492664787 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f94440a3250 0x7f94440a5710 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9450000c00 tx=0x7f94500315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:05.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.547+0000 7f944b7fe640 1 -- 172.21.15.1:0/3492664787 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f944c09c9d0 con 0x7f945c1025d0 2024-09-19T09:38:05.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:05 smithi022 ceph-mon[35583]: pgmap v338: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:38:05.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:05 smithi022 ceph-mon[35583]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:38:05.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:05 smithi121 ceph-mon[35577]: pgmap v338: 97 pgs: 97 active+clean; 639 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:38:05.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:05 smithi121 ceph-mon[35577]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:38:05.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.723+0000 7f9460b4b640 1 -- 172.21.15.1:0/3492664787 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f945c062630 con 0x7f94440a3250 2024-09-19T09:38:05.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.729+0000 7f944b7fe640 1 -- 172.21.15.1:0/3492664787 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259001 (secure 0 0 0) 0x7f945c062630 con 0x7f94440a3250 2024-09-19T09:38:05.734 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:38:05.735 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-19T09:38:05.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.733+0000 7f9460b4b640 1 -- 172.21.15.1:0/3492664787 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f94440a3250 msgr2=0x7f94440a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:05.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.733+0000 7f9460b4b640 1 --2- 172.21.15.1:0/3492664787 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f94440a3250 0x7f94440a5710 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9450000c00 tx=0x7f94500315b0 comp rx=0 tx=0).stop 2024-09-19T09:38:05.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.733+0000 7f9460b4b640 1 -- 172.21.15.1:0/3492664787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f945c1025d0 msgr2=0x7f945c197f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:05.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.733+0000 7f9460b4b640 1 --2- 172.21.15.1:0/3492664787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f945c1025d0 0x7f945c197f50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f944c00e9f0 tx=0x7f944c00eeb0 comp rx=0 tx=0).stop 2024-09-19T09:38:05.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.733+0000 7f9460b4b640 1 -- 172.21.15.1:0/3492664787 shutdown_connections 2024-09-19T09:38:05.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.733+0000 7f9460b4b640 1 --2- 172.21.15.1:0/3492664787 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f94440a3250 0x7f94440a5710 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:05.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.733+0000 7f9460b4b640 1 --2- 172.21.15.1:0/3492664787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f945c107830 0x7f945c19f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:05.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.733+0000 7f9460b4b640 1 --2- 172.21.15.1:0/3492664787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f945c104f00 0x7f945c198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:05.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.733+0000 7f9460b4b640 1 --2- 172.21.15.1:0/3492664787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f945c1025d0 0x7f945c197f50 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:05.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.733+0000 7f9460b4b640 1 -- 172.21.15.1:0/3492664787 >> 172.21.15.1:0/3492664787 conn(0x7f945c0fc1b0 msgr2=0x7f945c103010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:05.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.733+0000 7f9460b4b640 1 -- 172.21.15.1:0/3492664787 shutdown_connections 2024-09-19T09:38:05.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:05.733+0000 7f9460b4b640 1 -- 172.21.15.1:0/3492664787 wait complete. 2024-09-19T09:38:05.745 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-09-19T09:38:04.157147+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654468,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":340,"num_read_kb":280,"num_write":272,"num_write_kb":3030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":712,"ondisk_log_size":712,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":405964,"kb_used_data":10956,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124535860,"statfs":{"total":1151940427776,"available":1151524720640,"internally_reserved":0,"allocated":11218944,"data_stored":7256604,"data_compressed":178359,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19141,"internal_metadata":404272443},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002802"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147034+0000","last_change":"2024-09-19T09:36:12.985228+0000","last_active":"2024-09-19T09:37:44.147034+0000","last_peered":"2024-09-19T09:37:44.147034+0000","last_clean":"2024-09-19T09:37:44.147034+0000","last_became_active":"2024-09-19T09:36:12.984306+0000","last_became_peered":"2024-09-19T09:36:12.984306+0000","last_unstale":"2024-09-19T09:37:44.147034+0000","last_undegraded":"2024-09-19T09:37:44.147034+0000","last_fullsized":"2024-09-19T09:37:44.147034+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:45.988859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145651+0000","last_change":"2024-09-19T09:36:12.987631+0000","last_active":"2024-09-19T09:37:44.145651+0000","last_peered":"2024-09-19T09:37:44.145651+0000","last_clean":"2024-09-19T09:37:44.145651+0000","last_became_active":"2024-09-19T09:36:12.987298+0000","last_became_peered":"2024-09-19T09:36:12.987298+0000","last_unstale":"2024-09-19T09:37:44.145651+0000","last_undegraded":"2024-09-19T09:37:44.145651+0000","last_fullsized":"2024-09-19T09:37:44.145651+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:47.397162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.161196+0000","last_change":"2024-09-19T09:36:12.991466+0000","last_active":"2024-09-19T09:37:44.161196+0000","last_peered":"2024-09-19T09:37:44.161196+0000","last_clean":"2024-09-19T09:37:44.161196+0000","last_became_active":"2024-09-19T09:36:12.990903+0000","last_became_peered":"2024-09-19T09:36:12.990903+0000","last_unstale":"2024-09-19T09:37:44.161196+0000","last_undegraded":"2024-09-19T09:37:44.161196+0000","last_fullsized":"2024-09-19T09:37:44.161196+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:04.128768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.150215+0000","last_change":"2024-09-19T09:36:12.986686+0000","last_active":"2024-09-19T09:37:44.150215+0000","last_peered":"2024-09-19T09:37:44.150215+0000","last_clean":"2024-09-19T09:37:44.150215+0000","last_became_active":"2024-09-19T09:36:12.986334+0000","last_became_peered":"2024-09-19T09:36:12.986334+0000","last_unstale":"2024-09-19T09:37:44.150215+0000","last_undegraded":"2024-09-19T09:37:44.150215+0000","last_fullsized":"2024-09-19T09:37:44.150215+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:39.926343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.139116+0000","last_change":"2024-09-19T09:36:12.981964+0000","last_active":"2024-09-19T09:37:44.139116+0000","last_peered":"2024-09-19T09:37:44.139116+0000","last_clean":"2024-09-19T09:37:44.139116+0000","last_became_active":"2024-09-19T09:36:12.981558+0000","last_became_peered":"2024-09-19T09:36:12.981558+0000","last_unstale":"2024-09-19T09:37:44.139116+0000","last_undegraded":"2024-09-19T09:37:44.139116+0000","last_fullsized":"2024-09-19T09:37:44.139116+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:33.706451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146524+0000","last_change":"2024-09-19T09:36:12.992598+0000","last_active":"2024-09-19T09:37:44.146524+0000","last_peered":"2024-09-19T09:37:44.146524+0000","last_clean":"2024-09-19T09:37:44.146524+0000","last_became_active":"2024-09-19T09:36:12.992281+0000","last_became_peered":"2024-09-19T09:36:12.992281+0000","last_unstale":"2024-09-19T09:37:44.146524+0000","last_undegraded":"2024-09-19T09:37:44.146524+0000","last_fullsized":"2024-09-19T09:37:44.146524+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:26.107432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146663+0000","last_change":"2024-09-19T09:36:12.988583+0000","last_active":"2024-09-19T09:37:44.146663+0000","last_peered":"2024-09-19T09:37:44.146663+0000","last_clean":"2024-09-19T09:37:44.146663+0000","last_became_active":"2024-09-19T09:36:12.987895+0000","last_became_peered":"2024-09-19T09:36:12.987895+0000","last_unstale":"2024-09-19T09:37:44.146663+0000","last_undegraded":"2024-09-19T09:37:44.146663+0000","last_fullsized":"2024-09-19T09:37:44.146663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:47.617324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.141930+0000","last_change":"2024-09-19T09:36:12.988526+0000","last_active":"2024-09-19T09:37:44.141930+0000","last_peered":"2024-09-19T09:37:44.141930+0000","last_clean":"2024-09-19T09:37:44.141930+0000","last_became_active":"2024-09-19T09:36:12.988093+0000","last_became_peered":"2024-09-19T09:36:12.988093+0000","last_unstale":"2024-09-19T09:37:44.141930+0000","last_undegraded":"2024-09-19T09:37:44.141930+0000","last_fullsized":"2024-09-19T09:37:44.141930+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:48.949397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.157907+0000","last_change":"2024-09-19T09:36:12.992360+0000","last_active":"2024-09-19T09:37:44.157907+0000","last_peered":"2024-09-19T09:37:44.157907+0000","last_clean":"2024-09-19T09:37:44.157907+0000","last_became_active":"2024-09-19T09:36:12.991833+0000","last_became_peered":"2024-09-19T09:36:12.991833+0000","last_unstale":"2024-09-19T09:37:44.157907+0000","last_undegraded":"2024-09-19T09:37:44.157907+0000","last_fullsized":"2024-09-19T09:37:44.157907+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:47.715012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.144515+0000","last_change":"2024-09-19T09:36:12.993435+0000","last_active":"2024-09-19T09:37:44.144515+0000","last_peered":"2024-09-19T09:37:44.144515+0000","last_clean":"2024-09-19T09:37:44.144515+0000","last_became_active":"2024-09-19T09:36:12.993108+0000","last_became_peered":"2024-09-19T09:36:12.993108+0000","last_unstale":"2024-09-19T09:37:44.144515+0000","last_undegraded":"2024-09-19T09:37:44.144515+0000","last_fullsized":"2024-09-19T09:37:44.144515+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:54.453593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.162293+0000","last_change":"2024-09-19T09:36:12.991044+0000","last_active":"2024-09-19T09:37:44.162293+0000","last_peered":"2024-09-19T09:37:44.162293+0000","last_clean":"2024-09-19T09:37:44.162293+0000","last_became_active":"2024-09-19T09:36:12.989955+0000","last_became_peered":"2024-09-19T09:36:12.989955+0000","last_unstale":"2024-09-19T09:37:44.162293+0000","last_undegraded":"2024-09-19T09:37:44.162293+0000","last_fullsized":"2024-09-19T09:37:44.162293+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:21.034023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148886+0000","last_change":"2024-09-19T09:36:12.989679+0000","last_active":"2024-09-19T09:37:44.148886+0000","last_peered":"2024-09-19T09:37:44.148886+0000","last_clean":"2024-09-19T09:37:44.148886+0000","last_became_active":"2024-09-19T09:36:12.988463+0000","last_became_peered":"2024-09-19T09:36:12.988463+0000","last_unstale":"2024-09-19T09:37:44.148886+0000","last_undegraded":"2024-09-19T09:37:44.148886+0000","last_fullsized":"2024-09-19T09:37:44.148886+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:28.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.144722+0000","last_change":"2024-09-19T09:36:12.983494+0000","last_active":"2024-09-19T09:37:44.144722+0000","last_peered":"2024-09-19T09:37:44.144722+0000","last_clean":"2024-09-19T09:37:44.144722+0000","last_became_active":"2024-09-19T09:36:12.983143+0000","last_became_peered":"2024-09-19T09:36:12.983143+0000","last_unstale":"2024-09-19T09:37:44.144722+0000","last_undegraded":"2024-09-19T09:37:44.144722+0000","last_fullsized":"2024-09-19T09:37:44.144722+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:23.378183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.143385+0000","last_change":"2024-09-19T09:36:12.987512+0000","last_active":"2024-09-19T09:37:44.143385+0000","last_peered":"2024-09-19T09:37:44.143385+0000","last_clean":"2024-09-19T09:37:44.143385+0000","last_became_active":"2024-09-19T09:36:12.987288+0000","last_became_peered":"2024-09-19T09:36:12.987288+0000","last_unstale":"2024-09-19T09:37:44.143385+0000","last_undegraded":"2024-09-19T09:37:44.143385+0000","last_fullsized":"2024-09-19T09:37:44.143385+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:14.614333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147801+0000","last_change":"2024-09-19T09:37:16.131000+0000","last_active":"2024-09-19T09:37:44.147801+0000","last_peered":"2024-09-19T09:37:44.147801+0000","last_clean":"2024-09-19T09:37:44.147801+0000","last_became_active":"2024-09-19T09:37:16.130647+0000","last_became_peered":"2024-09-19T09:37:16.130647+0000","last_unstale":"2024-09-19T09:37:44.147801+0000","last_undegraded":"2024-09-19T09:37:44.147801+0000","last_fullsized":"2024-09-19T09:37:44.147801+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:22.498318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.162539+0000","last_change":"2024-09-19T09:36:12.988210+0000","last_active":"2024-09-19T09:37:44.162539+0000","last_peered":"2024-09-19T09:37:44.162539+0000","last_clean":"2024-09-19T09:37:44.162539+0000","last_became_active":"2024-09-19T09:36:12.987904+0000","last_became_peered":"2024-09-19T09:36:12.987904+0000","last_unstale":"2024-09-19T09:37:44.162539+0000","last_undegraded":"2024-09-19T09:37:44.162539+0000","last_fullsized":"2024-09-19T09:37:44.162539+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:13.588237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147356+0000","last_change":"2024-09-19T09:36:12.984028+0000","last_active":"2024-09-19T09:37:44.147356+0000","last_peered":"2024-09-19T09:37:44.147356+0000","last_clean":"2024-09-19T09:37:44.147356+0000","last_became_active":"2024-09-19T09:36:12.982062+0000","last_became_peered":"2024-09-19T09:36:12.982062+0000","last_unstale":"2024-09-19T09:37:44.147356+0000","last_undegraded":"2024-09-19T09:37:44.147356+0000","last_fullsized":"2024-09-19T09:37:44.147356+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:26.610287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.141161+0000","last_change":"2024-09-19T09:36:12.979277+0000","last_active":"2024-09-19T09:37:44.141161+0000","last_peered":"2024-09-19T09:37:44.141161+0000","last_clean":"2024-09-19T09:37:44.141161+0000","last_became_active":"2024-09-19T09:36:12.978970+0000","last_became_peered":"2024-09-19T09:36:12.978970+0000","last_unstale":"2024-09-19T09:37:44.141161+0000","last_undegraded":"2024-09-19T09:37:44.141161+0000","last_fullsized":"2024-09-19T09:37:44.141161+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:00.424728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147432+0000","last_change":"2024-09-19T09:36:12.981021+0000","last_active":"2024-09-19T09:37:44.147432+0000","last_peered":"2024-09-19T09:37:44.147432+0000","last_clean":"2024-09-19T09:37:44.147432+0000","last_became_active":"2024-09-19T09:36:12.980580+0000","last_became_peered":"2024-09-19T09:36:12.980580+0000","last_unstale":"2024-09-19T09:37:44.147432+0000","last_undegraded":"2024-09-19T09:37:44.147432+0000","last_fullsized":"2024-09-19T09:37:44.147432+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:17.464873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.143924+0000","last_change":"2024-09-19T09:36:12.986090+0000","last_active":"2024-09-19T09:37:44.143924+0000","last_peered":"2024-09-19T09:37:44.143924+0000","last_clean":"2024-09-19T09:37:44.143924+0000","last_became_active":"2024-09-19T09:36:12.985740+0000","last_became_peered":"2024-09-19T09:36:12.985740+0000","last_unstale":"2024-09-19T09:37:44.143924+0000","last_undegraded":"2024-09-19T09:37:44.143924+0000","last_fullsized":"2024-09-19T09:37:44.143924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:35.252834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145367+0000","last_change":"2024-09-19T09:36:12.981257+0000","last_active":"2024-09-19T09:37:44.145367+0000","last_peered":"2024-09-19T09:37:44.145367+0000","last_clean":"2024-09-19T09:37:44.145367+0000","last_became_active":"2024-09-19T09:36:12.980911+0000","last_became_peered":"2024-09-19T09:36:12.980911+0000","last_unstale":"2024-09-19T09:37:44.145367+0000","last_undegraded":"2024-09-19T09:37:44.145367+0000","last_fullsized":"2024-09-19T09:37:44.145367+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:41.470514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.161076+0000","last_change":"2024-09-19T09:36:12.982585+0000","last_active":"2024-09-19T09:37:44.161076+0000","last_peered":"2024-09-19T09:37:44.161076+0000","last_clean":"2024-09-19T09:37:44.161076+0000","last_became_active":"2024-09-19T09:36:12.982193+0000","last_became_peered":"2024-09-19T09:36:12.982193+0000","last_unstale":"2024-09-19T09:37:44.161076+0000","last_undegraded":"2024-09-19T09:37:44.161076+0000","last_fullsized":"2024-09-19T09:37:44.161076+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:30.057088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.143208+0000","last_change":"2024-09-19T09:36:12.985236+0000","last_active":"2024-09-19T09:37:44.143208+0000","last_peered":"2024-09-19T09:37:44.143208+0000","last_clean":"2024-09-19T09:37:44.143208+0000","last_became_active":"2024-09-19T09:36:12.984751+0000","last_became_peered":"2024-09-19T09:36:12.984751+0000","last_unstale":"2024-09-19T09:37:44.143208+0000","last_undegraded":"2024-09-19T09:37:44.143208+0000","last_fullsized":"2024-09-19T09:37:44.143208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:52.784216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.138535+0000","last_change":"2024-09-19T09:36:12.985856+0000","last_active":"2024-09-19T09:37:44.138535+0000","last_peered":"2024-09-19T09:37:44.138535+0000","last_clean":"2024-09-19T09:37:44.138535+0000","last_became_active":"2024-09-19T09:36:12.985312+0000","last_became_peered":"2024-09-19T09:36:12.985312+0000","last_unstale":"2024-09-19T09:37:44.138535+0000","last_undegraded":"2024-09-19T09:37:44.138535+0000","last_fullsized":"2024-09-19T09:37:44.138535+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:25.235945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.142807+0000","last_change":"2024-09-19T09:36:12.982443+0000","last_active":"2024-09-19T09:37:44.142807+0000","last_peered":"2024-09-19T09:37:44.142807+0000","last_clean":"2024-09-19T09:37:44.142807+0000","last_became_active":"2024-09-19T09:36:12.982130+0000","last_became_peered":"2024-09-19T09:36:12.982130+0000","last_unstale":"2024-09-19T09:37:44.142807+0000","last_undegraded":"2024-09-19T09:37:44.142807+0000","last_fullsized":"2024-09-19T09:37:44.142807+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:17.177563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145567+0000","last_change":"2024-09-19T09:36:12.990439+0000","last_active":"2024-09-19T09:37:44.145567+0000","last_peered":"2024-09-19T09:37:44.145567+0000","last_clean":"2024-09-19T09:37:44.145567+0000","last_became_active":"2024-09-19T09:36:12.990135+0000","last_became_peered":"2024-09-19T09:36:12.990135+0000","last_unstale":"2024-09-19T09:37:44.145567+0000","last_undegraded":"2024-09-19T09:37:44.145567+0000","last_fullsized":"2024-09-19T09:37:44.145567+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:51.685192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145105+0000","last_change":"2024-09-19T09:36:12.987261+0000","last_active":"2024-09-19T09:37:44.145105+0000","last_peered":"2024-09-19T09:37:44.145105+0000","last_clean":"2024-09-19T09:37:44.145105+0000","last_became_active":"2024-09-19T09:36:12.986192+0000","last_became_peered":"2024-09-19T09:36:12.986192+0000","last_unstale":"2024-09-19T09:37:44.145105+0000","last_undegraded":"2024-09-19T09:37:44.145105+0000","last_fullsized":"2024-09-19T09:37:44.145105+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:58.435605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.141377+0000","last_change":"2024-09-19T09:36:12.981248+0000","last_active":"2024-09-19T09:37:44.141377+0000","last_peered":"2024-09-19T09:37:44.141377+0000","last_clean":"2024-09-19T09:37:44.141377+0000","last_became_active":"2024-09-19T09:36:12.980754+0000","last_became_peered":"2024-09-19T09:36:12.980754+0000","last_unstale":"2024-09-19T09:37:44.141377+0000","last_undegraded":"2024-09-19T09:37:44.141377+0000","last_fullsized":"2024-09-19T09:37:44.141377+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:03.970402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.139500+0000","last_change":"2024-09-19T09:36:12.990841+0000","last_active":"2024-09-19T09:37:44.139500+0000","last_peered":"2024-09-19T09:37:44.139500+0000","last_clean":"2024-09-19T09:37:44.139500+0000","last_became_active":"2024-09-19T09:36:12.989667+0000","last_became_peered":"2024-09-19T09:36:12.989667+0000","last_unstale":"2024-09-19T09:37:44.139500+0000","last_undegraded":"2024-09-19T09:37:44.139500+0000","last_fullsized":"2024-09-19T09:37:44.139500+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:46:00.314590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148537+0000","last_change":"2024-09-19T09:36:12.984007+0000","last_active":"2024-09-19T09:37:44.148537+0000","last_peered":"2024-09-19T09:37:44.148537+0000","last_clean":"2024-09-19T09:37:44.148537+0000","last_became_active":"2024-09-19T09:36:12.983627+0000","last_became_peered":"2024-09-19T09:36:12.983627+0000","last_unstale":"2024-09-19T09:37:44.148537+0000","last_undegraded":"2024-09-19T09:37:44.148537+0000","last_fullsized":"2024-09-19T09:37:44.148537+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:42.038673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146461+0000","last_change":"2024-09-19T09:36:12.988032+0000","last_active":"2024-09-19T09:37:44.146461+0000","last_peered":"2024-09-19T09:37:44.146461+0000","last_clean":"2024-09-19T09:37:44.146461+0000","last_became_active":"2024-09-19T09:36:12.987588+0000","last_became_peered":"2024-09-19T09:36:12.987588+0000","last_unstale":"2024-09-19T09:37:44.146461+0000","last_undegraded":"2024-09-19T09:37:44.146461+0000","last_fullsized":"2024-09-19T09:37:44.146461+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:01.518543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148152+0000","last_change":"2024-09-19T09:37:16.131565+0000","last_active":"2024-09-19T09:37:44.148152+0000","last_peered":"2024-09-19T09:37:44.148152+0000","last_clean":"2024-09-19T09:37:44.148152+0000","last_became_active":"2024-09-19T09:37:16.131171+0000","last_became_peered":"2024-09-19T09:37:16.131171+0000","last_unstale":"2024-09-19T09:37:44.148152+0000","last_undegraded":"2024-09-19T09:37:44.148152+0000","last_fullsized":"2024-09-19T09:37:44.148152+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:18.195074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.141174+0000","last_change":"2024-09-19T09:36:12.989709+0000","last_active":"2024-09-19T09:37:44.141174+0000","last_peered":"2024-09-19T09:37:44.141174+0000","last_clean":"2024-09-19T09:37:44.141174+0000","last_became_active":"2024-09-19T09:36:12.989324+0000","last_became_peered":"2024-09-19T09:36:12.989324+0000","last_unstale":"2024-09-19T09:37:44.141174+0000","last_undegraded":"2024-09-19T09:37:44.141174+0000","last_fullsized":"2024-09-19T09:37:44.141174+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:09.843175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.033713+0000","last_change":"2024-09-19T09:37:16.033713+0000","last_active":"2024-09-19T09:37:16.033713+0000","last_peered":"2024-09-19T09:37:16.033713+0000","last_clean":"2024-09-19T09:37:16.033713+0000","last_became_active":"2024-09-19T09:37:16.033230+0000","last_became_peered":"2024-09-19T09:37:16.033230+0000","last_unstale":"2024-09-19T09:37:16.033713+0000","last_undegraded":"2024-09-19T09:37:16.033713+0000","last_fullsized":"2024-09-19T09:37:16.033713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:12.262115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.143084+0000","last_change":"2024-09-19T09:37:16.484760+0000","last_active":"2024-09-19T09:37:44.143084+0000","last_peered":"2024-09-19T09:37:44.143084+0000","last_clean":"2024-09-19T09:37:44.143084+0000","last_became_active":"2024-09-19T09:37:16.484316+0000","last_became_peered":"2024-09-19T09:37:16.484316+0000","last_unstale":"2024-09-19T09:37:44.143084+0000","last_undegraded":"2024-09-19T09:37:44.143084+0000","last_fullsized":"2024-09-19T09:37:44.143084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:14.897601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.124818+0000","last_change":"2024-09-19T09:37:16.124818+0000","last_active":"2024-09-19T09:37:16.124818+0000","last_peered":"2024-09-19T09:37:16.124818+0000","last_clean":"2024-09-19T09:37:16.124818+0000","last_became_active":"2024-09-19T09:37:16.124391+0000","last_became_peered":"2024-09-19T09:37:16.124391+0000","last_unstale":"2024-09-19T09:37:16.124818+0000","last_undegraded":"2024-09-19T09:37:16.124818+0000","last_fullsized":"2024-09-19T09:37:16.124818+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:25.443666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034105+0000","last_change":"2024-09-19T09:36:10.837287+0000","last_active":"2024-09-19T09:37:16.034105+0000","last_peered":"2024-09-19T09:37:16.034105+0000","last_clean":"2024-09-19T09:37:16.034105+0000","last_became_active":"2024-09-19T09:36:10.836890+0000","last_became_peered":"2024-09-19T09:36:10.836890+0000","last_unstale":"2024-09-19T09:37:16.034105+0000","last_undegraded":"2024-09-19T09:37:16.034105+0000","last_fullsized":"2024-09-19T09:37:16.034105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:09.676728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.139992+0000","last_change":"2024-09-19T09:36:12.975690+0000","last_active":"2024-09-19T09:37:44.139992+0000","last_peered":"2024-09-19T09:37:44.139992+0000","last_clean":"2024-09-19T09:37:44.139992+0000","last_became_active":"2024-09-19T09:36:12.975370+0000","last_became_peered":"2024-09-19T09:36:12.975370+0000","last_unstale":"2024-09-19T09:37:44.139992+0000","last_undegraded":"2024-09-19T09:37:44.139992+0000","last_fullsized":"2024-09-19T09:37:44.139992+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:05.650917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030234+0000","last_change":"2024-09-19T09:36:10.843736+0000","last_active":"2024-09-19T09:37:16.030234+0000","last_peered":"2024-09-19T09:37:16.030234+0000","last_clean":"2024-09-19T09:37:16.030234+0000","last_became_active":"2024-09-19T09:36:10.843353+0000","last_became_peered":"2024-09-19T09:36:10.843353+0000","last_unstale":"2024-09-19T09:37:16.030234+0000","last_undegraded":"2024-09-19T09:37:16.030234+0000","last_fullsized":"2024-09-19T09:37:16.030234+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:29.818642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.140596+0000","last_change":"2024-09-19T09:36:12.978841+0000","last_active":"2024-09-19T09:37:44.140596+0000","last_peered":"2024-09-19T09:37:44.140596+0000","last_clean":"2024-09-19T09:37:44.140596+0000","last_became_active":"2024-09-19T09:36:12.978501+0000","last_became_peered":"2024-09-19T09:36:12.978501+0000","last_unstale":"2024-09-19T09:37:44.140596+0000","last_undegraded":"2024-09-19T09:37:44.140596+0000","last_fullsized":"2024-09-19T09:37:44.140596+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:07.974576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.032030+0000","last_change":"2024-09-19T09:36:10.841997+0000","last_active":"2024-09-19T09:37:16.032030+0000","last_peered":"2024-09-19T09:37:16.032030+0000","last_clean":"2024-09-19T09:37:16.032030+0000","last_became_active":"2024-09-19T09:36:10.841641+0000","last_became_peered":"2024-09-19T09:36:10.841641+0000","last_unstale":"2024-09-19T09:37:16.032030+0000","last_undegraded":"2024-09-19T09:37:16.032030+0000","last_fullsized":"2024-09-19T09:37:16.032030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:10.477879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.156072+0000","last_change":"2024-09-19T09:36:12.981486+0000","last_active":"2024-09-19T09:37:44.156072+0000","last_peered":"2024-09-19T09:37:44.156072+0000","last_clean":"2024-09-19T09:37:44.156072+0000","last_became_active":"2024-09-19T09:36:12.981165+0000","last_became_peered":"2024-09-19T09:36:12.981165+0000","last_unstale":"2024-09-19T09:37:44.156072+0000","last_undegraded":"2024-09-19T09:37:44.156072+0000","last_fullsized":"2024-09-19T09:37:44.156072+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:21.986132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030755+0000","last_change":"2024-09-19T09:36:10.845362+0000","last_active":"2024-09-19T09:37:16.030755+0000","last_peered":"2024-09-19T09:37:16.030755+0000","last_clean":"2024-09-19T09:37:16.030755+0000","last_became_active":"2024-09-19T09:36:10.844992+0000","last_became_peered":"2024-09-19T09:36:10.844992+0000","last_unstale":"2024-09-19T09:37:16.030755+0000","last_undegraded":"2024-09-19T09:37:16.030755+0000","last_fullsized":"2024-09-19T09:37:16.030755+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:52.854333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.137951+0000","last_change":"2024-09-19T09:36:12.988924+0000","last_active":"2024-09-19T09:37:44.137951+0000","last_peered":"2024-09-19T09:37:44.137951+0000","last_clean":"2024-09-19T09:37:44.137951+0000","last_became_active":"2024-09-19T09:36:12.988331+0000","last_became_peered":"2024-09-19T09:36:12.988331+0000","last_unstale":"2024-09-19T09:37:44.137951+0000","last_undegraded":"2024-09-19T09:37:44.137951+0000","last_fullsized":"2024-09-19T09:37:44.137951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:24.754252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029903+0000","last_change":"2024-09-19T09:36:10.860003+0000","last_active":"2024-09-19T09:37:16.029903+0000","last_peered":"2024-09-19T09:37:16.029903+0000","last_clean":"2024-09-19T09:37:16.029903+0000","last_became_active":"2024-09-19T09:36:10.859584+0000","last_became_peered":"2024-09-19T09:36:10.859584+0000","last_unstale":"2024-09-19T09:37:16.029903+0000","last_undegraded":"2024-09-19T09:37:16.029903+0000","last_fullsized":"2024-09-19T09:37:16.029903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:44.837960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.160481+0000","last_change":"2024-09-19T09:36:12.985446+0000","last_active":"2024-09-19T09:37:44.160481+0000","last_peered":"2024-09-19T09:37:44.160481+0000","last_clean":"2024-09-19T09:37:44.160481+0000","last_became_active":"2024-09-19T09:36:12.984671+0000","last_became_peered":"2024-09-19T09:36:12.984671+0000","last_unstale":"2024-09-19T09:37:44.160481+0000","last_undegraded":"2024-09-19T09:37:44.160481+0000","last_fullsized":"2024-09-19T09:37:44.160481+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:54.800151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'30","reported_seq":260,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:38:01.106636+0000","last_change":"2024-09-19T09:36:10.841056+0000","last_active":"2024-09-19T09:38:01.106636+0000","last_peered":"2024-09-19T09:38:01.106636+0000","last_clean":"2024-09-19T09:38:01.106636+0000","last_became_active":"2024-09-19T09:36:10.840731+0000","last_became_peered":"2024-09-19T09:36:10.840731+0000","last_unstale":"2024-09-19T09:38:01.106636+0000","last_undegraded":"2024-09-19T09:38:01.106636+0000","last_fullsized":"2024-09-19T09:38:01.106636+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:13.676188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63068,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":208,"num_read_kb":165,"num_write":30,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146672+0000","last_change":"2024-09-19T09:36:12.990223+0000","last_active":"2024-09-19T09:37:44.146672+0000","last_peered":"2024-09-19T09:37:44.146672+0000","last_clean":"2024-09-19T09:37:44.146672+0000","last_became_active":"2024-09-19T09:36:12.989720+0000","last_became_peered":"2024-09-19T09:36:12.989720+0000","last_unstale":"2024-09-19T09:37:44.146672+0000","last_undegraded":"2024-09-19T09:37:44.146672+0000","last_fullsized":"2024-09-19T09:37:44.146672+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:37.003075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.129753+0000","last_change":"2024-09-19T09:36:10.843288+0000","last_active":"2024-09-19T09:37:16.129753+0000","last_peered":"2024-09-19T09:37:16.129753+0000","last_clean":"2024-09-19T09:37:16.129753+0000","last_became_active":"2024-09-19T09:36:10.842844+0000","last_became_peered":"2024-09-19T09:36:10.842844+0000","last_unstale":"2024-09-19T09:37:16.129753+0000","last_undegraded":"2024-09-19T09:37:16.129753+0000","last_fullsized":"2024-09-19T09:37:16.129753+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:38.695411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145354+0000","last_change":"2024-09-19T09:36:12.981251+0000","last_active":"2024-09-19T09:37:44.145354+0000","last_peered":"2024-09-19T09:37:44.145354+0000","last_clean":"2024-09-19T09:37:44.145354+0000","last_became_active":"2024-09-19T09:36:12.980861+0000","last_became_peered":"2024-09-19T09:36:12.980861+0000","last_unstale":"2024-09-19T09:37:44.145354+0000","last_undegraded":"2024-09-19T09:37:44.145354+0000","last_fullsized":"2024-09-19T09:37:44.145354+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:09.633644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030128+0000","last_change":"2024-09-19T09:36:10.843448+0000","last_active":"2024-09-19T09:37:16.030128+0000","last_peered":"2024-09-19T09:37:16.030128+0000","last_clean":"2024-09-19T09:37:16.030128+0000","last_became_active":"2024-09-19T09:36:10.843087+0000","last_became_peered":"2024-09-19T09:36:10.843087+0000","last_unstale":"2024-09-19T09:37:16.030128+0000","last_undegraded":"2024-09-19T09:37:16.030128+0000","last_fullsized":"2024-09-19T09:37:16.030128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:20.623613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.151910+0000","last_change":"2024-09-19T09:36:12.981160+0000","last_active":"2024-09-19T09:37:44.151910+0000","last_peered":"2024-09-19T09:37:44.151910+0000","last_clean":"2024-09-19T09:37:44.151910+0000","last_became_active":"2024-09-19T09:36:12.980823+0000","last_became_peered":"2024-09-19T09:36:12.980823+0000","last_unstale":"2024-09-19T09:37:44.151910+0000","last_undegraded":"2024-09-19T09:37:44.151910+0000","last_fullsized":"2024-09-19T09:37:44.151910+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:39.323439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028480+0000","last_change":"2024-09-19T09:36:10.842536+0000","last_active":"2024-09-19T09:37:16.028480+0000","last_peered":"2024-09-19T09:37:16.028480+0000","last_clean":"2024-09-19T09:37:16.028480+0000","last_became_active":"2024-09-19T09:36:10.842176+0000","last_became_peered":"2024-09-19T09:36:10.842176+0000","last_unstale":"2024-09-19T09:37:16.028480+0000","last_undegraded":"2024-09-19T09:37:16.028480+0000","last_fullsized":"2024-09-19T09:37:16.028480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:37.871299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145814+0000","last_change":"2024-09-19T09:36:12.987271+0000","last_active":"2024-09-19T09:37:44.145814+0000","last_peered":"2024-09-19T09:37:44.145814+0000","last_clean":"2024-09-19T09:37:44.145814+0000","last_became_active":"2024-09-19T09:36:12.986918+0000","last_became_peered":"2024-09-19T09:36:12.986918+0000","last_unstale":"2024-09-19T09:37:44.145814+0000","last_undegraded":"2024-09-19T09:37:44.145814+0000","last_fullsized":"2024-09-19T09:37:44.145814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:07.608541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030337+0000","last_change":"2024-09-19T09:36:10.860370+0000","last_active":"2024-09-19T09:37:16.030337+0000","last_peered":"2024-09-19T09:37:16.030337+0000","last_clean":"2024-09-19T09:37:16.030337+0000","last_became_active":"2024-09-19T09:36:10.859820+0000","last_became_peered":"2024-09-19T09:36:10.859820+0000","last_unstale":"2024-09-19T09:37:16.030337+0000","last_undegraded":"2024-09-19T09:37:16.030337+0000","last_fullsized":"2024-09-19T09:37:16.030337+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:12.121038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.161919+0000","last_change":"2024-09-19T09:36:12.994449+0000","last_active":"2024-09-19T09:37:44.161919+0000","last_peered":"2024-09-19T09:37:44.161919+0000","last_clean":"2024-09-19T09:37:44.161919+0000","last_became_active":"2024-09-19T09:36:12.994141+0000","last_became_peered":"2024-09-19T09:36:12.994141+0000","last_unstale":"2024-09-19T09:37:44.161919+0000","last_undegraded":"2024-09-19T09:37:44.161919+0000","last_fullsized":"2024-09-19T09:37:44.161919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:21.416453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031764+0000","last_change":"2024-09-19T09:36:10.839609+0000","last_active":"2024-09-19T09:37:16.031764+0000","last_peered":"2024-09-19T09:37:16.031764+0000","last_clean":"2024-09-19T09:37:16.031764+0000","last_became_active":"2024-09-19T09:36:10.839227+0000","last_became_peered":"2024-09-19T09:36:10.839227+0000","last_unstale":"2024-09-19T09:37:16.031764+0000","last_undegraded":"2024-09-19T09:37:16.031764+0000","last_fullsized":"2024-09-19T09:37:16.031764+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:00.734924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.144996+0000","last_change":"2024-09-19T09:36:12.983573+0000","last_active":"2024-09-19T09:37:44.144996+0000","last_peered":"2024-09-19T09:37:44.144996+0000","last_clean":"2024-09-19T09:37:44.144996+0000","last_became_active":"2024-09-19T09:36:12.983241+0000","last_became_peered":"2024-09-19T09:36:12.983241+0000","last_unstale":"2024-09-19T09:37:44.144996+0000","last_undegraded":"2024-09-19T09:37:44.144996+0000","last_fullsized":"2024-09-19T09:37:44.144996+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:44.050271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034765+0000","last_change":"2024-09-19T09:36:10.839789+0000","last_active":"2024-09-19T09:37:16.034765+0000","last_peered":"2024-09-19T09:37:16.034765+0000","last_clean":"2024-09-19T09:37:16.034765+0000","last_became_active":"2024-09-19T09:36:10.839445+0000","last_became_peered":"2024-09-19T09:36:10.839445+0000","last_unstale":"2024-09-19T09:37:16.034765+0000","last_undegraded":"2024-09-19T09:37:16.034765+0000","last_fullsized":"2024-09-19T09:37:16.034765+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:16.040249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148829+0000","last_change":"2024-09-19T09:36:12.993420+0000","last_active":"2024-09-19T09:37:44.148829+0000","last_peered":"2024-09-19T09:37:44.148829+0000","last_clean":"2024-09-19T09:37:44.148829+0000","last_became_active":"2024-09-19T09:36:12.992334+0000","last_became_peered":"2024-09-19T09:36:12.992334+0000","last_unstale":"2024-09-19T09:37:44.148829+0000","last_undegraded":"2024-09-19T09:37:44.148829+0000","last_fullsized":"2024-09-19T09:37:44.148829+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:21.693164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030247+0000","last_change":"2024-09-19T09:36:10.839461+0000","last_active":"2024-09-19T09:37:16.030247+0000","last_peered":"2024-09-19T09:37:16.030247+0000","last_clean":"2024-09-19T09:37:16.030247+0000","last_became_active":"2024-09-19T09:36:10.839092+0000","last_became_peered":"2024-09-19T09:36:10.839092+0000","last_unstale":"2024-09-19T09:37:16.030247+0000","last_undegraded":"2024-09-19T09:37:16.030247+0000","last_fullsized":"2024-09-19T09:37:16.030247+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:02.367267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145214+0000","last_change":"2024-09-19T09:36:12.988234+0000","last_active":"2024-09-19T09:37:44.145214+0000","last_peered":"2024-09-19T09:37:44.145214+0000","last_clean":"2024-09-19T09:37:44.145214+0000","last_became_active":"2024-09-19T09:36:12.987813+0000","last_became_peered":"2024-09-19T09:36:12.987813+0000","last_unstale":"2024-09-19T09:37:44.145214+0000","last_undegraded":"2024-09-19T09:37:44.145214+0000","last_fullsized":"2024-09-19T09:37:44.145214+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:56.024428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.130482+0000","last_change":"2024-09-19T09:36:10.945705+0000","last_active":"2024-09-19T09:37:16.130482+0000","last_peered":"2024-09-19T09:37:16.130482+0000","last_clean":"2024-09-19T09:37:16.130482+0000","last_became_active":"2024-09-19T09:36:10.945323+0000","last_became_peered":"2024-09-19T09:36:10.945323+0000","last_unstale":"2024-09-19T09:37:16.130482+0000","last_undegraded":"2024-09-19T09:37:16.130482+0000","last_fullsized":"2024-09-19T09:37:16.130482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:24.211909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.162179+0000","last_change":"2024-09-19T09:36:12.990517+0000","last_active":"2024-09-19T09:37:44.162179+0000","last_peered":"2024-09-19T09:37:44.162179+0000","last_clean":"2024-09-19T09:37:44.162179+0000","last_became_active":"2024-09-19T09:36:12.989291+0000","last_became_peered":"2024-09-19T09:36:12.989291+0000","last_unstale":"2024-09-19T09:37:44.162179+0000","last_undegraded":"2024-09-19T09:37:44.162179+0000","last_fullsized":"2024-09-19T09:37:44.162179+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:31.087798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":339,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030377+0000","last_change":"2024-09-19T09:34:59.337025+0000","last_active":"2024-09-19T09:37:16.030377+0000","last_peered":"2024-09-19T09:37:16.030377+0000","last_clean":"2024-09-19T09:37:16.030377+0000","last_became_active":"2024-09-19T09:34:59.336556+0000","last_became_peered":"2024-09-19T09:34:59.336556+0000","last_unstale":"2024-09-19T09:37:16.030377+0000","last_undegraded":"2024-09-19T09:37:16.030377+0000","last_fullsized":"2024-09-19T09:37:16.030377+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:31:30.566923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:31:30.566923+0000","last_clean_scrub_stamp":"2024-09-19T09:31:30.566923+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:00.675254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028715+0000","last_change":"2024-09-19T09:36:10.838131+0000","last_active":"2024-09-19T09:37:16.028715+0000","last_peered":"2024-09-19T09:37:16.028715+0000","last_clean":"2024-09-19T09:37:16.028715+0000","last_became_active":"2024-09-19T09:36:10.837725+0000","last_became_peered":"2024-09-19T09:36:10.837725+0000","last_unstale":"2024-09-19T09:37:16.028715+0000","last_undegraded":"2024-09-19T09:37:16.028715+0000","last_fullsized":"2024-09-19T09:37:16.028715+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:57.104726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.139840+0000","last_change":"2024-09-19T09:36:12.981951+0000","last_active":"2024-09-19T09:37:44.139840+0000","last_peered":"2024-09-19T09:37:44.139840+0000","last_clean":"2024-09-19T09:37:44.139840+0000","last_became_active":"2024-09-19T09:36:12.981558+0000","last_became_peered":"2024-09-19T09:36:12.981558+0000","last_unstale":"2024-09-19T09:37:44.139840+0000","last_undegraded":"2024-09-19T09:37:44.139840+0000","last_fullsized":"2024-09-19T09:37:44.139840+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:31.119853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030184+0000","last_change":"2024-09-19T09:36:10.843574+0000","last_active":"2024-09-19T09:37:16.030184+0000","last_peered":"2024-09-19T09:37:16.030184+0000","last_clean":"2024-09-19T09:37:16.030184+0000","last_became_active":"2024-09-19T09:36:10.843252+0000","last_became_peered":"2024-09-19T09:36:10.843252+0000","last_unstale":"2024-09-19T09:37:16.030184+0000","last_undegraded":"2024-09-19T09:37:16.030184+0000","last_fullsized":"2024-09-19T09:37:16.030184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:10.492812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147324+0000","last_change":"2024-09-19T09:36:12.984538+0000","last_active":"2024-09-19T09:37:44.147324+0000","last_peered":"2024-09-19T09:37:44.147324+0000","last_clean":"2024-09-19T09:37:44.147324+0000","last_became_active":"2024-09-19T09:36:12.983448+0000","last_became_peered":"2024-09-19T09:36:12.983448+0000","last_unstale":"2024-09-19T09:37:44.147324+0000","last_undegraded":"2024-09-19T09:37:44.147324+0000","last_fullsized":"2024-09-19T09:37:44.147324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:48.294473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034208+0000","last_change":"2024-09-19T09:36:10.858959+0000","last_active":"2024-09-19T09:37:16.034208+0000","last_peered":"2024-09-19T09:37:16.034208+0000","last_clean":"2024-09-19T09:37:16.034208+0000","last_became_active":"2024-09-19T09:36:10.858638+0000","last_became_peered":"2024-09-19T09:36:10.858638+0000","last_unstale":"2024-09-19T09:37:16.034208+0000","last_undegraded":"2024-09-19T09:37:16.034208+0000","last_fullsized":"2024-09-19T09:37:16.034208+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:12.646483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.142955+0000","last_change":"2024-09-19T09:36:12.992710+0000","last_active":"2024-09-19T09:37:44.142955+0000","last_peered":"2024-09-19T09:37:44.142955+0000","last_clean":"2024-09-19T09:37:44.142955+0000","last_became_active":"2024-09-19T09:36:12.992436+0000","last_became_peered":"2024-09-19T09:36:12.992436+0000","last_unstale":"2024-09-19T09:37:44.142955+0000","last_undegraded":"2024-09-19T09:37:44.142955+0000","last_fullsized":"2024-09-19T09:37:44.142955+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:51.685516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030475+0000","last_change":"2024-09-19T09:36:10.842031+0000","last_active":"2024-09-19T09:37:16.030475+0000","last_peered":"2024-09-19T09:37:16.030475+0000","last_clean":"2024-09-19T09:37:16.030475+0000","last_became_active":"2024-09-19T09:36:10.841693+0000","last_became_peered":"2024-09-19T09:36:10.841693+0000","last_unstale":"2024-09-19T09:37:16.030475+0000","last_undegraded":"2024-09-19T09:37:16.030475+0000","last_fullsized":"2024-09-19T09:37:16.030475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:28:51.040551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.138330+0000","last_change":"2024-09-19T09:37:16.034026+0000","last_active":"2024-09-19T09:37:44.138330+0000","last_peered":"2024-09-19T09:37:44.138330+0000","last_clean":"2024-09-19T09:37:44.138330+0000","last_became_active":"2024-09-19T09:37:16.033546+0000","last_became_peered":"2024-09-19T09:37:16.033546+0000","last_unstale":"2024-09-19T09:37:44.138330+0000","last_undegraded":"2024-09-19T09:37:44.138330+0000","last_fullsized":"2024-09-19T09:37:44.138330+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:42.673825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.027885+0000","last_change":"2024-09-19T09:36:10.860470+0000","last_active":"2024-09-19T09:37:16.027885+0000","last_peered":"2024-09-19T09:37:16.027885+0000","last_clean":"2024-09-19T09:37:16.027885+0000","last_became_active":"2024-09-19T09:36:10.860097+0000","last_became_peered":"2024-09-19T09:36:10.860097+0000","last_unstale":"2024-09-19T09:37:16.027885+0000","last_undegraded":"2024-09-19T09:37:16.027885+0000","last_fullsized":"2024-09-19T09:37:16.027885+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:14.933378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.139200+0000","last_change":"2024-09-19T09:36:12.988489+0000","last_active":"2024-09-19T09:37:44.139200+0000","last_peered":"2024-09-19T09:37:44.139200+0000","last_clean":"2024-09-19T09:37:44.139200+0000","last_became_active":"2024-09-19T09:36:12.988151+0000","last_became_peered":"2024-09-19T09:36:12.988151+0000","last_unstale":"2024-09-19T09:37:44.139200+0000","last_undegraded":"2024-09-19T09:37:44.139200+0000","last_fullsized":"2024-09-19T09:37:44.139200+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:24.088771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030844+0000","last_change":"2024-09-19T09:36:10.860103+0000","last_active":"2024-09-19T09:37:16.030844+0000","last_peered":"2024-09-19T09:37:16.030844+0000","last_clean":"2024-09-19T09:37:16.030844+0000","last_became_active":"2024-09-19T09:36:10.859526+0000","last_became_peered":"2024-09-19T09:36:10.859526+0000","last_unstale":"2024-09-19T09:37:16.030844+0000","last_undegraded":"2024-09-19T09:37:16.030844+0000","last_fullsized":"2024-09-19T09:37:16.030844+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:25.460372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148110+0000","last_change":"2024-09-19T09:36:12.986286+0000","last_active":"2024-09-19T09:37:44.148110+0000","last_peered":"2024-09-19T09:37:44.148110+0000","last_clean":"2024-09-19T09:37:44.148110+0000","last_became_active":"2024-09-19T09:36:12.985982+0000","last_became_peered":"2024-09-19T09:36:12.985982+0000","last_unstale":"2024-09-19T09:37:44.148110+0000","last_undegraded":"2024-09-19T09:37:44.148110+0000","last_fullsized":"2024-09-19T09:37:44.148110+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:19.026134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'11","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028153+0000","last_change":"2024-09-19T09:36:10.839280+0000","last_active":"2024-09-19T09:37:16.028153+0000","last_peered":"2024-09-19T09:37:16.028153+0000","last_clean":"2024-09-19T09:37:16.028153+0000","last_became_active":"2024-09-19T09:36:10.838979+0000","last_became_peered":"2024-09-19T09:36:10.838979+0000","last_unstale":"2024-09-19T09:37:16.028153+0000","last_undegraded":"2024-09-19T09:37:16.028153+0000","last_fullsized":"2024-09-19T09:37:16.028153+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:06.303175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146091+0000","last_change":"2024-09-19T09:36:12.979778+0000","last_active":"2024-09-19T09:37:44.146091+0000","last_peered":"2024-09-19T09:37:44.146091+0000","last_clean":"2024-09-19T09:37:44.146091+0000","last_became_active":"2024-09-19T09:36:12.979455+0000","last_became_peered":"2024-09-19T09:36:12.979455+0000","last_unstale":"2024-09-19T09:37:44.146091+0000","last_undegraded":"2024-09-19T09:37:44.146091+0000","last_fullsized":"2024-09-19T09:37:44.146091+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:36.620368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029063+0000","last_change":"2024-09-19T09:36:10.945706+0000","last_active":"2024-09-19T09:37:16.029063+0000","last_peered":"2024-09-19T09:37:16.029063+0000","last_clean":"2024-09-19T09:37:16.029063+0000","last_became_active":"2024-09-19T09:36:10.945314+0000","last_became_peered":"2024-09-19T09:36:10.945314+0000","last_unstale":"2024-09-19T09:37:16.029063+0000","last_undegraded":"2024-09-19T09:37:16.029063+0000","last_fullsized":"2024-09-19T09:37:16.029063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:49.786913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.141688+0000","last_change":"2024-09-19T09:36:12.989412+0000","last_active":"2024-09-19T09:37:44.141688+0000","last_peered":"2024-09-19T09:37:44.141688+0000","last_clean":"2024-09-19T09:37:44.141688+0000","last_became_active":"2024-09-19T09:36:12.989109+0000","last_became_peered":"2024-09-19T09:36:12.989109+0000","last_unstale":"2024-09-19T09:37:44.141688+0000","last_undegraded":"2024-09-19T09:37:44.141688+0000","last_fullsized":"2024-09-19T09:37:44.141688+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:33.142592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.123342+0000","last_change":"2024-09-19T09:36:10.858581+0000","last_active":"2024-09-19T09:37:16.123342+0000","last_peered":"2024-09-19T09:37:16.123342+0000","last_clean":"2024-09-19T09:37:16.123342+0000","last_became_active":"2024-09-19T09:36:10.858240+0000","last_became_peered":"2024-09-19T09:36:10.858240+0000","last_unstale":"2024-09-19T09:37:16.123342+0000","last_undegraded":"2024-09-19T09:37:16.123342+0000","last_fullsized":"2024-09-19T09:37:16.123342+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:45.285839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.111050+0000","last_change":"2024-09-19T09:36:12.989075+0000","last_active":"2024-09-19T09:37:44.111050+0000","last_peered":"2024-09-19T09:37:44.111050+0000","last_clean":"2024-09-19T09:37:44.111050+0000","last_became_active":"2024-09-19T09:36:12.988752+0000","last_became_peered":"2024-09-19T09:36:12.988752+0000","last_unstale":"2024-09-19T09:37:44.111050+0000","last_undegraded":"2024-09-19T09:37:44.111050+0000","last_fullsized":"2024-09-19T09:37:44.111050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.424032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.483353+0000","last_change":"2024-09-19T09:36:10.838716+0000","last_active":"2024-09-19T09:37:16.483353+0000","last_peered":"2024-09-19T09:37:16.483353+0000","last_clean":"2024-09-19T09:37:16.483353+0000","last_became_active":"2024-09-19T09:36:10.838393+0000","last_became_peered":"2024-09-19T09:36:10.838393+0000","last_unstale":"2024-09-19T09:37:16.483353+0000","last_undegraded":"2024-09-19T09:37:16.483353+0000","last_fullsized":"2024-09-19T09:37:16.483353+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:54.107223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147844+0000","last_change":"2024-09-19T09:36:12.991721+0000","last_active":"2024-09-19T09:37:44.147844+0000","last_peered":"2024-09-19T09:37:44.147844+0000","last_clean":"2024-09-19T09:37:44.147844+0000","last_became_active":"2024-09-19T09:36:12.991398+0000","last_became_peered":"2024-09-19T09:36:12.991398+0000","last_unstale":"2024-09-19T09:37:44.147844+0000","last_undegraded":"2024-09-19T09:37:44.147844+0000","last_fullsized":"2024-09-19T09:37:44.147844+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:19:31.312072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.485156+0000","last_change":"2024-09-19T09:37:16.484541+0000","last_active":"2024-09-19T09:37:16.485156+0000","last_peered":"2024-09-19T09:37:16.485156+0000","last_clean":"2024-09-19T09:37:16.485156+0000","last_became_active":"2024-09-19T09:37:16.484035+0000","last_became_peered":"2024-09-19T09:37:16.484035+0000","last_unstale":"2024-09-19T09:37:16.485156+0000","last_undegraded":"2024-09-19T09:37:16.485156+0000","last_fullsized":"2024-09-19T09:37:16.485156+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:36.332699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146414+0000","last_change":"2024-09-19T09:36:12.984180+0000","last_active":"2024-09-19T09:37:44.146414+0000","last_peered":"2024-09-19T09:37:44.146414+0000","last_clean":"2024-09-19T09:37:44.146414+0000","last_became_active":"2024-09-19T09:36:12.983876+0000","last_became_peered":"2024-09-19T09:36:12.983876+0000","last_unstale":"2024-09-19T09:37:44.146414+0000","last_undegraded":"2024-09-19T09:37:44.146414+0000","last_fullsized":"2024-09-19T09:37:44.146414+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:45.876771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031127+0000","last_change":"2024-09-19T09:36:10.845391+0000","last_active":"2024-09-19T09:37:16.031127+0000","last_peered":"2024-09-19T09:37:16.031127+0000","last_clean":"2024-09-19T09:37:16.031127+0000","last_became_active":"2024-09-19T09:36:10.844974+0000","last_became_peered":"2024-09-19T09:36:10.844974+0000","last_unstale":"2024-09-19T09:37:16.031127+0000","last_undegraded":"2024-09-19T09:37:16.031127+0000","last_fullsized":"2024-09-19T09:37:16.031127+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:00.318337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.162083+0000","last_change":"2024-09-19T09:36:12.991145+0000","last_active":"2024-09-19T09:37:44.162083+0000","last_peered":"2024-09-19T09:37:44.162083+0000","last_clean":"2024-09-19T09:37:44.162083+0000","last_became_active":"2024-09-19T09:36:12.989891+0000","last_became_peered":"2024-09-19T09:36:12.989891+0000","last_unstale":"2024-09-19T09:37:44.162083+0000","last_undegraded":"2024-09-19T09:37:44.162083+0000","last_fullsized":"2024-09-19T09:37:44.162083+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:21.054936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.162240+0000","last_change":"2024-09-19T09:36:12.995378+0000","last_active":"2024-09-19T09:37:44.162240+0000","last_peered":"2024-09-19T09:37:44.162240+0000","last_clean":"2024-09-19T09:37:44.162240+0000","last_became_active":"2024-09-19T09:36:12.995028+0000","last_became_peered":"2024-09-19T09:36:12.995028+0000","last_unstale":"2024-09-19T09:37:44.162240+0000","last_undegraded":"2024-09-19T09:37:44.162240+0000","last_fullsized":"2024-09-19T09:37:44.162240+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:41.102130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031259+0000","last_change":"2024-09-19T09:36:10.839595+0000","last_active":"2024-09-19T09:37:16.031259+0000","last_peered":"2024-09-19T09:37:16.031259+0000","last_clean":"2024-09-19T09:37:16.031259+0000","last_became_active":"2024-09-19T09:36:10.839196+0000","last_became_peered":"2024-09-19T09:36:10.839196+0000","last_unstale":"2024-09-19T09:37:16.031259+0000","last_undegraded":"2024-09-19T09:37:16.031259+0000","last_fullsized":"2024-09-19T09:37:16.031259+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:02.272731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.160402+0000","last_change":"2024-09-19T09:36:12.984485+0000","last_active":"2024-09-19T09:37:44.160402+0000","last_peered":"2024-09-19T09:37:44.160402+0000","last_clean":"2024-09-19T09:37:44.160402+0000","last_became_active":"2024-09-19T09:36:12.984004+0000","last_became_peered":"2024-09-19T09:36:12.984004+0000","last_unstale":"2024-09-19T09:37:44.160402+0000","last_undegraded":"2024-09-19T09:37:44.160402+0000","last_fullsized":"2024-09-19T09:37:44.160402+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:37.646776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030731+0000","last_change":"2024-09-19T09:36:10.845306+0000","last_active":"2024-09-19T09:37:16.030731+0000","last_peered":"2024-09-19T09:37:16.030731+0000","last_clean":"2024-09-19T09:37:16.030731+0000","last_became_active":"2024-09-19T09:36:10.844952+0000","last_became_peered":"2024-09-19T09:36:10.844952+0000","last_unstale":"2024-09-19T09:37:16.030731+0000","last_undegraded":"2024-09-19T09:37:16.030731+0000","last_fullsized":"2024-09-19T09:37:16.030731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:09.792482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.161016+0000","last_change":"2024-09-19T09:36:12.991260+0000","last_active":"2024-09-19T09:37:44.161016+0000","last_peered":"2024-09-19T09:37:44.161016+0000","last_clean":"2024-09-19T09:37:44.161016+0000","last_became_active":"2024-09-19T09:36:12.989981+0000","last_became_peered":"2024-09-19T09:36:12.989981+0000","last_unstale":"2024-09-19T09:37:44.161016+0000","last_undegraded":"2024-09-19T09:37:44.161016+0000","last_fullsized":"2024-09-19T09:37:44.161016+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:11.301790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.483876+0000","last_change":"2024-09-19T09:36:10.859016+0000","last_active":"2024-09-19T09:37:16.483876+0000","last_peered":"2024-09-19T09:37:16.483876+0000","last_clean":"2024-09-19T09:37:16.483876+0000","last_became_active":"2024-09-19T09:36:10.858661+0000","last_became_peered":"2024-09-19T09:36:10.858661+0000","last_unstale":"2024-09-19T09:37:16.483876+0000","last_undegraded":"2024-09-19T09:37:16.483876+0000","last_fullsized":"2024-09-19T09:37:16.483876+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:54.395977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148013+0000","last_change":"2024-09-19T09:37:16.131601+0000","last_active":"2024-09-19T09:37:44.148013+0000","last_peered":"2024-09-19T09:37:44.148013+0000","last_clean":"2024-09-19T09:37:44.148013+0000","last_became_active":"2024-09-19T09:37:16.131199+0000","last_became_peered":"2024-09-19T09:37:16.131199+0000","last_unstale":"2024-09-19T09:37:44.148013+0000","last_undegraded":"2024-09-19T09:37:44.148013+0000","last_fullsized":"2024-09-19T09:37:44.148013+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:27.358544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.039032+0000","last_change":"2024-09-19T09:37:16.039032+0000","last_active":"2024-09-19T09:37:16.039032+0000","last_peered":"2024-09-19T09:37:16.039032+0000","last_clean":"2024-09-19T09:37:16.039032+0000","last_became_active":"2024-09-19T09:37:16.035315+0000","last_became_peered":"2024-09-19T09:37:16.035315+0000","last_unstale":"2024-09-19T09:37:16.039032+0000","last_undegraded":"2024-09-19T09:37:16.039032+0000","last_fullsized":"2024-09-19T09:37:16.039032+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:58.795064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63866,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":214,"num_read_kb":171,"num_write":89,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":191598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282954,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547236,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":441682,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776169,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1036288,"data_stored":1094847,"data_compressed":41852,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972398,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":441682,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201330,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":441704,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430265,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":1031585,"data_compressed":41852,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593790,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":441217,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822723,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":1031767,"data_compressed":41852,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953544,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":441122,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215181,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":913408,"data_stored":441438,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444113,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":974848,"data_stored":504202,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":504168,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":441190,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":63068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":63102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":63262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:38:05.799 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:38:06.056 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:06.420 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:06 smithi001 ceph-mon[31225]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:38:06.420 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:06 smithi001 ceph-mon[31225]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:38:06.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.499+0000 7fbb3fbc4640 1 -- 172.21.15.1:0/1722762388 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb38102790 msgr2=0x7fbb381067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:06.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.499+0000 7fbb3fbc4640 1 --2- 172.21.15.1:0/1722762388 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb38102790 0x7fbb381067e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbb28009900 tx=0x7fbb2802a410 comp rx=0 tx=0).stop 2024-09-19T09:38:06.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.499+0000 7fbb3fbc4640 1 -- 172.21.15.1:0/1722762388 shutdown_connections 2024-09-19T09:38:06.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.500+0000 7fbb3fbc4640 1 --2- 172.21.15.1:0/1722762388 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb38106f10 0x7fbb3810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:06.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.500+0000 7fbb3fbc4640 1 --2- 172.21.15.1:0/1722762388 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb38102790 0x7fbb381067e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:06.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.500+0000 7fbb3fbc4640 1 --2- 172.21.15.1:0/1722762388 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb38101de0 0x7fbb381021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:06.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.500+0000 7fbb3fbc4640 1 -- 172.21.15.1:0/1722762388 >> 172.21.15.1:0/1722762388 conn(0x7fbb380fd8c0 msgr2=0x7fbb380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:06.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.500+0000 7fbb3fbc4640 1 -- 172.21.15.1:0/1722762388 shutdown_connections 2024-09-19T09:38:06.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.500+0000 7fbb3fbc4640 1 -- 172.21.15.1:0/1722762388 wait complete. 2024-09-19T09:38:06.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.500+0000 7fbb3fbc4640 1 Processor -- start 2024-09-19T09:38:06.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.500+0000 7fbb3fbc4640 1 -- start start 2024-09-19T09:38:06.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.500+0000 7fbb3fbc4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb38101de0 0x7fbb38198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:06.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.500+0000 7fbb3fbc4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb38102790 0x7fbb38198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:06.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.500+0000 7fbb3fbc4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb38106f10 0x7fbb3819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:06.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.500+0000 7fbb3fbc4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbb38111f70 con 0x7fbb38106f10 2024-09-19T09:38:06.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.500+0000 7fbb3fbc4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbb38111df0 con 0x7fbb38102790 2024-09-19T09:38:06.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.500+0000 7fbb3fbc4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbb381120f0 con 0x7fbb38101de0 2024-09-19T09:38:06.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.501+0000 7fbb3e161640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb38106f10 0x7fbb3819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:06.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.501+0000 7fbb3e161640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb38106f10 0x7fbb3819cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33660/0 (socket says 172.21.15.1:33660) 2024-09-19T09:38:06.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.501+0000 7fbb3d960640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb38101de0 0x7fbb38198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:06.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.501+0000 7fbb3e161640 1 -- 172.21.15.1:0/3679950029 learned_addr learned my addr 172.21.15.1:0/3679950029 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:06.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.501+0000 7fbb3d15f640 1 --2- 172.21.15.1:0/3679950029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb38102790 0x7fbb38198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:06.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.501+0000 7fbb3e161640 1 -- 172.21.15.1:0/3679950029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb38101de0 msgr2=0x7fbb38198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:06.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.501+0000 7fbb3e161640 1 --2- 172.21.15.1:0/3679950029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb38101de0 0x7fbb38198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:06.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.501+0000 7fbb3e161640 1 -- 172.21.15.1:0/3679950029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb38102790 msgr2=0x7fbb38198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:06.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.501+0000 7fbb3e161640 1 --2- 172.21.15.1:0/3679950029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb38102790 0x7fbb38198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:06.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.501+0000 7fbb3e161640 1 -- 172.21.15.1:0/3679950029 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb3819d400 con 0x7fbb38106f10 2024-09-19T09:38:06.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.501+0000 7fbb3d15f640 1 --2- 172.21.15.1:0/3679950029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb38102790 0x7fbb38198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:06.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.501+0000 7fbb3e161640 1 --2- 172.21.15.1:0/3679950029 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb38106f10 0x7fbb3819cd20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000eb10 tx=0x7fbb3000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:06.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.501+0000 7fbb2effd640 1 -- 172.21.15.1:0/3679950029 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb30004b20 con 0x7fbb38106f10 2024-09-19T09:38:06.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.501+0000 7fbb3fbc4640 1 -- 172.21.15.1:0/3679950029 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb3819d6f0 con 0x7fbb38106f10 2024-09-19T09:38:06.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.501+0000 7fbb2effd640 1 -- 172.21.15.1:0/3679950029 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb30004cc0 con 0x7fbb38106f10 2024-09-19T09:38:06.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.501+0000 7fbb2effd640 1 -- 172.21.15.1:0/3679950029 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb30010760 con 0x7fbb38106f10 2024-09-19T09:38:06.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.501+0000 7fbb3fbc4640 1 -- 172.21.15.1:0/3679950029 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb381a4fd0 con 0x7fbb38106f10 2024-09-19T09:38:06.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.502+0000 7fbb3fbc4640 1 -- 172.21.15.1:0/3679950029 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb381021c0 con 0x7fbb38106f10 2024-09-19T09:38:06.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.504+0000 7fbb2effd640 1 -- 172.21.15.1:0/3679950029 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fbb30005000 con 0x7fbb38106f10 2024-09-19T09:38:06.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.504+0000 7fbb2effd640 1 --2- 172.21.15.1:0/3679950029 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbb240a3240 0x7fbb240a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:06.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.504+0000 7fbb3d960640 1 --2- 172.21.15.1:0/3679950029 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbb240a3240 0x7fbb240a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:06.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.504+0000 7fbb2effd640 1 -- 172.21.15.1:0/3679950029 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fbb300d0110 con 0x7fbb38106f10 2024-09-19T09:38:06.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.505+0000 7fbb3d960640 1 --2- 172.21.15.1:0/3679950029 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbb240a3240 0x7fbb240a5700 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbb34005fd0 tx=0x7fbb3400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:06.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.508+0000 7fbb2effd640 1 -- 172.21.15.1:0/3679950029 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbb30054210 con 0x7fbb38106f10 2024-09-19T09:38:06.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:06 smithi022 ceph-mon[35583]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:38:06.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:06 smithi022 ceph-mon[35583]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:38:06.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:06 smithi121 ceph-mon[35577]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:38:06.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:06 smithi121 ceph-mon[35577]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:38:06.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.717+0000 7fbb3fbc4640 1 -- 172.21.15.1:0/3679950029 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb3810a1b0 con 0x7fbb38106f10 2024-09-19T09:38:06.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.718+0000 7fbb2effd640 1 -- 172.21.15.1:0/3679950029 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11837 (secure 0 0 0) 0x7fbb3009cdf0 con 0x7fbb38106f10 2024-09-19T09:38:06.720 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:38:06.720 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":19,"btime":"2024-09-19T09:36:24:006349+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:36:23.723388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6839/3279971690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3279971690},{"type":"v1","addr":"172.21.15.121:6839","nonce":3279971690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:38:06.720 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 19 2024-09-19T09:38:06.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.720+0000 7fbb3fbc4640 1 -- 172.21.15.1:0/3679950029 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbb240a3240 msgr2=0x7fbb240a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:06.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.720+0000 7fbb3fbc4640 1 --2- 172.21.15.1:0/3679950029 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbb240a3240 0x7fbb240a5700 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbb34005fd0 tx=0x7fbb3400b390 comp rx=0 tx=0).stop 2024-09-19T09:38:06.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.720+0000 7fbb3fbc4640 1 -- 172.21.15.1:0/3679950029 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb38106f10 msgr2=0x7fbb3819cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:06.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.720+0000 7fbb3fbc4640 1 --2- 172.21.15.1:0/3679950029 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb38106f10 0x7fbb3819cd20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000eb10 tx=0x7fbb3000c2d0 comp rx=0 tx=0).stop 2024-09-19T09:38:06.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.720+0000 7fbb3fbc4640 1 -- 172.21.15.1:0/3679950029 shutdown_connections 2024-09-19T09:38:06.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.720+0000 7fbb3fbc4640 1 --2- 172.21.15.1:0/3679950029 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb38106f10 0x7fbb3819cd20 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:06.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.720+0000 7fbb3fbc4640 1 --2- 172.21.15.1:0/3679950029 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbb240a3240 0x7fbb240a5700 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:06.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.720+0000 7fbb3fbc4640 1 --2- 172.21.15.1:0/3679950029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb38102790 0x7fbb38198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:06.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.720+0000 7fbb3fbc4640 1 --2- 172.21.15.1:0/3679950029 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb38101de0 0x7fbb38198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:06.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.720+0000 7fbb3fbc4640 1 -- 172.21.15.1:0/3679950029 >> 172.21.15.1:0/3679950029 conn(0x7fbb380fd8c0 msgr2=0x7fbb380febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:06.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.720+0000 7fbb3fbc4640 1 -- 172.21.15.1:0/3679950029 shutdown_connections 2024-09-19T09:38:06.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:06.720+0000 7fbb3fbc4640 1 -- 172.21.15.1:0/3679950029 wait complete. 2024-09-19T09:38:07.450 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:07 smithi001 ceph-mon[31225]: pgmap v339: 97 pgs: 97 active+clean; 645 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-19T09:38:07.450 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:07 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/3679950029' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:07.485 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:38:07.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:07 smithi022 ceph-mon[35583]: pgmap v339: 97 pgs: 97 active+clean; 645 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-19T09:38:07.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:07 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/3679950029' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:07.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:07 smithi121 ceph-mon[35577]: pgmap v339: 97 pgs: 97 active+clean; 645 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-19T09:38:07.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:07 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/3679950029' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:07.746 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:08.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.191+0000 7f4cd113a640 1 -- 172.21.15.1:0/1162336392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ccc101de0 msgr2=0x7f4ccc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:08.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.191+0000 7f4cd113a640 1 --2- 172.21.15.1:0/1162336392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ccc101de0 0x7f4ccc1021c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc009900 tx=0x7f4cbc02a410 comp rx=0 tx=0).stop 2024-09-19T09:38:08.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.191+0000 7f4cd113a640 1 -- 172.21.15.1:0/1162336392 shutdown_connections 2024-09-19T09:38:08.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.191+0000 7f4cd113a640 1 --2- 172.21.15.1:0/1162336392 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ccc106f10 0x7f4ccc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.191+0000 7f4cd113a640 1 --2- 172.21.15.1:0/1162336392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ccc102790 0x7f4ccc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.191+0000 7f4cd113a640 1 --2- 172.21.15.1:0/1162336392 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ccc101de0 0x7f4ccc1021c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.191+0000 7f4cd113a640 1 -- 172.21.15.1:0/1162336392 >> 172.21.15.1:0/1162336392 conn(0x7f4ccc0fd8c0 msgr2=0x7f4ccc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:08.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.191+0000 7f4cd113a640 1 -- 172.21.15.1:0/1162336392 shutdown_connections 2024-09-19T09:38:08.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.191+0000 7f4cd113a640 1 -- 172.21.15.1:0/1162336392 wait complete. 2024-09-19T09:38:08.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.192+0000 7f4cd113a640 1 Processor -- start 2024-09-19T09:38:08.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.192+0000 7f4cd113a640 1 -- start start 2024-09-19T09:38:08.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.193+0000 7f4cd113a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ccc101de0 0x7f4ccc198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:08.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.193+0000 7f4cd113a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ccc102790 0x7f4ccc198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:08.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.193+0000 7f4cd113a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ccc106f10 0x7f4ccc19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:08.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.193+0000 7f4cd113a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4ccc111f70 con 0x7f4ccc101de0 2024-09-19T09:38:08.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.193+0000 7f4cd113a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4ccc111df0 con 0x7f4ccc102790 2024-09-19T09:38:08.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.193+0000 7f4cd113a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4ccc1120f0 con 0x7f4ccc106f10 2024-09-19T09:38:08.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.193+0000 7f4ccad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ccc101de0 0x7f4ccc198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:08.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.193+0000 7f4ccad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ccc101de0 0x7f4ccc198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33672/0 (socket says 172.21.15.1:33672) 2024-09-19T09:38:08.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.193+0000 7f4ccad9d640 1 -- 172.21.15.1:0/2476699886 learned_addr learned my addr 172.21.15.1:0/2476699886 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:08.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.193+0000 7f4cca59c640 1 --2- 172.21.15.1:0/2476699886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ccc102790 0x7f4ccc198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:08.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.193+0000 7f4ccb59e640 1 --2- 172.21.15.1:0/2476699886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ccc106f10 0x7f4ccc19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:08.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.193+0000 7f4ccad9d640 1 -- 172.21.15.1:0/2476699886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ccc106f10 msgr2=0x7f4ccc19cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:08.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.193+0000 7f4ccad9d640 1 --2- 172.21.15.1:0/2476699886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ccc106f10 0x7f4ccc19cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.193+0000 7f4ccad9d640 1 -- 172.21.15.1:0/2476699886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ccc102790 msgr2=0x7f4ccc198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:08.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.193+0000 7f4ccad9d640 1 --2- 172.21.15.1:0/2476699886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ccc102790 0x7f4ccc198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.193+0000 7f4ccad9d640 1 -- 172.21.15.1:0/2476699886 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ccc19d400 con 0x7f4ccc101de0 2024-09-19T09:38:08.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.193+0000 7f4cca59c640 1 --2- 172.21.15.1:0/2476699886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ccc102790 0x7f4ccc198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:38:08.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.193+0000 7f4ccad9d640 1 --2- 172.21.15.1:0/2476699886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ccc101de0 0x7f4ccc198450 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc006010 tx=0x7f4cbc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:08.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.194+0000 7f4cb3fff640 1 -- 172.21.15.1:0/2476699886 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc03f030 con 0x7f4ccc101de0 2024-09-19T09:38:08.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.194+0000 7f4cd113a640 1 -- 172.21.15.1:0/2476699886 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ccc19d690 con 0x7f4ccc101de0 2024-09-19T09:38:08.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.194+0000 7f4cb3fff640 1 -- 172.21.15.1:0/2476699886 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cbc003ce0 con 0x7f4ccc101de0 2024-09-19T09:38:08.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.194+0000 7f4cd113a640 1 -- 172.21.15.1:0/2476699886 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ccc1a4fd0 con 0x7f4ccc101de0 2024-09-19T09:38:08.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.194+0000 7f4cb3fff640 1 -- 172.21.15.1:0/2476699886 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc035070 con 0x7f4ccc101de0 2024-09-19T09:38:08.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.195+0000 7f4cb1ffb640 1 -- 172.21.15.1:0/2476699886 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ccc1021c0 con 0x7f4ccc101de0 2024-09-19T09:38:08.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.197+0000 7f4cb3fff640 1 -- 172.21.15.1:0/2476699886 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f4cbc042030 con 0x7f4ccc101de0 2024-09-19T09:38:08.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.198+0000 7f4cb3fff640 1 --2- 172.21.15.1:0/2476699886 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4cb40a32c0 0x7f4cb40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:08.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.198+0000 7f4cb3fff640 1 -- 172.21.15.1:0/2476699886 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f4cbc0eff80 con 0x7f4ccc101de0 2024-09-19T09:38:08.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.198+0000 7f4cca59c640 1 --2- 172.21.15.1:0/2476699886 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4cb40a32c0 0x7f4cb40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:08.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.198+0000 7f4cca59c640 1 --2- 172.21.15.1:0/2476699886 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4cb40a32c0 0x7f4cb40a5780 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc0fdce0 tx=0x7f4cc0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:08.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.201+0000 7f4cb3fff640 1 -- 172.21.15.1:0/2476699886 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4cbc0bc710 con 0x7f4ccc101de0 2024-09-19T09:38:08.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.378+0000 7f4cb1ffb640 1 -- 172.21.15.1:0/2476699886 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4ccc1997b0 con 0x7f4ccc101de0 2024-09-19T09:38:08.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.380+0000 7f4cb3fff640 1 -- 172.21.15.1:0/2476699886 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22612 (secure 0 0 0) 0x7f4cbc0c0a10 con 0x7f4ccc101de0 2024-09-19T09:38:08.381 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:38:08.382 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":83,"fsid":"57238232-7669-11ef-bceb-c7b262605968","created":"2024-09-19T09:28:28.406983+0000","modified":"2024-09-19T09:37:16.024965+0000","last_up_change":"2024-09-19T09:35:21.422825+0000","last_in_change":"2024-09-19T09:34:57.199184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:31:30.566509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:36:09.521275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:36:11.954337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c165571d-43f1-4c43-ba1e-35872d914f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6803","nonce":502676986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6805","nonce":502676986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6809","nonce":502676986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6807","nonce":502676986}]},"public_addr":"172.21.15.1:6803/502676986","cluster_addr":"172.21.15.1:6805/502676986","heartbeat_back_addr":"172.21.15.1:6809/502676986","heartbeat_front_addr":"172.21.15.1:6807/502676986","state":["exists","up"]},{"osd":1,"uuid":"baf120f8-8ba3-4aa5-a12a-41cdc97ff11b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6801","nonce":3735826323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6803","nonce":3735826323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6807","nonce":3735826323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6805","nonce":3735826323}]},"public_addr":"172.21.15.22:6801/3735826323","cluster_addr":"172.21.15.22:6803/3735826323","heartbeat_back_addr":"172.21.15.22:6807/3735826323","heartbeat_front_addr":"172.21.15.22:6805/3735826323","state":["exists","up"]},{"osd":2,"uuid":"72c520bf-c5cc-44ee-a38c-c9bac0a6280b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6801","nonce":1924970833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6803","nonce":1924970833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6807","nonce":1924970833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6805","nonce":1924970833}]},"public_addr":"172.21.15.121:6801/1924970833","cluster_addr":"172.21.15.121:6803/1924970833","heartbeat_back_addr":"172.21.15.121:6807/1924970833","heartbeat_front_addr":"172.21.15.121:6805/1924970833","state":["exists","up"]},{"osd":3,"uuid":"adad6d17-16d9-4c43-b581-35ac1bb9d807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6811","nonce":1515009793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6813","nonce":1515009793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6817","nonce":1515009793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6815","nonce":1515009793}]},"public_addr":"172.21.15.1:6811/1515009793","cluster_addr":"172.21.15.1:6813/1515009793","heartbeat_back_addr":"172.21.15.1:6817/1515009793","heartbeat_front_addr":"172.21.15.1:6815/1515009793","state":["exists","up"]},{"osd":4,"uuid":"8fb06efe-c3a0-48a3-9730-3e8f3e60922d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6809","nonce":923697266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6811","nonce":923697266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6815","nonce":923697266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6813","nonce":923697266}]},"public_addr":"172.21.15.22:6809/923697266","cluster_addr":"172.21.15.22:6811/923697266","heartbeat_back_addr":"172.21.15.22:6815/923697266","heartbeat_front_addr":"172.21.15.22:6813/923697266","state":["exists","up"]},{"osd":5,"uuid":"3b2f428c-8a5a-49be-9f43-a9f379a1c7e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6809","nonce":3137245658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6811","nonce":3137245658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6815","nonce":3137245658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6813","nonce":3137245658}]},"public_addr":"172.21.15.121:6809/3137245658","cluster_addr":"172.21.15.121:6811/3137245658","heartbeat_back_addr":"172.21.15.121:6815/3137245658","heartbeat_front_addr":"172.21.15.121:6813/3137245658","state":["exists","up"]},{"osd":6,"uuid":"5aecec68-ff7e-440c-bd39-cc35ab89cc91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6819","nonce":3376780798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6821","nonce":3376780798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6825","nonce":3376780798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6823","nonce":3376780798}]},"public_addr":"172.21.15.1:6819/3376780798","cluster_addr":"172.21.15.1:6821/3376780798","heartbeat_back_addr":"172.21.15.1:6825/3376780798","heartbeat_front_addr":"172.21.15.1:6823/3376780798","state":["exists","up"]},{"osd":7,"uuid":"46556bdf-199e-4268-873b-6d87b54e1176","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6817","nonce":2920985295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6819","nonce":2920985295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6823","nonce":2920985295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6821","nonce":2920985295}]},"public_addr":"172.21.15.22:6817/2920985295","cluster_addr":"172.21.15.22:6819/2920985295","heartbeat_back_addr":"172.21.15.22:6823/2920985295","heartbeat_front_addr":"172.21.15.22:6821/2920985295","state":["exists","up"]},{"osd":8,"uuid":"e7c3792a-94a4-4440-be74-d6abdf3d9566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6817","nonce":3589985967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6819","nonce":3589985967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6823","nonce":3589985967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6821","nonce":3589985967}]},"public_addr":"172.21.15.121:6817/3589985967","cluster_addr":"172.21.15.121:6819/3589985967","heartbeat_back_addr":"172.21.15.121:6823/3589985967","heartbeat_front_addr":"172.21.15.121:6821/3589985967","state":["exists","up"]},{"osd":9,"uuid":"8af80ac9-d681-4966-b083-ead5185eff12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6827","nonce":1143859822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6829","nonce":1143859822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6833","nonce":1143859822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6831","nonce":1143859822}]},"public_addr":"172.21.15.1:6827/1143859822","cluster_addr":"172.21.15.1:6829/1143859822","heartbeat_back_addr":"172.21.15.1:6833/1143859822","heartbeat_front_addr":"172.21.15.1:6831/1143859822","state":["exists","up"]},{"osd":10,"uuid":"34edd06a-7f60-4465-bfe1-0c646abd53f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6825","nonce":343155547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6827","nonce":343155547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6831","nonce":343155547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6829","nonce":343155547}]},"public_addr":"172.21.15.22:6825/343155547","cluster_addr":"172.21.15.22:6827/343155547","heartbeat_back_addr":"172.21.15.22:6831/343155547","heartbeat_front_addr":"172.21.15.22:6829/343155547","state":["exists","up"]},{"osd":11,"uuid":"5a831eb6-ad66-4ab6-a30a-b6299ce1f88d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6825","nonce":3202514460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6827","nonce":3202514460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6831","nonce":3202514460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6829","nonce":3202514460}]},"public_addr":"172.21.15.121:6825/3202514460","cluster_addr":"172.21.15.121:6827/3202514460","heartbeat_back_addr":"172.21.15.121:6831/3202514460","heartbeat_front_addr":"172.21.15.121:6829/3202514460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:30:37.582893+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:01.915252+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:26.783477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:53.407014+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:19.407005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:45.022320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:11.377986+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:36.818700+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:01.745428+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:27.928916+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:53.363906+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:19.037551+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6800/1028873727":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/3137949087":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/1951370933":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2008363642":"2024-09-20T09:28:50.074985+0000","172.21.15.1:0/3006931063":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2486161758":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6801/1296304385":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6801/1028873727":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2783823049":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6800/1296304385":"2024-09-20T09:28:50.074985+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:38:08.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.382+0000 7f4cb1ffb640 1 -- 172.21.15.1:0/2476699886 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4cb40a32c0 msgr2=0x7f4cb40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:08.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.382+0000 7f4cb1ffb640 1 --2- 172.21.15.1:0/2476699886 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4cb40a32c0 0x7f4cb40a5780 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc0fdce0 tx=0x7f4cc0005f90 comp rx=0 tx=0).stop 2024-09-19T09:38:08.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.382+0000 7f4cb1ffb640 1 -- 172.21.15.1:0/2476699886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ccc101de0 msgr2=0x7f4ccc198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:08.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.382+0000 7f4cb1ffb640 1 --2- 172.21.15.1:0/2476699886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ccc101de0 0x7f4ccc198450 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc006010 tx=0x7f4cbc0042f0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.382+0000 7f4cb1ffb640 1 -- 172.21.15.1:0/2476699886 shutdown_connections 2024-09-19T09:38:08.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.382+0000 7f4cb1ffb640 1 --2- 172.21.15.1:0/2476699886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ccc106f10 0x7f4ccc19cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.382+0000 7f4cb1ffb640 1 --2- 172.21.15.1:0/2476699886 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4cb40a32c0 0x7f4cb40a5780 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.382+0000 7f4cb1ffb640 1 --2- 172.21.15.1:0/2476699886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ccc102790 0x7f4ccc198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.382+0000 7f4cb1ffb640 1 --2- 172.21.15.1:0/2476699886 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4ccc101de0 0x7f4ccc198450 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:08.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.382+0000 7f4cb1ffb640 1 -- 172.21.15.1:0/2476699886 >> 172.21.15.1:0/2476699886 conn(0x7f4ccc0fd8c0 msgr2=0x7f4ccc0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:08.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.382+0000 7f4cb1ffb640 1 -- 172.21.15.1:0/2476699886 shutdown_connections 2024-09-19T09:38:08.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:08.382+0000 7f4cb1ffb640 1 -- 172.21.15.1:0/2476699886 wait complete. 2024-09-19T09:38:09.167 DEBUG:tasks.fwd_scrub:Yielding 2024-09-19T09:38:09.167 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-19T09:38:09.179 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi001.front.sepia.ceph.com 2024-09-19T09:38:09.179 DEBUG:teuthology.orchestra.run.smithi001:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-19T09:38:09.179 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-19T09:38:09.179 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:38:09.179 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:38:09.181 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-19T09:38:09.196 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T09:38:09.196 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:38:09.452 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:09.463 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:09.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:09 smithi001 ceph-mon[31225]: pgmap v340: 97 pgs: 97 active+clean; 645 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T09:38:09.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:09 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/2476699886' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:38:09.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:09 smithi022 ceph-mon[35583]: pgmap v340: 97 pgs: 97 active+clean; 645 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T09:38:09.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:09 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/2476699886' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:38:09.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:09 smithi121 ceph-mon[35577]: pgmap v340: 97 pgs: 97 active+clean; 645 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T09:38:09.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:09 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/2476699886' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:38:10.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.110+0000 7f997873e640 1 -- 172.21.15.1:0/4250082412 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9970101420 msgr2=0x7f997010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:10.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.110+0000 7f997873e640 1 --2- 172.21.15.1:0/4250082412 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9970101420 0x7f997010d950 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9968009930 tx=0x7f996802a420 comp rx=0 tx=0).stop 2024-09-19T09:38:10.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.110+0000 7f997873e640 1 -- 172.21.15.1:0/4250082412 shutdown_connections 2024-09-19T09:38:10.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.110+0000 7f997873e640 1 --2- 172.21.15.1:0/4250082412 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9970101420 0x7f997010d950 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.110+0000 7f997873e640 1 --2- 172.21.15.1:0/4250082412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9970100a80 0x7f9970100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.110+0000 7f997873e640 1 --2- 172.21.15.1:0/4250082412 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9970106a80 0x7f9970106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.110+0000 7f997873e640 1 -- 172.21.15.1:0/4250082412 >> 172.21.15.1:0/4250082412 conn(0x7f99700fc7a0 msgr2=0x7f99700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:10.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.110+0000 7f997873e640 1 -- 172.21.15.1:0/4250082412 shutdown_connections 2024-09-19T09:38:10.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.110+0000 7f997873e640 1 -- 172.21.15.1:0/4250082412 wait complete. 2024-09-19T09:38:10.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.111+0000 7f997873e640 1 Processor -- start 2024-09-19T09:38:10.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.111+0000 7f997873e640 1 -- start start 2024-09-19T09:38:10.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.111+0000 7f997873e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9970100a80 0x7f9970198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:10.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.111+0000 7f997873e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9970101420 0x7f99701989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:10.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.111+0000 7f997873e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9970106a80 0x7f997019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:10.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.111+0000 7f997873e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9970110e80 con 0x7f9970101420 2024-09-19T09:38:10.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.111+0000 7f997873e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9970110d00 con 0x7f9970106a80 2024-09-19T09:38:10.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.111+0000 7f997873e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9970111000 con 0x7f9970100a80 2024-09-19T09:38:10.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.111+0000 7f9975cd9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9970101420 0x7f99701989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:10.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.111+0000 7f9975cd9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9970101420 0x7f99701989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33684/0 (socket says 172.21.15.1:33684) 2024-09-19T09:38:10.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.111+0000 7f9975cd9640 1 -- 172.21.15.1:0/493623545 learned_addr learned my addr 172.21.15.1:0/493623545 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:10.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.111+0000 7f9976cdb640 1 --2- 172.21.15.1:0/493623545 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9970106a80 0x7f997019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:10.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.111+0000 7f99764da640 1 --2- 172.21.15.1:0/493623545 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9970100a80 0x7f9970198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:10.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.112+0000 7f9975cd9640 1 -- 172.21.15.1:0/493623545 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9970100a80 msgr2=0x7f9970198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:10.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.112+0000 7f9975cd9640 1 --2- 172.21.15.1:0/493623545 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9970100a80 0x7f9970198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.112+0000 7f9975cd9640 1 -- 172.21.15.1:0/493623545 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9970106a80 msgr2=0x7f997019cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:10.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.112+0000 7f9975cd9640 1 --2- 172.21.15.1:0/493623545 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9970106a80 0x7f997019cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.112+0000 7f9975cd9640 1 -- 172.21.15.1:0/493623545 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f997019d420 con 0x7f9970101420 2024-09-19T09:38:10.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.112+0000 7f9976cdb640 1 --2- 172.21.15.1:0/493623545 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9970106a80 0x7f997019cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:10.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.112+0000 7f9975cd9640 1 --2- 172.21.15.1:0/493623545 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9970101420 0x7f99701989b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f996400cce0 tx=0x7f996400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:10.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.112+0000 7f996f7fe640 1 -- 172.21.15.1:0/493623545 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9964004b20 con 0x7f9970101420 2024-09-19T09:38:10.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.112+0000 7f996f7fe640 1 -- 172.21.15.1:0/493623545 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9964004cc0 con 0x7f9970101420 2024-09-19T09:38:10.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.112+0000 7f996f7fe640 1 -- 172.21.15.1:0/493623545 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f996400f7d0 con 0x7f9970101420 2024-09-19T09:38:10.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.112+0000 7f997873e640 1 -- 172.21.15.1:0/493623545 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f997019d710 con 0x7f9970101420 2024-09-19T09:38:10.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.112+0000 7f997873e640 1 -- 172.21.15.1:0/493623545 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99701a4ff0 con 0x7f9970101420 2024-09-19T09:38:10.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.115+0000 7f996f7fe640 1 -- 172.21.15.1:0/493623545 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f996400f970 con 0x7f9970101420 2024-09-19T09:38:10.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.115+0000 7f997ab17740 1 Processor -- start 2024-09-19T09:38:10.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.115+0000 7f997ab17740 1 -- start start 2024-09-19T09:38:10.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.116+0000 7f997ab17740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b96fc72b60 0x55b96fc72f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:10.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.116+0000 7f997ab17740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b96fc73480 0x55b96fc7d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:10.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.116+0000 7f997ab17740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b96fc7dd40 0x55b96fc80130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:10.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.116+0000 7f997ab17740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b96fbd8280 con 0x55b96fc73480 2024-09-19T09:38:10.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.116+0000 7f997ab17740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b96fb7fb10 con 0x55b96fc7dd40 2024-09-19T09:38:10.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.116+0000 7f997ab17740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b96fbd4240 con 0x55b96fc72b60 2024-09-19T09:38:10.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.116+0000 7f99764da640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b96fc73480 0x55b96fc7d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:10.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.116+0000 7f99764da640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b96fc73480 0x55b96fc7d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33692/0 (socket says 172.21.15.1:33692) 2024-09-19T09:38:10.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.116+0000 7f99764da640 1 -- 172.21.15.1:0/647881884 learned_addr learned my addr 172.21.15.1:0/647881884 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:10.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.116+0000 7f9975cd9640 1 --2- 172.21.15.1:0/647881884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b96fc7dd40 0x55b96fc80130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:10.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.116+0000 7f9976cdb640 1 --2- 172.21.15.1:0/647881884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b96fc72b60 0x55b96fc72f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:10.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.116+0000 7f99764da640 1 -- 172.21.15.1:0/647881884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b96fc72b60 msgr2=0x55b96fc72f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:10.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.116+0000 7f99764da640 1 --2- 172.21.15.1:0/647881884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b96fc72b60 0x55b96fc72f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.116+0000 7f99764da640 1 -- 172.21.15.1:0/647881884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b96fc7dd40 msgr2=0x55b96fc80130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:10.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.116+0000 7f99764da640 1 --2- 172.21.15.1:0/647881884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b96fc7dd40 0x55b96fc80130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.116+0000 7f99764da640 1 -- 172.21.15.1:0/647881884 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b96fb8c1f0 con 0x55b96fc73480 2024-09-19T09:38:10.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.116+0000 7f9976cdb640 1 --2- 172.21.15.1:0/647881884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b96fc72b60 0x55b96fc72f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:10.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.116+0000 7f9975cd9640 1 --2- 172.21.15.1:0/647881884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b96fc7dd40 0x55b96fc80130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:10.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.116+0000 7f99764da640 1 --2- 172.21.15.1:0/647881884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b96fc73480 0x55b96fc7d800 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f996000cb80 tx=0x7f996000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7195ca09fbb141a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:10.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.116+0000 7f996f7fe640 1 --2- 172.21.15.1:0/493623545 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f99580a32c0 0x7f99580a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:10.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.117+0000 7f9976cdb640 1 --2- 172.21.15.1:0/493623545 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f99580a32c0 0x7f99580a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:10.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.117+0000 7f996cff9640 1 -- 172.21.15.1:0/647881884 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9960010630 con 0x55b96fc73480 2024-09-19T09:38:10.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.117+0000 7f996f7fe640 1 -- 172.21.15.1:0/493623545 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f99640cfa00 con 0x7f9970101420 2024-09-19T09:38:10.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.117+0000 7f996cff9640 1 -- 172.21.15.1:0/647881884 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9960010cb0 con 0x55b96fc73480 2024-09-19T09:38:10.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.117+0000 7f996cff9640 1 -- 172.21.15.1:0/647881884 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f996000fc50 con 0x55b96fc73480 2024-09-19T09:38:10.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.117+0000 7f997ab17740 1 -- 172.21.15.1:0/647881884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b96fc73480 msgr2=0x55b96fc7d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:10.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.117+0000 7f997ab17740 1 --2- 172.21.15.1:0/647881884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b96fc73480 0x55b96fc7d800 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f996000cb80 tx=0x7f996000e720 comp rx=0 tx=0).stop 2024-09-19T09:38:10.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.117+0000 7f9976cdb640 1 --2- 172.21.15.1:0/493623545 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f99580a32c0 0x7f99580a5780 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9968005940 tx=0x7f99680058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:10.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.118+0000 7f997ab17740 1 -- 172.21.15.1:0/647881884 shutdown_connections 2024-09-19T09:38:10.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.118+0000 7f997ab17740 1 --2- 172.21.15.1:0/647881884 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b96fc7dd40 0x55b96fc80130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.118+0000 7f997ab17740 1 --2- 172.21.15.1:0/647881884 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b96fc73480 0x55b96fc7d800 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.118+0000 7f997ab17740 1 --2- 172.21.15.1:0/647881884 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b96fc72b60 0x55b96fc72f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.118+0000 7f997ab17740 1 -- 172.21.15.1:0/647881884 >> 172.21.15.1:0/647881884 conn(0x55b96fc6f0f0 msgr2=0x55b96fc6f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:10.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.118+0000 7f997ab17740 1 -- 172.21.15.1:0/647881884 shutdown_connections 2024-09-19T09:38:10.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.118+0000 7f997ab17740 1 -- 172.21.15.1:0/647881884 wait complete. 2024-09-19T09:38:10.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.118+0000 7f997ab17740 1 -- start start 2024-09-19T09:38:10.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.118+0000 7f997ab17740 1 Processor -- start 2024-09-19T09:38:10.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.118+0000 7f997ab17740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b96fc72b60 0x55b96fc7ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:10.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.118+0000 7f997ab17740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b96fc73480 0x55b96fc7b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:10.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.118+0000 7f997ab17740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b96fc7dd40 0x55b96fc7b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:10.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.118+0000 7f997ab17740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b96fc80910 con 0x55b96fc72b60 2024-09-19T09:38:10.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.118+0000 7f997ab17740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b96fb92f10 con 0x55b96fc7dd40 2024-09-19T09:38:10.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.118+0000 7f997ab17740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b96fc80a90 con 0x55b96fc73480 2024-09-19T09:38:10.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.119+0000 7f997ab17740 10 client.0 _ll_register_callbacks cb 0x55b96fb5ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:10.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.119+0000 7f99764da640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b96fc72b60 0x55b96fc7ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:10.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.119+0000 7f99764da640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b96fc72b60 0x55b96fc7ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33694/0 (socket says 172.21.15.1:33694) 2024-09-19T09:38:10.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.119+0000 7f99764da640 1 -- 172.21.15.1:0/1892525714 learned_addr learned my addr 172.21.15.1:0/1892525714 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:10.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.119+0000 7f99764da640 1 -- 172.21.15.1:0/1892525714 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b96fc73480 msgr2=0x55b96fc7b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:10.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.119+0000 7f9975cd9640 1 --2- 172.21.15.1:0/1892525714 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b96fc73480 0x55b96fc7b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:10.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.119+0000 7f99764da640 1 --2- 172.21.15.1:0/1892525714 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b96fc73480 0x55b96fc7b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.119+0000 7f99764da640 1 -- 172.21.15.1:0/1892525714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b96fc7dd40 msgr2=0x55b96fc7b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:10.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.119+0000 7f99764da640 1 --2- 172.21.15.1:0/1892525714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b96fc7dd40 0x55b96fc7b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.119+0000 7f99764da640 1 -- 172.21.15.1:0/1892525714 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b96f9496a0 con 0x55b96fc72b60 2024-09-19T09:38:10.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.119+0000 7f99764da640 1 --2- 172.21.15.1:0/1892525714 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b96fc72b60 0x55b96fc7ac40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f996000ffc0 tx=0x7f996000ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4034b79b8970bb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:10.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.119+0000 7f9955ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:38:10.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.119+0000 7f9955ffb640 1 -- 172.21.15.1:0/1892525714 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9960028060 con 0x55b96fc72b60 2024-09-19T09:38:10.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.119+0000 7f9955ffb640 1 -- 172.21.15.1:0/1892525714 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f9960010430 con 0x55b96fc72b60 2024-09-19T09:38:10.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.119+0000 7f997ab17740 1 -- 172.21.15.1:0/1892525714 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9960010cb0 con 0x55b96fc72b60 2024-09-19T09:38:10.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.120+0000 7f9955ffb640 1 -- 172.21.15.1:0/1892525714 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9960010e60 con 0x55b96fc72b60 2024-09-19T09:38:10.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.120+0000 7f997ab17740 10 client.15138 fetch_fsmap learned FSMap version 19 2024-09-19T09:38:10.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.120+0000 7f997ab17740 1 -- 172.21.15.1:0/1892525714 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55b96fc8c540 con 0x55b96fc72b60 2024-09-19T09:38:10.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.120+0000 7f9955ffb640 1 -- 172.21.15.1:0/1892525714 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9960010cb0 con 0x55b96fc72b60 2024-09-19T09:38:10.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.120+0000 7f9955ffb640 1 -- 172.21.15.1:0/1892525714 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f996002d070 con 0x55b96fc72b60 2024-09-19T09:38:10.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.120+0000 7f997ab17740 10 client.15138 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:38:10.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.120+0000 7f997ab17740 10 client.15138 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:38:10.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.120+0000 7f997ab17740 20 client.15138 populate_metadata read hostname 'smithi001' 2024-09-19T09:38:10.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.120+0000 7f997ab17740 1 --2- 172.21.15.1:0/1892525714 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b96fc8d890 0x55b96fc8fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:10.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.120+0000 7f997ab17740 4 client.15138 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:38:10.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.120+0000 7f997ab17740 1 -- 172.21.15.1:0/1892525714 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b96fbe57f0 con 0x55b96fc8d890 2024-09-19T09:38:10.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.120+0000 7f9975cd9640 1 --2- 172.21.15.1:0/1892525714 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b96fc8d890 0x55b96fc8fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:10.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.121+0000 7f9975cd9640 1 --2- 172.21.15.1:0/1892525714 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b96fc8d890 0x55b96fc8fc80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e9f21654816f8e7 server_cookie=901e544a2de89ac3 in_seq=0 out_seq=0 2024-09-19T09:38:10.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.121+0000 7f9955ffb640 10 client.15138 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:10.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.121+0000 7f9955ffb640 1 -- 172.21.15.1:0/1892525714 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b96fbe57f0 con 0x55b96fc8d890 2024-09-19T09:38:10.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.121+0000 7f9955ffb640 10 client.15138 handle_command_reply: tid=0 2024-09-19T09:38:10.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.121+0000 7f997ab17740 1 client.15138 shutdown 2024-09-19T09:38:10.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.122+0000 7f997ab17740 1 -- 172.21.15.1:0/1892525714 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b96fc72b60 msgr2=0x55b96fc7ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:10.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.122+0000 7f997ab17740 1 --2- 172.21.15.1:0/1892525714 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b96fc72b60 0x55b96fc7ac40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f996000ffc0 tx=0x7f996000ce80 comp rx=0 tx=0).stop 2024-09-19T09:38:10.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.122+0000 7f997ab17740 1 -- 172.21.15.1:0/1892525714 shutdown_connections 2024-09-19T09:38:10.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.122+0000 7f997ab17740 1 --2- 172.21.15.1:0/1892525714 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b96fc8d890 0x55b96fc8fc80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.122+0000 7f997ab17740 1 --2- 172.21.15.1:0/1892525714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b96fc7dd40 0x55b96fc7b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.122+0000 7f997ab17740 1 --2- 172.21.15.1:0/1892525714 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b96fc73480 0x55b96fc7b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.122+0000 7f997ab17740 1 --2- 172.21.15.1:0/1892525714 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b96fc72b60 0x55b96fc7ac40 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.122+0000 7f997ab17740 1 -- 172.21.15.1:0/1892525714 >> 172.21.15.1:0/1892525714 conn(0x55b96fc6f0f0 msgr2=0x55b96fc74dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:10.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.122+0000 7f9955ffb640 0 client.15138 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:10.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.122+0000 7f997ab17740 1 -- 172.21.15.1:0/1892525714 shutdown_connections 2024-09-19T09:38:10.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.122+0000 7f997ab17740 1 -- 172.21.15.1:0/1892525714 wait complete. 2024-09-19T09:38:10.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.122+0000 7f997ab17740 20 client.15138 trim_cache size 0 max 16384 2024-09-19T09:38:10.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.139+0000 7f997ab17740 1 Processor -- start 2024-09-19T09:38:10.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.139+0000 7f997ab17740 1 -- start start 2024-09-19T09:38:10.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.139+0000 7f997ab17740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b96fc72b60 0x55b96fc6e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:10.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.139+0000 7f997ab17740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b96fc73480 0x55b96fc952b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:10.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.139+0000 7f997ab17740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b96fc7dd40 0x55b96fc957f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:10.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.139+0000 7f997ab17740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f99701ab680 con 0x55b96fc73480 2024-09-19T09:38:10.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.139+0000 7f997ab17740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f99701adf20 con 0x55b96fc72b60 2024-09-19T09:38:10.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.139+0000 7f997ab17740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f99701abd10 con 0x55b96fc7dd40 2024-09-19T09:38:10.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.140+0000 7f9975cd9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b96fc73480 0x55b96fc952b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:10.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.140+0000 7f9975cd9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b96fc73480 0x55b96fc952b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33708/0 (socket says 172.21.15.1:33708) 2024-09-19T09:38:10.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.140+0000 7f9975cd9640 1 -- 172.21.15.1:0/2815095081 learned_addr learned my addr 172.21.15.1:0/2815095081 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:10.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.140+0000 7f99764da640 1 --2- 172.21.15.1:0/2815095081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b96fc72b60 0x55b96fc6e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:10.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.140+0000 7f9975cd9640 1 -- 172.21.15.1:0/2815095081 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b96fc7dd40 msgr2=0x55b96fc957f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:10.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.140+0000 7f9976cdb640 1 --2- 172.21.15.1:0/2815095081 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b96fc7dd40 0x55b96fc957f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:10.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.140+0000 7f9975cd9640 1 --2- 172.21.15.1:0/2815095081 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b96fc7dd40 0x55b96fc957f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.140+0000 7f9975cd9640 1 -- 172.21.15.1:0/2815095081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b96fc72b60 msgr2=0x55b96fc6e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:10.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.140+0000 7f9975cd9640 1 --2- 172.21.15.1:0/2815095081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b96fc72b60 0x55b96fc6e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.140+0000 7f9975cd9640 1 -- 172.21.15.1:0/2815095081 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b96fc807f0 con 0x55b96fc73480 2024-09-19T09:38:10.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.140+0000 7f9976cdb640 1 --2- 172.21.15.1:0/2815095081 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b96fc7dd40 0x55b96fc957f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:10.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.140+0000 7f9975cd9640 1 --2- 172.21.15.1:0/2815095081 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b96fc73480 0x55b96fc952b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9964000f80 tx=0x7f99640bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5db66c5b7057ce8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:10.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.140+0000 7f9957fff640 1 -- 172.21.15.1:0/2815095081 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f996401d040 con 0x55b96fc73480 2024-09-19T09:38:10.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.140+0000 7f9957fff640 1 -- 172.21.15.1:0/2815095081 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f996409c720 con 0x55b96fc73480 2024-09-19T09:38:10.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.140+0000 7f9957fff640 1 -- 172.21.15.1:0/2815095081 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99640cd610 con 0x55b96fc73480 2024-09-19T09:38:10.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.141+0000 7f997ab17740 1 -- 172.21.15.1:0/2815095081 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b96fc73480 msgr2=0x55b96fc952b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:10.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.141+0000 7f997ab17740 1 --2- 172.21.15.1:0/2815095081 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b96fc73480 0x55b96fc952b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9964000f80 tx=0x7f99640bc040 comp rx=0 tx=0).stop 2024-09-19T09:38:10.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.141+0000 7f997ab17740 1 -- 172.21.15.1:0/2815095081 shutdown_connections 2024-09-19T09:38:10.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.141+0000 7f997ab17740 1 --2- 172.21.15.1:0/2815095081 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b96fc7dd40 0x55b96fc957f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.141+0000 7f997ab17740 1 --2- 172.21.15.1:0/2815095081 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b96fc73480 0x55b96fc952b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.141+0000 7f997ab17740 1 --2- 172.21.15.1:0/2815095081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b96fc72b60 0x55b96fc6e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.141+0000 7f997ab17740 1 -- 172.21.15.1:0/2815095081 >> 172.21.15.1:0/2815095081 conn(0x55b96fc6f0f0 msgr2=0x55b96fc6da50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:10.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.141+0000 7f997ab17740 1 -- 172.21.15.1:0/2815095081 shutdown_connections 2024-09-19T09:38:10.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.141+0000 7f997ab17740 1 -- 172.21.15.1:0/2815095081 wait complete. 2024-09-19T09:38:10.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.141+0000 7f997ab17740 1 -- start start 2024-09-19T09:38:10.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.141+0000 7f997ab17740 1 Processor -- start 2024-09-19T09:38:10.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.142+0000 7f997ab17740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b96fc72b60 0x55b96fc86370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:10.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.142+0000 7f997ab17740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b96fc73480 0x55b96fc816a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:10.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.142+0000 7f997ab17740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b96fc7dd40 0x55b96fc81be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:10.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.142+0000 7f997ab17740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f99701ac3e0 con 0x55b96fc7dd40 2024-09-19T09:38:10.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.142+0000 7f997ab17740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f99701ad850 con 0x55b96fc72b60 2024-09-19T09:38:10.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.142+0000 7f997ab17740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f99701acab0 con 0x55b96fc73480 2024-09-19T09:38:10.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.142+0000 7f997ab17740 10 client.0 _ll_register_callbacks cb 0x7f9960014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:10.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.142+0000 7f99764da640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b96fc72b60 0x55b96fc86370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:10.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.142+0000 7f99764da640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b96fc72b60 0x55b96fc86370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:37854/0 (socket says 172.21.15.1:37854) 2024-09-19T09:38:10.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.142+0000 7f9975cd9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b96fc73480 0x55b96fc816a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:10.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.142+0000 7f99764da640 1 -- 172.21.15.1:0/2957084168 learned_addr learned my addr 172.21.15.1:0/2957084168 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:10.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.142+0000 7f9976cdb640 1 --2- 172.21.15.1:0/2957084168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b96fc7dd40 0x55b96fc81be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:10.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.142+0000 7f99764da640 1 -- 172.21.15.1:0/2957084168 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b96fc73480 msgr2=0x55b96fc816a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:10.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.142+0000 7f99764da640 1 --2- 172.21.15.1:0/2957084168 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b96fc73480 0x55b96fc816a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.142+0000 7f99764da640 1 -- 172.21.15.1:0/2957084168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b96fc7dd40 msgr2=0x55b96fc81be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:10.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.142+0000 7f99764da640 1 --2- 172.21.15.1:0/2957084168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b96fc7dd40 0x55b96fc81be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.142+0000 7f99764da640 1 -- 172.21.15.1:0/2957084168 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b96fc823c0 con 0x55b96fc72b60 2024-09-19T09:38:10.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.142+0000 7f9975cd9640 1 --2- 172.21.15.1:0/2957084168 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b96fc73480 0x55b96fc816a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:38:10.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.142+0000 7f99764da640 1 --2- 172.21.15.1:0/2957084168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b96fc72b60 0x55b96fc86370 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9960000c00 tx=0x7f99600052f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8af37aafc22b9f4d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:10.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.142+0000 7f9955ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:38:10.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.143+0000 7f9955ffb640 1 -- 172.21.15.1:0/2957084168 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9960033070 con 0x55b96fc72b60 2024-09-19T09:38:10.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.143+0000 7f997ab17740 1 -- 172.21.15.1:0/2957084168 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f996409c720 con 0x55b96fc72b60 2024-09-19T09:38:10.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.143+0000 7f9955ffb640 1 -- 172.21.15.1:0/2957084168 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f9960004660 con 0x55b96fc72b60 2024-09-19T09:38:10.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.143+0000 7f9955ffb640 1 -- 172.21.15.1:0/2957084168 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f996003f050 con 0x55b96fc72b60 2024-09-19T09:38:10.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.143+0000 7f997ab17740 10 client.24878 fetch_fsmap learned FSMap version 19 2024-09-19T09:38:10.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.143+0000 7f997ab17740 1 -- 172.21.15.1:0/2957084168 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55b96fcf8180 con 0x55b96fc72b60 2024-09-19T09:38:10.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.143+0000 7f9955ffb640 1 -- 172.21.15.1:0/2957084168 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f996409c720 con 0x55b96fc72b60 2024-09-19T09:38:10.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.143+0000 7f9955ffb640 1 -- 172.21.15.1:0/2957084168 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f996002d040 con 0x55b96fc72b60 2024-09-19T09:38:10.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.143+0000 7f997ab17740 10 client.24878 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:38:10.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.143+0000 7f997ab17740 10 client.24878 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:38:10.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.143+0000 7f997ab17740 20 client.24878 populate_metadata read hostname 'smithi001' 2024-09-19T09:38:10.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.143+0000 7f997ab17740 1 --2- 172.21.15.1:0/2957084168 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b96fcf87e0 0x55b96fcfabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:10.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.143+0000 7f997ab17740 4 client.24878 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:38:10.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.143+0000 7f997ab17740 1 -- 172.21.15.1:0/2957084168 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b96fbdfd00 con 0x55b96fcf87e0 2024-09-19T09:38:10.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.143+0000 7f9975cd9640 1 --2- 172.21.15.1:0/2957084168 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b96fcf87e0 0x55b96fcfabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:10.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.144+0000 7f9975cd9640 1 --2- 172.21.15.1:0/2957084168 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b96fcf87e0 0x55b96fcfabd0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bff9c4a84dd7e451 server_cookie=caa594dfcf0ec775 in_seq=0 out_seq=0 2024-09-19T09:38:10.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.144+0000 7f9955ffb640 10 client.24878 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:10.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.145+0000 7f9955ffb640 1 -- 172.21.15.1:0/2957084168 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b96fbdfd00 con 0x55b96fcf87e0 2024-09-19T09:38:10.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.145+0000 7f9955ffb640 10 client.24878 handle_command_reply: tid=0 2024-09-19T09:38:10.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.145+0000 7f997ab17740 1 client.24878 shutdown 2024-09-19T09:38:10.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.145+0000 7f997ab17740 1 -- 172.21.15.1:0/2957084168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b96fc72b60 msgr2=0x55b96fc86370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:10.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.145+0000 7f997ab17740 1 --2- 172.21.15.1:0/2957084168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b96fc72b60 0x55b96fc86370 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9960000c00 tx=0x7f99600052f0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.145+0000 7f997ab17740 1 -- 172.21.15.1:0/2957084168 shutdown_connections 2024-09-19T09:38:10.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.145+0000 7f997ab17740 1 --2- 172.21.15.1:0/2957084168 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b96fcf87e0 0x55b96fcfabd0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.145+0000 7f9955ffb640 0 client.24878 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:10.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.145+0000 7f997ab17740 1 --2- 172.21.15.1:0/2957084168 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b96fc7dd40 0x55b96fc81be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.145+0000 7f997ab17740 1 --2- 172.21.15.1:0/2957084168 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b96fc73480 0x55b96fc816a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.145+0000 7f997ab17740 1 --2- 172.21.15.1:0/2957084168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b96fc72b60 0x55b96fc86370 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.145+0000 7f997ab17740 1 -- 172.21.15.1:0/2957084168 >> 172.21.15.1:0/2957084168 conn(0x55b96fc6f0f0 msgr2=0x55b96fc6e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:10.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.145+0000 7f997ab17740 1 -- 172.21.15.1:0/2957084168 shutdown_connections 2024-09-19T09:38:10.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.145+0000 7f997ab17740 1 -- 172.21.15.1:0/2957084168 wait complete. 2024-09-19T09:38:10.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.145+0000 7f997ab17740 20 client.24878 trim_cache size 0 max 16384 2024-09-19T09:38:10.153 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:38:10.153 INFO:teuthology.orchestra.run.smithi001.stdout: "return_code": 0, 2024-09-19T09:38:10.153 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_tag": "827df52d-23c2-4460-9e49-bb383ee25192", 2024-09-19T09:38:10.153 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": "asynchronous" 2024-09-19T09:38:10.153 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:38:10.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.146+0000 7f997873e640 1 -- 172.21.15.1:0/493623545 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f99580a32c0 msgr2=0x7f99580a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:10.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.146+0000 7f997873e640 1 --2- 172.21.15.1:0/493623545 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f99580a32c0 0x7f99580a5780 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9968005940 tx=0x7f99680058d0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.146+0000 7f997873e640 1 -- 172.21.15.1:0/493623545 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9970101420 msgr2=0x7f99701989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:10.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.146+0000 7f997873e640 1 --2- 172.21.15.1:0/493623545 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9970101420 0x7f99701989b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f996400cce0 tx=0x7f996400a620 comp rx=0 tx=0).stop 2024-09-19T09:38:10.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.146+0000 7f997873e640 1 -- 172.21.15.1:0/493623545 shutdown_connections 2024-09-19T09:38:10.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.146+0000 7f997873e640 1 --2- 172.21.15.1:0/493623545 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f99580a32c0 0x7f99580a5780 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.146+0000 7f997873e640 1 --2- 172.21.15.1:0/493623545 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9970106a80 0x7f997019cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.146+0000 7f997873e640 1 --2- 172.21.15.1:0/493623545 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9970101420 0x7f99701989b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.146+0000 7f997873e640 1 --2- 172.21.15.1:0/493623545 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9970100a80 0x7f9970198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.146+0000 7f997873e640 1 -- 172.21.15.1:0/493623545 >> 172.21.15.1:0/493623545 conn(0x7f99700fc7a0 msgr2=0x7f997006a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:10.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.146+0000 7f997873e640 1 -- 172.21.15.1:0/493623545 shutdown_connections 2024-09-19T09:38:10.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.146+0000 7f997873e640 1 -- 172.21.15.1:0/493623545 wait complete. 2024-09-19T09:38:10.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.334+0000 7f65de3e9640 1 -- 172.21.15.1:0/3164577782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65d8101380 msgr2=0x7f65d810dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:10.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.334+0000 7f65de3e9640 1 --2- 172.21.15.1:0/3164577782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65d8101380 0x7f65d810dfb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f65cc009900 tx=0x7f65cc02a410 comp rx=0 tx=0).stop 2024-09-19T09:38:10.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.334+0000 7f65de3e9640 1 -- 172.21.15.1:0/3164577782 shutdown_connections 2024-09-19T09:38:10.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.334+0000 7f65de3e9640 1 --2- 172.21.15.1:0/3164577782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65d810e4f0 0x7f65d8110900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.334+0000 7f65de3e9640 1 --2- 172.21.15.1:0/3164577782 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65d8101380 0x7f65d810dfb0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.334+0000 7f65de3e9640 1 --2- 172.21.15.1:0/3164577782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65d81009d0 0x7f65d8100db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.334+0000 7f65de3e9640 1 -- 172.21.15.1:0/3164577782 >> 172.21.15.1:0/3164577782 conn(0x7f65d80fc7d0 msgr2=0x7f65d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:10.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.334+0000 7f65de3e9640 1 -- 172.21.15.1:0/3164577782 shutdown_connections 2024-09-19T09:38:10.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.334+0000 7f65de3e9640 1 -- 172.21.15.1:0/3164577782 wait complete. 2024-09-19T09:38:10.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.334+0000 7f65de3e9640 1 Processor -- start 2024-09-19T09:38:10.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.334+0000 7f65de3e9640 1 -- start start 2024-09-19T09:38:10.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.335+0000 7f65de3e9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65d81009d0 0x7f65d81a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:10.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.335+0000 7f65de3e9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65d8101380 0x7f65d81a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:10.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.335+0000 7f65de3e9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65d810e4f0 0x7f65d819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:10.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.335+0000 7f65de3e9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f65d8114260 con 0x7f65d810e4f0 2024-09-19T09:38:10.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.335+0000 7f65de3e9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f65d81140e0 con 0x7f65d8101380 2024-09-19T09:38:10.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.335+0000 7f65de3e9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f65d81143e0 con 0x7f65d81009d0 2024-09-19T09:38:10.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.335+0000 7f65dc986640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65d810e4f0 0x7f65d819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:10.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.335+0000 7f65dc986640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65d810e4f0 0x7f65d819a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33746/0 (socket says 172.21.15.1:33746) 2024-09-19T09:38:10.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.335+0000 7f65dc986640 1 -- 172.21.15.1:0/1196003091 learned_addr learned my addr 172.21.15.1:0/1196003091 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:10.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.335+0000 7f65d7fff640 1 --2- 172.21.15.1:0/1196003091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65d81009d0 0x7f65d81a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:10.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.335+0000 7f65d77fe640 1 --2- 172.21.15.1:0/1196003091 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65d8101380 0x7f65d81a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:10.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.335+0000 7f65dc986640 1 -- 172.21.15.1:0/1196003091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65d81009d0 msgr2=0x7f65d81a03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:10.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.335+0000 7f65dc986640 1 --2- 172.21.15.1:0/1196003091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65d81009d0 0x7f65d81a03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.335+0000 7f65dc986640 1 -- 172.21.15.1:0/1196003091 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65d8101380 msgr2=0x7f65d81a0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:10.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.335+0000 7f65dc986640 1 --2- 172.21.15.1:0/1196003091 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65d8101380 0x7f65d81a0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.335+0000 7f65dc986640 1 -- 172.21.15.1:0/1196003091 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d819acc0 con 0x7f65d810e4f0 2024-09-19T09:38:10.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.335+0000 7f65d77fe640 1 --2- 172.21.15.1:0/1196003091 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65d8101380 0x7f65d81a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:10.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.336+0000 7f65dc986640 1 --2- 172.21.15.1:0/1196003091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65d810e4f0 0x7f65d819a590 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f65d000dac0 tx=0x7f65d000df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:10.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.336+0000 7f65d57fa640 1 -- 172.21.15.1:0/1196003091 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d0017070 con 0x7f65d810e4f0 2024-09-19T09:38:10.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.336+0000 7f65d57fa640 1 -- 172.21.15.1:0/1196003091 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65d0003e50 con 0x7f65d810e4f0 2024-09-19T09:38:10.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.336+0000 7f65de3e9640 1 -- 172.21.15.1:0/1196003091 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65d819afb0 con 0x7f65d810e4f0 2024-09-19T09:38:10.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.336+0000 7f65d57fa640 1 -- 172.21.15.1:0/1196003091 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d00106c0 con 0x7f65d810e4f0 2024-09-19T09:38:10.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.336+0000 7f65de3e9640 1 -- 172.21.15.1:0/1196003091 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65d81a72a0 con 0x7f65d810e4f0 2024-09-19T09:38:10.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.337+0000 7f65de3e9640 1 -- 172.21.15.1:0/1196003091 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65d806a7d0 con 0x7f65d810e4f0 2024-09-19T09:38:10.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.338+0000 7f65d57fa640 1 -- 172.21.15.1:0/1196003091 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f65d0003970 con 0x7f65d810e4f0 2024-09-19T09:38:10.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.339+0000 7f65d57fa640 1 --2- 172.21.15.1:0/1196003091 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f65c00a3240 0x7f65c00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:10.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.339+0000 7f65d7fff640 1 --2- 172.21.15.1:0/1196003091 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f65c00a3240 0x7f65c00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:10.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.339+0000 7f65d57fa640 1 -- 172.21.15.1:0/1196003091 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f65d00cf270 con 0x7f65d810e4f0 2024-09-19T09:38:10.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.339+0000 7f65d7fff640 1 --2- 172.21.15.1:0/1196003091 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f65c00a3240 0x7f65c00a5700 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f65c80058c0 tx=0x7f65c800a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:10.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.343+0000 7f65d57fa640 1 -- 172.21.15.1:0/1196003091 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f65d009bf90 con 0x7f65d810e4f0 2024-09-19T09:38:10.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.517+0000 7f65de3e9640 1 -- 172.21.15.1:0/1196003091 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f65d8062630 con 0x7f65c00a3240 2024-09-19T09:38:10.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.523+0000 7f65d57fa640 1 -- 172.21.15.1:0/1196003091 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259004 (secure 0 0 0) 0x7f65d8062630 con 0x7f65c00a3240 2024-09-19T09:38:10.527 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:38:10.528 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-19T09:38:10.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.527+0000 7f65de3e9640 1 -- 172.21.15.1:0/1196003091 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f65c00a3240 msgr2=0x7f65c00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:10.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.527+0000 7f65de3e9640 1 --2- 172.21.15.1:0/1196003091 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f65c00a3240 0x7f65c00a5700 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f65c80058c0 tx=0x7f65c800a250 comp rx=0 tx=0).stop 2024-09-19T09:38:10.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.527+0000 7f65de3e9640 1 -- 172.21.15.1:0/1196003091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65d810e4f0 msgr2=0x7f65d819a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:10.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.527+0000 7f65de3e9640 1 --2- 172.21.15.1:0/1196003091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65d810e4f0 0x7f65d819a590 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f65d000dac0 tx=0x7f65d000df80 comp rx=0 tx=0).stop 2024-09-19T09:38:10.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.527+0000 7f65de3e9640 1 -- 172.21.15.1:0/1196003091 shutdown_connections 2024-09-19T09:38:10.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.527+0000 7f65de3e9640 1 --2- 172.21.15.1:0/1196003091 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f65d810e4f0 0x7f65d819a590 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.527+0000 7f65de3e9640 1 --2- 172.21.15.1:0/1196003091 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f65c00a3240 0x7f65c00a5700 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.527+0000 7f65de3e9640 1 --2- 172.21.15.1:0/1196003091 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65d8101380 0x7f65d81a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.527+0000 7f65de3e9640 1 --2- 172.21.15.1:0/1196003091 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f65d81009d0 0x7f65d81a03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:10.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.527+0000 7f65de3e9640 1 -- 172.21.15.1:0/1196003091 >> 172.21.15.1:0/1196003091 conn(0x7f65d80fc7d0 msgr2=0x7f65d80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:10.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.527+0000 7f65de3e9640 1 -- 172.21.15.1:0/1196003091 shutdown_connections 2024-09-19T09:38:10.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:10.527+0000 7f65de3e9640 1 -- 172.21.15.1:0/1196003091 wait complete. 2024-09-19T09:38:11.268 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:38:11.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:11 smithi001 ceph-mon[31225]: scrub queued for path: / 2024-09-19T09:38:11.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:11 smithi001 ceph-mon[31225]: scrub summary: idle+waiting paths [/] 2024-09-19T09:38:11.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:11 smithi001 ceph-mon[31225]: scrub summary: active paths [/] 2024-09-19T09:38:11.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:11 smithi001 ceph-mon[31225]: scrub summary: idle+waiting paths [/] 2024-09-19T09:38:11.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:11 smithi001 ceph-mon[31225]: pgmap v341: 97 pgs: 97 active+clean; 645 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T09:38:11.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:11 smithi001 ceph-mon[31225]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:38:11.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:11 smithi022 ceph-mon[35583]: scrub queued for path: / 2024-09-19T09:38:11.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:11 smithi022 ceph-mon[35583]: scrub summary: idle+waiting paths [/] 2024-09-19T09:38:11.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:11 smithi022 ceph-mon[35583]: scrub summary: active paths [/] 2024-09-19T09:38:11.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:11 smithi022 ceph-mon[35583]: scrub summary: idle+waiting paths [/] 2024-09-19T09:38:11.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:11 smithi022 ceph-mon[35583]: pgmap v341: 97 pgs: 97 active+clean; 645 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T09:38:11.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:11 smithi022 ceph-mon[35583]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:38:11.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:11 smithi121 ceph-mon[35577]: scrub queued for path: / 2024-09-19T09:38:11.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:11 smithi121 ceph-mon[35577]: scrub summary: idle+waiting paths [/] 2024-09-19T09:38:11.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:11 smithi121 ceph-mon[35577]: scrub summary: active paths [/] 2024-09-19T09:38:11.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:11 smithi121 ceph-mon[35577]: scrub summary: idle+waiting paths [/] 2024-09-19T09:38:11.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:11 smithi121 ceph-mon[35577]: pgmap v341: 97 pgs: 97 active+clean; 645 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T09:38:11.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:11 smithi121 ceph-mon[35577]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:38:12.060 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":341,"stamp":"2024-09-19T09:38:10.158553+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660149,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":352,"num_read_kb":292,"num_write":277,"num_write_kb":3039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":716,"ondisk_log_size":716,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":405976,"kb_used_data":10968,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124535848,"statfs":{"total":1151940427776,"available":1151524708352,"internally_reserved":0,"allocated":11231232,"data_stored":7273647,"data_compressed":178359,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19141,"internal_metadata":404272443},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5681,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":17,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002746"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147034+0000","last_change":"2024-09-19T09:36:12.985228+0000","last_active":"2024-09-19T09:37:44.147034+0000","last_peered":"2024-09-19T09:37:44.147034+0000","last_clean":"2024-09-19T09:37:44.147034+0000","last_became_active":"2024-09-19T09:36:12.984306+0000","last_became_peered":"2024-09-19T09:36:12.984306+0000","last_unstale":"2024-09-19T09:37:44.147034+0000","last_undegraded":"2024-09-19T09:37:44.147034+0000","last_fullsized":"2024-09-19T09:37:44.147034+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:45.988859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145651+0000","last_change":"2024-09-19T09:36:12.987631+0000","last_active":"2024-09-19T09:37:44.145651+0000","last_peered":"2024-09-19T09:37:44.145651+0000","last_clean":"2024-09-19T09:37:44.145651+0000","last_became_active":"2024-09-19T09:36:12.987298+0000","last_became_peered":"2024-09-19T09:36:12.987298+0000","last_unstale":"2024-09-19T09:37:44.145651+0000","last_undegraded":"2024-09-19T09:37:44.145651+0000","last_fullsized":"2024-09-19T09:37:44.145651+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:47.397162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.161196+0000","last_change":"2024-09-19T09:36:12.991466+0000","last_active":"2024-09-19T09:37:44.161196+0000","last_peered":"2024-09-19T09:37:44.161196+0000","last_clean":"2024-09-19T09:37:44.161196+0000","last_became_active":"2024-09-19T09:36:12.990903+0000","last_became_peered":"2024-09-19T09:36:12.990903+0000","last_unstale":"2024-09-19T09:37:44.161196+0000","last_undegraded":"2024-09-19T09:37:44.161196+0000","last_fullsized":"2024-09-19T09:37:44.161196+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:04.128768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.150215+0000","last_change":"2024-09-19T09:36:12.986686+0000","last_active":"2024-09-19T09:37:44.150215+0000","last_peered":"2024-09-19T09:37:44.150215+0000","last_clean":"2024-09-19T09:37:44.150215+0000","last_became_active":"2024-09-19T09:36:12.986334+0000","last_became_peered":"2024-09-19T09:36:12.986334+0000","last_unstale":"2024-09-19T09:37:44.150215+0000","last_undegraded":"2024-09-19T09:37:44.150215+0000","last_fullsized":"2024-09-19T09:37:44.150215+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:39.926343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.139116+0000","last_change":"2024-09-19T09:36:12.981964+0000","last_active":"2024-09-19T09:37:44.139116+0000","last_peered":"2024-09-19T09:37:44.139116+0000","last_clean":"2024-09-19T09:37:44.139116+0000","last_became_active":"2024-09-19T09:36:12.981558+0000","last_became_peered":"2024-09-19T09:36:12.981558+0000","last_unstale":"2024-09-19T09:37:44.139116+0000","last_undegraded":"2024-09-19T09:37:44.139116+0000","last_fullsized":"2024-09-19T09:37:44.139116+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:33.706451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146524+0000","last_change":"2024-09-19T09:36:12.992598+0000","last_active":"2024-09-19T09:37:44.146524+0000","last_peered":"2024-09-19T09:37:44.146524+0000","last_clean":"2024-09-19T09:37:44.146524+0000","last_became_active":"2024-09-19T09:36:12.992281+0000","last_became_peered":"2024-09-19T09:36:12.992281+0000","last_unstale":"2024-09-19T09:37:44.146524+0000","last_undegraded":"2024-09-19T09:37:44.146524+0000","last_fullsized":"2024-09-19T09:37:44.146524+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:26.107432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146663+0000","last_change":"2024-09-19T09:36:12.988583+0000","last_active":"2024-09-19T09:37:44.146663+0000","last_peered":"2024-09-19T09:37:44.146663+0000","last_clean":"2024-09-19T09:37:44.146663+0000","last_became_active":"2024-09-19T09:36:12.987895+0000","last_became_peered":"2024-09-19T09:36:12.987895+0000","last_unstale":"2024-09-19T09:37:44.146663+0000","last_undegraded":"2024-09-19T09:37:44.146663+0000","last_fullsized":"2024-09-19T09:37:44.146663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:47.617324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.141930+0000","last_change":"2024-09-19T09:36:12.988526+0000","last_active":"2024-09-19T09:37:44.141930+0000","last_peered":"2024-09-19T09:37:44.141930+0000","last_clean":"2024-09-19T09:37:44.141930+0000","last_became_active":"2024-09-19T09:36:12.988093+0000","last_became_peered":"2024-09-19T09:36:12.988093+0000","last_unstale":"2024-09-19T09:37:44.141930+0000","last_undegraded":"2024-09-19T09:37:44.141930+0000","last_fullsized":"2024-09-19T09:37:44.141930+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:48.949397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.157907+0000","last_change":"2024-09-19T09:36:12.992360+0000","last_active":"2024-09-19T09:37:44.157907+0000","last_peered":"2024-09-19T09:37:44.157907+0000","last_clean":"2024-09-19T09:37:44.157907+0000","last_became_active":"2024-09-19T09:36:12.991833+0000","last_became_peered":"2024-09-19T09:36:12.991833+0000","last_unstale":"2024-09-19T09:37:44.157907+0000","last_undegraded":"2024-09-19T09:37:44.157907+0000","last_fullsized":"2024-09-19T09:37:44.157907+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:47.715012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.144515+0000","last_change":"2024-09-19T09:36:12.993435+0000","last_active":"2024-09-19T09:37:44.144515+0000","last_peered":"2024-09-19T09:37:44.144515+0000","last_clean":"2024-09-19T09:37:44.144515+0000","last_became_active":"2024-09-19T09:36:12.993108+0000","last_became_peered":"2024-09-19T09:36:12.993108+0000","last_unstale":"2024-09-19T09:37:44.144515+0000","last_undegraded":"2024-09-19T09:37:44.144515+0000","last_fullsized":"2024-09-19T09:37:44.144515+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:54.453593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.162293+0000","last_change":"2024-09-19T09:36:12.991044+0000","last_active":"2024-09-19T09:37:44.162293+0000","last_peered":"2024-09-19T09:37:44.162293+0000","last_clean":"2024-09-19T09:37:44.162293+0000","last_became_active":"2024-09-19T09:36:12.989955+0000","last_became_peered":"2024-09-19T09:36:12.989955+0000","last_unstale":"2024-09-19T09:37:44.162293+0000","last_undegraded":"2024-09-19T09:37:44.162293+0000","last_fullsized":"2024-09-19T09:37:44.162293+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:21.034023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148886+0000","last_change":"2024-09-19T09:36:12.989679+0000","last_active":"2024-09-19T09:37:44.148886+0000","last_peered":"2024-09-19T09:37:44.148886+0000","last_clean":"2024-09-19T09:37:44.148886+0000","last_became_active":"2024-09-19T09:36:12.988463+0000","last_became_peered":"2024-09-19T09:36:12.988463+0000","last_unstale":"2024-09-19T09:37:44.148886+0000","last_undegraded":"2024-09-19T09:37:44.148886+0000","last_fullsized":"2024-09-19T09:37:44.148886+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:28.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.144722+0000","last_change":"2024-09-19T09:36:12.983494+0000","last_active":"2024-09-19T09:37:44.144722+0000","last_peered":"2024-09-19T09:37:44.144722+0000","last_clean":"2024-09-19T09:37:44.144722+0000","last_became_active":"2024-09-19T09:36:12.983143+0000","last_became_peered":"2024-09-19T09:36:12.983143+0000","last_unstale":"2024-09-19T09:37:44.144722+0000","last_undegraded":"2024-09-19T09:37:44.144722+0000","last_fullsized":"2024-09-19T09:37:44.144722+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:23.378183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.143385+0000","last_change":"2024-09-19T09:36:12.987512+0000","last_active":"2024-09-19T09:37:44.143385+0000","last_peered":"2024-09-19T09:37:44.143385+0000","last_clean":"2024-09-19T09:37:44.143385+0000","last_became_active":"2024-09-19T09:36:12.987288+0000","last_became_peered":"2024-09-19T09:36:12.987288+0000","last_unstale":"2024-09-19T09:37:44.143385+0000","last_undegraded":"2024-09-19T09:37:44.143385+0000","last_fullsized":"2024-09-19T09:37:44.143385+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:14.614333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147801+0000","last_change":"2024-09-19T09:37:16.131000+0000","last_active":"2024-09-19T09:37:44.147801+0000","last_peered":"2024-09-19T09:37:44.147801+0000","last_clean":"2024-09-19T09:37:44.147801+0000","last_became_active":"2024-09-19T09:37:16.130647+0000","last_became_peered":"2024-09-19T09:37:16.130647+0000","last_unstale":"2024-09-19T09:37:44.147801+0000","last_undegraded":"2024-09-19T09:37:44.147801+0000","last_fullsized":"2024-09-19T09:37:44.147801+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:22.498318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.162539+0000","last_change":"2024-09-19T09:36:12.988210+0000","last_active":"2024-09-19T09:37:44.162539+0000","last_peered":"2024-09-19T09:37:44.162539+0000","last_clean":"2024-09-19T09:37:44.162539+0000","last_became_active":"2024-09-19T09:36:12.987904+0000","last_became_peered":"2024-09-19T09:36:12.987904+0000","last_unstale":"2024-09-19T09:37:44.162539+0000","last_undegraded":"2024-09-19T09:37:44.162539+0000","last_fullsized":"2024-09-19T09:37:44.162539+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:13.588237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147356+0000","last_change":"2024-09-19T09:36:12.984028+0000","last_active":"2024-09-19T09:37:44.147356+0000","last_peered":"2024-09-19T09:37:44.147356+0000","last_clean":"2024-09-19T09:37:44.147356+0000","last_became_active":"2024-09-19T09:36:12.982062+0000","last_became_peered":"2024-09-19T09:36:12.982062+0000","last_unstale":"2024-09-19T09:37:44.147356+0000","last_undegraded":"2024-09-19T09:37:44.147356+0000","last_fullsized":"2024-09-19T09:37:44.147356+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:26.610287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.141161+0000","last_change":"2024-09-19T09:36:12.979277+0000","last_active":"2024-09-19T09:37:44.141161+0000","last_peered":"2024-09-19T09:37:44.141161+0000","last_clean":"2024-09-19T09:37:44.141161+0000","last_became_active":"2024-09-19T09:36:12.978970+0000","last_became_peered":"2024-09-19T09:36:12.978970+0000","last_unstale":"2024-09-19T09:37:44.141161+0000","last_undegraded":"2024-09-19T09:37:44.141161+0000","last_fullsized":"2024-09-19T09:37:44.141161+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:00.424728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147432+0000","last_change":"2024-09-19T09:36:12.981021+0000","last_active":"2024-09-19T09:37:44.147432+0000","last_peered":"2024-09-19T09:37:44.147432+0000","last_clean":"2024-09-19T09:37:44.147432+0000","last_became_active":"2024-09-19T09:36:12.980580+0000","last_became_peered":"2024-09-19T09:36:12.980580+0000","last_unstale":"2024-09-19T09:37:44.147432+0000","last_undegraded":"2024-09-19T09:37:44.147432+0000","last_fullsized":"2024-09-19T09:37:44.147432+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:17.464873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.143924+0000","last_change":"2024-09-19T09:36:12.986090+0000","last_active":"2024-09-19T09:37:44.143924+0000","last_peered":"2024-09-19T09:37:44.143924+0000","last_clean":"2024-09-19T09:37:44.143924+0000","last_became_active":"2024-09-19T09:36:12.985740+0000","last_became_peered":"2024-09-19T09:36:12.985740+0000","last_unstale":"2024-09-19T09:37:44.143924+0000","last_undegraded":"2024-09-19T09:37:44.143924+0000","last_fullsized":"2024-09-19T09:37:44.143924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:35.252834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145367+0000","last_change":"2024-09-19T09:36:12.981257+0000","last_active":"2024-09-19T09:37:44.145367+0000","last_peered":"2024-09-19T09:37:44.145367+0000","last_clean":"2024-09-19T09:37:44.145367+0000","last_became_active":"2024-09-19T09:36:12.980911+0000","last_became_peered":"2024-09-19T09:36:12.980911+0000","last_unstale":"2024-09-19T09:37:44.145367+0000","last_undegraded":"2024-09-19T09:37:44.145367+0000","last_fullsized":"2024-09-19T09:37:44.145367+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:41.470514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.161076+0000","last_change":"2024-09-19T09:36:12.982585+0000","last_active":"2024-09-19T09:37:44.161076+0000","last_peered":"2024-09-19T09:37:44.161076+0000","last_clean":"2024-09-19T09:37:44.161076+0000","last_became_active":"2024-09-19T09:36:12.982193+0000","last_became_peered":"2024-09-19T09:36:12.982193+0000","last_unstale":"2024-09-19T09:37:44.161076+0000","last_undegraded":"2024-09-19T09:37:44.161076+0000","last_fullsized":"2024-09-19T09:37:44.161076+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:30.057088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.143208+0000","last_change":"2024-09-19T09:36:12.985236+0000","last_active":"2024-09-19T09:37:44.143208+0000","last_peered":"2024-09-19T09:37:44.143208+0000","last_clean":"2024-09-19T09:37:44.143208+0000","last_became_active":"2024-09-19T09:36:12.984751+0000","last_became_peered":"2024-09-19T09:36:12.984751+0000","last_unstale":"2024-09-19T09:37:44.143208+0000","last_undegraded":"2024-09-19T09:37:44.143208+0000","last_fullsized":"2024-09-19T09:37:44.143208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:52.784216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.138535+0000","last_change":"2024-09-19T09:36:12.985856+0000","last_active":"2024-09-19T09:37:44.138535+0000","last_peered":"2024-09-19T09:37:44.138535+0000","last_clean":"2024-09-19T09:37:44.138535+0000","last_became_active":"2024-09-19T09:36:12.985312+0000","last_became_peered":"2024-09-19T09:36:12.985312+0000","last_unstale":"2024-09-19T09:37:44.138535+0000","last_undegraded":"2024-09-19T09:37:44.138535+0000","last_fullsized":"2024-09-19T09:37:44.138535+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:25.235945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.142807+0000","last_change":"2024-09-19T09:36:12.982443+0000","last_active":"2024-09-19T09:37:44.142807+0000","last_peered":"2024-09-19T09:37:44.142807+0000","last_clean":"2024-09-19T09:37:44.142807+0000","last_became_active":"2024-09-19T09:36:12.982130+0000","last_became_peered":"2024-09-19T09:36:12.982130+0000","last_unstale":"2024-09-19T09:37:44.142807+0000","last_undegraded":"2024-09-19T09:37:44.142807+0000","last_fullsized":"2024-09-19T09:37:44.142807+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:17.177563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145567+0000","last_change":"2024-09-19T09:36:12.990439+0000","last_active":"2024-09-19T09:37:44.145567+0000","last_peered":"2024-09-19T09:37:44.145567+0000","last_clean":"2024-09-19T09:37:44.145567+0000","last_became_active":"2024-09-19T09:36:12.990135+0000","last_became_peered":"2024-09-19T09:36:12.990135+0000","last_unstale":"2024-09-19T09:37:44.145567+0000","last_undegraded":"2024-09-19T09:37:44.145567+0000","last_fullsized":"2024-09-19T09:37:44.145567+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:51.685192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145105+0000","last_change":"2024-09-19T09:36:12.987261+0000","last_active":"2024-09-19T09:37:44.145105+0000","last_peered":"2024-09-19T09:37:44.145105+0000","last_clean":"2024-09-19T09:37:44.145105+0000","last_became_active":"2024-09-19T09:36:12.986192+0000","last_became_peered":"2024-09-19T09:36:12.986192+0000","last_unstale":"2024-09-19T09:37:44.145105+0000","last_undegraded":"2024-09-19T09:37:44.145105+0000","last_fullsized":"2024-09-19T09:37:44.145105+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:58.435605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.141377+0000","last_change":"2024-09-19T09:36:12.981248+0000","last_active":"2024-09-19T09:37:44.141377+0000","last_peered":"2024-09-19T09:37:44.141377+0000","last_clean":"2024-09-19T09:37:44.141377+0000","last_became_active":"2024-09-19T09:36:12.980754+0000","last_became_peered":"2024-09-19T09:36:12.980754+0000","last_unstale":"2024-09-19T09:37:44.141377+0000","last_undegraded":"2024-09-19T09:37:44.141377+0000","last_fullsized":"2024-09-19T09:37:44.141377+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:03.970402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.139500+0000","last_change":"2024-09-19T09:36:12.990841+0000","last_active":"2024-09-19T09:37:44.139500+0000","last_peered":"2024-09-19T09:37:44.139500+0000","last_clean":"2024-09-19T09:37:44.139500+0000","last_became_active":"2024-09-19T09:36:12.989667+0000","last_became_peered":"2024-09-19T09:36:12.989667+0000","last_unstale":"2024-09-19T09:37:44.139500+0000","last_undegraded":"2024-09-19T09:37:44.139500+0000","last_fullsized":"2024-09-19T09:37:44.139500+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:46:00.314590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148537+0000","last_change":"2024-09-19T09:36:12.984007+0000","last_active":"2024-09-19T09:37:44.148537+0000","last_peered":"2024-09-19T09:37:44.148537+0000","last_clean":"2024-09-19T09:37:44.148537+0000","last_became_active":"2024-09-19T09:36:12.983627+0000","last_became_peered":"2024-09-19T09:36:12.983627+0000","last_unstale":"2024-09-19T09:37:44.148537+0000","last_undegraded":"2024-09-19T09:37:44.148537+0000","last_fullsized":"2024-09-19T09:37:44.148537+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:42.038673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146461+0000","last_change":"2024-09-19T09:36:12.988032+0000","last_active":"2024-09-19T09:37:44.146461+0000","last_peered":"2024-09-19T09:37:44.146461+0000","last_clean":"2024-09-19T09:37:44.146461+0000","last_became_active":"2024-09-19T09:36:12.987588+0000","last_became_peered":"2024-09-19T09:36:12.987588+0000","last_unstale":"2024-09-19T09:37:44.146461+0000","last_undegraded":"2024-09-19T09:37:44.146461+0000","last_fullsized":"2024-09-19T09:37:44.146461+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:01.518543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148152+0000","last_change":"2024-09-19T09:37:16.131565+0000","last_active":"2024-09-19T09:37:44.148152+0000","last_peered":"2024-09-19T09:37:44.148152+0000","last_clean":"2024-09-19T09:37:44.148152+0000","last_became_active":"2024-09-19T09:37:16.131171+0000","last_became_peered":"2024-09-19T09:37:16.131171+0000","last_unstale":"2024-09-19T09:37:44.148152+0000","last_undegraded":"2024-09-19T09:37:44.148152+0000","last_fullsized":"2024-09-19T09:37:44.148152+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:18.195074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.141174+0000","last_change":"2024-09-19T09:36:12.989709+0000","last_active":"2024-09-19T09:37:44.141174+0000","last_peered":"2024-09-19T09:37:44.141174+0000","last_clean":"2024-09-19T09:37:44.141174+0000","last_became_active":"2024-09-19T09:36:12.989324+0000","last_became_peered":"2024-09-19T09:36:12.989324+0000","last_unstale":"2024-09-19T09:37:44.141174+0000","last_undegraded":"2024-09-19T09:37:44.141174+0000","last_fullsized":"2024-09-19T09:37:44.141174+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:09.843175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.033713+0000","last_change":"2024-09-19T09:37:16.033713+0000","last_active":"2024-09-19T09:37:16.033713+0000","last_peered":"2024-09-19T09:37:16.033713+0000","last_clean":"2024-09-19T09:37:16.033713+0000","last_became_active":"2024-09-19T09:37:16.033230+0000","last_became_peered":"2024-09-19T09:37:16.033230+0000","last_unstale":"2024-09-19T09:37:16.033713+0000","last_undegraded":"2024-09-19T09:37:16.033713+0000","last_fullsized":"2024-09-19T09:37:16.033713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:12.262115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.143084+0000","last_change":"2024-09-19T09:37:16.484760+0000","last_active":"2024-09-19T09:37:44.143084+0000","last_peered":"2024-09-19T09:37:44.143084+0000","last_clean":"2024-09-19T09:37:44.143084+0000","last_became_active":"2024-09-19T09:37:16.484316+0000","last_became_peered":"2024-09-19T09:37:16.484316+0000","last_unstale":"2024-09-19T09:37:44.143084+0000","last_undegraded":"2024-09-19T09:37:44.143084+0000","last_fullsized":"2024-09-19T09:37:44.143084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:14.897601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.124818+0000","last_change":"2024-09-19T09:37:16.124818+0000","last_active":"2024-09-19T09:37:16.124818+0000","last_peered":"2024-09-19T09:37:16.124818+0000","last_clean":"2024-09-19T09:37:16.124818+0000","last_became_active":"2024-09-19T09:37:16.124391+0000","last_became_peered":"2024-09-19T09:37:16.124391+0000","last_unstale":"2024-09-19T09:37:16.124818+0000","last_undegraded":"2024-09-19T09:37:16.124818+0000","last_fullsized":"2024-09-19T09:37:16.124818+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:25.443666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034105+0000","last_change":"2024-09-19T09:36:10.837287+0000","last_active":"2024-09-19T09:37:16.034105+0000","last_peered":"2024-09-19T09:37:16.034105+0000","last_clean":"2024-09-19T09:37:16.034105+0000","last_became_active":"2024-09-19T09:36:10.836890+0000","last_became_peered":"2024-09-19T09:36:10.836890+0000","last_unstale":"2024-09-19T09:37:16.034105+0000","last_undegraded":"2024-09-19T09:37:16.034105+0000","last_fullsized":"2024-09-19T09:37:16.034105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:09.676728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.139992+0000","last_change":"2024-09-19T09:36:12.975690+0000","last_active":"2024-09-19T09:37:44.139992+0000","last_peered":"2024-09-19T09:37:44.139992+0000","last_clean":"2024-09-19T09:37:44.139992+0000","last_became_active":"2024-09-19T09:36:12.975370+0000","last_became_peered":"2024-09-19T09:36:12.975370+0000","last_unstale":"2024-09-19T09:37:44.139992+0000","last_undegraded":"2024-09-19T09:37:44.139992+0000","last_fullsized":"2024-09-19T09:37:44.139992+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:05.650917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030234+0000","last_change":"2024-09-19T09:36:10.843736+0000","last_active":"2024-09-19T09:37:16.030234+0000","last_peered":"2024-09-19T09:37:16.030234+0000","last_clean":"2024-09-19T09:37:16.030234+0000","last_became_active":"2024-09-19T09:36:10.843353+0000","last_became_peered":"2024-09-19T09:36:10.843353+0000","last_unstale":"2024-09-19T09:37:16.030234+0000","last_undegraded":"2024-09-19T09:37:16.030234+0000","last_fullsized":"2024-09-19T09:37:16.030234+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:29.818642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.140596+0000","last_change":"2024-09-19T09:36:12.978841+0000","last_active":"2024-09-19T09:37:44.140596+0000","last_peered":"2024-09-19T09:37:44.140596+0000","last_clean":"2024-09-19T09:37:44.140596+0000","last_became_active":"2024-09-19T09:36:12.978501+0000","last_became_peered":"2024-09-19T09:36:12.978501+0000","last_unstale":"2024-09-19T09:37:44.140596+0000","last_undegraded":"2024-09-19T09:37:44.140596+0000","last_fullsized":"2024-09-19T09:37:44.140596+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:07.974576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.032030+0000","last_change":"2024-09-19T09:36:10.841997+0000","last_active":"2024-09-19T09:37:16.032030+0000","last_peered":"2024-09-19T09:37:16.032030+0000","last_clean":"2024-09-19T09:37:16.032030+0000","last_became_active":"2024-09-19T09:36:10.841641+0000","last_became_peered":"2024-09-19T09:36:10.841641+0000","last_unstale":"2024-09-19T09:37:16.032030+0000","last_undegraded":"2024-09-19T09:37:16.032030+0000","last_fullsized":"2024-09-19T09:37:16.032030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:10.477879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.156072+0000","last_change":"2024-09-19T09:36:12.981486+0000","last_active":"2024-09-19T09:37:44.156072+0000","last_peered":"2024-09-19T09:37:44.156072+0000","last_clean":"2024-09-19T09:37:44.156072+0000","last_became_active":"2024-09-19T09:36:12.981165+0000","last_became_peered":"2024-09-19T09:36:12.981165+0000","last_unstale":"2024-09-19T09:37:44.156072+0000","last_undegraded":"2024-09-19T09:37:44.156072+0000","last_fullsized":"2024-09-19T09:37:44.156072+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:21.986132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030755+0000","last_change":"2024-09-19T09:36:10.845362+0000","last_active":"2024-09-19T09:37:16.030755+0000","last_peered":"2024-09-19T09:37:16.030755+0000","last_clean":"2024-09-19T09:37:16.030755+0000","last_became_active":"2024-09-19T09:36:10.844992+0000","last_became_peered":"2024-09-19T09:36:10.844992+0000","last_unstale":"2024-09-19T09:37:16.030755+0000","last_undegraded":"2024-09-19T09:37:16.030755+0000","last_fullsized":"2024-09-19T09:37:16.030755+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:52.854333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.137951+0000","last_change":"2024-09-19T09:36:12.988924+0000","last_active":"2024-09-19T09:37:44.137951+0000","last_peered":"2024-09-19T09:37:44.137951+0000","last_clean":"2024-09-19T09:37:44.137951+0000","last_became_active":"2024-09-19T09:36:12.988331+0000","last_became_peered":"2024-09-19T09:36:12.988331+0000","last_unstale":"2024-09-19T09:37:44.137951+0000","last_undegraded":"2024-09-19T09:37:44.137951+0000","last_fullsized":"2024-09-19T09:37:44.137951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:24.754252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029903+0000","last_change":"2024-09-19T09:36:10.860003+0000","last_active":"2024-09-19T09:37:16.029903+0000","last_peered":"2024-09-19T09:37:16.029903+0000","last_clean":"2024-09-19T09:37:16.029903+0000","last_became_active":"2024-09-19T09:36:10.859584+0000","last_became_peered":"2024-09-19T09:36:10.859584+0000","last_unstale":"2024-09-19T09:37:16.029903+0000","last_undegraded":"2024-09-19T09:37:16.029903+0000","last_fullsized":"2024-09-19T09:37:16.029903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:44.837960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.160481+0000","last_change":"2024-09-19T09:36:12.985446+0000","last_active":"2024-09-19T09:37:44.160481+0000","last_peered":"2024-09-19T09:37:44.160481+0000","last_clean":"2024-09-19T09:37:44.160481+0000","last_became_active":"2024-09-19T09:36:12.984671+0000","last_became_peered":"2024-09-19T09:36:12.984671+0000","last_unstale":"2024-09-19T09:37:44.160481+0000","last_undegraded":"2024-09-19T09:37:44.160481+0000","last_fullsized":"2024-09-19T09:37:44.160481+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:54.800151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'33","reported_seq":275,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:38:06.115182+0000","last_change":"2024-09-19T09:36:10.841056+0000","last_active":"2024-09-19T09:38:06.115182+0000","last_peered":"2024-09-19T09:38:06.115182+0000","last_clean":"2024-09-19T09:38:06.115182+0000","last_became_active":"2024-09-19T09:36:10.840731+0000","last_became_peered":"2024-09-19T09:36:10.840731+0000","last_unstale":"2024-09-19T09:38:06.115182+0000","last_undegraded":"2024-09-19T09:38:06.115182+0000","last_fullsized":"2024-09-19T09:38:06.115182+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:13.676188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68749,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":220,"num_read_kb":177,"num_write":33,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146672+0000","last_change":"2024-09-19T09:36:12.990223+0000","last_active":"2024-09-19T09:37:44.146672+0000","last_peered":"2024-09-19T09:37:44.146672+0000","last_clean":"2024-09-19T09:37:44.146672+0000","last_became_active":"2024-09-19T09:36:12.989720+0000","last_became_peered":"2024-09-19T09:36:12.989720+0000","last_unstale":"2024-09-19T09:37:44.146672+0000","last_undegraded":"2024-09-19T09:37:44.146672+0000","last_fullsized":"2024-09-19T09:37:44.146672+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:37.003075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.129753+0000","last_change":"2024-09-19T09:36:10.843288+0000","last_active":"2024-09-19T09:37:16.129753+0000","last_peered":"2024-09-19T09:37:16.129753+0000","last_clean":"2024-09-19T09:37:16.129753+0000","last_became_active":"2024-09-19T09:36:10.842844+0000","last_became_peered":"2024-09-19T09:36:10.842844+0000","last_unstale":"2024-09-19T09:37:16.129753+0000","last_undegraded":"2024-09-19T09:37:16.129753+0000","last_fullsized":"2024-09-19T09:37:16.129753+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:38.695411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145354+0000","last_change":"2024-09-19T09:36:12.981251+0000","last_active":"2024-09-19T09:37:44.145354+0000","last_peered":"2024-09-19T09:37:44.145354+0000","last_clean":"2024-09-19T09:37:44.145354+0000","last_became_active":"2024-09-19T09:36:12.980861+0000","last_became_peered":"2024-09-19T09:36:12.980861+0000","last_unstale":"2024-09-19T09:37:44.145354+0000","last_undegraded":"2024-09-19T09:37:44.145354+0000","last_fullsized":"2024-09-19T09:37:44.145354+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:09.633644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030128+0000","last_change":"2024-09-19T09:36:10.843448+0000","last_active":"2024-09-19T09:37:16.030128+0000","last_peered":"2024-09-19T09:37:16.030128+0000","last_clean":"2024-09-19T09:37:16.030128+0000","last_became_active":"2024-09-19T09:36:10.843087+0000","last_became_peered":"2024-09-19T09:36:10.843087+0000","last_unstale":"2024-09-19T09:37:16.030128+0000","last_undegraded":"2024-09-19T09:37:16.030128+0000","last_fullsized":"2024-09-19T09:37:16.030128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:20.623613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.151910+0000","last_change":"2024-09-19T09:36:12.981160+0000","last_active":"2024-09-19T09:37:44.151910+0000","last_peered":"2024-09-19T09:37:44.151910+0000","last_clean":"2024-09-19T09:37:44.151910+0000","last_became_active":"2024-09-19T09:36:12.980823+0000","last_became_peered":"2024-09-19T09:36:12.980823+0000","last_unstale":"2024-09-19T09:37:44.151910+0000","last_undegraded":"2024-09-19T09:37:44.151910+0000","last_fullsized":"2024-09-19T09:37:44.151910+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:39.323439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028480+0000","last_change":"2024-09-19T09:36:10.842536+0000","last_active":"2024-09-19T09:37:16.028480+0000","last_peered":"2024-09-19T09:37:16.028480+0000","last_clean":"2024-09-19T09:37:16.028480+0000","last_became_active":"2024-09-19T09:36:10.842176+0000","last_became_peered":"2024-09-19T09:36:10.842176+0000","last_unstale":"2024-09-19T09:37:16.028480+0000","last_undegraded":"2024-09-19T09:37:16.028480+0000","last_fullsized":"2024-09-19T09:37:16.028480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:37.871299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145814+0000","last_change":"2024-09-19T09:36:12.987271+0000","last_active":"2024-09-19T09:37:44.145814+0000","last_peered":"2024-09-19T09:37:44.145814+0000","last_clean":"2024-09-19T09:37:44.145814+0000","last_became_active":"2024-09-19T09:36:12.986918+0000","last_became_peered":"2024-09-19T09:36:12.986918+0000","last_unstale":"2024-09-19T09:37:44.145814+0000","last_undegraded":"2024-09-19T09:37:44.145814+0000","last_fullsized":"2024-09-19T09:37:44.145814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:07.608541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030337+0000","last_change":"2024-09-19T09:36:10.860370+0000","last_active":"2024-09-19T09:37:16.030337+0000","last_peered":"2024-09-19T09:37:16.030337+0000","last_clean":"2024-09-19T09:37:16.030337+0000","last_became_active":"2024-09-19T09:36:10.859820+0000","last_became_peered":"2024-09-19T09:36:10.859820+0000","last_unstale":"2024-09-19T09:37:16.030337+0000","last_undegraded":"2024-09-19T09:37:16.030337+0000","last_fullsized":"2024-09-19T09:37:16.030337+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:12.121038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.161919+0000","last_change":"2024-09-19T09:36:12.994449+0000","last_active":"2024-09-19T09:37:44.161919+0000","last_peered":"2024-09-19T09:37:44.161919+0000","last_clean":"2024-09-19T09:37:44.161919+0000","last_became_active":"2024-09-19T09:36:12.994141+0000","last_became_peered":"2024-09-19T09:36:12.994141+0000","last_unstale":"2024-09-19T09:37:44.161919+0000","last_undegraded":"2024-09-19T09:37:44.161919+0000","last_fullsized":"2024-09-19T09:37:44.161919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:21.416453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031764+0000","last_change":"2024-09-19T09:36:10.839609+0000","last_active":"2024-09-19T09:37:16.031764+0000","last_peered":"2024-09-19T09:37:16.031764+0000","last_clean":"2024-09-19T09:37:16.031764+0000","last_became_active":"2024-09-19T09:36:10.839227+0000","last_became_peered":"2024-09-19T09:36:10.839227+0000","last_unstale":"2024-09-19T09:37:16.031764+0000","last_undegraded":"2024-09-19T09:37:16.031764+0000","last_fullsized":"2024-09-19T09:37:16.031764+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:00.734924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.144996+0000","last_change":"2024-09-19T09:36:12.983573+0000","last_active":"2024-09-19T09:37:44.144996+0000","last_peered":"2024-09-19T09:37:44.144996+0000","last_clean":"2024-09-19T09:37:44.144996+0000","last_became_active":"2024-09-19T09:36:12.983241+0000","last_became_peered":"2024-09-19T09:36:12.983241+0000","last_unstale":"2024-09-19T09:37:44.144996+0000","last_undegraded":"2024-09-19T09:37:44.144996+0000","last_fullsized":"2024-09-19T09:37:44.144996+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:44.050271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034765+0000","last_change":"2024-09-19T09:36:10.839789+0000","last_active":"2024-09-19T09:37:16.034765+0000","last_peered":"2024-09-19T09:37:16.034765+0000","last_clean":"2024-09-19T09:37:16.034765+0000","last_became_active":"2024-09-19T09:36:10.839445+0000","last_became_peered":"2024-09-19T09:36:10.839445+0000","last_unstale":"2024-09-19T09:37:16.034765+0000","last_undegraded":"2024-09-19T09:37:16.034765+0000","last_fullsized":"2024-09-19T09:37:16.034765+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:16.040249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148829+0000","last_change":"2024-09-19T09:36:12.993420+0000","last_active":"2024-09-19T09:37:44.148829+0000","last_peered":"2024-09-19T09:37:44.148829+0000","last_clean":"2024-09-19T09:37:44.148829+0000","last_became_active":"2024-09-19T09:36:12.992334+0000","last_became_peered":"2024-09-19T09:36:12.992334+0000","last_unstale":"2024-09-19T09:37:44.148829+0000","last_undegraded":"2024-09-19T09:37:44.148829+0000","last_fullsized":"2024-09-19T09:37:44.148829+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:21.693164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030247+0000","last_change":"2024-09-19T09:36:10.839461+0000","last_active":"2024-09-19T09:37:16.030247+0000","last_peered":"2024-09-19T09:37:16.030247+0000","last_clean":"2024-09-19T09:37:16.030247+0000","last_became_active":"2024-09-19T09:36:10.839092+0000","last_became_peered":"2024-09-19T09:36:10.839092+0000","last_unstale":"2024-09-19T09:37:16.030247+0000","last_undegraded":"2024-09-19T09:37:16.030247+0000","last_fullsized":"2024-09-19T09:37:16.030247+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:02.367267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145214+0000","last_change":"2024-09-19T09:36:12.988234+0000","last_active":"2024-09-19T09:37:44.145214+0000","last_peered":"2024-09-19T09:37:44.145214+0000","last_clean":"2024-09-19T09:37:44.145214+0000","last_became_active":"2024-09-19T09:36:12.987813+0000","last_became_peered":"2024-09-19T09:36:12.987813+0000","last_unstale":"2024-09-19T09:37:44.145214+0000","last_undegraded":"2024-09-19T09:37:44.145214+0000","last_fullsized":"2024-09-19T09:37:44.145214+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:56.024428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.130482+0000","last_change":"2024-09-19T09:36:10.945705+0000","last_active":"2024-09-19T09:37:16.130482+0000","last_peered":"2024-09-19T09:37:16.130482+0000","last_clean":"2024-09-19T09:37:16.130482+0000","last_became_active":"2024-09-19T09:36:10.945323+0000","last_became_peered":"2024-09-19T09:36:10.945323+0000","last_unstale":"2024-09-19T09:37:16.130482+0000","last_undegraded":"2024-09-19T09:37:16.130482+0000","last_fullsized":"2024-09-19T09:37:16.130482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:24.211909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.162179+0000","last_change":"2024-09-19T09:36:12.990517+0000","last_active":"2024-09-19T09:37:44.162179+0000","last_peered":"2024-09-19T09:37:44.162179+0000","last_clean":"2024-09-19T09:37:44.162179+0000","last_became_active":"2024-09-19T09:36:12.989291+0000","last_became_peered":"2024-09-19T09:36:12.989291+0000","last_unstale":"2024-09-19T09:37:44.162179+0000","last_undegraded":"2024-09-19T09:37:44.162179+0000","last_fullsized":"2024-09-19T09:37:44.162179+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:31.087798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":339,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030377+0000","last_change":"2024-09-19T09:34:59.337025+0000","last_active":"2024-09-19T09:37:16.030377+0000","last_peered":"2024-09-19T09:37:16.030377+0000","last_clean":"2024-09-19T09:37:16.030377+0000","last_became_active":"2024-09-19T09:34:59.336556+0000","last_became_peered":"2024-09-19T09:34:59.336556+0000","last_unstale":"2024-09-19T09:37:16.030377+0000","last_undegraded":"2024-09-19T09:37:16.030377+0000","last_fullsized":"2024-09-19T09:37:16.030377+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:31:30.566923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:31:30.566923+0000","last_clean_scrub_stamp":"2024-09-19T09:31:30.566923+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:00.675254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028715+0000","last_change":"2024-09-19T09:36:10.838131+0000","last_active":"2024-09-19T09:37:16.028715+0000","last_peered":"2024-09-19T09:37:16.028715+0000","last_clean":"2024-09-19T09:37:16.028715+0000","last_became_active":"2024-09-19T09:36:10.837725+0000","last_became_peered":"2024-09-19T09:36:10.837725+0000","last_unstale":"2024-09-19T09:37:16.028715+0000","last_undegraded":"2024-09-19T09:37:16.028715+0000","last_fullsized":"2024-09-19T09:37:16.028715+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:57.104726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.139840+0000","last_change":"2024-09-19T09:36:12.981951+0000","last_active":"2024-09-19T09:37:44.139840+0000","last_peered":"2024-09-19T09:37:44.139840+0000","last_clean":"2024-09-19T09:37:44.139840+0000","last_became_active":"2024-09-19T09:36:12.981558+0000","last_became_peered":"2024-09-19T09:36:12.981558+0000","last_unstale":"2024-09-19T09:37:44.139840+0000","last_undegraded":"2024-09-19T09:37:44.139840+0000","last_fullsized":"2024-09-19T09:37:44.139840+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:31.119853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030184+0000","last_change":"2024-09-19T09:36:10.843574+0000","last_active":"2024-09-19T09:37:16.030184+0000","last_peered":"2024-09-19T09:37:16.030184+0000","last_clean":"2024-09-19T09:37:16.030184+0000","last_became_active":"2024-09-19T09:36:10.843252+0000","last_became_peered":"2024-09-19T09:36:10.843252+0000","last_unstale":"2024-09-19T09:37:16.030184+0000","last_undegraded":"2024-09-19T09:37:16.030184+0000","last_fullsized":"2024-09-19T09:37:16.030184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:10.492812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147324+0000","last_change":"2024-09-19T09:36:12.984538+0000","last_active":"2024-09-19T09:37:44.147324+0000","last_peered":"2024-09-19T09:37:44.147324+0000","last_clean":"2024-09-19T09:37:44.147324+0000","last_became_active":"2024-09-19T09:36:12.983448+0000","last_became_peered":"2024-09-19T09:36:12.983448+0000","last_unstale":"2024-09-19T09:37:44.147324+0000","last_undegraded":"2024-09-19T09:37:44.147324+0000","last_fullsized":"2024-09-19T09:37:44.147324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:48.294473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034208+0000","last_change":"2024-09-19T09:36:10.858959+0000","last_active":"2024-09-19T09:37:16.034208+0000","last_peered":"2024-09-19T09:37:16.034208+0000","last_clean":"2024-09-19T09:37:16.034208+0000","last_became_active":"2024-09-19T09:36:10.858638+0000","last_became_peered":"2024-09-19T09:36:10.858638+0000","last_unstale":"2024-09-19T09:37:16.034208+0000","last_undegraded":"2024-09-19T09:37:16.034208+0000","last_fullsized":"2024-09-19T09:37:16.034208+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:12.646483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.142955+0000","last_change":"2024-09-19T09:36:12.992710+0000","last_active":"2024-09-19T09:37:44.142955+0000","last_peered":"2024-09-19T09:37:44.142955+0000","last_clean":"2024-09-19T09:37:44.142955+0000","last_became_active":"2024-09-19T09:36:12.992436+0000","last_became_peered":"2024-09-19T09:36:12.992436+0000","last_unstale":"2024-09-19T09:37:44.142955+0000","last_undegraded":"2024-09-19T09:37:44.142955+0000","last_fullsized":"2024-09-19T09:37:44.142955+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:51.685516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030475+0000","last_change":"2024-09-19T09:36:10.842031+0000","last_active":"2024-09-19T09:37:16.030475+0000","last_peered":"2024-09-19T09:37:16.030475+0000","last_clean":"2024-09-19T09:37:16.030475+0000","last_became_active":"2024-09-19T09:36:10.841693+0000","last_became_peered":"2024-09-19T09:36:10.841693+0000","last_unstale":"2024-09-19T09:37:16.030475+0000","last_undegraded":"2024-09-19T09:37:16.030475+0000","last_fullsized":"2024-09-19T09:37:16.030475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:28:51.040551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.138330+0000","last_change":"2024-09-19T09:37:16.034026+0000","last_active":"2024-09-19T09:37:44.138330+0000","last_peered":"2024-09-19T09:37:44.138330+0000","last_clean":"2024-09-19T09:37:44.138330+0000","last_became_active":"2024-09-19T09:37:16.033546+0000","last_became_peered":"2024-09-19T09:37:16.033546+0000","last_unstale":"2024-09-19T09:37:44.138330+0000","last_undegraded":"2024-09-19T09:37:44.138330+0000","last_fullsized":"2024-09-19T09:37:44.138330+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:42.673825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.027885+0000","last_change":"2024-09-19T09:36:10.860470+0000","last_active":"2024-09-19T09:37:16.027885+0000","last_peered":"2024-09-19T09:37:16.027885+0000","last_clean":"2024-09-19T09:37:16.027885+0000","last_became_active":"2024-09-19T09:36:10.860097+0000","last_became_peered":"2024-09-19T09:36:10.860097+0000","last_unstale":"2024-09-19T09:37:16.027885+0000","last_undegraded":"2024-09-19T09:37:16.027885+0000","last_fullsized":"2024-09-19T09:37:16.027885+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:14.933378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.139200+0000","last_change":"2024-09-19T09:36:12.988489+0000","last_active":"2024-09-19T09:37:44.139200+0000","last_peered":"2024-09-19T09:37:44.139200+0000","last_clean":"2024-09-19T09:37:44.139200+0000","last_became_active":"2024-09-19T09:36:12.988151+0000","last_became_peered":"2024-09-19T09:36:12.988151+0000","last_unstale":"2024-09-19T09:37:44.139200+0000","last_undegraded":"2024-09-19T09:37:44.139200+0000","last_fullsized":"2024-09-19T09:37:44.139200+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:24.088771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030844+0000","last_change":"2024-09-19T09:36:10.860103+0000","last_active":"2024-09-19T09:37:16.030844+0000","last_peered":"2024-09-19T09:37:16.030844+0000","last_clean":"2024-09-19T09:37:16.030844+0000","last_became_active":"2024-09-19T09:36:10.859526+0000","last_became_peered":"2024-09-19T09:36:10.859526+0000","last_unstale":"2024-09-19T09:37:16.030844+0000","last_undegraded":"2024-09-19T09:37:16.030844+0000","last_fullsized":"2024-09-19T09:37:16.030844+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:25.460372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148110+0000","last_change":"2024-09-19T09:36:12.986286+0000","last_active":"2024-09-19T09:37:44.148110+0000","last_peered":"2024-09-19T09:37:44.148110+0000","last_clean":"2024-09-19T09:37:44.148110+0000","last_became_active":"2024-09-19T09:36:12.985982+0000","last_became_peered":"2024-09-19T09:36:12.985982+0000","last_unstale":"2024-09-19T09:37:44.148110+0000","last_undegraded":"2024-09-19T09:37:44.148110+0000","last_fullsized":"2024-09-19T09:37:44.148110+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:19.026134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'12","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.989217+0000","last_change":"2024-09-19T09:36:10.839280+0000","last_active":"2024-09-19T09:37:44.989217+0000","last_peered":"2024-09-19T09:37:44.989217+0000","last_clean":"2024-09-19T09:37:44.989217+0000","last_became_active":"2024-09-19T09:36:10.838979+0000","last_became_peered":"2024-09-19T09:36:10.838979+0000","last_unstale":"2024-09-19T09:37:44.989217+0000","last_undegraded":"2024-09-19T09:37:44.989217+0000","last_fullsized":"2024-09-19T09:37:44.989217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:06.303175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146091+0000","last_change":"2024-09-19T09:36:12.979778+0000","last_active":"2024-09-19T09:37:44.146091+0000","last_peered":"2024-09-19T09:37:44.146091+0000","last_clean":"2024-09-19T09:37:44.146091+0000","last_became_active":"2024-09-19T09:36:12.979455+0000","last_became_peered":"2024-09-19T09:36:12.979455+0000","last_unstale":"2024-09-19T09:37:44.146091+0000","last_undegraded":"2024-09-19T09:37:44.146091+0000","last_fullsized":"2024-09-19T09:37:44.146091+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:36.620368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029063+0000","last_change":"2024-09-19T09:36:10.945706+0000","last_active":"2024-09-19T09:37:16.029063+0000","last_peered":"2024-09-19T09:37:16.029063+0000","last_clean":"2024-09-19T09:37:16.029063+0000","last_became_active":"2024-09-19T09:36:10.945314+0000","last_became_peered":"2024-09-19T09:36:10.945314+0000","last_unstale":"2024-09-19T09:37:16.029063+0000","last_undegraded":"2024-09-19T09:37:16.029063+0000","last_fullsized":"2024-09-19T09:37:16.029063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:49.786913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.141688+0000","last_change":"2024-09-19T09:36:12.989412+0000","last_active":"2024-09-19T09:37:44.141688+0000","last_peered":"2024-09-19T09:37:44.141688+0000","last_clean":"2024-09-19T09:37:44.141688+0000","last_became_active":"2024-09-19T09:36:12.989109+0000","last_became_peered":"2024-09-19T09:36:12.989109+0000","last_unstale":"2024-09-19T09:37:44.141688+0000","last_undegraded":"2024-09-19T09:37:44.141688+0000","last_fullsized":"2024-09-19T09:37:44.141688+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:33.142592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.123342+0000","last_change":"2024-09-19T09:36:10.858581+0000","last_active":"2024-09-19T09:37:16.123342+0000","last_peered":"2024-09-19T09:37:16.123342+0000","last_clean":"2024-09-19T09:37:16.123342+0000","last_became_active":"2024-09-19T09:36:10.858240+0000","last_became_peered":"2024-09-19T09:36:10.858240+0000","last_unstale":"2024-09-19T09:37:16.123342+0000","last_undegraded":"2024-09-19T09:37:16.123342+0000","last_fullsized":"2024-09-19T09:37:16.123342+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:45.285839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.111050+0000","last_change":"2024-09-19T09:36:12.989075+0000","last_active":"2024-09-19T09:37:44.111050+0000","last_peered":"2024-09-19T09:37:44.111050+0000","last_clean":"2024-09-19T09:37:44.111050+0000","last_became_active":"2024-09-19T09:36:12.988752+0000","last_became_peered":"2024-09-19T09:36:12.988752+0000","last_unstale":"2024-09-19T09:37:44.111050+0000","last_undegraded":"2024-09-19T09:37:44.111050+0000","last_fullsized":"2024-09-19T09:37:44.111050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.424032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.483353+0000","last_change":"2024-09-19T09:36:10.838716+0000","last_active":"2024-09-19T09:37:16.483353+0000","last_peered":"2024-09-19T09:37:16.483353+0000","last_clean":"2024-09-19T09:37:16.483353+0000","last_became_active":"2024-09-19T09:36:10.838393+0000","last_became_peered":"2024-09-19T09:36:10.838393+0000","last_unstale":"2024-09-19T09:37:16.483353+0000","last_undegraded":"2024-09-19T09:37:16.483353+0000","last_fullsized":"2024-09-19T09:37:16.483353+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:54.107223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147844+0000","last_change":"2024-09-19T09:36:12.991721+0000","last_active":"2024-09-19T09:37:44.147844+0000","last_peered":"2024-09-19T09:37:44.147844+0000","last_clean":"2024-09-19T09:37:44.147844+0000","last_became_active":"2024-09-19T09:36:12.991398+0000","last_became_peered":"2024-09-19T09:36:12.991398+0000","last_unstale":"2024-09-19T09:37:44.147844+0000","last_undegraded":"2024-09-19T09:37:44.147844+0000","last_fullsized":"2024-09-19T09:37:44.147844+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:19:31.312072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.485156+0000","last_change":"2024-09-19T09:37:16.484541+0000","last_active":"2024-09-19T09:37:16.485156+0000","last_peered":"2024-09-19T09:37:16.485156+0000","last_clean":"2024-09-19T09:37:16.485156+0000","last_became_active":"2024-09-19T09:37:16.484035+0000","last_became_peered":"2024-09-19T09:37:16.484035+0000","last_unstale":"2024-09-19T09:37:16.485156+0000","last_undegraded":"2024-09-19T09:37:16.485156+0000","last_fullsized":"2024-09-19T09:37:16.485156+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:36.332699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146414+0000","last_change":"2024-09-19T09:36:12.984180+0000","last_active":"2024-09-19T09:37:44.146414+0000","last_peered":"2024-09-19T09:37:44.146414+0000","last_clean":"2024-09-19T09:37:44.146414+0000","last_became_active":"2024-09-19T09:36:12.983876+0000","last_became_peered":"2024-09-19T09:36:12.983876+0000","last_unstale":"2024-09-19T09:37:44.146414+0000","last_undegraded":"2024-09-19T09:37:44.146414+0000","last_fullsized":"2024-09-19T09:37:44.146414+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:45.876771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031127+0000","last_change":"2024-09-19T09:36:10.845391+0000","last_active":"2024-09-19T09:37:16.031127+0000","last_peered":"2024-09-19T09:37:16.031127+0000","last_clean":"2024-09-19T09:37:16.031127+0000","last_became_active":"2024-09-19T09:36:10.844974+0000","last_became_peered":"2024-09-19T09:36:10.844974+0000","last_unstale":"2024-09-19T09:37:16.031127+0000","last_undegraded":"2024-09-19T09:37:16.031127+0000","last_fullsized":"2024-09-19T09:37:16.031127+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:00.318337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.162083+0000","last_change":"2024-09-19T09:36:12.991145+0000","last_active":"2024-09-19T09:37:44.162083+0000","last_peered":"2024-09-19T09:37:44.162083+0000","last_clean":"2024-09-19T09:37:44.162083+0000","last_became_active":"2024-09-19T09:36:12.989891+0000","last_became_peered":"2024-09-19T09:36:12.989891+0000","last_unstale":"2024-09-19T09:37:44.162083+0000","last_undegraded":"2024-09-19T09:37:44.162083+0000","last_fullsized":"2024-09-19T09:37:44.162083+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:21.054936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.162240+0000","last_change":"2024-09-19T09:36:12.995378+0000","last_active":"2024-09-19T09:37:44.162240+0000","last_peered":"2024-09-19T09:37:44.162240+0000","last_clean":"2024-09-19T09:37:44.162240+0000","last_became_active":"2024-09-19T09:36:12.995028+0000","last_became_peered":"2024-09-19T09:36:12.995028+0000","last_unstale":"2024-09-19T09:37:44.162240+0000","last_undegraded":"2024-09-19T09:37:44.162240+0000","last_fullsized":"2024-09-19T09:37:44.162240+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:41.102130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031259+0000","last_change":"2024-09-19T09:36:10.839595+0000","last_active":"2024-09-19T09:37:16.031259+0000","last_peered":"2024-09-19T09:37:16.031259+0000","last_clean":"2024-09-19T09:37:16.031259+0000","last_became_active":"2024-09-19T09:36:10.839196+0000","last_became_peered":"2024-09-19T09:36:10.839196+0000","last_unstale":"2024-09-19T09:37:16.031259+0000","last_undegraded":"2024-09-19T09:37:16.031259+0000","last_fullsized":"2024-09-19T09:37:16.031259+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:02.272731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.160402+0000","last_change":"2024-09-19T09:36:12.984485+0000","last_active":"2024-09-19T09:37:44.160402+0000","last_peered":"2024-09-19T09:37:44.160402+0000","last_clean":"2024-09-19T09:37:44.160402+0000","last_became_active":"2024-09-19T09:36:12.984004+0000","last_became_peered":"2024-09-19T09:36:12.984004+0000","last_unstale":"2024-09-19T09:37:44.160402+0000","last_undegraded":"2024-09-19T09:37:44.160402+0000","last_fullsized":"2024-09-19T09:37:44.160402+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:37.646776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030731+0000","last_change":"2024-09-19T09:36:10.845306+0000","last_active":"2024-09-19T09:37:16.030731+0000","last_peered":"2024-09-19T09:37:16.030731+0000","last_clean":"2024-09-19T09:37:16.030731+0000","last_became_active":"2024-09-19T09:36:10.844952+0000","last_became_peered":"2024-09-19T09:36:10.844952+0000","last_unstale":"2024-09-19T09:37:16.030731+0000","last_undegraded":"2024-09-19T09:37:16.030731+0000","last_fullsized":"2024-09-19T09:37:16.030731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:09.792482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.161016+0000","last_change":"2024-09-19T09:36:12.991260+0000","last_active":"2024-09-19T09:37:44.161016+0000","last_peered":"2024-09-19T09:37:44.161016+0000","last_clean":"2024-09-19T09:37:44.161016+0000","last_became_active":"2024-09-19T09:36:12.989981+0000","last_became_peered":"2024-09-19T09:36:12.989981+0000","last_unstale":"2024-09-19T09:37:44.161016+0000","last_undegraded":"2024-09-19T09:37:44.161016+0000","last_fullsized":"2024-09-19T09:37:44.161016+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:11.301790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.483876+0000","last_change":"2024-09-19T09:36:10.859016+0000","last_active":"2024-09-19T09:37:16.483876+0000","last_peered":"2024-09-19T09:37:16.483876+0000","last_clean":"2024-09-19T09:37:16.483876+0000","last_became_active":"2024-09-19T09:36:10.858661+0000","last_became_peered":"2024-09-19T09:36:10.858661+0000","last_unstale":"2024-09-19T09:37:16.483876+0000","last_undegraded":"2024-09-19T09:37:16.483876+0000","last_fullsized":"2024-09-19T09:37:16.483876+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:54.395977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148013+0000","last_change":"2024-09-19T09:37:16.131601+0000","last_active":"2024-09-19T09:37:44.148013+0000","last_peered":"2024-09-19T09:37:44.148013+0000","last_clean":"2024-09-19T09:37:44.148013+0000","last_became_active":"2024-09-19T09:37:16.131199+0000","last_became_peered":"2024-09-19T09:37:16.131199+0000","last_unstale":"2024-09-19T09:37:44.148013+0000","last_undegraded":"2024-09-19T09:37:44.148013+0000","last_fullsized":"2024-09-19T09:37:44.148013+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:27.358544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.039032+0000","last_change":"2024-09-19T09:37:16.039032+0000","last_active":"2024-09-19T09:37:16.039032+0000","last_peered":"2024-09-19T09:37:16.039032+0000","last_clean":"2024-09-19T09:37:16.039032+0000","last_became_active":"2024-09-19T09:37:16.035315+0000","last_became_peered":"2024-09-19T09:37:16.035315+0000","last_unstale":"2024-09-19T09:37:16.039032+0000","last_undegraded":"2024-09-19T09:37:16.039032+0000","last_fullsized":"2024-09-19T09:37:16.039032+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:58.795064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69547,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":226,"num_read_kb":183,"num_write":94,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":208641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77,"ondisk_log_size":77,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282954,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547237,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":441682,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776170,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1040384,"data_stored":1100528,"data_compressed":41852,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972400,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":441682,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201332,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":441704,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430266,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":1031585,"data_compressed":41852,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593791,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":441217,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822724,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":1031767,"data_compressed":41852,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953545,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":441122,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215182,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":913408,"data_stored":441438,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444115,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":978944,"data_stored":509883,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":974848,"data_stored":509849,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":441190,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":68749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":68783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:38:12.064 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:38:12.167 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:12.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.634+0000 7f419aa14640 1 -- 172.21.15.1:0/4238945127 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4194106f10 msgr2=0x7f419410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:12.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.634+0000 7f419aa14640 1 --2- 172.21.15.1:0/4238945127 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4194106f10 0x7f419410ea90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f418c009ca0 tx=0x7f418c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.634+0000 7f419aa14640 1 -- 172.21.15.1:0/4238945127 shutdown_connections 2024-09-19T09:38:12.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.634+0000 7f419aa14640 1 --2- 172.21.15.1:0/4238945127 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4194106f10 0x7f419410ea90 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.634+0000 7f419aa14640 1 --2- 172.21.15.1:0/4238945127 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4194102790 0x7f41941067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.634+0000 7f419aa14640 1 --2- 172.21.15.1:0/4238945127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4194101de0 0x7f41941021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.634+0000 7f419aa14640 1 -- 172.21.15.1:0/4238945127 >> 172.21.15.1:0/4238945127 conn(0x7f41940fd8c0 msgr2=0x7f41940ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:12.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.634+0000 7f419aa14640 1 -- 172.21.15.1:0/4238945127 shutdown_connections 2024-09-19T09:38:12.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.634+0000 7f419aa14640 1 -- 172.21.15.1:0/4238945127 wait complete. 2024-09-19T09:38:12.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.635+0000 7f419aa14640 1 Processor -- start 2024-09-19T09:38:12.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.635+0000 7f419aa14640 1 -- start start 2024-09-19T09:38:12.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.635+0000 7f419aa14640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4194101de0 0x7f41941983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:12.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.635+0000 7f419aa14640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4194102790 0x7f4194198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:12.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.635+0000 7f419aa14640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4194106f10 0x7f419419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:12.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.635+0000 7f419aa14640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4194111f70 con 0x7f4194102790 2024-09-19T09:38:12.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.635+0000 7f419aa14640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4194111df0 con 0x7f4194101de0 2024-09-19T09:38:12.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.635+0000 7f419aa14640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f41941120f0 con 0x7f4194106f10 2024-09-19T09:38:12.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.635+0000 7f41937fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4194102790 0x7f4194198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:12.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.635+0000 7f41937fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4194102790 0x7f4194198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33762/0 (socket says 172.21.15.1:33762) 2024-09-19T09:38:12.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.635+0000 7f41937fe640 1 -- 172.21.15.1:0/401762150 learned_addr learned my addr 172.21.15.1:0/401762150 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:12.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.635+0000 7f4193fff640 1 --2- 172.21.15.1:0/401762150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4194101de0 0x7f41941983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:12.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.635+0000 7f4198fb1640 1 --2- 172.21.15.1:0/401762150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4194106f10 0x7f419419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:12.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.636+0000 7f41937fe640 1 -- 172.21.15.1:0/401762150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4194106f10 msgr2=0x7f419419ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:12.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.636+0000 7f41937fe640 1 --2- 172.21.15.1:0/401762150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4194106f10 0x7f419419ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.636+0000 7f41937fe640 1 -- 172.21.15.1:0/401762150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4194101de0 msgr2=0x7f41941983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:12.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.636+0000 7f41937fe640 1 --2- 172.21.15.1:0/401762150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4194101de0 0x7f41941983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.636+0000 7f41937fe640 1 -- 172.21.15.1:0/401762150 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f419419d3a0 con 0x7f4194102790 2024-09-19T09:38:12.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.636+0000 7f4193fff640 1 --2- 172.21.15.1:0/401762150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4194101de0 0x7f41941983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:12.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.636+0000 7f41937fe640 1 --2- 172.21.15.1:0/401762150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4194102790 0x7f4194198930 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f418800d950 tx=0x7f418800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:12.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.636+0000 7f41917fa640 1 -- 172.21.15.1:0/401762150 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4188017070 con 0x7f4194102790 2024-09-19T09:38:12.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.636+0000 7f41917fa640 1 -- 172.21.15.1:0/401762150 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4188009c30 con 0x7f4194102790 2024-09-19T09:38:12.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.636+0000 7f419aa14640 1 -- 172.21.15.1:0/401762150 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f419419d690 con 0x7f4194102790 2024-09-19T09:38:12.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.636+0000 7f41917fa640 1 -- 172.21.15.1:0/401762150 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418800f6b0 con 0x7f4194102790 2024-09-19T09:38:12.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.636+0000 7f419aa14640 1 -- 172.21.15.1:0/401762150 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41941a4f70 con 0x7f4194102790 2024-09-19T09:38:12.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.639+0000 7f41917fa640 1 -- 172.21.15.1:0/401762150 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f41880109d0 con 0x7f4194102790 2024-09-19T09:38:12.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.639+0000 7f419cded740 1 Processor -- start 2024-09-19T09:38:12.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.639+0000 7f419cded740 1 -- start start 2024-09-19T09:38:12.654 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.640+0000 7f419cded740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5576bc6ef4a0 0x5576bc6ef880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:12.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.640+0000 7f419cded740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576bc6efdc0 0x5576bc6fa140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:12.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.640+0000 7f419cded740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576bc6fa680 0x5576bc6fca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:12.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.640+0000 7f419cded740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5576bc6552e0 con 0x5576bc6fa680 2024-09-19T09:38:12.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.640+0000 7f419cded740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5576bc5fcce0 con 0x5576bc6ef4a0 2024-09-19T09:38:12.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.640+0000 7f419cded740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5576bc6512a0 con 0x5576bc6efdc0 2024-09-19T09:38:12.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.640+0000 7f41937fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576bc6fa680 0x5576bc6fca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:12.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.640+0000 7f41937fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576bc6fa680 0x5576bc6fca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33772/0 (socket says 172.21.15.1:33772) 2024-09-19T09:38:12.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.640+0000 7f41937fe640 1 -- 172.21.15.1:0/1297218636 learned_addr learned my addr 172.21.15.1:0/1297218636 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:12.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.640+0000 7f4193fff640 1 --2- 172.21.15.1:0/1297218636 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576bc6efdc0 0x5576bc6fa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:12.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.640+0000 7f4198fb1640 1 --2- 172.21.15.1:0/1297218636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5576bc6ef4a0 0x5576bc6ef880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:12.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.640+0000 7f41917fa640 1 --2- 172.21.15.1:0/401762150 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f417c0a32c0 0x7f417c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:12.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.640+0000 7f41937fe640 1 -- 172.21.15.1:0/1297218636 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576bc6efdc0 msgr2=0x5576bc6fa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:12.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.640+0000 7f41937fe640 1 --2- 172.21.15.1:0/1297218636 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576bc6efdc0 0x5576bc6fa140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.640+0000 7f41937fe640 1 -- 172.21.15.1:0/1297218636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5576bc6ef4a0 msgr2=0x5576bc6ef880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:12.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.640+0000 7f41937fe640 1 --2- 172.21.15.1:0/1297218636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5576bc6ef4a0 0x5576bc6ef880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.640+0000 7f41937fe640 1 -- 172.21.15.1:0/1297218636 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576bc5e1440 con 0x5576bc6fa680 2024-09-19T09:38:12.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.640+0000 7f4198fb1640 1 --2- 172.21.15.1:0/401762150 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f417c0a32c0 0x7f417c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:12.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.640+0000 7f41917fa640 1 -- 172.21.15.1:0/401762150 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f41880cf510 con 0x7f4194102790 2024-09-19T09:38:12.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.640+0000 7f41937fe640 1 --2- 172.21.15.1:0/1297218636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576bc6fa680 0x5576bc6fca70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f41880b4740 tx=0x7f41880c6900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccadb8a98fb97fef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:12.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.641+0000 7f417a7fc640 1 -- 172.21.15.1:0/1297218636 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4188020070 con 0x5576bc6fa680 2024-09-19T09:38:12.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.641+0000 7f417a7fc640 1 -- 172.21.15.1:0/1297218636 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41880b5a10 con 0x5576bc6fa680 2024-09-19T09:38:12.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.641+0000 7f417a7fc640 1 -- 172.21.15.1:0/1297218636 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418809b490 con 0x5576bc6fa680 2024-09-19T09:38:12.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.641+0000 7f419cded740 1 -- 172.21.15.1:0/1297218636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576bc6fa680 msgr2=0x5576bc6fca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:12.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.641+0000 7f419cded740 1 --2- 172.21.15.1:0/1297218636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576bc6fa680 0x5576bc6fca70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f41880b4740 tx=0x7f41880c6900 comp rx=0 tx=0).stop 2024-09-19T09:38:12.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.641+0000 7f4198fb1640 1 --2- 172.21.15.1:0/401762150 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f417c0a32c0 0x7f417c0a5780 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f418c005e30 tx=0x7f418c0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:12.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.641+0000 7f419cded740 1 -- 172.21.15.1:0/1297218636 shutdown_connections 2024-09-19T09:38:12.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.641+0000 7f419cded740 1 --2- 172.21.15.1:0/1297218636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576bc6fa680 0x5576bc6fca70 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.641+0000 7f419cded740 1 --2- 172.21.15.1:0/1297218636 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576bc6efdc0 0x5576bc6fa140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.641+0000 7f419cded740 1 --2- 172.21.15.1:0/1297218636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5576bc6ef4a0 0x5576bc6ef880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.641+0000 7f419cded740 1 -- 172.21.15.1:0/1297218636 >> 172.21.15.1:0/1297218636 conn(0x5576bc6eba30 msgr2=0x5576bc6ebe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:12.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.642+0000 7f419cded740 1 -- 172.21.15.1:0/1297218636 shutdown_connections 2024-09-19T09:38:12.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.642+0000 7f419cded740 1 -- 172.21.15.1:0/1297218636 wait complete. 2024-09-19T09:38:12.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.642+0000 7f419cded740 1 -- start start 2024-09-19T09:38:12.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.642+0000 7f419cded740 1 Processor -- start 2024-09-19T09:38:12.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.642+0000 7f419cded740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576bc6ef4a0 0x5576bc6f9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:12.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.642+0000 7f419cded740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576bc6efdc0 0x5576bc6f7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:12.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.642+0000 7f419cded740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5576bc6fa680 0x5576bc6f7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:12.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.643+0000 7f419cded740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5576bc6fd250 con 0x5576bc6efdc0 2024-09-19T09:38:12.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.643+0000 7f419cded740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5576bc610050 con 0x5576bc6fa680 2024-09-19T09:38:12.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.643+0000 7f419cded740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5576bc6fd3d0 con 0x5576bc6ef4a0 2024-09-19T09:38:12.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.643+0000 7f419cded740 10 client.0 _ll_register_callbacks cb 0x5576bc650160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:12.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.643+0000 7f41937fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576bc6efdc0 0x5576bc6f7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:12.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.643+0000 7f41937fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576bc6efdc0 0x5576bc6f7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33778/0 (socket says 172.21.15.1:33778) 2024-09-19T09:38:12.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.643+0000 7f41937fe640 1 -- 172.21.15.1:0/4082303903 learned_addr learned my addr 172.21.15.1:0/4082303903 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:12.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.643+0000 7f4198fb1640 1 --2- 172.21.15.1:0/4082303903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5576bc6fa680 0x5576bc6f7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:12.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.643+0000 7f4193fff640 1 --2- 172.21.15.1:0/4082303903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576bc6ef4a0 0x5576bc6f9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:12.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.643+0000 7f41937fe640 1 -- 172.21.15.1:0/4082303903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576bc6ef4a0 msgr2=0x5576bc6f9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:12.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.643+0000 7f41937fe640 1 --2- 172.21.15.1:0/4082303903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576bc6ef4a0 0x5576bc6f9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.643+0000 7f41937fe640 1 -- 172.21.15.1:0/4082303903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5576bc6fa680 msgr2=0x5576bc6f7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:12.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.643+0000 7f41937fe640 1 --2- 172.21.15.1:0/4082303903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5576bc6fa680 0x5576bc6f7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.643+0000 7f41937fe640 1 -- 172.21.15.1:0/4082303903 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576bc3c63c0 con 0x5576bc6efdc0 2024-09-19T09:38:12.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.643+0000 7f4193fff640 1 --2- 172.21.15.1:0/4082303903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576bc6ef4a0 0x5576bc6f9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:12.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.643+0000 7f41937fe640 1 --2- 172.21.15.1:0/4082303903 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576bc6efdc0 0x5576bc6f7250 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f418809bac0 tx=0x7f418800bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de6d67fa47d8f44 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:12.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.643+0000 7f41737fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:38:12.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.643+0000 7f41737fe640 1 -- 172.21.15.1:0/4082303903 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418809ce60 con 0x5576bc6efdc0 2024-09-19T09:38:12.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.643+0000 7f41737fe640 1 -- 172.21.15.1:0/4082303903 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f4188099e30 con 0x5576bc6efdc0 2024-09-19T09:38:12.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.643+0000 7f419cded740 1 -- 172.21.15.1:0/4082303903 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5576bc662850 con 0x5576bc6efdc0 2024-09-19T09:38:12.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.644+0000 7f41737fe640 1 -- 172.21.15.1:0/4082303903 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4188020040 con 0x5576bc6efdc0 2024-09-19T09:38:12.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.644+0000 7f419cded740 10 client.15162 fetch_fsmap learned FSMap version 19 2024-09-19T09:38:12.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.644+0000 7f419cded740 1 -- 172.21.15.1:0/4082303903 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5576bc6fd250 con 0x5576bc6efdc0 2024-09-19T09:38:12.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.644+0000 7f41737fe640 1 -- 172.21.15.1:0/4082303903 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5576bc662850 con 0x5576bc6efdc0 2024-09-19T09:38:12.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.644+0000 7f41737fe640 1 -- 172.21.15.1:0/4082303903 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f41880cc0e0 con 0x5576bc6efdc0 2024-09-19T09:38:12.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.644+0000 7f419cded740 10 client.15162 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:38:12.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.644+0000 7f419cded740 10 client.15162 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:38:12.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.644+0000 7f419cded740 20 client.15162 populate_metadata read hostname 'smithi001' 2024-09-19T09:38:12.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.644+0000 7f419cded740 1 --2- 172.21.15.1:0/4082303903 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5576bc709d50 0x5576bc70c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:12.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.644+0000 7f419cded740 4 client.15162 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:38:12.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.644+0000 7f419cded740 1 -- 172.21.15.1:0/4082303903 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576bc65cd60 con 0x5576bc709d50 2024-09-19T09:38:12.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.644+0000 7f4193fff640 1 --2- 172.21.15.1:0/4082303903 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5576bc709d50 0x5576bc70c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:12.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.645+0000 7f41737fe640 10 client.15162 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:12.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.645+0000 7f4193fff640 1 --2- 172.21.15.1:0/4082303903 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5576bc709d50 0x5576bc70c140 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ee4aadaf188dc3d server_cookie=bedb35b857ddc1cb in_seq=0 out_seq=0 2024-09-19T09:38:12.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.645+0000 7f41737fe640 1 -- 172.21.15.1:0/4082303903 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5576bc65cd60 con 0x5576bc709d50 2024-09-19T09:38:12.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.645+0000 7f41737fe640 10 client.15162 handle_command_reply: tid=0 2024-09-19T09:38:12.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.645+0000 7f419cded740 1 client.15162 shutdown 2024-09-19T09:38:12.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.646+0000 7f419cded740 1 -- 172.21.15.1:0/4082303903 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576bc6efdc0 msgr2=0x5576bc6f7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:12.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.646+0000 7f419cded740 1 --2- 172.21.15.1:0/4082303903 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576bc6efdc0 0x5576bc6f7250 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f418809bac0 tx=0x7f418800bf60 comp rx=0 tx=0).stop 2024-09-19T09:38:12.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.646+0000 7f419cded740 1 -- 172.21.15.1:0/4082303903 shutdown_connections 2024-09-19T09:38:12.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.646+0000 7f419cded740 1 --2- 172.21.15.1:0/4082303903 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5576bc709d50 0x5576bc70c140 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.646+0000 7f419cded740 1 --2- 172.21.15.1:0/4082303903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5576bc6fa680 0x5576bc6f7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.646+0000 7f419cded740 1 --2- 172.21.15.1:0/4082303903 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576bc6efdc0 0x5576bc6f7250 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.646+0000 7f419cded740 1 --2- 172.21.15.1:0/4082303903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576bc6ef4a0 0x5576bc6f9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.646+0000 7f41737fe640 0 client.15162 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:12.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.646+0000 7f419cded740 1 -- 172.21.15.1:0/4082303903 >> 172.21.15.1:0/4082303903 conn(0x5576bc6eba30 msgr2=0x5576bc6f1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:12.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.646+0000 7f419cded740 1 -- 172.21.15.1:0/4082303903 shutdown_connections 2024-09-19T09:38:12.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.646+0000 7f419cded740 1 -- 172.21.15.1:0/4082303903 wait complete. 2024-09-19T09:38:12.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.646+0000 7f419cded740 20 client.15162 trim_cache size 0 max 16384 2024-09-19T09:38:12.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.663+0000 7f419cded740 1 Processor -- start 2024-09-19T09:38:12.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.663+0000 7f419cded740 1 -- start start 2024-09-19T09:38:12.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.663+0000 7f419cded740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5576bc6ef4a0 0x5576bc7064b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:12.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.663+0000 7f419cded740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576bc6efdc0 0x5576bc7118b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:12.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.663+0000 7f419cded740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576bc6fa680 0x5576bc711df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:12.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.663+0000 7f419cded740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f41941ab610 con 0x5576bc6efdc0 2024-09-19T09:38:12.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.663+0000 7f419cded740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f41941adeb0 con 0x5576bc6ef4a0 2024-09-19T09:38:12.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.663+0000 7f419cded740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f41941abca0 con 0x5576bc6fa680 2024-09-19T09:38:12.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.663+0000 7f41937fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576bc6efdc0 0x5576bc7118b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:12.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.663+0000 7f41937fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576bc6efdc0 0x5576bc7118b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33786/0 (socket says 172.21.15.1:33786) 2024-09-19T09:38:12.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.663+0000 7f41937fe640 1 -- 172.21.15.1:0/3622198183 learned_addr learned my addr 172.21.15.1:0/3622198183 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:12.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.663+0000 7f4193fff640 1 --2- 172.21.15.1:0/3622198183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5576bc6ef4a0 0x5576bc7064b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:12.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.664+0000 7f4198fb1640 1 --2- 172.21.15.1:0/3622198183 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576bc6fa680 0x5576bc711df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:12.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.664+0000 7f41937fe640 1 -- 172.21.15.1:0/3622198183 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576bc6fa680 msgr2=0x5576bc711df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:12.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.664+0000 7f41937fe640 1 --2- 172.21.15.1:0/3622198183 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576bc6fa680 0x5576bc711df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.664+0000 7f41937fe640 1 -- 172.21.15.1:0/3622198183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5576bc6ef4a0 msgr2=0x5576bc7064b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:12.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.664+0000 7f41937fe640 1 --2- 172.21.15.1:0/3622198183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5576bc6ef4a0 0x5576bc7064b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.664+0000 7f41937fe640 1 -- 172.21.15.1:0/3622198183 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576bc6eb860 con 0x5576bc6efdc0 2024-09-19T09:38:12.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.664+0000 7f4193fff640 1 --2- 172.21.15.1:0/3622198183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5576bc6ef4a0 0x5576bc7064b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:12.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.664+0000 7f41937fe640 1 --2- 172.21.15.1:0/3622198183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576bc6efdc0 0x5576bc7118b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4188009610 tx=0x7f4188005f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c6f01f06649c31 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:12.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.664+0000 7f4179ffb640 1 -- 172.21.15.1:0/3622198183 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418809ce60 con 0x5576bc6efdc0 2024-09-19T09:38:12.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.664+0000 7f4179ffb640 1 -- 172.21.15.1:0/3622198183 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f418809c230 con 0x5576bc6efdc0 2024-09-19T09:38:12.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.664+0000 7f4179ffb640 1 -- 172.21.15.1:0/3622198183 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41880b3020 con 0x5576bc6efdc0 2024-09-19T09:38:12.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.665+0000 7f419cded740 1 -- 172.21.15.1:0/3622198183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576bc6efdc0 msgr2=0x5576bc7118b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:12.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.665+0000 7f419cded740 1 --2- 172.21.15.1:0/3622198183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576bc6efdc0 0x5576bc7118b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4188009610 tx=0x7f4188005f70 comp rx=0 tx=0).stop 2024-09-19T09:38:12.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.665+0000 7f419cded740 1 -- 172.21.15.1:0/3622198183 shutdown_connections 2024-09-19T09:38:12.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.665+0000 7f419cded740 1 --2- 172.21.15.1:0/3622198183 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576bc6fa680 0x5576bc711df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.665+0000 7f419cded740 1 --2- 172.21.15.1:0/3622198183 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576bc6efdc0 0x5576bc7118b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.665+0000 7f419cded740 1 --2- 172.21.15.1:0/3622198183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5576bc6ef4a0 0x5576bc7064b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.665+0000 7f419cded740 1 -- 172.21.15.1:0/3622198183 >> 172.21.15.1:0/3622198183 conn(0x5576bc6eba30 msgr2=0x5576bc6f28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:12.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.665+0000 7f419cded740 1 -- 172.21.15.1:0/3622198183 shutdown_connections 2024-09-19T09:38:12.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.665+0000 7f419cded740 1 -- 172.21.15.1:0/3622198183 wait complete. 2024-09-19T09:38:12.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.665+0000 7f419cded740 1 -- start start 2024-09-19T09:38:12.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.665+0000 7f419cded740 1 Processor -- start 2024-09-19T09:38:12.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.666+0000 7f419cded740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5576bc6ef4a0 0x5576bc702ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:12.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.666+0000 7f419cded740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576bc6efdc0 0x5576bc6fde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:12.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.666+0000 7f419cded740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576bc6fa680 0x5576bc6fe3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:12.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.666+0000 7f419cded740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f41941ac370 con 0x5576bc6fa680 2024-09-19T09:38:12.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.666+0000 7f419cded740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f41941ad7e0 con 0x5576bc6ef4a0 2024-09-19T09:38:12.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.666+0000 7f419cded740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f41941aca40 con 0x5576bc6efdc0 2024-09-19T09:38:12.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.666+0000 7f419cded740 10 client.0 _ll_register_callbacks cb 0x7f4184005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:12.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.666+0000 7f4198fb1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576bc6fa680 0x5576bc6fe3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:12.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.666+0000 7f4198fb1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576bc6fa680 0x5576bc6fe3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33800/0 (socket says 172.21.15.1:33800) 2024-09-19T09:38:12.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.666+0000 7f4198fb1640 1 -- 172.21.15.1:0/397756972 learned_addr learned my addr 172.21.15.1:0/397756972 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:12.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.666+0000 7f4193fff640 1 --2- 172.21.15.1:0/397756972 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5576bc6ef4a0 0x5576bc702ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:12.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.666+0000 7f41937fe640 1 --2- 172.21.15.1:0/397756972 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576bc6efdc0 0x5576bc6fde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:12.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.666+0000 7f4198fb1640 1 -- 172.21.15.1:0/397756972 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576bc6efdc0 msgr2=0x5576bc6fde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:12.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.666+0000 7f4198fb1640 1 --2- 172.21.15.1:0/397756972 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576bc6efdc0 0x5576bc6fde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.666+0000 7f4198fb1640 1 -- 172.21.15.1:0/397756972 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5576bc6ef4a0 msgr2=0x5576bc702ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:12.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.666+0000 7f4198fb1640 1 --2- 172.21.15.1:0/397756972 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5576bc6ef4a0 0x5576bc702ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.666+0000 7f4198fb1640 1 -- 172.21.15.1:0/397756972 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576bc6ec6c0 con 0x5576bc6fa680 2024-09-19T09:38:12.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.666+0000 7f41937fe640 1 --2- 172.21.15.1:0/397756972 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576bc6efdc0 0x5576bc6fde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:12.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.666+0000 7f4198fb1640 1 --2- 172.21.15.1:0/397756972 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576bc6fa680 0x5576bc6fe3a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f418c009ca0 tx=0x7f418c041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70173a09c96ba01d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:12.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.666+0000 7f41737fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:38:12.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.666+0000 7f41737fe640 1 -- 172.21.15.1:0/397756972 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418c056060 con 0x5576bc6fa680 2024-09-19T09:38:12.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.666+0000 7f41737fe640 1 -- 172.21.15.1:0/397756972 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f418c0305c0 con 0x5576bc6fa680 2024-09-19T09:38:12.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.667+0000 7f419cded740 1 -- 172.21.15.1:0/397756972 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f418809c230 con 0x5576bc6fa680 2024-09-19T09:38:12.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.667+0000 7f41737fe640 1 -- 172.21.15.1:0/397756972 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f418c0307c0 con 0x5576bc6fa680 2024-09-19T09:38:12.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.667+0000 7f419cded740 10 client.15168 fetch_fsmap learned FSMap version 19 2024-09-19T09:38:12.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.667+0000 7f419cded740 1 -- 172.21.15.1:0/397756972 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5576bc774430 con 0x5576bc6fa680 2024-09-19T09:38:12.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.667+0000 7f41737fe640 1 -- 172.21.15.1:0/397756972 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f418809c230 con 0x5576bc6fa680 2024-09-19T09:38:12.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.667+0000 7f41737fe640 1 -- 172.21.15.1:0/397756972 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f418c0488c0 con 0x5576bc6fa680 2024-09-19T09:38:12.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.667+0000 7f419cded740 10 client.15168 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:38:12.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.667+0000 7f419cded740 10 client.15168 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:38:12.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.667+0000 7f419cded740 20 client.15168 populate_metadata read hostname 'smithi001' 2024-09-19T09:38:12.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.667+0000 7f419cded740 1 --2- 172.21.15.1:0/397756972 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5576bc774bb0 0x5576bc776fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:12.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.667+0000 7f419cded740 4 client.15168 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:38:12.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.667+0000 7f419cded740 1 -- 172.21.15.1:0/397756972 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5576bc5d9210 con 0x5576bc774bb0 2024-09-19T09:38:12.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.667+0000 7f4193fff640 1 --2- 172.21.15.1:0/397756972 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5576bc774bb0 0x5576bc776fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:12.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.668+0000 7f4193fff640 1 --2- 172.21.15.1:0/397756972 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5576bc774bb0 0x5576bc776fd0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e4ffc88b15a81f1 server_cookie=b9e0fa325b12f5f4 in_seq=0 out_seq=0 2024-09-19T09:38:12.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.668+0000 7f41737fe640 10 client.15168 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:12.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.668+0000 7f41737fe640 1 -- 172.21.15.1:0/397756972 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5576bc5d9210 con 0x5576bc774bb0 2024-09-19T09:38:12.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.668+0000 7f41737fe640 10 client.15168 handle_command_reply: tid=0 2024-09-19T09:38:12.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.668+0000 7f419cded740 1 client.15168 shutdown 2024-09-19T09:38:12.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.668+0000 7f419cded740 1 -- 172.21.15.1:0/397756972 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576bc6fa680 msgr2=0x5576bc6fe3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:12.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.668+0000 7f419cded740 1 --2- 172.21.15.1:0/397756972 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576bc6fa680 0x5576bc6fe3a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f418c009ca0 tx=0x7f418c041000 comp rx=0 tx=0).stop 2024-09-19T09:38:12.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.668+0000 7f419cded740 1 -- 172.21.15.1:0/397756972 shutdown_connections 2024-09-19T09:38:12.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.668+0000 7f419cded740 1 --2- 172.21.15.1:0/397756972 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5576bc774bb0 0x5576bc776fd0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.668+0000 7f419cded740 1 --2- 172.21.15.1:0/397756972 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5576bc6fa680 0x5576bc6fe3a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.668+0000 7f419cded740 1 --2- 172.21.15.1:0/397756972 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576bc6efdc0 0x5576bc6fde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.668+0000 7f419cded740 1 --2- 172.21.15.1:0/397756972 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5576bc6ef4a0 0x5576bc702ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.668+0000 7f419cded740 1 -- 172.21.15.1:0/397756972 >> 172.21.15.1:0/397756972 conn(0x5576bc6eba30 msgr2=0x5576bc6f0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:12.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.668+0000 7f41737fe640 0 client.15168 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:12.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.668+0000 7f419cded740 1 -- 172.21.15.1:0/397756972 shutdown_connections 2024-09-19T09:38:12.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.668+0000 7f419cded740 1 -- 172.21.15.1:0/397756972 wait complete. 2024-09-19T09:38:12.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.668+0000 7f419cded740 20 client.15168 trim_cache size 0 max 16384 2024-09-19T09:38:12.676 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:38:12.676 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:38:12.677 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": { 2024-09-19T09:38:12.677 INFO:teuthology.orchestra.run.smithi001.stdout: "827df52d-23c2-4460-9e49-bb383ee25192": { 2024-09-19T09:38:12.677 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-19T09:38:12.677 INFO:teuthology.orchestra.run.smithi001.stdout: "tag": "827df52d-23c2-4460-9e49-bb383ee25192", 2024-09-19T09:38:12.677 INFO:teuthology.orchestra.run.smithi001.stdout: "options": "recursive,force" 2024-09-19T09:38:12.677 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:38:12.677 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:38:12.677 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:38:12.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.669+0000 7f419aa14640 1 -- 172.21.15.1:0/401762150 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f417c0a32c0 msgr2=0x7f417c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:12.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.669+0000 7f419aa14640 1 --2- 172.21.15.1:0/401762150 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f417c0a32c0 0x7f417c0a5780 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f418c005e30 tx=0x7f418c0095c0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.669+0000 7f419aa14640 1 -- 172.21.15.1:0/401762150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4194102790 msgr2=0x7f4194198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:12.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.669+0000 7f419aa14640 1 --2- 172.21.15.1:0/401762150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4194102790 0x7f4194198930 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f418800d950 tx=0x7f418800de10 comp rx=0 tx=0).stop 2024-09-19T09:38:12.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.669+0000 7f419aa14640 1 -- 172.21.15.1:0/401762150 shutdown_connections 2024-09-19T09:38:12.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.669+0000 7f419aa14640 1 --2- 172.21.15.1:0/401762150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4194106f10 0x7f419419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.669+0000 7f419aa14640 1 --2- 172.21.15.1:0/401762150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4194102790 0x7f4194198930 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.669+0000 7f419aa14640 1 --2- 172.21.15.1:0/401762150 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f417c0a32c0 0x7f417c0a5780 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.669+0000 7f419aa14640 1 --2- 172.21.15.1:0/401762150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4194101de0 0x7f41941983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:12.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.669+0000 7f419aa14640 1 -- 172.21.15.1:0/401762150 >> 172.21.15.1:0/401762150 conn(0x7f41940fd8c0 msgr2=0x7f41940feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:12.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.669+0000 7f419aa14640 1 -- 172.21.15.1:0/401762150 shutdown_connections 2024-09-19T09:38:12.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:12.669+0000 7f419aa14640 1 -- 172.21.15.1:0/401762150 wait complete. 2024-09-19T09:38:13.401 INFO:tasks.cephfs.filesystem:scrub status for tag:827df52d-23c2-4460-9e49-bb383ee25192 - {'path': '/', 'tag': '827df52d-23c2-4460-9e49-bb383ee25192', 'options': 'recursive,force'} 2024-09-19T09:38:13.443 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:13.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:13 smithi001 ceph-mon[31225]: pgmap v342: 97 pgs: 97 active+clean; 645 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T09:38:13.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:13 smithi001 ceph-mon[31225]: scrub summary: idle 2024-09-19T09:38:13.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:13 smithi022 ceph-mon[35583]: pgmap v342: 97 pgs: 97 active+clean; 645 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T09:38:13.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:13 smithi022 ceph-mon[35583]: scrub summary: idle 2024-09-19T09:38:13.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:13 smithi121 ceph-mon[35577]: pgmap v342: 97 pgs: 97 active+clean; 645 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T09:38:13.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:13 smithi121 ceph-mon[35577]: scrub summary: idle 2024-09-19T09:38:13.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.881+0000 7fcc43d30640 1 -- 172.21.15.1:0/1860372499 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc3c101420 msgr2=0x7fcc3c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:13.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.881+0000 7fcc43d30640 1 --2- 172.21.15.1:0/1860372499 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc3c101420 0x7fcc3c10d950 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fcc34009cd0 tx=0x7fcc3402a8e0 comp rx=0 tx=0).stop 2024-09-19T09:38:13.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.881+0000 7fcc43d30640 1 -- 172.21.15.1:0/1860372499 shutdown_connections 2024-09-19T09:38:13.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.881+0000 7fcc43d30640 1 --2- 172.21.15.1:0/1860372499 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc3c101420 0x7fcc3c10d950 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:13.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.881+0000 7fcc43d30640 1 --2- 172.21.15.1:0/1860372499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc3c100a80 0x7fcc3c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:13.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.881+0000 7fcc43d30640 1 --2- 172.21.15.1:0/1860372499 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc3c106a80 0x7fcc3c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:13.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.881+0000 7fcc43d30640 1 -- 172.21.15.1:0/1860372499 >> 172.21.15.1:0/1860372499 conn(0x7fcc3c0fc7a0 msgr2=0x7fcc3c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:13.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.881+0000 7fcc43d30640 1 -- 172.21.15.1:0/1860372499 shutdown_connections 2024-09-19T09:38:13.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.881+0000 7fcc43d30640 1 -- 172.21.15.1:0/1860372499 wait complete. 2024-09-19T09:38:13.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.882+0000 7fcc43d30640 1 Processor -- start 2024-09-19T09:38:13.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.882+0000 7fcc43d30640 1 -- start start 2024-09-19T09:38:13.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.882+0000 7fcc43d30640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc3c100a80 0x7fcc3c1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:13.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.882+0000 7fcc43d30640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc3c101420 0x7fcc3c198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:13.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.882+0000 7fcc43d30640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc3c106a80 0x7fcc3c19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:13.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.882+0000 7fcc43d30640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c110ef0 con 0x7fcc3c101420 2024-09-19T09:38:13.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.882+0000 7fcc43d30640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c110d70 con 0x7fcc3c106a80 2024-09-19T09:38:13.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.882+0000 7fcc43d30640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c111070 con 0x7fcc3c100a80 2024-09-19T09:38:13.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.882+0000 7fcc412cb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc3c101420 0x7fcc3c198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:13.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.882+0000 7fcc412cb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc3c101420 0x7fcc3c198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33820/0 (socket says 172.21.15.1:33820) 2024-09-19T09:38:13.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.882+0000 7fcc412cb640 1 -- 172.21.15.1:0/3622386043 learned_addr learned my addr 172.21.15.1:0/3622386043 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:13.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.882+0000 7fcc41acc640 1 --2- 172.21.15.1:0/3622386043 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc3c100a80 0x7fcc3c1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:13.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.883+0000 7fcc422cd640 1 --2- 172.21.15.1:0/3622386043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc3c106a80 0x7fcc3c19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:13.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.883+0000 7fcc412cb640 1 -- 172.21.15.1:0/3622386043 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc3c100a80 msgr2=0x7fcc3c1984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:13.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.883+0000 7fcc412cb640 1 --2- 172.21.15.1:0/3622386043 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc3c100a80 0x7fcc3c1984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:13.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.883+0000 7fcc412cb640 1 -- 172.21.15.1:0/3622386043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc3c106a80 msgr2=0x7fcc3c19cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:13.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.883+0000 7fcc412cb640 1 --2- 172.21.15.1:0/3622386043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc3c106a80 0x7fcc3c19cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:13.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.883+0000 7fcc412cb640 1 -- 172.21.15.1:0/3622386043 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc3c19d480 con 0x7fcc3c101420 2024-09-19T09:38:13.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.883+0000 7fcc412cb640 1 --2- 172.21.15.1:0/3622386043 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc3c101420 0x7fcc3c198a10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c00d950 tx=0x7fcc2c00dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:13.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.883+0000 7fcc32ffd640 1 -- 172.21.15.1:0/3622386043 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c017070 con 0x7fcc3c101420 2024-09-19T09:38:13.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.883+0000 7fcc43d30640 1 -- 172.21.15.1:0/3622386043 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc3c19d770 con 0x7fcc3c101420 2024-09-19T09:38:13.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.883+0000 7fcc32ffd640 1 -- 172.21.15.1:0/3622386043 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc2c00de80 con 0x7fcc3c101420 2024-09-19T09:38:13.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.883+0000 7fcc32ffd640 1 -- 172.21.15.1:0/3622386043 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c00f620 con 0x7fcc3c101420 2024-09-19T09:38:13.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.883+0000 7fcc43d30640 1 -- 172.21.15.1:0/3622386043 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc3c1a5050 con 0x7fcc3c101420 2024-09-19T09:38:13.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.884+0000 7fcc43d30640 1 -- 172.21.15.1:0/3622386043 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc3c100ee0 con 0x7fcc3c101420 2024-09-19T09:38:13.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.885+0000 7fcc32ffd640 1 -- 172.21.15.1:0/3622386043 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fcc2c009c30 con 0x7fcc3c101420 2024-09-19T09:38:13.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.886+0000 7fcc32ffd640 1 --2- 172.21.15.1:0/3622386043 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fcc280a3240 0x7fcc280a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:13.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.886+0000 7fcc32ffd640 1 -- 172.21.15.1:0/3622386043 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fcc2c0cf510 con 0x7fcc3c101420 2024-09-19T09:38:13.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.886+0000 7fcc41acc640 1 --2- 172.21.15.1:0/3622386043 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fcc280a3240 0x7fcc280a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:13.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.887+0000 7fcc41acc640 1 --2- 172.21.15.1:0/3622386043 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fcc280a3240 0x7fcc280a5700 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcc38009990 tx=0x7fcc38009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:13.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:13.889+0000 7fcc32ffd640 1 -- 172.21.15.1:0/3622386043 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcc2c09c230 con 0x7fcc3c101420 2024-09-19T09:38:14.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:14.062+0000 7fcc43d30640 1 -- 172.21.15.1:0/3622386043 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcc3c06af40 con 0x7fcc280a3240 2024-09-19T09:38:14.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:14.068+0000 7fcc32ffd640 1 -- 172.21.15.1:0/3622386043 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259004 (secure 0 0 0) 0x7fcc3c06af40 con 0x7fcc280a3240 2024-09-19T09:38:14.072 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:38:14.073 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-19T09:38:14.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:14.071+0000 7fcc43d30640 1 -- 172.21.15.1:0/3622386043 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fcc280a3240 msgr2=0x7fcc280a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:14.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:14.071+0000 7fcc43d30640 1 --2- 172.21.15.1:0/3622386043 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fcc280a3240 0x7fcc280a5700 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcc38009990 tx=0x7fcc38009110 comp rx=0 tx=0).stop 2024-09-19T09:38:14.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:14.071+0000 7fcc43d30640 1 -- 172.21.15.1:0/3622386043 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc3c101420 msgr2=0x7fcc3c198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:14.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:14.071+0000 7fcc43d30640 1 --2- 172.21.15.1:0/3622386043 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc3c101420 0x7fcc3c198a10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c00d950 tx=0x7fcc2c00dd50 comp rx=0 tx=0).stop 2024-09-19T09:38:14.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:14.071+0000 7fcc43d30640 1 -- 172.21.15.1:0/3622386043 shutdown_connections 2024-09-19T09:38:14.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:14.071+0000 7fcc43d30640 1 --2- 172.21.15.1:0/3622386043 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fcc280a3240 0x7fcc280a5700 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:14.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:14.071+0000 7fcc43d30640 1 --2- 172.21.15.1:0/3622386043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc3c106a80 0x7fcc3c19cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:14.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:14.071+0000 7fcc43d30640 1 --2- 172.21.15.1:0/3622386043 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc3c101420 0x7fcc3c198a10 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:14.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:14.071+0000 7fcc43d30640 1 --2- 172.21.15.1:0/3622386043 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc3c100a80 0x7fcc3c1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:14.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:14.071+0000 7fcc43d30640 1 -- 172.21.15.1:0/3622386043 >> 172.21.15.1:0/3622386043 conn(0x7fcc3c0fc7a0 msgr2=0x7fcc3c06a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:14.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:14.071+0000 7fcc43d30640 1 -- 172.21.15.1:0/3622386043 shutdown_connections 2024-09-19T09:38:14.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:14.071+0000 7fcc43d30640 1 -- 172.21.15.1:0/3622386043 wait complete. 2024-09-19T09:38:14.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:14 smithi001 ceph-mon[31225]: from='client.15174 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:38:14.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:14 smithi022 ceph-mon[35583]: from='client.15174 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:38:14.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:14 smithi121 ceph-mon[35577]: from='client.15174 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:38:14.899 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":342,"stamp":"2024-09-19T09:38:12.159023+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660149,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":361,"num_read_kb":297,"num_write":277,"num_write_kb":3039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":716,"ondisk_log_size":716,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":405976,"kb_used_data":10968,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124535848,"statfs":{"total":1151940427776,"available":1151524708352,"internally_reserved":0,"allocated":11231232,"data_stored":7273647,"data_compressed":178359,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19141,"internal_metadata":404272443},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5681,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":22,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002798"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147034+0000","last_change":"2024-09-19T09:36:12.985228+0000","last_active":"2024-09-19T09:37:44.147034+0000","last_peered":"2024-09-19T09:37:44.147034+0000","last_clean":"2024-09-19T09:37:44.147034+0000","last_became_active":"2024-09-19T09:36:12.984306+0000","last_became_peered":"2024-09-19T09:36:12.984306+0000","last_unstale":"2024-09-19T09:37:44.147034+0000","last_undegraded":"2024-09-19T09:37:44.147034+0000","last_fullsized":"2024-09-19T09:37:44.147034+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:45.988859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145651+0000","last_change":"2024-09-19T09:36:12.987631+0000","last_active":"2024-09-19T09:37:44.145651+0000","last_peered":"2024-09-19T09:37:44.145651+0000","last_clean":"2024-09-19T09:37:44.145651+0000","last_became_active":"2024-09-19T09:36:12.987298+0000","last_became_peered":"2024-09-19T09:36:12.987298+0000","last_unstale":"2024-09-19T09:37:44.145651+0000","last_undegraded":"2024-09-19T09:37:44.145651+0000","last_fullsized":"2024-09-19T09:37:44.145651+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:47.397162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.161196+0000","last_change":"2024-09-19T09:36:12.991466+0000","last_active":"2024-09-19T09:37:44.161196+0000","last_peered":"2024-09-19T09:37:44.161196+0000","last_clean":"2024-09-19T09:37:44.161196+0000","last_became_active":"2024-09-19T09:36:12.990903+0000","last_became_peered":"2024-09-19T09:36:12.990903+0000","last_unstale":"2024-09-19T09:37:44.161196+0000","last_undegraded":"2024-09-19T09:37:44.161196+0000","last_fullsized":"2024-09-19T09:37:44.161196+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:04.128768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.150215+0000","last_change":"2024-09-19T09:36:12.986686+0000","last_active":"2024-09-19T09:37:44.150215+0000","last_peered":"2024-09-19T09:37:44.150215+0000","last_clean":"2024-09-19T09:37:44.150215+0000","last_became_active":"2024-09-19T09:36:12.986334+0000","last_became_peered":"2024-09-19T09:36:12.986334+0000","last_unstale":"2024-09-19T09:37:44.150215+0000","last_undegraded":"2024-09-19T09:37:44.150215+0000","last_fullsized":"2024-09-19T09:37:44.150215+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:39.926343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.139116+0000","last_change":"2024-09-19T09:36:12.981964+0000","last_active":"2024-09-19T09:37:44.139116+0000","last_peered":"2024-09-19T09:37:44.139116+0000","last_clean":"2024-09-19T09:37:44.139116+0000","last_became_active":"2024-09-19T09:36:12.981558+0000","last_became_peered":"2024-09-19T09:36:12.981558+0000","last_unstale":"2024-09-19T09:37:44.139116+0000","last_undegraded":"2024-09-19T09:37:44.139116+0000","last_fullsized":"2024-09-19T09:37:44.139116+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:33.706451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146524+0000","last_change":"2024-09-19T09:36:12.992598+0000","last_active":"2024-09-19T09:37:44.146524+0000","last_peered":"2024-09-19T09:37:44.146524+0000","last_clean":"2024-09-19T09:37:44.146524+0000","last_became_active":"2024-09-19T09:36:12.992281+0000","last_became_peered":"2024-09-19T09:36:12.992281+0000","last_unstale":"2024-09-19T09:37:44.146524+0000","last_undegraded":"2024-09-19T09:37:44.146524+0000","last_fullsized":"2024-09-19T09:37:44.146524+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:26.107432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146663+0000","last_change":"2024-09-19T09:36:12.988583+0000","last_active":"2024-09-19T09:37:44.146663+0000","last_peered":"2024-09-19T09:37:44.146663+0000","last_clean":"2024-09-19T09:37:44.146663+0000","last_became_active":"2024-09-19T09:36:12.987895+0000","last_became_peered":"2024-09-19T09:36:12.987895+0000","last_unstale":"2024-09-19T09:37:44.146663+0000","last_undegraded":"2024-09-19T09:37:44.146663+0000","last_fullsized":"2024-09-19T09:37:44.146663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:47.617324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.141930+0000","last_change":"2024-09-19T09:36:12.988526+0000","last_active":"2024-09-19T09:37:44.141930+0000","last_peered":"2024-09-19T09:37:44.141930+0000","last_clean":"2024-09-19T09:37:44.141930+0000","last_became_active":"2024-09-19T09:36:12.988093+0000","last_became_peered":"2024-09-19T09:36:12.988093+0000","last_unstale":"2024-09-19T09:37:44.141930+0000","last_undegraded":"2024-09-19T09:37:44.141930+0000","last_fullsized":"2024-09-19T09:37:44.141930+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:48.949397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.157907+0000","last_change":"2024-09-19T09:36:12.992360+0000","last_active":"2024-09-19T09:37:44.157907+0000","last_peered":"2024-09-19T09:37:44.157907+0000","last_clean":"2024-09-19T09:37:44.157907+0000","last_became_active":"2024-09-19T09:36:12.991833+0000","last_became_peered":"2024-09-19T09:36:12.991833+0000","last_unstale":"2024-09-19T09:37:44.157907+0000","last_undegraded":"2024-09-19T09:37:44.157907+0000","last_fullsized":"2024-09-19T09:37:44.157907+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:47.715012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.144515+0000","last_change":"2024-09-19T09:36:12.993435+0000","last_active":"2024-09-19T09:37:44.144515+0000","last_peered":"2024-09-19T09:37:44.144515+0000","last_clean":"2024-09-19T09:37:44.144515+0000","last_became_active":"2024-09-19T09:36:12.993108+0000","last_became_peered":"2024-09-19T09:36:12.993108+0000","last_unstale":"2024-09-19T09:37:44.144515+0000","last_undegraded":"2024-09-19T09:37:44.144515+0000","last_fullsized":"2024-09-19T09:37:44.144515+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:54.453593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.162293+0000","last_change":"2024-09-19T09:36:12.991044+0000","last_active":"2024-09-19T09:37:44.162293+0000","last_peered":"2024-09-19T09:37:44.162293+0000","last_clean":"2024-09-19T09:37:44.162293+0000","last_became_active":"2024-09-19T09:36:12.989955+0000","last_became_peered":"2024-09-19T09:36:12.989955+0000","last_unstale":"2024-09-19T09:37:44.162293+0000","last_undegraded":"2024-09-19T09:37:44.162293+0000","last_fullsized":"2024-09-19T09:37:44.162293+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:21.034023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148886+0000","last_change":"2024-09-19T09:36:12.989679+0000","last_active":"2024-09-19T09:37:44.148886+0000","last_peered":"2024-09-19T09:37:44.148886+0000","last_clean":"2024-09-19T09:37:44.148886+0000","last_became_active":"2024-09-19T09:36:12.988463+0000","last_became_peered":"2024-09-19T09:36:12.988463+0000","last_unstale":"2024-09-19T09:37:44.148886+0000","last_undegraded":"2024-09-19T09:37:44.148886+0000","last_fullsized":"2024-09-19T09:37:44.148886+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:28.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.144722+0000","last_change":"2024-09-19T09:36:12.983494+0000","last_active":"2024-09-19T09:37:44.144722+0000","last_peered":"2024-09-19T09:37:44.144722+0000","last_clean":"2024-09-19T09:37:44.144722+0000","last_became_active":"2024-09-19T09:36:12.983143+0000","last_became_peered":"2024-09-19T09:36:12.983143+0000","last_unstale":"2024-09-19T09:37:44.144722+0000","last_undegraded":"2024-09-19T09:37:44.144722+0000","last_fullsized":"2024-09-19T09:37:44.144722+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:23.378183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.143385+0000","last_change":"2024-09-19T09:36:12.987512+0000","last_active":"2024-09-19T09:37:44.143385+0000","last_peered":"2024-09-19T09:37:44.143385+0000","last_clean":"2024-09-19T09:37:44.143385+0000","last_became_active":"2024-09-19T09:36:12.987288+0000","last_became_peered":"2024-09-19T09:36:12.987288+0000","last_unstale":"2024-09-19T09:37:44.143385+0000","last_undegraded":"2024-09-19T09:37:44.143385+0000","last_fullsized":"2024-09-19T09:37:44.143385+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:14.614333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147801+0000","last_change":"2024-09-19T09:37:16.131000+0000","last_active":"2024-09-19T09:37:44.147801+0000","last_peered":"2024-09-19T09:37:44.147801+0000","last_clean":"2024-09-19T09:37:44.147801+0000","last_became_active":"2024-09-19T09:37:16.130647+0000","last_became_peered":"2024-09-19T09:37:16.130647+0000","last_unstale":"2024-09-19T09:37:44.147801+0000","last_undegraded":"2024-09-19T09:37:44.147801+0000","last_fullsized":"2024-09-19T09:37:44.147801+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:22.498318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.162539+0000","last_change":"2024-09-19T09:36:12.988210+0000","last_active":"2024-09-19T09:37:44.162539+0000","last_peered":"2024-09-19T09:37:44.162539+0000","last_clean":"2024-09-19T09:37:44.162539+0000","last_became_active":"2024-09-19T09:36:12.987904+0000","last_became_peered":"2024-09-19T09:36:12.987904+0000","last_unstale":"2024-09-19T09:37:44.162539+0000","last_undegraded":"2024-09-19T09:37:44.162539+0000","last_fullsized":"2024-09-19T09:37:44.162539+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:13.588237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147356+0000","last_change":"2024-09-19T09:36:12.984028+0000","last_active":"2024-09-19T09:37:44.147356+0000","last_peered":"2024-09-19T09:37:44.147356+0000","last_clean":"2024-09-19T09:37:44.147356+0000","last_became_active":"2024-09-19T09:36:12.982062+0000","last_became_peered":"2024-09-19T09:36:12.982062+0000","last_unstale":"2024-09-19T09:37:44.147356+0000","last_undegraded":"2024-09-19T09:37:44.147356+0000","last_fullsized":"2024-09-19T09:37:44.147356+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:26.610287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.141161+0000","last_change":"2024-09-19T09:36:12.979277+0000","last_active":"2024-09-19T09:37:44.141161+0000","last_peered":"2024-09-19T09:37:44.141161+0000","last_clean":"2024-09-19T09:37:44.141161+0000","last_became_active":"2024-09-19T09:36:12.978970+0000","last_became_peered":"2024-09-19T09:36:12.978970+0000","last_unstale":"2024-09-19T09:37:44.141161+0000","last_undegraded":"2024-09-19T09:37:44.141161+0000","last_fullsized":"2024-09-19T09:37:44.141161+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:00.424728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147432+0000","last_change":"2024-09-19T09:36:12.981021+0000","last_active":"2024-09-19T09:37:44.147432+0000","last_peered":"2024-09-19T09:37:44.147432+0000","last_clean":"2024-09-19T09:37:44.147432+0000","last_became_active":"2024-09-19T09:36:12.980580+0000","last_became_peered":"2024-09-19T09:36:12.980580+0000","last_unstale":"2024-09-19T09:37:44.147432+0000","last_undegraded":"2024-09-19T09:37:44.147432+0000","last_fullsized":"2024-09-19T09:37:44.147432+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:17.464873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.143924+0000","last_change":"2024-09-19T09:36:12.986090+0000","last_active":"2024-09-19T09:37:44.143924+0000","last_peered":"2024-09-19T09:37:44.143924+0000","last_clean":"2024-09-19T09:37:44.143924+0000","last_became_active":"2024-09-19T09:36:12.985740+0000","last_became_peered":"2024-09-19T09:36:12.985740+0000","last_unstale":"2024-09-19T09:37:44.143924+0000","last_undegraded":"2024-09-19T09:37:44.143924+0000","last_fullsized":"2024-09-19T09:37:44.143924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:35.252834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145367+0000","last_change":"2024-09-19T09:36:12.981257+0000","last_active":"2024-09-19T09:37:44.145367+0000","last_peered":"2024-09-19T09:37:44.145367+0000","last_clean":"2024-09-19T09:37:44.145367+0000","last_became_active":"2024-09-19T09:36:12.980911+0000","last_became_peered":"2024-09-19T09:36:12.980911+0000","last_unstale":"2024-09-19T09:37:44.145367+0000","last_undegraded":"2024-09-19T09:37:44.145367+0000","last_fullsized":"2024-09-19T09:37:44.145367+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:41.470514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.161076+0000","last_change":"2024-09-19T09:36:12.982585+0000","last_active":"2024-09-19T09:37:44.161076+0000","last_peered":"2024-09-19T09:37:44.161076+0000","last_clean":"2024-09-19T09:37:44.161076+0000","last_became_active":"2024-09-19T09:36:12.982193+0000","last_became_peered":"2024-09-19T09:36:12.982193+0000","last_unstale":"2024-09-19T09:37:44.161076+0000","last_undegraded":"2024-09-19T09:37:44.161076+0000","last_fullsized":"2024-09-19T09:37:44.161076+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:30.057088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.143208+0000","last_change":"2024-09-19T09:36:12.985236+0000","last_active":"2024-09-19T09:37:44.143208+0000","last_peered":"2024-09-19T09:37:44.143208+0000","last_clean":"2024-09-19T09:37:44.143208+0000","last_became_active":"2024-09-19T09:36:12.984751+0000","last_became_peered":"2024-09-19T09:36:12.984751+0000","last_unstale":"2024-09-19T09:37:44.143208+0000","last_undegraded":"2024-09-19T09:37:44.143208+0000","last_fullsized":"2024-09-19T09:37:44.143208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:52.784216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.138535+0000","last_change":"2024-09-19T09:36:12.985856+0000","last_active":"2024-09-19T09:37:44.138535+0000","last_peered":"2024-09-19T09:37:44.138535+0000","last_clean":"2024-09-19T09:37:44.138535+0000","last_became_active":"2024-09-19T09:36:12.985312+0000","last_became_peered":"2024-09-19T09:36:12.985312+0000","last_unstale":"2024-09-19T09:37:44.138535+0000","last_undegraded":"2024-09-19T09:37:44.138535+0000","last_fullsized":"2024-09-19T09:37:44.138535+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:25.235945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.142807+0000","last_change":"2024-09-19T09:36:12.982443+0000","last_active":"2024-09-19T09:37:44.142807+0000","last_peered":"2024-09-19T09:37:44.142807+0000","last_clean":"2024-09-19T09:37:44.142807+0000","last_became_active":"2024-09-19T09:36:12.982130+0000","last_became_peered":"2024-09-19T09:36:12.982130+0000","last_unstale":"2024-09-19T09:37:44.142807+0000","last_undegraded":"2024-09-19T09:37:44.142807+0000","last_fullsized":"2024-09-19T09:37:44.142807+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:17.177563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145567+0000","last_change":"2024-09-19T09:36:12.990439+0000","last_active":"2024-09-19T09:37:44.145567+0000","last_peered":"2024-09-19T09:37:44.145567+0000","last_clean":"2024-09-19T09:37:44.145567+0000","last_became_active":"2024-09-19T09:36:12.990135+0000","last_became_peered":"2024-09-19T09:36:12.990135+0000","last_unstale":"2024-09-19T09:37:44.145567+0000","last_undegraded":"2024-09-19T09:37:44.145567+0000","last_fullsized":"2024-09-19T09:37:44.145567+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:51.685192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145105+0000","last_change":"2024-09-19T09:36:12.987261+0000","last_active":"2024-09-19T09:37:44.145105+0000","last_peered":"2024-09-19T09:37:44.145105+0000","last_clean":"2024-09-19T09:37:44.145105+0000","last_became_active":"2024-09-19T09:36:12.986192+0000","last_became_peered":"2024-09-19T09:36:12.986192+0000","last_unstale":"2024-09-19T09:37:44.145105+0000","last_undegraded":"2024-09-19T09:37:44.145105+0000","last_fullsized":"2024-09-19T09:37:44.145105+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:58.435605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.141377+0000","last_change":"2024-09-19T09:36:12.981248+0000","last_active":"2024-09-19T09:37:44.141377+0000","last_peered":"2024-09-19T09:37:44.141377+0000","last_clean":"2024-09-19T09:37:44.141377+0000","last_became_active":"2024-09-19T09:36:12.980754+0000","last_became_peered":"2024-09-19T09:36:12.980754+0000","last_unstale":"2024-09-19T09:37:44.141377+0000","last_undegraded":"2024-09-19T09:37:44.141377+0000","last_fullsized":"2024-09-19T09:37:44.141377+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:03.970402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.139500+0000","last_change":"2024-09-19T09:36:12.990841+0000","last_active":"2024-09-19T09:37:44.139500+0000","last_peered":"2024-09-19T09:37:44.139500+0000","last_clean":"2024-09-19T09:37:44.139500+0000","last_became_active":"2024-09-19T09:36:12.989667+0000","last_became_peered":"2024-09-19T09:36:12.989667+0000","last_unstale":"2024-09-19T09:37:44.139500+0000","last_undegraded":"2024-09-19T09:37:44.139500+0000","last_fullsized":"2024-09-19T09:37:44.139500+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:46:00.314590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148537+0000","last_change":"2024-09-19T09:36:12.984007+0000","last_active":"2024-09-19T09:37:44.148537+0000","last_peered":"2024-09-19T09:37:44.148537+0000","last_clean":"2024-09-19T09:37:44.148537+0000","last_became_active":"2024-09-19T09:36:12.983627+0000","last_became_peered":"2024-09-19T09:36:12.983627+0000","last_unstale":"2024-09-19T09:37:44.148537+0000","last_undegraded":"2024-09-19T09:37:44.148537+0000","last_fullsized":"2024-09-19T09:37:44.148537+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:42.038673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146461+0000","last_change":"2024-09-19T09:36:12.988032+0000","last_active":"2024-09-19T09:37:44.146461+0000","last_peered":"2024-09-19T09:37:44.146461+0000","last_clean":"2024-09-19T09:37:44.146461+0000","last_became_active":"2024-09-19T09:36:12.987588+0000","last_became_peered":"2024-09-19T09:36:12.987588+0000","last_unstale":"2024-09-19T09:37:44.146461+0000","last_undegraded":"2024-09-19T09:37:44.146461+0000","last_fullsized":"2024-09-19T09:37:44.146461+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:01.518543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148152+0000","last_change":"2024-09-19T09:37:16.131565+0000","last_active":"2024-09-19T09:37:44.148152+0000","last_peered":"2024-09-19T09:37:44.148152+0000","last_clean":"2024-09-19T09:37:44.148152+0000","last_became_active":"2024-09-19T09:37:16.131171+0000","last_became_peered":"2024-09-19T09:37:16.131171+0000","last_unstale":"2024-09-19T09:37:44.148152+0000","last_undegraded":"2024-09-19T09:37:44.148152+0000","last_fullsized":"2024-09-19T09:37:44.148152+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:18.195074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.141174+0000","last_change":"2024-09-19T09:36:12.989709+0000","last_active":"2024-09-19T09:37:44.141174+0000","last_peered":"2024-09-19T09:37:44.141174+0000","last_clean":"2024-09-19T09:37:44.141174+0000","last_became_active":"2024-09-19T09:36:12.989324+0000","last_became_peered":"2024-09-19T09:36:12.989324+0000","last_unstale":"2024-09-19T09:37:44.141174+0000","last_undegraded":"2024-09-19T09:37:44.141174+0000","last_fullsized":"2024-09-19T09:37:44.141174+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:09.843175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.033713+0000","last_change":"2024-09-19T09:37:16.033713+0000","last_active":"2024-09-19T09:37:16.033713+0000","last_peered":"2024-09-19T09:37:16.033713+0000","last_clean":"2024-09-19T09:37:16.033713+0000","last_became_active":"2024-09-19T09:37:16.033230+0000","last_became_peered":"2024-09-19T09:37:16.033230+0000","last_unstale":"2024-09-19T09:37:16.033713+0000","last_undegraded":"2024-09-19T09:37:16.033713+0000","last_fullsized":"2024-09-19T09:37:16.033713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:12.262115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.143084+0000","last_change":"2024-09-19T09:37:16.484760+0000","last_active":"2024-09-19T09:37:44.143084+0000","last_peered":"2024-09-19T09:37:44.143084+0000","last_clean":"2024-09-19T09:37:44.143084+0000","last_became_active":"2024-09-19T09:37:16.484316+0000","last_became_peered":"2024-09-19T09:37:16.484316+0000","last_unstale":"2024-09-19T09:37:44.143084+0000","last_undegraded":"2024-09-19T09:37:44.143084+0000","last_fullsized":"2024-09-19T09:37:44.143084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:14.897601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.124818+0000","last_change":"2024-09-19T09:37:16.124818+0000","last_active":"2024-09-19T09:37:16.124818+0000","last_peered":"2024-09-19T09:37:16.124818+0000","last_clean":"2024-09-19T09:37:16.124818+0000","last_became_active":"2024-09-19T09:37:16.124391+0000","last_became_peered":"2024-09-19T09:37:16.124391+0000","last_unstale":"2024-09-19T09:37:16.124818+0000","last_undegraded":"2024-09-19T09:37:16.124818+0000","last_fullsized":"2024-09-19T09:37:16.124818+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:25.443666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034105+0000","last_change":"2024-09-19T09:36:10.837287+0000","last_active":"2024-09-19T09:37:16.034105+0000","last_peered":"2024-09-19T09:37:16.034105+0000","last_clean":"2024-09-19T09:37:16.034105+0000","last_became_active":"2024-09-19T09:36:10.836890+0000","last_became_peered":"2024-09-19T09:36:10.836890+0000","last_unstale":"2024-09-19T09:37:16.034105+0000","last_undegraded":"2024-09-19T09:37:16.034105+0000","last_fullsized":"2024-09-19T09:37:16.034105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:09.676728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.139992+0000","last_change":"2024-09-19T09:36:12.975690+0000","last_active":"2024-09-19T09:37:44.139992+0000","last_peered":"2024-09-19T09:37:44.139992+0000","last_clean":"2024-09-19T09:37:44.139992+0000","last_became_active":"2024-09-19T09:36:12.975370+0000","last_became_peered":"2024-09-19T09:36:12.975370+0000","last_unstale":"2024-09-19T09:37:44.139992+0000","last_undegraded":"2024-09-19T09:37:44.139992+0000","last_fullsized":"2024-09-19T09:37:44.139992+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:05.650917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030234+0000","last_change":"2024-09-19T09:36:10.843736+0000","last_active":"2024-09-19T09:37:16.030234+0000","last_peered":"2024-09-19T09:37:16.030234+0000","last_clean":"2024-09-19T09:37:16.030234+0000","last_became_active":"2024-09-19T09:36:10.843353+0000","last_became_peered":"2024-09-19T09:36:10.843353+0000","last_unstale":"2024-09-19T09:37:16.030234+0000","last_undegraded":"2024-09-19T09:37:16.030234+0000","last_fullsized":"2024-09-19T09:37:16.030234+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:29.818642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.140596+0000","last_change":"2024-09-19T09:36:12.978841+0000","last_active":"2024-09-19T09:37:44.140596+0000","last_peered":"2024-09-19T09:37:44.140596+0000","last_clean":"2024-09-19T09:37:44.140596+0000","last_became_active":"2024-09-19T09:36:12.978501+0000","last_became_peered":"2024-09-19T09:36:12.978501+0000","last_unstale":"2024-09-19T09:37:44.140596+0000","last_undegraded":"2024-09-19T09:37:44.140596+0000","last_fullsized":"2024-09-19T09:37:44.140596+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:07.974576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.032030+0000","last_change":"2024-09-19T09:36:10.841997+0000","last_active":"2024-09-19T09:37:16.032030+0000","last_peered":"2024-09-19T09:37:16.032030+0000","last_clean":"2024-09-19T09:37:16.032030+0000","last_became_active":"2024-09-19T09:36:10.841641+0000","last_became_peered":"2024-09-19T09:36:10.841641+0000","last_unstale":"2024-09-19T09:37:16.032030+0000","last_undegraded":"2024-09-19T09:37:16.032030+0000","last_fullsized":"2024-09-19T09:37:16.032030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:10.477879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.156072+0000","last_change":"2024-09-19T09:36:12.981486+0000","last_active":"2024-09-19T09:37:44.156072+0000","last_peered":"2024-09-19T09:37:44.156072+0000","last_clean":"2024-09-19T09:37:44.156072+0000","last_became_active":"2024-09-19T09:36:12.981165+0000","last_became_peered":"2024-09-19T09:36:12.981165+0000","last_unstale":"2024-09-19T09:37:44.156072+0000","last_undegraded":"2024-09-19T09:37:44.156072+0000","last_fullsized":"2024-09-19T09:37:44.156072+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:21.986132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030755+0000","last_change":"2024-09-19T09:36:10.845362+0000","last_active":"2024-09-19T09:37:16.030755+0000","last_peered":"2024-09-19T09:37:16.030755+0000","last_clean":"2024-09-19T09:37:16.030755+0000","last_became_active":"2024-09-19T09:36:10.844992+0000","last_became_peered":"2024-09-19T09:36:10.844992+0000","last_unstale":"2024-09-19T09:37:16.030755+0000","last_undegraded":"2024-09-19T09:37:16.030755+0000","last_fullsized":"2024-09-19T09:37:16.030755+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:52.854333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.137951+0000","last_change":"2024-09-19T09:36:12.988924+0000","last_active":"2024-09-19T09:37:44.137951+0000","last_peered":"2024-09-19T09:37:44.137951+0000","last_clean":"2024-09-19T09:37:44.137951+0000","last_became_active":"2024-09-19T09:36:12.988331+0000","last_became_peered":"2024-09-19T09:36:12.988331+0000","last_unstale":"2024-09-19T09:37:44.137951+0000","last_undegraded":"2024-09-19T09:37:44.137951+0000","last_fullsized":"2024-09-19T09:37:44.137951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:24.754252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029903+0000","last_change":"2024-09-19T09:36:10.860003+0000","last_active":"2024-09-19T09:37:16.029903+0000","last_peered":"2024-09-19T09:37:16.029903+0000","last_clean":"2024-09-19T09:37:16.029903+0000","last_became_active":"2024-09-19T09:36:10.859584+0000","last_became_peered":"2024-09-19T09:36:10.859584+0000","last_unstale":"2024-09-19T09:37:16.029903+0000","last_undegraded":"2024-09-19T09:37:16.029903+0000","last_fullsized":"2024-09-19T09:37:16.029903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:44.837960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.160481+0000","last_change":"2024-09-19T09:36:12.985446+0000","last_active":"2024-09-19T09:37:44.160481+0000","last_peered":"2024-09-19T09:37:44.160481+0000","last_clean":"2024-09-19T09:37:44.160481+0000","last_became_active":"2024-09-19T09:36:12.984671+0000","last_became_peered":"2024-09-19T09:36:12.984671+0000","last_unstale":"2024-09-19T09:37:44.160481+0000","last_undegraded":"2024-09-19T09:37:44.160481+0000","last_fullsized":"2024-09-19T09:37:44.160481+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:54.800151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'33","reported_seq":284,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:38:10.122276+0000","last_change":"2024-09-19T09:36:10.841056+0000","last_active":"2024-09-19T09:38:10.122276+0000","last_peered":"2024-09-19T09:38:10.122276+0000","last_clean":"2024-09-19T09:38:10.122276+0000","last_became_active":"2024-09-19T09:36:10.840731+0000","last_became_peered":"2024-09-19T09:36:10.840731+0000","last_unstale":"2024-09-19T09:38:10.122276+0000","last_undegraded":"2024-09-19T09:38:10.122276+0000","last_fullsized":"2024-09-19T09:38:10.122276+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:13.676188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68749,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":229,"num_read_kb":182,"num_write":33,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146672+0000","last_change":"2024-09-19T09:36:12.990223+0000","last_active":"2024-09-19T09:37:44.146672+0000","last_peered":"2024-09-19T09:37:44.146672+0000","last_clean":"2024-09-19T09:37:44.146672+0000","last_became_active":"2024-09-19T09:36:12.989720+0000","last_became_peered":"2024-09-19T09:36:12.989720+0000","last_unstale":"2024-09-19T09:37:44.146672+0000","last_undegraded":"2024-09-19T09:37:44.146672+0000","last_fullsized":"2024-09-19T09:37:44.146672+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:37.003075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.129753+0000","last_change":"2024-09-19T09:36:10.843288+0000","last_active":"2024-09-19T09:37:16.129753+0000","last_peered":"2024-09-19T09:37:16.129753+0000","last_clean":"2024-09-19T09:37:16.129753+0000","last_became_active":"2024-09-19T09:36:10.842844+0000","last_became_peered":"2024-09-19T09:36:10.842844+0000","last_unstale":"2024-09-19T09:37:16.129753+0000","last_undegraded":"2024-09-19T09:37:16.129753+0000","last_fullsized":"2024-09-19T09:37:16.129753+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:38.695411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145354+0000","last_change":"2024-09-19T09:36:12.981251+0000","last_active":"2024-09-19T09:37:44.145354+0000","last_peered":"2024-09-19T09:37:44.145354+0000","last_clean":"2024-09-19T09:37:44.145354+0000","last_became_active":"2024-09-19T09:36:12.980861+0000","last_became_peered":"2024-09-19T09:36:12.980861+0000","last_unstale":"2024-09-19T09:37:44.145354+0000","last_undegraded":"2024-09-19T09:37:44.145354+0000","last_fullsized":"2024-09-19T09:37:44.145354+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:09.633644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030128+0000","last_change":"2024-09-19T09:36:10.843448+0000","last_active":"2024-09-19T09:37:16.030128+0000","last_peered":"2024-09-19T09:37:16.030128+0000","last_clean":"2024-09-19T09:37:16.030128+0000","last_became_active":"2024-09-19T09:36:10.843087+0000","last_became_peered":"2024-09-19T09:36:10.843087+0000","last_unstale":"2024-09-19T09:37:16.030128+0000","last_undegraded":"2024-09-19T09:37:16.030128+0000","last_fullsized":"2024-09-19T09:37:16.030128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:20.623613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.151910+0000","last_change":"2024-09-19T09:36:12.981160+0000","last_active":"2024-09-19T09:37:44.151910+0000","last_peered":"2024-09-19T09:37:44.151910+0000","last_clean":"2024-09-19T09:37:44.151910+0000","last_became_active":"2024-09-19T09:36:12.980823+0000","last_became_peered":"2024-09-19T09:36:12.980823+0000","last_unstale":"2024-09-19T09:37:44.151910+0000","last_undegraded":"2024-09-19T09:37:44.151910+0000","last_fullsized":"2024-09-19T09:37:44.151910+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:39.323439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028480+0000","last_change":"2024-09-19T09:36:10.842536+0000","last_active":"2024-09-19T09:37:16.028480+0000","last_peered":"2024-09-19T09:37:16.028480+0000","last_clean":"2024-09-19T09:37:16.028480+0000","last_became_active":"2024-09-19T09:36:10.842176+0000","last_became_peered":"2024-09-19T09:36:10.842176+0000","last_unstale":"2024-09-19T09:37:16.028480+0000","last_undegraded":"2024-09-19T09:37:16.028480+0000","last_fullsized":"2024-09-19T09:37:16.028480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:37.871299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145814+0000","last_change":"2024-09-19T09:36:12.987271+0000","last_active":"2024-09-19T09:37:44.145814+0000","last_peered":"2024-09-19T09:37:44.145814+0000","last_clean":"2024-09-19T09:37:44.145814+0000","last_became_active":"2024-09-19T09:36:12.986918+0000","last_became_peered":"2024-09-19T09:36:12.986918+0000","last_unstale":"2024-09-19T09:37:44.145814+0000","last_undegraded":"2024-09-19T09:37:44.145814+0000","last_fullsized":"2024-09-19T09:37:44.145814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:07.608541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030337+0000","last_change":"2024-09-19T09:36:10.860370+0000","last_active":"2024-09-19T09:37:16.030337+0000","last_peered":"2024-09-19T09:37:16.030337+0000","last_clean":"2024-09-19T09:37:16.030337+0000","last_became_active":"2024-09-19T09:36:10.859820+0000","last_became_peered":"2024-09-19T09:36:10.859820+0000","last_unstale":"2024-09-19T09:37:16.030337+0000","last_undegraded":"2024-09-19T09:37:16.030337+0000","last_fullsized":"2024-09-19T09:37:16.030337+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:12.121038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.161919+0000","last_change":"2024-09-19T09:36:12.994449+0000","last_active":"2024-09-19T09:37:44.161919+0000","last_peered":"2024-09-19T09:37:44.161919+0000","last_clean":"2024-09-19T09:37:44.161919+0000","last_became_active":"2024-09-19T09:36:12.994141+0000","last_became_peered":"2024-09-19T09:36:12.994141+0000","last_unstale":"2024-09-19T09:37:44.161919+0000","last_undegraded":"2024-09-19T09:37:44.161919+0000","last_fullsized":"2024-09-19T09:37:44.161919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:21.416453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031764+0000","last_change":"2024-09-19T09:36:10.839609+0000","last_active":"2024-09-19T09:37:16.031764+0000","last_peered":"2024-09-19T09:37:16.031764+0000","last_clean":"2024-09-19T09:37:16.031764+0000","last_became_active":"2024-09-19T09:36:10.839227+0000","last_became_peered":"2024-09-19T09:36:10.839227+0000","last_unstale":"2024-09-19T09:37:16.031764+0000","last_undegraded":"2024-09-19T09:37:16.031764+0000","last_fullsized":"2024-09-19T09:37:16.031764+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:00.734924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.144996+0000","last_change":"2024-09-19T09:36:12.983573+0000","last_active":"2024-09-19T09:37:44.144996+0000","last_peered":"2024-09-19T09:37:44.144996+0000","last_clean":"2024-09-19T09:37:44.144996+0000","last_became_active":"2024-09-19T09:36:12.983241+0000","last_became_peered":"2024-09-19T09:36:12.983241+0000","last_unstale":"2024-09-19T09:37:44.144996+0000","last_undegraded":"2024-09-19T09:37:44.144996+0000","last_fullsized":"2024-09-19T09:37:44.144996+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:44.050271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034765+0000","last_change":"2024-09-19T09:36:10.839789+0000","last_active":"2024-09-19T09:37:16.034765+0000","last_peered":"2024-09-19T09:37:16.034765+0000","last_clean":"2024-09-19T09:37:16.034765+0000","last_became_active":"2024-09-19T09:36:10.839445+0000","last_became_peered":"2024-09-19T09:36:10.839445+0000","last_unstale":"2024-09-19T09:37:16.034765+0000","last_undegraded":"2024-09-19T09:37:16.034765+0000","last_fullsized":"2024-09-19T09:37:16.034765+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:16.040249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148829+0000","last_change":"2024-09-19T09:36:12.993420+0000","last_active":"2024-09-19T09:37:44.148829+0000","last_peered":"2024-09-19T09:37:44.148829+0000","last_clean":"2024-09-19T09:37:44.148829+0000","last_became_active":"2024-09-19T09:36:12.992334+0000","last_became_peered":"2024-09-19T09:36:12.992334+0000","last_unstale":"2024-09-19T09:37:44.148829+0000","last_undegraded":"2024-09-19T09:37:44.148829+0000","last_fullsized":"2024-09-19T09:37:44.148829+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:21.693164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030247+0000","last_change":"2024-09-19T09:36:10.839461+0000","last_active":"2024-09-19T09:37:16.030247+0000","last_peered":"2024-09-19T09:37:16.030247+0000","last_clean":"2024-09-19T09:37:16.030247+0000","last_became_active":"2024-09-19T09:36:10.839092+0000","last_became_peered":"2024-09-19T09:36:10.839092+0000","last_unstale":"2024-09-19T09:37:16.030247+0000","last_undegraded":"2024-09-19T09:37:16.030247+0000","last_fullsized":"2024-09-19T09:37:16.030247+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:02.367267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145214+0000","last_change":"2024-09-19T09:36:12.988234+0000","last_active":"2024-09-19T09:37:44.145214+0000","last_peered":"2024-09-19T09:37:44.145214+0000","last_clean":"2024-09-19T09:37:44.145214+0000","last_became_active":"2024-09-19T09:36:12.987813+0000","last_became_peered":"2024-09-19T09:36:12.987813+0000","last_unstale":"2024-09-19T09:37:44.145214+0000","last_undegraded":"2024-09-19T09:37:44.145214+0000","last_fullsized":"2024-09-19T09:37:44.145214+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:56.024428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.130482+0000","last_change":"2024-09-19T09:36:10.945705+0000","last_active":"2024-09-19T09:37:16.130482+0000","last_peered":"2024-09-19T09:37:16.130482+0000","last_clean":"2024-09-19T09:37:16.130482+0000","last_became_active":"2024-09-19T09:36:10.945323+0000","last_became_peered":"2024-09-19T09:36:10.945323+0000","last_unstale":"2024-09-19T09:37:16.130482+0000","last_undegraded":"2024-09-19T09:37:16.130482+0000","last_fullsized":"2024-09-19T09:37:16.130482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:24.211909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.162179+0000","last_change":"2024-09-19T09:36:12.990517+0000","last_active":"2024-09-19T09:37:44.162179+0000","last_peered":"2024-09-19T09:37:44.162179+0000","last_clean":"2024-09-19T09:37:44.162179+0000","last_became_active":"2024-09-19T09:36:12.989291+0000","last_became_peered":"2024-09-19T09:36:12.989291+0000","last_unstale":"2024-09-19T09:37:44.162179+0000","last_undegraded":"2024-09-19T09:37:44.162179+0000","last_fullsized":"2024-09-19T09:37:44.162179+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:31.087798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":339,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030377+0000","last_change":"2024-09-19T09:34:59.337025+0000","last_active":"2024-09-19T09:37:16.030377+0000","last_peered":"2024-09-19T09:37:16.030377+0000","last_clean":"2024-09-19T09:37:16.030377+0000","last_became_active":"2024-09-19T09:34:59.336556+0000","last_became_peered":"2024-09-19T09:34:59.336556+0000","last_unstale":"2024-09-19T09:37:16.030377+0000","last_undegraded":"2024-09-19T09:37:16.030377+0000","last_fullsized":"2024-09-19T09:37:16.030377+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:31:30.566923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:31:30.566923+0000","last_clean_scrub_stamp":"2024-09-19T09:31:30.566923+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:00.675254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028715+0000","last_change":"2024-09-19T09:36:10.838131+0000","last_active":"2024-09-19T09:37:16.028715+0000","last_peered":"2024-09-19T09:37:16.028715+0000","last_clean":"2024-09-19T09:37:16.028715+0000","last_became_active":"2024-09-19T09:36:10.837725+0000","last_became_peered":"2024-09-19T09:36:10.837725+0000","last_unstale":"2024-09-19T09:37:16.028715+0000","last_undegraded":"2024-09-19T09:37:16.028715+0000","last_fullsized":"2024-09-19T09:37:16.028715+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:57.104726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.139840+0000","last_change":"2024-09-19T09:36:12.981951+0000","last_active":"2024-09-19T09:37:44.139840+0000","last_peered":"2024-09-19T09:37:44.139840+0000","last_clean":"2024-09-19T09:37:44.139840+0000","last_became_active":"2024-09-19T09:36:12.981558+0000","last_became_peered":"2024-09-19T09:36:12.981558+0000","last_unstale":"2024-09-19T09:37:44.139840+0000","last_undegraded":"2024-09-19T09:37:44.139840+0000","last_fullsized":"2024-09-19T09:37:44.139840+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:31.119853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030184+0000","last_change":"2024-09-19T09:36:10.843574+0000","last_active":"2024-09-19T09:37:16.030184+0000","last_peered":"2024-09-19T09:37:16.030184+0000","last_clean":"2024-09-19T09:37:16.030184+0000","last_became_active":"2024-09-19T09:36:10.843252+0000","last_became_peered":"2024-09-19T09:36:10.843252+0000","last_unstale":"2024-09-19T09:37:16.030184+0000","last_undegraded":"2024-09-19T09:37:16.030184+0000","last_fullsized":"2024-09-19T09:37:16.030184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:10.492812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147324+0000","last_change":"2024-09-19T09:36:12.984538+0000","last_active":"2024-09-19T09:37:44.147324+0000","last_peered":"2024-09-19T09:37:44.147324+0000","last_clean":"2024-09-19T09:37:44.147324+0000","last_became_active":"2024-09-19T09:36:12.983448+0000","last_became_peered":"2024-09-19T09:36:12.983448+0000","last_unstale":"2024-09-19T09:37:44.147324+0000","last_undegraded":"2024-09-19T09:37:44.147324+0000","last_fullsized":"2024-09-19T09:37:44.147324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:48.294473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034208+0000","last_change":"2024-09-19T09:36:10.858959+0000","last_active":"2024-09-19T09:37:16.034208+0000","last_peered":"2024-09-19T09:37:16.034208+0000","last_clean":"2024-09-19T09:37:16.034208+0000","last_became_active":"2024-09-19T09:36:10.858638+0000","last_became_peered":"2024-09-19T09:36:10.858638+0000","last_unstale":"2024-09-19T09:37:16.034208+0000","last_undegraded":"2024-09-19T09:37:16.034208+0000","last_fullsized":"2024-09-19T09:37:16.034208+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:12.646483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.142955+0000","last_change":"2024-09-19T09:36:12.992710+0000","last_active":"2024-09-19T09:37:44.142955+0000","last_peered":"2024-09-19T09:37:44.142955+0000","last_clean":"2024-09-19T09:37:44.142955+0000","last_became_active":"2024-09-19T09:36:12.992436+0000","last_became_peered":"2024-09-19T09:36:12.992436+0000","last_unstale":"2024-09-19T09:37:44.142955+0000","last_undegraded":"2024-09-19T09:37:44.142955+0000","last_fullsized":"2024-09-19T09:37:44.142955+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:51.685516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030475+0000","last_change":"2024-09-19T09:36:10.842031+0000","last_active":"2024-09-19T09:37:16.030475+0000","last_peered":"2024-09-19T09:37:16.030475+0000","last_clean":"2024-09-19T09:37:16.030475+0000","last_became_active":"2024-09-19T09:36:10.841693+0000","last_became_peered":"2024-09-19T09:36:10.841693+0000","last_unstale":"2024-09-19T09:37:16.030475+0000","last_undegraded":"2024-09-19T09:37:16.030475+0000","last_fullsized":"2024-09-19T09:37:16.030475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:28:51.040551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.138330+0000","last_change":"2024-09-19T09:37:16.034026+0000","last_active":"2024-09-19T09:37:44.138330+0000","last_peered":"2024-09-19T09:37:44.138330+0000","last_clean":"2024-09-19T09:37:44.138330+0000","last_became_active":"2024-09-19T09:37:16.033546+0000","last_became_peered":"2024-09-19T09:37:16.033546+0000","last_unstale":"2024-09-19T09:37:44.138330+0000","last_undegraded":"2024-09-19T09:37:44.138330+0000","last_fullsized":"2024-09-19T09:37:44.138330+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:42.673825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.027885+0000","last_change":"2024-09-19T09:36:10.860470+0000","last_active":"2024-09-19T09:37:16.027885+0000","last_peered":"2024-09-19T09:37:16.027885+0000","last_clean":"2024-09-19T09:37:16.027885+0000","last_became_active":"2024-09-19T09:36:10.860097+0000","last_became_peered":"2024-09-19T09:36:10.860097+0000","last_unstale":"2024-09-19T09:37:16.027885+0000","last_undegraded":"2024-09-19T09:37:16.027885+0000","last_fullsized":"2024-09-19T09:37:16.027885+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:14.933378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.139200+0000","last_change":"2024-09-19T09:36:12.988489+0000","last_active":"2024-09-19T09:37:44.139200+0000","last_peered":"2024-09-19T09:37:44.139200+0000","last_clean":"2024-09-19T09:37:44.139200+0000","last_became_active":"2024-09-19T09:36:12.988151+0000","last_became_peered":"2024-09-19T09:36:12.988151+0000","last_unstale":"2024-09-19T09:37:44.139200+0000","last_undegraded":"2024-09-19T09:37:44.139200+0000","last_fullsized":"2024-09-19T09:37:44.139200+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:24.088771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030844+0000","last_change":"2024-09-19T09:36:10.860103+0000","last_active":"2024-09-19T09:37:16.030844+0000","last_peered":"2024-09-19T09:37:16.030844+0000","last_clean":"2024-09-19T09:37:16.030844+0000","last_became_active":"2024-09-19T09:36:10.859526+0000","last_became_peered":"2024-09-19T09:36:10.859526+0000","last_unstale":"2024-09-19T09:37:16.030844+0000","last_undegraded":"2024-09-19T09:37:16.030844+0000","last_fullsized":"2024-09-19T09:37:16.030844+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:25.460372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148110+0000","last_change":"2024-09-19T09:36:12.986286+0000","last_active":"2024-09-19T09:37:44.148110+0000","last_peered":"2024-09-19T09:37:44.148110+0000","last_clean":"2024-09-19T09:37:44.148110+0000","last_became_active":"2024-09-19T09:36:12.985982+0000","last_became_peered":"2024-09-19T09:36:12.985982+0000","last_unstale":"2024-09-19T09:37:44.148110+0000","last_undegraded":"2024-09-19T09:37:44.148110+0000","last_fullsized":"2024-09-19T09:37:44.148110+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:19.026134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'12","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.989217+0000","last_change":"2024-09-19T09:36:10.839280+0000","last_active":"2024-09-19T09:37:44.989217+0000","last_peered":"2024-09-19T09:37:44.989217+0000","last_clean":"2024-09-19T09:37:44.989217+0000","last_became_active":"2024-09-19T09:36:10.838979+0000","last_became_peered":"2024-09-19T09:36:10.838979+0000","last_unstale":"2024-09-19T09:37:44.989217+0000","last_undegraded":"2024-09-19T09:37:44.989217+0000","last_fullsized":"2024-09-19T09:37:44.989217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:06.303175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146091+0000","last_change":"2024-09-19T09:36:12.979778+0000","last_active":"2024-09-19T09:37:44.146091+0000","last_peered":"2024-09-19T09:37:44.146091+0000","last_clean":"2024-09-19T09:37:44.146091+0000","last_became_active":"2024-09-19T09:36:12.979455+0000","last_became_peered":"2024-09-19T09:36:12.979455+0000","last_unstale":"2024-09-19T09:37:44.146091+0000","last_undegraded":"2024-09-19T09:37:44.146091+0000","last_fullsized":"2024-09-19T09:37:44.146091+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:36.620368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029063+0000","last_change":"2024-09-19T09:36:10.945706+0000","last_active":"2024-09-19T09:37:16.029063+0000","last_peered":"2024-09-19T09:37:16.029063+0000","last_clean":"2024-09-19T09:37:16.029063+0000","last_became_active":"2024-09-19T09:36:10.945314+0000","last_became_peered":"2024-09-19T09:36:10.945314+0000","last_unstale":"2024-09-19T09:37:16.029063+0000","last_undegraded":"2024-09-19T09:37:16.029063+0000","last_fullsized":"2024-09-19T09:37:16.029063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:49.786913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.141688+0000","last_change":"2024-09-19T09:36:12.989412+0000","last_active":"2024-09-19T09:37:44.141688+0000","last_peered":"2024-09-19T09:37:44.141688+0000","last_clean":"2024-09-19T09:37:44.141688+0000","last_became_active":"2024-09-19T09:36:12.989109+0000","last_became_peered":"2024-09-19T09:36:12.989109+0000","last_unstale":"2024-09-19T09:37:44.141688+0000","last_undegraded":"2024-09-19T09:37:44.141688+0000","last_fullsized":"2024-09-19T09:37:44.141688+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:33.142592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.123342+0000","last_change":"2024-09-19T09:36:10.858581+0000","last_active":"2024-09-19T09:37:16.123342+0000","last_peered":"2024-09-19T09:37:16.123342+0000","last_clean":"2024-09-19T09:37:16.123342+0000","last_became_active":"2024-09-19T09:36:10.858240+0000","last_became_peered":"2024-09-19T09:36:10.858240+0000","last_unstale":"2024-09-19T09:37:16.123342+0000","last_undegraded":"2024-09-19T09:37:16.123342+0000","last_fullsized":"2024-09-19T09:37:16.123342+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:45.285839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.111050+0000","last_change":"2024-09-19T09:36:12.989075+0000","last_active":"2024-09-19T09:37:44.111050+0000","last_peered":"2024-09-19T09:37:44.111050+0000","last_clean":"2024-09-19T09:37:44.111050+0000","last_became_active":"2024-09-19T09:36:12.988752+0000","last_became_peered":"2024-09-19T09:36:12.988752+0000","last_unstale":"2024-09-19T09:37:44.111050+0000","last_undegraded":"2024-09-19T09:37:44.111050+0000","last_fullsized":"2024-09-19T09:37:44.111050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.424032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.483353+0000","last_change":"2024-09-19T09:36:10.838716+0000","last_active":"2024-09-19T09:37:16.483353+0000","last_peered":"2024-09-19T09:37:16.483353+0000","last_clean":"2024-09-19T09:37:16.483353+0000","last_became_active":"2024-09-19T09:36:10.838393+0000","last_became_peered":"2024-09-19T09:36:10.838393+0000","last_unstale":"2024-09-19T09:37:16.483353+0000","last_undegraded":"2024-09-19T09:37:16.483353+0000","last_fullsized":"2024-09-19T09:37:16.483353+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:54.107223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147844+0000","last_change":"2024-09-19T09:36:12.991721+0000","last_active":"2024-09-19T09:37:44.147844+0000","last_peered":"2024-09-19T09:37:44.147844+0000","last_clean":"2024-09-19T09:37:44.147844+0000","last_became_active":"2024-09-19T09:36:12.991398+0000","last_became_peered":"2024-09-19T09:36:12.991398+0000","last_unstale":"2024-09-19T09:37:44.147844+0000","last_undegraded":"2024-09-19T09:37:44.147844+0000","last_fullsized":"2024-09-19T09:37:44.147844+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:19:31.312072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.485156+0000","last_change":"2024-09-19T09:37:16.484541+0000","last_active":"2024-09-19T09:37:16.485156+0000","last_peered":"2024-09-19T09:37:16.485156+0000","last_clean":"2024-09-19T09:37:16.485156+0000","last_became_active":"2024-09-19T09:37:16.484035+0000","last_became_peered":"2024-09-19T09:37:16.484035+0000","last_unstale":"2024-09-19T09:37:16.485156+0000","last_undegraded":"2024-09-19T09:37:16.485156+0000","last_fullsized":"2024-09-19T09:37:16.485156+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:36.332699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146414+0000","last_change":"2024-09-19T09:36:12.984180+0000","last_active":"2024-09-19T09:37:44.146414+0000","last_peered":"2024-09-19T09:37:44.146414+0000","last_clean":"2024-09-19T09:37:44.146414+0000","last_became_active":"2024-09-19T09:36:12.983876+0000","last_became_peered":"2024-09-19T09:36:12.983876+0000","last_unstale":"2024-09-19T09:37:44.146414+0000","last_undegraded":"2024-09-19T09:37:44.146414+0000","last_fullsized":"2024-09-19T09:37:44.146414+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:45.876771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031127+0000","last_change":"2024-09-19T09:36:10.845391+0000","last_active":"2024-09-19T09:37:16.031127+0000","last_peered":"2024-09-19T09:37:16.031127+0000","last_clean":"2024-09-19T09:37:16.031127+0000","last_became_active":"2024-09-19T09:36:10.844974+0000","last_became_peered":"2024-09-19T09:36:10.844974+0000","last_unstale":"2024-09-19T09:37:16.031127+0000","last_undegraded":"2024-09-19T09:37:16.031127+0000","last_fullsized":"2024-09-19T09:37:16.031127+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:00.318337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.162083+0000","last_change":"2024-09-19T09:36:12.991145+0000","last_active":"2024-09-19T09:37:44.162083+0000","last_peered":"2024-09-19T09:37:44.162083+0000","last_clean":"2024-09-19T09:37:44.162083+0000","last_became_active":"2024-09-19T09:36:12.989891+0000","last_became_peered":"2024-09-19T09:36:12.989891+0000","last_unstale":"2024-09-19T09:37:44.162083+0000","last_undegraded":"2024-09-19T09:37:44.162083+0000","last_fullsized":"2024-09-19T09:37:44.162083+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:21.054936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.162240+0000","last_change":"2024-09-19T09:36:12.995378+0000","last_active":"2024-09-19T09:37:44.162240+0000","last_peered":"2024-09-19T09:37:44.162240+0000","last_clean":"2024-09-19T09:37:44.162240+0000","last_became_active":"2024-09-19T09:36:12.995028+0000","last_became_peered":"2024-09-19T09:36:12.995028+0000","last_unstale":"2024-09-19T09:37:44.162240+0000","last_undegraded":"2024-09-19T09:37:44.162240+0000","last_fullsized":"2024-09-19T09:37:44.162240+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:41.102130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031259+0000","last_change":"2024-09-19T09:36:10.839595+0000","last_active":"2024-09-19T09:37:16.031259+0000","last_peered":"2024-09-19T09:37:16.031259+0000","last_clean":"2024-09-19T09:37:16.031259+0000","last_became_active":"2024-09-19T09:36:10.839196+0000","last_became_peered":"2024-09-19T09:36:10.839196+0000","last_unstale":"2024-09-19T09:37:16.031259+0000","last_undegraded":"2024-09-19T09:37:16.031259+0000","last_fullsized":"2024-09-19T09:37:16.031259+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:02.272731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.160402+0000","last_change":"2024-09-19T09:36:12.984485+0000","last_active":"2024-09-19T09:37:44.160402+0000","last_peered":"2024-09-19T09:37:44.160402+0000","last_clean":"2024-09-19T09:37:44.160402+0000","last_became_active":"2024-09-19T09:36:12.984004+0000","last_became_peered":"2024-09-19T09:36:12.984004+0000","last_unstale":"2024-09-19T09:37:44.160402+0000","last_undegraded":"2024-09-19T09:37:44.160402+0000","last_fullsized":"2024-09-19T09:37:44.160402+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:37.646776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030731+0000","last_change":"2024-09-19T09:36:10.845306+0000","last_active":"2024-09-19T09:37:16.030731+0000","last_peered":"2024-09-19T09:37:16.030731+0000","last_clean":"2024-09-19T09:37:16.030731+0000","last_became_active":"2024-09-19T09:36:10.844952+0000","last_became_peered":"2024-09-19T09:36:10.844952+0000","last_unstale":"2024-09-19T09:37:16.030731+0000","last_undegraded":"2024-09-19T09:37:16.030731+0000","last_fullsized":"2024-09-19T09:37:16.030731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:09.792482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.161016+0000","last_change":"2024-09-19T09:36:12.991260+0000","last_active":"2024-09-19T09:37:44.161016+0000","last_peered":"2024-09-19T09:37:44.161016+0000","last_clean":"2024-09-19T09:37:44.161016+0000","last_became_active":"2024-09-19T09:36:12.989981+0000","last_became_peered":"2024-09-19T09:36:12.989981+0000","last_unstale":"2024-09-19T09:37:44.161016+0000","last_undegraded":"2024-09-19T09:37:44.161016+0000","last_fullsized":"2024-09-19T09:37:44.161016+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:11.301790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.483925+0000","last_change":"2024-09-19T09:36:10.859016+0000","last_active":"2024-09-19T09:37:16.483925+0000","last_peered":"2024-09-19T09:37:16.483925+0000","last_clean":"2024-09-19T09:37:16.483925+0000","last_became_active":"2024-09-19T09:36:10.858661+0000","last_became_peered":"2024-09-19T09:36:10.858661+0000","last_unstale":"2024-09-19T09:37:16.483925+0000","last_undegraded":"2024-09-19T09:37:16.483925+0000","last_fullsized":"2024-09-19T09:37:16.483925+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:54.395977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148013+0000","last_change":"2024-09-19T09:37:16.131601+0000","last_active":"2024-09-19T09:37:44.148013+0000","last_peered":"2024-09-19T09:37:44.148013+0000","last_clean":"2024-09-19T09:37:44.148013+0000","last_became_active":"2024-09-19T09:37:16.131199+0000","last_became_peered":"2024-09-19T09:37:16.131199+0000","last_unstale":"2024-09-19T09:37:44.148013+0000","last_undegraded":"2024-09-19T09:37:44.148013+0000","last_fullsized":"2024-09-19T09:37:44.148013+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:27.358544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.039032+0000","last_change":"2024-09-19T09:37:16.039032+0000","last_active":"2024-09-19T09:37:16.039032+0000","last_peered":"2024-09-19T09:37:16.039032+0000","last_clean":"2024-09-19T09:37:16.039032+0000","last_became_active":"2024-09-19T09:37:16.035315+0000","last_became_peered":"2024-09-19T09:37:16.035315+0000","last_unstale":"2024-09-19T09:37:16.039032+0000","last_undegraded":"2024-09-19T09:37:16.039032+0000","last_fullsized":"2024-09-19T09:37:16.039032+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:58.795064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69547,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":235,"num_read_kb":188,"num_write":94,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":208641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77,"ondisk_log_size":77,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282954,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547238,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":441682,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776171,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1040384,"data_stored":1100528,"data_compressed":41852,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972400,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":441682,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201332,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":441704,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430266,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":1031585,"data_compressed":41852,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593791,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":441217,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822724,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":1031767,"data_compressed":41852,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953545,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":441122,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215183,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":913408,"data_stored":441438,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444115,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":978944,"data_stored":509883,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":974848,"data_stored":509849,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":441190,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":68749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":68783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:38:14.903 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T09:38:14.904 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T09:38:15.165 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:15.584 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:15 smithi001 ceph-mon[31225]: pgmap v343: 97 pgs: 97 active+clean; 645 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T09:38:15.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.659+0000 7f61b1d75640 1 -- 172.21.15.1:0/644320941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61ac1027a0 msgr2=0x7f61ac1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:15.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.659+0000 7f61b1d75640 1 --2- 172.21.15.1:0/644320941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61ac1027a0 0x7f61ac1067f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f61a0009900 tx=0x7f61a002a410 comp rx=0 tx=0).stop 2024-09-19T09:38:15.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.659+0000 7f61b1d75640 1 -- 172.21.15.1:0/644320941 shutdown_connections 2024-09-19T09:38:15.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.659+0000 7f61b1d75640 1 --2- 172.21.15.1:0/644320941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61ac106f20 0x7f61ac10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:15.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.659+0000 7f61b1d75640 1 --2- 172.21.15.1:0/644320941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61ac1027a0 0x7f61ac1067f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:15.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.659+0000 7f61b1d75640 1 --2- 172.21.15.1:0/644320941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61ac101df0 0x7f61ac1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:15.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.659+0000 7f61b1d75640 1 -- 172.21.15.1:0/644320941 >> 172.21.15.1:0/644320941 conn(0x7f61ac0fd8b0 msgr2=0x7f61ac0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:15.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.659+0000 7f61b1d75640 1 -- 172.21.15.1:0/644320941 shutdown_connections 2024-09-19T09:38:15.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.659+0000 7f61b1d75640 1 -- 172.21.15.1:0/644320941 wait complete. 2024-09-19T09:38:15.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.660+0000 7f61b1d75640 1 Processor -- start 2024-09-19T09:38:15.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.660+0000 7f61b1d75640 1 -- start start 2024-09-19T09:38:15.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.660+0000 7f61b1d75640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61ac101df0 0x7f61ac0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:15.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.660+0000 7f61b1d75640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61ac1027a0 0x7f61ac074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:15.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.661+0000 7f61b1d75640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61ac106f20 0x7f61ac074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:15.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.661+0000 7f61b1d75640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f61ac111f80 con 0x7f61ac101df0 2024-09-19T09:38:15.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.661+0000 7f61b1d75640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f61ac111e00 con 0x7f61ac106f20 2024-09-19T09:38:15.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.661+0000 7f61b1d75640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f61ac112100 con 0x7f61ac1027a0 2024-09-19T09:38:15.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.661+0000 7f61ab7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61ac101df0 0x7f61ac0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:15.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.661+0000 7f61ab7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61ac101df0 0x7f61ac0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53480/0 (socket says 172.21.15.1:53480) 2024-09-19T09:38:15.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.661+0000 7f61ab7fe640 1 -- 172.21.15.1:0/1524931039 learned_addr learned my addr 172.21.15.1:0/1524931039 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:15.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.661+0000 7f61aaffd640 1 --2- 172.21.15.1:0/1524931039 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61ac1027a0 0x7f61ac074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:15.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.661+0000 7f61abfff640 1 --2- 172.21.15.1:0/1524931039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61ac106f20 0x7f61ac074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:15.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.661+0000 7f61ab7fe640 1 -- 172.21.15.1:0/1524931039 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61ac1027a0 msgr2=0x7f61ac074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:15.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.661+0000 7f61ab7fe640 1 --2- 172.21.15.1:0/1524931039 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61ac1027a0 0x7f61ac074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:15.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.661+0000 7f61ab7fe640 1 -- 172.21.15.1:0/1524931039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61ac106f20 msgr2=0x7f61ac074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:15.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.661+0000 7f61ab7fe640 1 --2- 172.21.15.1:0/1524931039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61ac106f20 0x7f61ac074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:15.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.661+0000 7f61ab7fe640 1 -- 172.21.15.1:0/1524931039 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61ac1a68c0 con 0x7f61ac101df0 2024-09-19T09:38:15.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.661+0000 7f61ab7fe640 1 --2- 172.21.15.1:0/1524931039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61ac101df0 0x7f61ac0744f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f619c00d950 tx=0x7f619c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:15.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.661+0000 7f61a8ff9640 1 -- 172.21.15.1:0/1524931039 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619c017070 con 0x7f61ac101df0 2024-09-19T09:38:15.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.661+0000 7f61a8ff9640 1 -- 172.21.15.1:0/1524931039 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f619c009c30 con 0x7f61ac101df0 2024-09-19T09:38:15.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.661+0000 7f61b1d75640 1 -- 172.21.15.1:0/1524931039 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61ac1a6bb0 con 0x7f61ac101df0 2024-09-19T09:38:15.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.661+0000 7f61a8ff9640 1 -- 172.21.15.1:0/1524931039 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619c00f6b0 con 0x7f61ac101df0 2024-09-19T09:38:15.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.661+0000 7f61b1d75640 1 -- 172.21.15.1:0/1524931039 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61ac1a70c0 con 0x7f61ac101df0 2024-09-19T09:38:15.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.663+0000 7f61b1d75640 1 -- 172.21.15.1:0/1524931039 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61ac1021d0 con 0x7f61ac101df0 2024-09-19T09:38:15.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.664+0000 7f61a8ff9640 1 -- 172.21.15.1:0/1524931039 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f619c0109d0 con 0x7f61ac101df0 2024-09-19T09:38:15.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.664+0000 7f61a8ff9640 1 --2- 172.21.15.1:0/1524931039 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f61940a3240 0x7f61940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:15.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.665+0000 7f61a8ff9640 1 -- 172.21.15.1:0/1524931039 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f619c0cf4b0 con 0x7f61ac101df0 2024-09-19T09:38:15.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.665+0000 7f61aaffd640 1 --2- 172.21.15.1:0/1524931039 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f61940a3240 0x7f61940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:15.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.665+0000 7f61aaffd640 1 --2- 172.21.15.1:0/1524931039 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f61940a3240 0x7f61940a5700 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f61a0009230 tx=0x7f61a00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:15.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.669+0000 7f61a8ff9640 1 -- 172.21.15.1:0/1524931039 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f619c009de0 con 0x7f61ac101df0 2024-09-19T09:38:15.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.841+0000 7f61b1d75640 1 -- 172.21.15.1:0/1524931039 --> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f61ac10a1d0 con 0x7f61940a3240 2024-09-19T09:38:15.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.847+0000 7f61a8ff9640 1 -- 172.21.15.1:0/1524931039 <== mgr.14150 v2:172.21.15.1:6800/3871697789 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259004 (secure 0 0 0) 0x7f61a0031730 con 0x7f61940a3240 2024-09-19T09:38:15.851 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:38:15.852 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-09-19T09:38:15.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.850+0000 7f61b1d75640 1 -- 172.21.15.1:0/1524931039 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f61940a3240 msgr2=0x7f61940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:15.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.850+0000 7f61b1d75640 1 --2- 172.21.15.1:0/1524931039 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f61940a3240 0x7f61940a5700 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f61a0009230 tx=0x7f61a00058d0 comp rx=0 tx=0).stop 2024-09-19T09:38:15.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.850+0000 7f61b1d75640 1 -- 172.21.15.1:0/1524931039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61ac101df0 msgr2=0x7f61ac0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:15.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.850+0000 7f61b1d75640 1 --2- 172.21.15.1:0/1524931039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61ac101df0 0x7f61ac0744f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f619c00d950 tx=0x7f619c00de10 comp rx=0 tx=0).stop 2024-09-19T09:38:15.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.850+0000 7f61b1d75640 1 -- 172.21.15.1:0/1524931039 shutdown_connections 2024-09-19T09:38:15.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.850+0000 7f61b1d75640 1 --2- 172.21.15.1:0/1524931039 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f61940a3240 0x7f61940a5700 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:15.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.850+0000 7f61b1d75640 1 --2- 172.21.15.1:0/1524931039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61ac106f20 0x7f61ac074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:15.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.850+0000 7f61b1d75640 1 --2- 172.21.15.1:0/1524931039 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61ac1027a0 0x7f61ac074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:15.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.850+0000 7f61b1d75640 1 --2- 172.21.15.1:0/1524931039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f61ac101df0 0x7f61ac0744f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:15.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.850+0000 7f61b1d75640 1 -- 172.21.15.1:0/1524931039 >> 172.21.15.1:0/1524931039 conn(0x7f61ac0fd8b0 msgr2=0x7f61ac0feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:15.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.851+0000 7f61b1d75640 1 -- 172.21.15.1:0/1524931039 shutdown_connections 2024-09-19T09:38:15.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:15.851+0000 7f61b1d75640 1 -- 172.21.15.1:0/1524931039 wait complete. 2024-09-19T09:38:15.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:15 smithi022 ceph-mon[35583]: pgmap v343: 97 pgs: 97 active+clean; 645 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T09:38:15.866 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:15 smithi121 ceph-mon[35577]: pgmap v343: 97 pgs: 97 active+clean; 645 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-19T09:38:16.615 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-09-19T09:38:14.159465+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660149,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":361,"num_read_kb":297,"num_write":277,"num_write_kb":3039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1181318,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":716,"ondisk_log_size":716,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":405976,"kb_used_data":10968,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124535848,"statfs":{"total":1151940427776,"available":1151524708352,"internally_reserved":0,"allocated":11231232,"data_stored":7273647,"data_compressed":178359,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19141,"internal_metadata":404272443},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5681,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002761"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147034+0000","last_change":"2024-09-19T09:36:12.985228+0000","last_active":"2024-09-19T09:37:44.147034+0000","last_peered":"2024-09-19T09:37:44.147034+0000","last_clean":"2024-09-19T09:37:44.147034+0000","last_became_active":"2024-09-19T09:36:12.984306+0000","last_became_peered":"2024-09-19T09:36:12.984306+0000","last_unstale":"2024-09-19T09:37:44.147034+0000","last_undegraded":"2024-09-19T09:37:44.147034+0000","last_fullsized":"2024-09-19T09:37:44.147034+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:45.988859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145651+0000","last_change":"2024-09-19T09:36:12.987631+0000","last_active":"2024-09-19T09:37:44.145651+0000","last_peered":"2024-09-19T09:37:44.145651+0000","last_clean":"2024-09-19T09:37:44.145651+0000","last_became_active":"2024-09-19T09:36:12.987298+0000","last_became_peered":"2024-09-19T09:36:12.987298+0000","last_unstale":"2024-09-19T09:37:44.145651+0000","last_undegraded":"2024-09-19T09:37:44.145651+0000","last_fullsized":"2024-09-19T09:37:44.145651+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:47.397162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.161196+0000","last_change":"2024-09-19T09:36:12.991466+0000","last_active":"2024-09-19T09:37:44.161196+0000","last_peered":"2024-09-19T09:37:44.161196+0000","last_clean":"2024-09-19T09:37:44.161196+0000","last_became_active":"2024-09-19T09:36:12.990903+0000","last_became_peered":"2024-09-19T09:36:12.990903+0000","last_unstale":"2024-09-19T09:37:44.161196+0000","last_undegraded":"2024-09-19T09:37:44.161196+0000","last_fullsized":"2024-09-19T09:37:44.161196+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:04.128768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.150511+0000","last_change":"2024-09-19T09:36:12.986686+0000","last_active":"2024-09-19T09:37:44.150511+0000","last_peered":"2024-09-19T09:37:44.150511+0000","last_clean":"2024-09-19T09:37:44.150511+0000","last_became_active":"2024-09-19T09:36:12.986334+0000","last_became_peered":"2024-09-19T09:36:12.986334+0000","last_unstale":"2024-09-19T09:37:44.150511+0000","last_undegraded":"2024-09-19T09:37:44.150511+0000","last_fullsized":"2024-09-19T09:37:44.150511+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:39.926343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.139116+0000","last_change":"2024-09-19T09:36:12.981964+0000","last_active":"2024-09-19T09:37:44.139116+0000","last_peered":"2024-09-19T09:37:44.139116+0000","last_clean":"2024-09-19T09:37:44.139116+0000","last_became_active":"2024-09-19T09:36:12.981558+0000","last_became_peered":"2024-09-19T09:36:12.981558+0000","last_unstale":"2024-09-19T09:37:44.139116+0000","last_undegraded":"2024-09-19T09:37:44.139116+0000","last_fullsized":"2024-09-19T09:37:44.139116+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:33.706451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146524+0000","last_change":"2024-09-19T09:36:12.992598+0000","last_active":"2024-09-19T09:37:44.146524+0000","last_peered":"2024-09-19T09:37:44.146524+0000","last_clean":"2024-09-19T09:37:44.146524+0000","last_became_active":"2024-09-19T09:36:12.992281+0000","last_became_peered":"2024-09-19T09:36:12.992281+0000","last_unstale":"2024-09-19T09:37:44.146524+0000","last_undegraded":"2024-09-19T09:37:44.146524+0000","last_fullsized":"2024-09-19T09:37:44.146524+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:26.107432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146663+0000","last_change":"2024-09-19T09:36:12.988583+0000","last_active":"2024-09-19T09:37:44.146663+0000","last_peered":"2024-09-19T09:37:44.146663+0000","last_clean":"2024-09-19T09:37:44.146663+0000","last_became_active":"2024-09-19T09:36:12.987895+0000","last_became_peered":"2024-09-19T09:36:12.987895+0000","last_unstale":"2024-09-19T09:37:44.146663+0000","last_undegraded":"2024-09-19T09:37:44.146663+0000","last_fullsized":"2024-09-19T09:37:44.146663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:47.617324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.141930+0000","last_change":"2024-09-19T09:36:12.988526+0000","last_active":"2024-09-19T09:37:44.141930+0000","last_peered":"2024-09-19T09:37:44.141930+0000","last_clean":"2024-09-19T09:37:44.141930+0000","last_became_active":"2024-09-19T09:36:12.988093+0000","last_became_peered":"2024-09-19T09:36:12.988093+0000","last_unstale":"2024-09-19T09:37:44.141930+0000","last_undegraded":"2024-09-19T09:37:44.141930+0000","last_fullsized":"2024-09-19T09:37:44.141930+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:48.949397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.157907+0000","last_change":"2024-09-19T09:36:12.992360+0000","last_active":"2024-09-19T09:37:44.157907+0000","last_peered":"2024-09-19T09:37:44.157907+0000","last_clean":"2024-09-19T09:37:44.157907+0000","last_became_active":"2024-09-19T09:36:12.991833+0000","last_became_peered":"2024-09-19T09:36:12.991833+0000","last_unstale":"2024-09-19T09:37:44.157907+0000","last_undegraded":"2024-09-19T09:37:44.157907+0000","last_fullsized":"2024-09-19T09:37:44.157907+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:47.715012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.144515+0000","last_change":"2024-09-19T09:36:12.993435+0000","last_active":"2024-09-19T09:37:44.144515+0000","last_peered":"2024-09-19T09:37:44.144515+0000","last_clean":"2024-09-19T09:37:44.144515+0000","last_became_active":"2024-09-19T09:36:12.993108+0000","last_became_peered":"2024-09-19T09:36:12.993108+0000","last_unstale":"2024-09-19T09:37:44.144515+0000","last_undegraded":"2024-09-19T09:37:44.144515+0000","last_fullsized":"2024-09-19T09:37:44.144515+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:54.453593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.162293+0000","last_change":"2024-09-19T09:36:12.991044+0000","last_active":"2024-09-19T09:37:44.162293+0000","last_peered":"2024-09-19T09:37:44.162293+0000","last_clean":"2024-09-19T09:37:44.162293+0000","last_became_active":"2024-09-19T09:36:12.989955+0000","last_became_peered":"2024-09-19T09:36:12.989955+0000","last_unstale":"2024-09-19T09:37:44.162293+0000","last_undegraded":"2024-09-19T09:37:44.162293+0000","last_fullsized":"2024-09-19T09:37:44.162293+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:21.034023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148886+0000","last_change":"2024-09-19T09:36:12.989679+0000","last_active":"2024-09-19T09:37:44.148886+0000","last_peered":"2024-09-19T09:37:44.148886+0000","last_clean":"2024-09-19T09:37:44.148886+0000","last_became_active":"2024-09-19T09:36:12.988463+0000","last_became_peered":"2024-09-19T09:36:12.988463+0000","last_unstale":"2024-09-19T09:37:44.148886+0000","last_undegraded":"2024-09-19T09:37:44.148886+0000","last_fullsized":"2024-09-19T09:37:44.148886+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:28.562207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.144722+0000","last_change":"2024-09-19T09:36:12.983494+0000","last_active":"2024-09-19T09:37:44.144722+0000","last_peered":"2024-09-19T09:37:44.144722+0000","last_clean":"2024-09-19T09:37:44.144722+0000","last_became_active":"2024-09-19T09:36:12.983143+0000","last_became_peered":"2024-09-19T09:36:12.983143+0000","last_unstale":"2024-09-19T09:37:44.144722+0000","last_undegraded":"2024-09-19T09:37:44.144722+0000","last_fullsized":"2024-09-19T09:37:44.144722+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:23.378183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.143385+0000","last_change":"2024-09-19T09:36:12.987512+0000","last_active":"2024-09-19T09:37:44.143385+0000","last_peered":"2024-09-19T09:37:44.143385+0000","last_clean":"2024-09-19T09:37:44.143385+0000","last_became_active":"2024-09-19T09:36:12.987288+0000","last_became_peered":"2024-09-19T09:36:12.987288+0000","last_unstale":"2024-09-19T09:37:44.143385+0000","last_undegraded":"2024-09-19T09:37:44.143385+0000","last_fullsized":"2024-09-19T09:37:44.143385+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:13:14.614333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147801+0000","last_change":"2024-09-19T09:37:16.131000+0000","last_active":"2024-09-19T09:37:44.147801+0000","last_peered":"2024-09-19T09:37:44.147801+0000","last_clean":"2024-09-19T09:37:44.147801+0000","last_became_active":"2024-09-19T09:37:16.130647+0000","last_became_peered":"2024-09-19T09:37:16.130647+0000","last_unstale":"2024-09-19T09:37:44.147801+0000","last_undegraded":"2024-09-19T09:37:44.147801+0000","last_fullsized":"2024-09-19T09:37:44.147801+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:22.498318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.162539+0000","last_change":"2024-09-19T09:36:12.988210+0000","last_active":"2024-09-19T09:37:44.162539+0000","last_peered":"2024-09-19T09:37:44.162539+0000","last_clean":"2024-09-19T09:37:44.162539+0000","last_became_active":"2024-09-19T09:36:12.987904+0000","last_became_peered":"2024-09-19T09:36:12.987904+0000","last_unstale":"2024-09-19T09:37:44.162539+0000","last_undegraded":"2024-09-19T09:37:44.162539+0000","last_fullsized":"2024-09-19T09:37:44.162539+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:13.588237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147356+0000","last_change":"2024-09-19T09:36:12.984028+0000","last_active":"2024-09-19T09:37:44.147356+0000","last_peered":"2024-09-19T09:37:44.147356+0000","last_clean":"2024-09-19T09:37:44.147356+0000","last_became_active":"2024-09-19T09:36:12.982062+0000","last_became_peered":"2024-09-19T09:36:12.982062+0000","last_unstale":"2024-09-19T09:37:44.147356+0000","last_undegraded":"2024-09-19T09:37:44.147356+0000","last_fullsized":"2024-09-19T09:37:44.147356+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:26.610287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.141161+0000","last_change":"2024-09-19T09:36:12.979277+0000","last_active":"2024-09-19T09:37:44.141161+0000","last_peered":"2024-09-19T09:37:44.141161+0000","last_clean":"2024-09-19T09:37:44.141161+0000","last_became_active":"2024-09-19T09:36:12.978970+0000","last_became_peered":"2024-09-19T09:36:12.978970+0000","last_unstale":"2024-09-19T09:37:44.141161+0000","last_undegraded":"2024-09-19T09:37:44.141161+0000","last_fullsized":"2024-09-19T09:37:44.141161+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:00.424728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147432+0000","last_change":"2024-09-19T09:36:12.981021+0000","last_active":"2024-09-19T09:37:44.147432+0000","last_peered":"2024-09-19T09:37:44.147432+0000","last_clean":"2024-09-19T09:37:44.147432+0000","last_became_active":"2024-09-19T09:36:12.980580+0000","last_became_peered":"2024-09-19T09:36:12.980580+0000","last_unstale":"2024-09-19T09:37:44.147432+0000","last_undegraded":"2024-09-19T09:37:44.147432+0000","last_fullsized":"2024-09-19T09:37:44.147432+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:17.464873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.143924+0000","last_change":"2024-09-19T09:36:12.986090+0000","last_active":"2024-09-19T09:37:44.143924+0000","last_peered":"2024-09-19T09:37:44.143924+0000","last_clean":"2024-09-19T09:37:44.143924+0000","last_became_active":"2024-09-19T09:36:12.985740+0000","last_became_peered":"2024-09-19T09:36:12.985740+0000","last_unstale":"2024-09-19T09:37:44.143924+0000","last_undegraded":"2024-09-19T09:37:44.143924+0000","last_fullsized":"2024-09-19T09:37:44.143924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:35.252834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145367+0000","last_change":"2024-09-19T09:36:12.981257+0000","last_active":"2024-09-19T09:37:44.145367+0000","last_peered":"2024-09-19T09:37:44.145367+0000","last_clean":"2024-09-19T09:37:44.145367+0000","last_became_active":"2024-09-19T09:36:12.980911+0000","last_became_peered":"2024-09-19T09:36:12.980911+0000","last_unstale":"2024-09-19T09:37:44.145367+0000","last_undegraded":"2024-09-19T09:37:44.145367+0000","last_fullsized":"2024-09-19T09:37:44.145367+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:41.470514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.161076+0000","last_change":"2024-09-19T09:36:12.982585+0000","last_active":"2024-09-19T09:37:44.161076+0000","last_peered":"2024-09-19T09:37:44.161076+0000","last_clean":"2024-09-19T09:37:44.161076+0000","last_became_active":"2024-09-19T09:36:12.982193+0000","last_became_peered":"2024-09-19T09:36:12.982193+0000","last_unstale":"2024-09-19T09:37:44.161076+0000","last_undegraded":"2024-09-19T09:37:44.161076+0000","last_fullsized":"2024-09-19T09:37:44.161076+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:09:30.057088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.143208+0000","last_change":"2024-09-19T09:36:12.985236+0000","last_active":"2024-09-19T09:37:44.143208+0000","last_peered":"2024-09-19T09:37:44.143208+0000","last_clean":"2024-09-19T09:37:44.143208+0000","last_became_active":"2024-09-19T09:36:12.984751+0000","last_became_peered":"2024-09-19T09:36:12.984751+0000","last_unstale":"2024-09-19T09:37:44.143208+0000","last_undegraded":"2024-09-19T09:37:44.143208+0000","last_fullsized":"2024-09-19T09:37:44.143208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:52.784216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.138535+0000","last_change":"2024-09-19T09:36:12.985856+0000","last_active":"2024-09-19T09:37:44.138535+0000","last_peered":"2024-09-19T09:37:44.138535+0000","last_clean":"2024-09-19T09:37:44.138535+0000","last_became_active":"2024-09-19T09:36:12.985312+0000","last_became_peered":"2024-09-19T09:36:12.985312+0000","last_unstale":"2024-09-19T09:37:44.138535+0000","last_undegraded":"2024-09-19T09:37:44.138535+0000","last_fullsized":"2024-09-19T09:37:44.138535+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:25.235945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.142807+0000","last_change":"2024-09-19T09:36:12.982443+0000","last_active":"2024-09-19T09:37:44.142807+0000","last_peered":"2024-09-19T09:37:44.142807+0000","last_clean":"2024-09-19T09:37:44.142807+0000","last_became_active":"2024-09-19T09:36:12.982130+0000","last_became_peered":"2024-09-19T09:36:12.982130+0000","last_unstale":"2024-09-19T09:37:44.142807+0000","last_undegraded":"2024-09-19T09:37:44.142807+0000","last_fullsized":"2024-09-19T09:37:44.142807+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:17.177563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145567+0000","last_change":"2024-09-19T09:36:12.990439+0000","last_active":"2024-09-19T09:37:44.145567+0000","last_peered":"2024-09-19T09:37:44.145567+0000","last_clean":"2024-09-19T09:37:44.145567+0000","last_became_active":"2024-09-19T09:36:12.990135+0000","last_became_peered":"2024-09-19T09:36:12.990135+0000","last_unstale":"2024-09-19T09:37:44.145567+0000","last_undegraded":"2024-09-19T09:37:44.145567+0000","last_fullsized":"2024-09-19T09:37:44.145567+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:51.685192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145105+0000","last_change":"2024-09-19T09:36:12.987261+0000","last_active":"2024-09-19T09:37:44.145105+0000","last_peered":"2024-09-19T09:37:44.145105+0000","last_clean":"2024-09-19T09:37:44.145105+0000","last_became_active":"2024-09-19T09:36:12.986192+0000","last_became_peered":"2024-09-19T09:36:12.986192+0000","last_unstale":"2024-09-19T09:37:44.145105+0000","last_undegraded":"2024-09-19T09:37:44.145105+0000","last_fullsized":"2024-09-19T09:37:44.145105+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:58.435605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.141377+0000","last_change":"2024-09-19T09:36:12.981248+0000","last_active":"2024-09-19T09:37:44.141377+0000","last_peered":"2024-09-19T09:37:44.141377+0000","last_clean":"2024-09-19T09:37:44.141377+0000","last_became_active":"2024-09-19T09:36:12.980754+0000","last_became_peered":"2024-09-19T09:36:12.980754+0000","last_unstale":"2024-09-19T09:37:44.141377+0000","last_undegraded":"2024-09-19T09:37:44.141377+0000","last_fullsized":"2024-09-19T09:37:44.141377+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:03.970402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.139500+0000","last_change":"2024-09-19T09:36:12.990841+0000","last_active":"2024-09-19T09:37:44.139500+0000","last_peered":"2024-09-19T09:37:44.139500+0000","last_clean":"2024-09-19T09:37:44.139500+0000","last_became_active":"2024-09-19T09:36:12.989667+0000","last_became_peered":"2024-09-19T09:36:12.989667+0000","last_unstale":"2024-09-19T09:37:44.139500+0000","last_undegraded":"2024-09-19T09:37:44.139500+0000","last_fullsized":"2024-09-19T09:37:44.139500+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:46:00.314590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148537+0000","last_change":"2024-09-19T09:36:12.984007+0000","last_active":"2024-09-19T09:37:44.148537+0000","last_peered":"2024-09-19T09:37:44.148537+0000","last_clean":"2024-09-19T09:37:44.148537+0000","last_became_active":"2024-09-19T09:36:12.983627+0000","last_became_peered":"2024-09-19T09:36:12.983627+0000","last_unstale":"2024-09-19T09:37:44.148537+0000","last_undegraded":"2024-09-19T09:37:44.148537+0000","last_fullsized":"2024-09-19T09:37:44.148537+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:42.038673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146461+0000","last_change":"2024-09-19T09:36:12.988032+0000","last_active":"2024-09-19T09:37:44.146461+0000","last_peered":"2024-09-19T09:37:44.146461+0000","last_clean":"2024-09-19T09:37:44.146461+0000","last_became_active":"2024-09-19T09:36:12.987588+0000","last_became_peered":"2024-09-19T09:36:12.987588+0000","last_unstale":"2024-09-19T09:37:44.146461+0000","last_undegraded":"2024-09-19T09:37:44.146461+0000","last_fullsized":"2024-09-19T09:37:44.146461+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:01.518543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148152+0000","last_change":"2024-09-19T09:37:16.131565+0000","last_active":"2024-09-19T09:37:44.148152+0000","last_peered":"2024-09-19T09:37:44.148152+0000","last_clean":"2024-09-19T09:37:44.148152+0000","last_became_active":"2024-09-19T09:37:16.131171+0000","last_became_peered":"2024-09-19T09:37:16.131171+0000","last_unstale":"2024-09-19T09:37:44.148152+0000","last_undegraded":"2024-09-19T09:37:44.148152+0000","last_fullsized":"2024-09-19T09:37:44.148152+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:18.195074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.141174+0000","last_change":"2024-09-19T09:36:12.989709+0000","last_active":"2024-09-19T09:37:44.141174+0000","last_peered":"2024-09-19T09:37:44.141174+0000","last_clean":"2024-09-19T09:37:44.141174+0000","last_became_active":"2024-09-19T09:36:12.989324+0000","last_became_peered":"2024-09-19T09:36:12.989324+0000","last_unstale":"2024-09-19T09:37:44.141174+0000","last_undegraded":"2024-09-19T09:37:44.141174+0000","last_fullsized":"2024-09-19T09:37:44.141174+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:09.843175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.033713+0000","last_change":"2024-09-19T09:37:16.033713+0000","last_active":"2024-09-19T09:37:16.033713+0000","last_peered":"2024-09-19T09:37:16.033713+0000","last_clean":"2024-09-19T09:37:16.033713+0000","last_became_active":"2024-09-19T09:37:16.033230+0000","last_became_peered":"2024-09-19T09:37:16.033230+0000","last_unstale":"2024-09-19T09:37:16.033713+0000","last_undegraded":"2024-09-19T09:37:16.033713+0000","last_fullsized":"2024-09-19T09:37:16.033713+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:12.262115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.143084+0000","last_change":"2024-09-19T09:37:16.484760+0000","last_active":"2024-09-19T09:37:44.143084+0000","last_peered":"2024-09-19T09:37:44.143084+0000","last_clean":"2024-09-19T09:37:44.143084+0000","last_became_active":"2024-09-19T09:37:16.484316+0000","last_became_peered":"2024-09-19T09:37:16.484316+0000","last_unstale":"2024-09-19T09:37:44.143084+0000","last_undegraded":"2024-09-19T09:37:44.143084+0000","last_fullsized":"2024-09-19T09:37:44.143084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:14.897601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.124818+0000","last_change":"2024-09-19T09:37:16.124818+0000","last_active":"2024-09-19T09:37:16.124818+0000","last_peered":"2024-09-19T09:37:16.124818+0000","last_clean":"2024-09-19T09:37:16.124818+0000","last_became_active":"2024-09-19T09:37:16.124391+0000","last_became_peered":"2024-09-19T09:37:16.124391+0000","last_unstale":"2024-09-19T09:37:16.124818+0000","last_undegraded":"2024-09-19T09:37:16.124818+0000","last_fullsized":"2024-09-19T09:37:16.124818+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:25.443666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034105+0000","last_change":"2024-09-19T09:36:10.837287+0000","last_active":"2024-09-19T09:37:16.034105+0000","last_peered":"2024-09-19T09:37:16.034105+0000","last_clean":"2024-09-19T09:37:16.034105+0000","last_became_active":"2024-09-19T09:36:10.836890+0000","last_became_peered":"2024-09-19T09:36:10.836890+0000","last_unstale":"2024-09-19T09:37:16.034105+0000","last_undegraded":"2024-09-19T09:37:16.034105+0000","last_fullsized":"2024-09-19T09:37:16.034105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:09.676728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.139992+0000","last_change":"2024-09-19T09:36:12.975690+0000","last_active":"2024-09-19T09:37:44.139992+0000","last_peered":"2024-09-19T09:37:44.139992+0000","last_clean":"2024-09-19T09:37:44.139992+0000","last_became_active":"2024-09-19T09:36:12.975370+0000","last_became_peered":"2024-09-19T09:36:12.975370+0000","last_unstale":"2024-09-19T09:37:44.139992+0000","last_undegraded":"2024-09-19T09:37:44.139992+0000","last_fullsized":"2024-09-19T09:37:44.139992+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:05.650917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030234+0000","last_change":"2024-09-19T09:36:10.843736+0000","last_active":"2024-09-19T09:37:16.030234+0000","last_peered":"2024-09-19T09:37:16.030234+0000","last_clean":"2024-09-19T09:37:16.030234+0000","last_became_active":"2024-09-19T09:36:10.843353+0000","last_became_peered":"2024-09-19T09:36:10.843353+0000","last_unstale":"2024-09-19T09:37:16.030234+0000","last_undegraded":"2024-09-19T09:37:16.030234+0000","last_fullsized":"2024-09-19T09:37:16.030234+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:29.818642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.140596+0000","last_change":"2024-09-19T09:36:12.978841+0000","last_active":"2024-09-19T09:37:44.140596+0000","last_peered":"2024-09-19T09:37:44.140596+0000","last_clean":"2024-09-19T09:37:44.140596+0000","last_became_active":"2024-09-19T09:36:12.978501+0000","last_became_peered":"2024-09-19T09:36:12.978501+0000","last_unstale":"2024-09-19T09:37:44.140596+0000","last_undegraded":"2024-09-19T09:37:44.140596+0000","last_fullsized":"2024-09-19T09:37:44.140596+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:07.974576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.032030+0000","last_change":"2024-09-19T09:36:10.841997+0000","last_active":"2024-09-19T09:37:16.032030+0000","last_peered":"2024-09-19T09:37:16.032030+0000","last_clean":"2024-09-19T09:37:16.032030+0000","last_became_active":"2024-09-19T09:36:10.841641+0000","last_became_peered":"2024-09-19T09:36:10.841641+0000","last_unstale":"2024-09-19T09:37:16.032030+0000","last_undegraded":"2024-09-19T09:37:16.032030+0000","last_fullsized":"2024-09-19T09:37:16.032030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:10.477879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.156072+0000","last_change":"2024-09-19T09:36:12.981486+0000","last_active":"2024-09-19T09:37:44.156072+0000","last_peered":"2024-09-19T09:37:44.156072+0000","last_clean":"2024-09-19T09:37:44.156072+0000","last_became_active":"2024-09-19T09:36:12.981165+0000","last_became_peered":"2024-09-19T09:36:12.981165+0000","last_unstale":"2024-09-19T09:37:44.156072+0000","last_undegraded":"2024-09-19T09:37:44.156072+0000","last_fullsized":"2024-09-19T09:37:44.156072+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:21.986132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030755+0000","last_change":"2024-09-19T09:36:10.845362+0000","last_active":"2024-09-19T09:37:16.030755+0000","last_peered":"2024-09-19T09:37:16.030755+0000","last_clean":"2024-09-19T09:37:16.030755+0000","last_became_active":"2024-09-19T09:36:10.844992+0000","last_became_peered":"2024-09-19T09:36:10.844992+0000","last_unstale":"2024-09-19T09:37:16.030755+0000","last_undegraded":"2024-09-19T09:37:16.030755+0000","last_fullsized":"2024-09-19T09:37:16.030755+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:52.854333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.137951+0000","last_change":"2024-09-19T09:36:12.988924+0000","last_active":"2024-09-19T09:37:44.137951+0000","last_peered":"2024-09-19T09:37:44.137951+0000","last_clean":"2024-09-19T09:37:44.137951+0000","last_became_active":"2024-09-19T09:36:12.988331+0000","last_became_peered":"2024-09-19T09:36:12.988331+0000","last_unstale":"2024-09-19T09:37:44.137951+0000","last_undegraded":"2024-09-19T09:37:44.137951+0000","last_fullsized":"2024-09-19T09:37:44.137951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:24.754252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029903+0000","last_change":"2024-09-19T09:36:10.860003+0000","last_active":"2024-09-19T09:37:16.029903+0000","last_peered":"2024-09-19T09:37:16.029903+0000","last_clean":"2024-09-19T09:37:16.029903+0000","last_became_active":"2024-09-19T09:36:10.859584+0000","last_became_peered":"2024-09-19T09:36:10.859584+0000","last_unstale":"2024-09-19T09:37:16.029903+0000","last_undegraded":"2024-09-19T09:37:16.029903+0000","last_fullsized":"2024-09-19T09:37:16.029903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:44.837960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.160481+0000","last_change":"2024-09-19T09:36:12.985446+0000","last_active":"2024-09-19T09:37:44.160481+0000","last_peered":"2024-09-19T09:37:44.160481+0000","last_clean":"2024-09-19T09:37:44.160481+0000","last_became_active":"2024-09-19T09:36:12.984671+0000","last_became_peered":"2024-09-19T09:36:12.984671+0000","last_unstale":"2024-09-19T09:37:44.160481+0000","last_undegraded":"2024-09-19T09:37:44.160481+0000","last_fullsized":"2024-09-19T09:37:44.160481+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:54.800151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'33","reported_seq":284,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:38:10.122276+0000","last_change":"2024-09-19T09:36:10.841056+0000","last_active":"2024-09-19T09:38:10.122276+0000","last_peered":"2024-09-19T09:38:10.122276+0000","last_clean":"2024-09-19T09:38:10.122276+0000","last_became_active":"2024-09-19T09:36:10.840731+0000","last_became_peered":"2024-09-19T09:36:10.840731+0000","last_unstale":"2024-09-19T09:38:10.122276+0000","last_undegraded":"2024-09-19T09:38:10.122276+0000","last_fullsized":"2024-09-19T09:38:10.122276+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:13.676188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68749,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":229,"num_read_kb":182,"num_write":33,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146672+0000","last_change":"2024-09-19T09:36:12.990223+0000","last_active":"2024-09-19T09:37:44.146672+0000","last_peered":"2024-09-19T09:37:44.146672+0000","last_clean":"2024-09-19T09:37:44.146672+0000","last_became_active":"2024-09-19T09:36:12.989720+0000","last_became_peered":"2024-09-19T09:36:12.989720+0000","last_unstale":"2024-09-19T09:37:44.146672+0000","last_undegraded":"2024-09-19T09:37:44.146672+0000","last_fullsized":"2024-09-19T09:37:44.146672+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:37.003075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.129753+0000","last_change":"2024-09-19T09:36:10.843288+0000","last_active":"2024-09-19T09:37:16.129753+0000","last_peered":"2024-09-19T09:37:16.129753+0000","last_clean":"2024-09-19T09:37:16.129753+0000","last_became_active":"2024-09-19T09:36:10.842844+0000","last_became_peered":"2024-09-19T09:36:10.842844+0000","last_unstale":"2024-09-19T09:37:16.129753+0000","last_undegraded":"2024-09-19T09:37:16.129753+0000","last_fullsized":"2024-09-19T09:37:16.129753+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:38.695411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145354+0000","last_change":"2024-09-19T09:36:12.981251+0000","last_active":"2024-09-19T09:37:44.145354+0000","last_peered":"2024-09-19T09:37:44.145354+0000","last_clean":"2024-09-19T09:37:44.145354+0000","last_became_active":"2024-09-19T09:36:12.980861+0000","last_became_peered":"2024-09-19T09:36:12.980861+0000","last_unstale":"2024-09-19T09:37:44.145354+0000","last_undegraded":"2024-09-19T09:37:44.145354+0000","last_fullsized":"2024-09-19T09:37:44.145354+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:09.633644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030128+0000","last_change":"2024-09-19T09:36:10.843448+0000","last_active":"2024-09-19T09:37:16.030128+0000","last_peered":"2024-09-19T09:37:16.030128+0000","last_clean":"2024-09-19T09:37:16.030128+0000","last_became_active":"2024-09-19T09:36:10.843087+0000","last_became_peered":"2024-09-19T09:36:10.843087+0000","last_unstale":"2024-09-19T09:37:16.030128+0000","last_undegraded":"2024-09-19T09:37:16.030128+0000","last_fullsized":"2024-09-19T09:37:16.030128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:20.623613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.151910+0000","last_change":"2024-09-19T09:36:12.981160+0000","last_active":"2024-09-19T09:37:44.151910+0000","last_peered":"2024-09-19T09:37:44.151910+0000","last_clean":"2024-09-19T09:37:44.151910+0000","last_became_active":"2024-09-19T09:36:12.980823+0000","last_became_peered":"2024-09-19T09:36:12.980823+0000","last_unstale":"2024-09-19T09:37:44.151910+0000","last_undegraded":"2024-09-19T09:37:44.151910+0000","last_fullsized":"2024-09-19T09:37:44.151910+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:39.323439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028480+0000","last_change":"2024-09-19T09:36:10.842536+0000","last_active":"2024-09-19T09:37:16.028480+0000","last_peered":"2024-09-19T09:37:16.028480+0000","last_clean":"2024-09-19T09:37:16.028480+0000","last_became_active":"2024-09-19T09:36:10.842176+0000","last_became_peered":"2024-09-19T09:36:10.842176+0000","last_unstale":"2024-09-19T09:37:16.028480+0000","last_undegraded":"2024-09-19T09:37:16.028480+0000","last_fullsized":"2024-09-19T09:37:16.028480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:37.871299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145814+0000","last_change":"2024-09-19T09:36:12.987271+0000","last_active":"2024-09-19T09:37:44.145814+0000","last_peered":"2024-09-19T09:37:44.145814+0000","last_clean":"2024-09-19T09:37:44.145814+0000","last_became_active":"2024-09-19T09:36:12.986918+0000","last_became_peered":"2024-09-19T09:36:12.986918+0000","last_unstale":"2024-09-19T09:37:44.145814+0000","last_undegraded":"2024-09-19T09:37:44.145814+0000","last_fullsized":"2024-09-19T09:37:44.145814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:07.608541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030337+0000","last_change":"2024-09-19T09:36:10.860370+0000","last_active":"2024-09-19T09:37:16.030337+0000","last_peered":"2024-09-19T09:37:16.030337+0000","last_clean":"2024-09-19T09:37:16.030337+0000","last_became_active":"2024-09-19T09:36:10.859820+0000","last_became_peered":"2024-09-19T09:36:10.859820+0000","last_unstale":"2024-09-19T09:37:16.030337+0000","last_undegraded":"2024-09-19T09:37:16.030337+0000","last_fullsized":"2024-09-19T09:37:16.030337+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:12.121038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.161919+0000","last_change":"2024-09-19T09:36:12.994449+0000","last_active":"2024-09-19T09:37:44.161919+0000","last_peered":"2024-09-19T09:37:44.161919+0000","last_clean":"2024-09-19T09:37:44.161919+0000","last_became_active":"2024-09-19T09:36:12.994141+0000","last_became_peered":"2024-09-19T09:36:12.994141+0000","last_unstale":"2024-09-19T09:37:44.161919+0000","last_undegraded":"2024-09-19T09:37:44.161919+0000","last_fullsized":"2024-09-19T09:37:44.161919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:21.416453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031764+0000","last_change":"2024-09-19T09:36:10.839609+0000","last_active":"2024-09-19T09:37:16.031764+0000","last_peered":"2024-09-19T09:37:16.031764+0000","last_clean":"2024-09-19T09:37:16.031764+0000","last_became_active":"2024-09-19T09:36:10.839227+0000","last_became_peered":"2024-09-19T09:36:10.839227+0000","last_unstale":"2024-09-19T09:37:16.031764+0000","last_undegraded":"2024-09-19T09:37:16.031764+0000","last_fullsized":"2024-09-19T09:37:16.031764+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:00.734924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.144996+0000","last_change":"2024-09-19T09:36:12.983573+0000","last_active":"2024-09-19T09:37:44.144996+0000","last_peered":"2024-09-19T09:37:44.144996+0000","last_clean":"2024-09-19T09:37:44.144996+0000","last_became_active":"2024-09-19T09:36:12.983241+0000","last_became_peered":"2024-09-19T09:36:12.983241+0000","last_unstale":"2024-09-19T09:37:44.144996+0000","last_undegraded":"2024-09-19T09:37:44.144996+0000","last_fullsized":"2024-09-19T09:37:44.144996+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:44.050271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034765+0000","last_change":"2024-09-19T09:36:10.839789+0000","last_active":"2024-09-19T09:37:16.034765+0000","last_peered":"2024-09-19T09:37:16.034765+0000","last_clean":"2024-09-19T09:37:16.034765+0000","last_became_active":"2024-09-19T09:36:10.839445+0000","last_became_peered":"2024-09-19T09:36:10.839445+0000","last_unstale":"2024-09-19T09:37:16.034765+0000","last_undegraded":"2024-09-19T09:37:16.034765+0000","last_fullsized":"2024-09-19T09:37:16.034765+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:16.040249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148829+0000","last_change":"2024-09-19T09:36:12.993420+0000","last_active":"2024-09-19T09:37:44.148829+0000","last_peered":"2024-09-19T09:37:44.148829+0000","last_clean":"2024-09-19T09:37:44.148829+0000","last_became_active":"2024-09-19T09:36:12.992334+0000","last_became_peered":"2024-09-19T09:36:12.992334+0000","last_unstale":"2024-09-19T09:37:44.148829+0000","last_undegraded":"2024-09-19T09:37:44.148829+0000","last_fullsized":"2024-09-19T09:37:44.148829+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:21.693164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030247+0000","last_change":"2024-09-19T09:36:10.839461+0000","last_active":"2024-09-19T09:37:16.030247+0000","last_peered":"2024-09-19T09:37:16.030247+0000","last_clean":"2024-09-19T09:37:16.030247+0000","last_became_active":"2024-09-19T09:36:10.839092+0000","last_became_peered":"2024-09-19T09:36:10.839092+0000","last_unstale":"2024-09-19T09:37:16.030247+0000","last_undegraded":"2024-09-19T09:37:16.030247+0000","last_fullsized":"2024-09-19T09:37:16.030247+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:02.367267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.145214+0000","last_change":"2024-09-19T09:36:12.988234+0000","last_active":"2024-09-19T09:37:44.145214+0000","last_peered":"2024-09-19T09:37:44.145214+0000","last_clean":"2024-09-19T09:37:44.145214+0000","last_became_active":"2024-09-19T09:36:12.987813+0000","last_became_peered":"2024-09-19T09:36:12.987813+0000","last_unstale":"2024-09-19T09:37:44.145214+0000","last_undegraded":"2024-09-19T09:37:44.145214+0000","last_fullsized":"2024-09-19T09:37:44.145214+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:56.024428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.130482+0000","last_change":"2024-09-19T09:36:10.945705+0000","last_active":"2024-09-19T09:37:16.130482+0000","last_peered":"2024-09-19T09:37:16.130482+0000","last_clean":"2024-09-19T09:37:16.130482+0000","last_became_active":"2024-09-19T09:36:10.945323+0000","last_became_peered":"2024-09-19T09:36:10.945323+0000","last_unstale":"2024-09-19T09:37:16.130482+0000","last_undegraded":"2024-09-19T09:37:16.130482+0000","last_fullsized":"2024-09-19T09:37:16.130482+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:24.211909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.162179+0000","last_change":"2024-09-19T09:36:12.990517+0000","last_active":"2024-09-19T09:37:44.162179+0000","last_peered":"2024-09-19T09:37:44.162179+0000","last_clean":"2024-09-19T09:37:44.162179+0000","last_became_active":"2024-09-19T09:36:12.989291+0000","last_became_peered":"2024-09-19T09:36:12.989291+0000","last_unstale":"2024-09-19T09:37:44.162179+0000","last_undegraded":"2024-09-19T09:37:44.162179+0000","last_fullsized":"2024-09-19T09:37:44.162179+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:31.087798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":339,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030377+0000","last_change":"2024-09-19T09:34:59.337025+0000","last_active":"2024-09-19T09:37:16.030377+0000","last_peered":"2024-09-19T09:37:16.030377+0000","last_clean":"2024-09-19T09:37:16.030377+0000","last_became_active":"2024-09-19T09:34:59.336556+0000","last_became_peered":"2024-09-19T09:34:59.336556+0000","last_unstale":"2024-09-19T09:37:16.030377+0000","last_undegraded":"2024-09-19T09:37:16.030377+0000","last_fullsized":"2024-09-19T09:37:16.030377+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:31:30.566923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:31:30.566923+0000","last_clean_scrub_stamp":"2024-09-19T09:31:30.566923+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:00.675254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.028715+0000","last_change":"2024-09-19T09:36:10.838131+0000","last_active":"2024-09-19T09:37:16.028715+0000","last_peered":"2024-09-19T09:37:16.028715+0000","last_clean":"2024-09-19T09:37:16.028715+0000","last_became_active":"2024-09-19T09:36:10.837725+0000","last_became_peered":"2024-09-19T09:36:10.837725+0000","last_unstale":"2024-09-19T09:37:16.028715+0000","last_undegraded":"2024-09-19T09:37:16.028715+0000","last_fullsized":"2024-09-19T09:37:16.028715+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:57.104726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.139840+0000","last_change":"2024-09-19T09:36:12.981951+0000","last_active":"2024-09-19T09:37:44.139840+0000","last_peered":"2024-09-19T09:37:44.139840+0000","last_clean":"2024-09-19T09:37:44.139840+0000","last_became_active":"2024-09-19T09:36:12.981558+0000","last_became_peered":"2024-09-19T09:36:12.981558+0000","last_unstale":"2024-09-19T09:37:44.139840+0000","last_undegraded":"2024-09-19T09:37:44.139840+0000","last_fullsized":"2024-09-19T09:37:44.139840+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:31.119853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030246+0000","last_change":"2024-09-19T09:36:10.843574+0000","last_active":"2024-09-19T09:37:16.030246+0000","last_peered":"2024-09-19T09:37:16.030246+0000","last_clean":"2024-09-19T09:37:16.030246+0000","last_became_active":"2024-09-19T09:36:10.843252+0000","last_became_peered":"2024-09-19T09:36:10.843252+0000","last_unstale":"2024-09-19T09:37:16.030246+0000","last_undegraded":"2024-09-19T09:37:16.030246+0000","last_fullsized":"2024-09-19T09:37:16.030246+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:10.492812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147324+0000","last_change":"2024-09-19T09:36:12.984538+0000","last_active":"2024-09-19T09:37:44.147324+0000","last_peered":"2024-09-19T09:37:44.147324+0000","last_clean":"2024-09-19T09:37:44.147324+0000","last_became_active":"2024-09-19T09:36:12.983448+0000","last_became_peered":"2024-09-19T09:36:12.983448+0000","last_unstale":"2024-09-19T09:37:44.147324+0000","last_undegraded":"2024-09-19T09:37:44.147324+0000","last_fullsized":"2024-09-19T09:37:44.147324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:48.294473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.034208+0000","last_change":"2024-09-19T09:36:10.858959+0000","last_active":"2024-09-19T09:37:16.034208+0000","last_peered":"2024-09-19T09:37:16.034208+0000","last_clean":"2024-09-19T09:37:16.034208+0000","last_became_active":"2024-09-19T09:36:10.858638+0000","last_became_peered":"2024-09-19T09:36:10.858638+0000","last_unstale":"2024-09-19T09:37:16.034208+0000","last_undegraded":"2024-09-19T09:37:16.034208+0000","last_fullsized":"2024-09-19T09:37:16.034208+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:12.646483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.143115+0000","last_change":"2024-09-19T09:36:12.992710+0000","last_active":"2024-09-19T09:37:44.143115+0000","last_peered":"2024-09-19T09:37:44.143115+0000","last_clean":"2024-09-19T09:37:44.143115+0000","last_became_active":"2024-09-19T09:36:12.992436+0000","last_became_peered":"2024-09-19T09:36:12.992436+0000","last_unstale":"2024-09-19T09:37:44.143115+0000","last_undegraded":"2024-09-19T09:37:44.143115+0000","last_fullsized":"2024-09-19T09:37:44.143115+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:51.685516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030475+0000","last_change":"2024-09-19T09:36:10.842031+0000","last_active":"2024-09-19T09:37:16.030475+0000","last_peered":"2024-09-19T09:37:16.030475+0000","last_clean":"2024-09-19T09:37:16.030475+0000","last_became_active":"2024-09-19T09:36:10.841693+0000","last_became_peered":"2024-09-19T09:36:10.841693+0000","last_unstale":"2024-09-19T09:37:16.030475+0000","last_undegraded":"2024-09-19T09:37:16.030475+0000","last_fullsized":"2024-09-19T09:37:16.030475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:28:51.040551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.138330+0000","last_change":"2024-09-19T09:37:16.034026+0000","last_active":"2024-09-19T09:37:44.138330+0000","last_peered":"2024-09-19T09:37:44.138330+0000","last_clean":"2024-09-19T09:37:44.138330+0000","last_became_active":"2024-09-19T09:37:16.033546+0000","last_became_peered":"2024-09-19T09:37:16.033546+0000","last_unstale":"2024-09-19T09:37:44.138330+0000","last_undegraded":"2024-09-19T09:37:44.138330+0000","last_fullsized":"2024-09-19T09:37:44.138330+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:42.673825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.027885+0000","last_change":"2024-09-19T09:36:10.860470+0000","last_active":"2024-09-19T09:37:16.027885+0000","last_peered":"2024-09-19T09:37:16.027885+0000","last_clean":"2024-09-19T09:37:16.027885+0000","last_became_active":"2024-09-19T09:36:10.860097+0000","last_became_peered":"2024-09-19T09:36:10.860097+0000","last_unstale":"2024-09-19T09:37:16.027885+0000","last_undegraded":"2024-09-19T09:37:16.027885+0000","last_fullsized":"2024-09-19T09:37:16.027885+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:14.933378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.139200+0000","last_change":"2024-09-19T09:36:12.988489+0000","last_active":"2024-09-19T09:37:44.139200+0000","last_peered":"2024-09-19T09:37:44.139200+0000","last_clean":"2024-09-19T09:37:44.139200+0000","last_became_active":"2024-09-19T09:36:12.988151+0000","last_became_peered":"2024-09-19T09:36:12.988151+0000","last_unstale":"2024-09-19T09:37:44.139200+0000","last_undegraded":"2024-09-19T09:37:44.139200+0000","last_fullsized":"2024-09-19T09:37:44.139200+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:24.088771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030844+0000","last_change":"2024-09-19T09:36:10.860103+0000","last_active":"2024-09-19T09:37:16.030844+0000","last_peered":"2024-09-19T09:37:16.030844+0000","last_clean":"2024-09-19T09:37:16.030844+0000","last_became_active":"2024-09-19T09:36:10.859526+0000","last_became_peered":"2024-09-19T09:36:10.859526+0000","last_unstale":"2024-09-19T09:37:16.030844+0000","last_undegraded":"2024-09-19T09:37:16.030844+0000","last_fullsized":"2024-09-19T09:37:16.030844+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:25.460372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148110+0000","last_change":"2024-09-19T09:36:12.986286+0000","last_active":"2024-09-19T09:37:44.148110+0000","last_peered":"2024-09-19T09:37:44.148110+0000","last_clean":"2024-09-19T09:37:44.148110+0000","last_became_active":"2024-09-19T09:36:12.985982+0000","last_became_peered":"2024-09-19T09:36:12.985982+0000","last_unstale":"2024-09-19T09:37:44.148110+0000","last_undegraded":"2024-09-19T09:37:44.148110+0000","last_fullsized":"2024-09-19T09:37:44.148110+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:19.026134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'12","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.989217+0000","last_change":"2024-09-19T09:36:10.839280+0000","last_active":"2024-09-19T09:37:44.989217+0000","last_peered":"2024-09-19T09:37:44.989217+0000","last_clean":"2024-09-19T09:37:44.989217+0000","last_became_active":"2024-09-19T09:36:10.838979+0000","last_became_peered":"2024-09-19T09:36:10.838979+0000","last_unstale":"2024-09-19T09:37:44.989217+0000","last_undegraded":"2024-09-19T09:37:44.989217+0000","last_fullsized":"2024-09-19T09:37:44.989217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:06.303175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146091+0000","last_change":"2024-09-19T09:36:12.979778+0000","last_active":"2024-09-19T09:37:44.146091+0000","last_peered":"2024-09-19T09:37:44.146091+0000","last_clean":"2024-09-19T09:37:44.146091+0000","last_became_active":"2024-09-19T09:36:12.979455+0000","last_became_peered":"2024-09-19T09:36:12.979455+0000","last_unstale":"2024-09-19T09:37:44.146091+0000","last_undegraded":"2024-09-19T09:37:44.146091+0000","last_fullsized":"2024-09-19T09:37:44.146091+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:36.620368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.029063+0000","last_change":"2024-09-19T09:36:10.945706+0000","last_active":"2024-09-19T09:37:16.029063+0000","last_peered":"2024-09-19T09:37:16.029063+0000","last_clean":"2024-09-19T09:37:16.029063+0000","last_became_active":"2024-09-19T09:36:10.945314+0000","last_became_peered":"2024-09-19T09:36:10.945314+0000","last_unstale":"2024-09-19T09:37:16.029063+0000","last_undegraded":"2024-09-19T09:37:16.029063+0000","last_fullsized":"2024-09-19T09:37:16.029063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:49.786913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.141688+0000","last_change":"2024-09-19T09:36:12.989412+0000","last_active":"2024-09-19T09:37:44.141688+0000","last_peered":"2024-09-19T09:37:44.141688+0000","last_clean":"2024-09-19T09:37:44.141688+0000","last_became_active":"2024-09-19T09:36:12.989109+0000","last_became_peered":"2024-09-19T09:36:12.989109+0000","last_unstale":"2024-09-19T09:37:44.141688+0000","last_undegraded":"2024-09-19T09:37:44.141688+0000","last_fullsized":"2024-09-19T09:37:44.141688+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:33.142592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.123342+0000","last_change":"2024-09-19T09:36:10.858581+0000","last_active":"2024-09-19T09:37:16.123342+0000","last_peered":"2024-09-19T09:37:16.123342+0000","last_clean":"2024-09-19T09:37:16.123342+0000","last_became_active":"2024-09-19T09:36:10.858240+0000","last_became_peered":"2024-09-19T09:36:10.858240+0000","last_unstale":"2024-09-19T09:37:16.123342+0000","last_undegraded":"2024-09-19T09:37:16.123342+0000","last_fullsized":"2024-09-19T09:37:16.123342+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:45.285839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.111050+0000","last_change":"2024-09-19T09:36:12.989075+0000","last_active":"2024-09-19T09:37:44.111050+0000","last_peered":"2024-09-19T09:37:44.111050+0000","last_clean":"2024-09-19T09:37:44.111050+0000","last_became_active":"2024-09-19T09:36:12.988752+0000","last_became_peered":"2024-09-19T09:36:12.988752+0000","last_unstale":"2024-09-19T09:37:44.111050+0000","last_undegraded":"2024-09-19T09:37:44.111050+0000","last_fullsized":"2024-09-19T09:37:44.111050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.424032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.483353+0000","last_change":"2024-09-19T09:36:10.838716+0000","last_active":"2024-09-19T09:37:16.483353+0000","last_peered":"2024-09-19T09:37:16.483353+0000","last_clean":"2024-09-19T09:37:16.483353+0000","last_became_active":"2024-09-19T09:36:10.838393+0000","last_became_peered":"2024-09-19T09:36:10.838393+0000","last_unstale":"2024-09-19T09:37:16.483353+0000","last_undegraded":"2024-09-19T09:37:16.483353+0000","last_fullsized":"2024-09-19T09:37:16.483353+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:54.107223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.147844+0000","last_change":"2024-09-19T09:36:12.991721+0000","last_active":"2024-09-19T09:37:44.147844+0000","last_peered":"2024-09-19T09:37:44.147844+0000","last_clean":"2024-09-19T09:37:44.147844+0000","last_became_active":"2024-09-19T09:36:12.991398+0000","last_became_peered":"2024-09-19T09:36:12.991398+0000","last_unstale":"2024-09-19T09:37:44.147844+0000","last_undegraded":"2024-09-19T09:37:44.147844+0000","last_fullsized":"2024-09-19T09:37:44.147844+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:19:31.312072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.485156+0000","last_change":"2024-09-19T09:37:16.484541+0000","last_active":"2024-09-19T09:37:16.485156+0000","last_peered":"2024-09-19T09:37:16.485156+0000","last_clean":"2024-09-19T09:37:16.485156+0000","last_became_active":"2024-09-19T09:37:16.484035+0000","last_became_peered":"2024-09-19T09:37:16.484035+0000","last_unstale":"2024-09-19T09:37:16.485156+0000","last_undegraded":"2024-09-19T09:37:16.485156+0000","last_fullsized":"2024-09-19T09:37:16.485156+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:36.332699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.146414+0000","last_change":"2024-09-19T09:36:12.984180+0000","last_active":"2024-09-19T09:37:44.146414+0000","last_peered":"2024-09-19T09:37:44.146414+0000","last_clean":"2024-09-19T09:37:44.146414+0000","last_became_active":"2024-09-19T09:36:12.983876+0000","last_became_peered":"2024-09-19T09:36:12.983876+0000","last_unstale":"2024-09-19T09:37:44.146414+0000","last_undegraded":"2024-09-19T09:37:44.146414+0000","last_fullsized":"2024-09-19T09:37:44.146414+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:45.876771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031127+0000","last_change":"2024-09-19T09:36:10.845391+0000","last_active":"2024-09-19T09:37:16.031127+0000","last_peered":"2024-09-19T09:37:16.031127+0000","last_clean":"2024-09-19T09:37:16.031127+0000","last_became_active":"2024-09-19T09:36:10.844974+0000","last_became_peered":"2024-09-19T09:36:10.844974+0000","last_unstale":"2024-09-19T09:37:16.031127+0000","last_undegraded":"2024-09-19T09:37:16.031127+0000","last_fullsized":"2024-09-19T09:37:16.031127+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:00.318337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.162083+0000","last_change":"2024-09-19T09:36:12.991145+0000","last_active":"2024-09-19T09:37:44.162083+0000","last_peered":"2024-09-19T09:37:44.162083+0000","last_clean":"2024-09-19T09:37:44.162083+0000","last_became_active":"2024-09-19T09:36:12.989891+0000","last_became_peered":"2024-09-19T09:36:12.989891+0000","last_unstale":"2024-09-19T09:37:44.162083+0000","last_undegraded":"2024-09-19T09:37:44.162083+0000","last_fullsized":"2024-09-19T09:37:44.162083+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:21.054936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.162240+0000","last_change":"2024-09-19T09:36:12.995378+0000","last_active":"2024-09-19T09:37:44.162240+0000","last_peered":"2024-09-19T09:37:44.162240+0000","last_clean":"2024-09-19T09:37:44.162240+0000","last_became_active":"2024-09-19T09:36:12.995028+0000","last_became_peered":"2024-09-19T09:36:12.995028+0000","last_unstale":"2024-09-19T09:37:44.162240+0000","last_undegraded":"2024-09-19T09:37:44.162240+0000","last_fullsized":"2024-09-19T09:37:44.162240+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:41.102130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.031259+0000","last_change":"2024-09-19T09:36:10.839595+0000","last_active":"2024-09-19T09:37:16.031259+0000","last_peered":"2024-09-19T09:37:16.031259+0000","last_clean":"2024-09-19T09:37:16.031259+0000","last_became_active":"2024-09-19T09:36:10.839196+0000","last_became_peered":"2024-09-19T09:36:10.839196+0000","last_unstale":"2024-09-19T09:37:16.031259+0000","last_undegraded":"2024-09-19T09:37:16.031259+0000","last_fullsized":"2024-09-19T09:37:16.031259+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:02.272731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.160402+0000","last_change":"2024-09-19T09:36:12.984485+0000","last_active":"2024-09-19T09:37:44.160402+0000","last_peered":"2024-09-19T09:37:44.160402+0000","last_clean":"2024-09-19T09:37:44.160402+0000","last_became_active":"2024-09-19T09:36:12.984004+0000","last_became_peered":"2024-09-19T09:36:12.984004+0000","last_unstale":"2024-09-19T09:37:44.160402+0000","last_undegraded":"2024-09-19T09:37:44.160402+0000","last_fullsized":"2024-09-19T09:37:44.160402+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:37.646776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.030731+0000","last_change":"2024-09-19T09:36:10.845306+0000","last_active":"2024-09-19T09:37:16.030731+0000","last_peered":"2024-09-19T09:37:16.030731+0000","last_clean":"2024-09-19T09:37:16.030731+0000","last_became_active":"2024-09-19T09:36:10.844952+0000","last_became_peered":"2024-09-19T09:36:10.844952+0000","last_unstale":"2024-09-19T09:37:16.030731+0000","last_undegraded":"2024-09-19T09:37:16.030731+0000","last_fullsized":"2024-09-19T09:37:16.030731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:09.792482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.161016+0000","last_change":"2024-09-19T09:36:12.991260+0000","last_active":"2024-09-19T09:37:44.161016+0000","last_peered":"2024-09-19T09:37:44.161016+0000","last_clean":"2024-09-19T09:37:44.161016+0000","last_became_active":"2024-09-19T09:36:12.989981+0000","last_became_peered":"2024-09-19T09:36:12.989981+0000","last_unstale":"2024-09-19T09:37:44.161016+0000","last_undegraded":"2024-09-19T09:37:44.161016+0000","last_fullsized":"2024-09-19T09:37:44.161016+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:46:11.301790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.483925+0000","last_change":"2024-09-19T09:36:10.859016+0000","last_active":"2024-09-19T09:37:16.483925+0000","last_peered":"2024-09-19T09:37:16.483925+0000","last_clean":"2024-09-19T09:37:16.483925+0000","last_became_active":"2024-09-19T09:36:10.858661+0000","last_became_peered":"2024-09-19T09:36:10.858661+0000","last_unstale":"2024-09-19T09:37:16.483925+0000","last_undegraded":"2024-09-19T09:37:16.483925+0000","last_fullsized":"2024-09-19T09:37:16.483925+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:54.395977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:44.148013+0000","last_change":"2024-09-19T09:37:16.131601+0000","last_active":"2024-09-19T09:37:44.148013+0000","last_peered":"2024-09-19T09:37:44.148013+0000","last_clean":"2024-09-19T09:37:44.148013+0000","last_became_active":"2024-09-19T09:37:16.131199+0000","last_became_peered":"2024-09-19T09:37:16.131199+0000","last_unstale":"2024-09-19T09:37:44.148013+0000","last_undegraded":"2024-09-19T09:37:44.148013+0000","last_fullsized":"2024-09-19T09:37:44.148013+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:11.954784+0000","last_clean_scrub_stamp":"2024-09-19T09:36:11.954784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:27.358544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1f","version":"81'4","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T09:37:16.039032+0000","last_change":"2024-09-19T09:37:16.039032+0000","last_active":"2024-09-19T09:37:16.039032+0000","last_peered":"2024-09-19T09:37:16.039032+0000","last_clean":"2024-09-19T09:37:16.039032+0000","last_became_active":"2024-09-19T09:37:16.035315+0000","last_became_peered":"2024-09-19T09:37:16.035315+0000","last_unstale":"2024-09-19T09:37:16.039032+0000","last_undegraded":"2024-09-19T09:37:16.039032+0000","last_fullsized":"2024-09-19T09:37:16.039032+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:36:09.822259+0000","last_clean_scrub_stamp":"2024-09-19T09:36:09.822259+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:42:58.795064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69547,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":235,"num_read_kb":188,"num_write":94,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":208641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77,"ondisk_log_size":77,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282954,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547238,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":441682,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776171,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1040384,"data_stored":1100528,"data_compressed":41852,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972400,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":441682,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201332,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":441704,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430267,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":1031585,"data_compressed":41852,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593792,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":441217,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822725,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":962560,"data_stored":1031767,"data_compressed":41852,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953546,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":441122,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215183,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36236,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708916,"statfs":{"total":95995035648,"available":95957929984,"internally_reserved":0,"allocated":913408,"data_stored":441438,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":36174280},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444115,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":978944,"data_stored":509883,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36296,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708856,"statfs":{"total":95995035648,"available":95957868544,"internally_reserved":0,"allocated":974848,"data_stored":509849,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":901120,"data_stored":441190,"data_compressed":5867,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34343,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35985,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":68749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":68783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T09:38:16.620 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:38:16.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:16 smithi022 ceph-mon[35583]: from='client.15180 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:38:16.866 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:16 smithi121 ceph-mon[35577]: from='client.15180 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:38:16.880 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:16.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:16 smithi001 ceph-mon[31225]: from='client.15180 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T09:38:17.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.385+0000 7fd452aa7640 1 -- 172.21.15.1:0/466189243 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd44c100e20 msgr2=0x7fd44c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:17.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.385+0000 7fd452aa7640 1 --2- 172.21.15.1:0/466189243 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd44c100e20 0x7fd44c101200 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd440009900 tx=0x7fd44002a480 comp rx=0 tx=0).stop 2024-09-19T09:38:17.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.385+0000 7fd452aa7640 1 -- 172.21.15.1:0/466189243 shutdown_connections 2024-09-19T09:38:17.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.385+0000 7fd452aa7640 1 --2- 172.21.15.1:0/466189243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd44c102ef0 0x7fd44c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:17.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.385+0000 7fd452aa7640 1 --2- 172.21.15.1:0/466189243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd44c102570 0x7fd44c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:17.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.385+0000 7fd452aa7640 1 --2- 172.21.15.1:0/466189243 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd44c100e20 0x7fd44c101200 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:17.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.385+0000 7fd452aa7640 1 -- 172.21.15.1:0/466189243 >> 172.21.15.1:0/466189243 conn(0x7fd44c0fc7d0 msgr2=0x7fd44c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:17.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.385+0000 7fd452aa7640 1 -- 172.21.15.1:0/466189243 shutdown_connections 2024-09-19T09:38:17.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.385+0000 7fd452aa7640 1 -- 172.21.15.1:0/466189243 wait complete. 2024-09-19T09:38:17.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.385+0000 7fd452aa7640 1 Processor -- start 2024-09-19T09:38:17.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.385+0000 7fd452aa7640 1 -- start start 2024-09-19T09:38:17.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.385+0000 7fd452aa7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd44c100e20 0x7fd44c19a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:17.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.386+0000 7fd452aa7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd44c102570 0x7fd44c19ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:17.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.386+0000 7fd452aa7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd44c102ef0 0x7fd44c19dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:17.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.386+0000 7fd452aa7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd44c110fa0 con 0x7fd44c100e20 2024-09-19T09:38:17.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.386+0000 7fd452aa7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd44c110e20 con 0x7fd44c102ef0 2024-09-19T09:38:17.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.386+0000 7fd452aa7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd44c111120 con 0x7fd44c102570 2024-09-19T09:38:17.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.386+0000 7fd450843640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd44c100e20 0x7fd44c19a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:17.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.386+0000 7fd450843640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd44c100e20 0x7fd44c19a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53488/0 (socket says 172.21.15.1:53488) 2024-09-19T09:38:17.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.386+0000 7fd450843640 1 -- 172.21.15.1:0/822157745 learned_addr learned my addr 172.21.15.1:0/822157745 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:17.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.386+0000 7fd44bfff640 1 --2- 172.21.15.1:0/822157745 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd44c102570 0x7fd44c19ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:17.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.386+0000 7fd451044640 1 --2- 172.21.15.1:0/822157745 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd44c102ef0 0x7fd44c19dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:17.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.386+0000 7fd450843640 1 -- 172.21.15.1:0/822157745 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd44c102570 msgr2=0x7fd44c19ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:17.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.386+0000 7fd450843640 1 --2- 172.21.15.1:0/822157745 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd44c102570 0x7fd44c19ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:17.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.386+0000 7fd450843640 1 -- 172.21.15.1:0/822157745 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd44c102ef0 msgr2=0x7fd44c19dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:17.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.386+0000 7fd450843640 1 --2- 172.21.15.1:0/822157745 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd44c102ef0 0x7fd44c19dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:17.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.386+0000 7fd450843640 1 -- 172.21.15.1:0/822157745 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd44c19e6f0 con 0x7fd44c100e20 2024-09-19T09:38:17.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.386+0000 7fd451044640 1 --2- 172.21.15.1:0/822157745 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd44c102ef0 0x7fd44c19dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:17.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.386+0000 7fd450843640 1 --2- 172.21.15.1:0/822157745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd44c100e20 0x7fd44c19a7a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd440006010 tx=0x7fd440003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:17.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.386+0000 7fd449ffb640 1 -- 172.21.15.1:0/822157745 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44003f070 con 0x7fd44c100e20 2024-09-19T09:38:17.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.386+0000 7fd452aa7640 1 -- 172.21.15.1:0/822157745 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd44c19e980 con 0x7fd44c100e20 2024-09-19T09:38:17.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.386+0000 7fd449ffb640 1 -- 172.21.15.1:0/822157745 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd440031c30 con 0x7fd44c100e20 2024-09-19T09:38:17.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.386+0000 7fd449ffb640 1 -- 172.21.15.1:0/822157745 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd440035030 con 0x7fd44c100e20 2024-09-19T09:38:17.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.387+0000 7fd452aa7640 1 -- 172.21.15.1:0/822157745 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd44c1a7350 con 0x7fd44c100e20 2024-09-19T09:38:17.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.388+0000 7fd452aa7640 1 -- 172.21.15.1:0/822157745 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd44c101200 con 0x7fd44c100e20 2024-09-19T09:38:17.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.390+0000 7fd449ffb640 1 -- 172.21.15.1:0/822157745 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fd440042070 con 0x7fd44c100e20 2024-09-19T09:38:17.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.390+0000 7fd449ffb640 1 --2- 172.21.15.1:0/822157745 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd43c0a3240 0x7fd43c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:17.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.390+0000 7fd44bfff640 1 --2- 172.21.15.1:0/822157745 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd43c0a3240 0x7fd43c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:17.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.390+0000 7fd449ffb640 1 -- 172.21.15.1:0/822157745 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fd4400f0680 con 0x7fd44c100e20 2024-09-19T09:38:17.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.391+0000 7fd44bfff640 1 --2- 172.21.15.1:0/822157745 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd43c0a3240 0x7fd43c0a5700 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd438005fd0 tx=0x7fd438005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:17.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.393+0000 7fd449ffb640 1 -- 172.21.15.1:0/822157745 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd440031de0 con 0x7fd44c100e20 2024-09-19T09:38:17.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.609+0000 7fd452aa7640 1 -- 172.21.15.1:0/822157745 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd44c1a7520 con 0x7fd44c100e20 2024-09-19T09:38:17.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.609+0000 7fd449ffb640 1 -- 172.21.15.1:0/822157745 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11837 (secure 0 0 0) 0x7fd4400bd360 con 0x7fd44c100e20 2024-09-19T09:38:17.611 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:38:17.611 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":19,"btime":"2024-09-19T09:36:24:006349+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:36:23.723388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6839/3279971690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3279971690},{"type":"v1","addr":"172.21.15.121:6839","nonce":3279971690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:38:17.611 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 19 2024-09-19T09:38:17.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.612+0000 7fd452aa7640 1 -- 172.21.15.1:0/822157745 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd43c0a3240 msgr2=0x7fd43c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:17.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.612+0000 7fd452aa7640 1 --2- 172.21.15.1:0/822157745 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd43c0a3240 0x7fd43c0a5700 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd438005fd0 tx=0x7fd438005850 comp rx=0 tx=0).stop 2024-09-19T09:38:17.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.612+0000 7fd452aa7640 1 -- 172.21.15.1:0/822157745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd44c100e20 msgr2=0x7fd44c19a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:17.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.612+0000 7fd452aa7640 1 --2- 172.21.15.1:0/822157745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd44c100e20 0x7fd44c19a7a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd440006010 tx=0x7fd440003c10 comp rx=0 tx=0).stop 2024-09-19T09:38:17.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.612+0000 7fd452aa7640 1 -- 172.21.15.1:0/822157745 shutdown_connections 2024-09-19T09:38:17.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.612+0000 7fd452aa7640 1 --2- 172.21.15.1:0/822157745 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd43c0a3240 0x7fd43c0a5700 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:17.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.612+0000 7fd452aa7640 1 --2- 172.21.15.1:0/822157745 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd44c102ef0 0x7fd44c19dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:17.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.612+0000 7fd452aa7640 1 --2- 172.21.15.1:0/822157745 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd44c102570 0x7fd44c19ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:17.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.612+0000 7fd452aa7640 1 --2- 172.21.15.1:0/822157745 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd44c100e20 0x7fd44c19a7a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:17.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.612+0000 7fd452aa7640 1 -- 172.21.15.1:0/822157745 >> 172.21.15.1:0/822157745 conn(0x7fd44c0fc7d0 msgr2=0x7fd44c06a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:17.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.612+0000 7fd452aa7640 1 -- 172.21.15.1:0/822157745 shutdown_connections 2024-09-19T09:38:17.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:17.612+0000 7fd452aa7640 1 -- 172.21.15.1:0/822157745 wait complete. 2024-09-19T09:38:17.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:17 smithi022 ceph-mon[35583]: pgmap v344: 97 pgs: 97 active+clean; 645 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-19T09:38:17.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:17 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:38:17.866 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:17 smithi121 ceph-mon[35577]: pgmap v344: 97 pgs: 97 active+clean; 645 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-19T09:38:17.866 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:17 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:38:17.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:17 smithi001 ceph-mon[31225]: pgmap v344: 97 pgs: 97 active+clean; 645 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-19T09:38:17.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:17 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:38:18.314 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:38:18.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:18 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/822157745' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:18.866 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:18 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/822157745' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:18.937 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:18 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/822157745' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:19.229 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:19.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.745+0000 7f4fcee85640 1 -- 172.21.15.1:0/4062151814 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fc810c170 msgr2=0x7f4fc810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:19.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.745+0000 7f4fcee85640 1 --2- 172.21.15.1:0/4062151814 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fc810c170 0x7f4fc810e610 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0009ca0 tx=0x7f4fc002a950 comp rx=0 tx=0).stop 2024-09-19T09:38:19.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.745+0000 7f4fcee85640 1 -- 172.21.15.1:0/4062151814 shutdown_connections 2024-09-19T09:38:19.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.745+0000 7f4fcee85640 1 --2- 172.21.15.1:0/4062151814 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fc810c170 0x7f4fc810e610 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:19.782 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.745+0000 7f4fcee85640 1 --2- 172.21.15.1:0/4062151814 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fc8103660 0x7f4fc810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:19.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.745+0000 7f4fcee85640 1 --2- 172.21.15.1:0/4062151814 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fc8102d40 0x7f4fc8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:19.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.745+0000 7f4fcee85640 1 -- 172.21.15.1:0/4062151814 >> 172.21.15.1:0/4062151814 conn(0x7f4fc80fc7a0 msgr2=0x7f4fc80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:19.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.745+0000 7f4fcee85640 1 -- 172.21.15.1:0/4062151814 shutdown_connections 2024-09-19T09:38:19.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.745+0000 7f4fcee85640 1 -- 172.21.15.1:0/4062151814 wait complete. 2024-09-19T09:38:19.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.746+0000 7f4fcee85640 1 Processor -- start 2024-09-19T09:38:19.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.746+0000 7f4fcee85640 1 -- start start 2024-09-19T09:38:19.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.746+0000 7f4fcee85640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fc8102d40 0x7f4fc8198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:19.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.746+0000 7f4fcee85640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fc8103660 0x7f4fc8198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:19.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.746+0000 7f4fcee85640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fc810c170 0x7f4fc819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:19.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.746+0000 7f4fcee85640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc8111f30 con 0x7f4fc8103660 2024-09-19T09:38:19.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.746+0000 7f4fcee85640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc8111db0 con 0x7f4fc8102d40 2024-09-19T09:38:19.783 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.746+0000 7f4fcee85640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc81120b0 con 0x7f4fc810c170 2024-09-19T09:38:19.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.746+0000 7f4fccc21640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fc8102d40 0x7f4fc8198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:19.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.746+0000 7f4fccc21640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fc8102d40 0x7f4fc8198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:60692/0 (socket says 172.21.15.1:60692) 2024-09-19T09:38:19.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.746+0000 7f4fccc21640 1 -- 172.21.15.1:0/2004399890 learned_addr learned my addr 172.21.15.1:0/2004399890 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:19.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.746+0000 7f4fc7fff640 1 --2- 172.21.15.1:0/2004399890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fc8103660 0x7f4fc8198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:19.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.746+0000 7f4fcd422640 1 --2- 172.21.15.1:0/2004399890 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fc810c170 0x7f4fc819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:19.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.747+0000 7f4fccc21640 1 -- 172.21.15.1:0/2004399890 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fc810c170 msgr2=0x7f4fc819cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:19.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.747+0000 7f4fccc21640 1 --2- 172.21.15.1:0/2004399890 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fc810c170 0x7f4fc819cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:19.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.747+0000 7f4fccc21640 1 -- 172.21.15.1:0/2004399890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fc8103660 msgr2=0x7f4fc8198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:19.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.747+0000 7f4fccc21640 1 --2- 172.21.15.1:0/2004399890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fc8103660 0x7f4fc8198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:19.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.747+0000 7f4fccc21640 1 -- 172.21.15.1:0/2004399890 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc819d3f0 con 0x7f4fc8102d40 2024-09-19T09:38:19.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.747+0000 7f4fc7fff640 1 --2- 172.21.15.1:0/2004399890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fc8103660 0x7f4fc8198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:38:19.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.747+0000 7f4fccc21640 1 --2- 172.21.15.1:0/2004399890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fc8102d40 0x7f4fc8198440 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4fb800d950 tx=0x7f4fb800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:19.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.747+0000 7f4fc5ffb640 1 -- 172.21.15.1:0/2004399890 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8017070 con 0x7f4fc8102d40 2024-09-19T09:38:19.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.747+0000 7f4fcee85640 1 -- 172.21.15.1:0/2004399890 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fc819d6e0 con 0x7f4fc8102d40 2024-09-19T09:38:19.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.747+0000 7f4fc5ffb640 1 -- 172.21.15.1:0/2004399890 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4fb8009c30 con 0x7f4fc8102d40 2024-09-19T09:38:19.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.747+0000 7f4fc5ffb640 1 -- 172.21.15.1:0/2004399890 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fb800f6b0 con 0x7f4fc8102d40 2024-09-19T09:38:19.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.747+0000 7f4fcee85640 1 -- 172.21.15.1:0/2004399890 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fc81a4fc0 con 0x7f4fc8102d40 2024-09-19T09:38:19.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.748+0000 7f4fcee85640 1 -- 172.21.15.1:0/2004399890 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fc8103120 con 0x7f4fc8102d40 2024-09-19T09:38:19.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.749+0000 7f4fc5ffb640 1 -- 172.21.15.1:0/2004399890 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f4fb80109d0 con 0x7f4fc8102d40 2024-09-19T09:38:19.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.750+0000 7f4fc5ffb640 1 --2- 172.21.15.1:0/2004399890 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4fb40a3240 0x7f4fb40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:19.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.750+0000 7f4fc7fff640 1 --2- 172.21.15.1:0/2004399890 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4fb40a3240 0x7f4fb40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:19.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.750+0000 7f4fc5ffb640 1 -- 172.21.15.1:0/2004399890 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f4fb80cf510 con 0x7f4fc8102d40 2024-09-19T09:38:19.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.750+0000 7f4fc7fff640 1 --2- 172.21.15.1:0/2004399890 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4fb40a3240 0x7f4fb40a5700 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80fedc0 tx=0x7f4fb000b2e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:19.785 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.755+0000 7f4fc5ffb640 1 -- 172.21.15.1:0/2004399890 <== mon.2 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4fb8009de0 con 0x7f4fc8102d40 2024-09-19T09:38:19.963 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:19 smithi001 ceph-mon[31225]: pgmap v345: 97 pgs: 97 active+clean; 645 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-19T09:38:19.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.993+0000 7f4fcee85640 1 -- 172.21.15.1:0/2004399890 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4fc81997a0 con 0x7f4fc8102d40 2024-09-19T09:38:19.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.994+0000 7f4fc5ffb640 1 -- 172.21.15.1:0/2004399890 <== mon.2 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11837 (secure 0 0 0) 0x7f4fb809bba0 con 0x7f4fc8102d40 2024-09-19T09:38:19.996 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:38:19.996 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":19,"btime":"2024-09-19T09:36:24:006349+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:36:23.723388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6839/3279971690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3279971690},{"type":"v1","addr":"172.21.15.121:6839","nonce":3279971690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:38:19.996 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 19 2024-09-19T09:38:19.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.996+0000 7f4fcee85640 1 -- 172.21.15.1:0/2004399890 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4fb40a3240 msgr2=0x7f4fb40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:19.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.996+0000 7f4fcee85640 1 --2- 172.21.15.1:0/2004399890 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4fb40a3240 0x7f4fb40a5700 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80fedc0 tx=0x7f4fb000b2e0 comp rx=0 tx=0).stop 2024-09-19T09:38:19.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.996+0000 7f4fcee85640 1 -- 172.21.15.1:0/2004399890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fc8102d40 msgr2=0x7f4fc8198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:19.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.996+0000 7f4fcee85640 1 --2- 172.21.15.1:0/2004399890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fc8102d40 0x7f4fc8198440 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4fb800d950 tx=0x7f4fb800de10 comp rx=0 tx=0).stop 2024-09-19T09:38:19.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.996+0000 7f4fcee85640 1 -- 172.21.15.1:0/2004399890 shutdown_connections 2024-09-19T09:38:19.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.996+0000 7f4fcee85640 1 --2- 172.21.15.1:0/2004399890 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fc810c170 0x7f4fc819cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:19.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.996+0000 7f4fcee85640 1 --2- 172.21.15.1:0/2004399890 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4fc8103660 0x7f4fc8198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:19.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.996+0000 7f4fcee85640 1 --2- 172.21.15.1:0/2004399890 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4fb40a3240 0x7f4fb40a5700 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:19.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.996+0000 7f4fcee85640 1 --2- 172.21.15.1:0/2004399890 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4fc8102d40 0x7f4fc8198440 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:19.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.996+0000 7f4fcee85640 1 -- 172.21.15.1:0/2004399890 >> 172.21.15.1:0/2004399890 conn(0x7f4fc80fc7a0 msgr2=0x7f4fc80fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:19.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.996+0000 7f4fcee85640 1 -- 172.21.15.1:0/2004399890 shutdown_connections 2024-09-19T09:38:19.998 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:19.996+0000 7f4fcee85640 1 -- 172.21.15.1:0/2004399890 wait complete. 2024-09-19T09:38:20.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:19 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:38:20.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:19 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:38:20.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:19 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:38:20.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:19 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:38:20.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:19 smithi022 ceph-mon[35583]: pgmap v345: 97 pgs: 97 active+clean; 645 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-19T09:38:20.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:19 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:38:20.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:19 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:38:20.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:19 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:38:20.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:19 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:38:20.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:19 smithi121 ceph-mon[35577]: pgmap v345: 97 pgs: 97 active+clean; 645 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-19T09:38:20.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:19 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:38:20.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:19 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:38:20.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:19 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:38:20.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:19 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:38:20.657 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:38:20.918 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:21.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:20 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/2004399890' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:21.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:20 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:38:21.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:20 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:38:21.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:20 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:38:21.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:20 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:38:21.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:20 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:38:21.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:20 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/2004399890' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:21.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:20 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:38:21.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:20 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:38:21.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:20 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:38:21.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:20 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:38:21.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:20 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:38:21.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:20 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/2004399890' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:21.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:20 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:38:21.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:20 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:38:21.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:20 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:38:21.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:20 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:38:21.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:20 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:38:21.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.406+0000 7ff9d06be640 1 -- 172.21.15.1:0/3295066046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9c8100a80 msgr2=0x7ff9c8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:21.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.406+0000 7ff9d06be640 1 --2- 172.21.15.1:0/3295066046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9c8100a80 0x7ff9c8100ee0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8009930 tx=0x7ff9b802a420 comp rx=0 tx=0).stop 2024-09-19T09:38:21.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.406+0000 7ff9d06be640 1 -- 172.21.15.1:0/3295066046 shutdown_connections 2024-09-19T09:38:21.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.406+0000 7ff9d06be640 1 --2- 172.21.15.1:0/3295066046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9c8101420 0x7ff9c810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:21.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.406+0000 7ff9d06be640 1 --2- 172.21.15.1:0/3295066046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9c8100a80 0x7ff9c8100ee0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:21.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.406+0000 7ff9d06be640 1 --2- 172.21.15.1:0/3295066046 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9c8106a80 0x7ff9c8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:21.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.406+0000 7ff9d06be640 1 -- 172.21.15.1:0/3295066046 >> 172.21.15.1:0/3295066046 conn(0x7ff9c80fc7a0 msgr2=0x7ff9c80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:21.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.406+0000 7ff9d06be640 1 -- 172.21.15.1:0/3295066046 shutdown_connections 2024-09-19T09:38:21.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.406+0000 7ff9d06be640 1 -- 172.21.15.1:0/3295066046 wait complete. 2024-09-19T09:38:21.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.407+0000 7ff9d06be640 1 Processor -- start 2024-09-19T09:38:21.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.407+0000 7ff9d06be640 1 -- start start 2024-09-19T09:38:21.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.407+0000 7ff9d06be640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9c8100a80 0x7ff9c81970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:21.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.407+0000 7ff9d06be640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9c8101420 0x7ff9c81975f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:21.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.407+0000 7ff9d06be640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9c8106a80 0x7ff9c819c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:21.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.407+0000 7ff9d06be640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c8110ef0 con 0x7ff9c8100a80 2024-09-19T09:38:21.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.407+0000 7ff9d06be640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c8110d70 con 0x7ff9c8106a80 2024-09-19T09:38:21.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.407+0000 7ff9d06be640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c8111070 con 0x7ff9c8101420 2024-09-19T09:38:21.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.407+0000 7ff9ce45a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9c8100a80 0x7ff9c81970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:21.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.407+0000 7ff9ce45a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9c8100a80 0x7ff9c81970b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53534/0 (socket says 172.21.15.1:53534) 2024-09-19T09:38:21.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.407+0000 7ff9ce45a640 1 -- 172.21.15.1:0/589441987 learned_addr learned my addr 172.21.15.1:0/589441987 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:21.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.407+0000 7ff9cec5b640 1 --2- 172.21.15.1:0/589441987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9c8106a80 0x7ff9c819c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:21.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.407+0000 7ff9ce45a640 1 -- 172.21.15.1:0/589441987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9c8101420 msgr2=0x7ff9c81975f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:21.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.407+0000 7ff9cdc59640 1 --2- 172.21.15.1:0/589441987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9c8101420 0x7ff9c81975f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:21.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.407+0000 7ff9ce45a640 1 --2- 172.21.15.1:0/589441987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9c8101420 0x7ff9c81975f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:21.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.407+0000 7ff9ce45a640 1 -- 172.21.15.1:0/589441987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9c8106a80 msgr2=0x7ff9c819c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:21.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.407+0000 7ff9ce45a640 1 --2- 172.21.15.1:0/589441987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9c8106a80 0x7ff9c819c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:21.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.407+0000 7ff9ce45a640 1 -- 172.21.15.1:0/589441987 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c819c640 con 0x7ff9c8100a80 2024-09-19T09:38:21.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.408+0000 7ff9cec5b640 1 --2- 172.21.15.1:0/589441987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9c8106a80 0x7ff9c819c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:21.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.408+0000 7ff9ce45a640 1 --2- 172.21.15.1:0/589441987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9c8100a80 0x7ff9c81970b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400b4a0 tx=0x7ff9c400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:21.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.408+0000 7ff9bf7fe640 1 -- 172.21.15.1:0/589441987 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4014070 con 0x7ff9c8100a80 2024-09-19T09:38:21.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.408+0000 7ff9bf7fe640 1 -- 172.21.15.1:0/589441987 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9c4010af0 con 0x7ff9c8100a80 2024-09-19T09:38:21.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.408+0000 7ff9bf7fe640 1 -- 172.21.15.1:0/589441987 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4017d10 con 0x7ff9c8100a80 2024-09-19T09:38:21.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.408+0000 7ff9d06be640 1 -- 172.21.15.1:0/589441987 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9c819c930 con 0x7ff9c8100a80 2024-09-19T09:38:21.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.408+0000 7ff9d06be640 1 -- 172.21.15.1:0/589441987 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9c819ce70 con 0x7ff9c8100a80 2024-09-19T09:38:21.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.409+0000 7ff9d06be640 1 -- 172.21.15.1:0/589441987 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9c81021c0 con 0x7ff9c8100a80 2024-09-19T09:38:21.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.410+0000 7ff9bf7fe640 1 -- 172.21.15.1:0/589441987 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7ff9c4017070 con 0x7ff9c8100a80 2024-09-19T09:38:21.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.411+0000 7ff9bf7fe640 1 --2- 172.21.15.1:0/589441987 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff9b40a3240 0x7ff9b40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:21.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.411+0000 7ff9cdc59640 1 --2- 172.21.15.1:0/589441987 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff9b40a3240 0x7ff9b40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:21.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.411+0000 7ff9bf7fe640 1 -- 172.21.15.1:0/589441987 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7ff9c40cf120 con 0x7ff9c8100a80 2024-09-19T09:38:21.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.411+0000 7ff9cdc59640 1 --2- 172.21.15.1:0/589441987 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff9b40a3240 0x7ff9b40a5700 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff9b80096c0 tx=0x7ff9b8005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:21.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.414+0000 7ff9bf7fe640 1 -- 172.21.15.1:0/589441987 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff9c409be40 con 0x7ff9c8100a80 2024-09-19T09:38:21.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.590+0000 7ff9d06be640 1 -- 172.21.15.1:0/589441987 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff9c8100ee0 con 0x7ff9c8100a80 2024-09-19T09:38:21.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.592+0000 7ff9bf7fe640 1 -- 172.21.15.1:0/589441987 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22612 (secure 0 0 0) 0x7ff9c409b740 con 0x7ff9c8100a80 2024-09-19T09:38:21.593 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:38:21.594 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":83,"fsid":"57238232-7669-11ef-bceb-c7b262605968","created":"2024-09-19T09:28:28.406983+0000","modified":"2024-09-19T09:37:16.024965+0000","last_up_change":"2024-09-19T09:35:21.422825+0000","last_in_change":"2024-09-19T09:34:57.199184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:31:30.566509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:36:09.521275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:36:11.954337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c165571d-43f1-4c43-ba1e-35872d914f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6803","nonce":502676986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6805","nonce":502676986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6809","nonce":502676986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6807","nonce":502676986}]},"public_addr":"172.21.15.1:6803/502676986","cluster_addr":"172.21.15.1:6805/502676986","heartbeat_back_addr":"172.21.15.1:6809/502676986","heartbeat_front_addr":"172.21.15.1:6807/502676986","state":["exists","up"]},{"osd":1,"uuid":"baf120f8-8ba3-4aa5-a12a-41cdc97ff11b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6801","nonce":3735826323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6803","nonce":3735826323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6807","nonce":3735826323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6805","nonce":3735826323}]},"public_addr":"172.21.15.22:6801/3735826323","cluster_addr":"172.21.15.22:6803/3735826323","heartbeat_back_addr":"172.21.15.22:6807/3735826323","heartbeat_front_addr":"172.21.15.22:6805/3735826323","state":["exists","up"]},{"osd":2,"uuid":"72c520bf-c5cc-44ee-a38c-c9bac0a6280b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6801","nonce":1924970833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6803","nonce":1924970833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6807","nonce":1924970833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6805","nonce":1924970833}]},"public_addr":"172.21.15.121:6801/1924970833","cluster_addr":"172.21.15.121:6803/1924970833","heartbeat_back_addr":"172.21.15.121:6807/1924970833","heartbeat_front_addr":"172.21.15.121:6805/1924970833","state":["exists","up"]},{"osd":3,"uuid":"adad6d17-16d9-4c43-b581-35ac1bb9d807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6811","nonce":1515009793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6813","nonce":1515009793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6817","nonce":1515009793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6815","nonce":1515009793}]},"public_addr":"172.21.15.1:6811/1515009793","cluster_addr":"172.21.15.1:6813/1515009793","heartbeat_back_addr":"172.21.15.1:6817/1515009793","heartbeat_front_addr":"172.21.15.1:6815/1515009793","state":["exists","up"]},{"osd":4,"uuid":"8fb06efe-c3a0-48a3-9730-3e8f3e60922d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6809","nonce":923697266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6811","nonce":923697266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6815","nonce":923697266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6813","nonce":923697266}]},"public_addr":"172.21.15.22:6809/923697266","cluster_addr":"172.21.15.22:6811/923697266","heartbeat_back_addr":"172.21.15.22:6815/923697266","heartbeat_front_addr":"172.21.15.22:6813/923697266","state":["exists","up"]},{"osd":5,"uuid":"3b2f428c-8a5a-49be-9f43-a9f379a1c7e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6809","nonce":3137245658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6811","nonce":3137245658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6815","nonce":3137245658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6813","nonce":3137245658}]},"public_addr":"172.21.15.121:6809/3137245658","cluster_addr":"172.21.15.121:6811/3137245658","heartbeat_back_addr":"172.21.15.121:6815/3137245658","heartbeat_front_addr":"172.21.15.121:6813/3137245658","state":["exists","up"]},{"osd":6,"uuid":"5aecec68-ff7e-440c-bd39-cc35ab89cc91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6819","nonce":3376780798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6821","nonce":3376780798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6825","nonce":3376780798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6823","nonce":3376780798}]},"public_addr":"172.21.15.1:6819/3376780798","cluster_addr":"172.21.15.1:6821/3376780798","heartbeat_back_addr":"172.21.15.1:6825/3376780798","heartbeat_front_addr":"172.21.15.1:6823/3376780798","state":["exists","up"]},{"osd":7,"uuid":"46556bdf-199e-4268-873b-6d87b54e1176","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6817","nonce":2920985295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6819","nonce":2920985295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6823","nonce":2920985295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6821","nonce":2920985295}]},"public_addr":"172.21.15.22:6817/2920985295","cluster_addr":"172.21.15.22:6819/2920985295","heartbeat_back_addr":"172.21.15.22:6823/2920985295","heartbeat_front_addr":"172.21.15.22:6821/2920985295","state":["exists","up"]},{"osd":8,"uuid":"e7c3792a-94a4-4440-be74-d6abdf3d9566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6817","nonce":3589985967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6819","nonce":3589985967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6823","nonce":3589985967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6821","nonce":3589985967}]},"public_addr":"172.21.15.121:6817/3589985967","cluster_addr":"172.21.15.121:6819/3589985967","heartbeat_back_addr":"172.21.15.121:6823/3589985967","heartbeat_front_addr":"172.21.15.121:6821/3589985967","state":["exists","up"]},{"osd":9,"uuid":"8af80ac9-d681-4966-b083-ead5185eff12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6827","nonce":1143859822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6829","nonce":1143859822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6833","nonce":1143859822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6831","nonce":1143859822}]},"public_addr":"172.21.15.1:6827/1143859822","cluster_addr":"172.21.15.1:6829/1143859822","heartbeat_back_addr":"172.21.15.1:6833/1143859822","heartbeat_front_addr":"172.21.15.1:6831/1143859822","state":["exists","up"]},{"osd":10,"uuid":"34edd06a-7f60-4465-bfe1-0c646abd53f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6825","nonce":343155547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6827","nonce":343155547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6831","nonce":343155547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6829","nonce":343155547}]},"public_addr":"172.21.15.22:6825/343155547","cluster_addr":"172.21.15.22:6827/343155547","heartbeat_back_addr":"172.21.15.22:6831/343155547","heartbeat_front_addr":"172.21.15.22:6829/343155547","state":["exists","up"]},{"osd":11,"uuid":"5a831eb6-ad66-4ab6-a30a-b6299ce1f88d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6825","nonce":3202514460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6827","nonce":3202514460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6831","nonce":3202514460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6829","nonce":3202514460}]},"public_addr":"172.21.15.121:6825/3202514460","cluster_addr":"172.21.15.121:6827/3202514460","heartbeat_back_addr":"172.21.15.121:6831/3202514460","heartbeat_front_addr":"172.21.15.121:6829/3202514460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:30:37.582893+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:01.915252+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:26.783477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:53.407014+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:19.407005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:45.022320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:11.377986+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:36.818700+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:01.745428+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:27.928916+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:53.363906+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:19.037551+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6800/1028873727":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/3137949087":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/1951370933":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2008363642":"2024-09-20T09:28:50.074985+0000","172.21.15.1:0/3006931063":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2486161758":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6801/1296304385":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6801/1028873727":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2783823049":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6800/1296304385":"2024-09-20T09:28:50.074985+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:38:21.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.594+0000 7ff9d06be640 1 -- 172.21.15.1:0/589441987 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff9b40a3240 msgr2=0x7ff9b40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:21.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.594+0000 7ff9d06be640 1 --2- 172.21.15.1:0/589441987 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff9b40a3240 0x7ff9b40a5700 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff9b80096c0 tx=0x7ff9b8005fd0 comp rx=0 tx=0).stop 2024-09-19T09:38:21.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.594+0000 7ff9d06be640 1 -- 172.21.15.1:0/589441987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9c8100a80 msgr2=0x7ff9c81970b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:21.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.594+0000 7ff9d06be640 1 --2- 172.21.15.1:0/589441987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9c8100a80 0x7ff9c81970b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400b4a0 tx=0x7ff9c400b960 comp rx=0 tx=0).stop 2024-09-19T09:38:21.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.594+0000 7ff9d06be640 1 -- 172.21.15.1:0/589441987 shutdown_connections 2024-09-19T09:38:21.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.594+0000 7ff9d06be640 1 --2- 172.21.15.1:0/589441987 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff9b40a3240 0x7ff9b40a5700 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:21.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.594+0000 7ff9d06be640 1 --2- 172.21.15.1:0/589441987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9c8106a80 0x7ff9c819c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:21.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.594+0000 7ff9d06be640 1 --2- 172.21.15.1:0/589441987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9c8101420 0x7ff9c81975f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:21.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.594+0000 7ff9d06be640 1 --2- 172.21.15.1:0/589441987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9c8100a80 0x7ff9c81970b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:21.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.594+0000 7ff9d06be640 1 -- 172.21.15.1:0/589441987 >> 172.21.15.1:0/589441987 conn(0x7ff9c80fc7a0 msgr2=0x7ff9c80fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:21.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.594+0000 7ff9d06be640 1 -- 172.21.15.1:0/589441987 shutdown_connections 2024-09-19T09:38:21.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:21.594+0000 7ff9d06be640 1 -- 172.21.15.1:0/589441987 wait complete. 2024-09-19T09:38:22.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:21 smithi001 ceph-mon[31225]: pgmap v346: 97 pgs: 97 active+clean; 645 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-19T09:38:22.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:21 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/589441987' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:38:22.328 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-19T09:38:22.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.327+0000 7fad1458d640 1 -- 172.21.15.1:0/4290452372 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad0c107840 msgr2=0x7fad0c109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:22.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.327+0000 7fad1458d640 1 --2- 172.21.15.1:0/4290452372 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad0c107840 0x7fad0c109cb0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fad04009ca0 tx=0x7fad0402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.327+0000 7fad1458d640 1 -- 172.21.15.1:0/4290452372 shutdown_connections 2024-09-19T09:38:22.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.327+0000 7fad1458d640 1 --2- 172.21.15.1:0/4290452372 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad0c107840 0x7fad0c109cb0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.327+0000 7fad1458d640 1 --2- 172.21.15.1:0/4290452372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad0c104f10 0x7fad0c107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.327+0000 7fad1458d640 1 --2- 172.21.15.1:0/4290452372 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad0c1025e0 0x7fad0c1049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.327+0000 7fad1458d640 1 -- 172.21.15.1:0/4290452372 >> 172.21.15.1:0/4290452372 conn(0x7fad0c0fc1c0 msgr2=0x7fad0c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:22.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.327+0000 7fad1458d640 1 -- 172.21.15.1:0/4290452372 shutdown_connections 2024-09-19T09:38:22.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.327+0000 7fad1458d640 1 -- 172.21.15.1:0/4290452372 wait complete. 2024-09-19T09:38:22.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.328+0000 7fad1458d640 1 Processor -- start 2024-09-19T09:38:22.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.328+0000 7fad1458d640 1 -- start start 2024-09-19T09:38:22.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.328+0000 7fad1458d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad0c1025e0 0x7fad0c197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.328+0000 7fad1458d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad0c104f10 0x7fad0c198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.328+0000 7fad1458d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad0c107840 0x7fad0c19f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.328+0000 7fad1458d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c10d820 con 0x7fad0c107840 2024-09-19T09:38:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.328+0000 7fad1458d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c10d6a0 con 0x7fad0c1025e0 2024-09-19T09:38:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.328+0000 7fad1458d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c10d9a0 con 0x7fad0c104f10 2024-09-19T09:38:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.328+0000 7fad12b2a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad0c107840 0x7fad0c19f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.328+0000 7fad12b2a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad0c107840 0x7fad0c19f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53564/0 (socket says 172.21.15.1:53564) 2024-09-19T09:38:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.328+0000 7fad12b2a640 1 -- 172.21.15.1:0/2613038090 learned_addr learned my addr 172.21.15.1:0/2613038090 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.328+0000 7fad12329640 1 --2- 172.21.15.1:0/2613038090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad0c1025e0 0x7fad0c197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.328+0000 7fad11b28640 1 --2- 172.21.15.1:0/2613038090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad0c104f10 0x7fad0c198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.328+0000 7fad12b2a640 1 -- 172.21.15.1:0/2613038090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad0c104f10 msgr2=0x7fad0c198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.328+0000 7fad12b2a640 1 --2- 172.21.15.1:0/2613038090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad0c104f10 0x7fad0c198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.328+0000 7fad12b2a640 1 -- 172.21.15.1:0/2613038090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad0c1025e0 msgr2=0x7fad0c197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:22.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.328+0000 7fad12b2a640 1 --2- 172.21.15.1:0/2613038090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad0c1025e0 0x7fad0c197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.328+0000 7fad12b2a640 1 -- 172.21.15.1:0/2613038090 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad0c19fae0 con 0x7fad0c107840 2024-09-19T09:38:22.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.328+0000 7fad11b28640 1 --2- 172.21.15.1:0/2613038090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad0c104f10 0x7fad0c198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:22.335 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.329+0000 7fad12b2a640 1 --2- 172.21.15.1:0/2613038090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad0c107840 0x7fad0c19f470 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fad0402f540 tx=0x7fad04031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:22.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.329+0000 7fad037fe640 1 -- 172.21.15.1:0/2613038090 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad04003c30 con 0x7fad0c107840 2024-09-19T09:38:22.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.329+0000 7fad037fe640 1 -- 172.21.15.1:0/2613038090 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad04003dd0 con 0x7fad0c107840 2024-09-19T09:38:22.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.329+0000 7fad1458d640 1 -- 172.21.15.1:0/2613038090 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad0c19fd70 con 0x7fad0c107840 2024-09-19T09:38:22.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.329+0000 7fad037fe640 1 -- 172.21.15.1:0/2613038090 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0402fd90 con 0x7fad0c107840 2024-09-19T09:38:22.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.329+0000 7fad1458d640 1 -- 172.21.15.1:0/2613038090 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad0c1a0260 con 0x7fad0c107840 2024-09-19T09:38:22.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.332+0000 7fad17401740 1 Processor -- start 2024-09-19T09:38:22.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.332+0000 7fad037fe640 1 -- 172.21.15.1:0/2613038090 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fad04004050 con 0x7fad0c107840 2024-09-19T09:38:22.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.333+0000 7fad17401740 1 -- start start 2024-09-19T09:38:22.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.333+0000 7fad17401740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b566b0ddb0 0x55b566b0e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:22.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.333+0000 7fad17401740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b566b0e6f0 0x55b566b131b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:22.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.333+0000 7fad17401740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b566b13780 0x55b566b15c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:22.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.333+0000 7fad17401740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b566a6d2f0 con 0x55b566b13780 2024-09-19T09:38:22.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.333+0000 7fad17401740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b566a15270 con 0x55b566b0ddb0 2024-09-19T09:38:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.333+0000 7fad17401740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b566a692b0 con 0x55b566b0e6f0 2024-09-19T09:38:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.333+0000 7fad11b28640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b566b13780 0x55b566b15c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.333+0000 7fad11b28640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b566b13780 0x55b566b15c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53574/0 (socket says 172.21.15.1:53574) 2024-09-19T09:38:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.333+0000 7fad11b28640 1 -- 172.21.15.1:0/238792904 learned_addr learned my addr 172.21.15.1:0/238792904 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.333+0000 7fad12329640 1 --2- 172.21.15.1:0/238792904 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b566b0e6f0 0x55b566b131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.333+0000 7fad11b28640 1 --2- 172.21.15.1:0/238792904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b566b0ddb0 0x55b566b0e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.333+0000 7fad037fe640 1 --2- 172.21.15.1:0/2613038090 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7facf80a3240 0x7facf80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.333+0000 7fad11b28640 1 -- 172.21.15.1:0/238792904 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b566b0e6f0 msgr2=0x55b566b131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.333+0000 7fad11b28640 1 --2- 172.21.15.1:0/238792904 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b566b0e6f0 0x55b566b131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.333+0000 7fad11b28640 1 -- 172.21.15.1:0/238792904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b566b0ddb0 msgr2=0x55b566b0e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.333+0000 7fad11b28640 1 --2- 172.21.15.1:0/238792904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b566b0ddb0 0x55b566b0e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.333+0000 7fad11b28640 1 -- 172.21.15.1:0/238792904 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b566a14340 con 0x55b566b13780 2024-09-19T09:38:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.334+0000 7fad037fe640 1 -- 172.21.15.1:0/2613038090 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fad040f0ac0 con 0x7fad0c107840 2024-09-19T09:38:22.338 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.334+0000 7fad12b2a640 1 --2- 172.21.15.1:0/2613038090 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7facf80a3240 0x7facf80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:22.338 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.334+0000 7fad11b28640 1 --2- 172.21.15.1:0/238792904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b566b13780 0x55b566b15c40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7facfc012820 tx=0x7facfc00d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f4f6c10714d37c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:22.338 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.334+0000 7fad00bfe640 1 -- 172.21.15.1:0/238792904 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc012e60 con 0x55b566b13780 2024-09-19T09:38:22.338 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.334+0000 7fad00bfe640 1 -- 172.21.15.1:0/238792904 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facfc01d430 con 0x55b566b13780 2024-09-19T09:38:22.338 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.334+0000 7fad00bfe640 1 -- 172.21.15.1:0/238792904 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc0105d0 con 0x55b566b13780 2024-09-19T09:38:22.338 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.334+0000 7fad12b2a640 1 --2- 172.21.15.1:0/2613038090 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7facf80a3240 0x7facf80a5700 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fad040bd190 tx=0x7fad04033040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.335+0000 7fad17401740 1 -- 172.21.15.1:0/238792904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b566b13780 msgr2=0x55b566b15c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.335+0000 7fad17401740 1 --2- 172.21.15.1:0/238792904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b566b13780 0x55b566b15c40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7facfc012820 tx=0x7facfc00d3a0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.335+0000 7fad17401740 1 -- 172.21.15.1:0/238792904 shutdown_connections 2024-09-19T09:38:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.335+0000 7fad17401740 1 --2- 172.21.15.1:0/238792904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b566b13780 0x55b566b15c40 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.335+0000 7fad17401740 1 --2- 172.21.15.1:0/238792904 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b566b0e6f0 0x55b566b131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.335+0000 7fad17401740 1 --2- 172.21.15.1:0/238792904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b566b0ddb0 0x55b566b0e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.335+0000 7fad17401740 1 -- 172.21.15.1:0/238792904 >> 172.21.15.1:0/238792904 conn(0x55b566b05010 msgr2=0x55b566b05410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.335+0000 7fad17401740 1 -- 172.21.15.1:0/238792904 shutdown_connections 2024-09-19T09:38:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.335+0000 7fad17401740 1 -- 172.21.15.1:0/238792904 wait complete. 2024-09-19T09:38:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.335+0000 7fad17401740 1 -- start start 2024-09-19T09:38:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.335+0000 7fad17401740 1 Processor -- start 2024-09-19T09:38:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.336+0000 7fad17401740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b566b0ddb0 0x55b566b18030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.336+0000 7fad17401740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b566b0e6f0 0x55b566b18570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.336+0000 7fad17401740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b566b13780 0x55b566b1f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.336+0000 7fad17401740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b566b16750 con 0x55b566b0ddb0 2024-09-19T09:38:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.336+0000 7fad17401740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b5669f6290 con 0x55b566b13780 2024-09-19T09:38:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.336+0000 7fad17401740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b566b168d0 con 0x55b566b0e6f0 2024-09-19T09:38:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.336+0000 7fad17401740 10 client.0 _ll_register_callbacks cb 0x55b566a27140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.336+0000 7fad11b28640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b566b0ddb0 0x55b566b18030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.336+0000 7fad11b28640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b566b0ddb0 0x55b566b18030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53582/0 (socket says 172.21.15.1:53582) 2024-09-19T09:38:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.336+0000 7fad11b28640 1 -- 172.21.15.1:0/2881790879 learned_addr learned my addr 172.21.15.1:0/2881790879 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.336+0000 7fad12329640 1 --2- 172.21.15.1:0/2881790879 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b566b0e6f0 0x55b566b18570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.336+0000 7fad11b28640 1 --2- 172.21.15.1:0/2881790879 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b566b13780 0x55b566b1f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.336+0000 7fad12329640 1 -- 172.21.15.1:0/2881790879 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b566b13780 msgr2=0x55b566b1f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.336+0000 7fad12329640 1 --2- 172.21.15.1:0/2881790879 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b566b13780 0x55b566b1f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.336+0000 7fad12329640 1 -- 172.21.15.1:0/2881790879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b566b0ddb0 msgr2=0x55b566b18030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.336+0000 7fad12329640 1 --2- 172.21.15.1:0/2881790879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b566b0ddb0 0x55b566b18030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.336+0000 7fad12329640 1 -- 172.21.15.1:0/2881790879 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b566780210 con 0x55b566b0e6f0 2024-09-19T09:38:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.336+0000 7fad11b28640 1 --2- 172.21.15.1:0/2881790879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b566b0ddb0 0x55b566b18030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:38:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.336+0000 7fad12329640 1 --2- 172.21.15.1:0/2881790879 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b566b0e6f0 0x55b566b18570 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x55b566b0f120 tx=0x7fad08012b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f445f540e8bcf47d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.336+0000 7facf5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-19T09:38:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.337+0000 7facf5ffb640 1 -- 172.21.15.1:0/2881790879 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0800f8c0 con 0x55b566b0e6f0 2024-09-19T09:38:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.337+0000 7fad17401740 1 -- 172.21.15.1:0/2881790879 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facfc01d430 con 0x55b566b0e6f0 2024-09-19T09:38:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.337+0000 7facf5ffb640 1 -- 172.21.15.1:0/2881790879 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fad0800fa60 con 0x55b566b0e6f0 2024-09-19T09:38:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.337+0000 7facf5ffb640 1 -- 172.21.15.1:0/2881790879 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fad0800fc60 con 0x55b566b0e6f0 2024-09-19T09:38:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.337+0000 7fad17401740 10 client.24856 fetch_fsmap learned FSMap version 19 2024-09-19T09:38:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.337+0000 7fad17401740 1 -- 172.21.15.1:0/2881790879 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55b56684c620 con 0x55b566b0e6f0 2024-09-19T09:38:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.337+0000 7facf5ffb640 1 -- 172.21.15.1:0/2881790879 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facfc01d430 con 0x55b566b0e6f0 2024-09-19T09:38:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.337+0000 7facf5ffb640 1 -- 172.21.15.1:0/2881790879 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fad0801c420 con 0x55b566b0e6f0 2024-09-19T09:38:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.337+0000 7fad17401740 10 client.24856 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:38:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.337+0000 7fad17401740 10 client.24856 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:38:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.337+0000 7fad17401740 20 client.24856 populate_metadata read hostname 'smithi001' 2024-09-19T09:38:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.337+0000 7fad17401740 1 --2- 172.21.15.1:0/2881790879 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b566b23d00 0x55b566b26110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.337+0000 7fad17401740 4 client.24856 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:38:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.337+0000 7fad17401740 1 -- 172.21.15.1:0/2881790879 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b566a7aa20 con 0x55b566b23d00 2024-09-19T09:38:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.338+0000 7fad11b28640 1 --2- 172.21.15.1:0/2881790879 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b566b23d00 0x55b566b26110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.338+0000 7fad11b28640 1 --2- 172.21.15.1:0/2881790879 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b566b23d00 0x55b566b26110 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de4e90a3f6bd2fed server_cookie=9139ac7efdf33a38 in_seq=0 out_seq=0 2024-09-19T09:38:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.338+0000 7facf5ffb640 10 client.24856 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.339+0000 7facf5ffb640 1 -- 172.21.15.1:0/2881790879 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b566a7aa20 con 0x55b566b23d00 2024-09-19T09:38:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.339+0000 7facf5ffb640 10 client.24856 handle_command_reply: tid=0 2024-09-19T09:38:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.339+0000 7fad17401740 1 client.24856 shutdown 2024-09-19T09:38:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.339+0000 7fad17401740 1 -- 172.21.15.1:0/2881790879 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b566b0e6f0 msgr2=0x55b566b18570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.339+0000 7fad17401740 1 --2- 172.21.15.1:0/2881790879 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b566b0e6f0 0x55b566b18570 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x55b566b0f120 tx=0x7fad08012b60 comp rx=0 tx=0).stop 2024-09-19T09:38:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.339+0000 7fad17401740 1 -- 172.21.15.1:0/2881790879 shutdown_connections 2024-09-19T09:38:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.339+0000 7fad17401740 1 --2- 172.21.15.1:0/2881790879 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b566b23d00 0x55b566b26110 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.339+0000 7fad17401740 1 --2- 172.21.15.1:0/2881790879 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b566b13780 0x55b566b1f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.339+0000 7fad17401740 1 --2- 172.21.15.1:0/2881790879 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b566b0e6f0 0x55b566b18570 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.339+0000 7facf5ffb640 0 client.24856 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.339+0000 7fad17401740 1 --2- 172.21.15.1:0/2881790879 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b566b0ddb0 0x55b566b18030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.339+0000 7fad17401740 1 -- 172.21.15.1:0/2881790879 >> 172.21.15.1:0/2881790879 conn(0x55b566b05010 msgr2=0x55b566b06820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.339+0000 7fad17401740 1 -- 172.21.15.1:0/2881790879 shutdown_connections 2024-09-19T09:38:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.339+0000 7fad17401740 1 -- 172.21.15.1:0/2881790879 wait complete. 2024-09-19T09:38:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.339+0000 7fad17401740 20 client.24856 trim_cache size 0 max 16384 2024-09-19T09:38:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.354+0000 7fad17401740 1 Processor -- start 2024-09-19T09:38:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.354+0000 7fad17401740 1 -- start start 2024-09-19T09:38:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.354+0000 7fad17401740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b566b05010 0x55b566b040b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.354+0000 7fad17401740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b566b0ddb0 0x55b566b1f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.354+0000 7fad17401740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b566b0e6f0 0x55b566b06400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.354+0000 7fad17401740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c1a4e80 con 0x55b566b0e6f0 2024-09-19T09:38:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.354+0000 7fad17401740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c1a7720 con 0x55b566b0ddb0 2024-09-19T09:38:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.354+0000 7fad17401740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c1a5510 con 0x55b566b05010 2024-09-19T09:38:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.355+0000 7fad11b28640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b566b0e6f0 0x55b566b06400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.355+0000 7fad12329640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b566b0ddb0 0x55b566b1f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.355+0000 7fad12329640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b566b0ddb0 0x55b566b1f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:60774/0 (socket says 172.21.15.1:60774) 2024-09-19T09:38:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.355+0000 7fad12329640 1 -- 172.21.15.1:0/245440995 learned_addr learned my addr 172.21.15.1:0/245440995 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.355+0000 7fad11b28640 1 --2- 172.21.15.1:0/245440995 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b566b05010 0x55b566b040b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.355+0000 7fad12329640 1 -- 172.21.15.1:0/245440995 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b566b05010 msgr2=0x55b566b040b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.355+0000 7fad12329640 1 --2- 172.21.15.1:0/245440995 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b566b05010 0x55b566b040b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.355+0000 7fad12329640 1 -- 172.21.15.1:0/245440995 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b566b0e6f0 msgr2=0x55b566b06400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.355+0000 7fad12329640 1 --2- 172.21.15.1:0/245440995 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b566b0e6f0 0x55b566b06400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.355+0000 7fad12329640 1 -- 172.21.15.1:0/245440995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b566b17b70 con 0x55b566b0ddb0 2024-09-19T09:38:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.355+0000 7fad12329640 1 --2- 172.21.15.1:0/245440995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b566b0ddb0 0x55b566b1f570 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fad08001eb0 tx=0x7fad080096c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fed6f759aadb7a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.355+0000 7facf7fff640 1 -- 172.21.15.1:0/245440995 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0801c420 con 0x55b566b0ddb0 2024-09-19T09:38:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.355+0000 7facf7fff640 1 -- 172.21.15.1:0/245440995 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad0802b020 con 0x55b566b0ddb0 2024-09-19T09:38:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.355+0000 7facf7fff640 1 -- 172.21.15.1:0/245440995 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad08005250 con 0x55b566b0ddb0 2024-09-19T09:38:22.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.356+0000 7fad17401740 1 -- 172.21.15.1:0/245440995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b566b0ddb0 msgr2=0x55b566b1f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:22.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.356+0000 7fad17401740 1 --2- 172.21.15.1:0/245440995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b566b0ddb0 0x55b566b1f570 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fad08001eb0 tx=0x7fad080096c0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.356+0000 7fad17401740 1 -- 172.21.15.1:0/245440995 shutdown_connections 2024-09-19T09:38:22.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.356+0000 7fad17401740 1 --2- 172.21.15.1:0/245440995 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b566b0e6f0 0x55b566b06400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.356+0000 7fad17401740 1 --2- 172.21.15.1:0/245440995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b566b0ddb0 0x55b566b1f570 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.356+0000 7fad17401740 1 --2- 172.21.15.1:0/245440995 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b566b05010 0x55b566b040b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.356+0000 7fad17401740 1 -- 172.21.15.1:0/245440995 >> 172.21.15.1:0/245440995 conn(0x55b566b132d0 msgr2=0x55b566b039a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.356+0000 7fad17401740 1 -- 172.21.15.1:0/245440995 shutdown_connections 2024-09-19T09:38:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.356+0000 7fad17401740 1 -- 172.21.15.1:0/245440995 wait complete. 2024-09-19T09:38:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.356+0000 7fad17401740 1 -- start start 2024-09-19T09:38:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.357+0000 7fad17401740 1 Processor -- start 2024-09-19T09:38:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.357+0000 7fad17401740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b566b05010 0x55b566b1cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.357+0000 7fad17401740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b566b0ddb0 0x55b566b1d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.357+0000 7fad17401740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b566b0e6f0 0x55b566b1e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.357+0000 7fad17401740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c1a5be0 con 0x55b566b0e6f0 2024-09-19T09:38:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.357+0000 7fad17401740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c1a7050 con 0x55b566b0ddb0 2024-09-19T09:38:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.357+0000 7fad17401740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c1a62b0 con 0x55b566b05010 2024-09-19T09:38:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.357+0000 7fad17401740 10 client.0 _ll_register_callbacks cb 0x7fad08009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.357+0000 7fad11b28640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b566b0e6f0 0x55b566b1e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.357+0000 7fad11b28640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b566b0e6f0 0x55b566b1e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53602/0 (socket says 172.21.15.1:53602) 2024-09-19T09:38:22.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.357+0000 7fad11b28640 1 -- 172.21.15.1:0/1279114064 learned_addr learned my addr 172.21.15.1:0/1279114064 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.357+0000 7fad12329640 1 --2- 172.21.15.1:0/1279114064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b566b0ddb0 0x55b566b1d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.357+0000 7fad11b28640 1 --2- 172.21.15.1:0/1279114064 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b566b05010 0x55b566b1cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.357+0000 7fad11b28640 1 -- 172.21.15.1:0/1279114064 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b566b05010 msgr2=0x55b566b1cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.357+0000 7fad11b28640 1 --2- 172.21.15.1:0/1279114064 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b566b05010 0x55b566b1cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.357+0000 7fad11b28640 1 -- 172.21.15.1:0/1279114064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b566b0ddb0 msgr2=0x55b566b1d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.357+0000 7fad11b28640 1 --2- 172.21.15.1:0/1279114064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b566b0ddb0 0x55b566b1d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.357+0000 7fad11b28640 1 -- 172.21.15.1:0/1279114064 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b566b1e900 con 0x55b566b0e6f0 2024-09-19T09:38:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.357+0000 7fad11b28640 1 --2- 172.21.15.1:0/1279114064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b566b0e6f0 0x55b566b1e2f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7facfc015010 tx=0x7facfc015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c08ca24c9fb7659c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.357+0000 7facf5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:38:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.358+0000 7facf5ffb640 1 -- 172.21.15.1:0/1279114064 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc03d060 con 0x55b566b0e6f0 2024-09-19T09:38:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.358+0000 7facf5ffb640 1 -- 172.21.15.1:0/1279114064 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7facfc00aa60 con 0x55b566b0e6f0 2024-09-19T09:38:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.358+0000 7fad17401740 1 -- 172.21.15.1:0/1279114064 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad0802b020 con 0x55b566b0e6f0 2024-09-19T09:38:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.358+0000 7facf5ffb640 1 -- 172.21.15.1:0/1279114064 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7facfc031040 con 0x55b566b0e6f0 2024-09-19T09:38:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.358+0000 7fad17401740 10 client.15216 fetch_fsmap learned FSMap version 19 2024-09-19T09:38:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.358+0000 7fad17401740 1 -- 172.21.15.1:0/1279114064 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55b566b8eb80 con 0x55b566b0e6f0 2024-09-19T09:38:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.358+0000 7facf5ffb640 1 -- 172.21.15.1:0/1279114064 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad0802b020 con 0x55b566b0e6f0 2024-09-19T09:38:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.358+0000 7facf5ffb640 1 -- 172.21.15.1:0/1279114064 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7facfc037040 con 0x55b566b0e6f0 2024-09-19T09:38:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.358+0000 7fad17401740 10 client.15216 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:38:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.358+0000 7fad17401740 10 client.15216 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:38:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.358+0000 7fad17401740 20 client.15216 populate_metadata read hostname 'smithi001' 2024-09-19T09:38:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.358+0000 7fad17401740 1 --2- 172.21.15.1:0/1279114064 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b566b13780 0x55b566b91350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.358+0000 7fad17401740 4 client.15216 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:38:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.358+0000 7fad17401740 1 -- 172.21.15.1:0/1279114064 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b566a74d70 con 0x55b566b13780 2024-09-19T09:38:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.359+0000 7fad12329640 1 --2- 172.21.15.1:0/1279114064 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b566b13780 0x55b566b91350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.359+0000 7facf5ffb640 10 client.15216 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.359+0000 7fad12329640 1 --2- 172.21.15.1:0/1279114064 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b566b13780 0x55b566b91350 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ac5c60a7184023e server_cookie=75f46faf2dd0d878 in_seq=0 out_seq=0 2024-09-19T09:38:22.366 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:21 smithi022 ceph-mon[35583]: pgmap v346: 97 pgs: 97 active+clean; 645 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-19T09:38:22.366 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:21 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/589441987' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:38:22.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:21 smithi121 ceph-mon[35577]: pgmap v346: 97 pgs: 97 active+clean; 645 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-19T09:38:22.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:21 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/589441987' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:38:22.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.369+0000 7facf5ffb640 1 -- 172.21.15.1:0/1279114064 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b566a74d70 con 0x55b566b13780 2024-09-19T09:38:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.370+0000 7facf5ffb640 10 client.15216 handle_command_reply: tid=0 2024-09-19T09:38:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.370+0000 7fad17401740 1 client.15216 shutdown 2024-09-19T09:38:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.370+0000 7fad17401740 1 -- 172.21.15.1:0/1279114064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b566b0e6f0 msgr2=0x55b566b1e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.370+0000 7fad17401740 1 --2- 172.21.15.1:0/1279114064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b566b0e6f0 0x55b566b1e2f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7facfc015010 tx=0x7facfc015040 comp rx=0 tx=0).stop 2024-09-19T09:38:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.370+0000 7fad17401740 1 -- 172.21.15.1:0/1279114064 shutdown_connections 2024-09-19T09:38:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.370+0000 7fad17401740 1 --2- 172.21.15.1:0/1279114064 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b566b13780 0x55b566b91350 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.370+0000 7fad17401740 1 --2- 172.21.15.1:0/1279114064 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b566b0e6f0 0x55b566b1e2f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.370+0000 7fad17401740 1 --2- 172.21.15.1:0/1279114064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b566b0ddb0 0x55b566b1d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.370+0000 7fad17401740 1 --2- 172.21.15.1:0/1279114064 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b566b05010 0x55b566b1cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.370+0000 7fad17401740 1 -- 172.21.15.1:0/1279114064 >> 172.21.15.1:0/1279114064 conn(0x55b566b132d0 msgr2=0x55b566b041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.370+0000 7facf5ffb640 0 client.15216 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.370+0000 7fad17401740 1 -- 172.21.15.1:0/1279114064 shutdown_connections 2024-09-19T09:38:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.370+0000 7fad17401740 1 -- 172.21.15.1:0/1279114064 wait complete. 2024-09-19T09:38:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.370+0000 7fad17401740 20 client.15216 trim_cache size 0 max 16384 2024-09-19T09:38:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:38:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:38:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:38:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:38:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.370+0000 7fad1458d640 1 -- 172.21.15.1:0/2613038090 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7facf80a3240 msgr2=0x7facf80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.370+0000 7fad1458d640 1 --2- 172.21.15.1:0/2613038090 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7facf80a3240 0x7facf80a5700 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fad040bd190 tx=0x7fad04033040 comp rx=0 tx=0).stop 2024-09-19T09:38:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.371+0000 7fad1458d640 1 -- 172.21.15.1:0/2613038090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad0c107840 msgr2=0x7fad0c19f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.371+0000 7fad1458d640 1 --2- 172.21.15.1:0/2613038090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad0c107840 0x7fad0c19f470 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fad0402f540 tx=0x7fad04031ee0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.371+0000 7fad1458d640 1 -- 172.21.15.1:0/2613038090 shutdown_connections 2024-09-19T09:38:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.371+0000 7fad1458d640 1 --2- 172.21.15.1:0/2613038090 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad0c107840 0x7fad0c19f470 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.371+0000 7fad1458d640 1 --2- 172.21.15.1:0/2613038090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad0c104f10 0x7fad0c198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.371+0000 7fad1458d640 1 --2- 172.21.15.1:0/2613038090 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7facf80a3240 0x7facf80a5700 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.371+0000 7fad1458d640 1 --2- 172.21.15.1:0/2613038090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fad0c1025e0 0x7fad0c197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.371+0000 7fad1458d640 1 -- 172.21.15.1:0/2613038090 >> 172.21.15.1:0/2613038090 conn(0x7fad0c0fc1c0 msgr2=0x7fad0c102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.371+0000 7fad1458d640 1 -- 172.21.15.1:0/2613038090 shutdown_connections 2024-09-19T09:38:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:22.371+0000 7fad1458d640 1 -- 172.21.15.1:0/2613038090 wait complete. 2024-09-19T09:38:22.589 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:23.770 INFO:teuthology.orchestra.run.smithi001.stdout:{"run_dir":"/var/run/ceph"} 2024-09-19T09:38:23.770 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-19T09:38:23.770 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 1747 2024-09-19T09:38:23.770 DEBUG:tasks.quiescer:Yielding 2024-09-19T09:38:23.771 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T09:38:23.785 INFO:tasks.workunit:Pulling workunits from ref 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T09:38:23.786 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T09:38:23.786 INFO:tasks.workunit:timeout=3h 2024-09-19T09:38:23.786 INFO:tasks.workunit:cleanup=True 2024-09-19T09:38:23.786 DEBUG:teuthology.orchestra.run.smithi001:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T09:38:23.787 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:38:23.828 INFO:teuthology.orchestra.run.smithi001.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-19T09:38:23.828 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-19T09:38:23.828 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-19T09:38:23.828 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:38:23.828 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-19T09:38:23.828 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-09-19 09:36:30.913640227 +0000 2024-09-19T09:38:23.828 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-09-19 09:36:30.913640227 +0000 2024-09-19T09:38:23.828 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-09-19 09:38:01.408559882 +0000 2024-09-19T09:38:23.829 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-09-19 09:36:30.913640227 +0000 2024-09-19T09:38:23.829 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-19T09:38:23.829 DEBUG:teuthology.orchestra.run.smithi001:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-19T09:38:23.899 DEBUG:teuthology.orchestra.run.smithi001:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T09:38:23.957 INFO:tasks.workunit.client.0.smithi001.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T09:38:23.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:23 smithi001 ceph-mon[31225]: pgmap v347: 97 pgs: 97 active+clean; 645 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-19T09:38:24.083 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:24.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:23 smithi022 ceph-mon[35583]: pgmap v347: 97 pgs: 97 active+clean; 645 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-19T09:38:24.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:23 smithi121 ceph-mon[35577]: pgmap v347: 97 pgs: 97 active+clean; 645 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-19T09:38:24.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.592+0000 7ff99e17b640 1 -- 172.21.15.1:0/835329309 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff998100e20 msgr2=0x7ff998101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:24.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.592+0000 7ff99e17b640 1 --2- 172.21.15.1:0/835329309 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff998100e20 0x7ff998101200 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff988009900 tx=0x7ff98802a480 comp rx=0 tx=0).stop 2024-09-19T09:38:24.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.592+0000 7ff99e17b640 1 -- 172.21.15.1:0/835329309 shutdown_connections 2024-09-19T09:38:24.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.592+0000 7ff99e17b640 1 --2- 172.21.15.1:0/835329309 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff998102ef0 0x7ff99810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.592+0000 7ff99e17b640 1 --2- 172.21.15.1:0/835329309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff998102570 0x7ff9981029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.592+0000 7ff99e17b640 1 --2- 172.21.15.1:0/835329309 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff998100e20 0x7ff998101200 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.592+0000 7ff99e17b640 1 -- 172.21.15.1:0/835329309 >> 172.21.15.1:0/835329309 conn(0x7ff9980fc7d0 msgr2=0x7ff9980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:24.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.592+0000 7ff99e17b640 1 -- 172.21.15.1:0/835329309 shutdown_connections 2024-09-19T09:38:24.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.592+0000 7ff99e17b640 1 -- 172.21.15.1:0/835329309 wait complete. 2024-09-19T09:38:24.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.593+0000 7ff99e17b640 1 Processor -- start 2024-09-19T09:38:24.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.593+0000 7ff99e17b640 1 -- start start 2024-09-19T09:38:24.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.593+0000 7ff99e17b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff998100e20 0x7ff9981984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.593+0000 7ff99e17b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff998102570 0x7ff998198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.593+0000 7ff99e17b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff998102ef0 0x7ff99819cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.593+0000 7ff99e17b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff998110f80 con 0x7ff998102ef0 2024-09-19T09:38:24.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.593+0000 7ff99e17b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff998110e00 con 0x7ff998102570 2024-09-19T09:38:24.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.593+0000 7ff99e17b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff998111100 con 0x7ff998100e20 2024-09-19T09:38:24.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.593+0000 7ff997fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff998102ef0 0x7ff99819cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.593+0000 7ff997fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff998102ef0 0x7ff99819cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53618/0 (socket says 172.21.15.1:53618) 2024-09-19T09:38:24.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.593+0000 7ff997fff640 1 -- 172.21.15.1:0/857025309 learned_addr learned my addr 172.21.15.1:0/857025309 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:24.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.593+0000 7ff98ffff640 1 --2- 172.21.15.1:0/857025309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff998102570 0x7ff998198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.593+0000 7ff9977fe640 1 --2- 172.21.15.1:0/857025309 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff998100e20 0x7ff9981984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.594+0000 7ff997fff640 1 -- 172.21.15.1:0/857025309 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff998100e20 msgr2=0x7ff9981984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:24.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.594+0000 7ff997fff640 1 --2- 172.21.15.1:0/857025309 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff998100e20 0x7ff9981984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.594+0000 7ff997fff640 1 -- 172.21.15.1:0/857025309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff998102570 msgr2=0x7ff998198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:24.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.594+0000 7ff997fff640 1 --2- 172.21.15.1:0/857025309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff998102570 0x7ff998198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.594+0000 7ff997fff640 1 -- 172.21.15.1:0/857025309 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff99819d4a0 con 0x7ff998102ef0 2024-09-19T09:38:24.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.594+0000 7ff98ffff640 1 --2- 172.21.15.1:0/857025309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff998102570 0x7ff998198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:24.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.594+0000 7ff997fff640 1 --2- 172.21.15.1:0/857025309 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff998102ef0 0x7ff99819cdc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff99000eaa0 tx=0x7ff99000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:24.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.594+0000 7ff9957fa640 1 -- 172.21.15.1:0/857025309 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99000cdb0 con 0x7ff998102ef0 2024-09-19T09:38:24.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.594+0000 7ff9957fa640 1 -- 172.21.15.1:0/857025309 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff990005020 con 0x7ff998102ef0 2024-09-19T09:38:24.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.594+0000 7ff99e17b640 1 -- 172.21.15.1:0/857025309 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff99819d790 con 0x7ff998102ef0 2024-09-19T09:38:24.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.594+0000 7ff9957fa640 1 -- 172.21.15.1:0/857025309 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9900116b0 con 0x7ff998102ef0 2024-09-19T09:38:24.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.594+0000 7ff99e17b640 1 -- 172.21.15.1:0/857025309 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff998103680 con 0x7ff998102ef0 2024-09-19T09:38:24.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.595+0000 7ff99e17b640 1 -- 172.21.15.1:0/857025309 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff998101200 con 0x7ff998102ef0 2024-09-19T09:38:24.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.596+0000 7ff9957fa640 1 -- 172.21.15.1:0/857025309 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7ff990005560 con 0x7ff998102ef0 2024-09-19T09:38:24.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.597+0000 7ff9957fa640 1 --2- 172.21.15.1:0/857025309 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff9840a3240 0x7ff9840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:24.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.597+0000 7ff9977fe640 1 --2- 172.21.15.1:0/857025309 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff9840a3240 0x7ff9840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:24.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.597+0000 7ff9957fa640 1 -- 172.21.15.1:0/857025309 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7ff9900cfb80 con 0x7ff998102ef0 2024-09-19T09:38:24.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.598+0000 7ff9977fe640 1 --2- 172.21.15.1:0/857025309 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff9840a3240 0x7ff9840a5700 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff988009230 tx=0x7ff9880058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:24.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.601+0000 7ff9957fa640 1 -- 172.21.15.1:0/857025309 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff990016030 con 0x7ff998102ef0 2024-09-19T09:38:24.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.814+0000 7ff99e17b640 1 -- 172.21.15.1:0/857025309 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff998103940 con 0x7ff998102ef0 2024-09-19T09:38:24.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.815+0000 7ff9957fa640 1 -- 172.21.15.1:0/857025309 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11837 (secure 0 0 0) 0x7ff99009c8a0 con 0x7ff998102ef0 2024-09-19T09:38:24.817 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:38:24.817 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":19,"btime":"2024-09-19T09:36:24:006349+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:36:23.723388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6839/3279971690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3279971690},{"type":"v1","addr":"172.21.15.121:6839","nonce":3279971690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:38:24.817 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 19 2024-09-19T09:38:24.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.817+0000 7ff99e17b640 1 -- 172.21.15.1:0/857025309 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff9840a3240 msgr2=0x7ff9840a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:24.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.817+0000 7ff99e17b640 1 --2- 172.21.15.1:0/857025309 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff9840a3240 0x7ff9840a5700 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff988009230 tx=0x7ff9880058d0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.817+0000 7ff99e17b640 1 -- 172.21.15.1:0/857025309 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff998102ef0 msgr2=0x7ff99819cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:24.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.817+0000 7ff99e17b640 1 --2- 172.21.15.1:0/857025309 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff998102ef0 0x7ff99819cdc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff99000eaa0 tx=0x7ff99000ef60 comp rx=0 tx=0).stop 2024-09-19T09:38:24.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.817+0000 7ff99e17b640 1 -- 172.21.15.1:0/857025309 shutdown_connections 2024-09-19T09:38:24.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.817+0000 7ff99e17b640 1 --2- 172.21.15.1:0/857025309 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff998102ef0 0x7ff99819cdc0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.817+0000 7ff99e17b640 1 --2- 172.21.15.1:0/857025309 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff9840a3240 0x7ff9840a5700 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.817+0000 7ff99e17b640 1 --2- 172.21.15.1:0/857025309 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff998102570 0x7ff998198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.817+0000 7ff99e17b640 1 --2- 172.21.15.1:0/857025309 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff998100e20 0x7ff9981984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:24.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.817+0000 7ff99e17b640 1 -- 172.21.15.1:0/857025309 >> 172.21.15.1:0/857025309 conn(0x7ff9980fc7d0 msgr2=0x7ff99806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:24.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.818+0000 7ff99e17b640 1 -- 172.21.15.1:0/857025309 shutdown_connections 2024-09-19T09:38:24.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:24.818+0000 7ff99e17b640 1 -- 172.21.15.1:0/857025309 wait complete. 2024-09-19T09:38:25.211 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:24 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/857025309' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:25.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:24 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/857025309' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:25.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:24 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/857025309' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:25.465 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T09:36:13.637508+0000', 'modified': '2024-09-19T09:36:23.723388+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24497}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24490': {'gid': 24490, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.121:6839/3279971690', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6838', 'nonce': 3279971690}, {'type': 'v1', 'addr': '172.21.15.121:6839', 'nonce': 3279971690}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24497': {'gid': 24497, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.22:6839/2513831228', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6838', 'nonce': 2513831228}, {'type': 'v1', 'addr': '172.21.15.22:6839', 'nonce': 2513831228}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24497, 'qdb_cluster': [24497]} 2024-09-19T09:38:25.465 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T09:38:25.465 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T09:38:25.766 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:26.180 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:25 smithi001 ceph-mon[31225]: pgmap v348: 97 pgs: 97 active+clean; 645 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 341 B/s wr, 3 op/s 2024-09-19T09:38:26.265 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:25 smithi022 ceph-mon[35583]: pgmap v348: 97 pgs: 97 active+clean; 645 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 341 B/s wr, 3 op/s 2024-09-19T09:38:26.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.262+0000 7f60bc38c640 1 -- 172.21.15.1:0/72919732 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b4101de0 msgr2=0x7f60b41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:26.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.262+0000 7f60bc38c640 1 --2- 172.21.15.1:0/72919732 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b4101de0 0x7f60b41021c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f60b0009900 tx=0x7f60b002a410 comp rx=0 tx=0).stop 2024-09-19T09:38:26.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.262+0000 7f60bc38c640 1 -- 172.21.15.1:0/72919732 shutdown_connections 2024-09-19T09:38:26.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.262+0000 7f60bc38c640 1 --2- 172.21.15.1:0/72919732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60b4106f10 0x7f60b410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.262+0000 7f60bc38c640 1 --2- 172.21.15.1:0/72919732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60b4102790 0x7f60b41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.262+0000 7f60bc38c640 1 --2- 172.21.15.1:0/72919732 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b4101de0 0x7f60b41021c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.262+0000 7f60bc38c640 1 -- 172.21.15.1:0/72919732 >> 172.21.15.1:0/72919732 conn(0x7f60b40fd8c0 msgr2=0x7f60b40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:26.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.262+0000 7f60bc38c640 1 -- 172.21.15.1:0/72919732 shutdown_connections 2024-09-19T09:38:26.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.262+0000 7f60bc38c640 1 -- 172.21.15.1:0/72919732 wait complete. 2024-09-19T09:38:26.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.263+0000 7f60bc38c640 1 Processor -- start 2024-09-19T09:38:26.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.263+0000 7f60bc38c640 1 -- start start 2024-09-19T09:38:26.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.263+0000 7f60bc38c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b4101de0 0x7f60b4198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.263+0000 7f60bc38c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60b4102790 0x7f60b4198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.263+0000 7f60bc38c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60b4106f10 0x7f60b419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.263+0000 7f60bc38c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f60b4111f70 con 0x7f60b4101de0 2024-09-19T09:38:26.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.263+0000 7f60bc38c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f60b4111df0 con 0x7f60b4106f10 2024-09-19T09:38:26.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.263+0000 7f60bc38c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f60b41120f0 con 0x7f60b4102790 2024-09-19T09:38:26.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.263+0000 7f60ba128640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b4101de0 0x7f60b4198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.263+0000 7f60ba128640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b4101de0 0x7f60b4198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44504/0 (socket says 172.21.15.1:44504) 2024-09-19T09:38:26.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.263+0000 7f60ba128640 1 -- 172.21.15.1:0/29551447 learned_addr learned my addr 172.21.15.1:0/29551447 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:26.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.263+0000 7f60b9927640 1 --2- 172.21.15.1:0/29551447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60b4102790 0x7f60b4198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.263+0000 7f60ba929640 1 --2- 172.21.15.1:0/29551447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60b4106f10 0x7f60b419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.264+0000 7f60ba128640 1 -- 172.21.15.1:0/29551447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60b4102790 msgr2=0x7f60b4198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:26.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.264+0000 7f60ba128640 1 --2- 172.21.15.1:0/29551447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60b4102790 0x7f60b4198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.264+0000 7f60ba128640 1 -- 172.21.15.1:0/29551447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60b4106f10 msgr2=0x7f60b419cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:26.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.264+0000 7f60ba128640 1 --2- 172.21.15.1:0/29551447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60b4106f10 0x7f60b419cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.264+0000 7f60ba128640 1 -- 172.21.15.1:0/29551447 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b419d3e0 con 0x7f60b4101de0 2024-09-19T09:38:26.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.264+0000 7f60ba128640 1 --2- 172.21.15.1:0/29551447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b4101de0 0x7f60b4198430 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f60b0006010 tx=0x7f60b00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:26.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.264+0000 7f60ab7fe640 1 -- 172.21.15.1:0/29551447 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b003f030 con 0x7f60b4101de0 2024-09-19T09:38:26.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.264+0000 7f60bc38c640 1 -- 172.21.15.1:0/29551447 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60b419d670 con 0x7f60b4101de0 2024-09-19T09:38:26.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.264+0000 7f60ab7fe640 1 -- 172.21.15.1:0/29551447 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60b0003ce0 con 0x7f60b4101de0 2024-09-19T09:38:26.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.264+0000 7f60ab7fe640 1 -- 172.21.15.1:0/29551447 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b0035070 con 0x7f60b4101de0 2024-09-19T09:38:26.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.264+0000 7f60bc38c640 1 -- 172.21.15.1:0/29551447 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60b41a4fb0 con 0x7f60b4101de0 2024-09-19T09:38:26.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.266+0000 7f60ab7fe640 1 -- 172.21.15.1:0/29551447 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f60b0042030 con 0x7f60b4101de0 2024-09-19T09:38:26.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.267+0000 7f60be765740 1 Processor -- start 2024-09-19T09:38:26.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.267+0000 7f60be765740 1 -- start start 2024-09-19T09:38:26.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.267+0000 7f60ab7fe640 1 --2- 172.21.15.1:0/29551447 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f60a00a3240 0x7f60a00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.267+0000 7f60be765740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c41cae9d0 0x558c41caedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.267+0000 7f60be765740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c41caf2f0 0x558c41cb9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.267+0000 7f60be765740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c41cb9bb0 0x558c41cbbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.267+0000 7f60be765740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558c41c15090 con 0x558c41caf2f0 2024-09-19T09:38:26.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.267+0000 7f60be765740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558c41bbca70 con 0x558c41cb9bb0 2024-09-19T09:38:26.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.267+0000 7f60be765740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558c41c11050 con 0x558c41cae9d0 2024-09-19T09:38:26.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.267+0000 7f60ab7fe640 1 -- 172.21.15.1:0/29551447 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f60b00efd70 con 0x7f60b4101de0 2024-09-19T09:38:26.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.267+0000 7f60ba929640 1 --2- 172.21.15.1:0/29551447 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f60a00a3240 0x7f60a00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.268+0000 7f60ba929640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c41cb9bb0 0x558c41cbbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.268+0000 7f60ba128640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c41cae9d0 0x558c41caedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.268+0000 7f60ba929640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c41cb9bb0 0x558c41cbbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:56958/0 (socket says 172.21.15.1:56958) 2024-09-19T09:38:26.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.268+0000 7f60ba929640 1 -- 172.21.15.1:0/3559446859 learned_addr learned my addr 172.21.15.1:0/3559446859 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:26.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.268+0000 7f60b9927640 1 --2- 172.21.15.1:0/3559446859 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c41caf2f0 0x558c41cb9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.268+0000 7f60ba929640 1 --2- 172.21.15.1:0/29551447 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f60a00a3240 0x7f60a00a5700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f60ac009fd0 tx=0x7f60ac014c10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:26.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.268+0000 7f60ba929640 1 -- 172.21.15.1:0/3559446859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c41cae9d0 msgr2=0x558c41caedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:26.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.268+0000 7f60ba929640 1 --2- 172.21.15.1:0/3559446859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c41cae9d0 0x558c41caedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.268+0000 7f60ba929640 1 -- 172.21.15.1:0/3559446859 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c41caf2f0 msgr2=0x558c41cb9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:26.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.268+0000 7f60ba929640 1 --2- 172.21.15.1:0/3559446859 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c41caf2f0 0x558c41cb9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.268+0000 7f60ba929640 1 -- 172.21.15.1:0/3559446859 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c41bc9130 con 0x558c41cb9bb0 2024-09-19T09:38:26.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.269+0000 7f60ba929640 1 --2- 172.21.15.1:0/3559446859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c41cb9bb0 0x558c41cbbfa0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f60ac012ac0 tx=0x7f60ac01e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d2e914463cdc38a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:26.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.269+0000 7f60a8dea640 1 -- 172.21.15.1:0/3559446859 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac01eab0 con 0x558c41cb9bb0 2024-09-19T09:38:26.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.269+0000 7f60a8dea640 1 -- 172.21.15.1:0/3559446859 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60ac01ec50 con 0x558c41cb9bb0 2024-09-19T09:38:26.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.269+0000 7f60a8dea640 1 -- 172.21.15.1:0/3559446859 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ac01f5d0 con 0x558c41cb9bb0 2024-09-19T09:38:26.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.269+0000 7f60be765740 1 -- 172.21.15.1:0/3559446859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c41cb9bb0 msgr2=0x558c41cbbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:26.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.269+0000 7f60be765740 1 --2- 172.21.15.1:0/3559446859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c41cb9bb0 0x558c41cbbfa0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f60ac012ac0 tx=0x7f60ac01e000 comp rx=0 tx=0).stop 2024-09-19T09:38:26.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.270+0000 7f60be765740 1 -- 172.21.15.1:0/3559446859 shutdown_connections 2024-09-19T09:38:26.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.270+0000 7f60be765740 1 --2- 172.21.15.1:0/3559446859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c41cb9bb0 0x558c41cbbfa0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.270+0000 7f60be765740 1 --2- 172.21.15.1:0/3559446859 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c41caf2f0 0x558c41cb9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.270+0000 7f60be765740 1 --2- 172.21.15.1:0/3559446859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c41cae9d0 0x558c41caedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.270+0000 7f60be765740 1 -- 172.21.15.1:0/3559446859 >> 172.21.15.1:0/3559446859 conn(0x558c41caaf60 msgr2=0x558c41cab340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:26.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.270+0000 7f60be765740 1 -- 172.21.15.1:0/3559446859 shutdown_connections 2024-09-19T09:38:26.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.270+0000 7f60be765740 1 -- 172.21.15.1:0/3559446859 wait complete. 2024-09-19T09:38:26.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.270+0000 7f60be765740 1 -- start start 2024-09-19T09:38:26.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.270+0000 7f60be765740 1 Processor -- start 2024-09-19T09:38:26.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.270+0000 7f60be765740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c41cae9d0 0x558c41cb9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.270+0000 7f60be765740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c41caf2f0 0x558c41cb67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.270+0000 7f60be765740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c41cb9bb0 0x558c41cb6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.270+0000 7f60be765740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558c41cbc780 con 0x558c41cae9d0 2024-09-19T09:38:26.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.270+0000 7f60be765740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558c41bcff20 con 0x558c41caf2f0 2024-09-19T09:38:26.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.270+0000 7f60be765740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558c41cbc900 con 0x558c41cb9bb0 2024-09-19T09:38:26.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.270+0000 7f60be765740 10 client.0 _ll_register_callbacks cb 0x558c41b99030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:26.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.270+0000 7f60ba128640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c41cae9d0 0x558c41cb9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.270+0000 7f60ba128640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c41cae9d0 0x558c41cb9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44518/0 (socket says 172.21.15.1:44518) 2024-09-19T09:38:26.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.270+0000 7f60ba128640 1 -- 172.21.15.1:0/900086560 learned_addr learned my addr 172.21.15.1:0/900086560 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:26.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.271+0000 7f60b9927640 1 --2- 172.21.15.1:0/900086560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c41caf2f0 0x558c41cb67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.271+0000 7f60ba929640 1 --2- 172.21.15.1:0/900086560 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c41cb9bb0 0x558c41cb6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.271+0000 7f60ba128640 1 -- 172.21.15.1:0/900086560 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c41cb9bb0 msgr2=0x558c41cb6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:26.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.271+0000 7f60ba128640 1 --2- 172.21.15.1:0/900086560 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c41cb9bb0 0x558c41cb6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.271+0000 7f60ba128640 1 -- 172.21.15.1:0/900086560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c41caf2f0 msgr2=0x558c41cb67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:26.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.271+0000 7f60ba128640 1 --2- 172.21.15.1:0/900086560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c41caf2f0 0x558c41cb67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.271+0000 7f60ba128640 1 -- 172.21.15.1:0/900086560 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c419862b0 con 0x558c41cae9d0 2024-09-19T09:38:26.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.271+0000 7f60b9927640 1 --2- 172.21.15.1:0/900086560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c41caf2f0 0x558c41cb67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:26.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.271+0000 7f60ba128640 1 --2- 172.21.15.1:0/900086560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c41cae9d0 0x558c41cb9460 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f60b00bc200 tx=0x7f60b00bc390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec110c0ef646ba5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:26.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.271+0000 7f609dffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:38:26.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.271+0000 7f609dffb640 1 -- 172.21.15.1:0/900086560 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b0049070 con 0x558c41cae9d0 2024-09-19T09:38:26.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.271+0000 7f609dffb640 1 -- 172.21.15.1:0/900086560 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f60b00b8b70 con 0x558c41cae9d0 2024-09-19T09:38:26.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.271+0000 7f60be765740 1 -- 172.21.15.1:0/900086560 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60ac01ec50 con 0x558c41cae9d0 2024-09-19T09:38:26.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.271+0000 7f609dffb640 1 -- 172.21.15.1:0/900086560 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f60b0038350 con 0x558c41cae9d0 2024-09-19T09:38:26.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.271+0000 7f60be765740 10 client.15234 fetch_fsmap learned FSMap version 19 2024-09-19T09:38:26.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.271+0000 7f60be765740 1 -- 172.21.15.1:0/900086560 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558c41cc80a0 con 0x558c41cae9d0 2024-09-19T09:38:26.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.271+0000 7f609dffb640 1 -- 172.21.15.1:0/900086560 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60ac01ec50 con 0x558c41cae9d0 2024-09-19T09:38:26.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.272+0000 7f609dffb640 1 -- 172.21.15.1:0/900086560 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f60b0038cd0 con 0x558c41cae9d0 2024-09-19T09:38:26.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.272+0000 7f60be765740 10 client.15234 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:38:26.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.272+0000 7f60be765740 10 client.15234 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:38:26.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.272+0000 7f60be765740 20 client.15234 populate_metadata read hostname 'smithi001' 2024-09-19T09:38:26.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.272+0000 7f60be765740 1 --2- 172.21.15.1:0/900086560 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x558c41cca730 0x558c41ccbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.272+0000 7f60be765740 4 client.15234 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:38:26.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.272+0000 7f60be765740 1 -- 172.21.15.1:0/900086560 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c41c22600 con 0x558c41cca730 2024-09-19T09:38:26.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.272+0000 7f60b9927640 1 --2- 172.21.15.1:0/900086560 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x558c41cca730 0x558c41ccbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.273+0000 7f609dffb640 10 client.15234 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:26.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.273+0000 7f60b9927640 1 --2- 172.21.15.1:0/900086560 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x558c41cca730 0x558c41ccbba0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80880ebfc6e2913d server_cookie=49e2a266d49eb783 in_seq=0 out_seq=0 2024-09-19T09:38:26.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.273+0000 7f609dffb640 1 -- 172.21.15.1:0/900086560 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558c41c22600 con 0x558c41cca730 2024-09-19T09:38:26.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.273+0000 7f609dffb640 10 client.15234 handle_command_reply: tid=0 2024-09-19T09:38:26.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.273+0000 7f60be765740 1 client.15234 shutdown 2024-09-19T09:38:26.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.273+0000 7f60be765740 1 -- 172.21.15.1:0/900086560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c41cae9d0 msgr2=0x558c41cb9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:26.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.273+0000 7f60be765740 1 --2- 172.21.15.1:0/900086560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c41cae9d0 0x558c41cb9460 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f60b00bc200 tx=0x7f60b00bc390 comp rx=0 tx=0).stop 2024-09-19T09:38:26.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.273+0000 7f60be765740 1 -- 172.21.15.1:0/900086560 shutdown_connections 2024-09-19T09:38:26.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.273+0000 7f60be765740 1 --2- 172.21.15.1:0/900086560 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x558c41cca730 0x558c41ccbba0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.273+0000 7f60be765740 1 --2- 172.21.15.1:0/900086560 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c41cb9bb0 0x558c41cb6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.273+0000 7f60be765740 1 --2- 172.21.15.1:0/900086560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c41caf2f0 0x558c41cb67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.273+0000 7f609dffb640 0 client.15234 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:26.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.273+0000 7f60be765740 1 --2- 172.21.15.1:0/900086560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c41cae9d0 0x558c41cb9460 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.273+0000 7f60be765740 1 -- 172.21.15.1:0/900086560 >> 172.21.15.1:0/900086560 conn(0x558c41caaf60 msgr2=0x558c41cb0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:26.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.274+0000 7f60be765740 1 -- 172.21.15.1:0/900086560 shutdown_connections 2024-09-19T09:38:26.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.274+0000 7f60be765740 1 -- 172.21.15.1:0/900086560 wait complete. 2024-09-19T09:38:26.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.274+0000 7f60be765740 20 client.15234 trim_cache size 0 max 16384 2024-09-19T09:38:26.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.291+0000 7f60be765740 1 Processor -- start 2024-09-19T09:38:26.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.291+0000 7f60be765740 1 -- start start 2024-09-19T09:38:26.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.291+0000 7f60be765740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c41cae9d0 0x558c41cca060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.291+0000 7f60be765740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c41caf2f0 0x558c41cb6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.291+0000 7f60be765740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c41cb9bb0 0x558c41cd4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.291+0000 7f60be765740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558c41cc9ee0 con 0x558c41cae9d0 2024-09-19T09:38:26.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.291+0000 7f60be765740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558c41cca5b0 con 0x558c41cb9bb0 2024-09-19T09:38:26.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.291+0000 7f60be765740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558c41ccac80 con 0x558c41caf2f0 2024-09-19T09:38:26.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.292+0000 7f60ba128640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c41cae9d0 0x558c41cca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.292+0000 7f60ba128640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c41cae9d0 0x558c41cca060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44522/0 (socket says 172.21.15.1:44522) 2024-09-19T09:38:26.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.292+0000 7f60ba128640 1 -- 172.21.15.1:0/3470689823 learned_addr learned my addr 172.21.15.1:0/3470689823 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:26.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.292+0000 7f60ba929640 1 --2- 172.21.15.1:0/3470689823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c41cb9bb0 0x558c41cd4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.292+0000 7f60ba128640 1 -- 172.21.15.1:0/3470689823 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c41caf2f0 msgr2=0x558c41cb6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:26.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.292+0000 7f60b9927640 1 --2- 172.21.15.1:0/3470689823 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c41caf2f0 0x558c41cb6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.292+0000 7f60ba128640 1 --2- 172.21.15.1:0/3470689823 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c41caf2f0 0x558c41cb6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.292+0000 7f60ba128640 1 -- 172.21.15.1:0/3470689823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c41cb9bb0 msgr2=0x558c41cd4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:26.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.292+0000 7f60ba128640 1 --2- 172.21.15.1:0/3470689823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c41cb9bb0 0x558c41cd4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.292+0000 7f60ba128640 1 -- 172.21.15.1:0/3470689823 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c41caf120 con 0x558c41cae9d0 2024-09-19T09:38:26.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.292+0000 7f60ba929640 1 --2- 172.21.15.1:0/3470689823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c41cb9bb0 0x558c41cd4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:26.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.292+0000 7f60b9927640 1 --2- 172.21.15.1:0/3470689823 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c41caf2f0 0x558c41cb6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:26.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.292+0000 7f60ba128640 1 --2- 172.21.15.1:0/3470689823 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c41cae9d0 0x558c41cca060 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f60b003d040 tx=0x7f60b002f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cdd9c05fee6ed77 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:26.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.292+0000 7f609ffff640 1 -- 172.21.15.1:0/3470689823 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b0049070 con 0x558c41cae9d0 2024-09-19T09:38:26.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.292+0000 7f609ffff640 1 -- 172.21.15.1:0/3470689823 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60b003b580 con 0x558c41cae9d0 2024-09-19T09:38:26.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.292+0000 7f609ffff640 1 -- 172.21.15.1:0/3470689823 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b00044e0 con 0x558c41cae9d0 2024-09-19T09:38:26.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.293+0000 7f60be765740 1 -- 172.21.15.1:0/3470689823 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c41cae9d0 msgr2=0x558c41cca060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:26.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.293+0000 7f60be765740 1 --2- 172.21.15.1:0/3470689823 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c41cae9d0 0x558c41cca060 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f60b003d040 tx=0x7f60b002f000 comp rx=0 tx=0).stop 2024-09-19T09:38:26.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.293+0000 7f60be765740 1 -- 172.21.15.1:0/3470689823 shutdown_connections 2024-09-19T09:38:26.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.293+0000 7f60be765740 1 --2- 172.21.15.1:0/3470689823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c41cb9bb0 0x558c41cd4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.293+0000 7f60be765740 1 --2- 172.21.15.1:0/3470689823 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c41caf2f0 0x558c41cb6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.293+0000 7f60be765740 1 --2- 172.21.15.1:0/3470689823 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c41cae9d0 0x558c41cca060 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.293+0000 7f60be765740 1 -- 172.21.15.1:0/3470689823 >> 172.21.15.1:0/3470689823 conn(0x558c41caaf60 msgr2=0x558c41cab340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:26.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.293+0000 7f60be765740 1 -- 172.21.15.1:0/3470689823 shutdown_connections 2024-09-19T09:38:26.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.293+0000 7f60be765740 1 -- 172.21.15.1:0/3470689823 wait complete. 2024-09-19T09:38:26.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.293+0000 7f60be765740 1 -- start start 2024-09-19T09:38:26.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.293+0000 7f60be765740 1 Processor -- start 2024-09-19T09:38:26.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.294+0000 7f60be765740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c41cae9d0 0x558c41cce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.294+0000 7f60be765740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c41caf2f0 0x558c41cd39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.294+0000 7f60be765740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c41cb9bb0 0x558c41cd3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.294+0000 7f60be765740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558c41ccba20 con 0x558c41caf2f0 2024-09-19T09:38:26.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.294+0000 7f60be765740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558c41ccb350 con 0x558c41cae9d0 2024-09-19T09:38:26.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.294+0000 7f60be765740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558c41ccc0f0 con 0x558c41cb9bb0 2024-09-19T09:38:26.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.294+0000 7f60be765740 10 client.0 _ll_register_callbacks cb 0x7f60b003b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:26.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.294+0000 7f60b9927640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c41caf2f0 0x558c41cd39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.294+0000 7f60b9927640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c41caf2f0 0x558c41cd39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:44536/0 (socket says 172.21.15.1:44536) 2024-09-19T09:38:26.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.294+0000 7f60b9927640 1 -- 172.21.15.1:0/3463586212 learned_addr learned my addr 172.21.15.1:0/3463586212 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:26.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.294+0000 7f60ba929640 1 --2- 172.21.15.1:0/3463586212 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c41cb9bb0 0x558c41cd3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.294+0000 7f60ba128640 1 --2- 172.21.15.1:0/3463586212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c41cae9d0 0x558c41cce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.294+0000 7f60b9927640 1 -- 172.21.15.1:0/3463586212 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c41cb9bb0 msgr2=0x558c41cd3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:26.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.294+0000 7f60b9927640 1 --2- 172.21.15.1:0/3463586212 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c41cb9bb0 0x558c41cd3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.294+0000 7f60b9927640 1 -- 172.21.15.1:0/3463586212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c41cae9d0 msgr2=0x558c41cce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:26.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.294+0000 7f60b9927640 1 --2- 172.21.15.1:0/3463586212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c41cae9d0 0x558c41cce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.294+0000 7f60b9927640 1 -- 172.21.15.1:0/3463586212 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c41cd46e0 con 0x558c41caf2f0 2024-09-19T09:38:26.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.294+0000 7f60ba128640 1 --2- 172.21.15.1:0/3463586212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c41cae9d0 0x558c41cce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:26.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.294+0000 7f60b9927640 1 --2- 172.21.15.1:0/3463586212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c41caf2f0 0x558c41cd39a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f60a4004650 tx=0x7f60a400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf943b9d5b5e3971 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:26.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.294+0000 7f609dffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:38:26.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.295+0000 7f609dffb640 1 -- 172.21.15.1:0/3463586212 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a4005220 con 0x558c41caf2f0 2024-09-19T09:38:26.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.295+0000 7f609dffb640 1 -- 172.21.15.1:0/3463586212 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f60a40053c0 con 0x558c41caf2f0 2024-09-19T09:38:26.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.295+0000 7f60be765740 1 -- 172.21.15.1:0/3463586212 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558c41c1cb10 con 0x558c41caf2f0 2024-09-19T09:38:26.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.295+0000 7f609dffb640 1 -- 172.21.15.1:0/3463586212 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f60a4003f70 con 0x558c41caf2f0 2024-09-19T09:38:26.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.295+0000 7f60be765740 10 client.15240 fetch_fsmap learned FSMap version 19 2024-09-19T09:38:26.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.295+0000 7f60be765740 1 -- 172.21.15.1:0/3463586212 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558c41d38e10 con 0x558c41caf2f0 2024-09-19T09:38:26.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.295+0000 7f609dffb640 1 -- 172.21.15.1:0/3463586212 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x558c41c1cb10 con 0x558c41caf2f0 2024-09-19T09:38:26.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.295+0000 7f609dffb640 1 -- 172.21.15.1:0/3463586212 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f60a4024030 con 0x558c41caf2f0 2024-09-19T09:38:26.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.295+0000 7f60be765740 10 client.15240 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:38:26.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.295+0000 7f60be765740 10 client.15240 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:38:26.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.295+0000 7f60be765740 20 client.15240 populate_metadata read hostname 'smithi001' 2024-09-19T09:38:26.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.295+0000 7f60be765740 1 --2- 172.21.15.1:0/3463586212 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x558c41d3d9a0 0x558c41d3c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:26.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.295+0000 7f60be765740 4 client.15240 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:38:26.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.295+0000 7f60be765740 1 -- 172.21.15.1:0/3463586212 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "status"}) -- 0x558c41b990e0 con 0x558c41d3d9a0 2024-09-19T09:38:26.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.296+0000 7f60ba128640 1 --2- 172.21.15.1:0/3463586212 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x558c41d3d9a0 0x558c41d3c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:26.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.296+0000 7f60ba128640 1 --2- 172.21.15.1:0/3463586212 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x558c41d3d9a0 0x558c41d3c6b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3ac81f3f660d625 server_cookie=868cc5836dc5b812 in_seq=0 out_seq=0 2024-09-19T09:38:26.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.296+0000 7f609dffb640 10 client.15240 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:26.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.296+0000 7f609dffb640 1 -- 172.21.15.1:0/3463586212 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x558c41b990e0 con 0x558c41d3d9a0 2024-09-19T09:38:26.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.296+0000 7f609dffb640 10 client.15240 handle_command_reply: tid=0 2024-09-19T09:38:26.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.296+0000 7f60be765740 1 client.15240 shutdown 2024-09-19T09:38:26.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.296+0000 7f60be765740 1 -- 172.21.15.1:0/3463586212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c41caf2f0 msgr2=0x558c41cd39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:26.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.296+0000 7f60be765740 1 --2- 172.21.15.1:0/3463586212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c41caf2f0 0x558c41cd39a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f60a4004650 tx=0x7f60a400bf90 comp rx=0 tx=0).stop 2024-09-19T09:38:26.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.296+0000 7f60be765740 1 -- 172.21.15.1:0/3463586212 shutdown_connections 2024-09-19T09:38:26.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.296+0000 7f60be765740 1 --2- 172.21.15.1:0/3463586212 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x558c41d3d9a0 0x558c41d3c6b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.296+0000 7f60be765740 1 --2- 172.21.15.1:0/3463586212 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c41cb9bb0 0x558c41cd3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.296+0000 7f60be765740 1 --2- 172.21.15.1:0/3463586212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558c41caf2f0 0x558c41cd39a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.296+0000 7f609dffb640 0 client.15240 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:26.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.296+0000 7f60be765740 1 --2- 172.21.15.1:0/3463586212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558c41cae9d0 0x558c41cce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.296+0000 7f60be765740 1 -- 172.21.15.1:0/3463586212 >> 172.21.15.1:0/3463586212 conn(0x558c41caaf60 msgr2=0x558c41cb4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:26.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.296+0000 7f60be765740 1 -- 172.21.15.1:0/3463586212 shutdown_connections 2024-09-19T09:38:26.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.296+0000 7f60be765740 1 -- 172.21.15.1:0/3463586212 wait complete. 2024-09-19T09:38:26.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.297+0000 7f60be765740 20 client.15240 trim_cache size 0 max 16384 2024-09-19T09:38:26.309 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:38:26.309 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "57238232-7669-11ef-bceb-c7b262605968", 2024-09-19T09:38:26.309 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2024-09-19T09:38:26.309 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 24497, 2024-09-19T09:38:26.309 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-09-19T09:38:26.309 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-09-19T09:38:26.309 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-09-19T09:38:26.309 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 132.32730693900001, 2024-09-19T09:38:26.309 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 19, 2024-09-19T09:38:26.310 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 83, 2024-09-19T09:38:26.310 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T09:38:26.310 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 143.21192880999999 2024-09-19T09:38:26.310 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:38:26.310 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.297+0000 7f60bc38c640 1 -- 172.21.15.1:0/29551447 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f60a00a3240 msgr2=0x7f60a00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:26.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.297+0000 7f60bc38c640 1 --2- 172.21.15.1:0/29551447 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f60a00a3240 0x7f60a00a5700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f60ac009fd0 tx=0x7f60ac014c10 comp rx=0 tx=0).stop 2024-09-19T09:38:26.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.297+0000 7f60bc38c640 1 -- 172.21.15.1:0/29551447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b4101de0 msgr2=0x7f60b4198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:26.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.297+0000 7f60bc38c640 1 --2- 172.21.15.1:0/29551447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b4101de0 0x7f60b4198430 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f60b0006010 tx=0x7f60b00042f0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.297+0000 7f60bc38c640 1 -- 172.21.15.1:0/29551447 shutdown_connections 2024-09-19T09:38:26.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.297+0000 7f60bc38c640 1 --2- 172.21.15.1:0/29551447 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f60a00a3240 0x7f60a00a5700 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.297+0000 7f60bc38c640 1 --2- 172.21.15.1:0/29551447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60b4106f10 0x7f60b419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.297+0000 7f60bc38c640 1 --2- 172.21.15.1:0/29551447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60b4102790 0x7f60b4198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.297+0000 7f60bc38c640 1 --2- 172.21.15.1:0/29551447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f60b4101de0 0x7f60b4198430 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:26.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.297+0000 7f60bc38c640 1 -- 172.21.15.1:0/29551447 >> 172.21.15.1:0/29551447 conn(0x7f60b40fd8c0 msgr2=0x7f60b40febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:26.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.297+0000 7f60bc38c640 1 -- 172.21.15.1:0/29551447 shutdown_connections 2024-09-19T09:38:26.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:26.297+0000 7f60bc38c640 1 -- 172.21.15.1:0/29551447 wait complete. 2024-09-19T09:38:26.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:25 smithi121 ceph-mon[35577]: pgmap v348: 97 pgs: 97 active+clean; 645 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 341 B/s wr, 3 op/s 2024-09-19T09:38:26.949 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-19T09:38:28.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:27 smithi001 ceph-mon[31225]: pgmap v349: 97 pgs: 97 active+clean; 651 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-19T09:38:28.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:27 smithi022 ceph-mon[35583]: pgmap v349: 97 pgs: 97 active+clean; 651 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-19T09:38:28.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:27 smithi121 ceph-mon[35577]: pgmap v349: 97 pgs: 97 active+clean; 651 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-19T09:38:30.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:29 smithi001 ceph-mon[31225]: pgmap v350: 97 pgs: 97 active+clean; 651 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-19T09:38:30.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:29 smithi022 ceph-mon[35583]: pgmap v350: 97 pgs: 97 active+clean; 651 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-19T09:38:30.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:29 smithi121 ceph-mon[35577]: pgmap v350: 97 pgs: 97 active+clean; 651 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-19T09:38:32.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:31 smithi001 ceph-mon[31225]: pgmap v351: 97 pgs: 97 active+clean; 651 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-19T09:38:32.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:31 smithi022 ceph-mon[35583]: pgmap v351: 97 pgs: 97 active+clean; 651 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-19T09:38:32.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:31 smithi121 ceph-mon[35577]: pgmap v351: 97 pgs: 97 active+clean; 651 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-19T09:38:34.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:33 smithi001 ceph-mon[31225]: pgmap v352: 97 pgs: 97 active+clean; 651 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-19T09:38:34.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:33 smithi022 ceph-mon[35583]: pgmap v352: 97 pgs: 97 active+clean; 651 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-19T09:38:34.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:33 smithi121 ceph-mon[35577]: pgmap v352: 97 pgs: 97 active+clean; 651 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-19T09:38:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.471+0000 7f56920a6640 1 -- 172.21.15.1:0/1029065803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f568c100a40 msgr2=0x7f568c100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.471+0000 7f56920a6640 1 --2- 172.21.15.1:0/1029065803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f568c100a40 0x7f568c100e40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f567c009900 tx=0x7f567c02a410 comp rx=0 tx=0).stop 2024-09-19T09:38:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.471+0000 7f56920a6640 1 -- 172.21.15.1:0/1029065803 shutdown_connections 2024-09-19T09:38:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.471+0000 7f56920a6640 1 --2- 172.21.15.1:0/1029065803 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f568c1025f0 0x7f568c108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.473 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.471+0000 7f56920a6640 1 --2- 172.21.15.1:0/1029065803 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f568c101c30 0x7f568c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.474 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.471+0000 7f56920a6640 1 --2- 172.21.15.1:0/1029065803 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f568c100a40 0x7f568c100e40 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.474 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.471+0000 7f56920a6640 1 -- 172.21.15.1:0/1029065803 >> 172.21.15.1:0/1029065803 conn(0x7f568c0fc1c0 msgr2=0x7f568c0fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:35.474 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.471+0000 7f56920a6640 1 -- 172.21.15.1:0/1029065803 shutdown_connections 2024-09-19T09:38:35.474 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.471+0000 7f56920a6640 1 -- 172.21.15.1:0/1029065803 wait complete. 2024-09-19T09:38:35.474 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.472+0000 7f56920a6640 1 Processor -- start 2024-09-19T09:38:35.474 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.472+0000 7f56920a6640 1 -- start start 2024-09-19T09:38:35.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.472+0000 7f56920a6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f568c100a40 0x7f568c197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:35.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.472+0000 7f56920a6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f568c101c30 0x7f568c198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:35.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.472+0000 7f56920a6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f568c1025f0 0x7f568c19f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:35.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.472+0000 7f56920a6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f568c10c6a0 con 0x7f568c101c30 2024-09-19T09:38:35.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.472+0000 7f56920a6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f568c10c520 con 0x7f568c1025f0 2024-09-19T09:38:35.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.472+0000 7f56920a6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f568c10c820 con 0x7f568c100a40 2024-09-19T09:38:35.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.472+0000 7f5682ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f568c101c30 0x7f568c198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:35.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.472+0000 7f5682ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f568c101c30 0x7f568c198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56870/0 (socket says 172.21.15.1:56870) 2024-09-19T09:38:35.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.472+0000 7f5682ffd640 1 -- 172.21.15.1:0/744035099 learned_addr learned my addr 172.21.15.1:0/744035099 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:35.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.472+0000 7f568bfff640 1 --2- 172.21.15.1:0/744035099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f568c1025f0 0x7f568c19f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:35.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.472+0000 7f568b7fe640 1 --2- 172.21.15.1:0/744035099 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f568c100a40 0x7f568c197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:35.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.473+0000 7f5682ffd640 1 -- 172.21.15.1:0/744035099 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f568c100a40 msgr2=0x7f568c197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:35.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.473+0000 7f5682ffd640 1 --2- 172.21.15.1:0/744035099 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f568c100a40 0x7f568c197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.473+0000 7f5682ffd640 1 -- 172.21.15.1:0/744035099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f568c1025f0 msgr2=0x7f568c19f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:35.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.473+0000 7f5682ffd640 1 --2- 172.21.15.1:0/744035099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f568c1025f0 0x7f568c19f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.473+0000 7f5682ffd640 1 -- 172.21.15.1:0/744035099 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f568c19fb00 con 0x7f568c101c30 2024-09-19T09:38:35.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.473+0000 7f5682ffd640 1 --2- 172.21.15.1:0/744035099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f568c101c30 0x7f568c198420 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f567400d950 tx=0x7f567400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:35.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.473+0000 7f56897fa640 1 -- 172.21.15.1:0/744035099 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5674017070 con 0x7f568c101c30 2024-09-19T09:38:35.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.473+0000 7f56920a6640 1 -- 172.21.15.1:0/744035099 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f568c19fdf0 con 0x7f568c101c30 2024-09-19T09:38:35.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.473+0000 7f56897fa640 1 -- 172.21.15.1:0/744035099 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5674009c30 con 0x7f568c101c30 2024-09-19T09:38:35.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.473+0000 7f56897fa640 1 -- 172.21.15.1:0/744035099 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567400f6b0 con 0x7f568c101c30 2024-09-19T09:38:35.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.473+0000 7f56920a6640 1 -- 172.21.15.1:0/744035099 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f568c1a0300 con 0x7f568c101c30 2024-09-19T09:38:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.476+0000 7f56897fa640 1 -- 172.21.15.1:0/744035099 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f56740109d0 con 0x7f568c101c30 2024-09-19T09:38:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.476+0000 7f5694e3b740 1 Processor -- start 2024-09-19T09:38:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.476+0000 7f5694e3b740 1 -- start start 2024-09-19T09:38:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.476+0000 7f5694e3b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5638e3e5ddb0 0x5638e3e5e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.476+0000 7f5694e3b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638e3e5e6f0 0x5638e3e631b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.476+0000 7f5694e3b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638e3e63780 0x5638e3e65c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.476+0000 7f5694e3b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5638e3dbd2f0 con 0x5638e3e5e6f0 2024-09-19T09:38:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.476+0000 7f5694e3b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5638e3d65270 con 0x5638e3e5ddb0 2024-09-19T09:38:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.476+0000 7f5694e3b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5638e3db92b0 con 0x5638e3e63780 2024-09-19T09:38:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.476+0000 7f568b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638e3e5e6f0 0x5638e3e631b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.476+0000 7f568b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638e3e5e6f0 0x5638e3e631b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56876/0 (socket says 172.21.15.1:56876) 2024-09-19T09:38:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.476+0000 7f568b7fe640 1 -- 172.21.15.1:0/1771735609 learned_addr learned my addr 172.21.15.1:0/1771735609 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.476+0000 7f568bfff640 1 --2- 172.21.15.1:0/1771735609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5638e3e5ddb0 0x5638e3e5e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.476+0000 7f56897fa640 1 --2- 172.21.15.1:0/744035099 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f56780a3240 0x7f56780a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.476+0000 7f5682ffd640 1 --2- 172.21.15.1:0/1771735609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638e3e63780 0x5638e3e65c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.477+0000 7f568b7fe640 1 -- 172.21.15.1:0/1771735609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638e3e63780 msgr2=0x5638e3e65c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.477+0000 7f568b7fe640 1 --2- 172.21.15.1:0/1771735609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638e3e63780 0x5638e3e65c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.477+0000 7f568b7fe640 1 -- 172.21.15.1:0/1771735609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5638e3e5ddb0 msgr2=0x5638e3e5e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.477+0000 7f568b7fe640 1 --2- 172.21.15.1:0/1771735609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5638e3e5ddb0 0x5638e3e5e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.477+0000 7f568b7fe640 1 -- 172.21.15.1:0/1771735609 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638e3d64340 con 0x5638e3e5e6f0 2024-09-19T09:38:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.477+0000 7f568bfff640 1 --2- 172.21.15.1:0/1771735609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5638e3e5ddb0 0x5638e3e5e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.477+0000 7f568bfff640 1 --2- 172.21.15.1:0/744035099 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f56780a3240 0x7f56780a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.477+0000 7f56897fa640 1 -- 172.21.15.1:0/744035099 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f56740cf4a0 con 0x7f568c101c30 2024-09-19T09:38:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.477+0000 7f568b7fe640 1 --2- 172.21.15.1:0/1771735609 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638e3e5e6f0 0x5638e3e631b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f567c031610 tx=0x7f567c005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354de694c583a00c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.477+0000 7f5681ffb640 1 -- 172.21.15.1:0/1771735609 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c040070 con 0x5638e3e5e6f0 2024-09-19T09:38:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.477+0000 7f568bfff640 1 --2- 172.21.15.1:0/744035099 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f56780a3240 0x7f56780a5700 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f56840098b0 tx=0x7f5684004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.477+0000 7f5681ffb640 1 -- 172.21.15.1:0/1771735609 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f567c0318b0 con 0x5638e3e5e6f0 2024-09-19T09:38:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.477+0000 7f5681ffb640 1 -- 172.21.15.1:0/1771735609 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c035040 con 0x5638e3e5e6f0 2024-09-19T09:38:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.478+0000 7f5694e3b740 1 -- 172.21.15.1:0/1771735609 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638e3e5e6f0 msgr2=0x5638e3e631b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.478+0000 7f5694e3b740 1 --2- 172.21.15.1:0/1771735609 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638e3e5e6f0 0x5638e3e631b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f567c031610 tx=0x7f567c005c00 comp rx=0 tx=0).stop 2024-09-19T09:38:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.478+0000 7f5694e3b740 1 -- 172.21.15.1:0/1771735609 shutdown_connections 2024-09-19T09:38:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.478+0000 7f5694e3b740 1 --2- 172.21.15.1:0/1771735609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638e3e63780 0x5638e3e65c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.478+0000 7f5694e3b740 1 --2- 172.21.15.1:0/1771735609 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638e3e5e6f0 0x5638e3e631b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.478+0000 7f5694e3b740 1 --2- 172.21.15.1:0/1771735609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5638e3e5ddb0 0x5638e3e5e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.478+0000 7f5694e3b740 1 -- 172.21.15.1:0/1771735609 >> 172.21.15.1:0/1771735609 conn(0x5638e3e55010 msgr2=0x5638e3e55410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.478+0000 7f5694e3b740 1 -- 172.21.15.1:0/1771735609 shutdown_connections 2024-09-19T09:38:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.478+0000 7f5694e3b740 1 -- 172.21.15.1:0/1771735609 wait complete. 2024-09-19T09:38:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.478+0000 7f5694e3b740 1 -- start start 2024-09-19T09:38:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.479+0000 7f5694e3b740 1 Processor -- start 2024-09-19T09:38:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.479+0000 7f5694e3b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638e3e5ddb0 0x5638e3e67f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.479+0000 7f5694e3b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638e3e5e6f0 0x5638e3e684b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.479+0000 7f5694e3b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5638e3e63780 0x5638e3e6f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.479+0000 7f5694e3b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5638e3e666f0 con 0x5638e3e5e6f0 2024-09-19T09:38:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.479+0000 7f5694e3b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5638e3d46290 con 0x5638e3e63780 2024-09-19T09:38:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.479+0000 7f5694e3b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5638e3e66870 con 0x5638e3e5ddb0 2024-09-19T09:38:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.479+0000 7f5694e3b740 10 client.0 _ll_register_callbacks cb 0x5638e3d77140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.479+0000 7f5682ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638e3e5e6f0 0x5638e3e684b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.479+0000 7f5682ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638e3e5e6f0 0x5638e3e684b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56882/0 (socket says 172.21.15.1:56882) 2024-09-19T09:38:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.479+0000 7f5682ffd640 1 -- 172.21.15.1:0/2896479951 learned_addr learned my addr 172.21.15.1:0/2896479951 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:35.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.479+0000 7f568b7fe640 1 --2- 172.21.15.1:0/2896479951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638e3e5ddb0 0x5638e3e67f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.479+0000 7f568bfff640 1 --2- 172.21.15.1:0/2896479951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5638e3e63780 0x5638e3e6f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.479+0000 7f5682ffd640 1 -- 172.21.15.1:0/2896479951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638e3e5ddb0 msgr2=0x5638e3e67f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.479+0000 7f5682ffd640 1 --2- 172.21.15.1:0/2896479951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638e3e5ddb0 0x5638e3e67f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.479+0000 7f5682ffd640 1 -- 172.21.15.1:0/2896479951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5638e3e63780 msgr2=0x5638e3e6f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.479+0000 7f5682ffd640 1 --2- 172.21.15.1:0/2896479951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5638e3e63780 0x5638e3e6f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.479+0000 7f5682ffd640 1 -- 172.21.15.1:0/2896479951 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638e3ad0210 con 0x5638e3e5e6f0 2024-09-19T09:38:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.479+0000 7f568bfff640 1 --2- 172.21.15.1:0/2896479951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5638e3e63780 0x5638e3e6f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.480+0000 7f5682ffd640 1 --2- 172.21.15.1:0/2896479951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638e3e5e6f0 0x5638e3e684b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5674000c00 tx=0x7f567409b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=932e21c3269eede1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.480+0000 7f566affd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:38:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.480+0000 7f566affd640 1 -- 172.21.15.1:0/2896479951 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5674020070 con 0x5638e3e5e6f0 2024-09-19T09:38:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.480+0000 7f566affd640 1 -- 172.21.15.1:0/2896479951 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f56740cd0b0 con 0x5638e3e5e6f0 2024-09-19T09:38:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.480+0000 7f5694e3b740 1 -- 172.21.15.1:0/2896479951 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f567c0318b0 con 0x5638e3e5e6f0 2024-09-19T09:38:35.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.480+0000 7f566affd640 1 -- 172.21.15.1:0/2896479951 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f5674009de0 con 0x5638e3e5e6f0 2024-09-19T09:38:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.480+0000 7f5694e3b740 10 client.15252 fetch_fsmap learned FSMap version 19 2024-09-19T09:38:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.480+0000 7f5694e3b740 1 -- 172.21.15.1:0/2896479951 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5638e3b9c620 con 0x5638e3e5e6f0 2024-09-19T09:38:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.480+0000 7f566affd640 1 -- 172.21.15.1:0/2896479951 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f567c0318b0 con 0x5638e3e5e6f0 2024-09-19T09:38:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.480+0000 7f566affd640 1 -- 172.21.15.1:0/2896479951 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f56740860b0 con 0x5638e3e5e6f0 2024-09-19T09:38:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.480+0000 7f5694e3b740 10 client.15252 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:38:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.480+0000 7f5694e3b740 10 client.15252 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:38:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.480+0000 7f5694e3b740 20 client.15252 populate_metadata read hostname 'smithi001' 2024-09-19T09:38:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.480+0000 7f5694e3b740 1 --2- 172.21.15.1:0/2896479951 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5638e3e73c30 0x5638e3e76060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.480+0000 7f5694e3b740 4 client.15252 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:38:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.480+0000 7f5694e3b740 1 -- 172.21.15.1:0/2896479951 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638e3dcaa20 con 0x5638e3e73c30 2024-09-19T09:38:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.481+0000 7f568b7fe640 1 --2- 172.21.15.1:0/2896479951 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5638e3e73c30 0x5638e3e76060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.481+0000 7f568b7fe640 1 --2- 172.21.15.1:0/2896479951 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5638e3e73c30 0x5638e3e76060 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=188068e8cacde923 server_cookie=db35ca81e43080ec in_seq=0 out_seq=0 2024-09-19T09:38:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.481+0000 7f566affd640 10 client.15252 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.482+0000 7f566affd640 1 -- 172.21.15.1:0/2896479951 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5638e3dcaa20 con 0x5638e3e73c30 2024-09-19T09:38:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.482+0000 7f566affd640 10 client.15252 handle_command_reply: tid=0 2024-09-19T09:38:35.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.482+0000 7f5694e3b740 1 client.15252 shutdown 2024-09-19T09:38:35.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.482+0000 7f5694e3b740 1 -- 172.21.15.1:0/2896479951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638e3e5e6f0 msgr2=0x5638e3e684b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:35.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.482+0000 7f5694e3b740 1 --2- 172.21.15.1:0/2896479951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638e3e5e6f0 0x5638e3e684b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5674000c00 tx=0x7f567409b7b0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.482+0000 7f5694e3b740 1 -- 172.21.15.1:0/2896479951 shutdown_connections 2024-09-19T09:38:35.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.482+0000 7f5694e3b740 1 --2- 172.21.15.1:0/2896479951 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5638e3e73c30 0x5638e3e76060 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.482+0000 7f5694e3b740 1 --2- 172.21.15.1:0/2896479951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5638e3e63780 0x5638e3e6f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.482+0000 7f5694e3b740 1 --2- 172.21.15.1:0/2896479951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638e3e5e6f0 0x5638e3e684b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.482+0000 7f566affd640 0 client.15252 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:35.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.482+0000 7f5694e3b740 1 --2- 172.21.15.1:0/2896479951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638e3e5ddb0 0x5638e3e67f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.482+0000 7f5694e3b740 1 -- 172.21.15.1:0/2896479951 >> 172.21.15.1:0/2896479951 conn(0x5638e3e55010 msgr2=0x5638e3e56820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:35.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.482+0000 7f5694e3b740 1 -- 172.21.15.1:0/2896479951 shutdown_connections 2024-09-19T09:38:35.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.482+0000 7f5694e3b740 1 -- 172.21.15.1:0/2896479951 wait complete. 2024-09-19T09:38:35.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.482+0000 7f5694e3b740 20 client.15252 trim_cache size 0 max 16384 2024-09-19T09:38:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.497+0000 7f5694e3b740 1 Processor -- start 2024-09-19T09:38:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.497+0000 7f5694e3b740 1 -- start start 2024-09-19T09:38:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.497+0000 7f5694e3b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638e3e5ddb0 0x5638e3e7a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.497+0000 7f5694e3b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638e3e5e6f0 0x5638e3e6f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.497+0000 7f5694e3b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5638e3e63780 0x5638e3e7aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.497+0000 7f5694e3b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f568c1a4eb0 con 0x5638e3e5ddb0 2024-09-19T09:38:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.497+0000 7f5694e3b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f568c1a7750 con 0x5638e3e63780 2024-09-19T09:38:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.497+0000 7f5694e3b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f568c1a5540 con 0x5638e3e5e6f0 2024-09-19T09:38:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.497+0000 7f568b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638e3e5ddb0 0x5638e3e7a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.497+0000 7f568b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638e3e5ddb0 0x5638e3e7a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56890/0 (socket says 172.21.15.1:56890) 2024-09-19T09:38:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.497+0000 7f568b7fe640 1 -- 172.21.15.1:0/108997326 learned_addr learned my addr 172.21.15.1:0/108997326 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.498+0000 7f568bfff640 1 --2- 172.21.15.1:0/108997326 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5638e3e63780 0x5638e3e7aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.498+0000 7f5682ffd640 1 --2- 172.21.15.1:0/108997326 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638e3e5e6f0 0x5638e3e6f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.498+0000 7f568b7fe640 1 -- 172.21.15.1:0/108997326 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638e3e5e6f0 msgr2=0x5638e3e6f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.498+0000 7f568b7fe640 1 --2- 172.21.15.1:0/108997326 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638e3e5e6f0 0x5638e3e6f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.498+0000 7f568b7fe640 1 -- 172.21.15.1:0/108997326 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5638e3e63780 msgr2=0x5638e3e7aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.498+0000 7f568b7fe640 1 --2- 172.21.15.1:0/108997326 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5638e3e63780 0x5638e3e7aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.498+0000 7f568b7fe640 1 -- 172.21.15.1:0/108997326 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638e3e502d0 con 0x5638e3e5ddb0 2024-09-19T09:38:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.498+0000 7f568bfff640 1 --2- 172.21.15.1:0/108997326 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5638e3e63780 0x5638e3e7aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.498+0000 7f568b7fe640 1 --2- 172.21.15.1:0/108997326 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638e3e5ddb0 0x5638e3e7a960 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f567c009900 tx=0x7f567c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed99eb47f1e7a0ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.498+0000 7f56817fa640 1 -- 172.21.15.1:0/108997326 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c035040 con 0x5638e3e5ddb0 2024-09-19T09:38:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.498+0000 7f56817fa640 1 -- 172.21.15.1:0/108997326 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f567c005420 con 0x5638e3e5ddb0 2024-09-19T09:38:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.498+0000 7f56817fa640 1 -- 172.21.15.1:0/108997326 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c040040 con 0x5638e3e5ddb0 2024-09-19T09:38:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.499+0000 7f5694e3b740 1 -- 172.21.15.1:0/108997326 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638e3e5ddb0 msgr2=0x5638e3e7a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.499+0000 7f5694e3b740 1 --2- 172.21.15.1:0/108997326 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638e3e5ddb0 0x5638e3e7a960 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f567c009900 tx=0x7f567c02a410 comp rx=0 tx=0).stop 2024-09-19T09:38:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.499+0000 7f5694e3b740 1 -- 172.21.15.1:0/108997326 shutdown_connections 2024-09-19T09:38:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.499+0000 7f5694e3b740 1 --2- 172.21.15.1:0/108997326 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5638e3e63780 0x5638e3e7aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.499+0000 7f5694e3b740 1 --2- 172.21.15.1:0/108997326 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638e3e5e6f0 0x5638e3e6f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.499+0000 7f5694e3b740 1 --2- 172.21.15.1:0/108997326 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638e3e5ddb0 0x5638e3e7a960 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.499+0000 7f5694e3b740 1 -- 172.21.15.1:0/108997326 >> 172.21.15.1:0/108997326 conn(0x5638e3e55010 msgr2=0x5638e3e541c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.499+0000 7f5694e3b740 1 -- 172.21.15.1:0/108997326 shutdown_connections 2024-09-19T09:38:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.499+0000 7f5694e3b740 1 -- 172.21.15.1:0/108997326 wait complete. 2024-09-19T09:38:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.499+0000 7f5694e3b740 1 -- start start 2024-09-19T09:38:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.499+0000 7f5694e3b740 1 Processor -- start 2024-09-19T09:38:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.500+0000 7f5694e3b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638e3e5ddb0 0x5638e3e6d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.500+0000 7f5694e3b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5638e3e5e6f0 0x5638e3e6d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.500+0000 7f5694e3b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638e3e63780 0x5638e3e6e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.500+0000 7f5694e3b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f568c1a5c10 con 0x5638e3e5ddb0 2024-09-19T09:38:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.500+0000 7f5694e3b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f568c1a7080 con 0x5638e3e5e6f0 2024-09-19T09:38:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.500+0000 7f5694e3b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f568c1a62e0 con 0x5638e3e63780 2024-09-19T09:38:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.500+0000 7f5694e3b740 10 client.0 _ll_register_callbacks cb 0x7f567400df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.500+0000 7f568b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638e3e5ddb0 0x5638e3e6d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.500+0000 7f568b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638e3e5ddb0 0x5638e3e6d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56898/0 (socket says 172.21.15.1:56898) 2024-09-19T09:38:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.500+0000 7f568b7fe640 1 -- 172.21.15.1:0/208295477 learned_addr learned my addr 172.21.15.1:0/208295477 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.500+0000 7f5682ffd640 1 --2- 172.21.15.1:0/208295477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5638e3e5e6f0 0x5638e3e6d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.500+0000 7f568bfff640 1 --2- 172.21.15.1:0/208295477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638e3e63780 0x5638e3e6e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.500+0000 7f568b7fe640 1 -- 172.21.15.1:0/208295477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638e3e63780 msgr2=0x5638e3e6e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.500+0000 7f568b7fe640 1 --2- 172.21.15.1:0/208295477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638e3e63780 0x5638e3e6e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.500+0000 7f568b7fe640 1 -- 172.21.15.1:0/208295477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5638e3e5e6f0 msgr2=0x5638e3e6d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.500+0000 7f568b7fe640 1 --2- 172.21.15.1:0/208295477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5638e3e5e6f0 0x5638e3e6d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.500+0000 7f568b7fe640 1 -- 172.21.15.1:0/208295477 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638e3e6ece0 con 0x5638e3e5ddb0 2024-09-19T09:38:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.500+0000 7f568b7fe640 1 --2- 172.21.15.1:0/208295477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638e3e5ddb0 0x5638e3e6d1d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f567c006010 tx=0x7f567c031960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e9d426732713e02 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.500+0000 7f566affd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:38:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.500+0000 7f566affd640 1 -- 172.21.15.1:0/208295477 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c05d070 con 0x5638e3e5ddb0 2024-09-19T09:38:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.500+0000 7f566affd640 1 -- 172.21.15.1:0/208295477 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f567c059670 con 0x5638e3e5ddb0 2024-09-19T09:38:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.500+0000 7f5694e3b740 1 -- 172.21.15.1:0/208295477 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f567c005420 con 0x5638e3e5ddb0 2024-09-19T09:38:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.501+0000 7f566affd640 1 -- 172.21.15.1:0/208295477 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f567c069050 con 0x5638e3e5ddb0 2024-09-19T09:38:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.501+0000 7f5694e3b740 10 client.15258 fetch_fsmap learned FSMap version 19 2024-09-19T09:38:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.501+0000 7f5694e3b740 1 -- 172.21.15.1:0/208295477 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5638e3edef40 con 0x5638e3e5ddb0 2024-09-19T09:38:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.501+0000 7f566affd640 1 -- 172.21.15.1:0/208295477 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f567c005420 con 0x5638e3e5ddb0 2024-09-19T09:38:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.501+0000 7f566affd640 1 -- 172.21.15.1:0/208295477 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f567c04d070 con 0x5638e3e5ddb0 2024-09-19T09:38:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.501+0000 7f5694e3b740 10 client.15258 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:38:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.501+0000 7f5694e3b740 10 client.15258 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:38:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.501+0000 7f5694e3b740 20 client.15258 populate_metadata read hostname 'smithi001' 2024-09-19T09:38:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.501+0000 7f5694e3b740 1 --2- 172.21.15.1:0/208295477 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5638e3edf4a0 0x5638e3ee1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.501+0000 7f5694e3b740 4 client.15258 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:38:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.501+0000 7f5694e3b740 1 -- 172.21.15.1:0/208295477 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5638e3dc4d70 con 0x5638e3edf4a0 2024-09-19T09:38:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.501+0000 7f5682ffd640 1 --2- 172.21.15.1:0/208295477 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5638e3edf4a0 0x5638e3ee1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.502+0000 7f566affd640 10 client.15258 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.502+0000 7f5682ffd640 1 --2- 172.21.15.1:0/208295477 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5638e3edf4a0 0x5638e3ee1890 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b07058257d976d83 server_cookie=c0cf473acd60dcac in_seq=0 out_seq=0 2024-09-19T09:38:35.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.509+0000 7f566affd640 1 -- 172.21.15.1:0/208295477 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5638e3dc4d70 con 0x5638e3edf4a0 2024-09-19T09:38:35.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.509+0000 7f566affd640 10 client.15258 handle_command_reply: tid=0 2024-09-19T09:38:35.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.509+0000 7f5694e3b740 1 client.15258 shutdown 2024-09-19T09:38:35.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.509+0000 7f5694e3b740 1 -- 172.21.15.1:0/208295477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638e3e5ddb0 msgr2=0x5638e3e6d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:35.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.509+0000 7f5694e3b740 1 --2- 172.21.15.1:0/208295477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638e3e5ddb0 0x5638e3e6d1d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f567c006010 tx=0x7f567c031960 comp rx=0 tx=0).stop 2024-09-19T09:38:35.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.509+0000 7f5694e3b740 1 -- 172.21.15.1:0/208295477 shutdown_connections 2024-09-19T09:38:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.509+0000 7f5694e3b740 1 --2- 172.21.15.1:0/208295477 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5638e3edf4a0 0x5638e3ee1890 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.509+0000 7f5694e3b740 1 --2- 172.21.15.1:0/208295477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5638e3e63780 0x5638e3e6e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.509+0000 7f5694e3b740 1 --2- 172.21.15.1:0/208295477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5638e3e5e6f0 0x5638e3e6d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.509+0000 7f566affd640 0 client.15258 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.509+0000 7f5694e3b740 1 --2- 172.21.15.1:0/208295477 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5638e3e5ddb0 0x5638e3e6d1d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.509+0000 7f5694e3b740 1 -- 172.21.15.1:0/208295477 >> 172.21.15.1:0/208295477 conn(0x5638e3e55010 msgr2=0x5638e3e55ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.509+0000 7f5694e3b740 1 -- 172.21.15.1:0/208295477 shutdown_connections 2024-09-19T09:38:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.510+0000 7f5694e3b740 1 -- 172.21.15.1:0/208295477 wait complete. 2024-09-19T09:38:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.510+0000 7f5694e3b740 20 client.15258 trim_cache size 0 max 16384 2024-09-19T09:38:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:38:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:38:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:38:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:38:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.510+0000 7f56920a6640 1 -- 172.21.15.1:0/744035099 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f56780a3240 msgr2=0x7f56780a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.510+0000 7f56920a6640 1 --2- 172.21.15.1:0/744035099 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f56780a3240 0x7f56780a5700 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f56840098b0 tx=0x7f5684004a40 comp rx=0 tx=0).stop 2024-09-19T09:38:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.510+0000 7f56920a6640 1 -- 172.21.15.1:0/744035099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f568c101c30 msgr2=0x7f568c198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.510+0000 7f56920a6640 1 --2- 172.21.15.1:0/744035099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f568c101c30 0x7f568c198420 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f567400d950 tx=0x7f567400de10 comp rx=0 tx=0).stop 2024-09-19T09:38:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.510+0000 7f56920a6640 1 -- 172.21.15.1:0/744035099 shutdown_connections 2024-09-19T09:38:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.510+0000 7f56920a6640 1 --2- 172.21.15.1:0/744035099 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f56780a3240 0x7f56780a5700 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.510+0000 7f56920a6640 1 --2- 172.21.15.1:0/744035099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f568c1025f0 0x7f568c19f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.510+0000 7f56920a6640 1 --2- 172.21.15.1:0/744035099 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f568c101c30 0x7f568c198420 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.510+0000 7f56920a6640 1 --2- 172.21.15.1:0/744035099 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f568c100a40 0x7f568c197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.510+0000 7f56920a6640 1 -- 172.21.15.1:0/744035099 >> 172.21.15.1:0/744035099 conn(0x7f568c0fc1c0 msgr2=0x7f568c069a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.510+0000 7f56920a6640 1 -- 172.21.15.1:0/744035099 shutdown_connections 2024-09-19T09:38:35.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:35.510+0000 7f56920a6640 1 -- 172.21.15.1:0/744035099 wait complete. 2024-09-19T09:38:36.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:35 smithi001 ceph-mon[31225]: pgmap v353: 97 pgs: 97 active+clean; 651 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-19T09:38:36.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:35 smithi022 ceph-mon[35583]: pgmap v353: 97 pgs: 97 active+clean; 651 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-19T09:38:36.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:35 smithi121 ceph-mon[35577]: pgmap v353: 97 pgs: 97 active+clean; 651 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-19T09:38:38.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:37 smithi022 ceph-mon[35583]: pgmap v354: 97 pgs: 97 active+clean; 652 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-19T09:38:38.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:37 smithi121 ceph-mon[35577]: pgmap v354: 97 pgs: 97 active+clean; 652 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-19T09:38:38.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:37 smithi001 ceph-mon[31225]: pgmap v354: 97 pgs: 97 active+clean; 652 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-19T09:38:40.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:40 smithi022 ceph-mon[35583]: pgmap v355: 97 pgs: 97 active+clean; 652 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 426 B/s wr, 2 op/s 2024-09-19T09:38:40.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:40 smithi121 ceph-mon[35577]: pgmap v355: 97 pgs: 97 active+clean; 652 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 426 B/s wr, 2 op/s 2024-09-19T09:38:40.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:40 smithi001 ceph-mon[31225]: pgmap v355: 97 pgs: 97 active+clean; 652 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 426 B/s wr, 2 op/s 2024-09-19T09:38:41.949 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 11.2 2024-09-19T09:38:41.950 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:38:42.229 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:42.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:42 smithi001 ceph-mon[31225]: pgmap v356: 97 pgs: 97 active+clean; 652 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 938 B/s wr, 3 op/s 2024-09-19T09:38:42.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:42 smithi022 ceph-mon[35583]: pgmap v356: 97 pgs: 97 active+clean; 652 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 938 B/s wr, 3 op/s 2024-09-19T09:38:42.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:42 smithi121 ceph-mon[35577]: pgmap v356: 97 pgs: 97 active+clean; 652 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 938 B/s wr, 3 op/s 2024-09-19T09:38:42.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.847+0000 7faf22d6d640 1 -- 172.21.15.1:0/2571545434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf1c103740 msgr2=0x7faf1c107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:42.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.847+0000 7faf22d6d640 1 --2- 172.21.15.1:0/2571545434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf1c103740 0x7faf1c107b80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7faf04009930 tx=0x7faf0402a420 comp rx=0 tx=0).stop 2024-09-19T09:38:42.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.847+0000 7faf22d6d640 1 -- 172.21.15.1:0/2571545434 shutdown_connections 2024-09-19T09:38:42.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.847+0000 7faf22d6d640 1 --2- 172.21.15.1:0/2571545434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf1c108290 0x7faf1c10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:42.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.847+0000 7faf22d6d640 1 --2- 172.21.15.1:0/2571545434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf1c103740 0x7faf1c107b80 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:42.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.847+0000 7faf22d6d640 1 --2- 172.21.15.1:0/2571545434 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf1c102d90 0x7faf1c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:42.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.847+0000 7faf22d6d640 1 -- 172.21.15.1:0/2571545434 >> 172.21.15.1:0/2571545434 conn(0x7faf1c0fc7d0 msgr2=0x7faf1c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:42.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.847+0000 7faf22d6d640 1 -- 172.21.15.1:0/2571545434 shutdown_connections 2024-09-19T09:38:42.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.847+0000 7faf22d6d640 1 -- 172.21.15.1:0/2571545434 wait complete. 2024-09-19T09:38:42.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.848+0000 7faf22d6d640 1 Processor -- start 2024-09-19T09:38:42.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.848+0000 7faf22d6d640 1 -- start start 2024-09-19T09:38:42.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.848+0000 7faf22d6d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf1c102d90 0x7faf1c198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:42.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.848+0000 7faf22d6d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf1c103740 0x7faf1c198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:42.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.848+0000 7faf22d6d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf1c108290 0x7faf1c19ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:42.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.848+0000 7faf22d6d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faf1c112090 con 0x7faf1c108290 2024-09-19T09:38:42.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.848+0000 7faf22d6d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faf1c111f10 con 0x7faf1c102d90 2024-09-19T09:38:42.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.848+0000 7faf22d6d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7faf1c112210 con 0x7faf1c103740 2024-09-19T09:38:42.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.848+0000 7faf2130a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf1c108290 0x7faf1c19ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:42.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.848+0000 7faf2130a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf1c108290 0x7faf1c19ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56912/0 (socket says 172.21.15.1:56912) 2024-09-19T09:38:42.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.848+0000 7faf2130a640 1 -- 172.21.15.1:0/3058844285 learned_addr learned my addr 172.21.15.1:0/3058844285 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:42.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.848+0000 7faf1bfff640 1 --2- 172.21.15.1:0/3058844285 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf1c103740 0x7faf1c198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:42.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.848+0000 7faf20b09640 1 --2- 172.21.15.1:0/3058844285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf1c102d90 0x7faf1c198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:42.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.849+0000 7faf2130a640 1 -- 172.21.15.1:0/3058844285 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf1c103740 msgr2=0x7faf1c198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:42.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.849+0000 7faf2130a640 1 --2- 172.21.15.1:0/3058844285 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf1c103740 0x7faf1c198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:42.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.849+0000 7faf2130a640 1 -- 172.21.15.1:0/3058844285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf1c102d90 msgr2=0x7faf1c198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:42.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.849+0000 7faf2130a640 1 --2- 172.21.15.1:0/3058844285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf1c102d90 0x7faf1c198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:42.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.849+0000 7faf2130a640 1 -- 172.21.15.1:0/3058844285 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf1c19d500 con 0x7faf1c108290 2024-09-19T09:38:42.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.849+0000 7faf2130a640 1 --2- 172.21.15.1:0/3058844285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf1c108290 0x7faf1c19ce20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7faf1400c970 tx=0x7faf1400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:42.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.849+0000 7faf19ffb640 1 -- 172.21.15.1:0/3058844285 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf14007bb0 con 0x7faf1c108290 2024-09-19T09:38:42.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.849+0000 7faf22d6d640 1 -- 172.21.15.1:0/3058844285 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf1c19d7f0 con 0x7faf1c108290 2024-09-19T09:38:42.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.849+0000 7faf19ffb640 1 -- 172.21.15.1:0/3058844285 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf14007d50 con 0x7faf1c108290 2024-09-19T09:38:42.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.849+0000 7faf19ffb640 1 -- 172.21.15.1:0/3058844285 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf14018800 con 0x7faf1c108290 2024-09-19T09:38:42.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.849+0000 7faf22d6d640 1 -- 172.21.15.1:0/3058844285 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf1c1a50d0 con 0x7faf1c108290 2024-09-19T09:38:42.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.851+0000 7faf22d6d640 1 -- 172.21.15.1:0/3058844285 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf1c103170 con 0x7faf1c108290 2024-09-19T09:38:42.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.852+0000 7faf19ffb640 1 -- 172.21.15.1:0/3058844285 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7faf1400fa50 con 0x7faf1c108290 2024-09-19T09:38:42.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.852+0000 7faf19ffb640 1 --2- 172.21.15.1:0/3058844285 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7faf080a32c0 0x7faf080a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:42.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.853+0000 7faf20b09640 1 --2- 172.21.15.1:0/3058844285 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7faf080a32c0 0x7faf080a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:42.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.853+0000 7faf19ffb640 1 -- 172.21.15.1:0/3058844285 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7faf140cf7e0 con 0x7faf1c108290 2024-09-19T09:38:42.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.853+0000 7faf20b09640 1 --2- 172.21.15.1:0/3058844285 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7faf080a32c0 0x7faf080a5780 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7faf0c005fd0 tx=0x7faf0c009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:42.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:42.861+0000 7faf19ffb640 1 -- 172.21.15.1:0/3058844285 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faf14014030 con 0x7faf1c108290 2024-09-19T09:38:43.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:43.096+0000 7faf22d6d640 1 -- 172.21.15.1:0/3058844285 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf1c10a2a0 con 0x7faf1c108290 2024-09-19T09:38:43.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:43.097+0000 7faf19ffb640 1 -- 172.21.15.1:0/3058844285 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11837 (secure 0 0 0) 0x7faf1409c500 con 0x7faf1c108290 2024-09-19T09:38:43.099 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:38:43.099 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":19,"btime":"2024-09-19T09:36:24:006349+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:36:23.723388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6839/3279971690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3279971690},{"type":"v1","addr":"172.21.15.121:6839","nonce":3279971690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:38:43.099 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 19 2024-09-19T09:38:43.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:43.099+0000 7faf22d6d640 1 -- 172.21.15.1:0/3058844285 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7faf080a32c0 msgr2=0x7faf080a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:43.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:43.099+0000 7faf22d6d640 1 --2- 172.21.15.1:0/3058844285 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7faf080a32c0 0x7faf080a5780 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7faf0c005fd0 tx=0x7faf0c009680 comp rx=0 tx=0).stop 2024-09-19T09:38:43.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:43.099+0000 7faf22d6d640 1 -- 172.21.15.1:0/3058844285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf1c108290 msgr2=0x7faf1c19ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:43.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:43.099+0000 7faf22d6d640 1 --2- 172.21.15.1:0/3058844285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf1c108290 0x7faf1c19ce20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7faf1400c970 tx=0x7faf1400ce30 comp rx=0 tx=0).stop 2024-09-19T09:38:43.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:43.099+0000 7faf22d6d640 1 -- 172.21.15.1:0/3058844285 shutdown_connections 2024-09-19T09:38:43.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:43.099+0000 7faf22d6d640 1 --2- 172.21.15.1:0/3058844285 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf1c108290 0x7faf1c19ce20 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:43.099+0000 7faf22d6d640 1 --2- 172.21.15.1:0/3058844285 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf1c103740 0x7faf1c198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:43.099+0000 7faf22d6d640 1 --2- 172.21.15.1:0/3058844285 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7faf080a32c0 0x7faf080a5780 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:43.099+0000 7faf22d6d640 1 --2- 172.21.15.1:0/3058844285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf1c102d90 0x7faf1c198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:43.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:43.100+0000 7faf22d6d640 1 -- 172.21.15.1:0/3058844285 >> 172.21.15.1:0/3058844285 conn(0x7faf1c0fc7d0 msgr2=0x7faf1c105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:43.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:43.100+0000 7faf22d6d640 1 -- 172.21.15.1:0/3058844285 shutdown_connections 2024-09-19T09:38:43.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:43.100+0000 7faf22d6d640 1 -- 172.21.15.1:0/3058844285 wait complete. 2024-09-19T09:38:43.403 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:38:43.737 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0' 2024-09-19T09:38:43.738 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0 2024-09-19T09:38:43.786 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:44.282 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:44 smithi001 ceph-mon[31225]: pgmap v357: 97 pgs: 97 active+clean; 652 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 938 B/s wr, 4 op/s 2024-09-19T09:38:44.282 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:44 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/3058844285' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:44.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.283+0000 7fc1732b9640 1 -- 172.21.15.1:0/1853386728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc16c102ef0 msgr2=0x7fc16c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:44.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.283+0000 7fc1732b9640 1 --2- 172.21.15.1:0/1853386728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc16c102ef0 0x7fc16c10da40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc164009ca0 tx=0x7fc16402a950 comp rx=0 tx=0).stop 2024-09-19T09:38:44.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.283+0000 7fc1732b9640 1 -- 172.21.15.1:0/1853386728 shutdown_connections 2024-09-19T09:38:44.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.283+0000 7fc1732b9640 1 --2- 172.21.15.1:0/1853386728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc16c102ef0 0x7fc16c10da40 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.283+0000 7fc1732b9640 1 --2- 172.21.15.1:0/1853386728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc16c102570 0x7fc16c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.283+0000 7fc1732b9640 1 --2- 172.21.15.1:0/1853386728 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc16c100e20 0x7fc16c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.283+0000 7fc1732b9640 1 -- 172.21.15.1:0/1853386728 >> 172.21.15.1:0/1853386728 conn(0x7fc16c0fc7d0 msgr2=0x7fc16c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:44.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.283+0000 7fc1732b9640 1 -- 172.21.15.1:0/1853386728 shutdown_connections 2024-09-19T09:38:44.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.283+0000 7fc1732b9640 1 -- 172.21.15.1:0/1853386728 wait complete. 2024-09-19T09:38:44.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.284+0000 7fc1732b9640 1 Processor -- start 2024-09-19T09:38:44.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.284+0000 7fc1732b9640 1 -- start start 2024-09-19T09:38:44.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.285+0000 7fc1732b9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc16c100e20 0x7fc16c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:44.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.285+0000 7fc1732b9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc16c102570 0x7fc16c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:44.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.285+0000 7fc1732b9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc16c102ef0 0x7fc16c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:44.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.285+0000 7fc1732b9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c110f80 con 0x7fc16c102570 2024-09-19T09:38:44.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.285+0000 7fc1732b9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c110e00 con 0x7fc16c100e20 2024-09-19T09:38:44.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.285+0000 7fc1732b9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c111100 con 0x7fc16c102ef0 2024-09-19T09:38:44.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.285+0000 7fc170854640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc16c102570 0x7fc16c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:44.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.285+0000 7fc170854640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc16c102570 0x7fc16c0fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56916/0 (socket says 172.21.15.1:56916) 2024-09-19T09:38:44.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.285+0000 7fc170854640 1 -- 172.21.15.1:0/919893051 learned_addr learned my addr 172.21.15.1:0/919893051 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:44.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.285+0000 7fc171055640 1 --2- 172.21.15.1:0/919893051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc16c100e20 0x7fc16c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:44.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.285+0000 7fc171856640 1 --2- 172.21.15.1:0/919893051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc16c102ef0 0x7fc16c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:44.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.285+0000 7fc170854640 1 -- 172.21.15.1:0/919893051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc16c102ef0 msgr2=0x7fc16c0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:44.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.285+0000 7fc170854640 1 --2- 172.21.15.1:0/919893051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc16c102ef0 0x7fc16c0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.285+0000 7fc170854640 1 -- 172.21.15.1:0/919893051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc16c100e20 msgr2=0x7fc16c0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:44.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.285+0000 7fc170854640 1 --2- 172.21.15.1:0/919893051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc16c100e20 0x7fc16c0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.285+0000 7fc170854640 1 -- 172.21.15.1:0/919893051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc16c1a6910 con 0x7fc16c102570 2024-09-19T09:38:44.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.285+0000 7fc171055640 1 --2- 172.21.15.1:0/919893051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc16c100e20 0x7fc16c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:38:44.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.286+0000 7fc170854640 1 --2- 172.21.15.1:0/919893051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc16c102570 0x7fc16c0fd1c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc15c00d950 tx=0x7fc15c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:44.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.286+0000 7fc1627fc640 1 -- 172.21.15.1:0/919893051 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c017030 con 0x7fc16c102570 2024-09-19T09:38:44.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.286+0000 7fc1627fc640 1 -- 172.21.15.1:0/919893051 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc15c004020 con 0x7fc16c102570 2024-09-19T09:38:44.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.286+0000 7fc1627fc640 1 -- 172.21.15.1:0/919893051 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c0047a0 con 0x7fc16c102570 2024-09-19T09:38:44.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.286+0000 7fc1732b9640 1 -- 172.21.15.1:0/919893051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc16c1a6c00 con 0x7fc16c102570 2024-09-19T09:38:44.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.286+0000 7fc1732b9640 1 -- 172.21.15.1:0/919893051 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc16c1a70f0 con 0x7fc16c102570 2024-09-19T09:38:44.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.289+0000 7fc1627fc640 1 -- 172.21.15.1:0/919893051 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fc15c0041d0 con 0x7fc16c102570 2024-09-19T09:38:44.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.289+0000 7fc175692740 1 Processor -- start 2024-09-19T09:38:44.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.289+0000 7fc175692740 1 -- start start 2024-09-19T09:38:44.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.290+0000 7fc175692740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d174b724a0 0x55d174b72880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:44.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.290+0000 7fc175692740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d174b72dc0 0x55d174b7d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:44.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.290+0000 7fc175692740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d174b7d680 0x55d174b7fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:44.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.290+0000 7fc175692740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d174ad82e0 con 0x55d174b724a0 2024-09-19T09:38:44.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.290+0000 7fc175692740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d174a7fce0 con 0x55d174b72dc0 2024-09-19T09:38:44.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.290+0000 7fc175692740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d174ad42a0 con 0x55d174b7d680 2024-09-19T09:38:44.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.290+0000 7fc171856640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d174b724a0 0x55d174b72880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:44.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.290+0000 7fc171856640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d174b724a0 0x55d174b72880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56922/0 (socket says 172.21.15.1:56922) 2024-09-19T09:38:44.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.290+0000 7fc171856640 1 -- 172.21.15.1:0/1520871218 learned_addr learned my addr 172.21.15.1:0/1520871218 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:44.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.290+0000 7fc171055640 1 --2- 172.21.15.1:0/1520871218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d174b72dc0 0x55d174b7d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:44.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.290+0000 7fc170854640 1 --2- 172.21.15.1:0/1520871218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d174b7d680 0x55d174b7fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:44.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.290+0000 7fc171055640 1 -- 172.21.15.1:0/1520871218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d174b7d680 msgr2=0x55d174b7fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:44.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.290+0000 7fc171055640 1 --2- 172.21.15.1:0/1520871218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d174b7d680 0x55d174b7fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.290+0000 7fc171055640 1 -- 172.21.15.1:0/1520871218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d174b724a0 msgr2=0x55d174b72880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:44.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.290+0000 7fc171055640 1 --2- 172.21.15.1:0/1520871218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d174b724a0 0x55d174b72880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.290+0000 7fc171055640 1 -- 172.21.15.1:0/1520871218 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d174a64440 con 0x55d174b72dc0 2024-09-19T09:38:44.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.290+0000 7fc1627fc640 1 --2- 172.21.15.1:0/919893051 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc1580a3240 0x7fc1580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:44.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.291+0000 7fc171055640 1 --2- 172.21.15.1:0/1520871218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d174b72dc0 0x55d174b7d140 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc1680103d0 tx=0x7fc168010890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e427d2e4d4719fb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:44.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.291+0000 7fc171856640 1 --2- 172.21.15.1:0/919893051 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc1580a3240 0x7fc1580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:44.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.291+0000 7fc1577fe640 1 -- 172.21.15.1:0/1520871218 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc168004220 con 0x55d174b72dc0 2024-09-19T09:38:44.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.291+0000 7fc1577fe640 1 -- 172.21.15.1:0/1520871218 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1680043c0 con 0x55d174b72dc0 2024-09-19T09:38:44.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.291+0000 7fc1577fe640 1 -- 172.21.15.1:0/1520871218 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc168011a80 con 0x55d174b72dc0 2024-09-19T09:38:44.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.291+0000 7fc1627fc640 1 -- 172.21.15.1:0/919893051 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fc15c0cf1e0 con 0x7fc16c102570 2024-09-19T09:38:44.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.292+0000 7fc175692740 1 -- 172.21.15.1:0/1520871218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d174b72dc0 msgr2=0x55d174b7d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:44.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.292+0000 7fc171856640 1 --2- 172.21.15.1:0/919893051 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc1580a3240 0x7fc1580a5700 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc164009430 tx=0x7fc164005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:44.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.292+0000 7fc175692740 1 --2- 172.21.15.1:0/1520871218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d174b72dc0 0x55d174b7d140 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc1680103d0 tx=0x7fc168010890 comp rx=0 tx=0).stop 2024-09-19T09:38:44.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.292+0000 7fc175692740 1 -- 172.21.15.1:0/1520871218 shutdown_connections 2024-09-19T09:38:44.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.292+0000 7fc175692740 1 --2- 172.21.15.1:0/1520871218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d174b7d680 0x55d174b7fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.292+0000 7fc175692740 1 --2- 172.21.15.1:0/1520871218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d174b72dc0 0x55d174b7d140 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.292+0000 7fc175692740 1 --2- 172.21.15.1:0/1520871218 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d174b724a0 0x55d174b72880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.292+0000 7fc175692740 1 -- 172.21.15.1:0/1520871218 >> 172.21.15.1:0/1520871218 conn(0x55d174b6ea30 msgr2=0x55d174b6ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:44.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.293+0000 7fc175692740 1 -- 172.21.15.1:0/1520871218 shutdown_connections 2024-09-19T09:38:44.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.293+0000 7fc175692740 1 -- 172.21.15.1:0/1520871218 wait complete. 2024-09-19T09:38:44.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.293+0000 7fc175692740 1 -- start start 2024-09-19T09:38:44.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.293+0000 7fc175692740 1 Processor -- start 2024-09-19T09:38:44.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.294+0000 7fc175692740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d174b724a0 0x55d174b7cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:44.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.294+0000 7fc175692740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d174b72dc0 0x55d174b7a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:44.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.294+0000 7fc175692740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d174b7d680 0x55d174b7a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:44.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.294+0000 7fc175692740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d174b80250 con 0x55d174b7d680 2024-09-19T09:38:44.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.294+0000 7fc171856640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d174b7d680 0x55d174b7a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:44.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.294+0000 7fc171856640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d174b7d680 0x55d174b7a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56936/0 (socket says 172.21.15.1:56936) 2024-09-19T09:38:44.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.294+0000 7fc170854640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d174b72dc0 0x55d174b7a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:44.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.294+0000 7fc171856640 1 -- 172.21.15.1:0/2920497844 learned_addr learned my addr 172.21.15.1:0/2920497844 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:44.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.294+0000 7fc175692740 1 -- 172.21.15.1:0/2920497844 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d174a93050 con 0x55d174b72dc0 2024-09-19T09:38:44.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.294+0000 7fc175692740 1 -- 172.21.15.1:0/2920497844 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d174b803d0 con 0x55d174b724a0 2024-09-19T09:38:44.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.294+0000 7fc171055640 1 --2- 172.21.15.1:0/2920497844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d174b724a0 0x55d174b7cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:44.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.295+0000 7fc175692740 10 client.0 _ll_register_callbacks cb 0x55d174ad3160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:44.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.295+0000 7fc170854640 1 -- 172.21.15.1:0/2920497844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d174b724a0 msgr2=0x55d174b7cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:44.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.295+0000 7fc170854640 1 --2- 172.21.15.1:0/2920497844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d174b724a0 0x55d174b7cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.295+0000 7fc170854640 1 -- 172.21.15.1:0/2920497844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d174b7d680 msgr2=0x55d174b7a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:44.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.295+0000 7fc170854640 1 --2- 172.21.15.1:0/2920497844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d174b7d680 0x55d174b7a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.295+0000 7fc170854640 1 -- 172.21.15.1:0/2920497844 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1748493c0 con 0x55d174b72dc0 2024-09-19T09:38:44.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.295+0000 7fc175692740 1 -- 172.21.15.1:0/2920497844 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1680043c0 con 0x55d174b72dc0 2024-09-19T09:38:44.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.295+0000 7fc170854640 1 --2- 172.21.15.1:0/2920497844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d174b72dc0 0x55d174b7a210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x55d174b6fdb0 tx=0x7fc15c099d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df972217f82598c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:44.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.295+0000 7fc154ff9640 10 client.24995 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:38:44.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.295+0000 7fc154ff9640 1 -- 172.21.15.1:0/2920497844 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c014070 con 0x55d174b72dc0 2024-09-19T09:38:44.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.295+0000 7fc154ff9640 1 -- 172.21.15.1:0/2920497844 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fc15c084b50 con 0x55d174b72dc0 2024-09-19T09:38:44.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.295+0000 7fc154ff9640 1 -- 172.21.15.1:0/2920497844 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc15c09b340 con 0x55d174b72dc0 2024-09-19T09:38:44.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.295+0000 7fc175692740 10 client.24995 fetch_fsmap learned FSMap version 19 2024-09-19T09:38:44.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.295+0000 7fc175692740 1 -- 172.21.15.1:0/2920497844 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55d174b8bb40 con 0x55d174b72dc0 2024-09-19T09:38:44.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.296+0000 7fc154ff9640 1 -- 172.21.15.1:0/2920497844 <== mon.2 v2:172.21.15.22:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fc15c09cb30 con 0x55d174b72dc0 2024-09-19T09:38:44.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.296+0000 7fc175692740 10 client.24995 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:38:44.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.296+0000 7fc175692740 10 client.24995 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:38:44.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.296+0000 7fc175692740 20 client.24995 populate_metadata read hostname 'smithi001' 2024-09-19T09:38:44.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.296+0000 7fc175692740 1 --2- 172.21.15.1:0/2920497844 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d174b8cef0 0x55d174b8f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:44.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.296+0000 7fc175692740 4 client.24995 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:38:44.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.296+0000 7fc175692740 1 -- 172.21.15.1:0/2920497844 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d174ae5850 con 0x55d174b8cef0 2024-09-19T09:38:44.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.296+0000 7fc171055640 1 --2- 172.21.15.1:0/2920497844 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d174b8cef0 0x55d174b8f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:44.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.297+0000 7fc171055640 1 --2- 172.21.15.1:0/2920497844 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d174b8cef0 0x55d174b8f340 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6428f8c6eb272bdc server_cookie=83a6b0f55abed867 in_seq=0 out_seq=0 2024-09-19T09:38:44.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.297+0000 7fc154ff9640 10 client.24995 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:44.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.297+0000 7fc154ff9640 1 -- 172.21.15.1:0/2920497844 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d174ae5850 con 0x55d174b8cef0 2024-09-19T09:38:44.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.297+0000 7fc154ff9640 10 client.24995 handle_command_reply: tid=0 2024-09-19T09:38:44.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.297+0000 7fc175692740 1 client.24995 shutdown 2024-09-19T09:38:44.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.297+0000 7fc175692740 1 -- 172.21.15.1:0/2920497844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d174b72dc0 msgr2=0x55d174b7a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:44.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.297+0000 7fc175692740 1 --2- 172.21.15.1:0/2920497844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d174b72dc0 0x55d174b7a210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x55d174b6fdb0 tx=0x7fc15c099d10 comp rx=0 tx=0).stop 2024-09-19T09:38:44.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.298+0000 7fc175692740 1 -- 172.21.15.1:0/2920497844 shutdown_connections 2024-09-19T09:38:44.303 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.298+0000 7fc175692740 1 --2- 172.21.15.1:0/2920497844 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d174b8cef0 0x55d174b8f340 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.298+0000 7fc175692740 1 --2- 172.21.15.1:0/2920497844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d174b7d680 0x55d174b7a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.298+0000 7fc175692740 1 --2- 172.21.15.1:0/2920497844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d174b72dc0 0x55d174b7a210 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.298+0000 7fc175692740 1 --2- 172.21.15.1:0/2920497844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d174b724a0 0x55d174b7cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.298+0000 7fc175692740 1 -- 172.21.15.1:0/2920497844 >> 172.21.15.1:0/2920497844 conn(0x55d174b6ea30 msgr2=0x55d174b74760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:44.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.298+0000 7fc154ff9640 0 client.24995 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:44.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.298+0000 7fc175692740 1 -- 172.21.15.1:0/2920497844 shutdown_connections 2024-09-19T09:38:44.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.298+0000 7fc175692740 1 -- 172.21.15.1:0/2920497844 wait complete. 2024-09-19T09:38:44.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.298+0000 7fc175692740 20 client.24995 trim_cache size 0 max 16384 2024-09-19T09:38:44.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.317+0000 7fc175692740 1 Processor -- start 2024-09-19T09:38:44.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.317+0000 7fc175692740 1 -- start start 2024-09-19T09:38:44.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.317+0000 7fc175692740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d174b724a0 0x55d174b7c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:44.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.317+0000 7fc175692740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d174b72dc0 0x55d174b94c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:44.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.317+0000 7fc175692740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d174b7d680 0x55d174b95150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:44.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.317+0000 7fc175692740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c1ad7b0 con 0x55d174b7d680 2024-09-19T09:38:44.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.317+0000 7fc175692740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c1b0050 con 0x55d174b724a0 2024-09-19T09:38:44.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.317+0000 7fc175692740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c1ade40 con 0x55d174b72dc0 2024-09-19T09:38:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.317+0000 7fc171856640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d174b7d680 0x55d174b95150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.317+0000 7fc170854640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d174b72dc0 0x55d174b94c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.317+0000 7fc170854640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d174b72dc0 0x55d174b94c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:39516/0 (socket says 172.21.15.1:39516) 2024-09-19T09:38:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.317+0000 7fc171055640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d174b724a0 0x55d174b7c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.317+0000 7fc170854640 1 -- 172.21.15.1:0/2402398383 learned_addr learned my addr 172.21.15.1:0/2402398383 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.317+0000 7fc171856640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d174b7d680 0x55d174b95150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56946/0 (socket says 172.21.15.1:56946) 2024-09-19T09:38:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.318+0000 7fc170854640 1 -- 172.21.15.1:0/2402398383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d174b724a0 msgr2=0x55d174b7c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.318+0000 7fc170854640 1 --2- 172.21.15.1:0/2402398383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d174b724a0 0x55d174b7c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.318+0000 7fc170854640 1 -- 172.21.15.1:0/2402398383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d174b7d680 msgr2=0x55d174b95150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.318+0000 7fc170854640 1 --2- 172.21.15.1:0/2402398383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d174b7d680 0x55d174b95150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.318+0000 7fc170854640 1 -- 172.21.15.1:0/2402398383 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d174b7d2d0 con 0x55d174b72dc0 2024-09-19T09:38:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.318+0000 7fc171856640 1 --2- 172.21.15.1:0/2402398383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d174b7d680 0x55d174b95150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:38:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.318+0000 7fc170854640 1 --2- 172.21.15.1:0/2402398383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d174b72dc0 0x55d174b94c10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc15c09b790 tx=0x7fc15c0d1000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac2615e9403cd81 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:44.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.318+0000 7fc156ffd640 1 -- 172.21.15.1:0/2402398383 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c014070 con 0x55d174b72dc0 2024-09-19T09:38:44.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.318+0000 7fc156ffd640 1 -- 172.21.15.1:0/2402398383 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1680043c0 con 0x55d174b72dc0 2024-09-19T09:38:44.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.318+0000 7fc156ffd640 1 -- 172.21.15.1:0/2402398383 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c09b160 con 0x55d174b72dc0 2024-09-19T09:38:44.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.319+0000 7fc175692740 1 -- 172.21.15.1:0/2402398383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d174b72dc0 msgr2=0x55d174b94c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:44.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.319+0000 7fc175692740 1 --2- 172.21.15.1:0/2402398383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d174b72dc0 0x55d174b94c10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc15c09b790 tx=0x7fc15c0d1000 comp rx=0 tx=0).stop 2024-09-19T09:38:44.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.319+0000 7fc175692740 1 -- 172.21.15.1:0/2402398383 shutdown_connections 2024-09-19T09:38:44.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.319+0000 7fc175692740 1 --2- 172.21.15.1:0/2402398383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d174b7d680 0x55d174b95150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.319+0000 7fc175692740 1 --2- 172.21.15.1:0/2402398383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d174b72dc0 0x55d174b94c10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.319+0000 7fc175692740 1 --2- 172.21.15.1:0/2402398383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d174b724a0 0x55d174b7c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.319+0000 7fc175692740 1 -- 172.21.15.1:0/2402398383 >> 172.21.15.1:0/2402398383 conn(0x55d174b6ea30 msgr2=0x55d174b7ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:44.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.319+0000 7fc175692740 1 -- 172.21.15.1:0/2402398383 shutdown_connections 2024-09-19T09:38:44.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.319+0000 7fc175692740 1 -- 172.21.15.1:0/2402398383 wait complete. 2024-09-19T09:38:44.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.319+0000 7fc175692740 1 -- start start 2024-09-19T09:38:44.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.319+0000 7fc175692740 1 Processor -- start 2024-09-19T09:38:44.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.320+0000 7fc175692740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d174b724a0 0x55d174b85bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:44.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.320+0000 7fc175692740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d174b72dc0 0x55d174b82f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:44.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.320+0000 7fc175692740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d174b7d680 0x55d174b83440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:44.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.320+0000 7fc175692740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c1ae510 con 0x55d174b72dc0 2024-09-19T09:38:44.326 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.320+0000 7fc175692740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c1af980 con 0x55d174b724a0 2024-09-19T09:38:44.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.320+0000 7fc175692740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc16c1aebe0 con 0x55d174b7d680 2024-09-19T09:38:44.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.320+0000 7fc175692740 10 client.0 _ll_register_callbacks cb 0x7fc15c0973e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:44.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.320+0000 7fc170854640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d174b72dc0 0x55d174b82f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:44.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.320+0000 7fc170854640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d174b72dc0 0x55d174b82f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:56962/0 (socket says 172.21.15.1:56962) 2024-09-19T09:38:44.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.320+0000 7fc170854640 1 -- 172.21.15.1:0/4162477396 learned_addr learned my addr 172.21.15.1:0/4162477396 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:44.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.320+0000 7fc171856640 1 --2- 172.21.15.1:0/4162477396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d174b7d680 0x55d174b83440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:44.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.320+0000 7fc171055640 1 --2- 172.21.15.1:0/4162477396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d174b724a0 0x55d174b85bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:44.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.320+0000 7fc170854640 1 -- 172.21.15.1:0/4162477396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d174b7d680 msgr2=0x55d174b83440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:44.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.320+0000 7fc170854640 1 --2- 172.21.15.1:0/4162477396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d174b7d680 0x55d174b83440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.320+0000 7fc170854640 1 -- 172.21.15.1:0/4162477396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d174b724a0 msgr2=0x55d174b85bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:44.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.320+0000 7fc170854640 1 --2- 172.21.15.1:0/4162477396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d174b724a0 0x55d174b85bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.320+0000 7fc170854640 1 -- 172.21.15.1:0/4162477396 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d174b83a80 con 0x55d174b72dc0 2024-09-19T09:38:44.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.321+0000 7fc170854640 1 --2- 172.21.15.1:0/4162477396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d174b72dc0 0x55d174b82f00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc15c0045f0 tx=0x7fc15c086110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5c110219529896 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:44.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.321+0000 7fc154ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:38:44.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.321+0000 7fc154ff9640 1 -- 172.21.15.1:0/4162477396 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c014050 con 0x55d174b72dc0 2024-09-19T09:38:44.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.321+0000 7fc175692740 1 -- 172.21.15.1:0/4162477396 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1680043c0 con 0x55d174b72dc0 2024-09-19T09:38:44.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.321+0000 7fc154ff9640 1 -- 172.21.15.1:0/4162477396 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fc15c084d50 con 0x55d174b72dc0 2024-09-19T09:38:44.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.321+0000 7fc154ff9640 1 -- 172.21.15.1:0/4162477396 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc15c09b160 con 0x55d174b72dc0 2024-09-19T09:38:44.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.321+0000 7fc175692740 10 client.15282 fetch_fsmap learned FSMap version 19 2024-09-19T09:38:44.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.321+0000 7fc175692740 1 -- 172.21.15.1:0/4162477396 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d174b83a80 con 0x55d174b72dc0 2024-09-19T09:38:44.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.321+0000 7fc154ff9640 1 -- 172.21.15.1:0/4162477396 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc15c0a4470 con 0x55d174b72dc0 2024-09-19T09:38:44.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.322+0000 7fc154ff9640 1 -- 172.21.15.1:0/4162477396 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fc15c09ade0 con 0x55d174b72dc0 2024-09-19T09:38:44.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.322+0000 7fc175692740 10 client.15282 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:38:44.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.322+0000 7fc175692740 10 client.15282 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:38:44.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.322+0000 7fc175692740 20 client.15282 populate_metadata read hostname 'smithi001' 2024-09-19T09:38:44.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.322+0000 7fc175692740 1 --2- 172.21.15.1:0/4162477396 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d174c004b0 0x55d174c028a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:44.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.322+0000 7fc175692740 4 client.15282 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:38:44.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.322+0000 7fc175692740 1 -- 172.21.15.1:0/4162477396 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fc1680043c0 con 0x55d174c004b0 2024-09-19T09:38:44.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.323+0000 7fc171055640 1 --2- 172.21.15.1:0/4162477396 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d174c004b0 0x55d174c028a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:44.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.324+0000 7fc154ff9640 10 client.15282 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:44.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.324+0000 7fc171055640 1 --2- 172.21.15.1:0/4162477396 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d174c004b0 0x55d174c028a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a81da8d7c61ef05 server_cookie=6adbb2404fb9fc5a in_seq=0 out_seq=0 2024-09-19T09:38:44.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.324+0000 7fc154ff9640 1 -- 172.21.15.1:0/4162477396 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7fc1680043c0 con 0x55d174c004b0 2024-09-19T09:38:44.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.324+0000 7fc154ff9640 10 client.15282 handle_command_reply: tid=0 2024-09-19T09:38:44.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.324+0000 7fc175692740 1 client.15282 shutdown 2024-09-19T09:38:44.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.324+0000 7fc175692740 1 -- 172.21.15.1:0/4162477396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d174b72dc0 msgr2=0x55d174b82f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:44.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.324+0000 7fc175692740 1 --2- 172.21.15.1:0/4162477396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d174b72dc0 0x55d174b82f00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc15c0045f0 tx=0x7fc15c086110 comp rx=0 tx=0).stop 2024-09-19T09:38:44.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.324+0000 7fc175692740 1 -- 172.21.15.1:0/4162477396 shutdown_connections 2024-09-19T09:38:44.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.324+0000 7fc175692740 1 --2- 172.21.15.1:0/4162477396 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d174c004b0 0x55d174c028a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.324+0000 7fc175692740 1 --2- 172.21.15.1:0/4162477396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d174b7d680 0x55d174b83440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.324+0000 7fc175692740 1 --2- 172.21.15.1:0/4162477396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d174b72dc0 0x55d174b82f00 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.324+0000 7fc154ff9640 0 client.15282 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:44.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.324+0000 7fc175692740 1 --2- 172.21.15.1:0/4162477396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d174b724a0 0x55d174b85bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.324+0000 7fc175692740 1 -- 172.21.15.1:0/4162477396 >> 172.21.15.1:0/4162477396 conn(0x55d174b6ea30 msgr2=0x55d174b7c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:44.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.324+0000 7fc175692740 1 -- 172.21.15.1:0/4162477396 shutdown_connections 2024-09-19T09:38:44.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.324+0000 7fc175692740 1 -- 172.21.15.1:0/4162477396 wait complete. 2024-09-19T09:38:44.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.324+0000 7fc175692740 20 client.15282 trim_cache size 0 max 16384 2024-09-19T09:38:44.331 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:38:44.332 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "no active scrubs running", 2024-09-19T09:38:44.332 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": {} 2024-09-19T09:38:44.332 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:38:44.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.325+0000 7fc1732b9640 1 -- 172.21.15.1:0/919893051 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc1580a3240 msgr2=0x7fc1580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:44.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.325+0000 7fc1732b9640 1 --2- 172.21.15.1:0/919893051 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc1580a3240 0x7fc1580a5700 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc164009430 tx=0x7fc164005c50 comp rx=0 tx=0).stop 2024-09-19T09:38:44.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.325+0000 7fc1732b9640 1 -- 172.21.15.1:0/919893051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc16c102570 msgr2=0x7fc16c0fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:44.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.325+0000 7fc1732b9640 1 --2- 172.21.15.1:0/919893051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc16c102570 0x7fc16c0fd1c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc15c00d950 tx=0x7fc15c00de10 comp rx=0 tx=0).stop 2024-09-19T09:38:44.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.325+0000 7fc1732b9640 1 -- 172.21.15.1:0/919893051 shutdown_connections 2024-09-19T09:38:44.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.325+0000 7fc1732b9640 1 --2- 172.21.15.1:0/919893051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc16c102ef0 0x7fc16c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.325+0000 7fc1732b9640 1 --2- 172.21.15.1:0/919893051 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc16c102570 0x7fc16c0fd1c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.325+0000 7fc1732b9640 1 --2- 172.21.15.1:0/919893051 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc1580a3240 0x7fc1580a5700 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.325+0000 7fc1732b9640 1 --2- 172.21.15.1:0/919893051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc16c100e20 0x7fc16c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:44.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.325+0000 7fc1732b9640 1 -- 172.21.15.1:0/919893051 >> 172.21.15.1:0/919893051 conn(0x7fc16c0fc7d0 msgr2=0x7fc16c06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:44.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.325+0000 7fc1732b9640 1 -- 172.21.15.1:0/919893051 shutdown_connections 2024-09-19T09:38:44.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:44.325+0000 7fc1732b9640 1 -- 172.21.15.1:0/919893051 wait complete. 2024-09-19T09:38:44.334 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:44.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:44 smithi022 ceph-mon[35583]: pgmap v357: 97 pgs: 97 active+clean; 652 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 938 B/s wr, 4 op/s 2024-09-19T09:38:44.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:44 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/3058844285' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:44.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:44 smithi121 ceph-mon[35577]: pgmap v357: 97 pgs: 97 active+clean; 652 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 938 B/s wr, 4 op/s 2024-09-19T09:38:44.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:44 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/3058844285' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:45.093 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:38:45.093 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:38:45.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.559+0000 7fa6eebc7640 1 -- 172.21.15.1:0/2487407325 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6e8100e20 msgr2=0x7fa6e8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:45.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.559+0000 7fa6eebc7640 1 --2- 172.21.15.1:0/2487407325 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6e8100e20 0x7fa6e8101200 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8009ca0 tx=0x7fa6d802a950 comp rx=0 tx=0).stop 2024-09-19T09:38:45.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.559+0000 7fa6eebc7640 1 -- 172.21.15.1:0/2487407325 shutdown_connections 2024-09-19T09:38:45.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.559+0000 7fa6eebc7640 1 --2- 172.21.15.1:0/2487407325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6e8102ef0 0x7fa6e810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.559+0000 7fa6eebc7640 1 --2- 172.21.15.1:0/2487407325 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6e8102570 0x7fa6e81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.559+0000 7fa6eebc7640 1 --2- 172.21.15.1:0/2487407325 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6e8100e20 0x7fa6e8101200 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.559+0000 7fa6eebc7640 1 -- 172.21.15.1:0/2487407325 >> 172.21.15.1:0/2487407325 conn(0x7fa6e80fc7d0 msgr2=0x7fa6e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:45.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.559+0000 7fa6eebc7640 1 -- 172.21.15.1:0/2487407325 shutdown_connections 2024-09-19T09:38:45.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.559+0000 7fa6eebc7640 1 -- 172.21.15.1:0/2487407325 wait complete. 2024-09-19T09:38:45.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.560+0000 7fa6eebc7640 1 Processor -- start 2024-09-19T09:38:45.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.560+0000 7fa6eebc7640 1 -- start start 2024-09-19T09:38:45.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.560+0000 7fa6eebc7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6e8100e20 0x7fa6e81962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:45.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.560+0000 7fa6eebc7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6e8102570 0x7fa6e8196820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:45.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.560+0000 7fa6eebc7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6e8102ef0 0x7fa6e819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:45.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.561+0000 7fa6eebc7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e810fe80 con 0x7fa6e8100e20 2024-09-19T09:38:45.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.561+0000 7fa6ec963640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6e8100e20 0x7fa6e81962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:45.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.561+0000 7fa6ec963640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6e8100e20 0x7fa6e81962e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49844/0 (socket says 172.21.15.1:49844) 2024-09-19T09:38:45.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.561+0000 7fa6ec963640 1 -- 172.21.15.1:0/3657763360 learned_addr learned my addr 172.21.15.1:0/3657763360 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:45.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.561+0000 7fa6eebc7640 1 -- 172.21.15.1:0/3657763360 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e810fd00 con 0x7fa6e8102570 2024-09-19T09:38:45.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.561+0000 7fa6eebc7640 1 -- 172.21.15.1:0/3657763360 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e8110000 con 0x7fa6e8102ef0 2024-09-19T09:38:45.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.561+0000 7fa6ed164640 1 --2- 172.21.15.1:0/3657763360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6e8102ef0 0x7fa6e819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:45.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.561+0000 7fa6e7fff640 1 --2- 172.21.15.1:0/3657763360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6e8102570 0x7fa6e8196820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:45.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.561+0000 7fa6ec963640 1 -- 172.21.15.1:0/3657763360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6e8102ef0 msgr2=0x7fa6e819abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:45.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.561+0000 7fa6ec963640 1 --2- 172.21.15.1:0/3657763360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6e8102ef0 0x7fa6e819abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.561+0000 7fa6ec963640 1 -- 172.21.15.1:0/3657763360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6e8102570 msgr2=0x7fa6e8196820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:45.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.561+0000 7fa6ec963640 1 --2- 172.21.15.1:0/3657763360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6e8102570 0x7fa6e8196820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.561+0000 7fa6ec963640 1 -- 172.21.15.1:0/3657763360 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6e819b290 con 0x7fa6e8100e20 2024-09-19T09:38:45.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.562+0000 7fa6ec963640 1 --2- 172.21.15.1:0/3657763360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6e8100e20 0x7fa6e81962e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8005e30 tx=0x7fa6d8003cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:45.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.562+0000 7fa6e5ffb640 1 -- 172.21.15.1:0/3657763360 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d8034040 con 0x7fa6e8100e20 2024-09-19T09:38:45.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.562+0000 7fa6eebc7640 1 -- 172.21.15.1:0/3657763360 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6e819b520 con 0x7fa6e8100e20 2024-09-19T09:38:45.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.562+0000 7fa6e5ffb640 1 -- 172.21.15.1:0/3657763360 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6d802fe10 con 0x7fa6e8100e20 2024-09-19T09:38:45.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.562+0000 7fa6e5ffb640 1 -- 172.21.15.1:0/3657763360 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d80047f0 con 0x7fa6e8100e20 2024-09-19T09:38:45.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.562+0000 7fa6eebc7640 1 -- 172.21.15.1:0/3657763360 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6e81a2e60 con 0x7fa6e8100e20 2024-09-19T09:38:45.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.565+0000 7fa6e5ffb640 1 -- 172.21.15.1:0/3657763360 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fa6d8037020 con 0x7fa6e8100e20 2024-09-19T09:38:45.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.565+0000 7fa6f0fa0740 1 Processor -- start 2024-09-19T09:38:45.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.566+0000 7fa6f0fa0740 1 -- start start 2024-09-19T09:38:45.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.566+0000 7fa6f0fa0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5628e1268760 0x5628e1268b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:45.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.566+0000 7fa6f0fa0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628e1269080 0x5628e1273400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:45.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.566+0000 7fa6f0fa0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5628e1273940 0x5628e1275d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:45.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.566+0000 7fa6f0fa0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5628e11ce2a0 con 0x5628e1273940 2024-09-19T09:38:45.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.566+0000 7fa6f0fa0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5628e1175b10 con 0x5628e1269080 2024-09-19T09:38:45.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.566+0000 7fa6f0fa0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5628e11ca260 con 0x5628e1268760 2024-09-19T09:38:45.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.566+0000 7fa6e7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5628e1273940 0x5628e1275d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:45.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.566+0000 7fa6ed164640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5628e1268760 0x5628e1268b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:45.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.566+0000 7fa6ed164640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5628e1268760 0x5628e1268b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:36422/0 (socket says 172.21.15.1:36422) 2024-09-19T09:38:45.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.566+0000 7fa6ed164640 1 -- 172.21.15.1:0/3095173126 learned_addr learned my addr 172.21.15.1:0/3095173126 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:45.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.566+0000 7fa6ec963640 1 --2- 172.21.15.1:0/3095173126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628e1269080 0x5628e1273400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:45.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.566+0000 7fa6e5ffb640 1 --2- 172.21.15.1:0/3657763360 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fa6d40a32c0 0x7fa6d40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:45.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.567+0000 7fa6ed164640 1 -- 172.21.15.1:0/3095173126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628e1269080 msgr2=0x5628e1273400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:45.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.567+0000 7fa6ed164640 1 --2- 172.21.15.1:0/3095173126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628e1269080 0x5628e1273400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.567+0000 7fa6ed164640 1 -- 172.21.15.1:0/3095173126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5628e1273940 msgr2=0x5628e1275d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:45.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.567+0000 7fa6ed164640 1 --2- 172.21.15.1:0/3095173126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5628e1273940 0x5628e1275d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.567+0000 7fa6ed164640 1 -- 172.21.15.1:0/3095173126 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628e0f3fb90 con 0x5628e1268760 2024-09-19T09:38:45.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.567+0000 7fa6ed164640 1 --2- 172.21.15.1:0/3657763360 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fa6d40a32c0 0x7fa6d40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:45.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.567+0000 7fa6e5ffb640 1 -- 172.21.15.1:0/3657763360 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fa6d80f07a0 con 0x7fa6e8100e20 2024-09-19T09:38:45.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.567+0000 7fa6ed164640 1 --2- 172.21.15.1:0/3095173126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5628e1268760 0x5628e1268b40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa6e000e4e0 tx=0x7fa6e000fc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e621b43dc520b40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:45.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.567+0000 7fa6deffd640 1 -- 172.21.15.1:0/3095173126 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e000f4d0 con 0x5628e1268760 2024-09-19T09:38:45.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.567+0000 7fa6deffd640 1 -- 172.21.15.1:0/3095173126 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6e000fdf0 con 0x5628e1268760 2024-09-19T09:38:45.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.567+0000 7fa6deffd640 1 -- 172.21.15.1:0/3095173126 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e001b950 con 0x5628e1268760 2024-09-19T09:38:45.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.567+0000 7fa6ed164640 1 --2- 172.21.15.1:0/3657763360 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fa6d40a32c0 0x7fa6d40a5780 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa6e0023000 tx=0x7fa6e0024000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:45.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.568+0000 7fa6f0fa0740 1 -- 172.21.15.1:0/3095173126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5628e1268760 msgr2=0x5628e1268b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:45.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.568+0000 7fa6f0fa0740 1 --2- 172.21.15.1:0/3095173126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5628e1268760 0x5628e1268b40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa6e000e4e0 tx=0x7fa6e000fc00 comp rx=0 tx=0).stop 2024-09-19T09:38:45.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.568+0000 7fa6f0fa0740 1 -- 172.21.15.1:0/3095173126 shutdown_connections 2024-09-19T09:38:45.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.568+0000 7fa6f0fa0740 1 --2- 172.21.15.1:0/3095173126 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5628e1273940 0x5628e1275d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.568+0000 7fa6f0fa0740 1 --2- 172.21.15.1:0/3095173126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628e1269080 0x5628e1273400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.568+0000 7fa6f0fa0740 1 --2- 172.21.15.1:0/3095173126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5628e1268760 0x5628e1268b40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.568+0000 7fa6f0fa0740 1 -- 172.21.15.1:0/3095173126 >> 172.21.15.1:0/3095173126 conn(0x5628e1264cf0 msgr2=0x5628e12650d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:45.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.568+0000 7fa6f0fa0740 1 -- 172.21.15.1:0/3095173126 shutdown_connections 2024-09-19T09:38:45.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.568+0000 7fa6f0fa0740 1 -- 172.21.15.1:0/3095173126 wait complete. 2024-09-19T09:38:45.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.569+0000 7fa6f0fa0740 1 -- start start 2024-09-19T09:38:45.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.569+0000 7fa6f0fa0740 1 Processor -- start 2024-09-19T09:38:45.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.569+0000 7fa6f0fa0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628e1268760 0x5628e1270850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:45.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.569+0000 7fa6f0fa0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5628e1269080 0x5628e1270d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:45.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.569+0000 7fa6f0fa0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5628e1273940 0x5628e12712d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:45.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.569+0000 7fa6f0fa0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5628e1276510 con 0x5628e1269080 2024-09-19T09:38:45.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.569+0000 7fa6f0fa0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5628e11566e0 con 0x5628e1268760 2024-09-19T09:38:45.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.569+0000 7fa6f0fa0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5628e1276690 con 0x5628e1273940 2024-09-19T09:38:45.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.569+0000 7fa6f0fa0740 10 client.0 _ll_register_callbacks cb 0x5628e117aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:45.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.570+0000 7fa6e7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5628e1269080 0x5628e1270d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:45.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.570+0000 7fa6e7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5628e1269080 0x5628e1270d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49852/0 (socket says 172.21.15.1:49852) 2024-09-19T09:38:45.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.570+0000 7fa6e7fff640 1 -- 172.21.15.1:0/1689121184 learned_addr learned my addr 172.21.15.1:0/1689121184 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:45.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.570+0000 7fa6ec963640 1 --2- 172.21.15.1:0/1689121184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628e1268760 0x5628e1270850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:45.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.570+0000 7fa6ed164640 1 --2- 172.21.15.1:0/1689121184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5628e1273940 0x5628e12712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:45.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.570+0000 7fa6e7fff640 1 -- 172.21.15.1:0/1689121184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5628e1273940 msgr2=0x5628e12712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:45.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.570+0000 7fa6e7fff640 1 --2- 172.21.15.1:0/1689121184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5628e1273940 0x5628e12712d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.570+0000 7fa6e7fff640 1 -- 172.21.15.1:0/1689121184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628e1268760 msgr2=0x5628e1270850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:45.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.570+0000 7fa6e7fff640 1 --2- 172.21.15.1:0/1689121184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628e1268760 0x5628e1270850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.570+0000 7fa6e7fff640 1 -- 172.21.15.1:0/1689121184 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628e127fa30 con 0x5628e1269080 2024-09-19T09:38:45.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.570+0000 7fa6ec963640 1 --2- 172.21.15.1:0/1689121184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628e1268760 0x5628e1270850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:45.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.570+0000 7fa6e7fff640 1 --2- 172.21.15.1:0/1689121184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5628e1269080 0x5628e1270d90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000a870 tx=0x7fa6d000ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=753f0ab4a6b5362f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:45.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.570+0000 7fa6c7fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:38:45.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.570+0000 7fa6c7fff640 1 -- 172.21.15.1:0/1689121184 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0004220 con 0x5628e1269080 2024-09-19T09:38:45.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.571+0000 7fa6c7fff640 1 -- 172.21.15.1:0/1689121184 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fa6d00043c0 con 0x5628e1269080 2024-09-19T09:38:45.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.571+0000 7fa6f0fa0740 1 -- 172.21.15.1:0/1689121184 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6e000fdf0 con 0x5628e1269080 2024-09-19T09:38:45.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.571+0000 7fa6c7fff640 1 -- 172.21.15.1:0/1689121184 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa6d0026050 con 0x5628e1269080 2024-09-19T09:38:45.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.571+0000 7fa6f0fa0740 10 client.15294 fetch_fsmap learned FSMap version 19 2024-09-19T09:38:45.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.571+0000 7fa6f0fa0740 1 -- 172.21.15.1:0/1689121184 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5628e1282420 con 0x5628e1269080 2024-09-19T09:38:45.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.571+0000 7fa6c7fff640 1 -- 172.21.15.1:0/1689121184 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6d0013e80 con 0x5628e1269080 2024-09-19T09:38:45.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.571+0000 7fa6c7fff640 1 -- 172.21.15.1:0/1689121184 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fa6d00047a0 con 0x5628e1269080 2024-09-19T09:38:45.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.571+0000 7fa6f0fa0740 10 client.15294 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:38:45.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.571+0000 7fa6f0fa0740 10 client.15294 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:38:45.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.571+0000 7fa6f0fa0740 20 client.15294 populate_metadata read hostname 'smithi001' 2024-09-19T09:38:45.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.571+0000 7fa6f0fa0740 1 --2- 172.21.15.1:0/1689121184 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5628e1283830 0x5628e1285cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:45.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.571+0000 7fa6f0fa0740 4 client.15294 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:38:45.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.571+0000 7fa6f0fa0740 1 -- 172.21.15.1:0/1689121184 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa6e000fdf0 con 0x5628e1283830 2024-09-19T09:38:45.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.572+0000 7fa6ec963640 1 --2- 172.21.15.1:0/1689121184 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5628e1283830 0x5628e1285cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:45.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.572+0000 7fa6ec963640 1 --2- 172.21.15.1:0/1689121184 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5628e1283830 0x5628e1285cb0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=654cdc941d192eef server_cookie=5e46647345c18b30 in_seq=0 out_seq=0 2024-09-19T09:38:45.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.572+0000 7fa6c7fff640 10 client.15294 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:45.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.573+0000 7fa6c7fff640 1 -- 172.21.15.1:0/1689121184 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fa6e000fdf0 con 0x5628e1283830 2024-09-19T09:38:45.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.573+0000 7fa6c7fff640 10 client.15294 handle_command_reply: tid=0 2024-09-19T09:38:45.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.573+0000 7fa6f0fa0740 1 client.15294 shutdown 2024-09-19T09:38:45.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.573+0000 7fa6f0fa0740 1 -- 172.21.15.1:0/1689121184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5628e1269080 msgr2=0x5628e1270d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:45.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.573+0000 7fa6f0fa0740 1 --2- 172.21.15.1:0/1689121184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5628e1269080 0x5628e1270d90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000a870 tx=0x7fa6d000ad30 comp rx=0 tx=0).stop 2024-09-19T09:38:45.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.573+0000 7fa6f0fa0740 1 -- 172.21.15.1:0/1689121184 shutdown_connections 2024-09-19T09:38:45.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.573+0000 7fa6f0fa0740 1 --2- 172.21.15.1:0/1689121184 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5628e1283830 0x5628e1285cb0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.573+0000 7fa6c7fff640 0 client.15294 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:45.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.573+0000 7fa6f0fa0740 1 --2- 172.21.15.1:0/1689121184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5628e1273940 0x5628e12712d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.573+0000 7fa6f0fa0740 1 --2- 172.21.15.1:0/1689121184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5628e1269080 0x5628e1270d90 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.573+0000 7fa6f0fa0740 1 --2- 172.21.15.1:0/1689121184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628e1268760 0x5628e1270850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.573+0000 7fa6f0fa0740 1 -- 172.21.15.1:0/1689121184 >> 172.21.15.1:0/1689121184 conn(0x5628e1264cf0 msgr2=0x5628e1263e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:45.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.573+0000 7fa6f0fa0740 1 -- 172.21.15.1:0/1689121184 shutdown_connections 2024-09-19T09:38:45.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.574+0000 7fa6f0fa0740 1 -- 172.21.15.1:0/1689121184 wait complete. 2024-09-19T09:38:45.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.574+0000 7fa6f0fa0740 20 client.15294 trim_cache size 0 max 16384 2024-09-19T09:38:45.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.592+0000 7fa6f0fa0740 1 Processor -- start 2024-09-19T09:38:45.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.592+0000 7fa6f0fa0740 1 -- start start 2024-09-19T09:38:45.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.592+0000 7fa6f0fa0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5628e1268760 0x5628e1272720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:45.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.592+0000 7fa6f0fa0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5628e1269080 0x5628e126f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:45.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.592+0000 7fa6f0fa0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628e1273940 0x5628e126b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:45.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.592+0000 7fa6f0fa0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e81a92e0 con 0x5628e1269080 2024-09-19T09:38:45.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.593+0000 7fa6f0fa0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e81abb80 con 0x5628e1273940 2024-09-19T09:38:45.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.593+0000 7fa6f0fa0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e81a9970 con 0x5628e1268760 2024-09-19T09:38:45.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.593+0000 7fa6e7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5628e1269080 0x5628e126f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:45.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.593+0000 7fa6e7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5628e1269080 0x5628e126f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49854/0 (socket says 172.21.15.1:49854) 2024-09-19T09:38:45.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.593+0000 7fa6e7fff640 1 -- 172.21.15.1:0/1995321703 learned_addr learned my addr 172.21.15.1:0/1995321703 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:45.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.593+0000 7fa6ed164640 1 --2- 172.21.15.1:0/1995321703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628e1273940 0x5628e126b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:45.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.593+0000 7fa6ec963640 1 --2- 172.21.15.1:0/1995321703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5628e1268760 0x5628e1272720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:45.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.593+0000 7fa6e7fff640 1 -- 172.21.15.1:0/1995321703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5628e1268760 msgr2=0x5628e1272720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:45.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.593+0000 7fa6e7fff640 1 --2- 172.21.15.1:0/1995321703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5628e1268760 0x5628e1272720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.593+0000 7fa6e7fff640 1 -- 172.21.15.1:0/1995321703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628e1273940 msgr2=0x5628e126b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:45.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.593+0000 7fa6e7fff640 1 --2- 172.21.15.1:0/1995321703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628e1273940 0x5628e126b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.593+0000 7fa6e7fff640 1 -- 172.21.15.1:0/1995321703 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628e126b700 con 0x5628e1269080 2024-09-19T09:38:45.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.593+0000 7fa6ec963640 1 --2- 172.21.15.1:0/1995321703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5628e1268760 0x5628e1272720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:45.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.593+0000 7fa6e7fff640 1 --2- 172.21.15.1:0/1995321703 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5628e1269080 0x5628e126f120 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000a840 tx=0x7fa6d000b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=265646aa3b1a15c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:45.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.594+0000 7fa6de7fc640 1 -- 172.21.15.1:0/1995321703 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0004880 con 0x5628e1269080 2024-09-19T09:38:45.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.594+0000 7fa6de7fc640 1 -- 172.21.15.1:0/1995321703 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6d00139a0 con 0x5628e1269080 2024-09-19T09:38:45.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.594+0000 7fa6de7fc640 1 -- 172.21.15.1:0/1995321703 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0003850 con 0x5628e1269080 2024-09-19T09:38:45.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.595+0000 7fa6f0fa0740 1 -- 172.21.15.1:0/1995321703 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5628e1269080 msgr2=0x5628e126f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:45.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.595+0000 7fa6f0fa0740 1 --2- 172.21.15.1:0/1995321703 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5628e1269080 0x5628e126f120 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000a840 tx=0x7fa6d000b9a0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.595+0000 7fa6f0fa0740 1 -- 172.21.15.1:0/1995321703 shutdown_connections 2024-09-19T09:38:45.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.595+0000 7fa6f0fa0740 1 --2- 172.21.15.1:0/1995321703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628e1273940 0x5628e126b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.595+0000 7fa6f0fa0740 1 --2- 172.21.15.1:0/1995321703 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5628e1269080 0x5628e126f120 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.595+0000 7fa6f0fa0740 1 --2- 172.21.15.1:0/1995321703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5628e1268760 0x5628e1272720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.595+0000 7fa6f0fa0740 1 -- 172.21.15.1:0/1995321703 >> 172.21.15.1:0/1995321703 conn(0x5628e1264cf0 msgr2=0x5628e1263e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:45.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.595+0000 7fa6f0fa0740 1 -- 172.21.15.1:0/1995321703 shutdown_connections 2024-09-19T09:38:45.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.595+0000 7fa6f0fa0740 1 -- 172.21.15.1:0/1995321703 wait complete. 2024-09-19T09:38:45.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.596+0000 7fa6f0fa0740 1 -- start start 2024-09-19T09:38:45.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.596+0000 7fa6f0fa0740 1 Processor -- start 2024-09-19T09:38:45.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.596+0000 7fa6f0fa0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5628e1268760 0x5628e1277e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:45.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.596+0000 7fa6f0fa0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628e1269080 0x5628e1278350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:45.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.597+0000 7fa6f0fa0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5628e1273940 0x5628e12ed550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:45.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.597+0000 7fa6f0fa0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e81aa040 con 0x5628e1273940 2024-09-19T09:38:45.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.597+0000 7fa6f0fa0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e81ab4b0 con 0x5628e1269080 2024-09-19T09:38:45.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.597+0000 7fa6f0fa0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa6e81aa710 con 0x5628e1268760 2024-09-19T09:38:45.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.597+0000 7fa6ed164640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5628e1273940 0x5628e12ed550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:45.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.597+0000 7fa6ec963640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5628e1268760 0x5628e1277e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:45.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.597+0000 7fa6e7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628e1269080 0x5628e1278350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:45.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.597+0000 7fa6ec963640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5628e1268760 0x5628e1277e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:36464/0 (socket says 172.21.15.1:36464) 2024-09-19T09:38:45.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.597+0000 7fa6ed164640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5628e1273940 0x5628e12ed550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49868/0 (socket says 172.21.15.1:49868) 2024-09-19T09:38:45.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.597+0000 7fa6ec963640 1 -- 172.21.15.1:0/3746125163 learned_addr learned my addr 172.21.15.1:0/3746125163 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:45.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.597+0000 7fa6f0fa0740 10 client.0 _ll_register_callbacks cb 0x7fa6d000bdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:45.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.597+0000 7fa6e7fff640 1 -- 172.21.15.1:0/3746125163 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5628e1268760 msgr2=0x5628e1277e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:45.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.597+0000 7fa6e7fff640 1 --2- 172.21.15.1:0/3746125163 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5628e1268760 0x5628e1277e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.597+0000 7fa6e7fff640 1 -- 172.21.15.1:0/3746125163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5628e1273940 msgr2=0x5628e12ed550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:45.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.597+0000 7fa6e7fff640 1 --2- 172.21.15.1:0/3746125163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5628e1273940 0x5628e12ed550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.597+0000 7fa6e7fff640 1 -- 172.21.15.1:0/3746125163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628e12eda90 con 0x5628e1269080 2024-09-19T09:38:45.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.598+0000 7fa6ec963640 1 --2- 172.21.15.1:0/3746125163 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5628e1268760 0x5628e1277e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:45.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.598+0000 7fa6e7fff640 1 --2- 172.21.15.1:0/3746125163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628e1269080 0x5628e1278350 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x5628e12141b0 tx=0x7fa6d00136c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cffbc098f2575d0e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:45.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.598+0000 7fa6c7fff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:38:45.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.598+0000 7fa6c7fff640 1 -- 172.21.15.1:0/3746125163 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0004020 con 0x5628e1269080 2024-09-19T09:38:45.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.599+0000 7fa6c7fff640 1 -- 172.21.15.1:0/3746125163 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fa6d00041c0 con 0x5628e1269080 2024-09-19T09:38:45.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.599+0000 7fa6f0fa0740 1 -- 172.21.15.1:0/3746125163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6d00139a0 con 0x5628e1269080 2024-09-19T09:38:45.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.599+0000 7fa6c7fff640 1 -- 172.21.15.1:0/3746125163 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa6d0041050 con 0x5628e1269080 2024-09-19T09:38:45.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.599+0000 7fa6f0fa0740 10 client.25019 fetch_fsmap learned FSMap version 19 2024-09-19T09:38:45.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.599+0000 7fa6f0fa0740 1 -- 172.21.15.1:0/3746125163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5628e12eecc0 con 0x5628e1269080 2024-09-19T09:38:45.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.599+0000 7fa6c7fff640 1 -- 172.21.15.1:0/3746125163 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6d00139a0 con 0x5628e1269080 2024-09-19T09:38:45.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.600+0000 7fa6c7fff640 1 -- 172.21.15.1:0/3746125163 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fa6d0004e00 con 0x5628e1269080 2024-09-19T09:38:45.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.600+0000 7fa6f0fa0740 10 client.25019 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:38:45.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.600+0000 7fa6f0fa0740 10 client.25019 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:38:45.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.600+0000 7fa6f0fa0740 20 client.25019 populate_metadata read hostname 'smithi001' 2024-09-19T09:38:45.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.600+0000 7fa6f0fa0740 1 --2- 172.21.15.1:0/3746125163 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5628e12ef3e0 0x5628e12f1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:45.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.600+0000 7fa6f0fa0740 4 client.25019 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}] 2024-09-19T09:38:45.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.600+0000 7fa6f0fa0740 1 -- 172.21.15.1:0/3746125163 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}) -- 0x5628e11db9d0 con 0x5628e12ef3e0 2024-09-19T09:38:45.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.600+0000 7fa6ec963640 1 --2- 172.21.15.1:0/3746125163 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5628e12ef3e0 0x5628e12f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:45.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.601+0000 7fa6ec963640 1 --2- 172.21.15.1:0/3746125163 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5628e12ef3e0 0x5628e12f1800 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae7c9bad33b1472d server_cookie=5c64ace13992c30e in_seq=0 out_seq=0 2024-09-19T09:38:45.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.601+0000 7fa6c7fff640 10 client.25019 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:45.605 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:45.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.608+0000 7fa6c7fff640 1 -- 172.21.15.1:0/3746125163 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5628e11db9d0 con 0x5628e12ef3e0 2024-09-19T09:38:45.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.609+0000 7fa6c7fff640 10 client.25019 handle_command_reply: tid=0 2024-09-19T09:38:45.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.609+0000 7fa6f0fa0740 1 client.25019 shutdown 2024-09-19T09:38:45.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.609+0000 7fa6f0fa0740 1 -- 172.21.15.1:0/3746125163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628e1269080 msgr2=0x5628e1278350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:45.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.609+0000 7fa6f0fa0740 1 --2- 172.21.15.1:0/3746125163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628e1269080 0x5628e1278350 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x5628e12141b0 tx=0x7fa6d00136c0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.609+0000 7fa6f0fa0740 1 -- 172.21.15.1:0/3746125163 shutdown_connections 2024-09-19T09:38:45.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.609+0000 7fa6f0fa0740 1 --2- 172.21.15.1:0/3746125163 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5628e12ef3e0 0x5628e12f1800 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.609+0000 7fa6f0fa0740 1 --2- 172.21.15.1:0/3746125163 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5628e1273940 0x5628e12ed550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.609+0000 7fa6f0fa0740 1 --2- 172.21.15.1:0/3746125163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628e1269080 0x5628e1278350 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.609+0000 7fa6f0fa0740 1 --2- 172.21.15.1:0/3746125163 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5628e1268760 0x5628e1277e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.609+0000 7fa6f0fa0740 1 -- 172.21.15.1:0/3746125163 >> 172.21.15.1:0/3746125163 conn(0x5628e1264cf0 msgr2=0x5628e1263650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:45.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.609+0000 7fa6c7fff640 0 client.25019 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:45.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.609+0000 7fa6f0fa0740 1 -- 172.21.15.1:0/3746125163 shutdown_connections 2024-09-19T09:38:45.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.609+0000 7fa6f0fa0740 1 -- 172.21.15.1:0/3746125163 wait complete. 2024-09-19T09:38:45.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.609+0000 7fa6f0fa0740 20 client.25019 trim_cache size 0 max 16384 2024-09-19T09:38:45.613 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:38:45.613 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 19, 2024-09-19T09:38:45.613 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24497, 2024-09-19T09:38:45.613 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 2, 2024-09-19T09:38:45.613 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T09:38:45.614 INFO:teuthology.orchestra.run.smithi001.stdout: "6dc2d874": { 2024-09-19T09:38:45.614 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 2, 2024-09-19T09:38:45.614 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T09:38:45.614 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:38:45.614 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T09:38:45.614 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:38:45.614 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:38:45.614 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T09:38:45.614 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 131.2, 2024-09-19T09:38:45.614 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T09:38:45.614 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T09:38:45.614 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T09:38:45.614 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:38:45.615 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T09:38:45.615 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:38:45.615 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:38:45.615 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:38:45.615 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:38:45.615 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:38:45.615 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:38:45.615 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:38:45.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.610+0000 7fa6eebc7640 1 -- 172.21.15.1:0/3657763360 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fa6d40a32c0 msgr2=0x7fa6d40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:45.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.610+0000 7fa6eebc7640 1 --2- 172.21.15.1:0/3657763360 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fa6d40a32c0 0x7fa6d40a5780 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa6e0023000 tx=0x7fa6e0024000 comp rx=0 tx=0).stop 2024-09-19T09:38:45.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.610+0000 7fa6eebc7640 1 -- 172.21.15.1:0/3657763360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6e8100e20 msgr2=0x7fa6e81962e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:45.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.610+0000 7fa6eebc7640 1 --2- 172.21.15.1:0/3657763360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6e8100e20 0x7fa6e81962e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8005e30 tx=0x7fa6d8003cf0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.610+0000 7fa6eebc7640 1 -- 172.21.15.1:0/3657763360 shutdown_connections 2024-09-19T09:38:45.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.610+0000 7fa6eebc7640 1 --2- 172.21.15.1:0/3657763360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa6e8102ef0 0x7fa6e819abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.610+0000 7fa6eebc7640 1 --2- 172.21.15.1:0/3657763360 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fa6d40a32c0 0x7fa6d40a5780 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.610+0000 7fa6eebc7640 1 --2- 172.21.15.1:0/3657763360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6e8102570 0x7fa6e8196820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.610+0000 7fa6eebc7640 1 --2- 172.21.15.1:0/3657763360 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa6e8100e20 0x7fa6e81962e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:45.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.610+0000 7fa6eebc7640 1 -- 172.21.15.1:0/3657763360 >> 172.21.15.1:0/3657763360 conn(0x7fa6e80fc7d0 msgr2=0x7fa6e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:45.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.610+0000 7fa6eebc7640 1 -- 172.21.15.1:0/3657763360 shutdown_connections 2024-09-19T09:38:45.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:45.610+0000 7fa6eebc7640 1 -- 172.21.15.1:0/3657763360 wait complete. 2024-09-19T09:38:46.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:46 smithi001 ceph-mon[31225]: pgmap v358: 97 pgs: 97 active+clean; 652 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 938 B/s wr, 3 op/s 2024-09-19T09:38:46.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:46 smithi022 ceph-mon[35583]: pgmap v358: 97 pgs: 97 active+clean; 652 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 938 B/s wr, 3 op/s 2024-09-19T09:38:46.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:46 smithi121 ceph-mon[35577]: pgmap v358: 97 pgs: 97 active+clean; 652 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 938 B/s wr, 3 op/s 2024-09-19T09:38:46.530 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6dc2d874', quiesce took 4.6 seconds. Will release after: 6.6 2024-09-19T09:38:46.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.752+0000 7fa31790c640 1 -- 172.21.15.1:0/1407934131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa310102570 msgr2=0x7fa3101029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:46.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.752+0000 7fa31790c640 1 --2- 172.21.15.1:0/1407934131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa310102570 0x7fa3101029b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa300009900 tx=0x7fa30002a480 comp rx=0 tx=0).stop 2024-09-19T09:38:46.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.752+0000 7fa31790c640 1 -- 172.21.15.1:0/1407934131 shutdown_connections 2024-09-19T09:38:46.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.752+0000 7fa31790c640 1 --2- 172.21.15.1:0/1407934131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa310102ef0 0x7fa31010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:46.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.752+0000 7fa31790c640 1 --2- 172.21.15.1:0/1407934131 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa310102570 0x7fa3101029b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:46.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.752+0000 7fa31790c640 1 --2- 172.21.15.1:0/1407934131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa310100e20 0x7fa310101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:46.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.752+0000 7fa31790c640 1 -- 172.21.15.1:0/1407934131 >> 172.21.15.1:0/1407934131 conn(0x7fa3100fc7d0 msgr2=0x7fa3100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:46.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.752+0000 7fa31790c640 1 -- 172.21.15.1:0/1407934131 shutdown_connections 2024-09-19T09:38:46.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.752+0000 7fa31790c640 1 -- 172.21.15.1:0/1407934131 wait complete. 2024-09-19T09:38:46.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.752+0000 7fa31790c640 1 Processor -- start 2024-09-19T09:38:46.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.752+0000 7fa31790c640 1 -- start start 2024-09-19T09:38:46.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.753+0000 7fa31790c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa310100e20 0x7fa3100fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:46.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.753+0000 7fa31790c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa310102570 0x7fa3100fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:46.787 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.753+0000 7fa31790c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa310102ef0 0x7fa3100fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:46.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.753+0000 7fa31790c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa310110fc0 con 0x7fa310100e20 2024-09-19T09:38:46.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.753+0000 7fa31790c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa310110e40 con 0x7fa310102ef0 2024-09-19T09:38:46.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.753+0000 7fa31790c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa310111140 con 0x7fa310102570 2024-09-19T09:38:46.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.753+0000 7fa3156a8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa310100e20 0x7fa3100fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:46.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.753+0000 7fa3156a8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa310100e20 0x7fa3100fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49874/0 (socket says 172.21.15.1:49874) 2024-09-19T09:38:46.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.753+0000 7fa3156a8640 1 -- 172.21.15.1:0/2898156508 learned_addr learned my addr 172.21.15.1:0/2898156508 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:46.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.753+0000 7fa315ea9640 1 --2- 172.21.15.1:0/2898156508 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa310102ef0 0x7fa3100fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:46.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.753+0000 7fa314ea7640 1 --2- 172.21.15.1:0/2898156508 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa310102570 0x7fa3100fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:46.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.753+0000 7fa3156a8640 1 -- 172.21.15.1:0/2898156508 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa310102570 msgr2=0x7fa3100fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:46.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.753+0000 7fa3156a8640 1 --2- 172.21.15.1:0/2898156508 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa310102570 0x7fa3100fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:46.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.753+0000 7fa3156a8640 1 -- 172.21.15.1:0/2898156508 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa310102ef0 msgr2=0x7fa3100fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:46.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.753+0000 7fa3156a8640 1 --2- 172.21.15.1:0/2898156508 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa310102ef0 0x7fa3100fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:46.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.753+0000 7fa3156a8640 1 -- 172.21.15.1:0/2898156508 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3101a6a40 con 0x7fa310100e20 2024-09-19T09:38:46.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.753+0000 7fa314ea7640 1 --2- 172.21.15.1:0/2898156508 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa310102570 0x7fa3100fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:46.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.753+0000 7fa3156a8640 1 --2- 172.21.15.1:0/2898156508 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa310100e20 0x7fa3100fcc80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa30c00b4a0 tx=0x7fa30c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:46.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.754+0000 7fa3067fc640 1 -- 172.21.15.1:0/2898156508 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30c014070 con 0x7fa310100e20 2024-09-19T09:38:46.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.754+0000 7fa3067fc640 1 -- 172.21.15.1:0/2898156508 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa30c010af0 con 0x7fa310100e20 2024-09-19T09:38:46.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.754+0000 7fa31790c640 1 -- 172.21.15.1:0/2898156508 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3101a6d30 con 0x7fa310100e20 2024-09-19T09:38:46.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.754+0000 7fa3067fc640 1 -- 172.21.15.1:0/2898156508 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30c017d10 con 0x7fa310100e20 2024-09-19T09:38:46.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.754+0000 7fa31790c640 1 -- 172.21.15.1:0/2898156508 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3101a7210 con 0x7fa310100e20 2024-09-19T09:38:46.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.755+0000 7fa31790c640 1 -- 172.21.15.1:0/2898156508 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa310101200 con 0x7fa310100e20 2024-09-19T09:38:46.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.756+0000 7fa3067fc640 1 -- 172.21.15.1:0/2898156508 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fa30c017070 con 0x7fa310100e20 2024-09-19T09:38:46.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.757+0000 7fa3067fc640 1 --2- 172.21.15.1:0/2898156508 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fa2fc0a3240 0x7fa2fc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:46.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.758+0000 7fa314ea7640 1 --2- 172.21.15.1:0/2898156508 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fa2fc0a3240 0x7fa2fc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:46.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.758+0000 7fa3067fc640 1 -- 172.21.15.1:0/2898156508 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fa30c0cefd0 con 0x7fa310100e20 2024-09-19T09:38:46.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.758+0000 7fa314ea7640 1 --2- 172.21.15.1:0/2898156508 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fa2fc0a3240 0x7fa2fc0a5700 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa3100fe710 tx=0x7fa300005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:46.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.760+0000 7fa3067fc640 1 -- 172.21.15.1:0/2898156508 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa30c09bd90 con 0x7fa310100e20 2024-09-19T09:38:46.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.976+0000 7fa31790c640 1 -- 172.21.15.1:0/2898156508 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3100fe1b0 con 0x7fa310100e20 2024-09-19T09:38:46.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.976+0000 7fa3067fc640 1 -- 172.21.15.1:0/2898156508 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11837 (secure 0 0 0) 0x7fa3100fe1b0 con 0x7fa310100e20 2024-09-19T09:38:46.979 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:38:46.979 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":19,"btime":"2024-09-19T09:36:24:006349+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:36:23.723388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6839/3279971690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3279971690},{"type":"v1","addr":"172.21.15.121:6839","nonce":3279971690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:38:46.979 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 19 2024-09-19T09:38:46.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.980+0000 7fa31790c640 1 -- 172.21.15.1:0/2898156508 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fa2fc0a3240 msgr2=0x7fa2fc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:46.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.980+0000 7fa31790c640 1 --2- 172.21.15.1:0/2898156508 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fa2fc0a3240 0x7fa2fc0a5700 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa3100fe710 tx=0x7fa300005a20 comp rx=0 tx=0).stop 2024-09-19T09:38:46.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.980+0000 7fa31790c640 1 -- 172.21.15.1:0/2898156508 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa310100e20 msgr2=0x7fa3100fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:46.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.980+0000 7fa31790c640 1 --2- 172.21.15.1:0/2898156508 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa310100e20 0x7fa3100fcc80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa30c00b4a0 tx=0x7fa30c00b960 comp rx=0 tx=0).stop 2024-09-19T09:38:46.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.980+0000 7fa31790c640 1 -- 172.21.15.1:0/2898156508 shutdown_connections 2024-09-19T09:38:46.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.980+0000 7fa31790c640 1 --2- 172.21.15.1:0/2898156508 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fa2fc0a3240 0x7fa2fc0a5700 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:46.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.980+0000 7fa31790c640 1 --2- 172.21.15.1:0/2898156508 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa310102ef0 0x7fa3100fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:46.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.980+0000 7fa31790c640 1 --2- 172.21.15.1:0/2898156508 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa310102570 0x7fa3100fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:46.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.980+0000 7fa31790c640 1 --2- 172.21.15.1:0/2898156508 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa310100e20 0x7fa3100fcc80 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:46.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.980+0000 7fa31790c640 1 -- 172.21.15.1:0/2898156508 >> 172.21.15.1:0/2898156508 conn(0x7fa3100fc7d0 msgr2=0x7fa31006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:46.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.980+0000 7fa31790c640 1 -- 172.21.15.1:0/2898156508 shutdown_connections 2024-09-19T09:38:46.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:46.980+0000 7fa31790c640 1 -- 172.21.15.1:0/2898156508 wait complete. 2024-09-19T09:38:47.350 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:47 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/2898156508' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:47.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:47 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/2898156508' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:47.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:47 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/2898156508' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:48.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:48 smithi022 ceph-mon[35583]: pgmap v359: 97 pgs: 97 active+clean; 657 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-19T09:38:48.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:48 smithi121 ceph-mon[35577]: pgmap v359: 97 pgs: 97 active+clean; 657 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-19T09:38:48.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:48 smithi001 ceph-mon[31225]: pgmap v359: 97 pgs: 97 active+clean; 657 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-19T09:38:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.600+0000 7fd465a1e640 1 -- 172.21.15.1:0/3521353711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4600ffdf0 msgr2=0x7fd4601001f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.600+0000 7fd465a1e640 1 --2- 172.21.15.1:0/3521353711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4600ffdf0 0x7fd4601001f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd450009900 tx=0x7fd45002a410 comp rx=0 tx=0).stop 2024-09-19T09:38:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.600+0000 7fd465a1e640 1 -- 172.21.15.1:0/3521353711 shutdown_connections 2024-09-19T09:38:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.600+0000 7fd465a1e640 1 --2- 172.21.15.1:0/3521353711 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd460103780 0x7fd46010a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.605 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.600+0000 7fd465a1e640 1 --2- 172.21.15.1:0/3521353711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd460102dc0 0x7fd460103240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.600+0000 7fd465a1e640 1 --2- 172.21.15.1:0/3521353711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd4600ffdf0 0x7fd4601001f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.600+0000 7fd465a1e640 1 -- 172.21.15.1:0/3521353711 >> 172.21.15.1:0/3521353711 conn(0x7fd4600fb930 msgr2=0x7fd4600fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.600+0000 7fd465a1e640 1 -- 172.21.15.1:0/3521353711 shutdown_connections 2024-09-19T09:38:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.600+0000 7fd465a1e640 1 -- 172.21.15.1:0/3521353711 wait complete. 2024-09-19T09:38:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.601+0000 7fd465a1e640 1 Processor -- start 2024-09-19T09:38:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.601+0000 7fd465a1e640 1 -- start start 2024-09-19T09:38:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.601+0000 7fd465a1e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4600ffdf0 0x7fd460197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.601+0000 7fd465a1e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd460102dc0 0x7fd4601983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:48.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.601+0000 7fd465a1e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd460103780 0x7fd46019f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.601+0000 7fd465a1e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd46010d7c0 con 0x7fd460103780 2024-09-19T09:38:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.601+0000 7fd465a1e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd46010d640 con 0x7fd460102dc0 2024-09-19T09:38:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.601+0000 7fd465a1e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd46010d940 con 0x7fd4600ffdf0 2024-09-19T09:38:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.601+0000 7fd45f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd460103780 0x7fd46019f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.602+0000 7fd45f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd460103780 0x7fd46019f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49882/0 (socket says 172.21.15.1:49882) 2024-09-19T09:38:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.602+0000 7fd45f7fe640 1 -- 172.21.15.1:0/2353674205 learned_addr learned my addr 172.21.15.1:0/2353674205 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.602+0000 7fd45e7fc640 1 --2- 172.21.15.1:0/2353674205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd460102dc0 0x7fd4601983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.602+0000 7fd45effd640 1 --2- 172.21.15.1:0/2353674205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4600ffdf0 0x7fd460197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.602+0000 7fd45f7fe640 1 -- 172.21.15.1:0/2353674205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4600ffdf0 msgr2=0x7fd460197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.602+0000 7fd45f7fe640 1 --2- 172.21.15.1:0/2353674205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4600ffdf0 0x7fd460197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.602+0000 7fd45f7fe640 1 -- 172.21.15.1:0/2353674205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd460102dc0 msgr2=0x7fd4601983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:48.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.602+0000 7fd45f7fe640 1 --2- 172.21.15.1:0/2353674205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd460102dc0 0x7fd4601983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.602+0000 7fd45f7fe640 1 -- 172.21.15.1:0/2353674205 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd46019fac0 con 0x7fd460103780 2024-09-19T09:38:48.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.602+0000 7fd45f7fe640 1 --2- 172.21.15.1:0/2353674205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd460103780 0x7fd46019f450 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd45800eaa0 tx=0x7fd45800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:48.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.602+0000 7fd464a1c640 1 -- 172.21.15.1:0/2353674205 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45800cdb0 con 0x7fd460103780 2024-09-19T09:38:48.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.602+0000 7fd464a1c640 1 -- 172.21.15.1:0/2353674205 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd458005020 con 0x7fd460103780 2024-09-19T09:38:48.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.602+0000 7fd465a1e640 1 -- 172.21.15.1:0/2353674205 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd46019fdb0 con 0x7fd460103780 2024-09-19T09:38:48.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.602+0000 7fd464a1c640 1 -- 172.21.15.1:0/2353674205 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4580116b0 con 0x7fd460103780 2024-09-19T09:38:48.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.602+0000 7fd465a1e640 1 -- 172.21.15.1:0/2353674205 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4601a0220 con 0x7fd460103780 2024-09-19T09:38:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.605+0000 7fd464a1c640 1 -- 172.21.15.1:0/2353674205 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fd458005560 con 0x7fd460103780 2024-09-19T09:38:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.606+0000 7fd46888c740 1 Processor -- start 2024-09-19T09:38:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.606+0000 7fd46888c740 1 -- start start 2024-09-19T09:38:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.606+0000 7fd46888c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557afb6f19a0 0x557afb6f1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.606+0000 7fd46888c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557afb6f22e0 0x557afb6f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.606+0000 7fd46888c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557afb6f7370 0x557afb6f9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.606+0000 7fd46888c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557afb6552f0 con 0x557afb6f19a0 2024-09-19T09:38:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.606+0000 7fd46888c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557afb5fd270 con 0x557afb6f7370 2024-09-19T09:38:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.606+0000 7fd46888c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x557afb6512b0 con 0x557afb6f22e0 2024-09-19T09:38:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.606+0000 7fd45e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557afb6f19a0 0x557afb6f1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:48.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.606+0000 7fd45e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557afb6f19a0 0x557afb6f1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49886/0 (socket says 172.21.15.1:49886) 2024-09-19T09:38:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.606+0000 7fd45e7fc640 1 -- 172.21.15.1:0/815855112 learned_addr learned my addr 172.21.15.1:0/815855112 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.606+0000 7fd45effd640 1 --2- 172.21.15.1:0/815855112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557afb6f22e0 0x557afb6f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.606+0000 7fd45e7fc640 1 --2- 172.21.15.1:0/815855112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557afb6f7370 0x557afb6f9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.606+0000 7fd45e7fc640 1 -- 172.21.15.1:0/815855112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557afb6f22e0 msgr2=0x557afb6f6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.606+0000 7fd464a1c640 1 --2- 172.21.15.1:0/2353674205 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd4480a3240 0x7fd4480a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.606+0000 7fd45e7fc640 1 --2- 172.21.15.1:0/815855112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557afb6f22e0 0x557afb6f6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.606+0000 7fd45e7fc640 1 -- 172.21.15.1:0/815855112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557afb6f7370 msgr2=0x557afb6f9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.606+0000 7fd45e7fc640 1 --2- 172.21.15.1:0/815855112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557afb6f7370 0x557afb6f9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.607+0000 7fd45e7fc640 1 -- 172.21.15.1:0/815855112 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557afb5fc340 con 0x557afb6f19a0 2024-09-19T09:38:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.607+0000 7fd45f7fe640 1 --2- 172.21.15.1:0/2353674205 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd4480a3240 0x7fd4480a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.607+0000 7fd464a1c640 1 -- 172.21.15.1:0/2353674205 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fd4580cfad0 con 0x7fd460103780 2024-09-19T09:38:48.615 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.607+0000 7fd45e7fc640 1 --2- 172.21.15.1:0/815855112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557afb6f19a0 0x557afb6f1da0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd45400bc20 tx=0x7fd454004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a14d88134daf50 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:48.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.607+0000 7fd445ffb640 1 -- 172.21.15.1:0/815855112 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd454005020 con 0x557afb6f19a0 2024-09-19T09:38:48.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.607+0000 7fd445ffb640 1 -- 172.21.15.1:0/815855112 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4540056a0 con 0x557afb6f19a0 2024-09-19T09:38:48.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.607+0000 7fd445ffb640 1 -- 172.21.15.1:0/815855112 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4540106c0 con 0x557afb6f19a0 2024-09-19T09:38:48.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.608+0000 7fd46888c740 1 -- 172.21.15.1:0/815855112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557afb6f19a0 msgr2=0x557afb6f1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:48.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.608+0000 7fd46888c740 1 --2- 172.21.15.1:0/815855112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557afb6f19a0 0x557afb6f1da0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd45400bc20 tx=0x7fd454004250 comp rx=0 tx=0).stop 2024-09-19T09:38:48.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.608+0000 7fd45f7fe640 1 --2- 172.21.15.1:0/2353674205 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd4480a3240 0x7fd4480a5700 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd45800efd0 tx=0x7fd458066be0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:48.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.608+0000 7fd46888c740 1 -- 172.21.15.1:0/815855112 shutdown_connections 2024-09-19T09:38:48.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.608+0000 7fd46888c740 1 --2- 172.21.15.1:0/815855112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557afb6f7370 0x557afb6f9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.608+0000 7fd46888c740 1 --2- 172.21.15.1:0/815855112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557afb6f22e0 0x557afb6f6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.616 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.608+0000 7fd46888c740 1 --2- 172.21.15.1:0/815855112 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557afb6f19a0 0x557afb6f1da0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.608+0000 7fd46888c740 1 -- 172.21.15.1:0/815855112 >> 172.21.15.1:0/815855112 conn(0x557afb6ed010 msgr2=0x557afb6ed410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:48.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.608+0000 7fd46888c740 1 -- 172.21.15.1:0/815855112 shutdown_connections 2024-09-19T09:38:48.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.608+0000 7fd46888c740 1 -- 172.21.15.1:0/815855112 wait complete. 2024-09-19T09:38:48.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.608+0000 7fd46888c740 1 -- start start 2024-09-19T09:38:48.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.608+0000 7fd46888c740 1 Processor -- start 2024-09-19T09:38:48.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.609+0000 7fd46888c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557afb6f19a0 0x557afb6fbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:48.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.609+0000 7fd46888c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557afb6f22e0 0x557afb6fbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:48.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.609+0000 7fd46888c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557afb6f7370 0x557afb703020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:48.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.609+0000 7fd46888c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557afb6fa2e0 con 0x557afb6f7370 2024-09-19T09:38:48.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.609+0000 7fd46888c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557afb5de290 con 0x557afb6f22e0 2024-09-19T09:38:48.617 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.609+0000 7fd46888c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x557afb6fa460 con 0x557afb6f19a0 2024-09-19T09:38:48.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.609+0000 7fd46888c740 10 client.0 _ll_register_callbacks cb 0x557afb60f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:48.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.609+0000 7fd45e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557afb6f7370 0x557afb703020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:48.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.609+0000 7fd45e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557afb6f7370 0x557afb703020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49890/0 (socket says 172.21.15.1:49890) 2024-09-19T09:38:48.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.609+0000 7fd45e7fc640 1 -- 172.21.15.1:0/2649120780 learned_addr learned my addr 172.21.15.1:0/2649120780 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:48.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.609+0000 7fd45e7fc640 1 --2- 172.21.15.1:0/2649120780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557afb6f19a0 0x557afb6fbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:48.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.609+0000 7fd45effd640 1 --2- 172.21.15.1:0/2649120780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557afb6f22e0 0x557afb6fbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:48.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.609+0000 7fd45e7fc640 1 -- 172.21.15.1:0/2649120780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557afb6f19a0 msgr2=0x557afb6fbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:48.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.609+0000 7fd45e7fc640 1 --2- 172.21.15.1:0/2649120780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557afb6f19a0 0x557afb6fbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.609+0000 7fd45e7fc640 1 -- 172.21.15.1:0/2649120780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557afb6f22e0 msgr2=0x557afb6fbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:48.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.609+0000 7fd45e7fc640 1 --2- 172.21.15.1:0/2649120780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557afb6f22e0 0x557afb6fbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.609+0000 7fd45e7fc640 1 -- 172.21.15.1:0/2649120780 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557afb368210 con 0x557afb6f7370 2024-09-19T09:38:48.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.609+0000 7fd45effd640 1 --2- 172.21.15.1:0/2649120780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557afb6f22e0 0x557afb6fbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:48.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.609+0000 7fd45e7fc640 1 --2- 172.21.15.1:0/2649120780 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557afb6f7370 0x557afb703020 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd45400b910 tx=0x7fd454004ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=308c7a5f6b3af334 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.609+0000 7fd43effd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:38:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.609+0000 7fd43effd640 1 -- 172.21.15.1:0/2649120780 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd454005210 con 0x557afb6f7370 2024-09-19T09:38:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.610+0000 7fd43effd640 1 -- 172.21.15.1:0/2649120780 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fd4540053b0 con 0x557afb6f7370 2024-09-19T09:38:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.610+0000 7fd46888c740 1 -- 172.21.15.1:0/2649120780 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4540056a0 con 0x557afb6f7370 2024-09-19T09:38:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.610+0000 7fd43effd640 1 -- 172.21.15.1:0/2649120780 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd454010460 con 0x557afb6f7370 2024-09-19T09:38:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.610+0000 7fd46888c740 10 client.15318 fetch_fsmap learned FSMap version 19 2024-09-19T09:38:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.610+0000 7fd46888c740 1 -- 172.21.15.1:0/2649120780 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x557afb434620 con 0x557afb6f7370 2024-09-19T09:38:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.610+0000 7fd43effd640 1 -- 172.21.15.1:0/2649120780 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4540056a0 con 0x557afb6f7370 2024-09-19T09:38:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.610+0000 7fd43effd640 1 -- 172.21.15.1:0/2649120780 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fd45402f030 con 0x557afb6f7370 2024-09-19T09:38:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.610+0000 7fd46888c740 10 client.15318 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:38:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.610+0000 7fd46888c740 10 client.15318 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:38:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.610+0000 7fd46888c740 20 client.15318 populate_metadata read hostname 'smithi001' 2024-09-19T09:38:48.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.610+0000 7fd46888c740 1 --2- 172.21.15.1:0/2649120780 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x557afb7074a0 0x557afb7098b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:48.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.610+0000 7fd46888c740 4 client.15318 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:38:48.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.610+0000 7fd46888c740 1 -- 172.21.15.1:0/2649120780 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557afb662a20 con 0x557afb7074a0 2024-09-19T09:38:48.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.611+0000 7fd45effd640 1 --2- 172.21.15.1:0/2649120780 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x557afb7074a0 0x557afb7098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:48.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.611+0000 7fd45effd640 1 --2- 172.21.15.1:0/2649120780 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x557afb7074a0 0x557afb7098b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=363fcd48d47e6d0c server_cookie=61effd329df1b4cd in_seq=0 out_seq=0 2024-09-19T09:38:48.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.611+0000 7fd43effd640 10 client.15318 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.612+0000 7fd43effd640 1 -- 172.21.15.1:0/2649120780 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557afb662a20 con 0x557afb7074a0 2024-09-19T09:38:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.612+0000 7fd43effd640 10 client.15318 handle_command_reply: tid=0 2024-09-19T09:38:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.612+0000 7fd46888c740 1 client.15318 shutdown 2024-09-19T09:38:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.612+0000 7fd46888c740 1 -- 172.21.15.1:0/2649120780 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557afb6f7370 msgr2=0x557afb703020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:48.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.612+0000 7fd46888c740 1 --2- 172.21.15.1:0/2649120780 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557afb6f7370 0x557afb703020 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd45400b910 tx=0x7fd454004ec0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.612+0000 7fd46888c740 1 -- 172.21.15.1:0/2649120780 shutdown_connections 2024-09-19T09:38:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.612+0000 7fd46888c740 1 --2- 172.21.15.1:0/2649120780 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x557afb7074a0 0x557afb7098b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.612+0000 7fd46888c740 1 --2- 172.21.15.1:0/2649120780 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557afb6f7370 0x557afb703020 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.612+0000 7fd46888c740 1 --2- 172.21.15.1:0/2649120780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557afb6f22e0 0x557afb6fbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.612+0000 7fd43effd640 0 client.15318 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.612+0000 7fd46888c740 1 --2- 172.21.15.1:0/2649120780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557afb6f19a0 0x557afb6fbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.612+0000 7fd46888c740 1 -- 172.21.15.1:0/2649120780 >> 172.21.15.1:0/2649120780 conn(0x557afb6ed010 msgr2=0x557afb6ee820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.612+0000 7fd46888c740 1 -- 172.21.15.1:0/2649120780 shutdown_connections 2024-09-19T09:38:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.612+0000 7fd46888c740 1 -- 172.21.15.1:0/2649120780 wait complete. 2024-09-19T09:38:48.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.612+0000 7fd46888c740 20 client.15318 trim_cache size 0 max 16384 2024-09-19T09:38:48.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.626+0000 7fd46888c740 1 Processor -- start 2024-09-19T09:38:48.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.627+0000 7fd46888c740 1 -- start start 2024-09-19T09:38:48.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.627+0000 7fd46888c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557afb6f19a0 0x557afb6f1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:48.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.627+0000 7fd46888c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557afb6f22e0 0x557afb702f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.627+0000 7fd46888c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557afb6f7370 0x557afb6ec0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.627+0000 7fd46888c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd4601a7020 con 0x557afb6f22e0 2024-09-19T09:38:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.627+0000 7fd46888c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd4601a98c0 con 0x557afb6f7370 2024-09-19T09:38:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.627+0000 7fd46888c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd4601a76b0 con 0x557afb6f19a0 2024-09-19T09:38:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.627+0000 7fd45effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557afb6f22e0 0x557afb702f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.627+0000 7fd45effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557afb6f22e0 0x557afb702f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49896/0 (socket says 172.21.15.1:49896) 2024-09-19T09:38:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.627+0000 7fd45effd640 1 -- 172.21.15.1:0/368031243 learned_addr learned my addr 172.21.15.1:0/368031243 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.627+0000 7fd45e7fc640 1 --2- 172.21.15.1:0/368031243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557afb6f19a0 0x557afb6f1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.627+0000 7fd45e7fc640 1 --2- 172.21.15.1:0/368031243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557afb6f7370 0x557afb6ec0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.627+0000 7fd45effd640 1 -- 172.21.15.1:0/368031243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557afb6f19a0 msgr2=0x557afb6f1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.627+0000 7fd45effd640 1 --2- 172.21.15.1:0/368031243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557afb6f19a0 0x557afb6f1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.627+0000 7fd45effd640 1 -- 172.21.15.1:0/368031243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557afb6f7370 msgr2=0x557afb6ec0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:48.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.627+0000 7fd45effd640 1 --2- 172.21.15.1:0/368031243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557afb6f7370 0x557afb6ec0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.627+0000 7fd45effd640 1 -- 172.21.15.1:0/368031243 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557afb6f66f0 con 0x557afb6f22e0 2024-09-19T09:38:48.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.627+0000 7fd45e7fc640 1 --2- 172.21.15.1:0/368031243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557afb6f7370 0x557afb6ec0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:38:48.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.627+0000 7fd45effd640 1 --2- 172.21.15.1:0/368031243 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557afb6f22e0 0x557afb702f40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd4500314e0 tx=0x7fd450005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58b39b3b8c99809 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:48.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.628+0000 7fd4457fa640 1 -- 172.21.15.1:0/368031243 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd450035040 con 0x557afb6f22e0 2024-09-19T09:38:48.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.628+0000 7fd4457fa640 1 -- 172.21.15.1:0/368031243 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd45004a070 con 0x557afb6f22e0 2024-09-19T09:38:48.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.628+0000 7fd4457fa640 1 -- 172.21.15.1:0/368031243 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4500049e0 con 0x557afb6f22e0 2024-09-19T09:38:48.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.628+0000 7fd46888c740 1 -- 172.21.15.1:0/368031243 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557afb6f22e0 msgr2=0x557afb702f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:48.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.628+0000 7fd46888c740 1 --2- 172.21.15.1:0/368031243 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557afb6f22e0 0x557afb702f40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd4500314e0 tx=0x7fd450005fd0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.628+0000 7fd46888c740 1 -- 172.21.15.1:0/368031243 shutdown_connections 2024-09-19T09:38:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.628+0000 7fd46888c740 1 --2- 172.21.15.1:0/368031243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557afb6f7370 0x557afb6ec0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.628+0000 7fd46888c740 1 --2- 172.21.15.1:0/368031243 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557afb6f22e0 0x557afb702f40 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.628+0000 7fd46888c740 1 --2- 172.21.15.1:0/368031243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557afb6f19a0 0x557afb6f1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.628+0000 7fd46888c740 1 -- 172.21.15.1:0/368031243 >> 172.21.15.1:0/368031243 conn(0x557afb6ed010 msgr2=0x557afb6eb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.628+0000 7fd46888c740 1 -- 172.21.15.1:0/368031243 shutdown_connections 2024-09-19T09:38:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.628+0000 7fd46888c740 1 -- 172.21.15.1:0/368031243 wait complete. 2024-09-19T09:38:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.629+0000 7fd46888c740 1 -- start start 2024-09-19T09:38:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.629+0000 7fd46888c740 1 Processor -- start 2024-09-19T09:38:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.629+0000 7fd46888c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557afb6f19a0 0x557afb6ffed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.629+0000 7fd46888c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557afb6f22e0 0x557afb700410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.629+0000 7fd46888c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557afb6f7370 0x557afb770180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:48.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.629+0000 7fd46888c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd4601a7d80 con 0x557afb6f19a0 2024-09-19T09:38:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.629+0000 7fd46888c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd4601a91f0 con 0x557afb6f7370 2024-09-19T09:38:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.629+0000 7fd46888c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd4601a8450 con 0x557afb6f22e0 2024-09-19T09:38:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.629+0000 7fd46888c740 10 client.0 _ll_register_callbacks cb 0x7fd450005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.629+0000 7fd45e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557afb6f19a0 0x557afb6ffed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.629+0000 7fd45e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557afb6f19a0 0x557afb6ffed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49900/0 (socket says 172.21.15.1:49900) 2024-09-19T09:38:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.629+0000 7fd45e7fc640 1 -- 172.21.15.1:0/406407521 learned_addr learned my addr 172.21.15.1:0/406407521 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.629+0000 7fd45effd640 1 --2- 172.21.15.1:0/406407521 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557afb6f22e0 0x557afb700410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.630+0000 7fd45e7fc640 1 --2- 172.21.15.1:0/406407521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557afb6f7370 0x557afb770180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.630+0000 7fd45e7fc640 1 -- 172.21.15.1:0/406407521 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557afb6f22e0 msgr2=0x557afb700410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.630+0000 7fd45e7fc640 1 --2- 172.21.15.1:0/406407521 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557afb6f22e0 0x557afb700410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.630+0000 7fd45e7fc640 1 -- 172.21.15.1:0/406407521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557afb6f7370 msgr2=0x557afb770180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:48.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.630+0000 7fd45e7fc640 1 --2- 172.21.15.1:0/406407521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557afb6f7370 0x557afb770180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.630+0000 7fd45e7fc640 1 -- 172.21.15.1:0/406407521 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557afb7706c0 con 0x557afb6f19a0 2024-09-19T09:38:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.630+0000 7fd45e7fc640 1 --2- 172.21.15.1:0/406407521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557afb6f19a0 0x557afb6ffed0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd45401f6f0 tx=0x7fd454004ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd3d8365ae12806 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.630+0000 7fd43effd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:38:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.630+0000 7fd43effd640 1 -- 172.21.15.1:0/406407521 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45401f970 con 0x557afb6f19a0 2024-09-19T09:38:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.630+0000 7fd43effd640 1 -- 172.21.15.1:0/406407521 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fd454005210 con 0x557afb6f19a0 2024-09-19T09:38:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.630+0000 7fd46888c740 1 -- 172.21.15.1:0/406407521 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd45004a070 con 0x557afb6f19a0 2024-09-19T09:38:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.630+0000 7fd43effd640 1 -- 172.21.15.1:0/406407521 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd454005410 con 0x557afb6f19a0 2024-09-19T09:38:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.630+0000 7fd46888c740 10 client.15324 fetch_fsmap learned FSMap version 19 2024-09-19T09:38:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.630+0000 7fd46888c740 1 -- 172.21.15.1:0/406407521 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x557afb771980 con 0x557afb6f19a0 2024-09-19T09:38:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.630+0000 7fd43effd640 1 -- 172.21.15.1:0/406407521 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd45004a070 con 0x557afb6f19a0 2024-09-19T09:38:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.631+0000 7fd43effd640 1 -- 172.21.15.1:0/406407521 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fd45402f030 con 0x557afb6f19a0 2024-09-19T09:38:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.631+0000 7fd46888c740 10 client.15324 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:38:48.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.631+0000 7fd46888c740 10 client.15324 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:38:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.631+0000 7fd46888c740 20 client.15324 populate_metadata read hostname 'smithi001' 2024-09-19T09:38:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.631+0000 7fd46888c740 1 --2- 172.21.15.1:0/406407521 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x557afb7722e0 0x557afb774700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.631+0000 7fd46888c740 4 client.15324 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:38:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.631+0000 7fd46888c740 1 -- 172.21.15.1:0/406407521 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557afb65cd70 con 0x557afb7722e0 2024-09-19T09:38:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.631+0000 7fd45effd640 1 --2- 172.21.15.1:0/406407521 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x557afb7722e0 0x557afb774700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.631+0000 7fd45effd640 1 --2- 172.21.15.1:0/406407521 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x557afb7722e0 0x557afb774700 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e09aac2e12de84d server_cookie=6d70c52e57818372 in_seq=0 out_seq=0 2024-09-19T09:38:48.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.631+0000 7fd43effd640 10 client.15324 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.639+0000 7fd43effd640 1 -- 172.21.15.1:0/406407521 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557afb65cd70 con 0x557afb7722e0 2024-09-19T09:38:48.641 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.639+0000 7fd43effd640 10 client.15324 handle_command_reply: tid=0 2024-09-19T09:38:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.639+0000 7fd46888c740 1 client.15324 shutdown 2024-09-19T09:38:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.639+0000 7fd46888c740 1 -- 172.21.15.1:0/406407521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557afb6f19a0 msgr2=0x557afb6ffed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.639+0000 7fd46888c740 1 --2- 172.21.15.1:0/406407521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557afb6f19a0 0x557afb6ffed0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd45401f6f0 tx=0x7fd454004ec0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.639+0000 7fd46888c740 1 -- 172.21.15.1:0/406407521 shutdown_connections 2024-09-19T09:38:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.639+0000 7fd46888c740 1 --2- 172.21.15.1:0/406407521 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x557afb7722e0 0x557afb774700 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.639+0000 7fd46888c740 1 --2- 172.21.15.1:0/406407521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557afb6f7370 0x557afb770180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.639+0000 7fd46888c740 1 --2- 172.21.15.1:0/406407521 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557afb6f22e0 0x557afb700410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.639+0000 7fd43effd640 0 client.15324 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.639+0000 7fd46888c740 1 --2- 172.21.15.1:0/406407521 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557afb6f19a0 0x557afb6ffed0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.639+0000 7fd46888c740 1 -- 172.21.15.1:0/406407521 >> 172.21.15.1:0/406407521 conn(0x557afb6ed010 msgr2=0x557afb6ee740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.639+0000 7fd46888c740 1 -- 172.21.15.1:0/406407521 shutdown_connections 2024-09-19T09:38:48.642 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.639+0000 7fd46888c740 1 -- 172.21.15.1:0/406407521 wait complete. 2024-09-19T09:38:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.639+0000 7fd46888c740 20 client.15324 trim_cache size 0 max 16384 2024-09-19T09:38:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:38:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:38:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:38:48.643 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:38:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.640+0000 7fd465a1e640 1 -- 172.21.15.1:0/2353674205 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd4480a3240 msgr2=0x7fd4480a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.640+0000 7fd465a1e640 1 --2- 172.21.15.1:0/2353674205 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd4480a3240 0x7fd4480a5700 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd45800efd0 tx=0x7fd458066be0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.640+0000 7fd465a1e640 1 -- 172.21.15.1:0/2353674205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd460103780 msgr2=0x7fd46019f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.640+0000 7fd465a1e640 1 --2- 172.21.15.1:0/2353674205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd460103780 0x7fd46019f450 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd45800eaa0 tx=0x7fd45800ef60 comp rx=0 tx=0).stop 2024-09-19T09:38:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.640+0000 7fd465a1e640 1 -- 172.21.15.1:0/2353674205 shutdown_connections 2024-09-19T09:38:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.640+0000 7fd465a1e640 1 --2- 172.21.15.1:0/2353674205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd460103780 0x7fd46019f450 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.640+0000 7fd465a1e640 1 --2- 172.21.15.1:0/2353674205 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd4480a3240 0x7fd4480a5700 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.644 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.640+0000 7fd465a1e640 1 --2- 172.21.15.1:0/2353674205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd460102dc0 0x7fd4601983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.640+0000 7fd465a1e640 1 --2- 172.21.15.1:0/2353674205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4600ffdf0 0x7fd460197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.640+0000 7fd465a1e640 1 -- 172.21.15.1:0/2353674205 >> 172.21.15.1:0/2353674205 conn(0x7fd4600fb930 msgr2=0x7fd4601061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.640+0000 7fd465a1e640 1 -- 172.21.15.1:0/2353674205 shutdown_connections 2024-09-19T09:38:48.645 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:38:48.640+0000 7fd465a1e640 1 -- 172.21.15.1:0/2353674205 wait complete. 2024-09-19T09:38:48.721 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:38:48.990 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:50.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:50 smithi022 ceph-mon[35583]: pgmap v360: 97 pgs: 97 active+clean; 657 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-19T09:38:50.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:50 smithi121 ceph-mon[35577]: pgmap v360: 97 pgs: 97 active+clean; 657 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-19T09:38:50.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:50 smithi001 ceph-mon[31225]: pgmap v360: 97 pgs: 97 active+clean; 657 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1.1 KiB/s wr, 3 op/s 2024-09-19T09:38:51.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.061+0000 7faf86d81640 1 -- 172.21.15.1:0/1596309150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf80106f10 msgr2=0x7faf8010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:51.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.061+0000 7faf86d81640 1 --2- 172.21.15.1:0/1596309150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf80106f10 0x7faf8010ea90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7faf78009ca0 tx=0x7faf7802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.061+0000 7faf86d81640 1 -- 172.21.15.1:0/1596309150 shutdown_connections 2024-09-19T09:38:51.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.061+0000 7faf86d81640 1 --2- 172.21.15.1:0/1596309150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf80106f10 0x7faf8010ea90 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.061+0000 7faf86d81640 1 --2- 172.21.15.1:0/1596309150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf80102790 0x7faf801067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.061+0000 7faf86d81640 1 --2- 172.21.15.1:0/1596309150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf80101de0 0x7faf801021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.061+0000 7faf86d81640 1 -- 172.21.15.1:0/1596309150 >> 172.21.15.1:0/1596309150 conn(0x7faf800fd8e0 msgr2=0x7faf800ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:51.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.061+0000 7faf86d81640 1 -- 172.21.15.1:0/1596309150 shutdown_connections 2024-09-19T09:38:51.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.061+0000 7faf86d81640 1 -- 172.21.15.1:0/1596309150 wait complete. 2024-09-19T09:38:51.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.062+0000 7faf86d81640 1 Processor -- start 2024-09-19T09:38:51.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.062+0000 7faf86d81640 1 -- start start 2024-09-19T09:38:51.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.062+0000 7faf86d81640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf80101de0 0x7faf801983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:51.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.062+0000 7faf86d81640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf80102790 0x7faf80198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:51.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.062+0000 7faf86d81640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf80106f10 0x7faf8019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:51.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.062+0000 7faf86d81640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faf80111fc0 con 0x7faf80102790 2024-09-19T09:38:51.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.062+0000 7faf86d81640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faf80111e40 con 0x7faf80106f10 2024-09-19T09:38:51.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.062+0000 7faf86d81640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7faf80112140 con 0x7faf80101de0 2024-09-19T09:38:51.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.062+0000 7faf7ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf80102790 0x7faf80198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:51.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.062+0000 7faf7ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf80102790 0x7faf80198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49914/0 (socket says 172.21.15.1:49914) 2024-09-19T09:38:51.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.062+0000 7faf7ffff640 1 -- 172.21.15.1:0/3883040690 learned_addr learned my addr 172.21.15.1:0/3883040690 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:51.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.062+0000 7faf8531e640 1 --2- 172.21.15.1:0/3883040690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf80106f10 0x7faf8019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:51.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.062+0000 7faf84b1d640 1 --2- 172.21.15.1:0/3883040690 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf80101de0 0x7faf801983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:51.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.063+0000 7faf7ffff640 1 -- 172.21.15.1:0/3883040690 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf80101de0 msgr2=0x7faf801983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:51.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.063+0000 7faf7ffff640 1 --2- 172.21.15.1:0/3883040690 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf80101de0 0x7faf801983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.063+0000 7faf7ffff640 1 -- 172.21.15.1:0/3883040690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf80106f10 msgr2=0x7faf8019cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:51.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.063+0000 7faf7ffff640 1 --2- 172.21.15.1:0/3883040690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf80106f10 0x7faf8019cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.063+0000 7faf7ffff640 1 -- 172.21.15.1:0/3883040690 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf8019d370 con 0x7faf80102790 2024-09-19T09:38:51.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.063+0000 7faf7ffff640 1 --2- 172.21.15.1:0/3883040690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf80102790 0x7faf80198900 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7faf6c00d950 tx=0x7faf6c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:51.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.063+0000 7faf7dffb640 1 -- 172.21.15.1:0/3883040690 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6c017070 con 0x7faf80102790 2024-09-19T09:38:51.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.063+0000 7faf7dffb640 1 -- 172.21.15.1:0/3883040690 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf6c009c30 con 0x7faf80102790 2024-09-19T09:38:51.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.063+0000 7faf86d81640 1 -- 172.21.15.1:0/3883040690 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf8019d660 con 0x7faf80102790 2024-09-19T09:38:51.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.063+0000 7faf7dffb640 1 -- 172.21.15.1:0/3883040690 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6c00f6b0 con 0x7faf80102790 2024-09-19T09:38:51.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.063+0000 7faf86d81640 1 -- 172.21.15.1:0/3883040690 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf801a4f40 con 0x7faf80102790 2024-09-19T09:38:51.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.066+0000 7faf7dffb640 1 -- 172.21.15.1:0/3883040690 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7faf6c0109d0 con 0x7faf80102790 2024-09-19T09:38:51.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.066+0000 7faf8915a740 1 Processor -- start 2024-09-19T09:38:51.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.067+0000 7faf8915a740 1 -- start start 2024-09-19T09:38:51.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.067+0000 7faf8915a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559eaf215b40 0x559eaf214090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:51.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.067+0000 7faf8915a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559eaf2145d0 0x559eaf214a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:51.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.067+0000 7faf8915a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559eaf21f370 0x559eaf221760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:51.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.067+0000 7faf8915a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559eaf17a2f0 con 0x559eaf215b40 2024-09-19T09:38:51.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.067+0000 7faf8915a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559eaf121cf0 con 0x559eaf2145d0 2024-09-19T09:38:51.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.067+0000 7faf8915a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559eaf1762b0 con 0x559eaf21f370 2024-09-19T09:38:51.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.067+0000 7faf8531e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559eaf215b40 0x559eaf214090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:51.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.067+0000 7faf8531e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559eaf215b40 0x559eaf214090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49930/0 (socket says 172.21.15.1:49930) 2024-09-19T09:38:51.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.067+0000 7faf8531e640 1 -- 172.21.15.1:0/2161916248 learned_addr learned my addr 172.21.15.1:0/2161916248 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:51.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.067+0000 7faf84b1d640 1 --2- 172.21.15.1:0/2161916248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559eaf2145d0 0x559eaf214a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:51.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.067+0000 7faf7ffff640 1 --2- 172.21.15.1:0/2161916248 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559eaf21f370 0x559eaf221760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:51.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.068+0000 7faf7dffb640 1 --2- 172.21.15.1:0/3883040690 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7faf700a32c0 0x7faf700a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:51.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.068+0000 7faf8531e640 1 -- 172.21.15.1:0/2161916248 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559eaf21f370 msgr2=0x559eaf221760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:51.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.068+0000 7faf8531e640 1 --2- 172.21.15.1:0/2161916248 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559eaf21f370 0x559eaf221760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.068+0000 7faf8531e640 1 -- 172.21.15.1:0/2161916248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559eaf2145d0 msgr2=0x559eaf214a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:51.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.068+0000 7faf8531e640 1 --2- 172.21.15.1:0/2161916248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559eaf2145d0 0x559eaf214a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.068+0000 7faf8531e640 1 -- 172.21.15.1:0/2161916248 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559eaf1063a0 con 0x559eaf215b40 2024-09-19T09:38:51.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.068+0000 7faf7dffb640 1 -- 172.21.15.1:0/3883040690 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7faf6c0cf7d0 con 0x7faf80102790 2024-09-19T09:38:51.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.068+0000 7faf8531e640 1 --2- 172.21.15.1:0/2161916248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559eaf215b40 0x559eaf214090 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7faf7802aeb0 tx=0x7faf7802f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a07ae22b4544133b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:51.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.068+0000 7faf8531e640 1 --2- 172.21.15.1:0/3883040690 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7faf700a32c0 0x7faf700a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:51.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.068+0000 7faf6affd640 1 -- 172.21.15.1:0/2161916248 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7804a040 con 0x559eaf215b40 2024-09-19T09:38:51.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.068+0000 7faf6affd640 1 -- 172.21.15.1:0/2161916248 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf78036030 con 0x559eaf215b40 2024-09-19T09:38:51.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.068+0000 7faf6affd640 1 -- 172.21.15.1:0/2161916248 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7802f610 con 0x559eaf215b40 2024-09-19T09:38:51.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.069+0000 7faf8915a740 1 -- 172.21.15.1:0/2161916248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559eaf215b40 msgr2=0x559eaf214090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:51.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.069+0000 7faf8531e640 1 --2- 172.21.15.1:0/3883040690 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7faf700a32c0 0x7faf700a5780 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faf78031fd0 tx=0x7faf7802f960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:51.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.069+0000 7faf8915a740 1 --2- 172.21.15.1:0/2161916248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559eaf215b40 0x559eaf214090 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7faf7802aeb0 tx=0x7faf7802f450 comp rx=0 tx=0).stop 2024-09-19T09:38:51.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.069+0000 7faf8915a740 1 -- 172.21.15.1:0/2161916248 shutdown_connections 2024-09-19T09:38:51.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.069+0000 7faf8915a740 1 --2- 172.21.15.1:0/2161916248 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559eaf21f370 0x559eaf221760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.069+0000 7faf8915a740 1 --2- 172.21.15.1:0/2161916248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559eaf2145d0 0x559eaf214a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.069+0000 7faf8915a740 1 --2- 172.21.15.1:0/2161916248 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559eaf215b40 0x559eaf214090 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.069+0000 7faf8915a740 1 -- 172.21.15.1:0/2161916248 >> 172.21.15.1:0/2161916248 conn(0x559eaf1dd310 msgr2=0x559eaf210c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:51.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.069+0000 7faf8915a740 1 -- 172.21.15.1:0/2161916248 shutdown_connections 2024-09-19T09:38:51.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.069+0000 7faf8915a740 1 -- 172.21.15.1:0/2161916248 wait complete. 2024-09-19T09:38:51.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.070+0000 7faf8915a740 1 -- start start 2024-09-19T09:38:51.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.070+0000 7faf8915a740 1 Processor -- start 2024-09-19T09:38:51.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.070+0000 7faf8915a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559eaf2145d0 0x559eaf21ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:51.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.070+0000 7faf8915a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559eaf215b40 0x559eaf21bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:51.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.070+0000 7faf8915a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559eaf21f370 0x559eaf21c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:51.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.070+0000 7faf8915a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559eaf221e90 con 0x559eaf21f370 2024-09-19T09:38:51.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.070+0000 7faf8915a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559eaf135060 con 0x559eaf215b40 2024-09-19T09:38:51.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.070+0000 7faf8915a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559eaf222010 con 0x559eaf2145d0 2024-09-19T09:38:51.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.070+0000 7faf8915a740 10 client.0 _ll_register_callbacks cb 0x559eaee888c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:51.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.070+0000 7faf8531e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559eaf21f370 0x559eaf21c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:51.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.070+0000 7faf8531e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559eaf21f370 0x559eaf21c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49938/0 (socket says 172.21.15.1:49938) 2024-09-19T09:38:51.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.070+0000 7faf8531e640 1 -- 172.21.15.1:0/1850919154 learned_addr learned my addr 172.21.15.1:0/1850919154 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:51.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.071+0000 7faf84b1d640 1 --2- 172.21.15.1:0/1850919154 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559eaf2145d0 0x559eaf21ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:51.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.071+0000 7faf7ffff640 1 --2- 172.21.15.1:0/1850919154 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559eaf215b40 0x559eaf21bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:51.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.071+0000 7faf8531e640 1 -- 172.21.15.1:0/1850919154 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559eaf2145d0 msgr2=0x559eaf21ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:51.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.071+0000 7faf8531e640 1 --2- 172.21.15.1:0/1850919154 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559eaf2145d0 0x559eaf21ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.071+0000 7faf8531e640 1 -- 172.21.15.1:0/1850919154 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559eaf215b40 msgr2=0x559eaf21bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:51.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.071+0000 7faf8531e640 1 --2- 172.21.15.1:0/1850919154 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559eaf215b40 0x559eaf21bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.071+0000 7faf8531e640 1 -- 172.21.15.1:0/1850919154 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559eaeeeb3c0 con 0x559eaf21f370 2024-09-19T09:38:51.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.071+0000 7faf7ffff640 1 --2- 172.21.15.1:0/1850919154 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559eaf215b40 0x559eaf21bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:38:51.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.071+0000 7faf84b1d640 1 --2- 172.21.15.1:0/1850919154 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559eaf2145d0 0x559eaf21ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:38:51.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.071+0000 7faf8531e640 1 --2- 172.21.15.1:0/1850919154 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559eaf21f370 0x559eaf21c530 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7faf7802f850 tx=0x7faf78043000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8da343a57d07756 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:51.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.071+0000 7faf5ffff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:38:51.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.071+0000 7faf5ffff640 1 -- 172.21.15.1:0/1850919154 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7804a040 con 0x559eaf21f370 2024-09-19T09:38:51.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.071+0000 7faf8915a740 1 -- 172.21.15.1:0/1850919154 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf78036030 con 0x559eaf21f370 2024-09-19T09:38:51.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.072+0000 7faf5ffff640 1 -- 172.21.15.1:0/1850919154 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7faf78031660 con 0x559eaf21f370 2024-09-19T09:38:51.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.072+0000 7faf5ffff640 1 -- 172.21.15.1:0/1850919154 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7faf78004160 con 0x559eaf21f370 2024-09-19T09:38:51.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.072+0000 7faf8915a740 10 client.15336 fetch_fsmap learned FSMap version 19 2024-09-19T09:38:51.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.072+0000 7faf8915a740 1 -- 172.21.15.1:0/1850919154 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x559eaf221e90 con 0x559eaf21f370 2024-09-19T09:38:51.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.072+0000 7faf5ffff640 1 -- 172.21.15.1:0/1850919154 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf78036030 con 0x559eaf21f370 2024-09-19T09:38:51.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.072+0000 7faf5ffff640 1 -- 172.21.15.1:0/1850919154 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7faf78064020 con 0x559eaf21f370 2024-09-19T09:38:51.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.072+0000 7faf8915a740 10 client.15336 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:38:51.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.072+0000 7faf8915a740 10 client.15336 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:38:51.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.072+0000 7faf8915a740 20 client.15336 populate_metadata read hostname 'smithi001' 2024-09-19T09:38:51.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.072+0000 7faf8915a740 1 --2- 172.21.15.1:0/1850919154 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x559eaf22ea40 0x559eaf230e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:51.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.072+0000 7faf8915a740 4 client.15336 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:38:51.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.072+0000 7faf8915a740 1 -- 172.21.15.1:0/1850919154 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559eaf187860 con 0x559eaf22ea40 2024-09-19T09:38:51.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.073+0000 7faf84b1d640 1 --2- 172.21.15.1:0/1850919154 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x559eaf22ea40 0x559eaf230e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:51.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.073+0000 7faf84b1d640 1 --2- 172.21.15.1:0/1850919154 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x559eaf22ea40 0x559eaf230e70 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7dc50fcc320dffde server_cookie=31ccb17023f850c1 in_seq=0 out_seq=0 2024-09-19T09:38:51.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.073+0000 7faf5ffff640 10 client.15336 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:51.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.074+0000 7faf5ffff640 1 -- 172.21.15.1:0/1850919154 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559eaf187860 con 0x559eaf22ea40 2024-09-19T09:38:51.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.074+0000 7faf5ffff640 10 client.15336 handle_command_reply: tid=0 2024-09-19T09:38:51.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.074+0000 7faf8915a740 1 client.15336 shutdown 2024-09-19T09:38:51.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.074+0000 7faf8915a740 1 -- 172.21.15.1:0/1850919154 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559eaf21f370 msgr2=0x559eaf21c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:51.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.074+0000 7faf8915a740 1 --2- 172.21.15.1:0/1850919154 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559eaf21f370 0x559eaf21c530 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7faf7802f850 tx=0x7faf78043000 comp rx=0 tx=0).stop 2024-09-19T09:38:51.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.074+0000 7faf8915a740 1 -- 172.21.15.1:0/1850919154 shutdown_connections 2024-09-19T09:38:51.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.074+0000 7faf8915a740 1 --2- 172.21.15.1:0/1850919154 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x559eaf22ea40 0x559eaf230e70 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.074+0000 7faf8915a740 1 --2- 172.21.15.1:0/1850919154 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559eaf21f370 0x559eaf21c530 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.074+0000 7faf8915a740 1 --2- 172.21.15.1:0/1850919154 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559eaf215b40 0x559eaf21bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.074+0000 7faf5ffff640 0 client.15336 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:51.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.074+0000 7faf8915a740 1 --2- 172.21.15.1:0/1850919154 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559eaf2145d0 0x559eaf21ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.074+0000 7faf8915a740 1 -- 172.21.15.1:0/1850919154 >> 172.21.15.1:0/1850919154 conn(0x559eaf1dd310 msgr2=0x559eaf216930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:51.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.074+0000 7faf8915a740 1 -- 172.21.15.1:0/1850919154 shutdown_connections 2024-09-19T09:38:51.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.074+0000 7faf8915a740 1 -- 172.21.15.1:0/1850919154 wait complete. 2024-09-19T09:38:51.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.075+0000 7faf8915a740 20 client.15336 trim_cache size 0 max 16384 2024-09-19T09:38:51.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.089+0000 7faf8915a740 1 Processor -- start 2024-09-19T09:38:51.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.089+0000 7faf8915a740 1 -- start start 2024-09-19T09:38:51.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.089+0000 7faf8915a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559eaf2145d0 0x559eaf22b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:51.092 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.089+0000 7faf8915a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559eaf215b40 0x559eaf217120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:51.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.089+0000 7faf8915a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559eaf21f370 0x559eaf217660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:51.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.089+0000 7faf8915a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faf801ab4e0 con 0x559eaf2145d0 2024-09-19T09:38:51.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.089+0000 7faf8915a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faf801add80 con 0x559eaf215b40 2024-09-19T09:38:51.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.089+0000 7faf8915a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7faf801abb70 con 0x559eaf21f370 2024-09-19T09:38:51.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.090+0000 7faf84b1d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559eaf2145d0 0x559eaf22b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:51.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.090+0000 7faf84b1d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559eaf2145d0 0x559eaf22b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49946/0 (socket says 172.21.15.1:49946) 2024-09-19T09:38:51.093 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.090+0000 7faf84b1d640 1 -- 172.21.15.1:0/1191733743 learned_addr learned my addr 172.21.15.1:0/1191733743 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:51.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.090+0000 7faf7ffff640 1 --2- 172.21.15.1:0/1191733743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559eaf215b40 0x559eaf217120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:51.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.090+0000 7faf8531e640 1 --2- 172.21.15.1:0/1191733743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559eaf21f370 0x559eaf217660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:51.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.090+0000 7faf84b1d640 1 -- 172.21.15.1:0/1191733743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559eaf21f370 msgr2=0x559eaf217660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:51.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.090+0000 7faf84b1d640 1 --2- 172.21.15.1:0/1191733743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559eaf21f370 0x559eaf217660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.090+0000 7faf84b1d640 1 -- 172.21.15.1:0/1191733743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559eaf215b40 msgr2=0x559eaf217120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:51.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.090+0000 7faf84b1d640 1 --2- 172.21.15.1:0/1191733743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559eaf215b40 0x559eaf217120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.090+0000 7faf84b1d640 1 -- 172.21.15.1:0/1191733743 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559eaf217ba0 con 0x559eaf2145d0 2024-09-19T09:38:51.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.090+0000 7faf84b1d640 1 --2- 172.21.15.1:0/1191733743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559eaf2145d0 0x559eaf22b130 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7faf7400cfb0 tx=0x7faf7400c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fce7760f8c5d960 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:51.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.090+0000 7faf6a7fc640 1 -- 172.21.15.1:0/1191733743 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf74022070 con 0x559eaf2145d0 2024-09-19T09:38:51.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.090+0000 7faf6a7fc640 1 -- 172.21.15.1:0/1191733743 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf74004220 con 0x559eaf2145d0 2024-09-19T09:38:51.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.090+0000 7faf6a7fc640 1 -- 172.21.15.1:0/1191733743 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf74003a10 con 0x559eaf2145d0 2024-09-19T09:38:51.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.091+0000 7faf8915a740 1 -- 172.21.15.1:0/1191733743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559eaf2145d0 msgr2=0x559eaf22b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:51.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.091+0000 7faf8915a740 1 --2- 172.21.15.1:0/1191733743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559eaf2145d0 0x559eaf22b130 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7faf7400cfb0 tx=0x7faf7400c430 comp rx=0 tx=0).stop 2024-09-19T09:38:51.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.091+0000 7faf8915a740 1 -- 172.21.15.1:0/1191733743 shutdown_connections 2024-09-19T09:38:51.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.091+0000 7faf8915a740 1 --2- 172.21.15.1:0/1191733743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559eaf21f370 0x559eaf217660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.091+0000 7faf8915a740 1 --2- 172.21.15.1:0/1191733743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559eaf215b40 0x559eaf217120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.091+0000 7faf8915a740 1 --2- 172.21.15.1:0/1191733743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559eaf2145d0 0x559eaf22b130 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.091+0000 7faf8915a740 1 -- 172.21.15.1:0/1191733743 >> 172.21.15.1:0/1191733743 conn(0x559eaf1dd310 msgr2=0x559eaf21e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:51.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.091+0000 7faf8915a740 1 -- 172.21.15.1:0/1191733743 shutdown_connections 2024-09-19T09:38:51.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.091+0000 7faf8915a740 1 -- 172.21.15.1:0/1191733743 wait complete. 2024-09-19T09:38:51.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.092+0000 7faf8915a740 1 -- start start 2024-09-19T09:38:51.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.092+0000 7faf8915a740 1 Processor -- start 2024-09-19T09:38:51.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.093+0000 7faf8915a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559eaf2145d0 0x559eaf227990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:51.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.093+0000 7faf8915a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559eaf215b40 0x559eaf222cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:51.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.093+0000 7faf8915a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559eaf21f370 0x559eaf223200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:51.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.093+0000 7faf8915a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faf801ac240 con 0x559eaf2145d0 2024-09-19T09:38:51.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.093+0000 7faf8915a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faf801ad6b0 con 0x559eaf21f370 2024-09-19T09:38:51.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.093+0000 7faf84b1d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559eaf2145d0 0x559eaf227990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:51.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.093+0000 7faf8915a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7faf801ac910 con 0x559eaf215b40 2024-09-19T09:38:51.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.093+0000 7faf84b1d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559eaf2145d0 0x559eaf227990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49960/0 (socket says 172.21.15.1:49960) 2024-09-19T09:38:51.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.093+0000 7faf84b1d640 1 -- 172.21.15.1:0/679841774 learned_addr learned my addr 172.21.15.1:0/679841774 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:51.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.093+0000 7faf8915a740 10 client.0 _ll_register_callbacks cb 0x7faf7400c2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:51.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.093+0000 7faf7ffff640 1 --2- 172.21.15.1:0/679841774 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559eaf215b40 0x559eaf222cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:51.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.093+0000 7faf84b1d640 1 -- 172.21.15.1:0/679841774 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559eaf215b40 msgr2=0x559eaf222cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:51.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.093+0000 7faf84b1d640 1 --2- 172.21.15.1:0/679841774 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559eaf215b40 0x559eaf222cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.093+0000 7faf84b1d640 1 -- 172.21.15.1:0/679841774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559eaf21f370 msgr2=0x559eaf223200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:51.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.093+0000 7faf84b1d640 1 --2- 172.21.15.1:0/679841774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559eaf21f370 0x559eaf223200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.093+0000 7faf84b1d640 1 -- 172.21.15.1:0/679841774 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559eaf2239e0 con 0x559eaf2145d0 2024-09-19T09:38:51.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.094+0000 7faf84b1d640 1 --2- 172.21.15.1:0/679841774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559eaf2145d0 0x559eaf227990 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7faf740057b0 tx=0x7faf7400caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d577a137edf83f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:51.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.094+0000 7faf5ffff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:38:51.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.094+0000 7faf5ffff640 1 -- 172.21.15.1:0/679841774 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf74034060 con 0x559eaf2145d0 2024-09-19T09:38:51.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.094+0000 7faf5ffff640 1 -- 172.21.15.1:0/679841774 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7faf7401e500 con 0x559eaf2145d0 2024-09-19T09:38:51.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.094+0000 7faf8915a740 1 -- 172.21.15.1:0/679841774 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf74004220 con 0x559eaf2145d0 2024-09-19T09:38:51.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.094+0000 7faf5ffff640 1 -- 172.21.15.1:0/679841774 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7faf74022050 con 0x559eaf2145d0 2024-09-19T09:38:51.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.094+0000 7faf8915a740 10 client.15342 fetch_fsmap learned FSMap version 19 2024-09-19T09:38:51.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.094+0000 7faf8915a740 1 -- 172.21.15.1:0/679841774 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x559eaf29daa0 con 0x559eaf2145d0 2024-09-19T09:38:51.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.094+0000 7faf5ffff640 1 -- 172.21.15.1:0/679841774 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf74004220 con 0x559eaf2145d0 2024-09-19T09:38:51.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.094+0000 7faf5ffff640 1 -- 172.21.15.1:0/679841774 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7faf74039070 con 0x559eaf2145d0 2024-09-19T09:38:51.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.094+0000 7faf8915a740 10 client.15342 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:38:51.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.095+0000 7faf8915a740 10 client.15342 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:38:51.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.095+0000 7faf8915a740 20 client.15342 populate_metadata read hostname 'smithi001' 2024-09-19T09:38:51.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.095+0000 7faf8915a740 1 --2- 172.21.15.1:0/679841774 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x559eaf29e100 0x559eaf2a0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:51.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.095+0000 7faf8915a740 4 client.15342 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:38:51.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.095+0000 7faf8915a740 1 -- 172.21.15.1:0/679841774 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559eaf181d70 con 0x559eaf29e100 2024-09-19T09:38:51.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.095+0000 7faf7ffff640 1 --2- 172.21.15.1:0/679841774 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x559eaf29e100 0x559eaf2a0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:51.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.095+0000 7faf5ffff640 10 client.15342 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:51.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.095+0000 7faf7ffff640 1 --2- 172.21.15.1:0/679841774 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x559eaf29e100 0x559eaf2a0550 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b271ac7dc027351 server_cookie=db224fbc66bbf341 in_seq=0 out_seq=0 2024-09-19T09:38:51.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.096+0000 7faf5ffff640 1 -- 172.21.15.1:0/679841774 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559eaf181d70 con 0x559eaf29e100 2024-09-19T09:38:51.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.096+0000 7faf5ffff640 10 client.15342 handle_command_reply: tid=0 2024-09-19T09:38:51.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.096+0000 7faf8915a740 1 client.15342 shutdown 2024-09-19T09:38:51.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.096+0000 7faf8915a740 1 -- 172.21.15.1:0/679841774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559eaf2145d0 msgr2=0x559eaf227990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:51.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.096+0000 7faf8915a740 1 --2- 172.21.15.1:0/679841774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559eaf2145d0 0x559eaf227990 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7faf740057b0 tx=0x7faf7400caf0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.096+0000 7faf8915a740 1 -- 172.21.15.1:0/679841774 shutdown_connections 2024-09-19T09:38:51.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.096+0000 7faf8915a740 1 --2- 172.21.15.1:0/679841774 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x559eaf29e100 0x559eaf2a0550 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.096+0000 7faf8915a740 1 --2- 172.21.15.1:0/679841774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559eaf21f370 0x559eaf223200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.096+0000 7faf8915a740 1 --2- 172.21.15.1:0/679841774 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559eaf215b40 0x559eaf222cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.096+0000 7faf8915a740 1 --2- 172.21.15.1:0/679841774 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559eaf2145d0 0x559eaf227990 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.096+0000 7faf5ffff640 0 client.15342 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:51.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.096+0000 7faf8915a740 1 -- 172.21.15.1:0/679841774 >> 172.21.15.1:0/679841774 conn(0x559eaf1dd310 msgr2=0x559eaf21d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:51.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.096+0000 7faf8915a740 1 -- 172.21.15.1:0/679841774 shutdown_connections 2024-09-19T09:38:51.104 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-19T09:38:51.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.096+0000 7faf8915a740 1 -- 172.21.15.1:0/679841774 wait complete. 2024-09-19T09:38:51.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.096+0000 7faf8915a740 20 client.15342 trim_cache size 0 max 16384 2024-09-19T09:38:51.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.097+0000 7faf86d81640 1 -- 172.21.15.1:0/3883040690 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7faf700a32c0 msgr2=0x7faf700a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:51.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.097+0000 7faf86d81640 1 --2- 172.21.15.1:0/3883040690 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7faf700a32c0 0x7faf700a5780 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faf78031fd0 tx=0x7faf7802f960 comp rx=0 tx=0).stop 2024-09-19T09:38:51.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.097+0000 7faf86d81640 1 -- 172.21.15.1:0/3883040690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf80102790 msgr2=0x7faf80198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:51.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.097+0000 7faf86d81640 1 --2- 172.21.15.1:0/3883040690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf80102790 0x7faf80198900 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7faf6c00d950 tx=0x7faf6c00de10 comp rx=0 tx=0).stop 2024-09-19T09:38:51.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.097+0000 7faf86d81640 1 -- 172.21.15.1:0/3883040690 shutdown_connections 2024-09-19T09:38:51.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.097+0000 7faf86d81640 1 --2- 172.21.15.1:0/3883040690 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7faf700a32c0 0x7faf700a5780 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.097+0000 7faf86d81640 1 --2- 172.21.15.1:0/3883040690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf80106f10 0x7faf8019cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.097+0000 7faf86d81640 1 --2- 172.21.15.1:0/3883040690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faf80102790 0x7faf80198900 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.097+0000 7faf86d81640 1 --2- 172.21.15.1:0/3883040690 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faf80101de0 0x7faf801983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:51.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.097+0000 7faf86d81640 1 -- 172.21.15.1:0/3883040690 >> 172.21.15.1:0/3883040690 conn(0x7faf800fd8e0 msgr2=0x7faf800ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:51.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.097+0000 7faf86d81640 1 -- 172.21.15.1:0/3883040690 shutdown_connections 2024-09-19T09:38:51.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:51.097+0000 7faf86d81640 1 -- 172.21.15.1:0/3883040690 wait complete. 2024-09-19T09:38:52.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:52 smithi022 ceph-mon[35583]: pgmap v361: 97 pgs: 97 active+clean; 657 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1.3 KiB/s wr, 4 op/s 2024-09-19T09:38:52.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:52 smithi121 ceph-mon[35577]: pgmap v361: 97 pgs: 97 active+clean; 657 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1.3 KiB/s wr, 4 op/s 2024-09-19T09:38:52.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:52 smithi001 ceph-mon[31225]: pgmap v361: 97 pgs: 97 active+clean; 657 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1.3 KiB/s wr, 4 op/s 2024-09-19T09:38:52.768 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:38:52.768 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:38:53.052 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:53.131 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:38:53.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.582+0000 7f9534ac8640 1 -- 172.21.15.1:0/3349586083 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9530102d40 msgr2=0x7f9530103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:53.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.582+0000 7f9534ac8640 1 --2- 172.21.15.1:0/3349586083 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9530102d40 0x7f9530103120 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9520009900 tx=0x7f952002a480 comp rx=0 tx=0).stop 2024-09-19T09:38:53.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.583+0000 7f9534ac8640 1 -- 172.21.15.1:0/3349586083 shutdown_connections 2024-09-19T09:38:53.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.583+0000 7f9534ac8640 1 --2- 172.21.15.1:0/3349586083 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f953010c170 0x7f953010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.583+0000 7f9534ac8640 1 --2- 172.21.15.1:0/3349586083 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9530103660 0x7f953010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.583+0000 7f9534ac8640 1 --2- 172.21.15.1:0/3349586083 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9530102d40 0x7f9530103120 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.583+0000 7f9534ac8640 1 -- 172.21.15.1:0/3349586083 >> 172.21.15.1:0/3349586083 conn(0x7f95300fc7a0 msgr2=0x7f95300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:53.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.583+0000 7f9534ac8640 1 -- 172.21.15.1:0/3349586083 shutdown_connections 2024-09-19T09:38:53.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.583+0000 7f9534ac8640 1 -- 172.21.15.1:0/3349586083 wait complete. 2024-09-19T09:38:53.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.583+0000 7f9534ac8640 1 Processor -- start 2024-09-19T09:38:53.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.584+0000 7f9534ac8640 1 -- start start 2024-09-19T09:38:53.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.584+0000 7f9534ac8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9530102d40 0x7f9530198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.584+0000 7f9534ac8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9530103660 0x7f9530198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.584+0000 7f9534ac8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f953010c170 0x7f953019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.584+0000 7f952e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9530102d40 0x7f9530198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.584+0000 7f952e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9530102d40 0x7f9530198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49968/0 (socket says 172.21.15.1:49968) 2024-09-19T09:38:53.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.584+0000 7f952e59c640 1 -- 172.21.15.1:0/329758506 learned_addr learned my addr 172.21.15.1:0/329758506 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:53.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.584+0000 7f9534ac8640 1 -- 172.21.15.1:0/329758506 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9530111f70 con 0x7f9530102d40 2024-09-19T09:38:53.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.584+0000 7f9534ac8640 1 -- 172.21.15.1:0/329758506 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9530111df0 con 0x7f953010c170 2024-09-19T09:38:53.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.584+0000 7f9534ac8640 1 -- 172.21.15.1:0/329758506 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f95301120f0 con 0x7f9530103660 2024-09-19T09:38:53.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.584+0000 7f952dd9b640 1 --2- 172.21.15.1:0/329758506 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9530103660 0x7f9530198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.584+0000 7f952ed9d640 1 --2- 172.21.15.1:0/329758506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f953010c170 0x7f953019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.585+0000 7f952dd9b640 1 -- 172.21.15.1:0/329758506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f953010c170 msgr2=0x7f953019cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:53.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.585+0000 7f952dd9b640 1 --2- 172.21.15.1:0/329758506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f953010c170 0x7f953019cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.585+0000 7f952dd9b640 1 -- 172.21.15.1:0/329758506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9530102d40 msgr2=0x7f9530198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:53.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.585+0000 7f952dd9b640 1 --2- 172.21.15.1:0/329758506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9530102d40 0x7f9530198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.585+0000 7f952dd9b640 1 -- 172.21.15.1:0/329758506 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f953019d400 con 0x7f9530103660 2024-09-19T09:38:53.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.585+0000 7f952e59c640 1 --2- 172.21.15.1:0/329758506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9530102d40 0x7f9530198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:38:53.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.585+0000 7f952dd9b640 1 --2- 172.21.15.1:0/329758506 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9530103660 0x7f9530198990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9518005fd0 tx=0x7f951800db60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:53.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.585+0000 7f95277fe640 1 -- 172.21.15.1:0/329758506 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9518004230 con 0x7f9530103660 2024-09-19T09:38:53.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.585+0000 7f9534ac8640 1 -- 172.21.15.1:0/329758506 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f953019d6f0 con 0x7f9530103660 2024-09-19T09:38:53.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.585+0000 7f95277fe640 1 -- 172.21.15.1:0/329758506 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95180043d0 con 0x7f9530103660 2024-09-19T09:38:53.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.585+0000 7f95277fe640 1 -- 172.21.15.1:0/329758506 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9518010460 con 0x7f9530103660 2024-09-19T09:38:53.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.585+0000 7f9534ac8640 1 -- 172.21.15.1:0/329758506 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95301a4fd0 con 0x7f9530103660 2024-09-19T09:38:53.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.588+0000 7f95277fe640 1 -- 172.21.15.1:0/329758506 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f9518009820 con 0x7f9530103660 2024-09-19T09:38:53.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.588+0000 7f95277fe640 1 --2- 172.21.15.1:0/329758506 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f951c0a3240 0x7f951c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.589+0000 7f952e59c640 1 --2- 172.21.15.1:0/329758506 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f951c0a3240 0x7f951c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.589+0000 7f95277fe640 1 -- 172.21.15.1:0/329758506 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f95180cf370 con 0x7f9530103660 2024-09-19T09:38:53.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.589+0000 7f9536ea1740 1 Processor -- start 2024-09-19T09:38:53.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.589+0000 7f9536ea1740 1 -- start start 2024-09-19T09:38:53.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.589+0000 7f952e59c640 1 --2- 172.21.15.1:0/329758506 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f951c0a3240 0x7f951c0a5700 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f95200096c0 tx=0x7f9520005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:53.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.589+0000 7f9536ea1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b73902ab60 0x55b73902af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.589+0000 7f9536ea1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b73902b480 0x55b739035800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.590+0000 7f9536ea1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b739035d40 0x55b739038130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.590+0000 7f952e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b73902ab60 0x55b73902af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.590+0000 7f952dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b73902b480 0x55b739035800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.590+0000 7f9536ea1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b738f90280 con 0x55b73902ab60 2024-09-19T09:38:53.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.590+0000 7f952dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b73902b480 0x55b739035800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:45008/0 (socket says 172.21.15.1:45008) 2024-09-19T09:38:53.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.590+0000 7f952dd9b640 1 -- 172.21.15.1:0/2055090922 learned_addr learned my addr 172.21.15.1:0/2055090922 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:53.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.590+0000 7f9536ea1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b738f37b10 con 0x55b73902b480 2024-09-19T09:38:53.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.590+0000 7f9536ea1740 1 -- 172.21.15.1:0/2055090922 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b738f8c240 con 0x55b739035d40 2024-09-19T09:38:53.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.590+0000 7f952e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b73902ab60 0x55b73902af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49972/0 (socket says 172.21.15.1:49972) 2024-09-19T09:38:53.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.590+0000 7f952ed9d640 1 --2- 172.21.15.1:0/2055090922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b739035d40 0x55b739038130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.590+0000 7f952dd9b640 1 -- 172.21.15.1:0/2055090922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b739035d40 msgr2=0x55b739038130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:53.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.590+0000 7f952dd9b640 1 --2- 172.21.15.1:0/2055090922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b739035d40 0x55b739038130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.590+0000 7f952dd9b640 1 -- 172.21.15.1:0/2055090922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b73902ab60 msgr2=0x55b73902af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:53.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.590+0000 7f952dd9b640 1 --2- 172.21.15.1:0/2055090922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b73902ab60 0x55b73902af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.590+0000 7f952dd9b640 1 -- 172.21.15.1:0/2055090922 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b738f441f0 con 0x55b73902b480 2024-09-19T09:38:53.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.590+0000 7f952dd9b640 1 --2- 172.21.15.1:0/2055090922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b73902b480 0x55b739035800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f95180983d0 tx=0x7f9518003fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b9d29c7e7cfc9ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:53.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.591+0000 7f9524ff9640 1 -- 172.21.15.1:0/2055090922 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9518020070 con 0x55b73902b480 2024-09-19T09:38:53.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.591+0000 7f9524ff9640 1 -- 172.21.15.1:0/2055090922 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95180a45c0 con 0x55b73902b480 2024-09-19T09:38:53.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.591+0000 7f9524ff9640 1 -- 172.21.15.1:0/2055090922 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9518009d10 con 0x55b73902b480 2024-09-19T09:38:53.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.591+0000 7f9536ea1740 1 -- 172.21.15.1:0/2055090922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b73902b480 msgr2=0x55b739035800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:53.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.591+0000 7f9536ea1740 1 --2- 172.21.15.1:0/2055090922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b73902b480 0x55b739035800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f95180983d0 tx=0x7f9518003fb0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.591+0000 7f9536ea1740 1 -- 172.21.15.1:0/2055090922 shutdown_connections 2024-09-19T09:38:53.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.591+0000 7f9536ea1740 1 --2- 172.21.15.1:0/2055090922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b739035d40 0x55b739038130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.591+0000 7f9536ea1740 1 --2- 172.21.15.1:0/2055090922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b73902b480 0x55b739035800 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.591+0000 7f9536ea1740 1 --2- 172.21.15.1:0/2055090922 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b73902ab60 0x55b73902af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.591+0000 7f9536ea1740 1 -- 172.21.15.1:0/2055090922 >> 172.21.15.1:0/2055090922 conn(0x55b7390270f0 msgr2=0x55b7390274d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:53.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.592+0000 7f9536ea1740 1 -- 172.21.15.1:0/2055090922 shutdown_connections 2024-09-19T09:38:53.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.592+0000 7f9536ea1740 1 -- 172.21.15.1:0/2055090922 wait complete. 2024-09-19T09:38:53.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.592+0000 7f9536ea1740 1 -- start start 2024-09-19T09:38:53.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.592+0000 7f9536ea1740 1 Processor -- start 2024-09-19T09:38:53.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.592+0000 7f9536ea1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b73902ab60 0x55b739032cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.592+0000 7f9536ea1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b73902b480 0x55b739033200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.592+0000 7f9536ea1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b739035d40 0x55b739033740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.593+0000 7f9536ea1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b739038910 con 0x55b73902b480 2024-09-19T09:38:53.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.593+0000 7f9536ea1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b738f4af10 con 0x55b73902ab60 2024-09-19T09:38:53.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.593+0000 7f9536ea1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b739038a90 con 0x55b739035d40 2024-09-19T09:38:53.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.593+0000 7f9536ea1740 10 client.0 _ll_register_callbacks cb 0x55b738f13a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:53.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.593+0000 7f952dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b73902b480 0x55b739033200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.593+0000 7f952dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b73902b480 0x55b739033200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49986/0 (socket says 172.21.15.1:49986) 2024-09-19T09:38:53.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.593+0000 7f952dd9b640 1 -- 172.21.15.1:0/1555349327 learned_addr learned my addr 172.21.15.1:0/1555349327 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:53.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.593+0000 7f952e59c640 1 --2- 172.21.15.1:0/1555349327 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b73902ab60 0x55b739032cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.593+0000 7f952ed9d640 1 --2- 172.21.15.1:0/1555349327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b739035d40 0x55b739033740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.593+0000 7f952dd9b640 1 -- 172.21.15.1:0/1555349327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b739035d40 msgr2=0x55b739033740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:53.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.593+0000 7f952dd9b640 1 --2- 172.21.15.1:0/1555349327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b739035d40 0x55b739033740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.593+0000 7f952dd9b640 1 -- 172.21.15.1:0/1555349327 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b73902ab60 msgr2=0x55b739032cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:53.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.593+0000 7f952dd9b640 1 --2- 172.21.15.1:0/1555349327 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b73902ab60 0x55b739032cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.593+0000 7f952dd9b640 1 -- 172.21.15.1:0/1555349327 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b738d016a0 con 0x55b73902b480 2024-09-19T09:38:53.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.593+0000 7f952ed9d640 1 --2- 172.21.15.1:0/1555349327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b739035d40 0x55b739033740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:53.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.593+0000 7f952dd9b640 1 --2- 172.21.15.1:0/1555349327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b73902b480 0x55b739033200 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f951809b990 tx=0x7f95180982d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71c3d52218e1cd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:53.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.593+0000 7f9515ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:38:53.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.594+0000 7f9515ffb640 1 -- 172.21.15.1:0/1555349327 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9518020040 con 0x55b73902b480 2024-09-19T09:38:53.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.594+0000 7f9515ffb640 1 -- 172.21.15.1:0/1555349327 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f95180ba2a0 con 0x55b73902b480 2024-09-19T09:38:53.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.594+0000 7f9536ea1740 1 -- 172.21.15.1:0/1555349327 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95180a45c0 con 0x55b73902b480 2024-09-19T09:38:53.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.594+0000 7f9515ffb640 1 -- 172.21.15.1:0/1555349327 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9518081050 con 0x55b73902b480 2024-09-19T09:38:53.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.594+0000 7f9536ea1740 10 client.15354 fetch_fsmap learned FSMap version 19 2024-09-19T09:38:53.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.594+0000 7f9536ea1740 1 -- 172.21.15.1:0/1555349327 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55b7390445c0 con 0x55b73902b480 2024-09-19T09:38:53.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.594+0000 7f9515ffb640 1 -- 172.21.15.1:0/1555349327 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95180a45c0 con 0x55b73902b480 2024-09-19T09:38:53.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.594+0000 7f9515ffb640 1 -- 172.21.15.1:0/1555349327 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f95180ce070 con 0x55b73902b480 2024-09-19T09:38:53.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.594+0000 7f9536ea1740 10 client.15354 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:38:53.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.594+0000 7f9536ea1740 10 client.15354 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:38:53.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.595+0000 7f9536ea1740 20 client.15354 populate_metadata read hostname 'smithi001' 2024-09-19T09:38:53.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.595+0000 7f9536ea1740 1 --2- 172.21.15.1:0/1555349327 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b739045910 0x55b739047d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.595+0000 7f9536ea1740 4 client.15354 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:38:53.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.595+0000 7f9536ea1740 1 -- 172.21.15.1:0/1555349327 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b738f9d7f0 con 0x55b739045910 2024-09-19T09:38:53.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.595+0000 7f952e59c640 1 --2- 172.21.15.1:0/1555349327 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b739045910 0x55b739047d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.596+0000 7f9515ffb640 10 client.15354 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:53.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.596+0000 7f952e59c640 1 --2- 172.21.15.1:0/1555349327 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b739045910 0x55b739047d00 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f978f1a580a15c5f server_cookie=c6924bc943151f46 in_seq=0 out_seq=0 2024-09-19T09:38:53.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.596+0000 7f9515ffb640 1 -- 172.21.15.1:0/1555349327 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b738f9d7f0 con 0x55b739045910 2024-09-19T09:38:53.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.596+0000 7f9515ffb640 10 client.15354 handle_command_reply: tid=0 2024-09-19T09:38:53.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.596+0000 7f9536ea1740 1 client.15354 shutdown 2024-09-19T09:38:53.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.597+0000 7f9536ea1740 1 -- 172.21.15.1:0/1555349327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b73902b480 msgr2=0x55b739033200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:53.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.597+0000 7f9536ea1740 1 --2- 172.21.15.1:0/1555349327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b73902b480 0x55b739033200 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f951809b990 tx=0x7f95180982d0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.597+0000 7f9536ea1740 1 -- 172.21.15.1:0/1555349327 shutdown_connections 2024-09-19T09:38:53.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.597+0000 7f9536ea1740 1 --2- 172.21.15.1:0/1555349327 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b739045910 0x55b739047d00 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.597+0000 7f9536ea1740 1 --2- 172.21.15.1:0/1555349327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b739035d40 0x55b739033740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.597+0000 7f9536ea1740 1 --2- 172.21.15.1:0/1555349327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b73902b480 0x55b739033200 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.597+0000 7f9515ffb640 0 client.15354 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:53.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.597+0000 7f9536ea1740 1 --2- 172.21.15.1:0/1555349327 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b73902ab60 0x55b739032cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.597+0000 7f9536ea1740 1 -- 172.21.15.1:0/1555349327 >> 172.21.15.1:0/1555349327 conn(0x55b7390270f0 msgr2=0x55b73902ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:53.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.597+0000 7f9536ea1740 1 -- 172.21.15.1:0/1555349327 shutdown_connections 2024-09-19T09:38:53.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.597+0000 7f9536ea1740 1 -- 172.21.15.1:0/1555349327 wait complete. 2024-09-19T09:38:53.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.598+0000 7f9536ea1740 20 client.15354 trim_cache size 0 max 16384 2024-09-19T09:38:53.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.618+0000 7f9536ea1740 1 Processor -- start 2024-09-19T09:38:53.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.618+0000 7f9536ea1740 1 -- start start 2024-09-19T09:38:53.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.619+0000 7f9536ea1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b73902ab60 0x55b739034b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.619+0000 7f9536ea1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b73902b480 0x55b739033590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.619+0000 7f9536ea1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b739035d40 0x55b73902ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.619+0000 7f9536ea1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f95301a93e0 con 0x55b73902b480 2024-09-19T09:38:53.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.619+0000 7f9536ea1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f95301abc80 con 0x55b739035d40 2024-09-19T09:38:53.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.619+0000 7f9536ea1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f95301a9a70 con 0x55b73902ab60 2024-09-19T09:38:53.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.619+0000 7f952dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b73902b480 0x55b739033590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.619+0000 7f952dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b73902b480 0x55b739033590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50002/0 (socket says 172.21.15.1:50002) 2024-09-19T09:38:53.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.619+0000 7f952dd9b640 1 -- 172.21.15.1:0/3927735234 learned_addr learned my addr 172.21.15.1:0/3927735234 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:53.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.619+0000 7f952ed9d640 1 --2- 172.21.15.1:0/3927735234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b739035d40 0x55b73902ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.619+0000 7f952dd9b640 1 -- 172.21.15.1:0/3927735234 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b73902ab60 msgr2=0x55b739034b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:53.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.619+0000 7f952dd9b640 1 --2- 172.21.15.1:0/3927735234 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b73902ab60 0x55b739034b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.619+0000 7f952dd9b640 1 -- 172.21.15.1:0/3927735234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b739035d40 msgr2=0x55b73902ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:53.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.619+0000 7f952dd9b640 1 --2- 172.21.15.1:0/3927735234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b739035d40 0x55b73902ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.619+0000 7f952dd9b640 1 -- 172.21.15.1:0/3927735234 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b739035590 con 0x55b73902b480 2024-09-19T09:38:53.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.620+0000 7f952dd9b640 1 --2- 172.21.15.1:0/3927735234 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b73902b480 0x55b739033590 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f951809b700 tx=0x7f9518003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d707cdd3269826b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:53.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.620+0000 7f9517fff640 1 -- 172.21.15.1:0/3927735234 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9518020070 con 0x55b73902b480 2024-09-19T09:38:53.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.620+0000 7f9517fff640 1 -- 172.21.15.1:0/3927735234 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95180035f0 con 0x55b73902b480 2024-09-19T09:38:53.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.620+0000 7f9517fff640 1 -- 172.21.15.1:0/3927735234 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951809a8c0 con 0x55b73902b480 2024-09-19T09:38:53.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.621+0000 7f9536ea1740 1 -- 172.21.15.1:0/3927735234 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b73902b480 msgr2=0x55b739033590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:53.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.621+0000 7f9536ea1740 1 --2- 172.21.15.1:0/3927735234 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b73902b480 0x55b739033590 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f951809b700 tx=0x7f9518003910 comp rx=0 tx=0).stop 2024-09-19T09:38:53.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.621+0000 7f9536ea1740 1 -- 172.21.15.1:0/3927735234 shutdown_connections 2024-09-19T09:38:53.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.621+0000 7f9536ea1740 1 --2- 172.21.15.1:0/3927735234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b739035d40 0x55b73902ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.621+0000 7f9536ea1740 1 --2- 172.21.15.1:0/3927735234 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b73902b480 0x55b739033590 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.621+0000 7f9536ea1740 1 --2- 172.21.15.1:0/3927735234 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b73902ab60 0x55b739034b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.621+0000 7f9536ea1740 1 -- 172.21.15.1:0/3927735234 >> 172.21.15.1:0/3927735234 conn(0x55b7390270f0 msgr2=0x55b739034410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:53.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.621+0000 7f9536ea1740 1 -- 172.21.15.1:0/3927735234 shutdown_connections 2024-09-19T09:38:53.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.621+0000 7f9536ea1740 1 -- 172.21.15.1:0/3927735234 wait complete. 2024-09-19T09:38:53.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.622+0000 7f9536ea1740 1 -- start start 2024-09-19T09:38:53.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.622+0000 7f9536ea1740 1 Processor -- start 2024-09-19T09:38:53.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.622+0000 7f9536ea1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b73902ab60 0x55b73904b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.623+0000 7f9536ea1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b73902b480 0x55b739049710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.623+0000 7f9536ea1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b739035d40 0x55b739049c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.623+0000 7f952dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b73902b480 0x55b739049710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.623+0000 7f952e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b73902ab60 0x55b73904b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.623+0000 7f952e59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b73902ab60 0x55b73904b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:36656/0 (socket says 172.21.15.1:36656) 2024-09-19T09:38:53.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.623+0000 7f952e59c640 1 -- 172.21.15.1:0/1538754201 learned_addr learned my addr 172.21.15.1:0/1538754201 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:53.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.623+0000 7f952dd9b640 1 --2- 172.21.15.1:0/1538754201 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b73902b480 0x55b739049710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50012/0 (socket says 172.21.15.1:50012) 2024-09-19T09:38:53.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.623+0000 7f9536ea1740 1 -- 172.21.15.1:0/1538754201 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f95301aa140 con 0x55b73902b480 2024-09-19T09:38:53.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.623+0000 7f9536ea1740 1 -- 172.21.15.1:0/1538754201 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f95301ab5b0 con 0x55b739035d40 2024-09-19T09:38:53.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.623+0000 7f9536ea1740 1 -- 172.21.15.1:0/1538754201 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f95301aa810 con 0x55b73902ab60 2024-09-19T09:38:53.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.623+0000 7f952ed9d640 1 --2- 172.21.15.1:0/1538754201 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b739035d40 0x55b739049c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.623+0000 7f9536ea1740 10 client.0 _ll_register_callbacks cb 0x7f951809f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:53.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.624+0000 7f952dd9b640 1 -- 172.21.15.1:0/1538754201 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b73902ab60 msgr2=0x55b73904b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:53.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.624+0000 7f952dd9b640 1 --2- 172.21.15.1:0/1538754201 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b73902ab60 0x55b73904b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.624+0000 7f952dd9b640 1 -- 172.21.15.1:0/1538754201 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b739035d40 msgr2=0x55b739049c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:53.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.624+0000 7f952dd9b640 1 --2- 172.21.15.1:0/1538754201 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b739035d40 0x55b739049c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.624+0000 7f952dd9b640 1 -- 172.21.15.1:0/1538754201 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b73904a3c0 con 0x55b73902b480 2024-09-19T09:38:53.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.624+0000 7f952ed9d640 1 --2- 172.21.15.1:0/1538754201 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b739035d40 0x55b739049c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:53.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.624+0000 7f952dd9b640 1 --2- 172.21.15.1:0/1538754201 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b73902b480 0x55b739049710 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x55b73904def0 tx=0x7f9518005b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=938b670dfc0a56ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:53.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.624+0000 7f9515ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:38:53.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.624+0000 7f9515ffb640 1 -- 172.21.15.1:0/1538754201 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95180b3070 con 0x55b73902b480 2024-09-19T09:38:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.624+0000 7f9515ffb640 1 -- 172.21.15.1:0/1538754201 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f9518097750 con 0x55b73902b480 2024-09-19T09:38:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.624+0000 7f9536ea1740 1 -- 172.21.15.1:0/1538754201 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95180035f0 con 0x55b73902b480 2024-09-19T09:38:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.624+0000 7f9515ffb640 1 -- 172.21.15.1:0/1538754201 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9518020050 con 0x55b73902b480 2024-09-19T09:38:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.624+0000 7f9536ea1740 10 client.15360 fetch_fsmap learned FSMap version 19 2024-09-19T09:38:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.624+0000 7f9536ea1740 1 -- 172.21.15.1:0/1538754201 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55b73904a3c0 con 0x55b73902b480 2024-09-19T09:38:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.625+0000 7f9515ffb640 1 -- 172.21.15.1:0/1538754201 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95180a45c0 con 0x55b73902b480 2024-09-19T09:38:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.625+0000 7f9515ffb640 1 -- 172.21.15.1:0/1538754201 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f95180ad050 con 0x55b73902b480 2024-09-19T09:38:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.625+0000 7f9536ea1740 10 client.15360 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:38:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.625+0000 7f9536ea1740 10 client.15360 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:38:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.625+0000 7f9536ea1740 20 client.15360 populate_metadata read hostname 'smithi001' 2024-09-19T09:38:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.625+0000 7f9536ea1740 1 --2- 172.21.15.1:0/1538754201 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b7390ab520 0x55b7390ab900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.625+0000 7f9536ea1740 4 client.15360 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:38:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.625+0000 7f9536ea1740 1 -- 172.21.15.1:0/1538754201 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f95180035f0 con 0x55b7390ab520 2024-09-19T09:38:53.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.625+0000 7f952e59c640 1 --2- 172.21.15.1:0/1538754201 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b7390ab520 0x55b7390ab900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:53.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.626+0000 7f952e59c640 1 --2- 172.21.15.1:0/1538754201 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b7390ab520 0x55b7390ab900 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78ea3c8550af935d server_cookie=e33d53c0119930ba in_seq=0 out_seq=0 2024-09-19T09:38:53.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.626+0000 7f9515ffb640 10 client.15360 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:53.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.627+0000 7f9515ffb640 1 -- 172.21.15.1:0/1538754201 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f95180035f0 con 0x55b7390ab520 2024-09-19T09:38:53.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.627+0000 7f9515ffb640 10 client.15360 handle_command_reply: tid=0 2024-09-19T09:38:53.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.627+0000 7f9536ea1740 1 client.15360 shutdown 2024-09-19T09:38:53.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.627+0000 7f9536ea1740 1 -- 172.21.15.1:0/1538754201 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b73902b480 msgr2=0x55b739049710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:53.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.627+0000 7f9536ea1740 1 --2- 172.21.15.1:0/1538754201 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b73902b480 0x55b739049710 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x55b73904def0 tx=0x7f9518005b90 comp rx=0 tx=0).stop 2024-09-19T09:38:53.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.627+0000 7f9536ea1740 1 -- 172.21.15.1:0/1538754201 shutdown_connections 2024-09-19T09:38:53.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.627+0000 7f9536ea1740 1 --2- 172.21.15.1:0/1538754201 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b7390ab520 0x55b7390ab900 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.627+0000 7f9536ea1740 1 --2- 172.21.15.1:0/1538754201 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b739035d40 0x55b739049c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.628+0000 7f9515ffb640 0 client.15360 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:53.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.628+0000 7f9536ea1740 1 --2- 172.21.15.1:0/1538754201 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b73902b480 0x55b739049710 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.628+0000 7f9536ea1740 1 --2- 172.21.15.1:0/1538754201 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b73902ab60 0x55b73904b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.628+0000 7f9536ea1740 1 -- 172.21.15.1:0/1538754201 >> 172.21.15.1:0/1538754201 conn(0x55b7390270f0 msgr2=0x55b739041500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:53.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.628+0000 7f9536ea1740 1 -- 172.21.15.1:0/1538754201 shutdown_connections 2024-09-19T09:38:53.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.628+0000 7f9536ea1740 1 -- 172.21.15.1:0/1538754201 wait complete. 2024-09-19T09:38:53.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.628+0000 7f9536ea1740 20 client.15360 trim_cache size 0 max 16384 2024-09-19T09:38:53.633 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:38:53.633 INFO:teuthology.orchestra.run.smithi001.stdout: "return_code": 0, 2024-09-19T09:38:53.634 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_tag": "0b4e51b2-88c1-4464-a03a-5ed371200584", 2024-09-19T09:38:53.634 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": "asynchronous" 2024-09-19T09:38:53.634 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:38:53.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.629+0000 7f9534ac8640 1 -- 172.21.15.1:0/329758506 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f951c0a3240 msgr2=0x7f951c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:53.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.629+0000 7f9534ac8640 1 --2- 172.21.15.1:0/329758506 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f951c0a3240 0x7f951c0a5700 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f95200096c0 tx=0x7f9520005a20 comp rx=0 tx=0).stop 2024-09-19T09:38:53.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.629+0000 7f9534ac8640 1 -- 172.21.15.1:0/329758506 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9530103660 msgr2=0x7f9530198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:53.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.629+0000 7f9534ac8640 1 --2- 172.21.15.1:0/329758506 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9530103660 0x7f9530198990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9518005fd0 tx=0x7f951800db60 comp rx=0 tx=0).stop 2024-09-19T09:38:53.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.629+0000 7f9534ac8640 1 -- 172.21.15.1:0/329758506 shutdown_connections 2024-09-19T09:38:53.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.629+0000 7f9534ac8640 1 --2- 172.21.15.1:0/329758506 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f951c0a3240 0x7f951c0a5700 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.629+0000 7f9534ac8640 1 --2- 172.21.15.1:0/329758506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f953010c170 0x7f953019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.629+0000 7f9534ac8640 1 --2- 172.21.15.1:0/329758506 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9530103660 0x7f9530198990 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.629+0000 7f9534ac8640 1 --2- 172.21.15.1:0/329758506 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9530102d40 0x7f9530198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:53.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.629+0000 7f9534ac8640 1 -- 172.21.15.1:0/329758506 >> 172.21.15.1:0/329758506 conn(0x7f95300fc7a0 msgr2=0x7f95300fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:53.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.629+0000 7f9534ac8640 1 -- 172.21.15.1:0/329758506 shutdown_connections 2024-09-19T09:38:53.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:53.629+0000 7f9534ac8640 1 -- 172.21.15.1:0/329758506 wait complete. 2024-09-19T09:38:53.933 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:54.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:54 smithi022 ceph-mon[35583]: pgmap v362: 97 pgs: 97 active+clean; 658 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-19T09:38:54.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:54 smithi121 ceph-mon[35577]: pgmap v362: 97 pgs: 97 active+clean; 658 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-19T09:38:54.367 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:54 smithi001 ceph-mon[31225]: pgmap v362: 97 pgs: 97 active+clean; 658 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-19T09:38:54.407 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:38:54.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.861+0000 7fb49fde0640 1 -- 172.21.15.1:0/3163542073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4981036e0 msgr2=0x7fb498107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:54.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.861+0000 7fb49fde0640 1 --2- 172.21.15.1:0/3163542073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4981036e0 0x7fb498107b90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb488009930 tx=0x7fb48802a420 comp rx=0 tx=0).stop 2024-09-19T09:38:54.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.861+0000 7fb49fde0640 1 -- 172.21.15.1:0/3163542073 shutdown_connections 2024-09-19T09:38:54.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.861+0000 7fb49fde0640 1 --2- 172.21.15.1:0/3163542073 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4981082a0 0x7fb49810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:54.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.861+0000 7fb49fde0640 1 --2- 172.21.15.1:0/3163542073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4981036e0 0x7fb498107b90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:54.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.861+0000 7fb49fde0640 1 --2- 172.21.15.1:0/3163542073 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb498102d30 0x7fb498103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:54.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.862+0000 7fb49fde0640 1 -- 172.21.15.1:0/3163542073 >> 172.21.15.1:0/3163542073 conn(0x7fb4980fc7d0 msgr2=0x7fb4980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:54.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.862+0000 7fb49fde0640 1 -- 172.21.15.1:0/3163542073 shutdown_connections 2024-09-19T09:38:54.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.862+0000 7fb49fde0640 1 -- 172.21.15.1:0/3163542073 wait complete. 2024-09-19T09:38:54.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.862+0000 7fb49fde0640 1 Processor -- start 2024-09-19T09:38:54.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.863+0000 7fb49fde0640 1 -- start start 2024-09-19T09:38:54.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.863+0000 7fb49fde0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb498102d30 0x7fb498100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:54.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.863+0000 7fb49fde0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4981036e0 0x7fb498100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:54.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.863+0000 7fb49fde0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4981082a0 0x7fb498101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:54.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.863+0000 7fb49fde0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb4981120a0 con 0x7fb4981082a0 2024-09-19T09:38:54.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.863+0000 7fb49fde0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb498111f20 con 0x7fb4981036e0 2024-09-19T09:38:54.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.863+0000 7fb49fde0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb498112220 con 0x7fb498102d30 2024-09-19T09:38:54.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.863+0000 7fb49db7c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb498102d30 0x7fb498100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:54.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.863+0000 7fb49db7c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb498102d30 0x7fb498100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:36674/0 (socket says 172.21.15.1:36674) 2024-09-19T09:38:54.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.863+0000 7fb49db7c640 1 -- 172.21.15.1:0/3845402560 learned_addr learned my addr 172.21.15.1:0/3845402560 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:54.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.863+0000 7fb49e37d640 1 --2- 172.21.15.1:0/3845402560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4981082a0 0x7fb498101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:54.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.863+0000 7fb49d37b640 1 --2- 172.21.15.1:0/3845402560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4981036e0 0x7fb498100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:54.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.864+0000 7fb49db7c640 1 -- 172.21.15.1:0/3845402560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4981036e0 msgr2=0x7fb498100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:54.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.864+0000 7fb49db7c640 1 --2- 172.21.15.1:0/3845402560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4981036e0 0x7fb498100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:54.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.864+0000 7fb49db7c640 1 -- 172.21.15.1:0/3845402560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4981082a0 msgr2=0x7fb498101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:54.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.864+0000 7fb49db7c640 1 --2- 172.21.15.1:0/3845402560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4981082a0 0x7fb498101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:54.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.864+0000 7fb49db7c640 1 -- 172.21.15.1:0/3845402560 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4981a6ac0 con 0x7fb498102d30 2024-09-19T09:38:54.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.864+0000 7fb49d37b640 1 --2- 172.21.15.1:0/3845402560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4981036e0 0x7fb498100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:54.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.864+0000 7fb49db7c640 1 --2- 172.21.15.1:0/3845402560 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb498102d30 0x7fb498100990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb49400e9f0 tx=0x7fb49400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:54.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.864+0000 7fb48effd640 1 -- 172.21.15.1:0/3845402560 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49400ccc0 con 0x7fb498102d30 2024-09-19T09:38:54.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.864+0000 7fb49fde0640 1 -- 172.21.15.1:0/3845402560 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4981a6db0 con 0x7fb498102d30 2024-09-19T09:38:54.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.864+0000 7fb49fde0640 1 -- 172.21.15.1:0/3845402560 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4981a7260 con 0x7fb498102d30 2024-09-19T09:38:54.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.864+0000 7fb48effd640 1 -- 172.21.15.1:0/3845402560 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb49400ce60 con 0x7fb498102d30 2024-09-19T09:38:54.869 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.864+0000 7fb48effd640 1 -- 172.21.15.1:0/3845402560 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb494010430 con 0x7fb498102d30 2024-09-19T09:38:54.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.866+0000 7fb49fde0640 1 -- 172.21.15.1:0/3845402560 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb47c005290 con 0x7fb498102d30 2024-09-19T09:38:54.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.868+0000 7fb48effd640 1 -- 172.21.15.1:0/3845402560 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fb4940046c0 con 0x7fb498102d30 2024-09-19T09:38:54.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.869+0000 7fb48effd640 1 --2- 172.21.15.1:0/3845402560 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb4840a32c0 0x7fb4840a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:54.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.869+0000 7fb48effd640 1 -- 172.21.15.1:0/3845402560 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fb4940cfc30 con 0x7fb498102d30 2024-09-19T09:38:54.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.869+0000 7fb49d37b640 1 --2- 172.21.15.1:0/3845402560 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb4840a32c0 0x7fb4840a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:54.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.869+0000 7fb49d37b640 1 --2- 172.21.15.1:0/3845402560 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb4840a32c0 0x7fb4840a5780 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb488009900 tx=0x7fb488005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:54.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:54.873+0000 7fb48effd640 1 -- 172.21.15.1:0/3845402560 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb49409c950 con 0x7fb498102d30 2024-09-19T09:38:54.917 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:55.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.246+0000 7fb49fde0640 1 -- 172.21.15.1:0/3845402560 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb47c005580 con 0x7fb498102d30 2024-09-19T09:38:55.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.247+0000 7fb48effd640 1 -- 172.21.15.1:0/3845402560 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11837 (secure 0 0 0) 0x7fb49409c250 con 0x7fb498102d30 2024-09-19T09:38:55.249 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:38:55.249 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":19,"btime":"2024-09-19T09:36:24:006349+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:36:23.723388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6839/3279971690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3279971690},{"type":"v1","addr":"172.21.15.121:6839","nonce":3279971690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:38:55.250 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 19 2024-09-19T09:38:55.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.249+0000 7fb49fde0640 1 -- 172.21.15.1:0/3845402560 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb4840a32c0 msgr2=0x7fb4840a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:55.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.250+0000 7fb49fde0640 1 --2- 172.21.15.1:0/3845402560 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb4840a32c0 0x7fb4840a5780 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb488009900 tx=0x7fb488005a20 comp rx=0 tx=0).stop 2024-09-19T09:38:55.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.250+0000 7fb49fde0640 1 -- 172.21.15.1:0/3845402560 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb498102d30 msgr2=0x7fb498100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:55.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.250+0000 7fb49fde0640 1 --2- 172.21.15.1:0/3845402560 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb498102d30 0x7fb498100990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb49400e9f0 tx=0x7fb49400edf0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.250+0000 7fb49fde0640 1 -- 172.21.15.1:0/3845402560 shutdown_connections 2024-09-19T09:38:55.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.250+0000 7fb49fde0640 1 --2- 172.21.15.1:0/3845402560 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4981082a0 0x7fb498101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.250+0000 7fb49fde0640 1 --2- 172.21.15.1:0/3845402560 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb4840a32c0 0x7fb4840a5780 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.250+0000 7fb49fde0640 1 --2- 172.21.15.1:0/3845402560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4981036e0 0x7fb498100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.250+0000 7fb49fde0640 1 --2- 172.21.15.1:0/3845402560 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb498102d30 0x7fb498100990 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.250+0000 7fb49fde0640 1 -- 172.21.15.1:0/3845402560 >> 172.21.15.1:0/3845402560 conn(0x7fb4980fc7d0 msgr2=0x7fb498105ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:55.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.250+0000 7fb49fde0640 1 -- 172.21.15.1:0/3845402560 shutdown_connections 2024-09-19T09:38:55.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.250+0000 7fb49fde0640 1 -- 172.21.15.1:0/3845402560 wait complete. 2024-09-19T09:38:55.358 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:55 smithi001 ceph-mon[31225]: scrub queued for path: / 2024-09-19T09:38:55.358 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:55 smithi001 ceph-mon[31225]: scrub summary: idle+waiting paths [/] 2024-09-19T09:38:55.358 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:55 smithi001 ceph-mon[31225]: scrub summary: active paths [/] 2024-09-19T09:38:55.358 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:55 smithi001 ceph-mon[31225]: scrub summary: idle+waiting paths [/] 2024-09-19T09:38:55.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:55 smithi022 ceph-mon[35583]: scrub queued for path: / 2024-09-19T09:38:55.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:55 smithi022 ceph-mon[35583]: scrub summary: idle+waiting paths [/] 2024-09-19T09:38:55.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:55 smithi022 ceph-mon[35583]: scrub summary: active paths [/] 2024-09-19T09:38:55.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:55 smithi022 ceph-mon[35583]: scrub summary: idle+waiting paths [/] 2024-09-19T09:38:55.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:55 smithi121 ceph-mon[35577]: scrub queued for path: / 2024-09-19T09:38:55.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:55 smithi121 ceph-mon[35577]: scrub summary: idle+waiting paths [/] 2024-09-19T09:38:55.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:55 smithi121 ceph-mon[35577]: scrub summary: active paths [/] 2024-09-19T09:38:55.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:55 smithi121 ceph-mon[35577]: scrub summary: idle+waiting paths [/] 2024-09-19T09:38:55.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.470+0000 7fee8bc84640 1 -- 172.21.15.1:0/4031899427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee84102ef0 msgr2=0x7fee8410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:55.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.470+0000 7fee8bc84640 1 --2- 172.21.15.1:0/4031899427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee84102ef0 0x7fee8410da40 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fee7c009ca0 tx=0x7fee7c02a950 comp rx=0 tx=0).stop 2024-09-19T09:38:55.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.471+0000 7fee8bc84640 1 -- 172.21.15.1:0/4031899427 shutdown_connections 2024-09-19T09:38:55.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.471+0000 7fee8bc84640 1 --2- 172.21.15.1:0/4031899427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee84102ef0 0x7fee8410da40 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.471+0000 7fee8bc84640 1 --2- 172.21.15.1:0/4031899427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee84102570 0x7fee841029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.471+0000 7fee8bc84640 1 --2- 172.21.15.1:0/4031899427 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee84100e20 0x7fee84101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.471+0000 7fee8bc84640 1 -- 172.21.15.1:0/4031899427 >> 172.21.15.1:0/4031899427 conn(0x7fee840fc7d0 msgr2=0x7fee840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:55.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.471+0000 7fee8bc84640 1 -- 172.21.15.1:0/4031899427 shutdown_connections 2024-09-19T09:38:55.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.471+0000 7fee8bc84640 1 -- 172.21.15.1:0/4031899427 wait complete. 2024-09-19T09:38:55.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.471+0000 7fee8bc84640 1 Processor -- start 2024-09-19T09:38:55.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.471+0000 7fee8bc84640 1 -- start start 2024-09-19T09:38:55.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.472+0000 7fee8bc84640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee84100e20 0x7fee84198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:55.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.472+0000 7fee8bc84640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee84102570 0x7fee84198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:55.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.472+0000 7fee8bc84640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee84102ef0 0x7fee8419cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:55.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.472+0000 7fee8bc84640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fee84110f80 con 0x7fee84102570 2024-09-19T09:38:55.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.472+0000 7fee8bc84640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fee84110e00 con 0x7fee84102ef0 2024-09-19T09:38:55.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.472+0000 7fee8bc84640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fee84111100 con 0x7fee84100e20 2024-09-19T09:38:55.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.472+0000 7fee8921f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee84102570 0x7fee84198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:55.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.472+0000 7fee8921f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee84102570 0x7fee84198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59222/0 (socket says 172.21.15.1:59222) 2024-09-19T09:38:55.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.472+0000 7fee8921f640 1 -- 172.21.15.1:0/2254631531 learned_addr learned my addr 172.21.15.1:0/2254631531 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:55.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.472+0000 7fee8a221640 1 --2- 172.21.15.1:0/2254631531 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee84102ef0 0x7fee8419cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:55.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.472+0000 7fee89a20640 1 --2- 172.21.15.1:0/2254631531 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee84100e20 0x7fee84198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:55.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.473+0000 7fee8a221640 1 -- 172.21.15.1:0/2254631531 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee84100e20 msgr2=0x7fee84198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:55.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.473+0000 7fee8a221640 1 --2- 172.21.15.1:0/2254631531 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee84100e20 0x7fee84198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.473+0000 7fee8a221640 1 -- 172.21.15.1:0/2254631531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee84102570 msgr2=0x7fee84198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:55.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.473+0000 7fee8a221640 1 --2- 172.21.15.1:0/2254631531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee84102570 0x7fee84198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.473+0000 7fee8a221640 1 -- 172.21.15.1:0/2254631531 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee8419d4b0 con 0x7fee84102ef0 2024-09-19T09:38:55.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.473+0000 7fee8921f640 1 --2- 172.21.15.1:0/2254631531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee84102570 0x7fee84198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:38:55.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.473+0000 7fee8a221640 1 --2- 172.21.15.1:0/2254631531 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee84102ef0 0x7fee8419cdd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fee7c005cc0 tx=0x7fee7c02f9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:55.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.473+0000 7fee7affd640 1 -- 172.21.15.1:0/2254631531 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7c050070 con 0x7fee84102ef0 2024-09-19T09:38:55.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.473+0000 7fee7affd640 1 -- 172.21.15.1:0/2254631531 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee7c003970 con 0x7fee84102ef0 2024-09-19T09:38:55.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.473+0000 7fee7affd640 1 -- 172.21.15.1:0/2254631531 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7c034040 con 0x7fee84102ef0 2024-09-19T09:38:55.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.473+0000 7fee8bc84640 1 -- 172.21.15.1:0/2254631531 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee8419d740 con 0x7fee84102ef0 2024-09-19T09:38:55.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.474+0000 7fee8bc84640 1 -- 172.21.15.1:0/2254631531 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee8419db10 con 0x7fee84102ef0 2024-09-19T09:38:55.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.477+0000 7fee7affd640 1 -- 172.21.15.1:0/2254631531 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fee7c053070 con 0x7fee84102ef0 2024-09-19T09:38:55.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.477+0000 7fee8e05d740 1 Processor -- start 2024-09-19T09:38:55.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.478+0000 7fee8e05d740 1 -- start start 2024-09-19T09:38:55.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.478+0000 7fee8e05d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631d9b344a0 0x5631d9b34880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:55.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.478+0000 7fee8e05d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631d9b34dc0 0x5631d9b3f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:55.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.478+0000 7fee8e05d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5631d9b3f680 0x5631d9b41a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:55.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.478+0000 7fee8e05d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5631d9a9a2e0 con 0x5631d9b3f680 2024-09-19T09:38:55.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.478+0000 7fee8e05d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5631d9a41ce0 con 0x5631d9b34dc0 2024-09-19T09:38:55.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.478+0000 7fee8e05d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5631d9a962a0 con 0x5631d9b344a0 2024-09-19T09:38:55.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.478+0000 7fee8921f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5631d9b3f680 0x5631d9b41a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:55.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.478+0000 7fee8921f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5631d9b3f680 0x5631d9b41a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59234/0 (socket says 172.21.15.1:59234) 2024-09-19T09:38:55.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.478+0000 7fee8921f640 1 -- 172.21.15.1:0/1126557396 learned_addr learned my addr 172.21.15.1:0/1126557396 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:55.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.478+0000 7fee7affd640 1 --2- 172.21.15.1:0/2254631531 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fee700a3340 0x7fee700a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:55.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.478+0000 7fee8921f640 1 --2- 172.21.15.1:0/1126557396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631d9b344a0 0x5631d9b34880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:55.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.478+0000 7fee7affd640 1 -- 172.21.15.1:0/2254631531 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fee7c0f84c0 con 0x7fee84102ef0 2024-09-19T09:38:55.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.479+0000 7fee8a221640 1 --2- 172.21.15.1:0/2254631531 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fee700a3340 0x7fee700a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:55.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.479+0000 7fee8921f640 1 -- 172.21.15.1:0/1126557396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631d9b344a0 msgr2=0x5631d9b34880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:55.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.479+0000 7fee8921f640 1 --2- 172.21.15.1:0/1126557396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631d9b344a0 0x5631d9b34880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.479+0000 7fee8921f640 1 -- 172.21.15.1:0/1126557396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631d9b34dc0 msgr2=0x5631d9b3f140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:38:55.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.479+0000 7fee8921f640 1 --2- 172.21.15.1:0/1126557396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631d9b34dc0 0x5631d9b3f140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.479+0000 7fee8921f640 1 -- 172.21.15.1:0/1126557396 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631d9a26440 con 0x5631d9b3f680 2024-09-19T09:38:55.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.479+0000 7fee8a221640 1 --2- 172.21.15.1:0/2254631531 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fee700a3340 0x7fee700a5800 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fee7c009ca0 tx=0x7fee7c0304d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:55.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.479+0000 7fee8921f640 1 --2- 172.21.15.1:0/1126557396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5631d9b3f680 0x5631d9b41a70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fee74011db0 tx=0x7fee74009590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d65a971dd1877509 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:55.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.480+0000 7fee6ffff640 1 -- 172.21.15.1:0/1126557396 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee74027030 con 0x5631d9b3f680 2024-09-19T09:38:55.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.480+0000 7fee6ffff640 1 -- 172.21.15.1:0/1126557396 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee7400fe50 con 0x5631d9b3f680 2024-09-19T09:38:55.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.480+0000 7fee6ffff640 1 -- 172.21.15.1:0/1126557396 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7402a040 con 0x5631d9b3f680 2024-09-19T09:38:55.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.481+0000 7fee8e05d740 1 -- 172.21.15.1:0/1126557396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5631d9b3f680 msgr2=0x5631d9b41a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:55.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.481+0000 7fee8e05d740 1 --2- 172.21.15.1:0/1126557396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5631d9b3f680 0x5631d9b41a70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fee74011db0 tx=0x7fee74009590 comp rx=0 tx=0).stop 2024-09-19T09:38:55.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.481+0000 7fee8e05d740 1 -- 172.21.15.1:0/1126557396 shutdown_connections 2024-09-19T09:38:55.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.481+0000 7fee8e05d740 1 --2- 172.21.15.1:0/1126557396 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5631d9b3f680 0x5631d9b41a70 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.481+0000 7fee8e05d740 1 --2- 172.21.15.1:0/1126557396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631d9b34dc0 0x5631d9b3f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.481+0000 7fee8e05d740 1 --2- 172.21.15.1:0/1126557396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631d9b344a0 0x5631d9b34880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.481+0000 7fee8e05d740 1 -- 172.21.15.1:0/1126557396 >> 172.21.15.1:0/1126557396 conn(0x5631d9b30a30 msgr2=0x5631d9b30e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:55.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.481+0000 7fee8e05d740 1 -- 172.21.15.1:0/1126557396 shutdown_connections 2024-09-19T09:38:55.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.481+0000 7fee8e05d740 1 -- 172.21.15.1:0/1126557396 wait complete. 2024-09-19T09:38:55.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.482+0000 7fee8e05d740 1 -- start start 2024-09-19T09:38:55.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.482+0000 7fee8e05d740 1 Processor -- start 2024-09-19T09:38:55.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.482+0000 7fee8e05d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631d9b344a0 0x5631d9b3f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:55.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.482+0000 7fee8e05d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631d9b34dc0 0x5631d9b3c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:55.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.482+0000 7fee8e05d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5631d9b3f680 0x5631d9b3c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:55.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.482+0000 7fee8e05d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5631d9b42250 con 0x5631d9b3f680 2024-09-19T09:38:55.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.482+0000 7fee8e05d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5631d9a55050 con 0x5631d9b344a0 2024-09-19T09:38:55.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.482+0000 7fee8e05d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5631d9b423d0 con 0x5631d9b34dc0 2024-09-19T09:38:55.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.483+0000 7fee8921f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5631d9b3f680 0x5631d9b3c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:55.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.483+0000 7fee8921f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5631d9b3f680 0x5631d9b3c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59244/0 (socket says 172.21.15.1:59244) 2024-09-19T09:38:55.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.483+0000 7fee8921f640 1 -- 172.21.15.1:0/3526481054 learned_addr learned my addr 172.21.15.1:0/3526481054 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:55.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.483+0000 7fee8921f640 1 --2- 172.21.15.1:0/3526481054 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631d9b344a0 0x5631d9b3f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:55.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.483+0000 7fee89a20640 1 --2- 172.21.15.1:0/3526481054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631d9b34dc0 0x5631d9b3c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:55.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.483+0000 7fee8e05d740 10 client.0 _ll_register_callbacks cb 0x5631d9a95160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:55.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.483+0000 7fee8921f640 1 -- 172.21.15.1:0/3526481054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631d9b34dc0 msgr2=0x5631d9b3c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:55.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.483+0000 7fee8921f640 1 --2- 172.21.15.1:0/3526481054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631d9b34dc0 0x5631d9b3c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.483+0000 7fee8921f640 1 -- 172.21.15.1:0/3526481054 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631d9b344a0 msgr2=0x5631d9b3f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:55.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.483+0000 7fee8921f640 1 --2- 172.21.15.1:0/3526481054 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631d9b344a0 0x5631d9b3f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.483+0000 7fee8921f640 1 -- 172.21.15.1:0/3526481054 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631d980b3c0 con 0x5631d9b3f680 2024-09-19T09:38:55.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.483+0000 7fee8921f640 1 --2- 172.21.15.1:0/3526481054 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5631d9b3f680 0x5631d9b3c880 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fee74011560 tx=0x7fee7402e3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11bd09bf5ca223b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:55.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.483+0000 7fee6d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:38:55.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.483+0000 7fee6d7fa640 1 -- 172.21.15.1:0/3526481054 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee74027070 con 0x5631d9b3f680 2024-09-19T09:38:55.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.484+0000 7fee6d7fa640 1 -- 172.21.15.1:0/3526481054 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fee740119f0 con 0x5631d9b3f680 2024-09-19T09:38:55.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.484+0000 7fee8e05d740 1 -- 172.21.15.1:0/3526481054 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee7400fe50 con 0x5631d9b3f680 2024-09-19T09:38:55.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.484+0000 7fee6d7fa640 1 -- 172.21.15.1:0/3526481054 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fee74045050 con 0x5631d9b3f680 2024-09-19T09:38:55.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.484+0000 7fee8e05d740 10 client.15378 fetch_fsmap learned FSMap version 19 2024-09-19T09:38:55.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.484+0000 7fee8e05d740 1 -- 172.21.15.1:0/3526481054 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5631d9b4dc20 con 0x5631d9b3f680 2024-09-19T09:38:55.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.484+0000 7fee6d7fa640 1 -- 172.21.15.1:0/3526481054 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee74005620 con 0x5631d9b3f680 2024-09-19T09:38:55.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.484+0000 7fee6d7fa640 1 -- 172.21.15.1:0/3526481054 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fee74004680 con 0x5631d9b3f680 2024-09-19T09:38:55.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.484+0000 7fee8e05d740 10 client.15378 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:38:55.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.484+0000 7fee8e05d740 10 client.15378 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:38:55.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.485+0000 7fee8e05d740 20 client.15378 populate_metadata read hostname 'smithi001' 2024-09-19T09:38:55.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.485+0000 7fee8e05d740 1 --2- 172.21.15.1:0/3526481054 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5631d9b4ef70 0x5631d9b51360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:55.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.485+0000 7fee8e05d740 4 client.15378 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:38:55.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.485+0000 7fee8e05d740 1 -- 172.21.15.1:0/3526481054 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fee7400fe50 con 0x5631d9b4ef70 2024-09-19T09:38:55.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.485+0000 7fee89a20640 1 --2- 172.21.15.1:0/3526481054 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5631d9b4ef70 0x5631d9b51360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:55.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.485+0000 7fee89a20640 1 --2- 172.21.15.1:0/3526481054 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5631d9b4ef70 0x5631d9b51360 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2df4b80502e872e2 server_cookie=712747c4cf164a42 in_seq=0 out_seq=0 2024-09-19T09:38:55.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.485+0000 7fee6d7fa640 10 client.15378 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:55.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.486+0000 7fee6d7fa640 1 -- 172.21.15.1:0/3526481054 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fee7400fe50 con 0x5631d9b4ef70 2024-09-19T09:38:55.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.486+0000 7fee6d7fa640 10 client.15378 handle_command_reply: tid=0 2024-09-19T09:38:55.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.486+0000 7fee8e05d740 1 client.15378 shutdown 2024-09-19T09:38:55.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.486+0000 7fee8e05d740 1 -- 172.21.15.1:0/3526481054 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5631d9b3f680 msgr2=0x5631d9b3c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:55.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.486+0000 7fee8e05d740 1 --2- 172.21.15.1:0/3526481054 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5631d9b3f680 0x5631d9b3c880 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fee74011560 tx=0x7fee7402e3f0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.486+0000 7fee8e05d740 1 -- 172.21.15.1:0/3526481054 shutdown_connections 2024-09-19T09:38:55.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.486+0000 7fee8e05d740 1 --2- 172.21.15.1:0/3526481054 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5631d9b4ef70 0x5631d9b51360 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.486+0000 7fee8e05d740 1 --2- 172.21.15.1:0/3526481054 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5631d9b3f680 0x5631d9b3c880 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.486+0000 7fee8e05d740 1 --2- 172.21.15.1:0/3526481054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631d9b34dc0 0x5631d9b3c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.486+0000 7fee8e05d740 1 --2- 172.21.15.1:0/3526481054 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631d9b344a0 0x5631d9b3f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.486+0000 7fee8e05d740 1 -- 172.21.15.1:0/3526481054 >> 172.21.15.1:0/3526481054 conn(0x5631d9b30a30 msgr2=0x5631d9b36710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:55.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.486+0000 7fee6d7fa640 0 client.15378 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:55.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.487+0000 7fee8e05d740 1 -- 172.21.15.1:0/3526481054 shutdown_connections 2024-09-19T09:38:55.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.487+0000 7fee8e05d740 1 -- 172.21.15.1:0/3526481054 wait complete. 2024-09-19T09:38:55.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.487+0000 7fee8e05d740 20 client.15378 trim_cache size 0 max 16384 2024-09-19T09:38:55.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.520+0000 7fee8e05d740 1 Processor -- start 2024-09-19T09:38:55.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.520+0000 7fee8e05d740 1 -- start start 2024-09-19T09:38:55.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.521+0000 7fee8e05d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5631d9b344a0 0x5631d9b4b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:55.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.521+0000 7fee8e05d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631d9b34dc0 0x5631d9b56bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:55.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.521+0000 7fee8e05d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631d9b3f680 0x5631d9b57100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:55.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.521+0000 7fee8e05d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fee841a92f0 con 0x5631d9b344a0 2024-09-19T09:38:55.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.521+0000 7fee8e05d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fee841abb90 con 0x5631d9b34dc0 2024-09-19T09:38:55.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.521+0000 7fee8e05d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fee841a9980 con 0x5631d9b3f680 2024-09-19T09:38:55.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.521+0000 7fee89a20640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631d9b34dc0 0x5631d9b56bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:55.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.521+0000 7fee89a20640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631d9b34dc0 0x5631d9b56bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:46364/0 (socket says 172.21.15.1:46364) 2024-09-19T09:38:55.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.521+0000 7fee89a20640 1 -- 172.21.15.1:0/3148849155 learned_addr learned my addr 172.21.15.1:0/3148849155 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:55.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.521+0000 7fee8921f640 1 --2- 172.21.15.1:0/3148849155 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5631d9b344a0 0x5631d9b4b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:55.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.521+0000 7fee89a20640 1 -- 172.21.15.1:0/3148849155 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631d9b3f680 msgr2=0x5631d9b57100 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:38:55.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.521+0000 7fee89a20640 1 --2- 172.21.15.1:0/3148849155 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631d9b3f680 0x5631d9b57100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.521+0000 7fee89a20640 1 -- 172.21.15.1:0/3148849155 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5631d9b344a0 msgr2=0x5631d9b4b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:55.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.521+0000 7fee89a20640 1 --2- 172.21.15.1:0/3148849155 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5631d9b344a0 0x5631d9b4b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.521+0000 7fee89a20640 1 -- 172.21.15.1:0/3148849155 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631d9b34bb0 con 0x5631d9b34dc0 2024-09-19T09:38:55.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.521+0000 7fee8921f640 1 --2- 172.21.15.1:0/3148849155 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5631d9b344a0 0x5631d9b4b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:38:55.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.522+0000 7fee89a20640 1 --2- 172.21.15.1:0/3148849155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631d9b34dc0 0x5631d9b56bc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x5631d9b31890 tx=0x7fee80004410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce18deefcd48a545 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:55.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.522+0000 7fee6f7fe640 1 -- 172.21.15.1:0/3148849155 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee80003d50 con 0x5631d9b34dc0 2024-09-19T09:38:55.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.522+0000 7fee6f7fe640 1 -- 172.21.15.1:0/3148849155 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee80005530 con 0x5631d9b34dc0 2024-09-19T09:38:55.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.522+0000 7fee6f7fe640 1 -- 172.21.15.1:0/3148849155 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8001d470 con 0x5631d9b34dc0 2024-09-19T09:38:55.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.523+0000 7fee8e05d740 1 -- 172.21.15.1:0/3148849155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631d9b34dc0 msgr2=0x5631d9b56bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:55.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.523+0000 7fee8e05d740 1 --2- 172.21.15.1:0/3148849155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631d9b34dc0 0x5631d9b56bc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x5631d9b31890 tx=0x7fee80004410 comp rx=0 tx=0).stop 2024-09-19T09:38:55.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.523+0000 7fee8e05d740 1 -- 172.21.15.1:0/3148849155 shutdown_connections 2024-09-19T09:38:55.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.523+0000 7fee8e05d740 1 --2- 172.21.15.1:0/3148849155 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631d9b3f680 0x5631d9b57100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.523+0000 7fee8e05d740 1 --2- 172.21.15.1:0/3148849155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631d9b34dc0 0x5631d9b56bc0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.523+0000 7fee8e05d740 1 --2- 172.21.15.1:0/3148849155 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5631d9b344a0 0x5631d9b4b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.523+0000 7fee8e05d740 1 -- 172.21.15.1:0/3148849155 >> 172.21.15.1:0/3148849155 conn(0x5631d9b30a30 msgr2=0x5631d9b378b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:55.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.523+0000 7fee8e05d740 1 -- 172.21.15.1:0/3148849155 shutdown_connections 2024-09-19T09:38:55.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.523+0000 7fee8e05d740 1 -- 172.21.15.1:0/3148849155 wait complete. 2024-09-19T09:38:55.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.524+0000 7fee8e05d740 1 -- start start 2024-09-19T09:38:55.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.524+0000 7fee8e05d740 1 Processor -- start 2024-09-19T09:38:55.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.524+0000 7fee8e05d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631d9b344a0 0x5631d9b43360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:55.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.524+0000 7fee8e05d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631d9b34dc0 0x5631d9b438a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:55.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.524+0000 7fee8e05d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5631d9b3f680 0x5631d9b43de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:55.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.524+0000 7fee8e05d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fee841aa050 con 0x5631d9b3f680 2024-09-19T09:38:55.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.524+0000 7fee8e05d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fee841ab4c0 con 0x5631d9b34dc0 2024-09-19T09:38:55.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.524+0000 7fee8e05d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fee841aa720 con 0x5631d9b344a0 2024-09-19T09:38:55.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.524+0000 7fee8e05d740 10 client.0 _ll_register_callbacks cb 0x7fee74011710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:55.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.525+0000 7fee89a20640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631d9b34dc0 0x5631d9b438a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:55.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.525+0000 7fee89a20640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631d9b34dc0 0x5631d9b438a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:46372/0 (socket says 172.21.15.1:46372) 2024-09-19T09:38:55.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.525+0000 7fee89a20640 1 -- 172.21.15.1:0/1023391561 learned_addr learned my addr 172.21.15.1:0/1023391561 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:55.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.525+0000 7fee8921f640 1 --2- 172.21.15.1:0/1023391561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5631d9b3f680 0x5631d9b43de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:55.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.525+0000 7fee8921f640 1 --2- 172.21.15.1:0/1023391561 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631d9b344a0 0x5631d9b43360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:55.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.525+0000 7fee89a20640 1 -- 172.21.15.1:0/1023391561 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631d9b344a0 msgr2=0x5631d9b43360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:55.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.525+0000 7fee89a20640 1 --2- 172.21.15.1:0/1023391561 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631d9b344a0 0x5631d9b43360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.525+0000 7fee89a20640 1 -- 172.21.15.1:0/1023391561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5631d9b3f680 msgr2=0x5631d9b43de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:55.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.525+0000 7fee89a20640 1 --2- 172.21.15.1:0/1023391561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5631d9b3f680 0x5631d9b43de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.525+0000 7fee89a20640 1 -- 172.21.15.1:0/1023391561 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631d9bb8b90 con 0x5631d9b34dc0 2024-09-19T09:38:55.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.525+0000 7fee89a20640 1 --2- 172.21.15.1:0/1023391561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631d9b34dc0 0x5631d9b438a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x5631d9b31890 tx=0x7fee80004c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=163c4f8bca23faee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:55.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.525+0000 7fee6d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:38:55.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.526+0000 7fee6d7fa640 1 -- 172.21.15.1:0/1023391561 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee800048c0 con 0x5631d9b34dc0 2024-09-19T09:38:55.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.526+0000 7fee6d7fa640 1 -- 172.21.15.1:0/1023391561 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fee80005050 con 0x5631d9b34dc0 2024-09-19T09:38:55.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.526+0000 7fee8e05d740 1 -- 172.21.15.1:0/1023391561 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee80005530 con 0x5631d9b34dc0 2024-09-19T09:38:55.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.526+0000 7fee6d7fa640 1 -- 172.21.15.1:0/1023391561 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fee80005250 con 0x5631d9b34dc0 2024-09-19T09:38:55.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.526+0000 7fee8e05d740 10 client.25091 fetch_fsmap learned FSMap version 19 2024-09-19T09:38:55.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.526+0000 7fee8e05d740 1 -- 172.21.15.1:0/1023391561 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5631d9bb9e50 con 0x5631d9b34dc0 2024-09-19T09:38:55.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.526+0000 7fee6d7fa640 1 -- 172.21.15.1:0/1023391561 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee80005530 con 0x5631d9b34dc0 2024-09-19T09:38:55.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.526+0000 7fee6d7fa640 1 -- 172.21.15.1:0/1023391561 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fee8002a450 con 0x5631d9b34dc0 2024-09-19T09:38:55.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.526+0000 7fee8e05d740 10 client.25091 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:38:55.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.526+0000 7fee8e05d740 10 client.25091 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:38:55.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.527+0000 7fee8e05d740 20 client.25091 populate_metadata read hostname 'smithi001' 2024-09-19T09:38:55.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.527+0000 7fee8e05d740 1 --2- 172.21.15.1:0/1023391561 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5631d9bba5f0 0x5631d9bbca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:55.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.527+0000 7fee8e05d740 4 client.25091 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:38:55.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.527+0000 7fee8e05d740 1 -- 172.21.15.1:0/1023391561 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5631d9b315e0 con 0x5631d9bba5f0 2024-09-19T09:38:55.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.527+0000 7fee8921f640 1 --2- 172.21.15.1:0/1023391561 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5631d9bba5f0 0x5631d9bbca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:55.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.527+0000 7fee8921f640 1 --2- 172.21.15.1:0/1023391561 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5631d9bba5f0 0x5631d9bbca10 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2690833918ecc455 server_cookie=41ba6131df9db6d3 in_seq=0 out_seq=0 2024-09-19T09:38:55.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.527+0000 7fee6d7fa640 10 client.25091 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:55.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.527+0000 7fee6d7fa640 1 -- 172.21.15.1:0/1023391561 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5631d9b315e0 con 0x5631d9bba5f0 2024-09-19T09:38:55.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.527+0000 7fee6d7fa640 10 client.25091 handle_command_reply: tid=0 2024-09-19T09:38:55.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.528+0000 7fee8e05d740 1 client.25091 shutdown 2024-09-19T09:38:55.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.528+0000 7fee8e05d740 1 -- 172.21.15.1:0/1023391561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631d9b34dc0 msgr2=0x5631d9b438a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:55.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.528+0000 7fee8e05d740 1 --2- 172.21.15.1:0/1023391561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631d9b34dc0 0x5631d9b438a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x5631d9b31890 tx=0x7fee80004c40 comp rx=0 tx=0).stop 2024-09-19T09:38:55.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.528+0000 7fee8e05d740 1 -- 172.21.15.1:0/1023391561 shutdown_connections 2024-09-19T09:38:55.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.528+0000 7fee8e05d740 1 --2- 172.21.15.1:0/1023391561 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5631d9bba5f0 0x5631d9bbca10 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.528+0000 7fee8e05d740 1 --2- 172.21.15.1:0/1023391561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5631d9b3f680 0x5631d9b43de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.528+0000 7fee8e05d740 1 --2- 172.21.15.1:0/1023391561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5631d9b34dc0 0x5631d9b438a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.528+0000 7fee8e05d740 1 --2- 172.21.15.1:0/1023391561 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5631d9b344a0 0x5631d9b43360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.528+0000 7fee8e05d740 1 -- 172.21.15.1:0/1023391561 >> 172.21.15.1:0/1023391561 conn(0x5631d9b30a30 msgr2=0x5631d9b3db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:55.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.528+0000 7fee6d7fa640 0 client.25091 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:55.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.528+0000 7fee8e05d740 1 -- 172.21.15.1:0/1023391561 shutdown_connections 2024-09-19T09:38:55.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.528+0000 7fee8e05d740 1 -- 172.21.15.1:0/1023391561 wait complete. 2024-09-19T09:38:55.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.529+0000 7fee8e05d740 20 client.25091 trim_cache size 0 max 16384 2024-09-19T09:38:55.534 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:38:55.534 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:38:55.534 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": { 2024-09-19T09:38:55.535 INFO:teuthology.orchestra.run.smithi001.stdout: "0b4e51b2-88c1-4464-a03a-5ed371200584": { 2024-09-19T09:38:55.535 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-19T09:38:55.535 INFO:teuthology.orchestra.run.smithi001.stdout: "tag": "0b4e51b2-88c1-4464-a03a-5ed371200584", 2024-09-19T09:38:55.535 INFO:teuthology.orchestra.run.smithi001.stdout: "options": "recursive,force" 2024-09-19T09:38:55.535 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:38:55.535 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:38:55.535 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:38:55.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.529+0000 7fee8bc84640 1 -- 172.21.15.1:0/2254631531 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fee700a3340 msgr2=0x7fee700a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:55.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.529+0000 7fee8bc84640 1 --2- 172.21.15.1:0/2254631531 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fee700a3340 0x7fee700a5800 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fee7c009ca0 tx=0x7fee7c0304d0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.529+0000 7fee8bc84640 1 -- 172.21.15.1:0/2254631531 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee84102ef0 msgr2=0x7fee8419cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:55.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.529+0000 7fee8bc84640 1 --2- 172.21.15.1:0/2254631531 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee84102ef0 0x7fee8419cdd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fee7c005cc0 tx=0x7fee7c02f9b0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.529+0000 7fee8bc84640 1 -- 172.21.15.1:0/2254631531 shutdown_connections 2024-09-19T09:38:55.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.529+0000 7fee8bc84640 1 --2- 172.21.15.1:0/2254631531 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fee700a3340 0x7fee700a5800 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.529+0000 7fee8bc84640 1 --2- 172.21.15.1:0/2254631531 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fee84102ef0 0x7fee8419cdd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.529+0000 7fee8bc84640 1 --2- 172.21.15.1:0/2254631531 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fee84102570 0x7fee84198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.529+0000 7fee8bc84640 1 --2- 172.21.15.1:0/2254631531 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee84100e20 0x7fee84198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:55.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.529+0000 7fee8bc84640 1 -- 172.21.15.1:0/2254631531 >> 172.21.15.1:0/2254631531 conn(0x7fee840fc7d0 msgr2=0x7fee8406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:55.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.530+0000 7fee8bc84640 1 -- 172.21.15.1:0/2254631531 shutdown_connections 2024-09-19T09:38:55.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:55.530+0000 7fee8bc84640 1 -- 172.21.15.1:0/2254631531 wait complete. 2024-09-19T09:38:56.170 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db --set-id 6dc2d874 --release --await' 2024-09-19T09:38:56.170 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db --set-id 6dc2d874 --release --await 2024-09-19T09:38:56.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:56 smithi022 ceph-mon[35583]: pgmap v363: 97 pgs: 97 active+clean; 658 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-19T09:38:56.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:56 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/3845402560' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:56.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:56 smithi121 ceph-mon[35577]: pgmap v363: 97 pgs: 97 active+clean; 658 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-19T09:38:56.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:56 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/3845402560' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:56.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:56 smithi001 ceph-mon[31225]: pgmap v363: 97 pgs: 97 active+clean; 658 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-19T09:38:56.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:56 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/3845402560' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:38:56.498 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:38:56.921 INFO:tasks.cephfs.filesystem:scrub status for tag:0b4e51b2-88c1-4464-a03a-5ed371200584 - {'path': '/', 'tag': '0b4e51b2-88c1-4464-a03a-5ed371200584', 'options': 'recursive,force'} 2024-09-19T09:38:57.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.431+0000 7f11d96fa640 1 -- 172.21.15.1:0/3294853598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11d4102790 msgr2=0x7f11d41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:57.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.431+0000 7f11d96fa640 1 --2- 172.21.15.1:0/3294853598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11d4102790 0x7f11d41067e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f11c8009900 tx=0x7f11c802a410 comp rx=0 tx=0).stop 2024-09-19T09:38:57.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.431+0000 7f11d96fa640 1 -- 172.21.15.1:0/3294853598 shutdown_connections 2024-09-19T09:38:57.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.431+0000 7f11d96fa640 1 --2- 172.21.15.1:0/3294853598 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11d4106f10 0x7f11d410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.431+0000 7f11d96fa640 1 --2- 172.21.15.1:0/3294853598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11d4102790 0x7f11d41067e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.431+0000 7f11d96fa640 1 --2- 172.21.15.1:0/3294853598 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11d4101de0 0x7f11d41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.431+0000 7f11d96fa640 1 -- 172.21.15.1:0/3294853598 >> 172.21.15.1:0/3294853598 conn(0x7f11d40fd8c0 msgr2=0x7f11d40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:57.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.432+0000 7f11d96fa640 1 -- 172.21.15.1:0/3294853598 shutdown_connections 2024-09-19T09:38:57.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.432+0000 7f11d96fa640 1 -- 172.21.15.1:0/3294853598 wait complete. 2024-09-19T09:38:57.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.432+0000 7f11d96fa640 1 Processor -- start 2024-09-19T09:38:57.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.432+0000 7f11d96fa640 1 -- start start 2024-09-19T09:38:57.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.433+0000 7f11d96fa640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11d4101de0 0x7f11d4198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:57.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.433+0000 7f11d96fa640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11d4102790 0x7f11d41989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:57.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.433+0000 7f11d96fa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11d4106f10 0x7f11d419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:57.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.433+0000 7f11d96fa640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f11d4111fc0 con 0x7f11d4101de0 2024-09-19T09:38:57.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.433+0000 7f11d2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11d4101de0 0x7f11d4198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:57.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.433+0000 7f11d2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11d4101de0 0x7f11d4198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59296/0 (socket says 172.21.15.1:59296) 2024-09-19T09:38:57.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.433+0000 7f11d2ffd640 1 -- 172.21.15.1:0/3033469547 learned_addr learned my addr 172.21.15.1:0/3033469547 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:57.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.433+0000 7f11d96fa640 1 -- 172.21.15.1:0/3033469547 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f11d4111e40 con 0x7f11d4106f10 2024-09-19T09:38:57.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.433+0000 7f11d96fa640 1 -- 172.21.15.1:0/3033469547 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f11d4112140 con 0x7f11d4102790 2024-09-19T09:38:57.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.433+0000 7f11d37fe640 1 --2- 172.21.15.1:0/3033469547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11d4106f10 0x7f11d419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:57.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.433+0000 7f11d27fc640 1 --2- 172.21.15.1:0/3033469547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11d4102790 0x7f11d41989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:57.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.434+0000 7f11d2ffd640 1 -- 172.21.15.1:0/3033469547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11d4102790 msgr2=0x7f11d41989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:57.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.434+0000 7f11d2ffd640 1 --2- 172.21.15.1:0/3033469547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11d4102790 0x7f11d41989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.434+0000 7f11d2ffd640 1 -- 172.21.15.1:0/3033469547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11d4106f10 msgr2=0x7f11d419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:57.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.434+0000 7f11d2ffd640 1 --2- 172.21.15.1:0/3033469547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11d4106f10 0x7f11d419cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.434+0000 7f11d2ffd640 1 -- 172.21.15.1:0/3033469547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11d419d410 con 0x7f11d4101de0 2024-09-19T09:38:57.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.434+0000 7f11d37fe640 1 --2- 172.21.15.1:0/3033469547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11d4106f10 0x7f11d419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:38:57.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.434+0000 7f11d2ffd640 1 --2- 172.21.15.1:0/3033469547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11d4101de0 0x7f11d4198460 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f11c400da90 tx=0x7f11c400df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:57.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.434+0000 7f11bbfff640 1 -- 172.21.15.1:0/3033469547 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c4017070 con 0x7f11d4101de0 2024-09-19T09:38:57.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.434+0000 7f11bbfff640 1 -- 172.21.15.1:0/3033469547 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11c4009c00 con 0x7f11d4101de0 2024-09-19T09:38:57.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.434+0000 7f11bbfff640 1 -- 172.21.15.1:0/3033469547 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c400f700 con 0x7f11d4101de0 2024-09-19T09:38:57.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.434+0000 7f11d96fa640 1 -- 172.21.15.1:0/3033469547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11d419d700 con 0x7f11d4101de0 2024-09-19T09:38:57.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.435+0000 7f11d96fa640 1 -- 172.21.15.1:0/3033469547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11d41a4fe0 con 0x7f11d4101de0 2024-09-19T09:38:57.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.438+0000 7f11dbad3740 1 Processor -- start 2024-09-19T09:38:57.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.438+0000 7f11dbad3740 1 -- start start 2024-09-19T09:38:57.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.438+0000 7f11dbad3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56492f694060 0x56492f694440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:57.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.438+0000 7f11dbad3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56492f694980 0x56492f69ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:57.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.438+0000 7f11dbad3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56492f69f240 0x56492f6a1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:57.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.438+0000 7f11dbad3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56492f5f9620 con 0x56492f694980 2024-09-19T09:38:57.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.438+0000 7f11dbad3740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56492f5a0e50 con 0x56492f694060 2024-09-19T09:38:57.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.438+0000 7f11dbad3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56492f5f55e0 con 0x56492f69f240 2024-09-19T09:38:57.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.438+0000 7f11d37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56492f694060 0x56492f694440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:57.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.438+0000 7f11d37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56492f694060 0x56492f694440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:46390/0 (socket says 172.21.15.1:46390) 2024-09-19T09:38:57.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.438+0000 7f11d37fe640 1 -- 172.21.15.1:0/1239735276 learned_addr learned my addr 172.21.15.1:0/1239735276 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:57.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.439+0000 7f11d27fc640 1 --2- 172.21.15.1:0/1239735276 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56492f69f240 0x56492f6a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:57.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.439+0000 7f11d37fe640 1 -- 172.21.15.1:0/1239735276 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56492f69f240 msgr2=0x56492f6a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:57.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.439+0000 7f11d37fe640 1 --2- 172.21.15.1:0/1239735276 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56492f69f240 0x56492f6a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.439+0000 7f11d37fe640 1 -- 172.21.15.1:0/1239735276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56492f694980 msgr2=0x56492f69ed00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:38:57.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.439+0000 7f11d37fe640 1 --2- 172.21.15.1:0/1239735276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56492f694980 0x56492f69ed00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.439+0000 7f11d37fe640 1 -- 172.21.15.1:0/1239735276 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56492f591d40 con 0x56492f694060 2024-09-19T09:38:57.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.439+0000 7f11d37fe640 1 --2- 172.21.15.1:0/1239735276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56492f694060 0x56492f694440 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f11cc0099d0 tx=0x7f11cc011c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea6d031b0c1d7967 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:57.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.439+0000 7f11b97fa640 1 -- 172.21.15.1:0/1239735276 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11cc003b70 con 0x56492f694060 2024-09-19T09:38:57.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.439+0000 7f11bbfff640 1 -- 172.21.15.1:0/3033469547 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f11c4010460 con 0x7f11d4101de0 2024-09-19T09:38:57.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.439+0000 7f11b97fa640 1 -- 172.21.15.1:0/1239735276 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11cc023070 con 0x56492f694060 2024-09-19T09:38:57.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.439+0000 7f11b97fa640 1 -- 172.21.15.1:0/1239735276 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11cc004690 con 0x56492f694060 2024-09-19T09:38:57.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.440+0000 7f11bbfff640 1 --2- 172.21.15.1:0/3033469547 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f11bc0a32c0 0x7f11bc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:57.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.440+0000 7f11dbad3740 1 -- 172.21.15.1:0/1239735276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56492f694060 msgr2=0x56492f694440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:57.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.440+0000 7f11dbad3740 1 --2- 172.21.15.1:0/1239735276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56492f694060 0x56492f694440 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f11cc0099d0 tx=0x7f11cc011c40 comp rx=0 tx=0).stop 2024-09-19T09:38:57.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.441+0000 7f11d2ffd640 1 --2- 172.21.15.1:0/3033469547 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f11bc0a32c0 0x7f11bc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:57.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.441+0000 7f11dbad3740 1 -- 172.21.15.1:0/1239735276 shutdown_connections 2024-09-19T09:38:57.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.441+0000 7f11dbad3740 1 --2- 172.21.15.1:0/1239735276 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56492f69f240 0x56492f6a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.441+0000 7f11dbad3740 1 --2- 172.21.15.1:0/1239735276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56492f694980 0x56492f69ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.441+0000 7f11dbad3740 1 --2- 172.21.15.1:0/1239735276 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56492f694060 0x56492f694440 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.441+0000 7f11dbad3740 1 -- 172.21.15.1:0/1239735276 >> 172.21.15.1:0/1239735276 conn(0x56492f6905f0 msgr2=0x56492f6909d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:57.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.441+0000 7f11bbfff640 1 -- 172.21.15.1:0/3033469547 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f11c40cf3c0 con 0x7f11d4101de0 2024-09-19T09:38:57.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.441+0000 7f11dbad3740 1 -- 172.21.15.1:0/1239735276 shutdown_connections 2024-09-19T09:38:57.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.441+0000 7f11dbad3740 1 -- 172.21.15.1:0/1239735276 wait complete. 2024-09-19T09:38:57.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.441+0000 7f11d2ffd640 1 --2- 172.21.15.1:0/3033469547 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f11bc0a32c0 0x7f11bc0a5780 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f11c40976c0 tx=0x7f11c4086050 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:57.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.441+0000 7f11dbad3740 1 -- start start 2024-09-19T09:38:57.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.442+0000 7f11dbad3740 1 Processor -- start 2024-09-19T09:38:57.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.442+0000 7f11dbad3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56492f694060 0x56492f69c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:57.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.442+0000 7f11dbad3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56492f694980 0x56492f69c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:57.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.442+0000 7f11dbad3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56492f69f240 0x56492f69cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:57.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.442+0000 7f11dbad3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56492f6a1e10 con 0x56492f694060 2024-09-19T09:38:57.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.442+0000 7f11dbad3740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56492f581f10 con 0x56492f69f240 2024-09-19T09:38:57.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.442+0000 7f11dbad3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56492f6a1f90 con 0x56492f694980 2024-09-19T09:38:57.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.442+0000 7f11dbad3740 10 client.0 _ll_register_callbacks cb 0x56492f5a5db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:57.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.442+0000 7f11d37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56492f694060 0x56492f69c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:57.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.442+0000 7f11d37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56492f694060 0x56492f69c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59312/0 (socket says 172.21.15.1:59312) 2024-09-19T09:38:57.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.442+0000 7f11d37fe640 1 -- 172.21.15.1:0/1694924583 learned_addr learned my addr 172.21.15.1:0/1694924583 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:57.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.443+0000 7f11d37fe640 1 --2- 172.21.15.1:0/1694924583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56492f69f240 0x56492f69cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:57.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.443+0000 7f11d27fc640 1 --2- 172.21.15.1:0/1694924583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56492f694980 0x56492f69c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:57.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.443+0000 7f11d37fe640 1 -- 172.21.15.1:0/1694924583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56492f694980 msgr2=0x56492f69c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:57.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.443+0000 7f11d37fe640 1 --2- 172.21.15.1:0/1694924583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56492f694980 0x56492f69c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.443+0000 7f11d37fe640 1 -- 172.21.15.1:0/1694924583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56492f69f240 msgr2=0x56492f69cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:57.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.443+0000 7f11d37fe640 1 --2- 172.21.15.1:0/1694924583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56492f69f240 0x56492f69cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.443+0000 7f11d37fe640 1 -- 172.21.15.1:0/1694924583 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56492f308580 con 0x56492f694060 2024-09-19T09:38:57.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.443+0000 7f11d37fe640 1 --2- 172.21.15.1:0/1694924583 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56492f694060 0x56492f69c0f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f11cc004390 tx=0x7f11cc004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2032e89e5bc0bbff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:57.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.443+0000 7f11b6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:38:57.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.444+0000 7f11b6ff5640 1 -- 172.21.15.1:0/1694924583 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11cc003e20 con 0x56492f694060 2024-09-19T09:38:57.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.444+0000 7f11dbad3740 1 -- 172.21.15.1:0/1694924583 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11cc023070 con 0x56492f694060 2024-09-19T09:38:57.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.444+0000 7f11b6ff5640 1 -- 172.21.15.1:0/1694924583 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f11cc00fbb0 con 0x56492f694060 2024-09-19T09:38:57.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.444+0000 7f11b6ff5640 1 -- 172.21.15.1:0/1694924583 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f11cc00fdb0 con 0x56492f694060 2024-09-19T09:38:57.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.444+0000 7f11dbad3740 10 client.15393 fetch_fsmap learned FSMap version 19 2024-09-19T09:38:57.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.444+0000 7f11dbad3740 1 -- 172.21.15.1:0/1694924583 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56492f3d2960 con 0x56492f694060 2024-09-19T09:38:57.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.444+0000 7f11b6ff5640 1 -- 172.21.15.1:0/1694924583 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11cc023070 con 0x56492f694060 2024-09-19T09:38:57.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.444+0000 7f11b6ff5640 1 -- 172.21.15.1:0/1694924583 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f11cc026380 con 0x56492f694060 2024-09-19T09:38:57.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.444+0000 7f11dbad3740 10 client.15393 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:38:57.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.445+0000 7f11dbad3740 10 client.15393 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:38:57.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.445+0000 7f11dbad3740 20 client.15393 populate_metadata read hostname 'smithi001' 2024-09-19T09:38:57.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.445+0000 7f11dbad3740 1 --2- 172.21.15.1:0/1694924583 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56492f6aec60 0x56492f6b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:57.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.445+0000 7f11dbad3740 4 client.15393 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:38:57.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.445+0000 7f11dbad3740 1 -- 172.21.15.1:0/1694924583 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56492f606b90 con 0x56492f6aec60 2024-09-19T09:38:57.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.445+0000 7f11d27fc640 1 --2- 172.21.15.1:0/1694924583 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56492f6aec60 0x56492f6b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:57.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.445+0000 7f11d27fc640 1 --2- 172.21.15.1:0/1694924583 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56492f6aec60 0x56492f6b1050 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6369a627cc91ec22 server_cookie=adc598c1d84c2d84 in_seq=0 out_seq=0 2024-09-19T09:38:57.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.445+0000 7f11b6ff5640 10 client.15393 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:57.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.446+0000 7f11b6ff5640 1 -- 172.21.15.1:0/1694924583 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56492f606b90 con 0x56492f6aec60 2024-09-19T09:38:57.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.446+0000 7f11b6ff5640 10 client.15393 handle_command_reply: tid=0 2024-09-19T09:38:57.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.446+0000 7f11dbad3740 1 client.15393 shutdown 2024-09-19T09:38:57.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.446+0000 7f11dbad3740 1 -- 172.21.15.1:0/1694924583 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56492f694060 msgr2=0x56492f69c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:57.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.446+0000 7f11dbad3740 1 --2- 172.21.15.1:0/1694924583 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56492f694060 0x56492f69c0f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f11cc004390 tx=0x7f11cc004290 comp rx=0 tx=0).stop 2024-09-19T09:38:57.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.447+0000 7f11dbad3740 1 -- 172.21.15.1:0/1694924583 shutdown_connections 2024-09-19T09:38:57.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.447+0000 7f11dbad3740 1 --2- 172.21.15.1:0/1694924583 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56492f6aec60 0x56492f6b1050 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.447+0000 7f11dbad3740 1 --2- 172.21.15.1:0/1694924583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56492f69f240 0x56492f69cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.447+0000 7f11dbad3740 1 --2- 172.21.15.1:0/1694924583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56492f694980 0x56492f69c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.447+0000 7f11dbad3740 1 --2- 172.21.15.1:0/1694924583 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56492f694060 0x56492f69c0f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.447+0000 7f11dbad3740 1 -- 172.21.15.1:0/1694924583 >> 172.21.15.1:0/1694924583 conn(0x56492f6905f0 msgr2=0x56492f696320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:57.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.447+0000 7f11b6ff5640 0 client.15393 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:57.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.447+0000 7f11dbad3740 1 -- 172.21.15.1:0/1694924583 shutdown_connections 2024-09-19T09:38:57.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.447+0000 7f11dbad3740 1 -- 172.21.15.1:0/1694924583 wait complete. 2024-09-19T09:38:57.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.447+0000 7f11dbad3740 20 client.15393 trim_cache size 0 max 16384 2024-09-19T09:38:57.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.480+0000 7f11dbad3740 1 Processor -- start 2024-09-19T09:38:57.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.480+0000 7f11dbad3740 1 -- start start 2024-09-19T09:38:57.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.480+0000 7f11dbad3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56492f694060 0x56492f696ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:57.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.480+0000 7f11dbad3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56492f694980 0x56492f68f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:57.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.480+0000 7f11dbad3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56492f69f240 0x56492f6b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:57.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.480+0000 7f11dbad3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f11d41a94c0 con 0x56492f69f240 2024-09-19T09:38:57.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.480+0000 7f11dbad3740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f11d41abd60 con 0x56492f694060 2024-09-19T09:38:57.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.480+0000 7f11dbad3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f11d41a9b50 con 0x56492f694980 2024-09-19T09:38:57.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.480+0000 7f11d37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56492f69f240 0x56492f6b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:57.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.480+0000 7f11d37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56492f69f240 0x56492f6b68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59318/0 (socket says 172.21.15.1:59318) 2024-09-19T09:38:57.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.480+0000 7f11d37fe640 1 -- 172.21.15.1:0/740366641 learned_addr learned my addr 172.21.15.1:0/740366641 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:57.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.480+0000 7f11d37fe640 1 --2- 172.21.15.1:0/740366641 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56492f694060 0x56492f696ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:57.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.481+0000 7f11d27fc640 1 --2- 172.21.15.1:0/740366641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56492f694980 0x56492f68f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:57.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.481+0000 7f11d37fe640 1 -- 172.21.15.1:0/740366641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56492f694980 msgr2=0x56492f68f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:57.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.481+0000 7f11d37fe640 1 --2- 172.21.15.1:0/740366641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56492f694980 0x56492f68f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.481+0000 7f11d37fe640 1 -- 172.21.15.1:0/740366641 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56492f694060 msgr2=0x56492f696ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:57.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.481+0000 7f11d37fe640 1 --2- 172.21.15.1:0/740366641 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56492f694060 0x56492f696ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.481+0000 7f11d37fe640 1 -- 172.21.15.1:0/740366641 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56492f6947b0 con 0x56492f69f240 2024-09-19T09:38:57.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.481+0000 7f11d37fe640 1 --2- 172.21.15.1:0/740366641 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56492f69f240 0x56492f6b68b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f11cc004710 tx=0x7f11cc02f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d4736e3c7c470e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:57.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.481+0000 7f11b8ff9640 1 -- 172.21.15.1:0/740366641 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11cc00f790 con 0x56492f69f240 2024-09-19T09:38:57.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.481+0000 7f11b8ff9640 1 -- 172.21.15.1:0/740366641 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11cc023070 con 0x56492f69f240 2024-09-19T09:38:57.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.481+0000 7f11b8ff9640 1 -- 172.21.15.1:0/740366641 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11cc028480 con 0x56492f69f240 2024-09-19T09:38:57.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.482+0000 7f11dbad3740 1 -- 172.21.15.1:0/740366641 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56492f69f240 msgr2=0x56492f6b68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:57.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.482+0000 7f11dbad3740 1 --2- 172.21.15.1:0/740366641 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56492f69f240 0x56492f6b68b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f11cc004710 tx=0x7f11cc02f040 comp rx=0 tx=0).stop 2024-09-19T09:38:57.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.483+0000 7f11dbad3740 1 -- 172.21.15.1:0/740366641 shutdown_connections 2024-09-19T09:38:57.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.483+0000 7f11dbad3740 1 --2- 172.21.15.1:0/740366641 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56492f69f240 0x56492f6b68b0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.483+0000 7f11dbad3740 1 --2- 172.21.15.1:0/740366641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56492f694980 0x56492f68f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.483+0000 7f11dbad3740 1 --2- 172.21.15.1:0/740366641 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56492f694060 0x56492f696ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.483+0000 7f11dbad3740 1 -- 172.21.15.1:0/740366641 >> 172.21.15.1:0/740366641 conn(0x56492f6905f0 msgr2=0x56492f68ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:57.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.483+0000 7f11dbad3740 1 -- 172.21.15.1:0/740366641 shutdown_connections 2024-09-19T09:38:57.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.483+0000 7f11dbad3740 1 -- 172.21.15.1:0/740366641 wait complete. 2024-09-19T09:38:57.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.483+0000 7f11dbad3740 1 -- start start 2024-09-19T09:38:57.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.483+0000 7f11dbad3740 1 Processor -- start 2024-09-19T09:38:57.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.484+0000 7f11dbad3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56492f694060 0x56492f6a7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:57.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.484+0000 7f11dbad3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56492f694980 0x56492f6a2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:57.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.484+0000 7f11dbad3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56492f69f240 0x56492f6a35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:57.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.484+0000 7f11dbad3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f11d41aa220 con 0x56492f69f240 2024-09-19T09:38:57.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.484+0000 7f11dbad3740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f11d41ab690 con 0x56492f694980 2024-09-19T09:38:57.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.484+0000 7f11dbad3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f11d41aa8f0 con 0x56492f694060 2024-09-19T09:38:57.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.484+0000 7f11dbad3740 10 client.0 _ll_register_callbacks cb 0x7f11cc003d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:38:57.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.484+0000 7f11d37fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56492f694060 0x56492f6a7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:57.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.484+0000 7f11d37fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56492f694060 0x56492f6a7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:39908/0 (socket says 172.21.15.1:39908) 2024-09-19T09:38:57.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.484+0000 7f11d37fe640 1 -- 172.21.15.1:0/104031700 learned_addr learned my addr 172.21.15.1:0/104031700 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:38:57.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.484+0000 7f11d27fc640 1 --2- 172.21.15.1:0/104031700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56492f694980 0x56492f6a2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:57.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.484+0000 7f11d37fe640 1 --2- 172.21.15.1:0/104031700 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56492f69f240 0x56492f6a35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:57.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.484+0000 7f11d27fc640 1 -- 172.21.15.1:0/104031700 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56492f694060 msgr2=0x56492f6a7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:57.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.484+0000 7f11d27fc640 1 --2- 172.21.15.1:0/104031700 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56492f694060 0x56492f6a7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.484+0000 7f11d27fc640 1 -- 172.21.15.1:0/104031700 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56492f69f240 msgr2=0x56492f6a35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:38:57.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.484+0000 7f11d27fc640 1 --2- 172.21.15.1:0/104031700 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56492f69f240 0x56492f6a35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.484+0000 7f11d27fc640 1 -- 172.21.15.1:0/104031700 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56492f718880 con 0x56492f694980 2024-09-19T09:38:57.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.485+0000 7f11d27fc640 1 --2- 172.21.15.1:0/104031700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56492f694980 0x56492f6a2e20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f11c802aa00 tx=0x7f11c80044e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=838e0de4b82e4409 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:38:57.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.485+0000 7f11b6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:38:57.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.485+0000 7f11b6ff5640 1 -- 172.21.15.1:0/104031700 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c8035040 con 0x56492f694980 2024-09-19T09:38:57.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.485+0000 7f11b6ff5640 1 -- 172.21.15.1:0/104031700 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f11c8005510 con 0x56492f694980 2024-09-19T09:38:57.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.485+0000 7f11dbad3740 1 -- 172.21.15.1:0/104031700 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11cc023070 con 0x56492f694980 2024-09-19T09:38:57.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.485+0000 7f11b6ff5640 1 -- 172.21.15.1:0/104031700 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f11c80046c0 con 0x56492f694980 2024-09-19T09:38:57.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.485+0000 7f11dbad3740 10 client.25109 fetch_fsmap learned FSMap version 19 2024-09-19T09:38:57.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.485+0000 7f11dbad3740 1 -- 172.21.15.1:0/104031700 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56492f719ae0 con 0x56492f694980 2024-09-19T09:38:57.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.486+0000 7f11b6ff5640 1 -- 172.21.15.1:0/104031700 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f11c8004d40 con 0x56492f694980 2024-09-19T09:38:57.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.486+0000 7f11b6ff5640 1 -- 172.21.15.1:0/104031700 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f11c8031c50 con 0x56492f694980 2024-09-19T09:38:57.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.486+0000 7f11dbad3740 10 client.25109 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:38:57.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.486+0000 7f11dbad3740 10 client.25109 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:38:57.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.486+0000 7f11dbad3740 20 client.25109 populate_metadata read hostname 'smithi001' 2024-09-19T09:38:57.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.486+0000 7f11dbad3740 1 --2- 172.21.15.1:0/104031700 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56492f71a2b0 0x56492f71c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:38:57.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.486+0000 7f11dbad3740 4 client.25109 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6dc2d874", "release": true, "await": true}] 2024-09-19T09:38:57.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.486+0000 7f11dbad3740 1 -- 172.21.15.1:0/104031700 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6dc2d874", "release": true, "await": true}) -- 0x7f11cc023070 con 0x56492f71a2b0 2024-09-19T09:38:57.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.486+0000 7f11d37fe640 1 --2- 172.21.15.1:0/104031700 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56492f71a2b0 0x56492f71c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:38:57.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.487+0000 7f11b6ff5640 10 client.25109 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:57.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.487+0000 7f11d37fe640 1 --2- 172.21.15.1:0/104031700 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56492f71a2b0 0x56492f71c6d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd354620944c49e0 server_cookie=7fb1593ca9f00f9 in_seq=0 out_seq=0 2024-09-19T09:38:57.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.488+0000 7f11b6ff5640 1 -- 172.21.15.1:0/104031700 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7f11cc023070 con 0x56492f71a2b0 2024-09-19T09:38:57.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.488+0000 7f11b6ff5640 10 client.25109 handle_command_reply: tid=0 2024-09-19T09:38:57.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.488+0000 7f11dbad3740 1 client.25109 shutdown 2024-09-19T09:38:57.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.488+0000 7f11dbad3740 1 -- 172.21.15.1:0/104031700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56492f694980 msgr2=0x56492f6a2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:57.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.488+0000 7f11dbad3740 1 --2- 172.21.15.1:0/104031700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56492f694980 0x56492f6a2e20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f11c802aa00 tx=0x7f11c80044e0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.489+0000 7f11dbad3740 1 -- 172.21.15.1:0/104031700 shutdown_connections 2024-09-19T09:38:57.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.489+0000 7f11dbad3740 1 --2- 172.21.15.1:0/104031700 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56492f71a2b0 0x56492f71c6d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.489+0000 7f11dbad3740 1 --2- 172.21.15.1:0/104031700 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56492f69f240 0x56492f6a35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.496 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:38:57.496 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 19, 2024-09-19T09:38:57.497 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24497, 2024-09-19T09:38:57.497 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 4, 2024-09-19T09:38:57.497 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T09:38:57.497 INFO:teuthology.orchestra.run.smithi001.stdout: "6dc2d874": { 2024-09-19T09:38:57.497 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 4, 2024-09-19T09:38:57.497 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T09:38:57.498 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:38:57.498 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T09:38:57.498 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:38:57.498 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:38:57.498 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T09:38:57.498 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 131.2, 2024-09-19T09:38:57.498 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T09:38:57.498 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T09:38:57.498 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T09:38:57.498 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:38:57.498 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T09:38:57.498 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:38:57.498 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:38:57.498 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:38:57.499 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:38:57.499 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:38:57.499 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:38:57.499 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:38:57.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.489+0000 7f11dbad3740 1 --2- 172.21.15.1:0/104031700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56492f694980 0x56492f6a2e20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.489+0000 7f11dbad3740 1 --2- 172.21.15.1:0/104031700 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56492f694060 0x56492f6a7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.489+0000 7f11dbad3740 1 -- 172.21.15.1:0/104031700 >> 172.21.15.1:0/104031700 conn(0x56492f6905f0 msgr2=0x56492f68f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:57.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.489+0000 7f11b6ff5640 0 client.25109 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:38:57.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.489+0000 7f11dbad3740 1 -- 172.21.15.1:0/104031700 shutdown_connections 2024-09-19T09:38:57.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.489+0000 7f11dbad3740 1 -- 172.21.15.1:0/104031700 wait complete. 2024-09-19T09:38:57.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.489+0000 7f11dbad3740 20 client.25109 trim_cache size 0 max 16384 2024-09-19T09:38:57.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.489+0000 7f11d96fa640 1 -- 172.21.15.1:0/3033469547 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f11bc0a32c0 msgr2=0x7f11bc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:57.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.489+0000 7f11d96fa640 1 --2- 172.21.15.1:0/3033469547 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f11bc0a32c0 0x7f11bc0a5780 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f11c40976c0 tx=0x7f11c4086050 comp rx=0 tx=0).stop 2024-09-19T09:38:57.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.489+0000 7f11d96fa640 1 -- 172.21.15.1:0/3033469547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11d4101de0 msgr2=0x7f11d4198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:38:57.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.489+0000 7f11d96fa640 1 --2- 172.21.15.1:0/3033469547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11d4101de0 0x7f11d4198460 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f11c400da90 tx=0x7f11c400df50 comp rx=0 tx=0).stop 2024-09-19T09:38:57.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.489+0000 7f11d96fa640 1 -- 172.21.15.1:0/3033469547 shutdown_connections 2024-09-19T09:38:57.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.489+0000 7f11d96fa640 1 --2- 172.21.15.1:0/3033469547 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f11bc0a32c0 0x7f11bc0a5780 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.489+0000 7f11d96fa640 1 --2- 172.21.15.1:0/3033469547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11d4106f10 0x7f11d419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.489+0000 7f11d96fa640 1 --2- 172.21.15.1:0/3033469547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11d4102790 0x7f11d41989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.489+0000 7f11d96fa640 1 --2- 172.21.15.1:0/3033469547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11d4101de0 0x7f11d4198460 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:38:57.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.489+0000 7f11d96fa640 1 -- 172.21.15.1:0/3033469547 >> 172.21.15.1:0/3033469547 conn(0x7f11d40fd8c0 msgr2=0x7f11d40feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:38:57.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.490+0000 7f11d96fa640 1 -- 172.21.15.1:0/3033469547 shutdown_connections 2024-09-19T09:38:57.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:38:57.490+0000 7f11d96fa640 1 -- 172.21.15.1:0/3033469547 wait complete. 2024-09-19T09:38:58.221 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6dc2d874', total seconds elapsed: 16.3 2024-09-19T09:38:58.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:58 smithi022 ceph-mon[35583]: pgmap v364: 97 pgs: 97 active+clean; 658 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-19T09:38:58.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:58 smithi121 ceph-mon[35577]: pgmap v364: 97 pgs: 97 active+clean; 658 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-19T09:38:58.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:58 smithi001 ceph-mon[31225]: pgmap v364: 97 pgs: 97 active+clean; 658 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-19T09:38:59.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:38:59 smithi022 ceph-mon[35583]: scrub summary: idle 2024-09-19T09:38:59.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:38:59 smithi121 ceph-mon[35577]: scrub summary: idle 2024-09-19T09:38:59.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:38:59 smithi001 ceph-mon[31225]: scrub summary: idle 2024-09-19T09:39:00.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:00 smithi022 ceph-mon[35583]: pgmap v365: 97 pgs: 97 active+clean; 658 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 767 B/s wr, 4 op/s 2024-09-19T09:39:00.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:00 smithi121 ceph-mon[35577]: pgmap v365: 97 pgs: 97 active+clean; 658 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 767 B/s wr, 4 op/s 2024-09-19T09:39:00.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:00 smithi001 ceph-mon[31225]: pgmap v365: 97 pgs: 97 active+clean; 658 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 767 B/s wr, 4 op/s 2024-09-19T09:39:01.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.774+0000 7fc0b3766640 1 -- 172.21.15.1:0/246310266 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0ac101c30 msgr2=0x7fc0ac1020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:01.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.774+0000 7fc0b3766640 1 --2- 172.21.15.1:0/246310266 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0ac101c30 0x7fc0ac1020b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc09c009900 tx=0x7fc09c02a410 comp rx=0 tx=0).stop 2024-09-19T09:39:01.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.774+0000 7fc0b3766640 1 -- 172.21.15.1:0/246310266 shutdown_connections 2024-09-19T09:39:01.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.774+0000 7fc0b3766640 1 --2- 172.21.15.1:0/246310266 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0ac1025f0 0x7fc0ac108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.774+0000 7fc0b3766640 1 --2- 172.21.15.1:0/246310266 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0ac101c30 0x7fc0ac1020b0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.774+0000 7fc0b3766640 1 --2- 172.21.15.1:0/246310266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0ac100a40 0x7fc0ac100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.774+0000 7fc0b3766640 1 -- 172.21.15.1:0/246310266 >> 172.21.15.1:0/246310266 conn(0x7fc0ac0fc1c0 msgr2=0x7fc0ac0fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:01.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.774+0000 7fc0b3766640 1 -- 172.21.15.1:0/246310266 shutdown_connections 2024-09-19T09:39:01.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.774+0000 7fc0b3766640 1 -- 172.21.15.1:0/246310266 wait complete. 2024-09-19T09:39:01.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.775+0000 7fc0b3766640 1 Processor -- start 2024-09-19T09:39:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.775+0000 7fc0b3766640 1 -- start start 2024-09-19T09:39:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.775+0000 7fc0b3766640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0ac100a40 0x7fc0ac197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.775+0000 7fc0b3766640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0ac101c30 0x7fc0ac1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.776+0000 7fc0b3766640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0ac1025f0 0x7fc0ac19f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.776+0000 7fc0b3766640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ac10c6f0 con 0x7fc0ac1025f0 2024-09-19T09:39:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.776+0000 7fc0b1d03640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0ac1025f0 0x7fc0ac19f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.776+0000 7fc0b1d03640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0ac1025f0 0x7fc0ac19f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59342/0 (socket says 172.21.15.1:59342) 2024-09-19T09:39:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.776+0000 7fc0b1d03640 1 -- 172.21.15.1:0/836796420 learned_addr learned my addr 172.21.15.1:0/836796420 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.776+0000 7fc0b3766640 1 -- 172.21.15.1:0/836796420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ac10c570 con 0x7fc0ac101c30 2024-09-19T09:39:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.776+0000 7fc0b3766640 1 -- 172.21.15.1:0/836796420 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ac10c870 con 0x7fc0ac100a40 2024-09-19T09:39:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.776+0000 7fc0b0d01640 1 --2- 172.21.15.1:0/836796420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0ac101c30 0x7fc0ac1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.776+0000 7fc0b1502640 1 --2- 172.21.15.1:0/836796420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0ac100a40 0x7fc0ac197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:01.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.776+0000 7fc0b0d01640 1 -- 172.21.15.1:0/836796420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0ac100a40 msgr2=0x7fc0ac197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.776+0000 7fc0b0d01640 1 --2- 172.21.15.1:0/836796420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0ac100a40 0x7fc0ac197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.776+0000 7fc0b0d01640 1 -- 172.21.15.1:0/836796420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0ac1025f0 msgr2=0x7fc0ac19f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.776+0000 7fc0b0d01640 1 --2- 172.21.15.1:0/836796420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0ac1025f0 0x7fc0ac19f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.776+0000 7fc0b0d01640 1 -- 172.21.15.1:0/836796420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0ac102ed0 con 0x7fc0ac101c30 2024-09-19T09:39:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.776+0000 7fc0b0d01640 1 --2- 172.21.15.1:0/836796420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0ac101c30 0x7fc0ac1983e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc09c02a930 tx=0x7fc09c032ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.777+0000 7fc0a27fc640 1 -- 172.21.15.1:0/836796420 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c03f030 con 0x7fc0ac101c30 2024-09-19T09:39:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.777+0000 7fc0a27fc640 1 -- 172.21.15.1:0/836796420 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc09c003ce0 con 0x7fc0ac101c30 2024-09-19T09:39:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.777+0000 7fc0b3766640 1 -- 172.21.15.1:0/836796420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0ac103160 con 0x7fc0ac101c30 2024-09-19T09:39:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.777+0000 7fc0b3766640 1 -- 172.21.15.1:0/836796420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0ac103670 con 0x7fc0ac101c30 2024-09-19T09:39:01.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.777+0000 7fc0a27fc640 1 -- 172.21.15.1:0/836796420 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c035070 con 0x7fc0ac101c30 2024-09-19T09:39:01.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.780+0000 7fc0a27fc640 1 -- 172.21.15.1:0/836796420 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fc09c042030 con 0x7fc0ac101c30 2024-09-19T09:39:01.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.780+0000 7fc0b65dd740 1 Processor -- start 2024-09-19T09:39:01.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.781+0000 7fc0b65dd740 1 -- start start 2024-09-19T09:39:01.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.781+0000 7fc0b65dd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55960e10f9a0 0x55960e10fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:01.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.781+0000 7fc0b65dd740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55960e1102e0 0x55960e114da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:01.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.781+0000 7fc0b65dd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55960e115370 0x55960e117830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:01.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.781+0000 7fc0b65dd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55960e0732f0 con 0x55960e10f9a0 2024-09-19T09:39:01.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.781+0000 7fc0b65dd740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55960e01b270 con 0x55960e1102e0 2024-09-19T09:39:01.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.781+0000 7fc0b65dd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55960e06f2b0 con 0x55960e115370 2024-09-19T09:39:01.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.781+0000 7fc0b1502640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55960e1102e0 0x55960e114da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:01.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.781+0000 7fc0b0d01640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55960e115370 0x55960e117830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:01.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.781+0000 7fc0b1d03640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55960e10f9a0 0x55960e10fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.781+0000 7fc0b1502640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55960e1102e0 0x55960e114da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:46428/0 (socket says 172.21.15.1:46428) 2024-09-19T09:39:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.781+0000 7fc0b1502640 1 -- 172.21.15.1:0/4157750932 learned_addr learned my addr 172.21.15.1:0/4157750932 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.782+0000 7fc0b1502640 1 -- 172.21.15.1:0/4157750932 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55960e115370 msgr2=0x55960e117830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.782+0000 7fc0b1502640 1 --2- 172.21.15.1:0/4157750932 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55960e115370 0x55960e117830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.782+0000 7fc0b1502640 1 -- 172.21.15.1:0/4157750932 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55960e10f9a0 msgr2=0x55960e10fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.782+0000 7fc0b1502640 1 --2- 172.21.15.1:0/4157750932 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55960e10f9a0 0x55960e10fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.782+0000 7fc0b1502640 1 -- 172.21.15.1:0/4157750932 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55960e01a340 con 0x55960e1102e0 2024-09-19T09:39:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.782+0000 7fc0b1d03640 1 --2- 172.21.15.1:0/4157750932 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55960e10f9a0 0x55960e10fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.782+0000 7fc0a27fc640 1 --2- 172.21.15.1:0/836796420 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc0980a32c0 0x7fc0980a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.782+0000 7fc0b1502640 1 --2- 172.21.15.1:0/4157750932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55960e1102e0 0x55960e114da0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc0a800ac70 tx=0x7fc0a800f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db8cfc109bc1019c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:01.785 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.782+0000 7fc0b1d03640 1 --2- 172.21.15.1:0/836796420 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc0980a32c0 0x7fc0980a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.782+0000 7fc0977fe640 1 -- 172.21.15.1:0/4157750932 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8005220 con 0x55960e1102e0 2024-09-19T09:39:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.782+0000 7fc0a27fc640 1 -- 172.21.15.1:0/836796420 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fc09c0efb80 con 0x7fc0ac101c30 2024-09-19T09:39:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.782+0000 7fc0977fe640 1 -- 172.21.15.1:0/4157750932 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0a8004c80 con 0x55960e1102e0 2024-09-19T09:39:01.786 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.782+0000 7fc0977fe640 1 -- 172.21.15.1:0/4157750932 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a80188e0 con 0x55960e1102e0 2024-09-19T09:39:01.792 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.783+0000 7fc0b65dd740 1 -- 172.21.15.1:0/4157750932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55960e1102e0 msgr2=0x55960e114da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:01.792 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.783+0000 7fc0b1d03640 1 --2- 172.21.15.1:0/836796420 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc0980a32c0 0x7fc0980a5780 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc0a40049d0 tx=0x7fc0a4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:01.792 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.783+0000 7fc0b65dd740 1 --2- 172.21.15.1:0/4157750932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55960e1102e0 0x55960e114da0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc0a800ac70 tx=0x7fc0a800f790 comp rx=0 tx=0).stop 2024-09-19T09:39:01.792 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.783+0000 7fc0b65dd740 1 -- 172.21.15.1:0/4157750932 shutdown_connections 2024-09-19T09:39:01.792 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.783+0000 7fc0b65dd740 1 --2- 172.21.15.1:0/4157750932 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55960e115370 0x55960e117830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.783+0000 7fc0b65dd740 1 --2- 172.21.15.1:0/4157750932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55960e1102e0 0x55960e114da0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.783+0000 7fc0b65dd740 1 --2- 172.21.15.1:0/4157750932 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55960e10f9a0 0x55960e10fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.783+0000 7fc0b65dd740 1 -- 172.21.15.1:0/4157750932 >> 172.21.15.1:0/4157750932 conn(0x55960e10b010 msgr2=0x55960e10b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.783+0000 7fc0b65dd740 1 -- 172.21.15.1:0/4157750932 shutdown_connections 2024-09-19T09:39:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.784+0000 7fc0b65dd740 1 -- 172.21.15.1:0/4157750932 wait complete. 2024-09-19T09:39:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.784+0000 7fc0b65dd740 1 -- start start 2024-09-19T09:39:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.784+0000 7fc0b65dd740 1 Processor -- start 2024-09-19T09:39:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.785+0000 7fc0b65dd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55960e10f9a0 0x55960e119ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.785+0000 7fc0b65dd740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55960e1102e0 0x55960e11a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:01.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.785+0000 7fc0b65dd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55960e115370 0x55960e121120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:01.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.785+0000 7fc0b1502640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55960e10f9a0 0x55960e119ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:01.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.785+0000 7fc0b1502640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55960e10f9a0 0x55960e119ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:39944/0 (socket says 172.21.15.1:39944) 2024-09-19T09:39:01.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.785+0000 7fc0b1d03640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55960e115370 0x55960e121120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:01.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.785+0000 7fc0b1d03640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55960e115370 0x55960e121120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59364/0 (socket says 172.21.15.1:59364) 2024-09-19T09:39:01.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.785+0000 7fc0b0d01640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55960e1102e0 0x55960e11a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:01.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.785+0000 7fc0b1502640 1 -- 172.21.15.1:0/673759520 learned_addr learned my addr 172.21.15.1:0/673759520 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:01.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.785+0000 7fc0b65dd740 1 -- 172.21.15.1:0/673759520 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55960e118340 con 0x55960e115370 2024-09-19T09:39:01.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.785+0000 7fc0b65dd740 1 -- 172.21.15.1:0/673759520 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55960dffc290 con 0x55960e1102e0 2024-09-19T09:39:01.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.785+0000 7fc0b65dd740 1 -- 172.21.15.1:0/673759520 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55960e1184c0 con 0x55960e10f9a0 2024-09-19T09:39:01.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.786+0000 7fc0b1502640 1 -- 172.21.15.1:0/673759520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55960e1102e0 msgr2=0x55960e11a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:01.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.786+0000 7fc0b1502640 1 --2- 172.21.15.1:0/673759520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55960e1102e0 0x55960e11a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.786+0000 7fc0b1502640 1 -- 172.21.15.1:0/673759520 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55960e115370 msgr2=0x55960e121120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.786+0000 7fc0b1502640 1 --2- 172.21.15.1:0/673759520 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55960e115370 0x55960e121120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.786+0000 7fc0b1502640 1 -- 172.21.15.1:0/673759520 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55960dd86210 con 0x55960e10f9a0 2024-09-19T09:39:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.786+0000 7fc0b0d01640 1 --2- 172.21.15.1:0/673759520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55960e1102e0 0x55960e11a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.786+0000 7fc0b1d03640 1 --2- 172.21.15.1:0/673759520 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55960e115370 0x55960e121120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.786+0000 7fc0b65dd740 10 client.0 _ll_register_callbacks cb 0x55960e02d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.786+0000 7fc0b1502640 1 --2- 172.21.15.1:0/673759520 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55960e10f9a0 0x55960e119ba0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc0a801a040 tx=0x7fc0a8003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55664631857cfd01 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.786+0000 7fc0b65dd740 1 -- 172.21.15.1:0/673759520 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0a8004c80 con 0x55960e10f9a0 2024-09-19T09:39:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.786+0000 7fc094ff9640 10 client.25036 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-19T09:39:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.786+0000 7fc094ff9640 1 -- 172.21.15.1:0/673759520 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8027020 con 0x55960e10f9a0 2024-09-19T09:39:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.787+0000 7fc094ff9640 1 -- 172.21.15.1:0/673759520 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fc0a8003bd0 con 0x55960e10f9a0 2024-09-19T09:39:01.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.787+0000 7fc094ff9640 1 -- 172.21.15.1:0/673759520 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc0a8003e30 con 0x55960e10f9a0 2024-09-19T09:39:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.787+0000 7fc0b65dd740 10 client.25036 fetch_fsmap learned FSMap version 19 2024-09-19T09:39:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.787+0000 7fc0b65dd740 1 -- 172.21.15.1:0/673759520 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({fsmap=19}) -- 0x55960de52620 con 0x55960e10f9a0 2024-09-19T09:39:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.787+0000 7fc094ff9640 1 -- 172.21.15.1:0/673759520 <== mon.1 v2:172.21.15.121:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fc0a80185e0 con 0x55960e10f9a0 2024-09-19T09:39:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.787+0000 7fc0b65dd740 10 client.25036 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:39:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.787+0000 7fc0b65dd740 10 client.25036 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.787+0000 7fc0b65dd740 20 client.25036 populate_metadata read hostname 'smithi001' 2024-09-19T09:39:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.787+0000 7fc0b65dd740 1 --2- 172.21.15.1:0/673759520 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55960e125ac0 0x55960e127f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.787+0000 7fc0b65dd740 4 client.25036 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:39:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.787+0000 7fc0b65dd740 1 -- 172.21.15.1:0/673759520 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55960e080a20 con 0x55960e125ac0 2024-09-19T09:39:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.788+0000 7fc0b0d01640 1 --2- 172.21.15.1:0/673759520 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55960e125ac0 0x55960e127f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.788+0000 7fc094ff9640 10 client.25036 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:01.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.788+0000 7fc0b0d01640 1 --2- 172.21.15.1:0/673759520 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55960e125ac0 0x55960e127f80 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2837524bef54488 server_cookie=e9287e5b9e611a3f in_seq=0 out_seq=0 2024-09-19T09:39:01.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.789+0000 7fc094ff9640 1 -- 172.21.15.1:0/673759520 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55960e080a20 con 0x55960e125ac0 2024-09-19T09:39:01.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.789+0000 7fc094ff9640 10 client.25036 handle_command_reply: tid=0 2024-09-19T09:39:01.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.789+0000 7fc0b65dd740 1 client.25036 shutdown 2024-09-19T09:39:01.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.789+0000 7fc0b65dd740 1 -- 172.21.15.1:0/673759520 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55960e10f9a0 msgr2=0x55960e119ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:01.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.789+0000 7fc0b65dd740 1 --2- 172.21.15.1:0/673759520 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55960e10f9a0 0x55960e119ba0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc0a801a040 tx=0x7fc0a8003820 comp rx=0 tx=0).stop 2024-09-19T09:39:01.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.789+0000 7fc0b65dd740 1 -- 172.21.15.1:0/673759520 shutdown_connections 2024-09-19T09:39:01.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.789+0000 7fc0b65dd740 1 --2- 172.21.15.1:0/673759520 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55960e125ac0 0x55960e127f80 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.789+0000 7fc0b65dd740 1 --2- 172.21.15.1:0/673759520 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55960e115370 0x55960e121120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.789+0000 7fc094ff9640 0 client.25036 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:01.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.789+0000 7fc0b65dd740 1 --2- 172.21.15.1:0/673759520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55960e1102e0 0x55960e11a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.789+0000 7fc0b65dd740 1 --2- 172.21.15.1:0/673759520 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55960e10f9a0 0x55960e119ba0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.789+0000 7fc0b65dd740 1 -- 172.21.15.1:0/673759520 >> 172.21.15.1:0/673759520 conn(0x55960e10b010 msgr2=0x55960e10c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:01.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.789+0000 7fc0b65dd740 1 -- 172.21.15.1:0/673759520 shutdown_connections 2024-09-19T09:39:01.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.789+0000 7fc0b65dd740 1 -- 172.21.15.1:0/673759520 wait complete. 2024-09-19T09:39:01.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.789+0000 7fc0b65dd740 20 client.25036 trim_cache size 0 max 16384 2024-09-19T09:39:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.817+0000 7fc0b65dd740 1 Processor -- start 2024-09-19T09:39:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.817+0000 7fc0b65dd740 1 -- start start 2024-09-19T09:39:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.817+0000 7fc0b65dd740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55960e10f9a0 0x55960e118220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.817+0000 7fc0b65dd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55960e1102e0 0x55960e1210b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:01.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.817+0000 7fc0b65dd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55960e115370 0x55960e10b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.817+0000 7fc0b65dd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc09000c440 con 0x55960e1102e0 2024-09-19T09:39:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.817+0000 7fc0b65dd740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc09000ece0 con 0x55960e10f9a0 2024-09-19T09:39:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.817+0000 7fc0b65dd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc09000cad0 con 0x55960e115370 2024-09-19T09:39:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.817+0000 7fc0b0d01640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55960e1102e0 0x55960e1210b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.818+0000 7fc0b0d01640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55960e1102e0 0x55960e1210b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59370/0 (socket says 172.21.15.1:59370) 2024-09-19T09:39:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.818+0000 7fc0b0d01640 1 -- 172.21.15.1:0/2629754987 learned_addr learned my addr 172.21.15.1:0/2629754987 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.818+0000 7fc0b1d03640 1 --2- 172.21.15.1:0/2629754987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55960e115370 0x55960e10b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.818+0000 7fc0b1502640 1 --2- 172.21.15.1:0/2629754987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55960e10f9a0 0x55960e118220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.818+0000 7fc0b0d01640 1 -- 172.21.15.1:0/2629754987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55960e115370 msgr2=0x55960e10b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.818+0000 7fc0b0d01640 1 --2- 172.21.15.1:0/2629754987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55960e115370 0x55960e10b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.818+0000 7fc0b0d01640 1 -- 172.21.15.1:0/2629754987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55960e10f9a0 msgr2=0x55960e118220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.818+0000 7fc0b0d01640 1 --2- 172.21.15.1:0/2629754987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55960e10f9a0 0x55960e118220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.818+0000 7fc0b0d01640 1 -- 172.21.15.1:0/2629754987 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55960e1107c0 con 0x55960e1102e0 2024-09-19T09:39:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.818+0000 7fc0b1502640 1 --2- 172.21.15.1:0/2629754987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55960e10f9a0 0x55960e118220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.818+0000 7fc0b0d01640 1 --2- 172.21.15.1:0/2629754987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55960e1102e0 0x55960e1210b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc09c009900 tx=0x7fc09c0ed550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e45d3ea7bca2d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.818+0000 7fc096ffd640 1 -- 172.21.15.1:0/2629754987 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c049040 con 0x55960e1102e0 2024-09-19T09:39:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.819+0000 7fc096ffd640 1 -- 172.21.15.1:0/2629754987 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc09c0bc250 con 0x55960e1102e0 2024-09-19T09:39:01.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.819+0000 7fc096ffd640 1 -- 172.21.15.1:0/2629754987 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c0b88c0 con 0x55960e1102e0 2024-09-19T09:39:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.819+0000 7fc0b65dd740 1 -- 172.21.15.1:0/2629754987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55960e1102e0 msgr2=0x55960e1210b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:01.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.819+0000 7fc0b65dd740 1 --2- 172.21.15.1:0/2629754987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55960e1102e0 0x55960e1210b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc09c009900 tx=0x7fc09c0ed550 comp rx=0 tx=0).stop 2024-09-19T09:39:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.820+0000 7fc0b65dd740 1 -- 172.21.15.1:0/2629754987 shutdown_connections 2024-09-19T09:39:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.820+0000 7fc0b65dd740 1 --2- 172.21.15.1:0/2629754987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55960e115370 0x55960e10b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.820+0000 7fc0b65dd740 1 --2- 172.21.15.1:0/2629754987 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55960e1102e0 0x55960e1210b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.820+0000 7fc0b65dd740 1 --2- 172.21.15.1:0/2629754987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55960e10f9a0 0x55960e118220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.820+0000 7fc0b65dd740 1 -- 172.21.15.1:0/2629754987 >> 172.21.15.1:0/2629754987 conn(0x55960e10b010 msgr2=0x55960e119950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.820+0000 7fc0b65dd740 1 -- 172.21.15.1:0/2629754987 shutdown_connections 2024-09-19T09:39:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.820+0000 7fc0b65dd740 1 -- 172.21.15.1:0/2629754987 wait complete. 2024-09-19T09:39:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.820+0000 7fc0b65dd740 1 -- start start 2024-09-19T09:39:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.820+0000 7fc0b65dd740 1 Processor -- start 2024-09-19T09:39:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.821+0000 7fc0b65dd740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55960e10f9a0 0x55960e120dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:01.826 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.821+0000 7fc0b65dd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55960e1102e0 0x55960e11d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.821+0000 7fc0b65dd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55960e115370 0x55960e11ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.821+0000 7fc0b65dd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc09000d1a0 con 0x55960e1102e0 2024-09-19T09:39:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.821+0000 7fc0b65dd740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc09000e610 con 0x55960e10f9a0 2024-09-19T09:39:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.821+0000 7fc0b65dd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc09000d870 con 0x55960e115370 2024-09-19T09:39:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.821+0000 7fc0b65dd740 10 client.0 _ll_register_callbacks cb 0x7fc0a800aac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.821+0000 7fc0b0d01640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55960e1102e0 0x55960e11d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.821+0000 7fc0b0d01640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55960e1102e0 0x55960e11d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59384/0 (socket says 172.21.15.1:59384) 2024-09-19T09:39:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.821+0000 7fc0b0d01640 1 -- 172.21.15.1:0/4202396077 learned_addr learned my addr 172.21.15.1:0/4202396077 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:01.827 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.821+0000 7fc0b1502640 1 --2- 172.21.15.1:0/4202396077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55960e10f9a0 0x55960e120dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.821+0000 7fc0b1d03640 1 --2- 172.21.15.1:0/4202396077 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55960e115370 0x55960e11ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.821+0000 7fc0b0d01640 1 -- 172.21.15.1:0/4202396077 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55960e115370 msgr2=0x55960e11ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.821+0000 7fc0b0d01640 1 --2- 172.21.15.1:0/4202396077 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55960e115370 0x55960e11ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.821+0000 7fc0b0d01640 1 -- 172.21.15.1:0/4202396077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55960e10f9a0 msgr2=0x55960e120dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.821+0000 7fc0b0d01640 1 --2- 172.21.15.1:0/4202396077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55960e10f9a0 0x55960e120dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.821+0000 7fc0b0d01640 1 -- 172.21.15.1:0/4202396077 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55960e11e3a0 con 0x55960e1102e0 2024-09-19T09:39:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.821+0000 7fc0b1502640 1 --2- 172.21.15.1:0/4202396077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55960e10f9a0 0x55960e120dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.821+0000 7fc0b0d01640 1 --2- 172.21.15.1:0/4202396077 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55960e1102e0 0x55960e11d870 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc09c0bbf50 tx=0x7fc09c032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad51cc2af532b14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.821+0000 7fc094ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:39:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.821+0000 7fc094ff9640 1 -- 172.21.15.1:0/4202396077 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c049070 con 0x55960e1102e0 2024-09-19T09:39:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.822+0000 7fc094ff9640 1 -- 172.21.15.1:0/4202396077 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fc09c0b88c0 con 0x55960e1102e0 2024-09-19T09:39:01.828 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.822+0000 7fc0b65dd740 1 -- 172.21.15.1:0/4202396077 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc09c0bc250 con 0x55960e1102e0 2024-09-19T09:39:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.822+0000 7fc094ff9640 1 -- 172.21.15.1:0/4202396077 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc09c0c0550 con 0x55960e1102e0 2024-09-19T09:39:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.822+0000 7fc0b65dd740 10 client.15417 fetch_fsmap learned FSMap version 19 2024-09-19T09:39:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.822+0000 7fc0b65dd740 1 -- 172.21.15.1:0/4202396077 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55960e18f940 con 0x55960e1102e0 2024-09-19T09:39:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.822+0000 7fc094ff9640 1 -- 172.21.15.1:0/4202396077 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc09c0bc250 con 0x55960e1102e0 2024-09-19T09:39:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.822+0000 7fc094ff9640 1 -- 172.21.15.1:0/4202396077 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fc09c03b460 con 0x55960e1102e0 2024-09-19T09:39:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.823+0000 7fc0b65dd740 10 client.15417 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:39:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.823+0000 7fc0b65dd740 10 client.15417 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.823+0000 7fc0b65dd740 20 client.15417 populate_metadata read hostname 'smithi001' 2024-09-19T09:39:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.823+0000 7fc0b65dd740 1 --2- 172.21.15.1:0/4202396077 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55960e125ac0 0x55960e1920a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.823+0000 7fc0b65dd740 4 client.15417 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:39:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.823+0000 7fc0b65dd740 1 -- 172.21.15.1:0/4202396077 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55960e07ad70 con 0x55960e125ac0 2024-09-19T09:39:01.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.823+0000 7fc0b1502640 1 --2- 172.21.15.1:0/4202396077 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55960e125ac0 0x55960e1920a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.824+0000 7fc094ff9640 10 client.15417 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:01.830 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.824+0000 7fc0b1502640 1 --2- 172.21.15.1:0/4202396077 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55960e125ac0 0x55960e1920a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a33dbd81c7db29d server_cookie=89b097272a66ff0d in_seq=0 out_seq=0 2024-09-19T09:39:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.827+0000 7fc094ff9640 1 -- 172.21.15.1:0/4202396077 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55960e07ad70 con 0x55960e125ac0 2024-09-19T09:39:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.827+0000 7fc094ff9640 10 client.15417 handle_command_reply: tid=0 2024-09-19T09:39:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.827+0000 7fc0b65dd740 1 client.15417 shutdown 2024-09-19T09:39:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.827+0000 7fc0b65dd740 1 -- 172.21.15.1:0/4202396077 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55960e1102e0 msgr2=0x55960e11d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.827+0000 7fc0b65dd740 1 --2- 172.21.15.1:0/4202396077 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55960e1102e0 0x55960e11d870 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc09c0bbf50 tx=0x7fc09c032f90 comp rx=0 tx=0).stop 2024-09-19T09:39:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.828+0000 7fc0b65dd740 1 -- 172.21.15.1:0/4202396077 shutdown_connections 2024-09-19T09:39:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.828+0000 7fc0b65dd740 1 --2- 172.21.15.1:0/4202396077 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55960e125ac0 0x55960e1920a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.828+0000 7fc0b65dd740 1 --2- 172.21.15.1:0/4202396077 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55960e115370 0x55960e11ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.828+0000 7fc0b65dd740 1 --2- 172.21.15.1:0/4202396077 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55960e1102e0 0x55960e11d870 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.828+0000 7fc0b65dd740 1 --2- 172.21.15.1:0/4202396077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55960e10f9a0 0x55960e120dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.828+0000 7fc094ff9640 0 client.15417 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.828+0000 7fc0b65dd740 1 -- 172.21.15.1:0/4202396077 >> 172.21.15.1:0/4202396077 conn(0x55960e10b010 msgr2=0x55960e1099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.828+0000 7fc0b65dd740 1 -- 172.21.15.1:0/4202396077 shutdown_connections 2024-09-19T09:39:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.828+0000 7fc0b65dd740 1 -- 172.21.15.1:0/4202396077 wait complete. 2024-09-19T09:39:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.828+0000 7fc0b65dd740 20 client.15417 trim_cache size 0 max 16384 2024-09-19T09:39:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:39:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:39:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:39:01.832 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:39:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.828+0000 7fc0b3766640 1 -- 172.21.15.1:0/836796420 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc0980a32c0 msgr2=0x7fc0980a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.828+0000 7fc0b3766640 1 --2- 172.21.15.1:0/836796420 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc0980a32c0 0x7fc0980a5780 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc0a40049d0 tx=0x7fc0a4009500 comp rx=0 tx=0).stop 2024-09-19T09:39:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.828+0000 7fc0b3766640 1 -- 172.21.15.1:0/836796420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0ac101c30 msgr2=0x7fc0ac1983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.828+0000 7fc0b3766640 1 --2- 172.21.15.1:0/836796420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0ac101c30 0x7fc0ac1983e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc09c02a930 tx=0x7fc09c032ce0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.829+0000 7fc0b3766640 1 -- 172.21.15.1:0/836796420 shutdown_connections 2024-09-19T09:39:01.833 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.829+0000 7fc0b3766640 1 --2- 172.21.15.1:0/836796420 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc0ac1025f0 0x7fc0ac19f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.834 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.829+0000 7fc0b3766640 1 --2- 172.21.15.1:0/836796420 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc0980a32c0 0x7fc0980a5780 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.834 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.829+0000 7fc0b3766640 1 --2- 172.21.15.1:0/836796420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0ac101c30 0x7fc0ac1983e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.834 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.829+0000 7fc0b3766640 1 --2- 172.21.15.1:0/836796420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc0ac100a40 0x7fc0ac197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:01.834 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.829+0000 7fc0b3766640 1 -- 172.21.15.1:0/836796420 >> 172.21.15.1:0/836796420 conn(0x7fc0ac0fc1c0 msgr2=0x7fc0ac0fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:01.834 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.829+0000 7fc0b3766640 1 -- 172.21.15.1:0/836796420 shutdown_connections 2024-09-19T09:39:01.834 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:01.829+0000 7fc0b3766640 1 -- 172.21.15.1:0/836796420 wait complete. 2024-09-19T09:39:02.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:02 smithi022 ceph-mon[35583]: pgmap v366: 97 pgs: 97 active+clean; 658 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-19T09:39:02.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:02 smithi121 ceph-mon[35577]: pgmap v366: 97 pgs: 97 active+clean; 658 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-19T09:39:02.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:02 smithi001 ceph-mon[31225]: pgmap v366: 97 pgs: 97 active+clean; 658 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-19T09:39:04.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:04 smithi022 ceph-mon[35583]: pgmap v367: 97 pgs: 97 active+clean; 658 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-19T09:39:04.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:04 smithi121 ceph-mon[35577]: pgmap v367: 97 pgs: 97 active+clean; 658 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-19T09:39:04.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:04 smithi001 ceph-mon[31225]: pgmap v367: 97 pgs: 97 active+clean; 658 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-19T09:39:06.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:06 smithi022 ceph-mon[35583]: pgmap v368: 97 pgs: 97 active+clean; 658 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-19T09:39:06.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:06 smithi121 ceph-mon[35577]: pgmap v368: 97 pgs: 97 active+clean; 658 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-19T09:39:06.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:06 smithi001 ceph-mon[31225]: pgmap v368: 97 pgs: 97 active+clean; 658 KiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-19T09:39:08.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:08 smithi022 ceph-mon[35583]: pgmap v369: 97 pgs: 97 active+clean; 659 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 341 B/s wr, 3 op/s 2024-09-19T09:39:08.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:08 smithi121 ceph-mon[35577]: pgmap v369: 97 pgs: 97 active+clean; 659 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 341 B/s wr, 3 op/s 2024-09-19T09:39:08.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:08 smithi001 ceph-mon[31225]: pgmap v369: 97 pgs: 97 active+clean; 659 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 341 B/s wr, 3 op/s 2024-09-19T09:39:10.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:10 smithi022 ceph-mon[35583]: pgmap v370: 97 pgs: 97 active+clean; 659 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 341 B/s wr, 2 op/s 2024-09-19T09:39:10.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:10 smithi121 ceph-mon[35577]: pgmap v370: 97 pgs: 97 active+clean; 659 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 341 B/s wr, 2 op/s 2024-09-19T09:39:10.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:10 smithi001 ceph-mon[31225]: pgmap v370: 97 pgs: 97 active+clean; 659 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 341 B/s wr, 2 op/s 2024-09-19T09:39:12.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:12 smithi022 ceph-mon[35583]: pgmap v371: 97 pgs: 97 active+clean; 659 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 341 B/s wr, 2 op/s 2024-09-19T09:39:12.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:12 smithi121 ceph-mon[35577]: pgmap v371: 97 pgs: 97 active+clean; 659 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 341 B/s wr, 2 op/s 2024-09-19T09:39:12.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:12 smithi001 ceph-mon[31225]: pgmap v371: 97 pgs: 97 active+clean; 659 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 341 B/s wr, 2 op/s 2024-09-19T09:39:14.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:14 smithi022 ceph-mon[35583]: pgmap v372: 97 pgs: 97 active+clean; 659 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:39:14.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:14 smithi121 ceph-mon[35577]: pgmap v372: 97 pgs: 97 active+clean; 659 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:39:14.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:14 smithi001 ceph-mon[31225]: pgmap v372: 97 pgs: 97 active+clean; 659 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:39:14.924 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.922+0000 7f105e674640 1 -- 172.21.15.1:0/172424195 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1058104f90 msgr2=0x7f1058107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:14.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.922+0000 7f105e674640 1 --2- 172.21.15.1:0/172424195 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1058104f90 0x7f1058107380 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f104c009900 tx=0x7f104c02a410 comp rx=0 tx=0).stop 2024-09-19T09:39:14.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.922+0000 7f105e674640 1 -- 172.21.15.1:0/172424195 shutdown_connections 2024-09-19T09:39:14.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.922+0000 7f105e674640 1 --2- 172.21.15.1:0/172424195 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10581078c0 0x7f1058109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.922+0000 7f105e674640 1 --2- 172.21.15.1:0/172424195 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1058104f90 0x7f1058107380 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.922+0000 7f105e674640 1 --2- 172.21.15.1:0/172424195 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1058102660 0x7f1058104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.922+0000 7f105e674640 1 -- 172.21.15.1:0/172424195 >> 172.21.15.1:0/172424195 conn(0x7f10580fc1c0 msgr2=0x7f10580fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:14.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.922+0000 7f105e674640 1 -- 172.21.15.1:0/172424195 shutdown_connections 2024-09-19T09:39:14.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.923+0000 7f105e674640 1 -- 172.21.15.1:0/172424195 wait complete. 2024-09-19T09:39:14.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.923+0000 7f105e674640 1 Processor -- start 2024-09-19T09:39:14.925 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.923+0000 7f105e674640 1 -- start start 2024-09-19T09:39:14.927 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.924+0000 7f105e674640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1058102660 0x7f1058197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:14.928 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.924+0000 7f105e674640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1058104f90 0x7f1058198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:14.928 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.924+0000 7f105e674640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10581078c0 0x7f105819f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:14.928 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.924+0000 7f105e674640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f105810d7d0 con 0x7f1058104f90 2024-09-19T09:39:14.928 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.924+0000 7f105e674640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f105810d650 con 0x7f1058102660 2024-09-19T09:39:14.928 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.924+0000 7f105e674640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f105810d950 con 0x7f10581078c0 2024-09-19T09:39:14.928 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.924+0000 7f10577fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1058104f90 0x7f1058198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:14.928 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.924+0000 7f10577fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1058104f90 0x7f1058198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40122/0 (socket says 172.21.15.1:40122) 2024-09-19T09:39:14.928 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.924+0000 7f1057fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1058102660 0x7f1058197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:14.928 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.924+0000 7f10577fe640 1 -- 172.21.15.1:0/3943990594 learned_addr learned my addr 172.21.15.1:0/3943990594 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:14.928 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.924+0000 7f105cc11640 1 --2- 172.21.15.1:0/3943990594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10581078c0 0x7f105819f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:14.928 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.924+0000 7f10577fe640 1 -- 172.21.15.1:0/3943990594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10581078c0 msgr2=0x7f105819f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:14.928 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.924+0000 7f10577fe640 1 --2- 172.21.15.1:0/3943990594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10581078c0 0x7f105819f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.929 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.924+0000 7f10577fe640 1 -- 172.21.15.1:0/3943990594 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1058102660 msgr2=0x7f1058197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:14.929 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.924+0000 7f10577fe640 1 --2- 172.21.15.1:0/3943990594 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1058102660 0x7f1058197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.929 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.924+0000 7f10577fe640 1 -- 172.21.15.1:0/3943990594 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f105819fb00 con 0x7f1058104f90 2024-09-19T09:39:14.929 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.925+0000 7f10577fe640 1 --2- 172.21.15.1:0/3943990594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1058104f90 0x7f1058198420 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f104c031610 tx=0x7f104c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:14.929 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.925+0000 7f10557fa640 1 -- 172.21.15.1:0/3943990594 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104c03f030 con 0x7f1058104f90 2024-09-19T09:39:14.929 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.925+0000 7f10557fa640 1 -- 172.21.15.1:0/3943990594 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f104c003ad0 con 0x7f1058104f90 2024-09-19T09:39:14.929 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.925+0000 7f10557fa640 1 -- 172.21.15.1:0/3943990594 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104c035070 con 0x7f1058104f90 2024-09-19T09:39:14.929 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.925+0000 7f105e674640 1 -- 172.21.15.1:0/3943990594 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f105819fd90 con 0x7f1058104f90 2024-09-19T09:39:14.929 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.925+0000 7f105e674640 1 -- 172.21.15.1:0/3943990594 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10581006f0 con 0x7f1058104f90 2024-09-19T09:39:14.931 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.929+0000 7f10557fa640 1 -- 172.21.15.1:0/3943990594 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f104c042030 con 0x7f1058104f90 2024-09-19T09:39:14.931 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.929+0000 7f1061417740 1 Processor -- start 2024-09-19T09:39:14.931 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.929+0000 7f1061417740 1 -- start start 2024-09-19T09:39:14.931 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.929+0000 7f1061417740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2f8f98990 0x55c2f8f98d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:14.931 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.929+0000 7f1061417740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2f8f992d0 0x55c2f8f9dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:14.931 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.929+0000 7f1061417740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2f8f9e360 0x55c2f8fa0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:14.931 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.929+0000 7f1061417740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c2f8efc2f0 con 0x55c2f8f9e360 2024-09-19T09:39:14.931 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.929+0000 7f1061417740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55c2f8ea4270 con 0x55c2f8f98990 2024-09-19T09:39:14.931 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.929+0000 7f1061417740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c2f8ef82b0 con 0x55c2f8f992d0 2024-09-19T09:39:14.932 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.929+0000 7f1057fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2f8f992d0 0x55c2f8f9dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:14.932 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.929+0000 7f10577fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2f8f9e360 0x55c2f8fa0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:14.932 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.930+0000 7f105cc11640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2f8f98990 0x55c2f8f98d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:14.932 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.930+0000 7f10577fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2f8f9e360 0x55c2f8fa0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40132/0 (socket says 172.21.15.1:40132) 2024-09-19T09:39:14.932 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.930+0000 7f10577fe640 1 -- 172.21.15.1:0/3296878544 learned_addr learned my addr 172.21.15.1:0/3296878544 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:14.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.930+0000 7f105cc11640 1 -- 172.21.15.1:0/3296878544 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2f8f992d0 msgr2=0x55c2f8f9dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:14.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.930+0000 7f105cc11640 1 --2- 172.21.15.1:0/3296878544 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2f8f992d0 0x55c2f8f9dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.930+0000 7f105cc11640 1 -- 172.21.15.1:0/3296878544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2f8f9e360 msgr2=0x55c2f8fa0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.930+0000 7f105cc11640 1 --2- 172.21.15.1:0/3296878544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2f8f9e360 0x55c2f8fa0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.930+0000 7f105cc11640 1 -- 172.21.15.1:0/3296878544 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2f8ea3340 con 0x55c2f8f98990 2024-09-19T09:39:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.930+0000 7f10557fa640 1 --2- 172.21.15.1:0/3943990594 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f10400a32c0 0x7f10400a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.930+0000 7f105cc11640 1 --2- 172.21.15.1:0/3296878544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2f8f98990 0x55c2f8f98d90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f105806aaf0 tx=0x7f105000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87d9c33bb3dc3897 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.930+0000 7f1057fff640 1 --2- 172.21.15.1:0/3943990594 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f10400a32c0 0x7f10400a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.930+0000 7f10557fa640 1 -- 172.21.15.1:0/3943990594 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f104c0efd50 con 0x7f1058104f90 2024-09-19T09:39:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.931+0000 7f103e7fc640 1 -- 172.21.15.1:0/3296878544 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1050004d20 con 0x55c2f8f98990 2024-09-19T09:39:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.931+0000 7f103e7fc640 1 -- 172.21.15.1:0/3296878544 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1050010b20 con 0x55c2f8f98990 2024-09-19T09:39:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.931+0000 7f103e7fc640 1 -- 172.21.15.1:0/3296878544 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1050018a50 con 0x55c2f8f98990 2024-09-19T09:39:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.932+0000 7f1061417740 1 -- 172.21.15.1:0/3296878544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2f8f98990 msgr2=0x55c2f8f98d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.932+0000 7f1057fff640 1 --2- 172.21.15.1:0/3943990594 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f10400a32c0 0x7f10400a5780 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55c2f8f99d00 tx=0x7f1048005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:14.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.932+0000 7f1061417740 1 --2- 172.21.15.1:0/3296878544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2f8f98990 0x55c2f8f98d90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f105806aaf0 tx=0x7f105000f790 comp rx=0 tx=0).stop 2024-09-19T09:39:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.932+0000 7f1061417740 1 -- 172.21.15.1:0/3296878544 shutdown_connections 2024-09-19T09:39:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.932+0000 7f1061417740 1 --2- 172.21.15.1:0/3296878544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2f8f9e360 0x55c2f8fa0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.932+0000 7f1061417740 1 --2- 172.21.15.1:0/3296878544 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2f8f992d0 0x55c2f8f9dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.932+0000 7f1061417740 1 --2- 172.21.15.1:0/3296878544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2f8f98990 0x55c2f8f98d90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.932+0000 7f1061417740 1 -- 172.21.15.1:0/3296878544 >> 172.21.15.1:0/3296878544 conn(0x55c2f8f94000 msgr2=0x55c2f8f94400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.932+0000 7f1061417740 1 -- 172.21.15.1:0/3296878544 shutdown_connections 2024-09-19T09:39:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.932+0000 7f1061417740 1 -- 172.21.15.1:0/3296878544 wait complete. 2024-09-19T09:39:14.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.932+0000 7f1061417740 1 -- start start 2024-09-19T09:39:14.938 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.933+0000 7f1061417740 1 Processor -- start 2024-09-19T09:39:14.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.933+0000 7f1061417740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2f8f98990 0x55c2f8fa2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:14.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.933+0000 7f1061417740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2f8f992d0 0x55c2f8fa3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:14.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.933+0000 7f1061417740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2f8f9e360 0x55c2f8faa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:14.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.933+0000 7f1061417740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c2f8fa1330 con 0x55c2f8f9e360 2024-09-19T09:39:14.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.933+0000 7f1061417740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55c2f8e85290 con 0x55c2f8f98990 2024-09-19T09:39:14.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.933+0000 7f1061417740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c2f8fa14b0 con 0x55c2f8f992d0 2024-09-19T09:39:14.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.933+0000 7f1061417740 10 client.0 _ll_register_callbacks cb 0x55c2f8eb6140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:14.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.933+0000 7f105cc11640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2f8f9e360 0x55c2f8faa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:14.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.933+0000 7f105cc11640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2f8f9e360 0x55c2f8faa0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40146/0 (socket says 172.21.15.1:40146) 2024-09-19T09:39:14.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.933+0000 7f105cc11640 1 -- 172.21.15.1:0/1977743995 learned_addr learned my addr 172.21.15.1:0/1977743995 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:14.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.933+0000 7f1057fff640 1 --2- 172.21.15.1:0/1977743995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2f8f98990 0x55c2f8fa2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:14.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.933+0000 7f10577fe640 1 --2- 172.21.15.1:0/1977743995 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2f8f992d0 0x55c2f8fa3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:14.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.933+0000 7f105cc11640 1 -- 172.21.15.1:0/1977743995 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2f8f992d0 msgr2=0x55c2f8fa3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:14.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.933+0000 7f105cc11640 1 --2- 172.21.15.1:0/1977743995 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2f8f992d0 0x55c2f8fa3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.933+0000 7f105cc11640 1 -- 172.21.15.1:0/1977743995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2f8f98990 msgr2=0x55c2f8fa2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:14.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.933+0000 7f105cc11640 1 --2- 172.21.15.1:0/1977743995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2f8f98990 0x55c2f8fa2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.933+0000 7f105cc11640 1 -- 172.21.15.1:0/1977743995 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2f8c0f210 con 0x55c2f8f9e360 2024-09-19T09:39:14.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.933+0000 7f1057fff640 1 --2- 172.21.15.1:0/1977743995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2f8f98990 0x55c2f8fa2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:14.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.934+0000 7f105cc11640 1 --2- 172.21.15.1:0/1977743995 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2f8f9e360 0x55c2f8faa0d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1050005c40 tx=0x7f10500108f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279d185556dd3380 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:14.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.934+0000 7f10377fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:39:14.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.934+0000 7f10377fe640 1 -- 172.21.15.1:0/1977743995 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1050026020 con 0x55c2f8f9e360 2024-09-19T09:39:14.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.934+0000 7f10377fe640 1 -- 172.21.15.1:0/1977743995 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f1050003970 con 0x55c2f8f9e360 2024-09-19T09:39:14.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.934+0000 7f1061417740 1 -- 172.21.15.1:0/1977743995 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1050010b20 con 0x55c2f8f9e360 2024-09-19T09:39:14.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.934+0000 7f10377fe640 1 -- 172.21.15.1:0/1977743995 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1050004e50 con 0x55c2f8f9e360 2024-09-19T09:39:14.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.934+0000 7f1061417740 10 client.15429 fetch_fsmap learned FSMap version 19 2024-09-19T09:39:14.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.934+0000 7f1061417740 1 -- 172.21.15.1:0/1977743995 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55c2f8cdb620 con 0x55c2f8f9e360 2024-09-19T09:39:14.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.934+0000 7f10377fe640 1 -- 172.21.15.1:0/1977743995 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1050010b20 con 0x55c2f8f9e360 2024-09-19T09:39:14.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.934+0000 7f10377fe640 1 -- 172.21.15.1:0/1977743995 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1050004160 con 0x55c2f8f9e360 2024-09-19T09:39:14.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.935+0000 7f1061417740 10 client.15429 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:39:14.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.935+0000 7f1061417740 10 client.15429 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:14.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.935+0000 7f1061417740 20 client.15429 populate_metadata read hostname 'smithi001' 2024-09-19T09:39:14.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.935+0000 7f1061417740 1 --2- 172.21.15.1:0/1977743995 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55c2f8fae4f0 0x55c2f8fb08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:14.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.935+0000 7f1061417740 4 client.15429 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:39:14.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.935+0000 7f1061417740 1 -- 172.21.15.1:0/1977743995 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2f8f09a20 con 0x55c2f8fae4f0 2024-09-19T09:39:14.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.935+0000 7f1057fff640 1 --2- 172.21.15.1:0/1977743995 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55c2f8fae4f0 0x55c2f8fb08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:14.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.935+0000 7f10377fe640 10 client.15429 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:14.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.935+0000 7f1057fff640 1 --2- 172.21.15.1:0/1977743995 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55c2f8fae4f0 0x55c2f8fb08e0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1d30cc7468f404c server_cookie=aa39f05edac2d443 in_seq=0 out_seq=0 2024-09-19T09:39:14.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.936+0000 7f10377fe640 1 -- 172.21.15.1:0/1977743995 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c2f8f09a20 con 0x55c2f8fae4f0 2024-09-19T09:39:14.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.936+0000 7f10377fe640 10 client.15429 handle_command_reply: tid=0 2024-09-19T09:39:14.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.936+0000 7f1061417740 1 client.15429 shutdown 2024-09-19T09:39:14.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.936+0000 7f1061417740 1 -- 172.21.15.1:0/1977743995 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2f8f9e360 msgr2=0x55c2f8faa0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:14.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.936+0000 7f1061417740 1 --2- 172.21.15.1:0/1977743995 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2f8f9e360 0x55c2f8faa0d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1050005c40 tx=0x7f10500108f0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.936+0000 7f1061417740 1 -- 172.21.15.1:0/1977743995 shutdown_connections 2024-09-19T09:39:14.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.936+0000 7f1061417740 1 --2- 172.21.15.1:0/1977743995 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55c2f8fae4f0 0x55c2f8fb08e0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.937+0000 7f10377fe640 0 client.15429 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:14.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.937+0000 7f1061417740 1 --2- 172.21.15.1:0/1977743995 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2f8f9e360 0x55c2f8faa0d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.937+0000 7f1061417740 1 --2- 172.21.15.1:0/1977743995 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2f8f992d0 0x55c2f8fa3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.937+0000 7f1061417740 1 --2- 172.21.15.1:0/1977743995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2f8f98990 0x55c2f8fa2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.937+0000 7f1061417740 1 -- 172.21.15.1:0/1977743995 >> 172.21.15.1:0/1977743995 conn(0x55c2f8f94000 msgr2=0x55c2f8f95810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:14.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.937+0000 7f1061417740 1 -- 172.21.15.1:0/1977743995 shutdown_connections 2024-09-19T09:39:14.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.937+0000 7f1061417740 1 -- 172.21.15.1:0/1977743995 wait complete. 2024-09-19T09:39:14.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.937+0000 7f1061417740 20 client.15429 trim_cache size 0 max 16384 2024-09-19T09:39:14.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.951+0000 7f1061417740 1 Processor -- start 2024-09-19T09:39:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.951+0000 7f1061417740 1 -- start start 2024-09-19T09:39:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.952+0000 7f1061417740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2f8f98990 0x55c2f8f94eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.952+0000 7f1061417740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2f8f992d0 0x55c2f8fa9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.952+0000 7f1061417740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2f8f9e360 0x55c2f8f953f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.952+0000 7f1061417740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f10581a92d0 con 0x55c2f8f992d0 2024-09-19T09:39:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.952+0000 7f1061417740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f10581abb70 con 0x55c2f8f9e360 2024-09-19T09:39:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.952+0000 7f1061417740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f10581a9960 con 0x55c2f8f98990 2024-09-19T09:39:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.952+0000 7f10577fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2f8f992d0 0x55c2f8fa9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:14.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.952+0000 7f10577fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2f8f992d0 0x55c2f8fa9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40150/0 (socket says 172.21.15.1:40150) 2024-09-19T09:39:14.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.952+0000 7f10577fe640 1 -- 172.21.15.1:0/3292411241 learned_addr learned my addr 172.21.15.1:0/3292411241 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:14.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.952+0000 7f105cc11640 1 --2- 172.21.15.1:0/3292411241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2f8f9e360 0x55c2f8f953f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:14.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.952+0000 7f1057fff640 1 --2- 172.21.15.1:0/3292411241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2f8f98990 0x55c2f8f94eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:14.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.952+0000 7f105cc11640 1 -- 172.21.15.1:0/3292411241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2f8f98990 msgr2=0x55c2f8f94eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:14.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.952+0000 7f105cc11640 1 --2- 172.21.15.1:0/3292411241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2f8f98990 0x55c2f8f94eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.952+0000 7f105cc11640 1 -- 172.21.15.1:0/3292411241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2f8f992d0 msgr2=0x55c2f8fa9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:14.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.952+0000 7f105cc11640 1 --2- 172.21.15.1:0/3292411241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2f8f992d0 0x55c2f8fa9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.952+0000 7f105cc11640 1 -- 172.21.15.1:0/3292411241 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2f8f997b0 con 0x55c2f8f9e360 2024-09-19T09:39:14.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.952+0000 7f1057fff640 1 --2- 172.21.15.1:0/3292411241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2f8f98990 0x55c2f8f94eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:14.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.952+0000 7f10577fe640 1 --2- 172.21.15.1:0/3292411241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2f8f992d0 0x55c2f8fa9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:14.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.952+0000 7f105cc11640 1 --2- 172.21.15.1:0/3292411241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2f8f9e360 0x55c2f8f953f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f105000ad20 tx=0x7f105000fd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=578b99d03e11882b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:14.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.953+0000 7f103dffb640 1 -- 172.21.15.1:0/3292411241 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1050010a20 con 0x55c2f8f9e360 2024-09-19T09:39:14.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.953+0000 7f103dffb640 1 -- 172.21.15.1:0/3292411241 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f105003b070 con 0x55c2f8f9e360 2024-09-19T09:39:14.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.953+0000 7f103dffb640 1 -- 172.21.15.1:0/3292411241 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10500187a0 con 0x55c2f8f9e360 2024-09-19T09:39:14.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.953+0000 7f1061417740 1 -- 172.21.15.1:0/3292411241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2f8f9e360 msgr2=0x55c2f8f953f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:14.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.953+0000 7f1061417740 1 --2- 172.21.15.1:0/3292411241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2f8f9e360 0x55c2f8f953f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f105000ad20 tx=0x7f105000fd40 comp rx=0 tx=0).stop 2024-09-19T09:39:14.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.953+0000 7f1061417740 1 -- 172.21.15.1:0/3292411241 shutdown_connections 2024-09-19T09:39:14.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.953+0000 7f1061417740 1 --2- 172.21.15.1:0/3292411241 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2f8f9e360 0x55c2f8f953f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.954+0000 7f1061417740 1 --2- 172.21.15.1:0/3292411241 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2f8f992d0 0x55c2f8fa9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.954+0000 7f1061417740 1 --2- 172.21.15.1:0/3292411241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2f8f98990 0x55c2f8f94eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.954+0000 7f1061417740 1 -- 172.21.15.1:0/3292411241 >> 172.21.15.1:0/3292411241 conn(0x55c2f8f94000 msgr2=0x55c2f8fa2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:14.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.954+0000 7f1061417740 1 -- 172.21.15.1:0/3292411241 shutdown_connections 2024-09-19T09:39:14.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.954+0000 7f1061417740 1 -- 172.21.15.1:0/3292411241 wait complete. 2024-09-19T09:39:14.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.954+0000 7f1061417740 1 -- start start 2024-09-19T09:39:14.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.954+0000 7f1061417740 1 Processor -- start 2024-09-19T09:39:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.955+0000 7f1061417740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2f8f98990 0x55c2f8fa6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.955+0000 7f1061417740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2f8f992d0 0x55c2f8fa7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.955+0000 7f1061417740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2f8f9e360 0x55c2f9017140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.955+0000 7f1061417740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f10581aa030 con 0x55c2f8f9e360 2024-09-19T09:39:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.955+0000 7f1061417740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f10581ab4a0 con 0x55c2f8f992d0 2024-09-19T09:39:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.955+0000 7f1061417740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f10581aa700 con 0x55c2f8f98990 2024-09-19T09:39:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.955+0000 7f1061417740 10 client.0 _ll_register_callbacks cb 0x7f105000ac50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.955+0000 7f1057fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2f8f98990 0x55c2f8fa6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.955+0000 7f1057fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2f8f98990 0x55c2f8fa6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:50324/0 (socket says 172.21.15.1:50324) 2024-09-19T09:39:14.964 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.955+0000 7f1057fff640 1 -- 172.21.15.1:0/44500713 learned_addr learned my addr 172.21.15.1:0/44500713 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.955+0000 7f10577fe640 1 --2- 172.21.15.1:0/44500713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2f8f992d0 0x55c2f8fa7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.955+0000 7f105cc11640 1 --2- 172.21.15.1:0/44500713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2f8f9e360 0x55c2f9017140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.955+0000 7f1057fff640 1 -- 172.21.15.1:0/44500713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2f8f992d0 msgr2=0x55c2f8fa7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.955+0000 7f1057fff640 1 --2- 172.21.15.1:0/44500713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2f8f992d0 0x55c2f8fa7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.955+0000 7f1057fff640 1 -- 172.21.15.1:0/44500713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2f8f9e360 msgr2=0x55c2f9017140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.955+0000 7f1057fff640 1 --2- 172.21.15.1:0/44500713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2f8f9e360 0x55c2f9017140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.955+0000 7f1057fff640 1 -- 172.21.15.1:0/44500713 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2f9017680 con 0x55c2f8f98990 2024-09-19T09:39:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.955+0000 7f105cc11640 1 --2- 172.21.15.1:0/44500713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2f8f9e360 0x55c2f9017140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.956+0000 7f1057fff640 1 --2- 172.21.15.1:0/44500713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2f8f98990 0x55c2f8fa6ef0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x55c2f8fb1120 tx=0x7f10480046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2056771d97f3f08 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.956+0000 7f10377fe640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-19T09:39:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.956+0000 7f10377fe640 1 -- 172.21.15.1:0/44500713 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104802e070 con 0x55c2f8f98990 2024-09-19T09:39:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.956+0000 7f10377fe640 1 -- 172.21.15.1:0/44500713 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f10480037b0 con 0x55c2f8f98990 2024-09-19T09:39:14.965 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.956+0000 7f1061417740 1 -- 172.21.15.1:0/44500713 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f105003b070 con 0x55c2f8f98990 2024-09-19T09:39:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.956+0000 7f10377fe640 1 -- 172.21.15.1:0/44500713 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1048038050 con 0x55c2f8f98990 2024-09-19T09:39:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.956+0000 7f1061417740 10 client.25057 fetch_fsmap learned FSMap version 19 2024-09-19T09:39:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.956+0000 7f1061417740 1 -- 172.21.15.1:0/44500713 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55c2f9018a10 con 0x55c2f8f98990 2024-09-19T09:39:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.957+0000 7f10377fe640 1 -- 172.21.15.1:0/44500713 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f105003b070 con 0x55c2f8f98990 2024-09-19T09:39:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.957+0000 7f10377fe640 1 -- 172.21.15.1:0/44500713 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1048033c10 con 0x55c2f8f98990 2024-09-19T09:39:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.958+0000 7f1061417740 10 client.25057 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:39:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.958+0000 7f1061417740 10 client.25057 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.958+0000 7f1061417740 20 client.25057 populate_metadata read hostname 'smithi001' 2024-09-19T09:39:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.958+0000 7f1061417740 1 --2- 172.21.15.1:0/44500713 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55c2f8fae4f0 0x55c2f901b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.958+0000 7f1061417740 4 client.25057 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:39:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.958+0000 7f1061417740 1 -- 172.21.15.1:0/44500713 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c2f8f03d70 con 0x55c2f8fae4f0 2024-09-19T09:39:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.958+0000 7f10577fe640 1 --2- 172.21.15.1:0/44500713 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55c2f8fae4f0 0x55c2f901b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:14.966 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.959+0000 7f10577fe640 1 --2- 172.21.15.1:0/44500713 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55c2f8fae4f0 0x55c2f901b3a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d14e65b21eb6e2a3 server_cookie=b00400e4eda032ef in_seq=0 out_seq=0 2024-09-19T09:39:14.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.959+0000 7f10377fe640 10 client.25057 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.962+0000 7f10377fe640 1 -- 172.21.15.1:0/44500713 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c2f8f03d70 con 0x55c2f8fae4f0 2024-09-19T09:39:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.962+0000 7f10377fe640 10 client.25057 handle_command_reply: tid=0 2024-09-19T09:39:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.962+0000 7f1061417740 1 client.25057 shutdown 2024-09-19T09:39:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.963+0000 7f1061417740 1 -- 172.21.15.1:0/44500713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2f8f98990 msgr2=0x55c2f8fa6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.963+0000 7f1061417740 1 --2- 172.21.15.1:0/44500713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2f8f98990 0x55c2f8fa6ef0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x55c2f8fb1120 tx=0x7f10480046c0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.963+0000 7f1061417740 1 -- 172.21.15.1:0/44500713 shutdown_connections 2024-09-19T09:39:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.963+0000 7f1061417740 1 --2- 172.21.15.1:0/44500713 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55c2f8fae4f0 0x55c2f901b3a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.963+0000 7f10377fe640 0 client.25057 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.963+0000 7f1061417740 1 --2- 172.21.15.1:0/44500713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c2f8f9e360 0x55c2f9017140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.963+0000 7f1061417740 1 --2- 172.21.15.1:0/44500713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2f8f992d0 0x55c2f8fa7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.963+0000 7f1061417740 1 --2- 172.21.15.1:0/44500713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c2f8f98990 0x55c2f8fa6ef0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.963+0000 7f1061417740 1 -- 172.21.15.1:0/44500713 >> 172.21.15.1:0/44500713 conn(0x55c2f8f94000 msgr2=0x55c2f8f929f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.963+0000 7f1061417740 1 -- 172.21.15.1:0/44500713 shutdown_connections 2024-09-19T09:39:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.963+0000 7f1061417740 1 -- 172.21.15.1:0/44500713 wait complete. 2024-09-19T09:39:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.963+0000 7f1061417740 20 client.25057 trim_cache size 0 max 16384 2024-09-19T09:39:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:39:14.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:39:14.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:39:14.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:39:14.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.964+0000 7f105e674640 1 -- 172.21.15.1:0/3943990594 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f10400a32c0 msgr2=0x7f10400a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:14.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.964+0000 7f105e674640 1 --2- 172.21.15.1:0/3943990594 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f10400a32c0 0x7f10400a5780 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55c2f8f99d00 tx=0x7f1048005f90 comp rx=0 tx=0).stop 2024-09-19T09:39:14.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.964+0000 7f105e674640 1 -- 172.21.15.1:0/3943990594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1058104f90 msgr2=0x7f1058198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:14.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.964+0000 7f105e674640 1 --2- 172.21.15.1:0/3943990594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1058104f90 0x7f1058198420 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f104c031610 tx=0x7f104c0045e0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.964+0000 7f105e674640 1 -- 172.21.15.1:0/3943990594 shutdown_connections 2024-09-19T09:39:14.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.964+0000 7f105e674640 1 --2- 172.21.15.1:0/3943990594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10581078c0 0x7f105819f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.964+0000 7f105e674640 1 --2- 172.21.15.1:0/3943990594 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1058104f90 0x7f1058198420 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.964+0000 7f105e674640 1 --2- 172.21.15.1:0/3943990594 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f10400a32c0 0x7f10400a5780 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.964+0000 7f105e674640 1 --2- 172.21.15.1:0/3943990594 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1058102660 0x7f1058197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:14.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.964+0000 7f105e674640 1 -- 172.21.15.1:0/3943990594 >> 172.21.15.1:0/3943990594 conn(0x7f10580fc1c0 msgr2=0x7f10581030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:14.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.964+0000 7f105e674640 1 -- 172.21.15.1:0/3943990594 shutdown_connections 2024-09-19T09:39:14.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:14.964+0000 7f105e674640 1 -- 172.21.15.1:0/3943990594 wait complete. 2024-09-19T09:39:16.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:16 smithi022 ceph-mon[35583]: pgmap v373: 97 pgs: 97 active+clean; 659 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:39:16.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:16 smithi121 ceph-mon[35577]: pgmap v373: 97 pgs: 97 active+clean; 659 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:39:16.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:16 smithi001 ceph-mon[31225]: pgmap v373: 97 pgs: 97 active+clean; 659 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:39:18.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:18 smithi022 ceph-mon[35583]: pgmap v374: 97 pgs: 97 active+clean; 660 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-19T09:39:18.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:18 smithi121 ceph-mon[35577]: pgmap v374: 97 pgs: 97 active+clean; 660 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-19T09:39:18.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:18 smithi001 ceph-mon[31225]: pgmap v374: 97 pgs: 97 active+clean; 660 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-19T09:39:19.021 INFO:tasks.quiescer.fs.[cephfs]:Total duration (40.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T09:39:19.022 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T09:39:19.022 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:39:19.417 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:19.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.932+0000 7fea2d5df640 1 -- 172.21.15.1:0/1432041513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea28102d30 msgr2=0x7fea28103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:19.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.932+0000 7fea2d5df640 1 --2- 172.21.15.1:0/1432041513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea28102d30 0x7fea28103110 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fea18009930 tx=0x7fea1802a420 comp rx=0 tx=0).stop 2024-09-19T09:39:19.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.932+0000 7fea2d5df640 1 -- 172.21.15.1:0/1432041513 shutdown_connections 2024-09-19T09:39:19.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.932+0000 7fea2d5df640 1 --2- 172.21.15.1:0/1432041513 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea281082a0 0x7fea2810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.932+0000 7fea2d5df640 1 --2- 172.21.15.1:0/1432041513 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea281036e0 0x7fea28107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.932+0000 7fea2d5df640 1 --2- 172.21.15.1:0/1432041513 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea28102d30 0x7fea28103110 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.932+0000 7fea2d5df640 1 -- 172.21.15.1:0/1432041513 >> 172.21.15.1:0/1432041513 conn(0x7fea280fc7d0 msgr2=0x7fea280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:19.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.932+0000 7fea2d5df640 1 -- 172.21.15.1:0/1432041513 shutdown_connections 2024-09-19T09:39:19.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.932+0000 7fea2d5df640 1 -- 172.21.15.1:0/1432041513 wait complete. 2024-09-19T09:39:19.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.933+0000 7fea2d5df640 1 Processor -- start 2024-09-19T09:39:19.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.933+0000 7fea2d5df640 1 -- start start 2024-09-19T09:39:19.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.933+0000 7fea2d5df640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea28102d30 0x7fea281985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:19.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.933+0000 7fea2d5df640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea281036e0 0x7fea28198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:19.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.933+0000 7fea2d5df640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea281082a0 0x7fea2819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:19.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.933+0000 7fea2d5df640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fea281120a0 con 0x7fea28102d30 2024-09-19T09:39:19.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.933+0000 7fea2d5df640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fea28111f20 con 0x7fea281036e0 2024-09-19T09:39:19.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.933+0000 7fea2d5df640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fea28112220 con 0x7fea281082a0 2024-09-19T09:39:19.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.934+0000 7fea26ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea28102d30 0x7fea281985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:19.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.934+0000 7fea26ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea28102d30 0x7fea281985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45410/0 (socket says 172.21.15.1:45410) 2024-09-19T09:39:19.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.934+0000 7fea26ffd640 1 -- 172.21.15.1:0/3350529549 learned_addr learned my addr 172.21.15.1:0/3350529549 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:19.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.934+0000 7fea267fc640 1 --2- 172.21.15.1:0/3350529549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea281036e0 0x7fea28198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:19.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.934+0000 7fea277fe640 1 --2- 172.21.15.1:0/3350529549 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea281082a0 0x7fea2819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:19.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.934+0000 7fea26ffd640 1 -- 172.21.15.1:0/3350529549 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea281082a0 msgr2=0x7fea2819ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:19.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.934+0000 7fea26ffd640 1 --2- 172.21.15.1:0/3350529549 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea281082a0 0x7fea2819ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.934+0000 7fea26ffd640 1 -- 172.21.15.1:0/3350529549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea281036e0 msgr2=0x7fea28198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:19.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.934+0000 7fea26ffd640 1 --2- 172.21.15.1:0/3350529549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea281036e0 0x7fea28198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:19.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.934+0000 7fea26ffd640 1 -- 172.21.15.1:0/3350529549 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea2819d550 con 0x7fea28102d30 2024-09-19T09:39:19.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.934+0000 7fea277fe640 1 --2- 172.21.15.1:0/3350529549 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea281082a0 0x7fea2819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:19.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.934+0000 7fea267fc640 1 --2- 172.21.15.1:0/3350529549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea281036e0 0x7fea28198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:19.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.934+0000 7fea26ffd640 1 --2- 172.21.15.1:0/3350529549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea28102d30 0x7fea281985a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fea18009230 tx=0x7fea18004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:19.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.934+0000 7fea0ffff640 1 -- 172.21.15.1:0/3350529549 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1803f030 con 0x7fea28102d30 2024-09-19T09:39:19.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.934+0000 7fea0ffff640 1 -- 172.21.15.1:0/3350529549 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea18003ad0 con 0x7fea28102d30 2024-09-19T09:39:19.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.934+0000 7fea2d5df640 1 -- 172.21.15.1:0/3350529549 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea2819d7e0 con 0x7fea28102d30 2024-09-19T09:39:19.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.934+0000 7fea0ffff640 1 -- 172.21.15.1:0/3350529549 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea18035070 con 0x7fea28102d30 2024-09-19T09:39:19.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.935+0000 7fea2d5df640 1 -- 172.21.15.1:0/3350529549 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea281a5120 con 0x7fea28102d30 2024-09-19T09:39:19.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.936+0000 7fea2d5df640 1 -- 172.21.15.1:0/3350529549 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea2806a850 con 0x7fea28102d30 2024-09-19T09:39:19.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.937+0000 7fea0ffff640 1 -- 172.21.15.1:0/3350529549 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fea18042030 con 0x7fea28102d30 2024-09-19T09:39:19.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.937+0000 7fea0ffff640 1 --2- 172.21.15.1:0/3350529549 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fea100a3240 0x7fea100a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:19.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.937+0000 7fea0ffff640 1 -- 172.21.15.1:0/3350529549 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fea180eff30 con 0x7fea28102d30 2024-09-19T09:39:19.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.937+0000 7fea267fc640 1 --2- 172.21.15.1:0/3350529549 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fea100a3240 0x7fea100a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:19.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.938+0000 7fea267fc640 1 --2- 172.21.15.1:0/3350529549 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fea100a3240 0x7fea100a5700 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fea280fee00 tx=0x7fea1c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:19.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:19.942+0000 7fea0ffff640 1 -- 172.21.15.1:0/3350529549 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fea180bcc50 con 0x7fea28102d30 2024-09-19T09:39:20.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:20.155+0000 7fea2d5df640 1 -- 172.21.15.1:0/3350529549 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea2810a2b0 con 0x7fea28102d30 2024-09-19T09:39:20.157 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:20 smithi001 ceph-mon[31225]: pgmap v375: 97 pgs: 97 active+clean; 660 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:39:20.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:20.156+0000 7fea0ffff640 1 -- 172.21.15.1:0/3350529549 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11837 (secure 0 0 0) 0x7fea180bc550 con 0x7fea28102d30 2024-09-19T09:39:20.158 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:39:20.158 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":19,"btime":"2024-09-19T09:36:24:006349+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:36:23.723388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6839/3279971690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3279971690},{"type":"v1","addr":"172.21.15.121:6839","nonce":3279971690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:39:20.158 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 19 2024-09-19T09:39:20.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:20.159+0000 7fea2d5df640 1 -- 172.21.15.1:0/3350529549 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fea100a3240 msgr2=0x7fea100a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:20.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:20.159+0000 7fea2d5df640 1 --2- 172.21.15.1:0/3350529549 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fea100a3240 0x7fea100a5700 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fea280fee00 tx=0x7fea1c00b410 comp rx=0 tx=0).stop 2024-09-19T09:39:20.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:20.159+0000 7fea2d5df640 1 -- 172.21.15.1:0/3350529549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea28102d30 msgr2=0x7fea281985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:20.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:20.159+0000 7fea2d5df640 1 --2- 172.21.15.1:0/3350529549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea28102d30 0x7fea281985a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fea18009230 tx=0x7fea18004270 comp rx=0 tx=0).stop 2024-09-19T09:39:20.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:20.159+0000 7fea2d5df640 1 -- 172.21.15.1:0/3350529549 shutdown_connections 2024-09-19T09:39:20.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:20.159+0000 7fea2d5df640 1 --2- 172.21.15.1:0/3350529549 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fea281082a0 0x7fea2819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:20.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:20.159+0000 7fea2d5df640 1 --2- 172.21.15.1:0/3350529549 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fea100a3240 0x7fea100a5700 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:20.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:20.159+0000 7fea2d5df640 1 --2- 172.21.15.1:0/3350529549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fea281036e0 0x7fea28198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:20.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:20.159+0000 7fea2d5df640 1 --2- 172.21.15.1:0/3350529549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea28102d30 0x7fea281985a0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:20.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:20.159+0000 7fea2d5df640 1 -- 172.21.15.1:0/3350529549 >> 172.21.15.1:0/3350529549 conn(0x7fea280fc7d0 msgr2=0x7fea28105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:20.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:20.159+0000 7fea2d5df640 1 -- 172.21.15.1:0/3350529549 shutdown_connections 2024-09-19T09:39:20.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:20.159+0000 7fea2d5df640 1 -- 172.21.15.1:0/3350529549 wait complete. 2024-09-19T09:39:20.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:20 smithi022 ceph-mon[35583]: pgmap v375: 97 pgs: 97 active+clean; 660 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:39:20.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:20 smithi121 ceph-mon[35577]: pgmap v375: 97 pgs: 97 active+clean; 660 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:39:21.165 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T09:39:21.165 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T09:39:21.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:21 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/3350529549' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:21.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:21 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:39:21.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:21 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/3350529549' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:21.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:21 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:39:21.449 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:21.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:21 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/3350529549' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:21.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:21 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:39:22.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:22 smithi022 ceph-mon[35583]: pgmap v376: 97 pgs: 97 active+clean; 660 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:39:22.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:22 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:39:22.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:22 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:39:22.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:22 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:22.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:22 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:39:22.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:22 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:39:22.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:22 smithi121 ceph-mon[35577]: pgmap v376: 97 pgs: 97 active+clean; 660 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:39:22.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:22 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:39:22.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:22 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:39:22.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:22 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:22.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:22 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:39:22.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:22 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:39:22.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:22 smithi001 ceph-mon[31225]: pgmap v376: 97 pgs: 97 active+clean; 660 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:39:22.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:22 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:39:22.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:22 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:39:22.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:22 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:39:22.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:22 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:39:22.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:22 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:39:23.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.237+0000 7f4c8249f640 1 -- 172.21.15.1:0/2375634253 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c7c102ef0 msgr2=0x7f4c7c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:23.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.237+0000 7f4c8249f640 1 --2- 172.21.15.1:0/2375634253 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c7c102ef0 0x7f4c7c10da40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4c74009ca0 tx=0x7f4c7402a950 comp rx=0 tx=0).stop 2024-09-19T09:39:23.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.237+0000 7f4c8249f640 1 -- 172.21.15.1:0/2375634253 shutdown_connections 2024-09-19T09:39:23.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.237+0000 7f4c8249f640 1 --2- 172.21.15.1:0/2375634253 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c7c102ef0 0x7f4c7c10da40 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.237+0000 7f4c8249f640 1 --2- 172.21.15.1:0/2375634253 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c7c102570 0x7f4c7c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.237+0000 7f4c8249f640 1 --2- 172.21.15.1:0/2375634253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c7c100e20 0x7f4c7c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.237+0000 7f4c8249f640 1 -- 172.21.15.1:0/2375634253 >> 172.21.15.1:0/2375634253 conn(0x7f4c7c0fc7d0 msgr2=0x7f4c7c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:23.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.237+0000 7f4c8249f640 1 -- 172.21.15.1:0/2375634253 shutdown_connections 2024-09-19T09:39:23.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.238+0000 7f4c8249f640 1 -- 172.21.15.1:0/2375634253 wait complete. 2024-09-19T09:39:23.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.238+0000 7f4c8249f640 1 Processor -- start 2024-09-19T09:39:23.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.238+0000 7f4c8249f640 1 -- start start 2024-09-19T09:39:23.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.238+0000 7f4c8249f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c7c100e20 0x7f4c7c1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.239+0000 7f4c8249f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c7c102570 0x7f4c7c198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.239+0000 7f4c8249f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c7c102ef0 0x7f4c7c19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.239+0000 7f4c8249f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c110f80 con 0x7f4c7c102570 2024-09-19T09:39:23.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.239+0000 7f4c8249f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c110e00 con 0x7f4c7c100e20 2024-09-19T09:39:23.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.239+0000 7f4c8249f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c111100 con 0x7f4c7c102ef0 2024-09-19T09:39:23.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.239+0000 7f4c7b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c7c102570 0x7f4c7c198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.239+0000 7f4c7b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c7c102570 0x7f4c7c198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45426/0 (socket says 172.21.15.1:45426) 2024-09-19T09:39:23.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.239+0000 7f4c7b7fe640 1 -- 172.21.15.1:0/1239414978 learned_addr learned my addr 172.21.15.1:0/1239414978 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:23.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.239+0000 7f4c80a3c640 1 --2- 172.21.15.1:0/1239414978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c7c102ef0 0x7f4c7c19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.239+0000 7f4c7bfff640 1 --2- 172.21.15.1:0/1239414978 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c7c100e20 0x7f4c7c1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.239+0000 7f4c7b7fe640 1 -- 172.21.15.1:0/1239414978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c7c102ef0 msgr2=0x7f4c7c19cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:23.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.239+0000 7f4c7b7fe640 1 --2- 172.21.15.1:0/1239414978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c7c102ef0 0x7f4c7c19cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.239+0000 7f4c7b7fe640 1 -- 172.21.15.1:0/1239414978 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c7c100e20 msgr2=0x7f4c7c1984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:23.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.239+0000 7f4c7b7fe640 1 --2- 172.21.15.1:0/1239414978 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c7c100e20 0x7f4c7c1984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.239+0000 7f4c7b7fe640 1 -- 172.21.15.1:0/1239414978 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7c19d480 con 0x7f4c7c102570 2024-09-19T09:39:23.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.239+0000 7f4c7b7fe640 1 --2- 172.21.15.1:0/1239414978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c7c102570 0x7f4c7c198a10 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000d950 tx=0x7f4c7000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:23.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.240+0000 7f4c797fa640 1 -- 172.21.15.1:0/1239414978 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70017070 con 0x7f4c7c102570 2024-09-19T09:39:23.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.240+0000 7f4c8249f640 1 -- 172.21.15.1:0/1239414978 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c7c19d770 con 0x7f4c7c102570 2024-09-19T09:39:23.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.240+0000 7f4c797fa640 1 -- 172.21.15.1:0/1239414978 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c70009c30 con 0x7f4c7c102570 2024-09-19T09:39:23.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.240+0000 7f4c797fa640 1 -- 172.21.15.1:0/1239414978 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7000f6b0 con 0x7f4c7c102570 2024-09-19T09:39:23.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.240+0000 7f4c8249f640 1 -- 172.21.15.1:0/1239414978 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c7c1a5050 con 0x7f4c7c102570 2024-09-19T09:39:23.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.242+0000 7f4c84878740 1 Processor -- start 2024-09-19T09:39:23.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.242+0000 7f4c84878740 1 -- start start 2024-09-19T09:39:23.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.243+0000 7f4c84878740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b7ec6850 0x5629b7ec6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.243+0000 7f4c84878740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629b7ec7170 0x5629b7ed14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.243+0000 7f4c84878740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5629b7ed1a30 0x5629b7ed3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.243+0000 7f4c84878740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5629b7e2b160 con 0x5629b7ec6850 2024-09-19T09:39:23.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.243+0000 7f4c84878740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5629b7dd2720 con 0x5629b7ed1a30 2024-09-19T09:39:23.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.243+0000 7f4c84878740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5629b7e27120 con 0x5629b7ec7170 2024-09-19T09:39:23.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.243+0000 7f4c7bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629b7ec7170 0x5629b7ed14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.243+0000 7f4c80a3c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b7ec6850 0x5629b7ec6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.243+0000 7f4c7bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629b7ec7170 0x5629b7ed14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:45336/0 (socket says 172.21.15.1:45336) 2024-09-19T09:39:23.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.243+0000 7f4c7bfff640 1 -- 172.21.15.1:0/1579776667 learned_addr learned my addr 172.21.15.1:0/1579776667 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:23.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.243+0000 7f4c797fa640 1 -- 172.21.15.1:0/1239414978 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f4c7000f850 con 0x7f4c7c102570 2024-09-19T09:39:23.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.243+0000 7f4c7bfff640 1 -- 172.21.15.1:0/1579776667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5629b7ed1a30 msgr2=0x5629b7ed3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:23.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.243+0000 7f4c7bfff640 1 --2- 172.21.15.1:0/1579776667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5629b7ed1a30 0x5629b7ed3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.243+0000 7f4c7bfff640 1 -- 172.21.15.1:0/1579776667 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b7ec6850 msgr2=0x5629b7ec6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:23.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.243+0000 7f4c7bfff640 1 --2- 172.21.15.1:0/1579776667 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b7ec6850 0x5629b7ec6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.243+0000 7f4c7bfff640 1 -- 172.21.15.1:0/1579776667 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629b7b9cba0 con 0x5629b7ec7170 2024-09-19T09:39:23.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.244+0000 7f4c80a3c640 1 --2- 172.21.15.1:0/1579776667 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b7ec6850 0x5629b7ec6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:23.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.244+0000 7f4c7bfff640 1 --2- 172.21.15.1:0/1579776667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629b7ec7170 0x5629b7ed14f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c00cbf0 tx=0x7f4c6c00e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee3dd37b011ad911 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:23.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.244+0000 7f4c627fc640 1 -- 172.21.15.1:0/1579776667 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c010630 con 0x5629b7ec7170 2024-09-19T09:39:23.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.244+0000 7f4c627fc640 1 -- 172.21.15.1:0/1579776667 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c6c010cb0 con 0x5629b7ec7170 2024-09-19T09:39:23.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.244+0000 7f4c627fc640 1 -- 172.21.15.1:0/1579776667 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c019c90 con 0x5629b7ec7170 2024-09-19T09:39:23.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.244+0000 7f4c797fa640 1 --2- 172.21.15.1:0/1239414978 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4c640a32c0 0x7f4c640a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.244+0000 7f4c797fa640 1 -- 172.21.15.1:0/1239414978 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f4c700cf510 con 0x7f4c7c102570 2024-09-19T09:39:23.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.244+0000 7f4c80a3c640 1 --2- 172.21.15.1:0/1239414978 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4c640a32c0 0x7f4c640a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.245+0000 7f4c84878740 1 -- 172.21.15.1:0/1579776667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629b7ec7170 msgr2=0x5629b7ed14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:23.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.245+0000 7f4c84878740 1 --2- 172.21.15.1:0/1579776667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629b7ec7170 0x5629b7ed14f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c00cbf0 tx=0x7f4c6c00e720 comp rx=0 tx=0).stop 2024-09-19T09:39:23.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.245+0000 7f4c84878740 1 -- 172.21.15.1:0/1579776667 shutdown_connections 2024-09-19T09:39:23.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.245+0000 7f4c84878740 1 --2- 172.21.15.1:0/1579776667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5629b7ed1a30 0x5629b7ed3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.245+0000 7f4c84878740 1 --2- 172.21.15.1:0/1579776667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629b7ec7170 0x5629b7ed14f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.245+0000 7f4c84878740 1 --2- 172.21.15.1:0/1579776667 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b7ec6850 0x5629b7ec6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.245+0000 7f4c84878740 1 -- 172.21.15.1:0/1579776667 >> 172.21.15.1:0/1579776667 conn(0x5629b7ec2de0 msgr2=0x5629b7ec31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:23.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.245+0000 7f4c80a3c640 1 --2- 172.21.15.1:0/1239414978 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4c640a32c0 0x7f4c640a5780 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4c74005e30 tx=0x7f4c74005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:23.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.245+0000 7f4c84878740 1 -- 172.21.15.1:0/1579776667 shutdown_connections 2024-09-19T09:39:23.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.245+0000 7f4c84878740 1 -- 172.21.15.1:0/1579776667 wait complete. 2024-09-19T09:39:23.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.246+0000 7f4c84878740 1 -- start start 2024-09-19T09:39:23.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.246+0000 7f4c84878740 1 Processor -- start 2024-09-19T09:39:23.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.246+0000 7f4c84878740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b7ec6850 0x5629b7ece8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.246+0000 7f4c84878740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629b7ec7170 0x5629b7ecee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.246+0000 7f4c84878740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5629b7ed1a30 0x5629b7ecf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.246+0000 7f4c84878740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5629b7ed8a10 con 0x5629b7ec6850 2024-09-19T09:39:23.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.246+0000 7f4c84878740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5629b7db3900 con 0x5629b7ed1a30 2024-09-19T09:39:23.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.246+0000 7f4c84878740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5629b7ed8b90 con 0x5629b7ec7170 2024-09-19T09:39:23.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.246+0000 7f4c84878740 10 client.0 _ll_register_callbacks cb 0x5629b7db1780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:23.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.246+0000 7f4c7bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b7ec6850 0x5629b7ece8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.246+0000 7f4c80a3c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5629b7ed1a30 0x5629b7ecf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.246+0000 7f4c7bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b7ec6850 0x5629b7ece8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45452/0 (socket says 172.21.15.1:45452) 2024-09-19T09:39:23.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.246+0000 7f4c7bfff640 1 -- 172.21.15.1:0/1903220713 learned_addr learned my addr 172.21.15.1:0/1903220713 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:23.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.247+0000 7f4c7b7fe640 1 --2- 172.21.15.1:0/1903220713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629b7ec7170 0x5629b7ecee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.247+0000 7f4c7bfff640 1 -- 172.21.15.1:0/1903220713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629b7ec7170 msgr2=0x5629b7ecee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:23.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.247+0000 7f4c7bfff640 1 --2- 172.21.15.1:0/1903220713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629b7ec7170 0x5629b7ecee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.247+0000 7f4c7bfff640 1 -- 172.21.15.1:0/1903220713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5629b7ed1a30 msgr2=0x5629b7ecf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:23.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.247+0000 7f4c7bfff640 1 --2- 172.21.15.1:0/1903220713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5629b7ed1a30 0x5629b7ecf350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.247+0000 7f4c7bfff640 1 -- 172.21.15.1:0/1903220713 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629b7df3c50 con 0x5629b7ec6850 2024-09-19T09:39:23.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.247+0000 7f4c80a3c640 1 --2- 172.21.15.1:0/1903220713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5629b7ed1a30 0x5629b7ecf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:23.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.247+0000 7f4c7b7fe640 1 --2- 172.21.15.1:0/1903220713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629b7ec7170 0x5629b7ecee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:23.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.247+0000 7f4c7bfff640 1 --2- 172.21.15.1:0/1903220713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b7ec6850 0x5629b7ece8d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c00ec20 tx=0x7f4c6c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3867618034c7adcd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:23.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.247+0000 7f4c5b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:39:23.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.247+0000 7f4c5b7fe640 1 -- 172.21.15.1:0/1903220713 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c029060 con 0x5629b7ec6850 2024-09-19T09:39:23.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.247+0000 7f4c5b7fe640 1 -- 172.21.15.1:0/1903220713 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f4c6c005250 con 0x5629b7ec6850 2024-09-19T09:39:23.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.248+0000 7f4c84878740 1 -- 172.21.15.1:0/1903220713 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c6c010cb0 con 0x5629b7ec6850 2024-09-19T09:39:23.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.248+0000 7f4c5b7fe640 1 -- 172.21.15.1:0/1903220713 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4c6c010e60 con 0x5629b7ec6850 2024-09-19T09:39:23.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.248+0000 7f4c84878740 10 client.15453 fetch_fsmap learned FSMap version 19 2024-09-19T09:39:23.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.248+0000 7f4c84878740 1 -- 172.21.15.1:0/1903220713 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5629b7ee46a0 con 0x5629b7ec6850 2024-09-19T09:39:23.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.248+0000 7f4c5b7fe640 1 -- 172.21.15.1:0/1903220713 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c6c010cb0 con 0x5629b7ec6850 2024-09-19T09:39:23.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.248+0000 7f4c5b7fe640 1 -- 172.21.15.1:0/1903220713 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4c6c02e070 con 0x5629b7ec6850 2024-09-19T09:39:23.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.248+0000 7f4c84878740 10 client.15453 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:39:23.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.248+0000 7f4c84878740 10 client.15453 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:39:23.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.248+0000 7f4c84878740 20 client.15453 populate_metadata read hostname 'smithi001' 2024-09-19T09:39:23.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.248+0000 7f4c84878740 1 --2- 172.21.15.1:0/1903220713 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5629b7ee5b60 0x5629b7ee7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.248+0000 7f4c84878740 4 client.15453 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:39:23.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.248+0000 7f4c84878740 1 -- 172.21.15.1:0/1903220713 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629b7e38890 con 0x5629b7ee5b60 2024-09-19T09:39:23.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.249+0000 7f4c7b7fe640 1 --2- 172.21.15.1:0/1903220713 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5629b7ee5b60 0x5629b7ee7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.249+0000 7f4c5b7fe640 10 client.15453 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:23.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.249+0000 7f4c7b7fe640 1 --2- 172.21.15.1:0/1903220713 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5629b7ee5b60 0x5629b7ee7fb0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3852c90424cc25e0 server_cookie=2f8fe59862161bab in_seq=0 out_seq=0 2024-09-19T09:39:23.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.250+0000 7f4c5b7fe640 1 -- 172.21.15.1:0/1903220713 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5629b7e38890 con 0x5629b7ee5b60 2024-09-19T09:39:23.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.250+0000 7f4c5b7fe640 10 client.15453 handle_command_reply: tid=0 2024-09-19T09:39:23.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.250+0000 7f4c84878740 1 client.15453 shutdown 2024-09-19T09:39:23.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.250+0000 7f4c84878740 1 -- 172.21.15.1:0/1903220713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b7ec6850 msgr2=0x5629b7ece8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:23.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.250+0000 7f4c84878740 1 --2- 172.21.15.1:0/1903220713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b7ec6850 0x5629b7ece8d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c00ec20 tx=0x7f4c6c00c960 comp rx=0 tx=0).stop 2024-09-19T09:39:23.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.250+0000 7f4c84878740 1 -- 172.21.15.1:0/1903220713 shutdown_connections 2024-09-19T09:39:23.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.250+0000 7f4c84878740 1 --2- 172.21.15.1:0/1903220713 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5629b7ee5b60 0x5629b7ee7fb0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.250+0000 7f4c84878740 1 --2- 172.21.15.1:0/1903220713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5629b7ed1a30 0x5629b7ecf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.250+0000 7f4c84878740 1 --2- 172.21.15.1:0/1903220713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629b7ec7170 0x5629b7ecee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.250+0000 7f4c84878740 1 --2- 172.21.15.1:0/1903220713 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b7ec6850 0x5629b7ece8d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.250+0000 7f4c84878740 1 -- 172.21.15.1:0/1903220713 >> 172.21.15.1:0/1903220713 conn(0x5629b7ec2de0 msgr2=0x5629b7ec8b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:23.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.250+0000 7f4c5b7fe640 0 client.15453 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:23.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.251+0000 7f4c84878740 1 -- 172.21.15.1:0/1903220713 shutdown_connections 2024-09-19T09:39:23.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.251+0000 7f4c84878740 1 -- 172.21.15.1:0/1903220713 wait complete. 2024-09-19T09:39:23.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.251+0000 7f4c84878740 20 client.15453 trim_cache size 0 max 16384 2024-09-19T09:39:23.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.268+0000 7f4c84878740 1 Processor -- start 2024-09-19T09:39:23.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.268+0000 7f4c84878740 1 -- start start 2024-09-19T09:39:23.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.268+0000 7f4c84878740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629b7ec6850 0x5629b7ec92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.268+0000 7f4c84878740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5629b7ec7170 0x5629b7ec1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.268+0000 7f4c84878740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b7ed1a30 0x5629b7eed850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.268+0000 7f4c84878740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1a9410 con 0x5629b7ed1a30 2024-09-19T09:39:23.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.268+0000 7f4c84878740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1abcb0 con 0x5629b7ec7170 2024-09-19T09:39:23.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.268+0000 7f4c84878740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1a9aa0 con 0x5629b7ec6850 2024-09-19T09:39:23.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.268+0000 7f4c80a3c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b7ed1a30 0x5629b7eed850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.268+0000 7f4c80a3c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b7ed1a30 0x5629b7eed850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45458/0 (socket says 172.21.15.1:45458) 2024-09-19T09:39:23.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.268+0000 7f4c80a3c640 1 -- 172.21.15.1:0/1118825960 learned_addr learned my addr 172.21.15.1:0/1118825960 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:23.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.269+0000 7f4c7b7fe640 1 --2- 172.21.15.1:0/1118825960 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5629b7ec7170 0x5629b7ec1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.269+0000 7f4c7bfff640 1 --2- 172.21.15.1:0/1118825960 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629b7ec6850 0x5629b7ec92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.269+0000 7f4c80a3c640 1 -- 172.21.15.1:0/1118825960 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629b7ec6850 msgr2=0x5629b7ec92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:23.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.269+0000 7f4c80a3c640 1 --2- 172.21.15.1:0/1118825960 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629b7ec6850 0x5629b7ec92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.269+0000 7f4c80a3c640 1 -- 172.21.15.1:0/1118825960 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5629b7ec7170 msgr2=0x5629b7ec1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:23.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.269+0000 7f4c80a3c640 1 --2- 172.21.15.1:0/1118825960 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5629b7ec7170 0x5629b7ec1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.269+0000 7f4c80a3c640 1 -- 172.21.15.1:0/1118825960 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629b7ec6fa0 con 0x5629b7ed1a30 2024-09-19T09:39:23.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.269+0000 7f4c80a3c640 1 --2- 172.21.15.1:0/1118825960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b7ed1a30 0x5629b7eed850 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4c74009ca0 tx=0x7f4c74041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=950b0d7f3d1c89c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:23.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.269+0000 7f4c61ffb640 1 -- 172.21.15.1:0/1118825960 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c74034040 con 0x5629b7ed1a30 2024-09-19T09:39:23.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.269+0000 7f4c61ffb640 1 -- 172.21.15.1:0/1118825960 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c74003e40 con 0x5629b7ed1a30 2024-09-19T09:39:23.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.269+0000 7f4c61ffb640 1 -- 172.21.15.1:0/1118825960 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c74030b40 con 0x5629b7ed1a30 2024-09-19T09:39:23.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.270+0000 7f4c84878740 1 -- 172.21.15.1:0/1118825960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b7ed1a30 msgr2=0x5629b7eed850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:23.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.270+0000 7f4c84878740 1 --2- 172.21.15.1:0/1118825960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b7ed1a30 0x5629b7eed850 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4c74009ca0 tx=0x7f4c74041000 comp rx=0 tx=0).stop 2024-09-19T09:39:23.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.270+0000 7f4c84878740 1 -- 172.21.15.1:0/1118825960 shutdown_connections 2024-09-19T09:39:23.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.270+0000 7f4c84878740 1 --2- 172.21.15.1:0/1118825960 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b7ed1a30 0x5629b7eed850 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.270+0000 7f4c84878740 1 --2- 172.21.15.1:0/1118825960 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5629b7ec7170 0x5629b7ec1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.270+0000 7f4c84878740 1 --2- 172.21.15.1:0/1118825960 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629b7ec6850 0x5629b7ec92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.270+0000 7f4c84878740 1 -- 172.21.15.1:0/1118825960 >> 172.21.15.1:0/1118825960 conn(0x5629b7ec2de0 msgr2=0x5629b7ec16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:23.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.270+0000 7f4c84878740 1 -- 172.21.15.1:0/1118825960 shutdown_connections 2024-09-19T09:39:23.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.270+0000 7f4c84878740 1 -- 172.21.15.1:0/1118825960 wait complete. 2024-09-19T09:39:23.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.270+0000 7f4c84878740 1 -- start start 2024-09-19T09:39:23.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.271+0000 7f4c84878740 1 Processor -- start 2024-09-19T09:39:23.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.271+0000 7f4c84878740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5629b7ec6850 0x5629b7ed8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.271+0000 7f4c84878740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629b7ec7170 0x5629b7ed9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.271+0000 7f4c84878740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b7ed1a30 0x5629b7ed9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.271+0000 7f4c84878740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1aa170 con 0x5629b7ed1a30 2024-09-19T09:39:23.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.271+0000 7f4c84878740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1ab5e0 con 0x5629b7ec6850 2024-09-19T09:39:23.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.271+0000 7f4c84878740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1aa840 con 0x5629b7ec7170 2024-09-19T09:39:23.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.271+0000 7f4c84878740 10 client.0 _ll_register_callbacks cb 0x7f4c6c014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:23.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.271+0000 7f4c80a3c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b7ed1a30 0x5629b7ed9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.271+0000 7f4c80a3c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b7ed1a30 0x5629b7ed9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45474/0 (socket says 172.21.15.1:45474) 2024-09-19T09:39:23.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.271+0000 7f4c80a3c640 1 -- 172.21.15.1:0/849280017 learned_addr learned my addr 172.21.15.1:0/849280017 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:23.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.271+0000 7f4c7bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5629b7ec6850 0x5629b7ed8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.271+0000 7f4c7b7fe640 1 --2- 172.21.15.1:0/849280017 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629b7ec7170 0x5629b7ed9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.272+0000 7f4c80a3c640 1 -- 172.21.15.1:0/849280017 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629b7ec7170 msgr2=0x5629b7ed9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:23.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.272+0000 7f4c80a3c640 1 --2- 172.21.15.1:0/849280017 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629b7ec7170 0x5629b7ed9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.272+0000 7f4c80a3c640 1 -- 172.21.15.1:0/849280017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5629b7ec6850 msgr2=0x5629b7ed8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:23.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.272+0000 7f4c80a3c640 1 --2- 172.21.15.1:0/849280017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5629b7ec6850 0x5629b7ed8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.272+0000 7f4c80a3c640 1 -- 172.21.15.1:0/849280017 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629b7f4e960 con 0x5629b7ed1a30 2024-09-19T09:39:23.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.272+0000 7f4c80a3c640 1 --2- 172.21.15.1:0/849280017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b7ed1a30 0x5629b7ed9850 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4c74005cc0 tx=0x7f4c74030e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd882907f661196 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:23.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.272+0000 7f4c5b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:39:23.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.273+0000 7f4c5b7fe640 1 -- 172.21.15.1:0/849280017 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c74034030 con 0x5629b7ed1a30 2024-09-19T09:39:23.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.273+0000 7f4c5b7fe640 1 -- 172.21.15.1:0/849280017 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f4c74004210 con 0x5629b7ed1a30 2024-09-19T09:39:23.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.273+0000 7f4c84878740 1 -- 172.21.15.1:0/849280017 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5629b7e32be0 con 0x5629b7ed1a30 2024-09-19T09:39:23.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.273+0000 7f4c5b7fe640 1 -- 172.21.15.1:0/849280017 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4c74004410 con 0x5629b7ed1a30 2024-09-19T09:39:23.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.273+0000 7f4c84878740 10 client.15459 fetch_fsmap learned FSMap version 19 2024-09-19T09:39:23.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.273+0000 7f4c84878740 1 -- 172.21.15.1:0/849280017 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5629b7f4fc20 con 0x5629b7ed1a30 2024-09-19T09:39:23.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.273+0000 7f4c5b7fe640 1 -- 172.21.15.1:0/849280017 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4c740045b0 con 0x5629b7ed1a30 2024-09-19T09:39:23.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.273+0000 7f4c5b7fe640 1 -- 172.21.15.1:0/849280017 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4c74066ae0 con 0x5629b7ed1a30 2024-09-19T09:39:23.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.274+0000 7f4c84878740 10 client.15459 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:39:23.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.274+0000 7f4c84878740 10 client.15459 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:39:23.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.274+0000 7f4c84878740 20 client.15459 populate_metadata read hostname 'smithi001' 2024-09-19T09:39:23.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.274+0000 7f4c84878740 1 --2- 172.21.15.1:0/849280017 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5629b7f503a0 0x5629b7f527c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:23.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.274+0000 7f4c84878740 4 client.15459 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T09:39:23.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.274+0000 7f4c84878740 1 -- 172.21.15.1:0/849280017 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x5629b7e32be0 con 0x5629b7f503a0 2024-09-19T09:39:23.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.274+0000 7f4c7bfff640 1 --2- 172.21.15.1:0/849280017 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5629b7f503a0 0x5629b7f527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:23.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.274+0000 7f4c5b7fe640 10 client.15459 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:23.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.274+0000 7f4c7bfff640 1 --2- 172.21.15.1:0/849280017 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5629b7f503a0 0x5629b7f527c0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9222ed681dc1898 server_cookie=d3e76d3eadcff96a in_seq=0 out_seq=0 2024-09-19T09:39:23.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.278+0000 7f4c5b7fe640 1 -- 172.21.15.1:0/849280017 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5629b7e32be0 con 0x5629b7f503a0 2024-09-19T09:39:23.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.278+0000 7f4c5b7fe640 10 client.15459 handle_command_reply: tid=0 2024-09-19T09:39:23.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.278+0000 7f4c84878740 1 client.15459 shutdown 2024-09-19T09:39:23.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.278+0000 7f4c84878740 1 -- 172.21.15.1:0/849280017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b7ed1a30 msgr2=0x5629b7ed9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:23.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.278+0000 7f4c84878740 1 --2- 172.21.15.1:0/849280017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b7ed1a30 0x5629b7ed9850 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4c74005cc0 tx=0x7f4c74030e40 comp rx=0 tx=0).stop 2024-09-19T09:39:23.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.279+0000 7f4c84878740 1 -- 172.21.15.1:0/849280017 shutdown_connections 2024-09-19T09:39:23.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.279+0000 7f4c84878740 1 --2- 172.21.15.1:0/849280017 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5629b7f503a0 0x5629b7f527c0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.279+0000 7f4c84878740 1 --2- 172.21.15.1:0/849280017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5629b7ed1a30 0x5629b7ed9850 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.279+0000 7f4c84878740 1 --2- 172.21.15.1:0/849280017 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629b7ec7170 0x5629b7ed9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.279+0000 7f4c5b7fe640 0 client.15459 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:23.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.279+0000 7f4c84878740 1 --2- 172.21.15.1:0/849280017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5629b7ec6850 0x5629b7ed8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.279+0000 7f4c84878740 1 -- 172.21.15.1:0/849280017 >> 172.21.15.1:0/849280017 conn(0x5629b7ec2de0 msgr2=0x5629b7ecd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:23.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.279+0000 7f4c84878740 1 -- 172.21.15.1:0/849280017 shutdown_connections 2024-09-19T09:39:23.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.279+0000 7f4c84878740 1 -- 172.21.15.1:0/849280017 wait complete. 2024-09-19T09:39:23.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.279+0000 7f4c84878740 20 client.15459 trim_cache size 0 max 16384 2024-09-19T09:39:23.293 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:39:23.293 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 19, 2024-09-19T09:39:23.293 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24497, 2024-09-19T09:39:23.293 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 6, 2024-09-19T09:39:23.293 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T09:39:23.293 INFO:teuthology.orchestra.run.smithi001.stdout: "9e4bf5ad": { 2024-09-19T09:39:23.293 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 6, 2024-09-19T09:39:23.294 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T09:39:23.294 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:39:23.294 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T09:39:23.294 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:39:23.294 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:39:23.294 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T09:39:23.294 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 140.3, 2024-09-19T09:39:23.294 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T09:39:23.294 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T09:39:23.294 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T09:39:23.294 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:39:23.294 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T09:39:23.294 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:39:23.294 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:39:23.295 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:39:23.295 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:39:23.295 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:39:23.295 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:39:23.295 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:39:23.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.280+0000 7f4c8249f640 1 -- 172.21.15.1:0/1239414978 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4c640a32c0 msgr2=0x7f4c640a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:23.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.280+0000 7f4c8249f640 1 --2- 172.21.15.1:0/1239414978 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4c640a32c0 0x7f4c640a5780 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4c74005e30 tx=0x7f4c74005c50 comp rx=0 tx=0).stop 2024-09-19T09:39:23.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.280+0000 7f4c8249f640 1 -- 172.21.15.1:0/1239414978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c7c102570 msgr2=0x7f4c7c198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:23.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.280+0000 7f4c8249f640 1 --2- 172.21.15.1:0/1239414978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c7c102570 0x7f4c7c198a10 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000d950 tx=0x7f4c7000de10 comp rx=0 tx=0).stop 2024-09-19T09:39:23.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.280+0000 7f4c8249f640 1 -- 172.21.15.1:0/1239414978 shutdown_connections 2024-09-19T09:39:23.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.280+0000 7f4c8249f640 1 --2- 172.21.15.1:0/1239414978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4c7c102ef0 0x7f4c7c19cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.280+0000 7f4c8249f640 1 --2- 172.21.15.1:0/1239414978 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4c7c102570 0x7f4c7c198a10 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.280+0000 7f4c8249f640 1 --2- 172.21.15.1:0/1239414978 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4c640a32c0 0x7f4c640a5780 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.280+0000 7f4c8249f640 1 --2- 172.21.15.1:0/1239414978 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4c7c100e20 0x7f4c7c1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:23.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.280+0000 7f4c8249f640 1 -- 172.21.15.1:0/1239414978 >> 172.21.15.1:0/1239414978 conn(0x7f4c7c0fc7d0 msgr2=0x7f4c7c06a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:23.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.280+0000 7f4c8249f640 1 -- 172.21.15.1:0/1239414978 shutdown_connections 2024-09-19T09:39:23.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:23.280+0000 7f4c8249f640 1 -- 172.21.15.1:0/1239414978 wait complete. 2024-09-19T09:39:24.071 INFO:tasks.workunit.client.0.smithi001.stderr:Updating files: 89% (11583/12896) Updating files: 90% (11607/12896) Updating files: 91% (11736/12896) Updating files: 92% (11865/12896) Updating files: 93% (11994/12896) Updating files: 94% (12123/12896) Updating files: 95% (12252/12896) Updating files: 96% (12381/12896) Updating files: 97% (12510/12896) Updating files: 98% (12639/12896) Updating files: 99% (12768/12896) Updating files: 100% (12896/12896) Updating files: 100% (12896/12896), done. 2024-09-19T09:39:24.260 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '9e4bf5ad', quiesce took 5.2 seconds. Will release after: 15.150000000000002 2024-09-19T09:39:24.333 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:24 smithi001 ceph-mon[31225]: pgmap v377: 97 pgs: 97 active+clean; 660 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:39:24.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:24 smithi022 ceph-mon[35583]: pgmap v377: 97 pgs: 97 active+clean; 660 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:39:24.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:24 smithi121 ceph-mon[35577]: pgmap v377: 97 pgs: 97 active+clean; 660 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:39:24.473 INFO:tasks.workunit.client.0.smithi001.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T09:39:24.473 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-19T09:39:24.473 INFO:tasks.workunit.client.0.smithi001.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T09:39:24.473 INFO:tasks.workunit.client.0.smithi001.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T09:39:24.473 INFO:tasks.workunit.client.0.smithi001.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T09:39:24.473 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-19T09:39:24.473 INFO:tasks.workunit.client.0.smithi001.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T09:39:24.474 INFO:tasks.workunit.client.0.smithi001.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T09:39:24.474 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-19T09:39:24.474 INFO:tasks.workunit.client.0.smithi001.stderr: git switch -c 2024-09-19T09:39:24.474 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-19T09:39:24.474 INFO:tasks.workunit.client.0.smithi001.stderr:Or undo this operation with: 2024-09-19T09:39:24.474 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-19T09:39:24.474 INFO:tasks.workunit.client.0.smithi001.stderr: git switch - 2024-09-19T09:39:24.474 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-19T09:39:24.474 INFO:tasks.workunit.client.0.smithi001.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T09:39:24.474 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-09-19T09:39:24.474 INFO:tasks.workunit.client.0.smithi001.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T09:39:24.479 DEBUG:teuthology.orchestra.run.smithi001:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T09:39:24.501 INFO:tasks.workunit.client.0.smithi001.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T09:39:24.504 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T09:39:24.504 INFO:tasks.workunit.client.0.smithi001.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T09:39:25.197 INFO:tasks.workunit.client.0.smithi001.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T09:39:25.278 INFO:tasks.workunit.client.0.smithi001.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T09:39:25.320 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T09:39:25.321 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T09:39:25.321 INFO:tasks.workunit.client.0.smithi001.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T09:39:25.361 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T09:39:25.365 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T09:39:25.365 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T09:39:25.422 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2024-09-19T09:39:25.423 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-09-19T09:39:25.423 DEBUG:teuthology.orchestra.run.smithi001:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-19T09:39:26.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:26 smithi022 ceph-mon[35583]: pgmap v378: 97 pgs: 97 active+clean; 660 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:39:26.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:26 smithi121 ceph-mon[35577]: pgmap v378: 97 pgs: 97 active+clean; 660 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:39:26.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:26 smithi001 ceph-mon[31225]: pgmap v378: 97 pgs: 97 active+clean; 660 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:39:26.922 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:39:27.197 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:27.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.699+0000 7fd087ae9640 1 -- 172.21.15.1:0/399642380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd080103660 msgr2=0x7fd08010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:27.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.699+0000 7fd087ae9640 1 --2- 172.21.15.1:0/399642380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd080103660 0x7fd08010bb50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd074009ca0 tx=0x7fd07402a950 comp rx=0 tx=0).stop 2024-09-19T09:39:27.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.699+0000 7fd087ae9640 1 -- 172.21.15.1:0/399642380 shutdown_connections 2024-09-19T09:39:27.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.699+0000 7fd087ae9640 1 --2- 172.21.15.1:0/399642380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd08010c170 0x7fd08010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.699+0000 7fd087ae9640 1 --2- 172.21.15.1:0/399642380 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd080103660 0x7fd08010bb50 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.699+0000 7fd087ae9640 1 --2- 172.21.15.1:0/399642380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd080102d40 0x7fd080103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.699+0000 7fd087ae9640 1 -- 172.21.15.1:0/399642380 >> 172.21.15.1:0/399642380 conn(0x7fd0800fc7a0 msgr2=0x7fd0800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:27.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.699+0000 7fd087ae9640 1 -- 172.21.15.1:0/399642380 shutdown_connections 2024-09-19T09:39:27.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.699+0000 7fd087ae9640 1 -- 172.21.15.1:0/399642380 wait complete. 2024-09-19T09:39:27.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.700+0000 7fd087ae9640 1 Processor -- start 2024-09-19T09:39:27.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.700+0000 7fd087ae9640 1 -- start start 2024-09-19T09:39:27.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.700+0000 7fd087ae9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd080102d40 0x7fd080198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.700+0000 7fd087ae9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd080103660 0x7fd080198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.700+0000 7fd087ae9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd08010c170 0x7fd08019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.700+0000 7fd087ae9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd080111f70 con 0x7fd08010c170 2024-09-19T09:39:27.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.700+0000 7fd087ae9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd080111df0 con 0x7fd080103660 2024-09-19T09:39:27.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.700+0000 7fd087ae9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd0801120f0 con 0x7fd080102d40 2024-09-19T09:39:27.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.700+0000 7fd086086640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd08010c170 0x7fd08019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.700+0000 7fd086086640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd08010c170 0x7fd08019cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48686/0 (socket says 172.21.15.1:48686) 2024-09-19T09:39:27.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.700+0000 7fd086086640 1 -- 172.21.15.1:0/1460052395 learned_addr learned my addr 172.21.15.1:0/1460052395 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:27.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.700+0000 7fd085885640 1 --2- 172.21.15.1:0/1460052395 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd080102d40 0x7fd080198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.700+0000 7fd085084640 1 --2- 172.21.15.1:0/1460052395 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd080103660 0x7fd080198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.700+0000 7fd086086640 1 -- 172.21.15.1:0/1460052395 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd080102d40 msgr2=0x7fd080198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:27.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.700+0000 7fd086086640 1 --2- 172.21.15.1:0/1460052395 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd080102d40 0x7fd080198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.701+0000 7fd086086640 1 -- 172.21.15.1:0/1460052395 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd080103660 msgr2=0x7fd080198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:27.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.701+0000 7fd086086640 1 --2- 172.21.15.1:0/1460052395 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd080103660 0x7fd080198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.701+0000 7fd086086640 1 -- 172.21.15.1:0/1460052395 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd08019d3e0 con 0x7fd08010c170 2024-09-19T09:39:27.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.701+0000 7fd085885640 1 --2- 172.21.15.1:0/1460052395 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd080102d40 0x7fd080198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:27.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.701+0000 7fd085084640 1 --2- 172.21.15.1:0/1460052395 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd080103660 0x7fd080198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:27.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.701+0000 7fd086086640 1 --2- 172.21.15.1:0/1460052395 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd08010c170 0x7fd08019cd00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd07800c970 tx=0x7fd07800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:27.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.701+0000 7fd07effd640 1 -- 172.21.15.1:0/1460052395 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd078007bb0 con 0x7fd08010c170 2024-09-19T09:39:27.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.701+0000 7fd087ae9640 1 -- 172.21.15.1:0/1460052395 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd08019d6d0 con 0x7fd08010c170 2024-09-19T09:39:27.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.701+0000 7fd07effd640 1 -- 172.21.15.1:0/1460052395 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd078007d50 con 0x7fd08010c170 2024-09-19T09:39:27.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.701+0000 7fd07effd640 1 -- 172.21.15.1:0/1460052395 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07800f450 con 0x7fd08010c170 2024-09-19T09:39:27.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.701+0000 7fd087ae9640 1 -- 172.21.15.1:0/1460052395 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0801a4fb0 con 0x7fd08010c170 2024-09-19T09:39:27.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.703+0000 7fd07effd640 1 -- 172.21.15.1:0/1460052395 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fd078004f60 con 0x7fd08010c170 2024-09-19T09:39:27.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.703+0000 7fd089ec2740 1 Processor -- start 2024-09-19T09:39:27.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.704+0000 7fd089ec2740 1 -- start start 2024-09-19T09:39:27.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.704+0000 7fd089ec2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558e83bbf3a0 0x558e83bbf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.704+0000 7fd089ec2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e83bbfcc0 0x558e83bce550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.704+0000 7fd089ec2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e83bcea90 0x558e83bd0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.704+0000 7fd089ec2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558e83b252e0 con 0x558e83bbfcc0 2024-09-19T09:39:27.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.704+0000 7fd089ec2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558e83accce0 con 0x558e83bcea90 2024-09-19T09:39:27.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.704+0000 7fd089ec2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558e83b212a0 con 0x558e83bbf3a0 2024-09-19T09:39:27.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.704+0000 7fd07effd640 1 --2- 172.21.15.1:0/1460052395 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd0680a3240 0x7fd0680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.704+0000 7fd085885640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e83bbfcc0 0x558e83bce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.704+0000 7fd085885640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e83bbfcc0 0x558e83bce550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48692/0 (socket says 172.21.15.1:48692) 2024-09-19T09:39:27.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.704+0000 7fd085885640 1 -- 172.21.15.1:0/1191248175 learned_addr learned my addr 172.21.15.1:0/1191248175 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:27.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.704+0000 7fd085084640 1 --2- 172.21.15.1:0/1191248175 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e83bcea90 0x558e83bd0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.704+0000 7fd086086640 1 --2- 172.21.15.1:0/1460052395 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd0680a3240 0x7fd0680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.704+0000 7fd085084640 1 --2- 172.21.15.1:0/1191248175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558e83bbf3a0 0x558e83bbf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.704+0000 7fd07effd640 1 -- 172.21.15.1:0/1460052395 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fd0780cf670 con 0x7fd08010c170 2024-09-19T09:39:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.705+0000 7fd085885640 1 -- 172.21.15.1:0/1191248175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558e83bbf3a0 msgr2=0x558e83bbf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.705+0000 7fd085885640 1 --2- 172.21.15.1:0/1191248175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558e83bbf3a0 0x558e83bbf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.705+0000 7fd085885640 1 -- 172.21.15.1:0/1191248175 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e83bcea90 msgr2=0x558e83bd0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.705+0000 7fd085885640 1 --2- 172.21.15.1:0/1191248175 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e83bcea90 0x558e83bd0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.705+0000 7fd085885640 1 -- 172.21.15.1:0/1191248175 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e83ab1440 con 0x558e83bbfcc0 2024-09-19T09:39:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.705+0000 7fd085885640 1 --2- 172.21.15.1:0/1191248175 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e83bbfcc0 0x558e83bce550 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd07000bd40 tx=0x7fd07000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3043b1791762ecc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.705+0000 7fd086086640 1 --2- 172.21.15.1:0/1460052395 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd0680a3240 0x7fd0680a5700 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd07800c940 tx=0x7fd078086040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.705+0000 7fd067fff640 1 -- 172.21.15.1:0/1191248175 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd070015070 con 0x558e83bbfcc0 2024-09-19T09:39:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.705+0000 7fd067fff640 1 -- 172.21.15.1:0/1191248175 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd070011920 con 0x558e83bbfcc0 2024-09-19T09:39:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.705+0000 7fd067fff640 1 -- 172.21.15.1:0/1191248175 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd070010910 con 0x558e83bbfcc0 2024-09-19T09:39:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.706+0000 7fd089ec2740 1 -- 172.21.15.1:0/1191248175 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e83bbfcc0 msgr2=0x558e83bce550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.706+0000 7fd089ec2740 1 --2- 172.21.15.1:0/1191248175 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e83bbfcc0 0x558e83bce550 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd07000bd40 tx=0x7fd07000f730 comp rx=0 tx=0).stop 2024-09-19T09:39:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.706+0000 7fd089ec2740 1 -- 172.21.15.1:0/1191248175 shutdown_connections 2024-09-19T09:39:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.706+0000 7fd089ec2740 1 --2- 172.21.15.1:0/1191248175 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e83bcea90 0x558e83bd0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.706+0000 7fd089ec2740 1 --2- 172.21.15.1:0/1191248175 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e83bbfcc0 0x558e83bce550 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.706+0000 7fd089ec2740 1 --2- 172.21.15.1:0/1191248175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558e83bbf3a0 0x558e83bbf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.706+0000 7fd089ec2740 1 -- 172.21.15.1:0/1191248175 >> 172.21.15.1:0/1191248175 conn(0x558e83bbba30 msgr2=0x558e83bbbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.706+0000 7fd089ec2740 1 -- 172.21.15.1:0/1191248175 shutdown_connections 2024-09-19T09:39:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.706+0000 7fd089ec2740 1 -- 172.21.15.1:0/1191248175 wait complete. 2024-09-19T09:39:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.706+0000 7fd089ec2740 1 -- start start 2024-09-19T09:39:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.707+0000 7fd089ec2740 1 Processor -- start 2024-09-19T09:39:27.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.707+0000 7fd089ec2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558e83bbf3a0 0x558e83bce410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.707+0000 7fd089ec2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e83bbfcc0 0x558e83bcb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.707+0000 7fd089ec2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e83bcea90 0x558e83bcbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.707+0000 7fd089ec2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558e83bd16c0 con 0x558e83bbfcc0 2024-09-19T09:39:27.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.707+0000 7fd089ec2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558e83ae0050 con 0x558e83bcea90 2024-09-19T09:39:27.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.707+0000 7fd089ec2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558e83bd1840 con 0x558e83bbf3a0 2024-09-19T09:39:27.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.707+0000 7fd089ec2740 10 client.0 _ll_register_callbacks cb 0x558e83b20160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:27.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.707+0000 7fd085885640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e83bbfcc0 0x558e83bcb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.707+0000 7fd085885640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e83bbfcc0 0x558e83bcb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48698/0 (socket says 172.21.15.1:48698) 2024-09-19T09:39:27.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.707+0000 7fd085885640 1 -- 172.21.15.1:0/2806962384 learned_addr learned my addr 172.21.15.1:0/2806962384 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:27.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.707+0000 7fd085084640 1 --2- 172.21.15.1:0/2806962384 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558e83bbf3a0 0x558e83bce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.707+0000 7fd085084640 1 --2- 172.21.15.1:0/2806962384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e83bcea90 0x558e83bcbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.708+0000 7fd085885640 1 -- 172.21.15.1:0/2806962384 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558e83bbf3a0 msgr2=0x558e83bce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:27.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.708+0000 7fd085885640 1 --2- 172.21.15.1:0/2806962384 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558e83bbf3a0 0x558e83bce410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.708+0000 7fd085885640 1 -- 172.21.15.1:0/2806962384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e83bcea90 msgr2=0x558e83bcbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:27.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.708+0000 7fd085885640 1 --2- 172.21.15.1:0/2806962384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e83bcea90 0x558e83bcbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.708+0000 7fd085885640 1 -- 172.21.15.1:0/2806962384 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e838963c0 con 0x558e83bbfcc0 2024-09-19T09:39:27.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.708+0000 7fd085084640 1 --2- 172.21.15.1:0/2806962384 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558e83bbf3a0 0x558e83bce410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:27.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.708+0000 7fd085885640 1 --2- 172.21.15.1:0/2806962384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e83bbfcc0 0x558e83bcb6c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd070010410 tx=0x7fd07000bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a571efc8a0a5a05a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:27.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.708+0000 7fd0657fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:39:27.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.708+0000 7fd0657fa640 1 -- 172.21.15.1:0/2806962384 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd070015070 con 0x558e83bbfcc0 2024-09-19T09:39:27.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.708+0000 7fd089ec2740 1 -- 172.21.15.1:0/2806962384 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd070011920 con 0x558e83bbfcc0 2024-09-19T09:39:27.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.708+0000 7fd0657fa640 1 -- 172.21.15.1:0/2806962384 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fd0700116d0 con 0x558e83bbfcc0 2024-09-19T09:39:27.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.708+0000 7fd0657fa640 1 -- 172.21.15.1:0/2806962384 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd070011ad0 con 0x558e83bbfcc0 2024-09-19T09:39:27.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.708+0000 7fd089ec2740 10 client.15471 fetch_fsmap learned FSMap version 19 2024-09-19T09:39:27.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.708+0000 7fd089ec2740 1 -- 172.21.15.1:0/2806962384 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558e83bdd0f0 con 0x558e83bbfcc0 2024-09-19T09:39:27.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.708+0000 7fd0657fa640 1 -- 172.21.15.1:0/2806962384 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd070011920 con 0x558e83bbfcc0 2024-09-19T09:39:27.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.709+0000 7fd0657fa640 1 -- 172.21.15.1:0/2806962384 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fd070010930 con 0x558e83bbfcc0 2024-09-19T09:39:27.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.709+0000 7fd089ec2740 10 client.15471 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:39:27.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.709+0000 7fd089ec2740 10 client.15471 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:27.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.709+0000 7fd089ec2740 20 client.15471 populate_metadata read hostname 'smithi001' 2024-09-19T09:39:27.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.709+0000 7fd089ec2740 1 --2- 172.21.15.1:0/2806962384 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x558e83bde440 0x558e83be0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.709+0000 7fd089ec2740 4 client.15471 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:39:27.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.709+0000 7fd089ec2740 1 -- 172.21.15.1:0/2806962384 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e83b32850 con 0x558e83bde440 2024-09-19T09:39:27.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.709+0000 7fd085084640 1 --2- 172.21.15.1:0/2806962384 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x558e83bde440 0x558e83be0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.710+0000 7fd0657fa640 10 client.15471 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:27.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.710+0000 7fd085084640 1 --2- 172.21.15.1:0/2806962384 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x558e83bde440 0x558e83be0830 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9391de10cccf46d4 server_cookie=67f31d2c7435e73c in_seq=0 out_seq=0 2024-09-19T09:39:27.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.710+0000 7fd0657fa640 1 -- 172.21.15.1:0/2806962384 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558e83b32850 con 0x558e83bde440 2024-09-19T09:39:27.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.710+0000 7fd0657fa640 10 client.15471 handle_command_reply: tid=0 2024-09-19T09:39:27.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.710+0000 7fd089ec2740 1 client.15471 shutdown 2024-09-19T09:39:27.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.710+0000 7fd089ec2740 1 -- 172.21.15.1:0/2806962384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e83bbfcc0 msgr2=0x558e83bcb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:27.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.710+0000 7fd089ec2740 1 --2- 172.21.15.1:0/2806962384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e83bbfcc0 0x558e83bcb6c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd070010410 tx=0x7fd07000bab0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.711+0000 7fd089ec2740 1 -- 172.21.15.1:0/2806962384 shutdown_connections 2024-09-19T09:39:27.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.711+0000 7fd089ec2740 1 --2- 172.21.15.1:0/2806962384 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x558e83bde440 0x558e83be0830 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.711+0000 7fd089ec2740 1 --2- 172.21.15.1:0/2806962384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e83bcea90 0x558e83bcbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.711+0000 7fd089ec2740 1 --2- 172.21.15.1:0/2806962384 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e83bbfcc0 0x558e83bcb6c0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.711+0000 7fd089ec2740 1 --2- 172.21.15.1:0/2806962384 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558e83bbf3a0 0x558e83bce410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.711+0000 7fd089ec2740 1 -- 172.21.15.1:0/2806962384 >> 172.21.15.1:0/2806962384 conn(0x558e83bbba30 msgr2=0x558e83bc1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:27.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.711+0000 7fd0657fa640 0 client.15471 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:27.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.711+0000 7fd089ec2740 1 -- 172.21.15.1:0/2806962384 shutdown_connections 2024-09-19T09:39:27.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.711+0000 7fd089ec2740 1 -- 172.21.15.1:0/2806962384 wait complete. 2024-09-19T09:39:27.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.711+0000 7fd089ec2740 20 client.15471 trim_cache size 0 max 16384 2024-09-19T09:39:27.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.728+0000 7fd089ec2740 1 Processor -- start 2024-09-19T09:39:27.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.728+0000 7fd089ec2740 1 -- start start 2024-09-19T09:39:27.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.728+0000 7fd089ec2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e83bbf3a0 0x558e83bda960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.728+0000 7fd089ec2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e83bbfcc0 0x558e83be5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.728+0000 7fd089ec2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558e83bcea90 0x558e83be6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.728+0000 7fd089ec2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd0801a9310 con 0x558e83bbfcc0 2024-09-19T09:39:27.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.728+0000 7fd089ec2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd0801abbb0 con 0x558e83bbf3a0 2024-09-19T09:39:27.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.728+0000 7fd089ec2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd0801a99a0 con 0x558e83bcea90 2024-09-19T09:39:27.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.728+0000 7fd085885640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e83bbfcc0 0x558e83be5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.728+0000 7fd085885640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e83bbfcc0 0x558e83be5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48708/0 (socket says 172.21.15.1:48708) 2024-09-19T09:39:27.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.728+0000 7fd085885640 1 -- 172.21.15.1:0/38711935 learned_addr learned my addr 172.21.15.1:0/38711935 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:27.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.728+0000 7fd085084640 1 --2- 172.21.15.1:0/38711935 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e83bbf3a0 0x558e83bda960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.728+0000 7fd085885640 1 -- 172.21.15.1:0/38711935 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558e83bcea90 msgr2=0x558e83be6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:27.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.728+0000 7fd085885640 1 --2- 172.21.15.1:0/38711935 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558e83bcea90 0x558e83be6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.728+0000 7fd085885640 1 -- 172.21.15.1:0/38711935 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e83bbf3a0 msgr2=0x558e83bda960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:27.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.728+0000 7fd085885640 1 --2- 172.21.15.1:0/38711935 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e83bbf3a0 0x558e83bda960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.728+0000 7fd085885640 1 -- 172.21.15.1:0/38711935 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e83bbcbc0 con 0x558e83bbfcc0 2024-09-19T09:39:27.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.728+0000 7fd085084640 1 --2- 172.21.15.1:0/38711935 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e83bbf3a0 0x558e83bda960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:27.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.729+0000 7fd085885640 1 --2- 172.21.15.1:0/38711935 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e83bbfcc0 0x558e83be5fc0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd070010ef0 tx=0x7fd07000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=283c455778e87e5d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:27.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.729+0000 7fd0677fe640 1 -- 172.21.15.1:0/38711935 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd070015040 con 0x558e83bbfcc0 2024-09-19T09:39:27.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.729+0000 7fd0677fe640 1 -- 172.21.15.1:0/38711935 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd070010aa0 con 0x558e83bbfcc0 2024-09-19T09:39:27.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.729+0000 7fd0677fe640 1 -- 172.21.15.1:0/38711935 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07001a460 con 0x558e83bbfcc0 2024-09-19T09:39:27.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.729+0000 7fd089ec2740 1 -- 172.21.15.1:0/38711935 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e83bbfcc0 msgr2=0x558e83be5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:27.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.729+0000 7fd089ec2740 1 --2- 172.21.15.1:0/38711935 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e83bbfcc0 0x558e83be5fc0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd070010ef0 tx=0x7fd07000b480 comp rx=0 tx=0).stop 2024-09-19T09:39:27.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.729+0000 7fd089ec2740 1 -- 172.21.15.1:0/38711935 shutdown_connections 2024-09-19T09:39:27.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.729+0000 7fd089ec2740 1 --2- 172.21.15.1:0/38711935 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558e83bcea90 0x558e83be6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.729+0000 7fd089ec2740 1 --2- 172.21.15.1:0/38711935 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e83bbfcc0 0x558e83be5fc0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.729+0000 7fd089ec2740 1 --2- 172.21.15.1:0/38711935 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e83bbf3a0 0x558e83bda960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.729+0000 7fd089ec2740 1 -- 172.21.15.1:0/38711935 >> 172.21.15.1:0/38711935 conn(0x558e83bbba30 msgr2=0x558e83bc6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:27.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.730+0000 7fd089ec2740 1 -- 172.21.15.1:0/38711935 shutdown_connections 2024-09-19T09:39:27.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.730+0000 7fd089ec2740 1 -- 172.21.15.1:0/38711935 wait complete. 2024-09-19T09:39:27.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.730+0000 7fd089ec2740 1 -- start start 2024-09-19T09:39:27.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.730+0000 7fd089ec2740 1 Processor -- start 2024-09-19T09:39:27.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.730+0000 7fd089ec2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558e83bbf3a0 0x558e83bd2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.730+0000 7fd089ec2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e83bbfcc0 0x558e83bd2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.730+0000 7fd089ec2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e83bcea90 0x558e83c40f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.730+0000 7fd089ec2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd0801aa070 con 0x558e83bcea90 2024-09-19T09:39:27.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.730+0000 7fd089ec2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd0801ab4e0 con 0x558e83bbfcc0 2024-09-19T09:39:27.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.730+0000 7fd089ec2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd0801aa740 con 0x558e83bbf3a0 2024-09-19T09:39:27.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.730+0000 7fd089ec2740 10 client.0 _ll_register_callbacks cb 0x7fd08006b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:27.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.731+0000 7fd085084640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e83bcea90 0x558e83c40f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.731+0000 7fd085084640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e83bcea90 0x558e83c40f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48712/0 (socket says 172.21.15.1:48712) 2024-09-19T09:39:27.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.731+0000 7fd085084640 1 -- 172.21.15.1:0/2878576363 learned_addr learned my addr 172.21.15.1:0/2878576363 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:27.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.731+0000 7fd085885640 1 --2- 172.21.15.1:0/2878576363 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e83bbfcc0 0x558e83bd2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.731+0000 7fd085084640 1 --2- 172.21.15.1:0/2878576363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558e83bbf3a0 0x558e83bd2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.731+0000 7fd085084640 1 -- 172.21.15.1:0/2878576363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558e83bbf3a0 msgr2=0x558e83bd2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:27.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.731+0000 7fd085084640 1 --2- 172.21.15.1:0/2878576363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558e83bbf3a0 0x558e83bd2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.731+0000 7fd085084640 1 -- 172.21.15.1:0/2878576363 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e83bbfcc0 msgr2=0x558e83bd2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:27.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.731+0000 7fd085084640 1 --2- 172.21.15.1:0/2878576363 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e83bbfcc0 0x558e83bd2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.731+0000 7fd085084640 1 -- 172.21.15.1:0/2878576363 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e83c415c0 con 0x558e83bcea90 2024-09-19T09:39:27.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.731+0000 7fd085084640 1 --2- 172.21.15.1:0/2878576363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e83bcea90 0x558e83c40f50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd074009ca0 tx=0x7fd0740095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9781a71823fe3d89 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:27.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.731+0000 7fd0657fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:39:27.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.731+0000 7fd0657fa640 1 -- 172.21.15.1:0/2878576363 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd074034040 con 0x558e83bcea90 2024-09-19T09:39:27.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.731+0000 7fd0657fa640 1 -- 172.21.15.1:0/2878576363 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fd074030440 con 0x558e83bcea90 2024-09-19T09:39:27.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.731+0000 7fd089ec2740 1 -- 172.21.15.1:0/2878576363 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd070010aa0 con 0x558e83bcea90 2024-09-19T09:39:27.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.731+0000 7fd0657fa640 1 -- 172.21.15.1:0/2878576363 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd074004b40 con 0x558e83bcea90 2024-09-19T09:39:27.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.731+0000 7fd089ec2740 10 client.15477 fetch_fsmap learned FSMap version 19 2024-09-19T09:39:27.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.731+0000 7fd089ec2740 1 -- 172.21.15.1:0/2878576363 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558e83c48990 con 0x558e83bcea90 2024-09-19T09:39:27.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.732+0000 7fd0657fa640 1 -- 172.21.15.1:0/2878576363 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd070010aa0 con 0x558e83bcea90 2024-09-19T09:39:27.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.732+0000 7fd0657fa640 1 -- 172.21.15.1:0/2878576363 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fd074054070 con 0x558e83bcea90 2024-09-19T09:39:27.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.732+0000 7fd089ec2740 10 client.15477 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:39:27.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.732+0000 7fd089ec2740 10 client.15477 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:27.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.732+0000 7fd089ec2740 20 client.15477 populate_metadata read hostname 'smithi001' 2024-09-19T09:39:27.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.732+0000 7fd089ec2740 1 --2- 172.21.15.1:0/2878576363 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x558e83c490c0 0x558e83c4b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:27.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.732+0000 7fd089ec2740 4 client.15477 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:39:27.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.732+0000 7fd089ec2740 1 -- 172.21.15.1:0/2878576363 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558e83b2cd60 con 0x558e83c490c0 2024-09-19T09:39:27.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.732+0000 7fd085885640 1 --2- 172.21.15.1:0/2878576363 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x558e83c490c0 0x558e83c4b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:27.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.733+0000 7fd085885640 1 --2- 172.21.15.1:0/2878576363 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x558e83c490c0 0x558e83c4b4e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9905e0e33dc9d4c5 server_cookie=7fd3d0a9d7031a81 in_seq=0 out_seq=0 2024-09-19T09:39:27.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.733+0000 7fd0657fa640 10 client.15477 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:27.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.733+0000 7fd0657fa640 1 -- 172.21.15.1:0/2878576363 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558e83b2cd60 con 0x558e83c490c0 2024-09-19T09:39:27.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.733+0000 7fd0657fa640 10 client.15477 handle_command_reply: tid=0 2024-09-19T09:39:27.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.733+0000 7fd089ec2740 1 client.15477 shutdown 2024-09-19T09:39:27.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.733+0000 7fd089ec2740 1 -- 172.21.15.1:0/2878576363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e83bcea90 msgr2=0x558e83c40f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:27.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.733+0000 7fd089ec2740 1 --2- 172.21.15.1:0/2878576363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e83bcea90 0x558e83c40f50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd074009ca0 tx=0x7fd0740095c0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.733+0000 7fd089ec2740 1 -- 172.21.15.1:0/2878576363 shutdown_connections 2024-09-19T09:39:27.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.733+0000 7fd089ec2740 1 --2- 172.21.15.1:0/2878576363 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x558e83c490c0 0x558e83c4b4e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.733+0000 7fd089ec2740 1 --2- 172.21.15.1:0/2878576363 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558e83bcea90 0x558e83c40f50 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.733+0000 7fd089ec2740 1 --2- 172.21.15.1:0/2878576363 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558e83bbfcc0 0x558e83bd2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.733+0000 7fd089ec2740 1 --2- 172.21.15.1:0/2878576363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558e83bbf3a0 0x558e83bd2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.733+0000 7fd0657fa640 0 client.15477 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:27.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.733+0000 7fd089ec2740 1 -- 172.21.15.1:0/2878576363 >> 172.21.15.1:0/2878576363 conn(0x558e83bbba30 msgr2=0x558e83bccf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:27.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.733+0000 7fd089ec2740 1 -- 172.21.15.1:0/2878576363 shutdown_connections 2024-09-19T09:39:27.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.733+0000 7fd089ec2740 1 -- 172.21.15.1:0/2878576363 wait complete. 2024-09-19T09:39:27.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.733+0000 7fd089ec2740 20 client.15477 trim_cache size 0 max 16384 2024-09-19T09:39:27.741 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:39:27.741 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "no active scrubs running", 2024-09-19T09:39:27.741 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": {} 2024-09-19T09:39:27.742 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:39:27.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.734+0000 7fd087ae9640 1 -- 172.21.15.1:0/1460052395 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd0680a3240 msgr2=0x7fd0680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:27.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.734+0000 7fd087ae9640 1 --2- 172.21.15.1:0/1460052395 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd0680a3240 0x7fd0680a5700 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd07800c940 tx=0x7fd078086040 comp rx=0 tx=0).stop 2024-09-19T09:39:27.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.734+0000 7fd087ae9640 1 -- 172.21.15.1:0/1460052395 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd08010c170 msgr2=0x7fd08019cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:27.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.734+0000 7fd087ae9640 1 --2- 172.21.15.1:0/1460052395 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd08010c170 0x7fd08019cd00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd07800c970 tx=0x7fd07800ce30 comp rx=0 tx=0).stop 2024-09-19T09:39:27.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.734+0000 7fd087ae9640 1 -- 172.21.15.1:0/1460052395 shutdown_connections 2024-09-19T09:39:27.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.734+0000 7fd087ae9640 1 --2- 172.21.15.1:0/1460052395 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd08010c170 0x7fd08019cd00 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.734+0000 7fd087ae9640 1 --2- 172.21.15.1:0/1460052395 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd0680a3240 0x7fd0680a5700 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.734+0000 7fd087ae9640 1 --2- 172.21.15.1:0/1460052395 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd080103660 0x7fd080198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.734+0000 7fd087ae9640 1 --2- 172.21.15.1:0/1460052395 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd080102d40 0x7fd080198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:27.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.734+0000 7fd087ae9640 1 -- 172.21.15.1:0/1460052395 >> 172.21.15.1:0/1460052395 conn(0x7fd0800fc7a0 msgr2=0x7fd0800fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:27.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.734+0000 7fd087ae9640 1 -- 172.21.15.1:0/1460052395 shutdown_connections 2024-09-19T09:39:27.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:27.734+0000 7fd087ae9640 1 -- 172.21.15.1:0/1460052395 wait complete. 2024-09-19T09:39:28.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.060+0000 7f710dd31640 1 -- 172.21.15.1:0/1433599196 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71081025f0 msgr2=0x7f7108108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:28.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.060+0000 7f710dd31640 1 --2- 172.21.15.1:0/1433599196 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71081025f0 0x7f7108108e80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7100009ca0 tx=0x7f710002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.060+0000 7f710dd31640 1 -- 172.21.15.1:0/1433599196 shutdown_connections 2024-09-19T09:39:28.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.060+0000 7f710dd31640 1 --2- 172.21.15.1:0/1433599196 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f71081025f0 0x7f7108108e80 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.060+0000 7f710dd31640 1 --2- 172.21.15.1:0/1433599196 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7108101c30 0x7f71081020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.060+0000 7f710dd31640 1 --2- 172.21.15.1:0/1433599196 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7108100a40 0x7f7108100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.060+0000 7f710dd31640 1 -- 172.21.15.1:0/1433599196 >> 172.21.15.1:0/1433599196 conn(0x7f71080fc1c0 msgr2=0x7f71080fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:28.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.060+0000 7f710dd31640 1 -- 172.21.15.1:0/1433599196 shutdown_connections 2024-09-19T09:39:28.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.060+0000 7f710dd31640 1 -- 172.21.15.1:0/1433599196 wait complete. 2024-09-19T09:39:28.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.061+0000 7f710dd31640 1 Processor -- start 2024-09-19T09:39:28.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.061+0000 7f710dd31640 1 -- start start 2024-09-19T09:39:28.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.061+0000 7f710dd31640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7108100a40 0x7f7108197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.061+0000 7f710dd31640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7108101c30 0x7f71081982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.061+0000 7f710dd31640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71081025f0 0x7f710819f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.061+0000 7f710dd31640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f710810d830 con 0x7f7108101c30 2024-09-19T09:39:28.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.061+0000 7f710dd31640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f710810d6b0 con 0x7f71081025f0 2024-09-19T09:39:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.061+0000 7f710dd31640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f710810d9b0 con 0x7f7108100a40 2024-09-19T09:39:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.061+0000 7f7106ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7108101c30 0x7f71081982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.061+0000 7f7106ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7108101c30 0x7f71081982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48730/0 (socket says 172.21.15.1:48730) 2024-09-19T09:39:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.061+0000 7f7106ffd640 1 -- 172.21.15.1:0/2416573278 learned_addr learned my addr 172.21.15.1:0/2416573278 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.061+0000 7f7107fff640 1 --2- 172.21.15.1:0/2416573278 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71081025f0 0x7f710819f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.061+0000 7f71077fe640 1 --2- 172.21.15.1:0/2416573278 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7108100a40 0x7f7108197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.062+0000 7f7106ffd640 1 -- 172.21.15.1:0/2416573278 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7108100a40 msgr2=0x7f7108197d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.062+0000 7f7106ffd640 1 --2- 172.21.15.1:0/2416573278 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7108100a40 0x7f7108197d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.062+0000 7f7106ffd640 1 -- 172.21.15.1:0/2416573278 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71081025f0 msgr2=0x7f710819f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.062+0000 7f7106ffd640 1 --2- 172.21.15.1:0/2416573278 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71081025f0 0x7f710819f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.062+0000 7f7106ffd640 1 -- 172.21.15.1:0/2416573278 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710819f980 con 0x7f7108101c30 2024-09-19T09:39:28.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.062+0000 7f7106ffd640 1 --2- 172.21.15.1:0/2416573278 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7108101c30 0x7f71081982a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f70fc00d950 tx=0x7f70fc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:28.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.062+0000 7f7104ff9640 1 -- 172.21.15.1:0/2416573278 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc017030 con 0x7f7108101c30 2024-09-19T09:39:28.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.062+0000 7f7104ff9640 1 -- 172.21.15.1:0/2416573278 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70fc004020 con 0x7f7108101c30 2024-09-19T09:39:28.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.062+0000 7f710dd31640 1 -- 172.21.15.1:0/2416573278 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f710819fc70 con 0x7f7108101c30 2024-09-19T09:39:28.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.062+0000 7f7104ff9640 1 -- 172.21.15.1:0/2416573278 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc0047a0 con 0x7f7108101c30 2024-09-19T09:39:28.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.062+0000 7f710dd31640 1 -- 172.21.15.1:0/2416573278 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71081a01c0 con 0x7f7108101c30 2024-09-19T09:39:28.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.064+0000 7f7104ff9640 1 -- 172.21.15.1:0/2416573278 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f70fc0041d0 con 0x7f7108101c30 2024-09-19T09:39:28.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.064+0000 7f7110acc740 1 Processor -- start 2024-09-19T09:39:28.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.065+0000 7f7110acc740 1 -- start start 2024-09-19T09:39:28.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.065+0000 7f7110acc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563521b84db0 0x563521b851b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.065+0000 7f7110acc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563521b856f0 0x563521b8a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.065+0000 7f7110acc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563521b8a780 0x563521b8cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.065+0000 7f7110acc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563521ae42f0 con 0x563521b8a780 2024-09-19T09:39:28.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.065+0000 7f7110acc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563521a8c270 con 0x563521b856f0 2024-09-19T09:39:28.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.065+0000 7f7110acc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563521ae02b0 con 0x563521b84db0 2024-09-19T09:39:28.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.065+0000 7f7106ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563521b8a780 0x563521b8cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.065+0000 7f7106ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563521b8a780 0x563521b8cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48740/0 (socket says 172.21.15.1:48740) 2024-09-19T09:39:28.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.065+0000 7f7106ffd640 1 -- 172.21.15.1:0/3601531685 learned_addr learned my addr 172.21.15.1:0/3601531685 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:28.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.065+0000 7f7107fff640 1 --2- 172.21.15.1:0/3601531685 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563521b84db0 0x563521b851b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.065+0000 7f71077fe640 1 --2- 172.21.15.1:0/3601531685 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563521b856f0 0x563521b8a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.065+0000 7f7104ff9640 1 --2- 172.21.15.1:0/2416573278 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f70f00a3240 0x7f70f00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.065+0000 7f7106ffd640 1 -- 172.21.15.1:0/3601531685 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563521b84db0 msgr2=0x563521b851b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:28.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.065+0000 7f7106ffd640 1 --2- 172.21.15.1:0/3601531685 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563521b84db0 0x563521b851b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.065+0000 7f7106ffd640 1 -- 172.21.15.1:0/3601531685 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563521b856f0 msgr2=0x563521b8a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:28.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.065+0000 7f7106ffd640 1 --2- 172.21.15.1:0/3601531685 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563521b856f0 0x563521b8a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.065+0000 7f7106ffd640 1 -- 172.21.15.1:0/3601531685 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563521a8b340 con 0x563521b8a780 2024-09-19T09:39:28.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.065+0000 7f7107fff640 1 --2- 172.21.15.1:0/2416573278 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f70f00a3240 0x7f70f00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.065+0000 7f7104ff9640 1 -- 172.21.15.1:0/2416573278 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f70fc0cf2d0 con 0x7f7108101c30 2024-09-19T09:39:28.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.066+0000 7f7106ffd640 1 --2- 172.21.15.1:0/3601531685 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563521b8a780 0x563521b8cc40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f70fc0634e0 tx=0x7f70fc06a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae7312874ff4fd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.066+0000 7f70edffb640 1 -- 172.21.15.1:0/3601531685 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc09b6c0 con 0x563521b8a780 2024-09-19T09:39:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.066+0000 7f70edffb640 1 -- 172.21.15.1:0/3601531685 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70fc0d2e40 con 0x563521b8a780 2024-09-19T09:39:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.066+0000 7f70edffb640 1 -- 172.21.15.1:0/3601531685 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc063340 con 0x563521b8a780 2024-09-19T09:39:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.066+0000 7f7110acc740 1 -- 172.21.15.1:0/3601531685 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563521b8a780 msgr2=0x563521b8cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.066+0000 7f7107fff640 1 --2- 172.21.15.1:0/2416573278 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f70f00a3240 0x7f70f00a5700 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7100005e30 tx=0x7f71000095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.066+0000 7f7110acc740 1 --2- 172.21.15.1:0/3601531685 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563521b8a780 0x563521b8cc40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f70fc0634e0 tx=0x7f70fc06a630 comp rx=0 tx=0).stop 2024-09-19T09:39:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.066+0000 7f7110acc740 1 -- 172.21.15.1:0/3601531685 shutdown_connections 2024-09-19T09:39:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.066+0000 7f7110acc740 1 --2- 172.21.15.1:0/3601531685 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563521b8a780 0x563521b8cc40 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.066+0000 7f7110acc740 1 --2- 172.21.15.1:0/3601531685 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563521b856f0 0x563521b8a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.066+0000 7f7110acc740 1 --2- 172.21.15.1:0/3601531685 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563521b84db0 0x563521b851b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.079 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.066+0000 7f7110acc740 1 -- 172.21.15.1:0/3601531685 >> 172.21.15.1:0/3601531685 conn(0x563521b80420 msgr2=0x563521b80820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.067+0000 7f7110acc740 1 -- 172.21.15.1:0/3601531685 shutdown_connections 2024-09-19T09:39:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.067+0000 7f7110acc740 1 -- 172.21.15.1:0/3601531685 wait complete. 2024-09-19T09:39:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.067+0000 7f7110acc740 1 -- start start 2024-09-19T09:39:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.067+0000 7f7110acc740 1 Processor -- start 2024-09-19T09:39:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.067+0000 7f7110acc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563521b84db0 0x563521b8f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.067+0000 7f7110acc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563521b856f0 0x563521b8f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.067+0000 7f7110acc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563521b8a780 0x563521b964d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.067+0000 7f7110acc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563521b8d6f0 con 0x563521b84db0 2024-09-19T09:39:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.067+0000 7f7110acc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563521a6d290 con 0x563521b856f0 2024-09-19T09:39:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.067+0000 7f7110acc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563521b8d870 con 0x563521b8a780 2024-09-19T09:39:28.080 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.067+0000 7f7110acc740 10 client.0 _ll_register_callbacks cb 0x563521a9e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.067+0000 7f71077fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563521b84db0 0x563521b8f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.067+0000 7f71077fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563521b84db0 0x563521b8f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48752/0 (socket says 172.21.15.1:48752) 2024-09-19T09:39:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.067+0000 7f71077fe640 1 -- 172.21.15.1:0/3568197431 learned_addr learned my addr 172.21.15.1:0/3568197431 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.068+0000 7f7106ffd640 1 --2- 172.21.15.1:0/3568197431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563521b856f0 0x563521b8f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.068+0000 7f7107fff640 1 --2- 172.21.15.1:0/3568197431 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563521b8a780 0x563521b964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.068+0000 7f71077fe640 1 -- 172.21.15.1:0/3568197431 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563521b8a780 msgr2=0x563521b964d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.068+0000 7f71077fe640 1 --2- 172.21.15.1:0/3568197431 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563521b8a780 0x563521b964d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.068+0000 7f71077fe640 1 -- 172.21.15.1:0/3568197431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563521b856f0 msgr2=0x563521b8f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.068+0000 7f71077fe640 1 --2- 172.21.15.1:0/3568197431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563521b856f0 0x563521b8f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.068+0000 7f71077fe640 1 -- 172.21.15.1:0/3568197431 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635217f7210 con 0x563521b84db0 2024-09-19T09:39:28.081 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.068+0000 7f7106ffd640 1 --2- 172.21.15.1:0/3568197431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563521b856f0 0x563521b8f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:28.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.068+0000 7f71077fe640 1 --2- 172.21.15.1:0/3568197431 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563521b84db0 0x563521b8f030 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f70f8011830 tx=0x7f70f8011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d07160ac454c214 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:28.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.068+0000 7f70e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:39:28.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.068+0000 7f70e6ffd640 1 -- 172.21.15.1:0/3568197431 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f801e060 con 0x563521b84db0 2024-09-19T09:39:28.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.068+0000 7f70e6ffd640 1 -- 172.21.15.1:0/3568197431 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f70f800fdb0 con 0x563521b84db0 2024-09-19T09:39:28.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.068+0000 7f7110acc740 1 -- 172.21.15.1:0/3568197431 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563521af1a20 con 0x563521b84db0 2024-09-19T09:39:28.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.068+0000 7f70e6ffd640 1 -- 172.21.15.1:0/3568197431 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f70f80193f0 con 0x563521b84db0 2024-09-19T09:39:28.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.068+0000 7f7110acc740 10 client.15489 fetch_fsmap learned FSMap version 19 2024-09-19T09:39:28.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.068+0000 7f7110acc740 1 -- 172.21.15.1:0/3568197431 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5635218c3620 con 0x563521b84db0 2024-09-19T09:39:28.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.069+0000 7f70e6ffd640 1 -- 172.21.15.1:0/3568197431 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x563521af1a20 con 0x563521b84db0 2024-09-19T09:39:28.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.069+0000 7f70e6ffd640 1 -- 172.21.15.1:0/3568197431 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f70f8023070 con 0x563521b84db0 2024-09-19T09:39:28.082 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.069+0000 7f7110acc740 10 client.15489 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:39:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.069+0000 7f7110acc740 10 client.15489 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.069+0000 7f7110acc740 20 client.15489 populate_metadata read hostname 'smithi001' 2024-09-19T09:39:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.069+0000 7f7110acc740 1 --2- 172.21.15.1:0/3568197431 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563521b9ac70 0x563521b9d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.069+0000 7f7110acc740 4 client.15489 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:39:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.069+0000 7f7110acc740 1 -- 172.21.15.1:0/3568197431 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563521aebd70 con 0x563521b9ac70 2024-09-19T09:39:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.069+0000 7f7106ffd640 1 --2- 172.21.15.1:0/3568197431 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563521b9ac70 0x563521b9d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.070+0000 7f7106ffd640 1 --2- 172.21.15.1:0/3568197431 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563521b9ac70 0x563521b9d080 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28f4b2510dfebf9 server_cookie=a6a59226e5a8ec67 in_seq=0 out_seq=0 2024-09-19T09:39:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.070+0000 7f70e6ffd640 10 client.15489 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.070+0000 7f70e6ffd640 1 -- 172.21.15.1:0/3568197431 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563521aebd70 con 0x563521b9ac70 2024-09-19T09:39:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.070+0000 7f70e6ffd640 10 client.15489 handle_command_reply: tid=0 2024-09-19T09:39:28.083 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.070+0000 7f7110acc740 1 client.15489 shutdown 2024-09-19T09:39:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.070+0000 7f7110acc740 1 -- 172.21.15.1:0/3568197431 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563521b84db0 msgr2=0x563521b8f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.070+0000 7f7110acc740 1 --2- 172.21.15.1:0/3568197431 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563521b84db0 0x563521b8f030 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f70f8011830 tx=0x7f70f8011cf0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.070+0000 7f7110acc740 1 -- 172.21.15.1:0/3568197431 shutdown_connections 2024-09-19T09:39:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.070+0000 7f7110acc740 1 --2- 172.21.15.1:0/3568197431 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563521b9ac70 0x563521b9d080 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.071+0000 7f7110acc740 1 --2- 172.21.15.1:0/3568197431 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563521b8a780 0x563521b964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.071+0000 7f70e6ffd640 0 client.15489 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.071+0000 7f7110acc740 1 --2- 172.21.15.1:0/3568197431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563521b856f0 0x563521b8f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.071+0000 7f7110acc740 1 --2- 172.21.15.1:0/3568197431 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563521b84db0 0x563521b8f030 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.071+0000 7f7110acc740 1 -- 172.21.15.1:0/3568197431 >> 172.21.15.1:0/3568197431 conn(0x563521b80420 msgr2=0x563521b7b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:28.084 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.071+0000 7f7110acc740 1 -- 172.21.15.1:0/3568197431 shutdown_connections 2024-09-19T09:39:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.071+0000 7f7110acc740 1 -- 172.21.15.1:0/3568197431 wait complete. 2024-09-19T09:39:28.085 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.071+0000 7f7110acc740 20 client.15489 trim_cache size 0 max 16384 2024-09-19T09:39:28.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.085+0000 7f7110acc740 1 Processor -- start 2024-09-19T09:39:28.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.086+0000 7f7110acc740 1 -- start start 2024-09-19T09:39:28.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.086+0000 7f7110acc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563521b84db0 0x563521b8f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.086+0000 7f7110acc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563521b856f0 0x563521b96490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.086+0000 7f7110acc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563521b8a780 0x563521b813b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.086+0000 7f7110acc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f71081a4e80 con 0x563521b8a780 2024-09-19T09:39:28.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.086+0000 7f7110acc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f71081a7720 con 0x563521b856f0 2024-09-19T09:39:28.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.086+0000 7f7110acc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f71081a5510 con 0x563521b84db0 2024-09-19T09:39:28.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.086+0000 7f7107fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563521b8a780 0x563521b813b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.086+0000 7f7107fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563521b8a780 0x563521b813b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48768/0 (socket says 172.21.15.1:48768) 2024-09-19T09:39:28.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.086+0000 7f7107fff640 1 -- 172.21.15.1:0/2613503898 learned_addr learned my addr 172.21.15.1:0/2613503898 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:28.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.086+0000 7f71077fe640 1 --2- 172.21.15.1:0/2613503898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563521b84db0 0x563521b8f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.086+0000 7f7106ffd640 1 --2- 172.21.15.1:0/2613503898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563521b856f0 0x563521b96490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.086+0000 7f7107fff640 1 -- 172.21.15.1:0/2613503898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563521b84db0 msgr2=0x563521b8f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:28.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.086+0000 7f7107fff640 1 --2- 172.21.15.1:0/2613503898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563521b84db0 0x563521b8f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.086+0000 7f7107fff640 1 -- 172.21.15.1:0/2613503898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563521b856f0 msgr2=0x563521b96490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:28.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.086+0000 7f7107fff640 1 --2- 172.21.15.1:0/2613503898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563521b856f0 0x563521b96490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.086+0000 7f7107fff640 1 -- 172.21.15.1:0/2613503898 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563521b89c10 con 0x563521b8a780 2024-09-19T09:39:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.086+0000 7f7106ffd640 1 --2- 172.21.15.1:0/2613503898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563521b856f0 0x563521b96490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.086+0000 7f7107fff640 1 --2- 172.21.15.1:0/2613503898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563521b8a780 0x563521b813b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7100009ca0 tx=0x7f710003e030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50f7662480c98db3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.086+0000 7f70ed7fa640 1 -- 172.21.15.1:0/2613503898 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7100057070 con 0x563521b8a780 2024-09-19T09:39:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.087+0000 7f70ed7fa640 1 -- 172.21.15.1:0/2613503898 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7100036040 con 0x563521b8a780 2024-09-19T09:39:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.087+0000 7f70ed7fa640 1 -- 172.21.15.1:0/2613503898 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7100046670 con 0x563521b8a780 2024-09-19T09:39:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.087+0000 7f7110acc740 1 -- 172.21.15.1:0/2613503898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563521b8a780 msgr2=0x563521b813b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.087+0000 7f7110acc740 1 --2- 172.21.15.1:0/2613503898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563521b8a780 0x563521b813b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7100009ca0 tx=0x7f710003e030 comp rx=0 tx=0).stop 2024-09-19T09:39:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.087+0000 7f7110acc740 1 -- 172.21.15.1:0/2613503898 shutdown_connections 2024-09-19T09:39:28.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.087+0000 7f7110acc740 1 --2- 172.21.15.1:0/2613503898 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563521b8a780 0x563521b813b0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.087+0000 7f7110acc740 1 --2- 172.21.15.1:0/2613503898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563521b856f0 0x563521b96490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.087+0000 7f7110acc740 1 --2- 172.21.15.1:0/2613503898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563521b84db0 0x563521b8f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.087+0000 7f7110acc740 1 -- 172.21.15.1:0/2613503898 >> 172.21.15.1:0/2613503898 conn(0x563521b80420 msgr2=0x563521b8ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:28.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.087+0000 7f7110acc740 1 -- 172.21.15.1:0/2613503898 shutdown_connections 2024-09-19T09:39:28.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.087+0000 7f7110acc740 1 -- 172.21.15.1:0/2613503898 wait complete. 2024-09-19T09:39:28.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.088+0000 7f7110acc740 1 -- start start 2024-09-19T09:39:28.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.088+0000 7f7110acc740 1 Processor -- start 2024-09-19T09:39:28.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.088+0000 7f7110acc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563521b84db0 0x563521b93ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.088+0000 7f7110acc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563521b856f0 0x563521b94400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.096 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.088+0000 7f7110acc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563521b8a780 0x563521b95410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.097 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.088+0000 7f7110acc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f71081a5be0 con 0x563521b8a780 2024-09-19T09:39:28.097 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.088+0000 7f7110acc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f71081a7050 con 0x563521b856f0 2024-09-19T09:39:28.097 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.088+0000 7f7110acc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f71081a62b0 con 0x563521b84db0 2024-09-19T09:39:28.097 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.088+0000 7f7110acc740 10 client.0 _ll_register_callbacks cb 0x7f70f800c6f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:28.097 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.088+0000 7f7107fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563521b8a780 0x563521b95410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.097 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.088+0000 7f7107fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563521b8a780 0x563521b95410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48770/0 (socket says 172.21.15.1:48770) 2024-09-19T09:39:28.097 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.088+0000 7f7107fff640 1 -- 172.21.15.1:0/1325057542 learned_addr learned my addr 172.21.15.1:0/1325057542 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:28.097 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.088+0000 7f7106ffd640 1 --2- 172.21.15.1:0/1325057542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563521b856f0 0x563521b94400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.097 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.089+0000 7f71077fe640 1 --2- 172.21.15.1:0/1325057542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563521b84db0 0x563521b93ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.089+0000 7f7107fff640 1 -- 172.21.15.1:0/1325057542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563521b84db0 msgr2=0x563521b93ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:28.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.089+0000 7f7107fff640 1 --2- 172.21.15.1:0/1325057542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563521b84db0 0x563521b93ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.089+0000 7f7107fff640 1 -- 172.21.15.1:0/1325057542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563521b856f0 msgr2=0x563521b94400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:28.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.089+0000 7f7107fff640 1 --2- 172.21.15.1:0/1325057542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563521b856f0 0x563521b94400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.089+0000 7f7107fff640 1 -- 172.21.15.1:0/1325057542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563521b95a20 con 0x563521b8a780 2024-09-19T09:39:28.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.089+0000 7f7106ffd640 1 --2- 172.21.15.1:0/1325057542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563521b856f0 0x563521b94400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:28.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.089+0000 7f7107fff640 1 --2- 172.21.15.1:0/1325057542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563521b8a780 0x563521b95410 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7100031c10 tx=0x7f7100030910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae60b627e5622ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:28.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.089+0000 7f70e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:39:28.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.089+0000 7f70e6ffd640 1 -- 172.21.15.1:0/1325057542 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7100057040 con 0x563521b8a780 2024-09-19T09:39:28.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.089+0000 7f70e6ffd640 1 -- 172.21.15.1:0/1325057542 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f710002fad0 con 0x563521b8a780 2024-09-19T09:39:28.098 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.089+0000 7f7110acc740 1 -- 172.21.15.1:0/1325057542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7100036040 con 0x563521b8a780 2024-09-19T09:39:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.089+0000 7f70e6ffd640 1 -- 172.21.15.1:0/1325057542 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7100030e90 con 0x563521b8a780 2024-09-19T09:39:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.089+0000 7f7110acc740 10 client.15495 fetch_fsmap learned FSMap version 19 2024-09-19T09:39:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.089+0000 7f7110acc740 1 -- 172.21.15.1:0/1325057542 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x563521c05c30 con 0x563521b8a780 2024-09-19T09:39:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.089+0000 7f70e6ffd640 1 -- 172.21.15.1:0/1325057542 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7100036040 con 0x563521b8a780 2024-09-19T09:39:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.090+0000 7f70e6ffd640 1 -- 172.21.15.1:0/1325057542 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f7100065030 con 0x563521b8a780 2024-09-19T09:39:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.090+0000 7f7110acc740 10 client.15495 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:39:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.090+0000 7f7110acc740 10 client.15495 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.090+0000 7f7110acc740 20 client.15495 populate_metadata read hostname 'smithi001' 2024-09-19T09:39:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.090+0000 7f7110acc740 1 --2- 172.21.15.1:0/1325057542 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563521c065e0 0x563521c08a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:28.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.090+0000 7f7110acc740 4 client.15495 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:39:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.090+0000 7f7110acc740 1 -- 172.21.15.1:0/1325057542 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563521a68900 con 0x563521c065e0 2024-09-19T09:39:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.090+0000 7f71077fe640 1 --2- 172.21.15.1:0/1325057542 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563521c065e0 0x563521c08a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.090+0000 7f70e6ffd640 10 client.15495 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:28.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.090+0000 7f71077fe640 1 --2- 172.21.15.1:0/1325057542 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563521c065e0 0x563521c08a00 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e82a33e4b4cde93 server_cookie=9b3619cf8cdb0f3b in_seq=0 out_seq=0 2024-09-19T09:39:28.101 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.096+0000 7f70e6ffd640 1 -- 172.21.15.1:0/1325057542 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563521a68900 con 0x563521c065e0 2024-09-19T09:39:28.101 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.096+0000 7f70e6ffd640 10 client.15495 handle_command_reply: tid=0 2024-09-19T09:39:28.101 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.096+0000 7f7110acc740 1 client.15495 shutdown 2024-09-19T09:39:28.101 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.096+0000 7f7110acc740 1 -- 172.21.15.1:0/1325057542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563521b8a780 msgr2=0x563521b95410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:28.101 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.096+0000 7f7110acc740 1 --2- 172.21.15.1:0/1325057542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563521b8a780 0x563521b95410 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7100031c10 tx=0x7f7100030910 comp rx=0 tx=0).stop 2024-09-19T09:39:28.101 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.096+0000 7f7110acc740 1 -- 172.21.15.1:0/1325057542 shutdown_connections 2024-09-19T09:39:28.101 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.096+0000 7f7110acc740 1 --2- 172.21.15.1:0/1325057542 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563521c065e0 0x563521c08a00 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.096+0000 7f7110acc740 1 --2- 172.21.15.1:0/1325057542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563521b8a780 0x563521b95410 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.096+0000 7f7110acc740 1 --2- 172.21.15.1:0/1325057542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563521b856f0 0x563521b94400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.096+0000 7f70e6ffd640 0 client.15495 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:28.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.096+0000 7f7110acc740 1 --2- 172.21.15.1:0/1325057542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563521b84db0 0x563521b93ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.096+0000 7f7110acc740 1 -- 172.21.15.1:0/1325057542 >> 172.21.15.1:0/1325057542 conn(0x563521b80420 msgr2=0x563521b7b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:28.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.096+0000 7f7110acc740 1 -- 172.21.15.1:0/1325057542 shutdown_connections 2024-09-19T09:39:28.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.096+0000 7f7110acc740 1 -- 172.21.15.1:0/1325057542 wait complete. 2024-09-19T09:39:28.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.096+0000 7f7110acc740 20 client.15495 trim_cache size 0 max 16384 2024-09-19T09:39:28.103 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:39:28.103 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:39:28.103 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:39:28.103 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:39:28.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.096+0000 7f710dd31640 1 -- 172.21.15.1:0/2416573278 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f70f00a3240 msgr2=0x7f70f00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:28.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.096+0000 7f710dd31640 1 --2- 172.21.15.1:0/2416573278 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f70f00a3240 0x7f70f00a5700 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7100005e30 tx=0x7f71000095c0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.096+0000 7f710dd31640 1 -- 172.21.15.1:0/2416573278 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7108101c30 msgr2=0x7f71081982a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:28.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.096+0000 7f710dd31640 1 --2- 172.21.15.1:0/2416573278 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7108101c30 0x7f71081982a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f70fc00d950 tx=0x7f70fc00de10 comp rx=0 tx=0).stop 2024-09-19T09:39:28.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.097+0000 7f710dd31640 1 -- 172.21.15.1:0/2416573278 shutdown_connections 2024-09-19T09:39:28.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.097+0000 7f710dd31640 1 --2- 172.21.15.1:0/2416573278 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f70f00a3240 0x7f70f00a5700 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.097+0000 7f710dd31640 1 --2- 172.21.15.1:0/2416573278 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71081025f0 0x7f710819f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.104 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.097+0000 7f710dd31640 1 --2- 172.21.15.1:0/2416573278 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7108101c30 0x7f71081982a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.097+0000 7f710dd31640 1 --2- 172.21.15.1:0/2416573278 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7108100a40 0x7f7108197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.097+0000 7f710dd31640 1 -- 172.21.15.1:0/2416573278 >> 172.21.15.1:0/2416573278 conn(0x7f71080fc1c0 msgr2=0x7f7108104f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.097+0000 7f710dd31640 1 -- 172.21.15.1:0/2416573278 shutdown_connections 2024-09-19T09:39:28.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:28.097+0000 7f710dd31640 1 -- 172.21.15.1:0/2416573278 wait complete. 2024-09-19T09:39:28.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:28 smithi022 ceph-mon[35583]: pgmap v379: 97 pgs: 97 active+clean; 660 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:39:28.365 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:28 smithi001 ceph-mon[31225]: pgmap v379: 97 pgs: 97 active+clean; 660 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:39:28.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:28 smithi121 ceph-mon[35577]: pgmap v379: 97 pgs: 97 active+clean; 660 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:39:28.609 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:39:28.609 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:39:28.866 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:29.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.378+0000 7f5349f42640 1 -- 172.21.15.1:0/3253192140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5344102790 msgr2=0x7f53441067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:29.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.378+0000 7f5349f42640 1 --2- 172.21.15.1:0/3253192140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5344102790 0x7f53441067e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f532c009900 tx=0x7f532c02a410 comp rx=0 tx=0).stop 2024-09-19T09:39:29.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.378+0000 7f5349f42640 1 -- 172.21.15.1:0/3253192140 shutdown_connections 2024-09-19T09:39:29.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.378+0000 7f5349f42640 1 --2- 172.21.15.1:0/3253192140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5344106f10 0x7f534410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:29.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.378+0000 7f5349f42640 1 --2- 172.21.15.1:0/3253192140 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5344102790 0x7f53441067e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:29.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.378+0000 7f5349f42640 1 --2- 172.21.15.1:0/3253192140 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5344101de0 0x7f53441021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:29.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.378+0000 7f5349f42640 1 -- 172.21.15.1:0/3253192140 >> 172.21.15.1:0/3253192140 conn(0x7f53440fd8c0 msgr2=0x7f53440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:29.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.378+0000 7f5349f42640 1 -- 172.21.15.1:0/3253192140 shutdown_connections 2024-09-19T09:39:29.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.379+0000 7f5349f42640 1 -- 172.21.15.1:0/3253192140 wait complete. 2024-09-19T09:39:29.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.379+0000 7f5349f42640 1 Processor -- start 2024-09-19T09:39:29.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.379+0000 7f5349f42640 1 -- start start 2024-09-19T09:39:29.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.379+0000 7f5349f42640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5344101de0 0x7f5344198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:29.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.379+0000 7f5349f42640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5344102790 0x7f53441989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:29.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.379+0000 7f5349f42640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5344106f10 0x7f534419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:29.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.379+0000 7f5349f42640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5344111f70 con 0x7f5344106f10 2024-09-19T09:39:29.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.379+0000 7f5349f42640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5344111df0 con 0x7f5344102790 2024-09-19T09:39:29.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.379+0000 7f5349f42640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f53441120f0 con 0x7f5344101de0 2024-09-19T09:39:29.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.379+0000 7f5343fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5344106f10 0x7f534419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:29.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.379+0000 7f53437fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5344101de0 0x7f5344198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:29.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.380+0000 7f5343fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5344106f10 0x7f534419cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48778/0 (socket says 172.21.15.1:48778) 2024-09-19T09:39:29.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.380+0000 7f5343fff640 1 -- 172.21.15.1:0/3595976511 learned_addr learned my addr 172.21.15.1:0/3595976511 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:29.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.380+0000 7f533bfff640 1 --2- 172.21.15.1:0/3595976511 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5344102790 0x7f53441989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:29.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.380+0000 7f5343fff640 1 -- 172.21.15.1:0/3595976511 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5344101de0 msgr2=0x7f5344198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:29.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.380+0000 7f5343fff640 1 --2- 172.21.15.1:0/3595976511 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5344101de0 0x7f5344198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:29.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.380+0000 7f5343fff640 1 -- 172.21.15.1:0/3595976511 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5344102790 msgr2=0x7f53441989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:29.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.380+0000 7f5343fff640 1 --2- 172.21.15.1:0/3595976511 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5344102790 0x7f53441989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:29.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.380+0000 7f5343fff640 1 -- 172.21.15.1:0/3595976511 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f534419d440 con 0x7f5344106f10 2024-09-19T09:39:29.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.380+0000 7f5343fff640 1 --2- 172.21.15.1:0/3595976511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5344106f10 0x7f534419cd60 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f533c00eaa0 tx=0x7f533c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:29.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.380+0000 7f53417fa640 1 -- 172.21.15.1:0/3595976511 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c00cdb0 con 0x7f5344106f10 2024-09-19T09:39:29.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.380+0000 7f5349f42640 1 -- 172.21.15.1:0/3595976511 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f534419d730 con 0x7f5344106f10 2024-09-19T09:39:29.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.380+0000 7f53417fa640 1 -- 172.21.15.1:0/3595976511 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f533c005020 con 0x7f5344106f10 2024-09-19T09:39:29.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.380+0000 7f53417fa640 1 -- 172.21.15.1:0/3595976511 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c0116d0 con 0x7f5344106f10 2024-09-19T09:39:29.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.380+0000 7f5349f42640 1 -- 172.21.15.1:0/3595976511 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53441a5010 con 0x7f5344106f10 2024-09-19T09:39:29.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.381+0000 7f5349f42640 1 -- 172.21.15.1:0/3595976511 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53441021c0 con 0x7f5344106f10 2024-09-19T09:39:29.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.382+0000 7f53417fa640 1 -- 172.21.15.1:0/3595976511 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f533c0054d0 con 0x7f5344106f10 2024-09-19T09:39:29.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.383+0000 7f53417fa640 1 --2- 172.21.15.1:0/3595976511 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f53300a3240 0x7f53300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:29.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.383+0000 7f53437fe640 1 --2- 172.21.15.1:0/3595976511 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f53300a3240 0x7f53300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:29.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.383+0000 7f53417fa640 1 -- 172.21.15.1:0/3595976511 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f533c0cfa50 con 0x7f5344106f10 2024-09-19T09:39:29.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.384+0000 7f53437fe640 1 --2- 172.21.15.1:0/3595976511 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f53300a3240 0x7f53300a5700 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5334005d00 tx=0x7f533400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:29.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.387+0000 7f53417fa640 1 -- 172.21.15.1:0/3595976511 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f533c016030 con 0x7f5344106f10 2024-09-19T09:39:29.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.600+0000 7f5349f42640 1 -- 172.21.15.1:0/3595976511 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f534410a150 con 0x7f5344106f10 2024-09-19T09:39:29.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.601+0000 7f53417fa640 1 -- 172.21.15.1:0/3595976511 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11837 (secure 0 0 0) 0x7f533c09c0e0 con 0x7f5344106f10 2024-09-19T09:39:29.602 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:39:29.602 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":19,"btime":"2024-09-19T09:36:24:006349+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:36:23.723388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6839/3279971690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3279971690},{"type":"v1","addr":"172.21.15.121:6839","nonce":3279971690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:39:29.603 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 19 2024-09-19T09:39:29.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.603+0000 7f5349f42640 1 -- 172.21.15.1:0/3595976511 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f53300a3240 msgr2=0x7f53300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:29.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.603+0000 7f5349f42640 1 --2- 172.21.15.1:0/3595976511 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f53300a3240 0x7f53300a5700 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5334005d00 tx=0x7f533400b410 comp rx=0 tx=0).stop 2024-09-19T09:39:29.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.603+0000 7f5349f42640 1 -- 172.21.15.1:0/3595976511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5344106f10 msgr2=0x7f534419cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:29.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.603+0000 7f5349f42640 1 --2- 172.21.15.1:0/3595976511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5344106f10 0x7f534419cd60 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f533c00eaa0 tx=0x7f533c00ef60 comp rx=0 tx=0).stop 2024-09-19T09:39:29.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.603+0000 7f5349f42640 1 -- 172.21.15.1:0/3595976511 shutdown_connections 2024-09-19T09:39:29.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.603+0000 7f5349f42640 1 --2- 172.21.15.1:0/3595976511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5344106f10 0x7f534419cd60 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:29.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.603+0000 7f5349f42640 1 --2- 172.21.15.1:0/3595976511 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f53300a3240 0x7f53300a5700 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:29.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.603+0000 7f5349f42640 1 --2- 172.21.15.1:0/3595976511 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5344102790 0x7f53441989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:29.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.603+0000 7f5349f42640 1 --2- 172.21.15.1:0/3595976511 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5344101de0 0x7f5344198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:29.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.603+0000 7f5349f42640 1 -- 172.21.15.1:0/3595976511 >> 172.21.15.1:0/3595976511 conn(0x7f53440fd8c0 msgr2=0x7f53440fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:29.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.603+0000 7f5349f42640 1 -- 172.21.15.1:0/3595976511 shutdown_connections 2024-09-19T09:39:29.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:29.603+0000 7f5349f42640 1 -- 172.21.15.1:0/3595976511 wait complete. 2024-09-19T09:39:30.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:30 smithi001 ceph-mon[31225]: pgmap v380: 97 pgs: 97 active+clean; 660 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:39:30.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:30 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/3595976511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:30.322 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:39:30.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:30 smithi022 ceph-mon[35583]: pgmap v380: 97 pgs: 97 active+clean; 660 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:39:30.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:30 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/3595976511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:30.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:30 smithi121 ceph-mon[35577]: pgmap v380: 97 pgs: 97 active+clean; 660 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:39:30.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:30 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/3595976511' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:30.581 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:31.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.068+0000 7f9eff1ef640 1 -- 172.21.15.1:0/3983915075 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ef8106f50 msgr2=0x7f9ef810eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:31.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.068+0000 7f9eff1ef640 1 --2- 172.21.15.1:0/3983915075 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ef8106f50 0x7f9ef810eaf0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0009cd0 tx=0x7f9ef002a8e0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.068+0000 7f9eff1ef640 1 -- 172.21.15.1:0/3983915075 shutdown_connections 2024-09-19T09:39:31.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.068+0000 7f9eff1ef640 1 --2- 172.21.15.1:0/3983915075 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ef8106f50 0x7f9ef810eaf0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.068+0000 7f9eff1ef640 1 --2- 172.21.15.1:0/3983915075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ef8100ca0 0x7f9ef8106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.068+0000 7f9eff1ef640 1 --2- 172.21.15.1:0/3983915075 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ef81002f0 0x7f9ef81006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.068+0000 7f9eff1ef640 1 -- 172.21.15.1:0/3983915075 >> 172.21.15.1:0/3983915075 conn(0x7f9ef8077210 msgr2=0x7f9ef80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:31.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.068+0000 7f9eff1ef640 1 -- 172.21.15.1:0/3983915075 shutdown_connections 2024-09-19T09:39:31.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.068+0000 7f9eff1ef640 1 -- 172.21.15.1:0/3983915075 wait complete. 2024-09-19T09:39:31.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.069+0000 7f9eff1ef640 1 Processor -- start 2024-09-19T09:39:31.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.069+0000 7f9eff1ef640 1 -- start start 2024-09-19T09:39:31.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.069+0000 7f9eff1ef640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ef81002f0 0x7f9ef8198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:31.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.069+0000 7f9eff1ef640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ef8100ca0 0x7f9ef8198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:31.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.069+0000 7f9eff1ef640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ef8106f50 0x7f9ef819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:31.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.069+0000 7f9eff1ef640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef8112000 con 0x7f9ef8106f50 2024-09-19T09:39:31.096 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.069+0000 7f9eff1ef640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef8111e80 con 0x7f9ef81002f0 2024-09-19T09:39:31.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.069+0000 7f9eff1ef640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef8112180 con 0x7f9ef8100ca0 2024-09-19T09:39:31.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.069+0000 7f9efd78c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ef8106f50 0x7f9ef819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:31.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.069+0000 7f9efd78c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ef8106f50 0x7f9ef819cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48798/0 (socket says 172.21.15.1:48798) 2024-09-19T09:39:31.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.069+0000 7f9efd78c640 1 -- 172.21.15.1:0/1189250050 learned_addr learned my addr 172.21.15.1:0/1189250050 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:31.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.069+0000 7f9efcf8b640 1 --2- 172.21.15.1:0/1189250050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ef81002f0 0x7f9ef8198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:31.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.070+0000 7f9ef7fff640 1 --2- 172.21.15.1:0/1189250050 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ef8100ca0 0x7f9ef8198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:31.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.070+0000 7f9efd78c640 1 -- 172.21.15.1:0/1189250050 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ef8100ca0 msgr2=0x7f9ef8198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:31.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.070+0000 7f9efd78c640 1 --2- 172.21.15.1:0/1189250050 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ef8100ca0 0x7f9ef8198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.070+0000 7f9efd78c640 1 -- 172.21.15.1:0/1189250050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ef81002f0 msgr2=0x7f9ef8198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:31.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.070+0000 7f9efd78c640 1 --2- 172.21.15.1:0/1189250050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ef81002f0 0x7f9ef8198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.070+0000 7f9efd78c640 1 -- 172.21.15.1:0/1189250050 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ef819d3f0 con 0x7f9ef8106f50 2024-09-19T09:39:31.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.070+0000 7f9ef7fff640 1 --2- 172.21.15.1:0/1189250050 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ef8100ca0 0x7f9ef8198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:31.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.070+0000 7f9efd78c640 1 --2- 172.21.15.1:0/1189250050 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ef8106f50 0x7f9ef819cd10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0006010 tx=0x7f9ef0003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:31.097 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.070+0000 7f9ef5ffb640 1 -- 172.21.15.1:0/1189250050 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef0004450 con 0x7f9ef8106f50 2024-09-19T09:39:31.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.070+0000 7f9eff1ef640 1 -- 172.21.15.1:0/1189250050 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ef819d680 con 0x7f9ef8106f50 2024-09-19T09:39:31.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.070+0000 7f9ef5ffb640 1 -- 172.21.15.1:0/1189250050 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ef0003e10 con 0x7f9ef8106f50 2024-09-19T09:39:31.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.070+0000 7f9ef5ffb640 1 -- 172.21.15.1:0/1189250050 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef0046480 con 0x7f9ef8106f50 2024-09-19T09:39:31.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.070+0000 7f9eff1ef640 1 -- 172.21.15.1:0/1189250050 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ef81a4fc0 con 0x7f9ef8106f50 2024-09-19T09:39:31.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.073+0000 7f9ef5ffb640 1 -- 172.21.15.1:0/1189250050 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f9ef00045f0 con 0x7f9ef8106f50 2024-09-19T09:39:31.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.073+0000 7f9f015c8740 1 Processor -- start 2024-09-19T09:39:31.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.073+0000 7f9f015c8740 1 -- start start 2024-09-19T09:39:31.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.073+0000 7f9f015c8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eca5bedb40 0x55eca5bec090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:31.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.073+0000 7f9f015c8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eca5bec5d0 0x55eca5beca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:31.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.073+0000 7f9f015c8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eca5bf7370 0x55eca5bf9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:31.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.073+0000 7f9f015c8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55eca5b522f0 con 0x55eca5bf7370 2024-09-19T09:39:31.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.073+0000 7f9f015c8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55eca5af9cf0 con 0x55eca5bec5d0 2024-09-19T09:39:31.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.073+0000 7f9f015c8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55eca5b4e2b0 con 0x55eca5bedb40 2024-09-19T09:39:31.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.073+0000 7f9ef5ffb640 1 --2- 172.21.15.1:0/1189250050 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f9ee80a3240 0x7f9ee80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:31.098 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.073+0000 7f9ef7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eca5bf7370 0x55eca5bf9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:31.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.073+0000 7f9ef7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eca5bf7370 0x55eca5bf9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48810/0 (socket says 172.21.15.1:48810) 2024-09-19T09:39:31.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.073+0000 7f9ef7fff640 1 -- 172.21.15.1:0/3154375264 learned_addr learned my addr 172.21.15.1:0/3154375264 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:31.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.073+0000 7f9efd78c640 1 --2- 172.21.15.1:0/1189250050 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f9ee80a3240 0x7f9ee80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:31.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.073+0000 7f9efcf8b640 1 --2- 172.21.15.1:0/3154375264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eca5bec5d0 0x55eca5beca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:31.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.074+0000 7f9ef7fff640 1 --2- 172.21.15.1:0/3154375264 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eca5bedb40 0x55eca5bec090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:31.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.074+0000 7f9ef5ffb640 1 -- 172.21.15.1:0/1189250050 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f9ef002e030 con 0x7f9ef8106f50 2024-09-19T09:39:31.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.074+0000 7f9ef7fff640 1 -- 172.21.15.1:0/3154375264 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eca5bedb40 msgr2=0x55eca5bec090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:31.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.074+0000 7f9ef7fff640 1 --2- 172.21.15.1:0/3154375264 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eca5bedb40 0x55eca5bec090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.074+0000 7f9ef7fff640 1 -- 172.21.15.1:0/3154375264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eca5bec5d0 msgr2=0x55eca5beca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:31.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.074+0000 7f9ef7fff640 1 --2- 172.21.15.1:0/3154375264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eca5bec5d0 0x55eca5beca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.074+0000 7f9ef7fff640 1 -- 172.21.15.1:0/3154375264 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eca5ade3a0 con 0x55eca5bf7370 2024-09-19T09:39:31.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.074+0000 7f9efcf8b640 1 --2- 172.21.15.1:0/3154375264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eca5bec5d0 0x55eca5beca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:31.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.074+0000 7f9efd78c640 1 --2- 172.21.15.1:0/1189250050 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f9ee80a3240 0x7f9ee80a5700 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9ef00ba2b0 tx=0x7f9ef0090760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:31.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.074+0000 7f9ef7fff640 1 --2- 172.21.15.1:0/3154375264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eca5bf7370 0x55eca5bf9760 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4005fd0 tx=0x7f9ee400d420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b93b575eebb042 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:31.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.074+0000 7f9ee2ffd640 1 -- 172.21.15.1:0/3154375264 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee400aa60 con 0x55eca5bf7370 2024-09-19T09:39:31.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.074+0000 7f9ee2ffd640 1 -- 172.21.15.1:0/3154375264 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ee4005500 con 0x55eca5bf7370 2024-09-19T09:39:31.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.074+0000 7f9ee2ffd640 1 -- 172.21.15.1:0/3154375264 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4004ba0 con 0x55eca5bf7370 2024-09-19T09:39:31.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.075+0000 7f9f015c8740 1 -- 172.21.15.1:0/3154375264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eca5bf7370 msgr2=0x55eca5bf9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:31.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.075+0000 7f9f015c8740 1 --2- 172.21.15.1:0/3154375264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eca5bf7370 0x55eca5bf9760 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4005fd0 tx=0x7f9ee400d420 comp rx=0 tx=0).stop 2024-09-19T09:39:31.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.075+0000 7f9f015c8740 1 -- 172.21.15.1:0/3154375264 shutdown_connections 2024-09-19T09:39:31.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.075+0000 7f9f015c8740 1 --2- 172.21.15.1:0/3154375264 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eca5bf7370 0x55eca5bf9760 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.075+0000 7f9f015c8740 1 --2- 172.21.15.1:0/3154375264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eca5bec5d0 0x55eca5beca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.075+0000 7f9f015c8740 1 --2- 172.21.15.1:0/3154375264 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eca5bedb40 0x55eca5bec090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.075+0000 7f9f015c8740 1 -- 172.21.15.1:0/3154375264 >> 172.21.15.1:0/3154375264 conn(0x55eca5bb5310 msgr2=0x55eca5be8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:31.100 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.075+0000 7f9f015c8740 1 -- 172.21.15.1:0/3154375264 shutdown_connections 2024-09-19T09:39:31.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.075+0000 7f9f015c8740 1 -- 172.21.15.1:0/3154375264 wait complete. 2024-09-19T09:39:31.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.075+0000 7f9f015c8740 1 -- start start 2024-09-19T09:39:31.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.076+0000 7f9f015c8740 1 Processor -- start 2024-09-19T09:39:31.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.076+0000 7f9f015c8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eca5bec5d0 0x55eca5bf6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:31.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.076+0000 7f9f015c8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eca5bedb40 0x55eca5bf4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:31.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.076+0000 7f9f015c8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eca5bf7370 0x55eca5bf4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:31.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.076+0000 7f9f015c8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55eca5bfa070 con 0x55eca5bec5d0 2024-09-19T09:39:31.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.076+0000 7f9f015c8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55eca5b0d060 con 0x55eca5bf7370 2024-09-19T09:39:31.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.076+0000 7f9f015c8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55eca5bfa1f0 con 0x55eca5bedb40 2024-09-19T09:39:31.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.076+0000 7f9f015c8740 10 client.0 _ll_register_callbacks cb 0x55eca58608c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:31.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.076+0000 7f9ef7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eca5bec5d0 0x55eca5bf6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:31.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.076+0000 7f9ef7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eca5bec5d0 0x55eca5bf6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48816/0 (socket says 172.21.15.1:48816) 2024-09-19T09:39:31.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.076+0000 7f9ef7fff640 1 -- 172.21.15.1:0/2411000881 learned_addr learned my addr 172.21.15.1:0/2411000881 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:31.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.076+0000 7f9efcf8b640 1 --2- 172.21.15.1:0/2411000881 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eca5bedb40 0x55eca5bf4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:31.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.076+0000 7f9ef7fff640 1 --2- 172.21.15.1:0/2411000881 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eca5bf7370 0x55eca5bf4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:31.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.077+0000 7f9efcf8b640 1 -- 172.21.15.1:0/2411000881 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eca5bf7370 msgr2=0x55eca5bf4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:31.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.077+0000 7f9efcf8b640 1 --2- 172.21.15.1:0/2411000881 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eca5bf7370 0x55eca5bf4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.077+0000 7f9efcf8b640 1 -- 172.21.15.1:0/2411000881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eca5bec5d0 msgr2=0x55eca5bf6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:31.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.077+0000 7f9efcf8b640 1 --2- 172.21.15.1:0/2411000881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eca5bec5d0 0x55eca5bf6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.077+0000 7f9efcf8b640 1 -- 172.21.15.1:0/2411000881 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eca58c33c0 con 0x55eca5bedb40 2024-09-19T09:39:31.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.077+0000 7f9efcf8b640 1 --2- 172.21.15.1:0/2411000881 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eca5bedb40 0x55eca5bf4040 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x55eca5be9ac0 tx=0x7f9eec009ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dafb7e57fe6ff89 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:31.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.077+0000 7f9ed7fff640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-19T09:39:31.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.080+0000 7f9ed7fff640 1 -- 172.21.15.1:0/2411000881 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec00b7d0 con 0x55eca5bedb40 2024-09-19T09:39:31.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.080+0000 7f9ed7fff640 1 -- 172.21.15.1:0/2411000881 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f9eec00b970 con 0x55eca5bedb40 2024-09-19T09:39:31.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.080+0000 7f9f015c8740 1 -- 172.21.15.1:0/2411000881 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ee4005500 con 0x55eca5bedb40 2024-09-19T09:39:31.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.080+0000 7f9ed7fff640 1 -- 172.21.15.1:0/2411000881 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9eec00bb70 con 0x55eca5bedb40 2024-09-19T09:39:31.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.080+0000 7f9f015c8740 10 client.25117 fetch_fsmap learned FSMap version 19 2024-09-19T09:39:31.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.080+0000 7f9f015c8740 1 -- 172.21.15.1:0/2411000881 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55eca5c05ba0 con 0x55eca5bedb40 2024-09-19T09:39:31.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.080+0000 7f9ed7fff640 1 -- 172.21.15.1:0/2411000881 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ee4005500 con 0x55eca5bedb40 2024-09-19T09:39:31.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.080+0000 7f9ed7fff640 1 -- 172.21.15.1:0/2411000881 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f9eec024490 con 0x55eca5bedb40 2024-09-19T09:39:31.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.080+0000 7f9f015c8740 10 client.25117 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:39:31.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.080+0000 7f9f015c8740 10 client.25117 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:31.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.080+0000 7f9f015c8740 20 client.25117 populate_metadata read hostname 'smithi001' 2024-09-19T09:39:31.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.080+0000 7f9f015c8740 1 --2- 172.21.15.1:0/2411000881 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55eca5c07060 0x55eca5c094c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:31.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.080+0000 7f9f015c8740 4 client.25117 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:39:31.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.080+0000 7f9f015c8740 1 -- 172.21.15.1:0/2411000881 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eca5b5f860 con 0x55eca5c07060 2024-09-19T09:39:31.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.081+0000 7f9ef7fff640 1 --2- 172.21.15.1:0/2411000881 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55eca5c07060 0x55eca5c094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:31.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.081+0000 7f9ef7fff640 1 --2- 172.21.15.1:0/2411000881 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55eca5c07060 0x55eca5c094c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf470a3544c5b912 server_cookie=4e02f91712541c44 in_seq=0 out_seq=0 2024-09-19T09:39:31.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.081+0000 7f9ed7fff640 10 client.25117 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:31.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.082+0000 7f9ed7fff640 1 -- 172.21.15.1:0/2411000881 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eca5b5f860 con 0x55eca5c07060 2024-09-19T09:39:31.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.082+0000 7f9ed7fff640 10 client.25117 handle_command_reply: tid=0 2024-09-19T09:39:31.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.082+0000 7f9f015c8740 1 client.25117 shutdown 2024-09-19T09:39:31.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.082+0000 7f9f015c8740 1 -- 172.21.15.1:0/2411000881 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eca5bedb40 msgr2=0x55eca5bf4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:31.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.082+0000 7f9f015c8740 1 --2- 172.21.15.1:0/2411000881 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eca5bedb40 0x55eca5bf4040 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x55eca5be9ac0 tx=0x7f9eec009ab0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.082+0000 7f9f015c8740 1 -- 172.21.15.1:0/2411000881 shutdown_connections 2024-09-19T09:39:31.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.082+0000 7f9f015c8740 1 --2- 172.21.15.1:0/2411000881 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55eca5c07060 0x55eca5c094c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.082+0000 7f9f015c8740 1 --2- 172.21.15.1:0/2411000881 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eca5bf7370 0x55eca5bf4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.082+0000 7f9ed7fff640 0 client.25117 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:31.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.082+0000 7f9f015c8740 1 --2- 172.21.15.1:0/2411000881 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eca5bedb40 0x55eca5bf4040 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.082+0000 7f9f015c8740 1 --2- 172.21.15.1:0/2411000881 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eca5bec5d0 0x55eca5bf6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.082+0000 7f9f015c8740 1 -- 172.21.15.1:0/2411000881 >> 172.21.15.1:0/2411000881 conn(0x55eca5bb5310 msgr2=0x55eca5bee960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:31.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.082+0000 7f9f015c8740 1 -- 172.21.15.1:0/2411000881 shutdown_connections 2024-09-19T09:39:31.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.082+0000 7f9f015c8740 1 -- 172.21.15.1:0/2411000881 wait complete. 2024-09-19T09:39:31.104 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.083+0000 7f9f015c8740 20 client.25117 trim_cache size 0 max 16384 2024-09-19T09:39:31.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.096+0000 7f9f015c8740 1 Processor -- start 2024-09-19T09:39:31.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.096+0000 7f9f015c8740 1 -- start start 2024-09-19T09:39:31.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.096+0000 7f9f015c8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eca5bec5d0 0x55eca5be8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:31.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.096+0000 7f9f015c8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eca5bedb40 0x55eca5c03310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:31.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.096+0000 7f9f015c8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eca5bf7370 0x55eca5c0ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:31.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.096+0000 7f9f015c8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef81a9320 con 0x55eca5bf7370 2024-09-19T09:39:31.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.096+0000 7f9f015c8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef81abbc0 con 0x55eca5bedb40 2024-09-19T09:39:31.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.096+0000 7f9f015c8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef81a99b0 con 0x55eca5bec5d0 2024-09-19T09:39:31.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.097+0000 7f9ef7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eca5bf7370 0x55eca5c0ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:31.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.097+0000 7f9ef7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eca5bf7370 0x55eca5c0ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48818/0 (socket says 172.21.15.1:48818) 2024-09-19T09:39:31.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.097+0000 7f9ef7fff640 1 -- 172.21.15.1:0/4271996361 learned_addr learned my addr 172.21.15.1:0/4271996361 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:31.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.097+0000 7f9efcf8b640 1 --2- 172.21.15.1:0/4271996361 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eca5bedb40 0x55eca5c03310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:31.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.097+0000 7f9ef7fff640 1 --2- 172.21.15.1:0/4271996361 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eca5bec5d0 0x55eca5be8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:31.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.097+0000 7f9ef7fff640 1 -- 172.21.15.1:0/4271996361 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eca5bec5d0 msgr2=0x55eca5be8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:31.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.097+0000 7f9ef7fff640 1 --2- 172.21.15.1:0/4271996361 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eca5bec5d0 0x55eca5be8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.097+0000 7f9ef7fff640 1 -- 172.21.15.1:0/4271996361 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eca5bedb40 msgr2=0x55eca5c03310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:31.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.097+0000 7f9ef7fff640 1 --2- 172.21.15.1:0/4271996361 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eca5bedb40 0x55eca5c03310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.097+0000 7f9ef7fff640 1 -- 172.21.15.1:0/4271996361 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eca5bec2d0 con 0x55eca5bf7370 2024-09-19T09:39:31.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.097+0000 7f9efcf8b640 1 --2- 172.21.15.1:0/4271996361 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eca5bedb40 0x55eca5c03310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:31.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.097+0000 7f9ef7fff640 1 --2- 172.21.15.1:0/4271996361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eca5bf7370 0x55eca5c0ed90 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9ee400de30 tx=0x7f9ee4004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e354abe00d9371 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:31.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.097+0000 7f9ee27fc640 1 -- 172.21.15.1:0/4271996361 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4026040 con 0x55eca5bf7370 2024-09-19T09:39:31.110 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.097+0000 7f9ee27fc640 1 -- 172.21.15.1:0/4271996361 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ee402e8c0 con 0x55eca5bf7370 2024-09-19T09:39:31.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.097+0000 7f9ee27fc640 1 -- 172.21.15.1:0/4271996361 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee401d650 con 0x55eca5bf7370 2024-09-19T09:39:31.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.098+0000 7f9f015c8740 1 -- 172.21.15.1:0/4271996361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eca5bf7370 msgr2=0x55eca5c0ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:31.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.098+0000 7f9f015c8740 1 --2- 172.21.15.1:0/4271996361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eca5bf7370 0x55eca5c0ed90 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9ee400de30 tx=0x7f9ee4004840 comp rx=0 tx=0).stop 2024-09-19T09:39:31.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.098+0000 7f9f015c8740 1 -- 172.21.15.1:0/4271996361 shutdown_connections 2024-09-19T09:39:31.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.098+0000 7f9f015c8740 1 --2- 172.21.15.1:0/4271996361 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eca5bf7370 0x55eca5c0ed90 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.098+0000 7f9f015c8740 1 --2- 172.21.15.1:0/4271996361 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eca5bedb40 0x55eca5c03310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.098+0000 7f9f015c8740 1 --2- 172.21.15.1:0/4271996361 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eca5bec5d0 0x55eca5be8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.098+0000 7f9f015c8740 1 -- 172.21.15.1:0/4271996361 >> 172.21.15.1:0/4271996361 conn(0x55eca5bb5310 msgr2=0x55eca5be8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:31.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.098+0000 7f9f015c8740 1 -- 172.21.15.1:0/4271996361 shutdown_connections 2024-09-19T09:39:31.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.098+0000 7f9f015c8740 1 -- 172.21.15.1:0/4271996361 wait complete. 2024-09-19T09:39:31.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.099+0000 7f9f015c8740 1 -- start start 2024-09-19T09:39:31.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.099+0000 7f9f015c8740 1 Processor -- start 2024-09-19T09:39:31.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.099+0000 7f9f015c8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eca5bec5d0 0x55eca5bf1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:31.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.099+0000 7f9f015c8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eca5bedb40 0x55eca5bf1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:31.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.099+0000 7f9f015c8740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eca5bf7370 0x55eca5bf1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:31.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.099+0000 7f9f015c8740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef81aa080 con 0x55eca5bf7370 2024-09-19T09:39:31.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.099+0000 7f9f015c8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef81ab4f0 con 0x55eca5bedb40 2024-09-19T09:39:31.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.099+0000 7f9f015c8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef81aa750 con 0x55eca5bec5d0 2024-09-19T09:39:31.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.099+0000 7f9f015c8740 10 client.0 _ll_register_callbacks cb 0x7f9eec010770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:31.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.099+0000 7f9ef7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eca5bf7370 0x55eca5bf1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:31.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.099+0000 7f9ef7fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eca5bf7370 0x55eca5bf1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48820/0 (socket says 172.21.15.1:48820) 2024-09-19T09:39:31.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.099+0000 7f9ef7fff640 1 -- 172.21.15.1:0/3655340617 learned_addr learned my addr 172.21.15.1:0/3655340617 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:31.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.099+0000 7f9efcf8b640 1 --2- 172.21.15.1:0/3655340617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eca5bedb40 0x55eca5bf1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:31.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.099+0000 7f9ef7fff640 1 --2- 172.21.15.1:0/3655340617 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eca5bec5d0 0x55eca5bf1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:31.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.100+0000 7f9efcf8b640 1 -- 172.21.15.1:0/3655340617 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eca5bec5d0 msgr2=0x55eca5bf1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:31.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.100+0000 7f9efcf8b640 1 --2- 172.21.15.1:0/3655340617 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eca5bec5d0 0x55eca5bf1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.100+0000 7f9efcf8b640 1 -- 172.21.15.1:0/3655340617 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eca5bf7370 msgr2=0x55eca5bf1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:31.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.100+0000 7f9efcf8b640 1 --2- 172.21.15.1:0/3655340617 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eca5bf7370 0x55eca5bf1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.100+0000 7f9efcf8b640 1 -- 172.21.15.1:0/3655340617 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eca5c79570 con 0x55eca5bedb40 2024-09-19T09:39:31.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.100+0000 7f9efcf8b640 1 --2- 172.21.15.1:0/3655340617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eca5bedb40 0x55eca5bf1550 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9eec024950 tx=0x7f9eec00bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd232fce6da5f083 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:31.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.100+0000 7f9ed7fff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:39:31.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.100+0000 7f9ed7fff640 1 -- 172.21.15.1:0/3655340617 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec034060 con 0x55eca5bedb40 2024-09-19T09:39:31.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.100+0000 7f9ed7fff640 1 -- 172.21.15.1:0/3655340617 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f9eec024400 con 0x55eca5bedb40 2024-09-19T09:39:31.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.100+0000 7f9f015c8740 1 -- 172.21.15.1:0/3655340617 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ee402e8c0 con 0x55eca5bedb40 2024-09-19T09:39:31.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.100+0000 7f9ed7fff640 1 -- 172.21.15.1:0/3655340617 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9eec024d50 con 0x55eca5bedb40 2024-09-19T09:39:31.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.100+0000 7f9f015c8740 10 client.25211 fetch_fsmap learned FSMap version 19 2024-09-19T09:39:31.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.100+0000 7f9f015c8740 1 -- 172.21.15.1:0/3655340617 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55eca5c7a840 con 0x55eca5bedb40 2024-09-19T09:39:31.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.101+0000 7f9ed7fff640 1 -- 172.21.15.1:0/3655340617 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ee402e8c0 con 0x55eca5bedb40 2024-09-19T09:39:31.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.101+0000 7f9ed7fff640 1 -- 172.21.15.1:0/3655340617 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f9eec039070 con 0x55eca5bedb40 2024-09-19T09:39:31.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.101+0000 7f9f015c8740 10 client.25211 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:39:31.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.101+0000 7f9f015c8740 10 client.25211 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:31.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.101+0000 7f9f015c8740 20 client.25211 populate_metadata read hostname 'smithi001' 2024-09-19T09:39:31.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.101+0000 7f9f015c8740 1 --2- 172.21.15.1:0/3655340617 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55eca5c7aff0 0x55eca5c7d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:31.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.101+0000 7f9f015c8740 4 client.25211 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:39:31.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.101+0000 7f9f015c8740 1 -- 172.21.15.1:0/3655340617 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55eca5b59d70 con 0x55eca5c7aff0 2024-09-19T09:39:31.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.101+0000 7f9ef7fff640 1 --2- 172.21.15.1:0/3655340617 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55eca5c7aff0 0x55eca5c7d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:31.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.101+0000 7f9ef7fff640 1 --2- 172.21.15.1:0/3655340617 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55eca5c7aff0 0x55eca5c7d410 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b349556959ea7217 server_cookie=cbb31e960a70facb in_seq=0 out_seq=0 2024-09-19T09:39:31.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.101+0000 7f9ed7fff640 10 client.25211 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:31.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.102+0000 7f9ed7fff640 1 -- 172.21.15.1:0/3655340617 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55eca5b59d70 con 0x55eca5c7aff0 2024-09-19T09:39:31.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.102+0000 7f9ed7fff640 10 client.25211 handle_command_reply: tid=0 2024-09-19T09:39:31.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.102+0000 7f9f015c8740 1 client.25211 shutdown 2024-09-19T09:39:31.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.102+0000 7f9f015c8740 1 -- 172.21.15.1:0/3655340617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eca5bedb40 msgr2=0x55eca5bf1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:31.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.102+0000 7f9f015c8740 1 --2- 172.21.15.1:0/3655340617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eca5bedb40 0x55eca5bf1550 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9eec024950 tx=0x7f9eec00bf40 comp rx=0 tx=0).stop 2024-09-19T09:39:31.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.102+0000 7f9f015c8740 1 -- 172.21.15.1:0/3655340617 shutdown_connections 2024-09-19T09:39:31.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.102+0000 7f9f015c8740 1 --2- 172.21.15.1:0/3655340617 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55eca5c7aff0 0x55eca5c7d410 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.102+0000 7f9f015c8740 1 --2- 172.21.15.1:0/3655340617 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55eca5bf7370 0x55eca5bf1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.102+0000 7f9f015c8740 1 --2- 172.21.15.1:0/3655340617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55eca5bedb40 0x55eca5bf1550 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.102+0000 7f9f015c8740 1 --2- 172.21.15.1:0/3655340617 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55eca5bec5d0 0x55eca5bf1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.102+0000 7f9ed7fff640 0 client.25211 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:31.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.102+0000 7f9f015c8740 1 -- 172.21.15.1:0/3655340617 >> 172.21.15.1:0/3655340617 conn(0x55eca5bb5310 msgr2=0x55eca5bf58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:31.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.102+0000 7f9f015c8740 1 -- 172.21.15.1:0/3655340617 shutdown_connections 2024-09-19T09:39:31.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.102+0000 7f9f015c8740 1 -- 172.21.15.1:0/3655340617 wait complete. 2024-09-19T09:39:31.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.102+0000 7f9f015c8740 20 client.25211 trim_cache size 0 max 16384 2024-09-19T09:39:31.115 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-19T09:39:31.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.102+0000 7f9eff1ef640 1 -- 172.21.15.1:0/1189250050 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f9ee80a3240 msgr2=0x7f9ee80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:31.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.103+0000 7f9eff1ef640 1 --2- 172.21.15.1:0/1189250050 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f9ee80a3240 0x7f9ee80a5700 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9ef00ba2b0 tx=0x7f9ef0090760 comp rx=0 tx=0).stop 2024-09-19T09:39:31.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.103+0000 7f9eff1ef640 1 -- 172.21.15.1:0/1189250050 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ef8106f50 msgr2=0x7f9ef819cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:31.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.103+0000 7f9eff1ef640 1 --2- 172.21.15.1:0/1189250050 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ef8106f50 0x7f9ef819cd10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0006010 tx=0x7f9ef0003c20 comp rx=0 tx=0).stop 2024-09-19T09:39:31.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.103+0000 7f9eff1ef640 1 -- 172.21.15.1:0/1189250050 shutdown_connections 2024-09-19T09:39:31.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.103+0000 7f9eff1ef640 1 --2- 172.21.15.1:0/1189250050 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9ef8106f50 0x7f9ef819cd10 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.116 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.103+0000 7f9eff1ef640 1 --2- 172.21.15.1:0/1189250050 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ef8100ca0 0x7f9ef8198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.103+0000 7f9eff1ef640 1 --2- 172.21.15.1:0/1189250050 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f9ee80a3240 0x7f9ee80a5700 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.103+0000 7f9eff1ef640 1 --2- 172.21.15.1:0/1189250050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ef81002f0 0x7f9ef8198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:31.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.103+0000 7f9eff1ef640 1 -- 172.21.15.1:0/1189250050 >> 172.21.15.1:0/1189250050 conn(0x7f9ef8077210 msgr2=0x7f9ef8105750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:31.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.103+0000 7f9eff1ef640 1 -- 172.21.15.1:0/1189250050 shutdown_connections 2024-09-19T09:39:31.117 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:31.103+0000 7f9eff1ef640 1 -- 172.21.15.1:0/1189250050 wait complete. 2024-09-19T09:39:32.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:32 smithi022 ceph-mon[35583]: pgmap v381: 97 pgs: 97 active+clean; 660 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 170 B/s wr, 1 op/s 2024-09-19T09:39:32.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:32 smithi121 ceph-mon[35577]: pgmap v381: 97 pgs: 97 active+clean; 660 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 170 B/s wr, 1 op/s 2024-09-19T09:39:32.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:32 smithi001 ceph-mon[31225]: pgmap v381: 97 pgs: 97 active+clean; 660 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 170 B/s wr, 1 op/s 2024-09-19T09:39:32.792 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:39:32.792 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:39:33.061 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:33.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.529+0000 7f14e47da640 1 -- 172.21.15.1:0/1512497496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14dc106a80 msgr2=0x7f14dc106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:33.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.529+0000 7f14e47da640 1 --2- 172.21.15.1:0/1512497496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14dc106a80 0x7f14dc106e60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f14d8009930 tx=0x7f14d802a420 comp rx=0 tx=0).stop 2024-09-19T09:39:33.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.529+0000 7f14e47da640 1 -- 172.21.15.1:0/1512497496 shutdown_connections 2024-09-19T09:39:33.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.529+0000 7f14e47da640 1 --2- 172.21.15.1:0/1512497496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14dc101420 0x7f14dc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.529+0000 7f14e47da640 1 --2- 172.21.15.1:0/1512497496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14dc100a80 0x7f14dc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.529+0000 7f14e47da640 1 --2- 172.21.15.1:0/1512497496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14dc106a80 0x7f14dc106e60 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.529+0000 7f14e47da640 1 -- 172.21.15.1:0/1512497496 >> 172.21.15.1:0/1512497496 conn(0x7f14dc0fc7a0 msgr2=0x7f14dc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:33.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.529+0000 7f14e47da640 1 -- 172.21.15.1:0/1512497496 shutdown_connections 2024-09-19T09:39:33.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.529+0000 7f14e47da640 1 -- 172.21.15.1:0/1512497496 wait complete. 2024-09-19T09:39:33.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.530+0000 7f14e47da640 1 Processor -- start 2024-09-19T09:39:33.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.530+0000 7f14e47da640 1 -- start start 2024-09-19T09:39:33.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.530+0000 7f14e47da640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14dc100a80 0x7f14dc1992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:33.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.530+0000 7f14e47da640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14dc101420 0x7f14dc199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:33.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.530+0000 7f14e47da640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14dc106a80 0x7f14dc1a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:33.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.530+0000 7f14e47da640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f14dc110e80 con 0x7f14dc101420 2024-09-19T09:39:33.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.530+0000 7f14e47da640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f14dc110d00 con 0x7f14dc106a80 2024-09-19T09:39:33.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.530+0000 7f14e47da640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f14dc111000 con 0x7f14dc100a80 2024-09-19T09:39:33.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.530+0000 7f14e1d75640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14dc101420 0x7f14dc199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:33.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.530+0000 7f14e1d75640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14dc101420 0x7f14dc199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48844/0 (socket says 172.21.15.1:48844) 2024-09-19T09:39:33.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.530+0000 7f14e1d75640 1 -- 172.21.15.1:0/586371141 learned_addr learned my addr 172.21.15.1:0/586371141 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:33.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.530+0000 7f14e2576640 1 --2- 172.21.15.1:0/586371141 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14dc100a80 0x7f14dc1992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:33.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.530+0000 7f14e2d77640 1 --2- 172.21.15.1:0/586371141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14dc106a80 0x7f14dc1a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:33.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.531+0000 7f14e1d75640 1 -- 172.21.15.1:0/586371141 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14dc100a80 msgr2=0x7f14dc1992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:33.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.531+0000 7f14e1d75640 1 --2- 172.21.15.1:0/586371141 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14dc100a80 0x7f14dc1992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.531+0000 7f14e1d75640 1 -- 172.21.15.1:0/586371141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14dc106a80 msgr2=0x7f14dc1a4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:33.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.531+0000 7f14e1d75640 1 --2- 172.21.15.1:0/586371141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14dc106a80 0x7f14dc1a4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.531+0000 7f14e1d75640 1 -- 172.21.15.1:0/586371141 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14dc1a4890 con 0x7f14dc101420 2024-09-19T09:39:33.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.531+0000 7f14e1d75640 1 --2- 172.21.15.1:0/586371141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14dc101420 0x7f14dc199810 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f14cc00e9f0 tx=0x7f14cc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:33.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.531+0000 7f14d37fe640 1 -- 172.21.15.1:0/586371141 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14cc00cd80 con 0x7f14dc101420 2024-09-19T09:39:33.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.531+0000 7f14e47da640 1 -- 172.21.15.1:0/586371141 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14dc1a4a60 con 0x7f14dc101420 2024-09-19T09:39:33.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.531+0000 7f14d37fe640 1 -- 172.21.15.1:0/586371141 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14cc010910 con 0x7f14dc101420 2024-09-19T09:39:33.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.531+0000 7f14d37fe640 1 -- 172.21.15.1:0/586371141 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14cc0188f0 con 0x7f14dc101420 2024-09-19T09:39:33.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.531+0000 7f14e47da640 1 -- 172.21.15.1:0/586371141 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14dc1a4f70 con 0x7f14dc101420 2024-09-19T09:39:33.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.534+0000 7f14d37fe640 1 -- 172.21.15.1:0/586371141 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f14cc010ac0 con 0x7f14dc101420 2024-09-19T09:39:33.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.534+0000 7f14e6bb3740 1 Processor -- start 2024-09-19T09:39:33.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.534+0000 7f14e6bb3740 1 -- start start 2024-09-19T09:39:33.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.535+0000 7f14e6bb3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d430b5aa00 0x55d430b5ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:33.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.535+0000 7f14e6bb3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d430b5b320 0x55d430b69c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:33.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.535+0000 7f14e6bb3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d430b6a150 0x55d430b6c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:33.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.535+0000 7f14e6bb3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d430ac0280 con 0x55d430b6a150 2024-09-19T09:39:33.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.535+0000 7f14e6bb3740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d430a67b10 con 0x55d430b5aa00 2024-09-19T09:39:33.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.535+0000 7f14e6bb3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d430abc240 con 0x55d430b5b320 2024-09-19T09:39:33.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.535+0000 7f14e1d75640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d430b6a150 0x55d430b6c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:33.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.535+0000 7f14e2d77640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d430b5aa00 0x55d430b5ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:33.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.535+0000 7f14e2576640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d430b5b320 0x55d430b69c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:33.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.535+0000 7f14e1d75640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d430b6a150 0x55d430b6c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48858/0 (socket says 172.21.15.1:48858) 2024-09-19T09:39:33.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.535+0000 7f14e2d77640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d430b5aa00 0x55d430b5ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:53944/0 (socket says 172.21.15.1:53944) 2024-09-19T09:39:33.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.535+0000 7f14e1d75640 1 -- 172.21.15.1:0/1882020159 learned_addr learned my addr 172.21.15.1:0/1882020159 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:33.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.535+0000 7f14d37fe640 1 --2- 172.21.15.1:0/586371141 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f14c80a3240 0x7f14c80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:33.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.535+0000 7f14e2d77640 1 --2- 172.21.15.1:0/586371141 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f14c80a3240 0x7f14c80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:33.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.535+0000 7f14d37fe640 1 -- 172.21.15.1:0/586371141 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f14cc0cfce0 con 0x7f14dc101420 2024-09-19T09:39:33.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.535+0000 7f14e1d75640 1 -- 172.21.15.1:0/1882020159 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d430b5b320 msgr2=0x55d430b69c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:33.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.535+0000 7f14e1d75640 1 --2- 172.21.15.1:0/1882020159 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d430b5b320 0x55d430b69c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.535+0000 7f14e1d75640 1 -- 172.21.15.1:0/1882020159 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d430b5aa00 msgr2=0x55d430b5ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:33.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.535+0000 7f14e1d75640 1 --2- 172.21.15.1:0/1882020159 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d430b5aa00 0x55d430b5ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.535+0000 7f14e1d75640 1 -- 172.21.15.1:0/1882020159 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d430a741f0 con 0x55d430b6a150 2024-09-19T09:39:33.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.535+0000 7f14e2576640 1 --2- 172.21.15.1:0/1882020159 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d430b5b320 0x55d430b69c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:33.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.536+0000 7f14e1d75640 1 --2- 172.21.15.1:0/1882020159 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d430b6a150 0x55d430b6c540 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f14cc098d40 tx=0x7f14cc01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a47854231f0e36 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:33.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.536+0000 7f14d0ff9640 1 -- 172.21.15.1:0/1882020159 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14cc0d3330 con 0x55d430b6a150 2024-09-19T09:39:33.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.536+0000 7f14e2d77640 1 --2- 172.21.15.1:0/586371141 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f14c80a3240 0x7f14c80a5700 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f14d4005fd0 tx=0x7f14d4004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:33.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.536+0000 7f14d0ff9640 1 -- 172.21.15.1:0/1882020159 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14cc0a0670 con 0x55d430b6a150 2024-09-19T09:39:33.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.536+0000 7f14d0ff9640 1 -- 172.21.15.1:0/1882020159 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14cc09baf0 con 0x55d430b6a150 2024-09-19T09:39:33.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.536+0000 7f14e6bb3740 1 -- 172.21.15.1:0/1882020159 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d430b6a150 msgr2=0x55d430b6c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:33.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.536+0000 7f14e6bb3740 1 --2- 172.21.15.1:0/1882020159 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d430b6a150 0x55d430b6c540 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f14cc098d40 tx=0x7f14cc01f000 comp rx=0 tx=0).stop 2024-09-19T09:39:33.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.537+0000 7f14e6bb3740 1 -- 172.21.15.1:0/1882020159 shutdown_connections 2024-09-19T09:39:33.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.537+0000 7f14e6bb3740 1 --2- 172.21.15.1:0/1882020159 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d430b6a150 0x55d430b6c540 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.537+0000 7f14e6bb3740 1 --2- 172.21.15.1:0/1882020159 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d430b5b320 0x55d430b69c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.537+0000 7f14e6bb3740 1 --2- 172.21.15.1:0/1882020159 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d430b5aa00 0x55d430b5ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.537+0000 7f14e6bb3740 1 -- 172.21.15.1:0/1882020159 >> 172.21.15.1:0/1882020159 conn(0x55d430b570f0 msgr2=0x55d430b574d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:33.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.537+0000 7f14e6bb3740 1 -- 172.21.15.1:0/1882020159 shutdown_connections 2024-09-19T09:39:33.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.537+0000 7f14e6bb3740 1 -- 172.21.15.1:0/1882020159 wait complete. 2024-09-19T09:39:33.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.537+0000 7f14e6bb3740 1 -- start start 2024-09-19T09:39:33.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.537+0000 7f14e6bb3740 1 Processor -- start 2024-09-19T09:39:33.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.537+0000 7f14e6bb3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d430b5aa00 0x55d430b670d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:33.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.537+0000 7f14e6bb3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d430b5b320 0x55d430b67610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:33.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.537+0000 7f14e6bb3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d430b6a150 0x55d430b67b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:33.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.537+0000 7f14e6bb3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d430b6cd20 con 0x55d430b5b320 2024-09-19T09:39:33.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.537+0000 7f14e6bb3740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d430a7af10 con 0x55d430b6a150 2024-09-19T09:39:33.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.537+0000 7f14e6bb3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d430b6cea0 con 0x55d430b5aa00 2024-09-19T09:39:33.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.537+0000 7f14e6bb3740 10 client.0 _ll_register_callbacks cb 0x55d430a43a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:33.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.537+0000 7f14e1d75640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d430b5b320 0x55d430b67610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:33.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.537+0000 7f14e1d75640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d430b5b320 0x55d430b67610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48872/0 (socket says 172.21.15.1:48872) 2024-09-19T09:39:33.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.537+0000 7f14e1d75640 1 -- 172.21.15.1:0/86475212 learned_addr learned my addr 172.21.15.1:0/86475212 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:33.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.538+0000 7f14e2d77640 1 --2- 172.21.15.1:0/86475212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d430b6a150 0x55d430b67b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:33.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.538+0000 7f14e2576640 1 --2- 172.21.15.1:0/86475212 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d430b5aa00 0x55d430b670d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:33.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.538+0000 7f14e1d75640 1 -- 172.21.15.1:0/86475212 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d430b5aa00 msgr2=0x55d430b670d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:33.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.538+0000 7f14e1d75640 1 --2- 172.21.15.1:0/86475212 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d430b5aa00 0x55d430b670d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.538+0000 7f14e1d75640 1 -- 172.21.15.1:0/86475212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d430b6a150 msgr2=0x55d430b67b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:33.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.538+0000 7f14e1d75640 1 --2- 172.21.15.1:0/86475212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d430b6a150 0x55d430b67b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.538+0000 7f14e1d75640 1 -- 172.21.15.1:0/86475212 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4308316a0 con 0x55d430b5b320 2024-09-19T09:39:33.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.538+0000 7f14e1d75640 1 --2- 172.21.15.1:0/86475212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d430b5b320 0x55d430b67610 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f14cc09c300 tx=0x7f14cc09a670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df5abd647f28a225 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:33.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.538+0000 7f14c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:39:33.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.538+0000 7f14c5ffb640 1 -- 172.21.15.1:0/86475212 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14cc0d2070 con 0x55d430b5b320 2024-09-19T09:39:33.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.538+0000 7f14c5ffb640 1 -- 172.21.15.1:0/86475212 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f14cc09b830 con 0x55d430b5b320 2024-09-19T09:39:33.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.538+0000 7f14e6bb3740 1 -- 172.21.15.1:0/86475212 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14cc0a0670 con 0x55d430b5b320 2024-09-19T09:39:33.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.538+0000 7f14c5ffb640 1 -- 172.21.15.1:0/86475212 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f14cc09ba30 con 0x55d430b5b320 2024-09-19T09:39:33.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.538+0000 7f14e6bb3740 10 client.15531 fetch_fsmap learned FSMap version 19 2024-09-19T09:39:33.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.538+0000 7f14e6bb3740 1 -- 172.21.15.1:0/86475212 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d430b78a10 con 0x55d430b5b320 2024-09-19T09:39:33.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.538+0000 7f14c5ffb640 1 -- 172.21.15.1:0/86475212 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14cc0a0670 con 0x55d430b5b320 2024-09-19T09:39:33.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.539+0000 7f14c5ffb640 1 -- 172.21.15.1:0/86475212 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f14cc0bc190 con 0x55d430b5b320 2024-09-19T09:39:33.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.539+0000 7f14e6bb3740 10 client.15531 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:39:33.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.539+0000 7f14e6bb3740 10 client.15531 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:33.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.539+0000 7f14e6bb3740 20 client.15531 populate_metadata read hostname 'smithi001' 2024-09-19T09:39:33.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.539+0000 7f14e6bb3740 1 --2- 172.21.15.1:0/86475212 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d430b79d60 0x55d430b7c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:33.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.539+0000 7f14e6bb3740 4 client.15531 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:39:33.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.539+0000 7f14e6bb3740 1 -- 172.21.15.1:0/86475212 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d430acd7f0 con 0x55d430b79d60 2024-09-19T09:39:33.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.539+0000 7f14e2576640 1 --2- 172.21.15.1:0/86475212 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d430b79d60 0x55d430b7c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:33.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.539+0000 7f14e2576640 1 --2- 172.21.15.1:0/86475212 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d430b79d60 0x55d430b7c150 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f97fcd82853ab35 server_cookie=f0079e8c48598276 in_seq=0 out_seq=0 2024-09-19T09:39:33.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.539+0000 7f14c5ffb640 10 client.15531 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:33.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.540+0000 7f14c5ffb640 1 -- 172.21.15.1:0/86475212 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d430acd7f0 con 0x55d430b79d60 2024-09-19T09:39:33.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.540+0000 7f14c5ffb640 10 client.15531 handle_command_reply: tid=0 2024-09-19T09:39:33.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.540+0000 7f14e6bb3740 1 client.15531 shutdown 2024-09-19T09:39:33.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.540+0000 7f14e6bb3740 1 -- 172.21.15.1:0/86475212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d430b5b320 msgr2=0x55d430b67610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:33.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.540+0000 7f14e6bb3740 1 --2- 172.21.15.1:0/86475212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d430b5b320 0x55d430b67610 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f14cc09c300 tx=0x7f14cc09a670 comp rx=0 tx=0).stop 2024-09-19T09:39:33.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.540+0000 7f14e6bb3740 1 -- 172.21.15.1:0/86475212 shutdown_connections 2024-09-19T09:39:33.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.541+0000 7f14e6bb3740 1 --2- 172.21.15.1:0/86475212 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d430b79d60 0x55d430b7c150 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.541+0000 7f14e6bb3740 1 --2- 172.21.15.1:0/86475212 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d430b6a150 0x55d430b67b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.541+0000 7f14e6bb3740 1 --2- 172.21.15.1:0/86475212 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d430b5b320 0x55d430b67610 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.541+0000 7f14c5ffb640 0 client.15531 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:33.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.541+0000 7f14e6bb3740 1 --2- 172.21.15.1:0/86475212 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d430b5aa00 0x55d430b670d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.541+0000 7f14e6bb3740 1 -- 172.21.15.1:0/86475212 >> 172.21.15.1:0/86475212 conn(0x55d430b570f0 msgr2=0x55d430b5ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:33.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.541+0000 7f14e6bb3740 1 -- 172.21.15.1:0/86475212 shutdown_connections 2024-09-19T09:39:33.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.541+0000 7f14e6bb3740 1 -- 172.21.15.1:0/86475212 wait complete. 2024-09-19T09:39:33.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.541+0000 7f14e6bb3740 20 client.15531 trim_cache size 0 max 16384 2024-09-19T09:39:33.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.558+0000 7f14e6bb3740 1 Processor -- start 2024-09-19T09:39:33.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.558+0000 7f14e6bb3740 1 -- start start 2024-09-19T09:39:33.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.558+0000 7f14e6bb3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d430b5aa00 0x55d430b679a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:33.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.558+0000 7f14e6bb3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d430b5b320 0x55d430b7f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:33.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.558+0000 7f14e6bb3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d430b6a150 0x55d430b7f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:33.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.558+0000 7f14e6bb3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f14dc1a93c0 con 0x55d430b5aa00 2024-09-19T09:39:33.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.558+0000 7f14e6bb3740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f14dc1abc60 con 0x55d430b5b320 2024-09-19T09:39:33.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.558+0000 7f14e6bb3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f14dc1a9a50 con 0x55d430b6a150 2024-09-19T09:39:33.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.558+0000 7f14e2576640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d430b5aa00 0x55d430b679a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:33.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.558+0000 7f14e2576640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d430b5aa00 0x55d430b679a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48884/0 (socket says 172.21.15.1:48884) 2024-09-19T09:39:33.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.558+0000 7f14e2576640 1 -- 172.21.15.1:0/1293374897 learned_addr learned my addr 172.21.15.1:0/1293374897 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:33.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.559+0000 7f14e1d75640 1 --2- 172.21.15.1:0/1293374897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d430b5b320 0x55d430b7f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:33.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.559+0000 7f14e2d77640 1 --2- 172.21.15.1:0/1293374897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d430b6a150 0x55d430b7f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:33.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.559+0000 7f14e2576640 1 -- 172.21.15.1:0/1293374897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d430b6a150 msgr2=0x55d430b7f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:33.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.559+0000 7f14e2576640 1 --2- 172.21.15.1:0/1293374897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d430b6a150 0x55d430b7f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.559+0000 7f14e2576640 1 -- 172.21.15.1:0/1293374897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d430b5b320 msgr2=0x55d430b7f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:33.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.559+0000 7f14e2576640 1 --2- 172.21.15.1:0/1293374897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d430b5b320 0x55d430b7f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.559+0000 7f14e2576640 1 -- 172.21.15.1:0/1293374897 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d430b6c8b0 con 0x55d430b5aa00 2024-09-19T09:39:33.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.559+0000 7f14e2d77640 1 --2- 172.21.15.1:0/1293374897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d430b6a150 0x55d430b7f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:33.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.559+0000 7f14e1d75640 1 --2- 172.21.15.1:0/1293374897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d430b5b320 0x55d430b7f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:33.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.559+0000 7f14e2576640 1 --2- 172.21.15.1:0/1293374897 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d430b5aa00 0x55d430b679a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f14d802a940 tx=0x7f14d80058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19221d9d39048376 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:33.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.559+0000 7f14c7fff640 1 -- 172.21.15.1:0/1293374897 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d804a070 con 0x55d430b5aa00 2024-09-19T09:39:33.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.559+0000 7f14c7fff640 1 -- 172.21.15.1:0/1293374897 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14d80035f0 con 0x55d430b5aa00 2024-09-19T09:39:33.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.559+0000 7f14c7fff640 1 -- 172.21.15.1:0/1293374897 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d8035040 con 0x55d430b5aa00 2024-09-19T09:39:33.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.560+0000 7f14e6bb3740 1 -- 172.21.15.1:0/1293374897 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d430b5aa00 msgr2=0x55d430b679a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:33.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.560+0000 7f14e6bb3740 1 --2- 172.21.15.1:0/1293374897 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d430b5aa00 0x55d430b679a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f14d802a940 tx=0x7f14d80058d0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.560+0000 7f14e6bb3740 1 -- 172.21.15.1:0/1293374897 shutdown_connections 2024-09-19T09:39:33.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.560+0000 7f14e6bb3740 1 --2- 172.21.15.1:0/1293374897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d430b6a150 0x55d430b7f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.560+0000 7f14e6bb3740 1 --2- 172.21.15.1:0/1293374897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d430b5b320 0x55d430b7f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.560+0000 7f14e6bb3740 1 --2- 172.21.15.1:0/1293374897 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d430b5aa00 0x55d430b679a0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.560+0000 7f14e6bb3740 1 -- 172.21.15.1:0/1293374897 >> 172.21.15.1:0/1293374897 conn(0x55d430b570f0 msgr2=0x55d430b75950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:33.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.560+0000 7f14e6bb3740 1 -- 172.21.15.1:0/1293374897 shutdown_connections 2024-09-19T09:39:33.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.560+0000 7f14e6bb3740 1 -- 172.21.15.1:0/1293374897 wait complete. 2024-09-19T09:39:33.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.560+0000 7f14e6bb3740 1 -- start start 2024-09-19T09:39:33.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.560+0000 7f14e6bb3740 1 Processor -- start 2024-09-19T09:39:33.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.560+0000 7f14e6bb3740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d430b5aa00 0x55d430b7f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:33.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.560+0000 7f14e6bb3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d430b5b320 0x55d430b7f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:33.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.560+0000 7f14e6bb3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d430b6a150 0x55d430b7d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:33.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.560+0000 7f14e6bb3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f14dc1aa120 con 0x55d430b5b320 2024-09-19T09:39:33.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.560+0000 7f14e6bb3740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f14dc1ab590 con 0x55d430b5aa00 2024-09-19T09:39:33.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.561+0000 7f14e6bb3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f14dc1aa7f0 con 0x55d430b6a150 2024-09-19T09:39:33.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.561+0000 7f14e6bb3740 10 client.0 _ll_register_callbacks cb 0x7f14d4009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:33.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.561+0000 7f14e1d75640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d430b5b320 0x55d430b7f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:33.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.561+0000 7f14e1d75640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d430b5b320 0x55d430b7f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48888/0 (socket says 172.21.15.1:48888) 2024-09-19T09:39:33.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.561+0000 7f14e1d75640 1 -- 172.21.15.1:0/1042101970 learned_addr learned my addr 172.21.15.1:0/1042101970 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:33.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.561+0000 7f14e2576640 1 --2- 172.21.15.1:0/1042101970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d430b5aa00 0x55d430b7f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:33.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.561+0000 7f14e2d77640 1 --2- 172.21.15.1:0/1042101970 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d430b6a150 0x55d430b7d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:33.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.561+0000 7f14e1d75640 1 -- 172.21.15.1:0/1042101970 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d430b6a150 msgr2=0x55d430b7d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:33.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.561+0000 7f14e1d75640 1 --2- 172.21.15.1:0/1042101970 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d430b6a150 0x55d430b7d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.561+0000 7f14e1d75640 1 -- 172.21.15.1:0/1042101970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d430b5aa00 msgr2=0x55d430b7f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:33.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.561+0000 7f14e1d75640 1 --2- 172.21.15.1:0/1042101970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d430b5aa00 0x55d430b7f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.561+0000 7f14e1d75640 1 -- 172.21.15.1:0/1042101970 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d430b7df80 con 0x55d430b5b320 2024-09-19T09:39:33.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.561+0000 7f14e2576640 1 --2- 172.21.15.1:0/1042101970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d430b5aa00 0x55d430b7f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:33.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.561+0000 7f14e2d77640 1 --2- 172.21.15.1:0/1042101970 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d430b6a150 0x55d430b7d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:33.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.561+0000 7f14e1d75640 1 --2- 172.21.15.1:0/1042101970 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d430b5b320 0x55d430b7f8a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f14cc09a620 tx=0x7f14cc0d3300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f90a0de42210fe8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:33.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.561+0000 7f14c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:39:33.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.561+0000 7f14c5ffb640 1 -- 172.21.15.1:0/1042101970 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14cc0d2030 con 0x55d430b5b320 2024-09-19T09:39:33.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.561+0000 7f14c5ffb640 1 -- 172.21.15.1:0/1042101970 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f14cc0bc0b0 con 0x55d430b5b320 2024-09-19T09:39:33.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.561+0000 7f14e6bb3740 1 -- 172.21.15.1:0/1042101970 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14d80035f0 con 0x55d430b5b320 2024-09-19T09:39:33.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.561+0000 7f14c5ffb640 1 -- 172.21.15.1:0/1042101970 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f14cc09bcd0 con 0x55d430b5b320 2024-09-19T09:39:33.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.561+0000 7f14e6bb3740 10 client.15537 fetch_fsmap learned FSMap version 19 2024-09-19T09:39:33.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.561+0000 7f14e6bb3740 1 -- 172.21.15.1:0/1042101970 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d430be5190 con 0x55d430b5b320 2024-09-19T09:39:33.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.562+0000 7f14c5ffb640 1 -- 172.21.15.1:0/1042101970 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14d80035f0 con 0x55d430b5b320 2024-09-19T09:39:33.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.562+0000 7f14c5ffb640 1 -- 172.21.15.1:0/1042101970 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f14cc09b230 con 0x55d430b5b320 2024-09-19T09:39:33.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.562+0000 7f14e6bb3740 10 client.15537 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:39:33.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.562+0000 7f14e6bb3740 10 client.15537 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:33.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.562+0000 7f14e6bb3740 20 client.15537 populate_metadata read hostname 'smithi001' 2024-09-19T09:39:33.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.562+0000 7f14e6bb3740 1 --2- 172.21.15.1:0/1042101970 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d430be56a0 0x55d430be7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:33.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.562+0000 7f14e6bb3740 4 client.15537 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:39:33.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.562+0000 7f14e6bb3740 1 -- 172.21.15.1:0/1042101970 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d430ac7d00 con 0x55d430be56a0 2024-09-19T09:39:33.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.562+0000 7f14e2576640 1 --2- 172.21.15.1:0/1042101970 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d430be56a0 0x55d430be7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:33.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.562+0000 7f14e2576640 1 --2- 172.21.15.1:0/1042101970 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d430be56a0 0x55d430be7ac0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38c0e9d99f6ee488 server_cookie=b80c2b666dbcc91b in_seq=0 out_seq=0 2024-09-19T09:39:33.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.562+0000 7f14c5ffb640 10 client.15537 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:33.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.564+0000 7f14c5ffb640 1 -- 172.21.15.1:0/1042101970 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d430ac7d00 con 0x55d430be56a0 2024-09-19T09:39:33.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.564+0000 7f14c5ffb640 10 client.15537 handle_command_reply: tid=0 2024-09-19T09:39:33.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.564+0000 7f14e6bb3740 1 client.15537 shutdown 2024-09-19T09:39:33.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.564+0000 7f14e6bb3740 1 -- 172.21.15.1:0/1042101970 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d430b5b320 msgr2=0x55d430b7f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:33.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.564+0000 7f14e6bb3740 1 --2- 172.21.15.1:0/1042101970 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d430b5b320 0x55d430b7f8a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f14cc09a620 tx=0x7f14cc0d3300 comp rx=0 tx=0).stop 2024-09-19T09:39:33.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.564+0000 7f14e6bb3740 1 -- 172.21.15.1:0/1042101970 shutdown_connections 2024-09-19T09:39:33.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.564+0000 7f14e6bb3740 1 --2- 172.21.15.1:0/1042101970 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d430be56a0 0x55d430be7ac0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.564+0000 7f14e6bb3740 1 --2- 172.21.15.1:0/1042101970 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d430b6a150 0x55d430b7d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.564+0000 7f14e6bb3740 1 --2- 172.21.15.1:0/1042101970 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d430b5b320 0x55d430b7f8a0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.564+0000 7f14e6bb3740 1 --2- 172.21.15.1:0/1042101970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d430b5aa00 0x55d430b7f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.564+0000 7f14e6bb3740 1 -- 172.21.15.1:0/1042101970 >> 172.21.15.1:0/1042101970 conn(0x55d430b570f0 msgr2=0x55d430b55a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:33.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.564+0000 7f14c5ffb640 0 client.15537 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:33.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.564+0000 7f14e6bb3740 1 -- 172.21.15.1:0/1042101970 shutdown_connections 2024-09-19T09:39:33.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.564+0000 7f14e6bb3740 1 -- 172.21.15.1:0/1042101970 wait complete. 2024-09-19T09:39:33.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.564+0000 7f14e6bb3740 20 client.15537 trim_cache size 0 max 16384 2024-09-19T09:39:33.571 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:39:33.571 INFO:teuthology.orchestra.run.smithi001.stdout: "return_code": 0, 2024-09-19T09:39:33.571 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_tag": "60ee9271-ccb5-44e1-93df-35a592a08107", 2024-09-19T09:39:33.571 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": "asynchronous" 2024-09-19T09:39:33.571 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:39:33.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.565+0000 7f14e47da640 1 -- 172.21.15.1:0/586371141 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f14c80a3240 msgr2=0x7f14c80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:33.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.565+0000 7f14e47da640 1 --2- 172.21.15.1:0/586371141 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f14c80a3240 0x7f14c80a5700 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f14d4005fd0 tx=0x7f14d4004ab0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.565+0000 7f14e47da640 1 -- 172.21.15.1:0/586371141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14dc101420 msgr2=0x7f14dc199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:33.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.565+0000 7f14e47da640 1 --2- 172.21.15.1:0/586371141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14dc101420 0x7f14dc199810 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f14cc00e9f0 tx=0x7f14cc00eeb0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.565+0000 7f14e47da640 1 -- 172.21.15.1:0/586371141 shutdown_connections 2024-09-19T09:39:33.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.565+0000 7f14e47da640 1 --2- 172.21.15.1:0/586371141 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f14c80a3240 0x7f14c80a5700 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.565+0000 7f14e47da640 1 --2- 172.21.15.1:0/586371141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14dc106a80 0x7f14dc1a4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.565+0000 7f14e47da640 1 --2- 172.21.15.1:0/586371141 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14dc101420 0x7f14dc199810 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.565+0000 7f14e47da640 1 --2- 172.21.15.1:0/586371141 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14dc100a80 0x7f14dc1992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:33.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.565+0000 7f14e47da640 1 -- 172.21.15.1:0/586371141 >> 172.21.15.1:0/586371141 conn(0x7f14dc0fc7a0 msgr2=0x7f14dc0fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:33.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.565+0000 7f14e47da640 1 -- 172.21.15.1:0/586371141 shutdown_connections 2024-09-19T09:39:33.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:33.565+0000 7f14e47da640 1 -- 172.21.15.1:0/586371141 wait complete. 2024-09-19T09:39:34.253 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:39:34.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:34 smithi022 ceph-mon[35583]: pgmap v382: 97 pgs: 97 active+clean; 665 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 853 B/s wr, 3 op/s 2024-09-19T09:39:34.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:34 smithi121 ceph-mon[35577]: pgmap v382: 97 pgs: 97 active+clean; 665 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 853 B/s wr, 3 op/s 2024-09-19T09:39:34.424 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:34 smithi001 ceph-mon[31225]: pgmap v382: 97 pgs: 97 active+clean; 665 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 853 B/s wr, 3 op/s 2024-09-19T09:39:34.541 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:35.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.036+0000 7f77221c7640 1 -- 172.21.15.1:0/1964777790 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f771c101de0 msgr2=0x7f771c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:35.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.036+0000 7f77221c7640 1 --2- 172.21.15.1:0/1964777790 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f771c101de0 0x7f771c1021c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f770c009ca0 tx=0x7f770c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.036+0000 7f77221c7640 1 -- 172.21.15.1:0/1964777790 shutdown_connections 2024-09-19T09:39:35.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.036+0000 7f77221c7640 1 --2- 172.21.15.1:0/1964777790 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f771c106f10 0x7f771c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.036+0000 7f77221c7640 1 --2- 172.21.15.1:0/1964777790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f771c102790 0x7f771c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.036+0000 7f77221c7640 1 --2- 172.21.15.1:0/1964777790 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f771c101de0 0x7f771c1021c0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.036+0000 7f77221c7640 1 -- 172.21.15.1:0/1964777790 >> 172.21.15.1:0/1964777790 conn(0x7f771c0fd8c0 msgr2=0x7f771c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:35.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.036+0000 7f77221c7640 1 -- 172.21.15.1:0/1964777790 shutdown_connections 2024-09-19T09:39:35.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.037+0000 7f77221c7640 1 -- 172.21.15.1:0/1964777790 wait complete. 2024-09-19T09:39:35.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.037+0000 7f77221c7640 1 Processor -- start 2024-09-19T09:39:35.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.037+0000 7f77221c7640 1 -- start start 2024-09-19T09:39:35.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.038+0000 7f77221c7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f771c101de0 0x7f771c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:35.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.038+0000 7f77221c7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f771c102790 0x7f771c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:35.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.038+0000 7f77221c7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f771c106f10 0x7f771c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:35.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.038+0000 7f77221c7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f771c111f70 con 0x7f771c101de0 2024-09-19T09:39:35.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.038+0000 7f77221c7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f771c111df0 con 0x7f771c102790 2024-09-19T09:39:35.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.038+0000 7f77221c7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f771c1120f0 con 0x7f771c106f10 2024-09-19T09:39:35.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.038+0000 7f771b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f771c101de0 0x7f771c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:35.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.038+0000 7f771b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f771c101de0 0x7f771c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48906/0 (socket says 172.21.15.1:48906) 2024-09-19T09:39:35.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.038+0000 7f771b7fe640 1 -- 172.21.15.1:0/1643593971 learned_addr learned my addr 172.21.15.1:0/1643593971 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:35.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.038+0000 7f771bfff640 1 --2- 172.21.15.1:0/1643593971 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f771c106f10 0x7f771c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:35.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.038+0000 7f771affd640 1 --2- 172.21.15.1:0/1643593971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f771c102790 0x7f771c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:35.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.038+0000 7f771b7fe640 1 -- 172.21.15.1:0/1643593971 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f771c106f10 msgr2=0x7f771c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:35.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.038+0000 7f771b7fe640 1 --2- 172.21.15.1:0/1643593971 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f771c106f10 0x7f771c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.038+0000 7f771b7fe640 1 -- 172.21.15.1:0/1643593971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f771c102790 msgr2=0x7f771c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:35.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.038+0000 7f771b7fe640 1 --2- 172.21.15.1:0/1643593971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f771c102790 0x7f771c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.038+0000 7f771b7fe640 1 -- 172.21.15.1:0/1643593971 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f771c1a6990 con 0x7f771c101de0 2024-09-19T09:39:35.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.038+0000 7f771affd640 1 --2- 172.21.15.1:0/1643593971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f771c102790 0x7f771c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:35.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.038+0000 7f771b7fe640 1 --2- 172.21.15.1:0/1643593971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f771c101de0 0x7f771c0744f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f770c02ade0 tx=0x7f770c0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:35.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.038+0000 7f7718ff9640 1 -- 172.21.15.1:0/1643593971 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c02fa20 con 0x7f771c101de0 2024-09-19T09:39:35.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.038+0000 7f7718ff9640 1 -- 172.21.15.1:0/1643593971 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f770c02fbc0 con 0x7f771c101de0 2024-09-19T09:39:35.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.038+0000 7f7718ff9640 1 -- 172.21.15.1:0/1643593971 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c0467b0 con 0x7f771c101de0 2024-09-19T09:39:35.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.038+0000 7f77221c7640 1 -- 172.21.15.1:0/1643593971 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f771c1a6c20 con 0x7f771c101de0 2024-09-19T09:39:35.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.039+0000 7f77221c7640 1 -- 172.21.15.1:0/1643593971 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f771c1a71b0 con 0x7f771c101de0 2024-09-19T09:39:35.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.041+0000 7f7718ff9640 1 -- 172.21.15.1:0/1643593971 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f770c046950 con 0x7f771c101de0 2024-09-19T09:39:35.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.041+0000 7f77245a0740 1 Processor -- start 2024-09-19T09:39:35.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.041+0000 7f77245a0740 1 -- start start 2024-09-19T09:39:35.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.041+0000 7f77245a0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d38b09e4a0 0x55d38b09e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:35.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.041+0000 7f77245a0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d38b09edc0 0x55d38b0a9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:35.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.041+0000 7f77245a0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d38b0a9680 0x55d38b0aba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:35.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.041+0000 7f77245a0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d38b0042e0 con 0x55d38b0a9680 2024-09-19T09:39:35.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.041+0000 7f77245a0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d38afabce0 con 0x55d38b09edc0 2024-09-19T09:39:35.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.041+0000 7f77245a0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d38b0002a0 con 0x55d38b09e4a0 2024-09-19T09:39:35.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.041+0000 7f771affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d38b0a9680 0x55d38b0aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:35.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.041+0000 7f771affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d38b0a9680 0x55d38b0aba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48916/0 (socket says 172.21.15.1:48916) 2024-09-19T09:39:35.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.041+0000 7f771affd640 1 -- 172.21.15.1:0/1894074892 learned_addr learned my addr 172.21.15.1:0/1894074892 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:35.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.041+0000 7f771bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d38b09e4a0 0x55d38b09e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:35.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.042+0000 7f7718ff9640 1 --2- 172.21.15.1:0/1643593971 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f77080a32c0 0x7f77080a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:35.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.042+0000 7f771b7fe640 1 --2- 172.21.15.1:0/1894074892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d38b09edc0 0x55d38b0a9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:35.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.042+0000 7f771bfff640 1 --2- 172.21.15.1:0/1643593971 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f77080a32c0 0x7f77080a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:35.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.042+0000 7f771affd640 1 -- 172.21.15.1:0/1894074892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d38b09e4a0 msgr2=0x55d38b09e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:35.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.042+0000 7f771affd640 1 --2- 172.21.15.1:0/1894074892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d38b09e4a0 0x55d38b09e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.042+0000 7f771affd640 1 -- 172.21.15.1:0/1894074892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d38b09edc0 msgr2=0x55d38b0a9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:35.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.042+0000 7f771affd640 1 --2- 172.21.15.1:0/1894074892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d38b09edc0 0x55d38b0a9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.042+0000 7f771affd640 1 -- 172.21.15.1:0/1894074892 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d38af90440 con 0x55d38b0a9680 2024-09-19T09:39:35.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.042+0000 7f7718ff9640 1 -- 172.21.15.1:0/1643593971 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f770c0f0db0 con 0x7f771c101de0 2024-09-19T09:39:35.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.042+0000 7f771bfff640 1 --2- 172.21.15.1:0/1894074892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d38b09e4a0 0x55d38b09e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:35.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.042+0000 7f771affd640 1 --2- 172.21.15.1:0/1894074892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d38b0a9680 0x55d38b0aba70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f770400bb40 tx=0x7f770400d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d60b8f85cb718e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:35.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.042+0000 7f771bfff640 1 --2- 172.21.15.1:0/1643593971 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f77080a32c0 0x7f77080a5780 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f771400bd30 tx=0x7f7714004730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:35.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.042+0000 7f7711ffb640 1 -- 172.21.15.1:0/1894074892 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7704017420 con 0x55d38b0a9680 2024-09-19T09:39:35.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.042+0000 7f7711ffb640 1 -- 172.21.15.1:0/1894074892 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7704017aa0 con 0x55d38b0a9680 2024-09-19T09:39:35.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.042+0000 7f7711ffb640 1 -- 172.21.15.1:0/1894074892 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770400fbd0 con 0x55d38b0a9680 2024-09-19T09:39:35.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.043+0000 7f77245a0740 1 -- 172.21.15.1:0/1894074892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d38b0a9680 msgr2=0x55d38b0aba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:35.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.043+0000 7f77245a0740 1 --2- 172.21.15.1:0/1894074892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d38b0a9680 0x55d38b0aba70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f770400bb40 tx=0x7f770400d340 comp rx=0 tx=0).stop 2024-09-19T09:39:35.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.043+0000 7f77245a0740 1 -- 172.21.15.1:0/1894074892 shutdown_connections 2024-09-19T09:39:35.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.043+0000 7f77245a0740 1 --2- 172.21.15.1:0/1894074892 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d38b0a9680 0x55d38b0aba70 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.043+0000 7f77245a0740 1 --2- 172.21.15.1:0/1894074892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d38b09edc0 0x55d38b0a9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.043+0000 7f77245a0740 1 --2- 172.21.15.1:0/1894074892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d38b09e4a0 0x55d38b09e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.043+0000 7f77245a0740 1 -- 172.21.15.1:0/1894074892 >> 172.21.15.1:0/1894074892 conn(0x55d38b09aa30 msgr2=0x55d38b09ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:35.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.043+0000 7f77245a0740 1 -- 172.21.15.1:0/1894074892 shutdown_connections 2024-09-19T09:39:35.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.043+0000 7f77245a0740 1 -- 172.21.15.1:0/1894074892 wait complete. 2024-09-19T09:39:35.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.043+0000 7f77245a0740 1 -- start start 2024-09-19T09:39:35.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.044+0000 7f77245a0740 1 Processor -- start 2024-09-19T09:39:35.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.044+0000 7f77245a0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d38b09e4a0 0x55d38b0a8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:35.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.044+0000 7f77245a0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d38b09edc0 0x55d38b0a6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:35.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.044+0000 7f77245a0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d38b0a9680 0x55d38b0a67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:35.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.044+0000 7f77245a0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d38b0ac250 con 0x55d38b09edc0 2024-09-19T09:39:35.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.044+0000 7f77245a0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d38afbf050 con 0x55d38b09e4a0 2024-09-19T09:39:35.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.044+0000 7f77245a0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d38b0ac3d0 con 0x55d38b0a9680 2024-09-19T09:39:35.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.044+0000 7f77245a0740 10 client.0 _ll_register_callbacks cb 0x55d38afff160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:35.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.044+0000 7f771affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d38b09edc0 0x55d38b0a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:35.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.044+0000 7f771affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d38b09edc0 0x55d38b0a6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48920/0 (socket says 172.21.15.1:48920) 2024-09-19T09:39:35.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.044+0000 7f771affd640 1 -- 172.21.15.1:0/1641465210 learned_addr learned my addr 172.21.15.1:0/1641465210 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:35.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.044+0000 7f771bfff640 1 --2- 172.21.15.1:0/1641465210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d38b0a9680 0x55d38b0a67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:35.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.044+0000 7f771b7fe640 1 --2- 172.21.15.1:0/1641465210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d38b09e4a0 0x55d38b0a8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:35.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.044+0000 7f771affd640 1 -- 172.21.15.1:0/1641465210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d38b0a9680 msgr2=0x55d38b0a67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:35.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.044+0000 7f771affd640 1 --2- 172.21.15.1:0/1641465210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d38b0a9680 0x55d38b0a67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.044+0000 7f771affd640 1 -- 172.21.15.1:0/1641465210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d38b09e4a0 msgr2=0x55d38b0a8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:35.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.044+0000 7f771affd640 1 --2- 172.21.15.1:0/1641465210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d38b09e4a0 0x55d38b0a8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.044+0000 7f771affd640 1 -- 172.21.15.1:0/1641465210 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d38ad753c0 con 0x55d38b09edc0 2024-09-19T09:39:35.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.045+0000 7f771affd640 1 --2- 172.21.15.1:0/1641465210 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d38b09edc0 0x55d38b0a6270 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f770400b310 tx=0x7f7704004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb3601eb40c77ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:35.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.045+0000 7f76faffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:39:35.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.045+0000 7f76faffd640 1 -- 172.21.15.1:0/1641465210 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7704026070 con 0x55d38b09edc0 2024-09-19T09:39:35.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.045+0000 7f76faffd640 1 -- 172.21.15.1:0/1641465210 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f770400fbc0 con 0x55d38b09edc0 2024-09-19T09:39:35.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.045+0000 7f77245a0740 1 -- 172.21.15.1:0/1641465210 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7704017aa0 con 0x55d38b09edc0 2024-09-19T09:39:35.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.045+0000 7f76faffd640 1 -- 172.21.15.1:0/1641465210 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7704032050 con 0x55d38b09edc0 2024-09-19T09:39:35.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.045+0000 7f77245a0740 10 client.15549 fetch_fsmap learned FSMap version 19 2024-09-19T09:39:35.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.045+0000 7f77245a0740 1 -- 172.21.15.1:0/1641465210 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d38b0b7c00 con 0x55d38b09edc0 2024-09-19T09:39:35.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.045+0000 7f76faffd640 1 -- 172.21.15.1:0/1641465210 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7704017aa0 con 0x55d38b09edc0 2024-09-19T09:39:35.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.045+0000 7f76faffd640 1 -- 172.21.15.1:0/1641465210 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f77040227e0 con 0x55d38b09edc0 2024-09-19T09:39:35.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.045+0000 7f77245a0740 10 client.15549 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:39:35.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.045+0000 7f77245a0740 10 client.15549 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:35.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.045+0000 7f77245a0740 20 client.15549 populate_metadata read hostname 'smithi001' 2024-09-19T09:39:35.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.045+0000 7f77245a0740 1 --2- 172.21.15.1:0/1641465210 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d38b0b8fb0 0x55d38b0bb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:35.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.045+0000 7f77245a0740 4 client.15549 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:39:35.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.046+0000 7f77245a0740 1 -- 172.21.15.1:0/1641465210 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d38b011850 con 0x55d38b0b8fb0 2024-09-19T09:39:35.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.046+0000 7f771b7fe640 1 --2- 172.21.15.1:0/1641465210 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d38b0b8fb0 0x55d38b0bb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:35.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.046+0000 7f771b7fe640 1 --2- 172.21.15.1:0/1641465210 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d38b0b8fb0 0x55d38b0bb3a0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9d91e3fd34150eb server_cookie=73af15c288c090a1 in_seq=0 out_seq=0 2024-09-19T09:39:35.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.046+0000 7f76faffd640 10 client.15549 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:35.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.047+0000 7f76faffd640 1 -- 172.21.15.1:0/1641465210 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d38b011850 con 0x55d38b0b8fb0 2024-09-19T09:39:35.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.047+0000 7f76faffd640 10 client.15549 handle_command_reply: tid=0 2024-09-19T09:39:35.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.047+0000 7f77245a0740 1 client.15549 shutdown 2024-09-19T09:39:35.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.047+0000 7f77245a0740 1 -- 172.21.15.1:0/1641465210 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d38b09edc0 msgr2=0x55d38b0a6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:35.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.047+0000 7f77245a0740 1 --2- 172.21.15.1:0/1641465210 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d38b09edc0 0x55d38b0a6270 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f770400b310 tx=0x7f7704004730 comp rx=0 tx=0).stop 2024-09-19T09:39:35.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.047+0000 7f77245a0740 1 -- 172.21.15.1:0/1641465210 shutdown_connections 2024-09-19T09:39:35.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.047+0000 7f77245a0740 1 --2- 172.21.15.1:0/1641465210 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d38b0b8fb0 0x55d38b0bb3a0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.047+0000 7f77245a0740 1 --2- 172.21.15.1:0/1641465210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d38b0a9680 0x55d38b0a67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.047+0000 7f77245a0740 1 --2- 172.21.15.1:0/1641465210 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d38b09edc0 0x55d38b0a6270 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.047+0000 7f76faffd640 0 client.15549 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:35.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.047+0000 7f77245a0740 1 --2- 172.21.15.1:0/1641465210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d38b09e4a0 0x55d38b0a8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.047+0000 7f77245a0740 1 -- 172.21.15.1:0/1641465210 >> 172.21.15.1:0/1641465210 conn(0x55d38b09aa30 msgr2=0x55d38b0a0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:35.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.047+0000 7f77245a0740 1 -- 172.21.15.1:0/1641465210 shutdown_connections 2024-09-19T09:39:35.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.047+0000 7f77245a0740 1 -- 172.21.15.1:0/1641465210 wait complete. 2024-09-19T09:39:35.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.047+0000 7f77245a0740 20 client.15549 trim_cache size 0 max 16384 2024-09-19T09:39:35.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.064+0000 7f77245a0740 1 Processor -- start 2024-09-19T09:39:35.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.064+0000 7f77245a0740 1 -- start start 2024-09-19T09:39:35.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.064+0000 7f77245a0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d38b09e4a0 0x55d38b0b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:35.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.064+0000 7f77245a0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d38b09edc0 0x55d38b0c0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:35.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.064+0000 7f77245a0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d38b0a9680 0x55d38b0c0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:35.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.064+0000 7f77245a0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f771c1ad7b0 con 0x55d38b0a9680 2024-09-19T09:39:35.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.064+0000 7f77245a0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f771c1b0050 con 0x55d38b09edc0 2024-09-19T09:39:35.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.064+0000 7f77245a0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f771c1ade40 con 0x55d38b09e4a0 2024-09-19T09:39:35.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.065+0000 7f771bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d38b0a9680 0x55d38b0c0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:35.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.065+0000 7f771affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d38b09edc0 0x55d38b0c0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:35.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.065+0000 7f771bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d38b0a9680 0x55d38b0c0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48932/0 (socket says 172.21.15.1:48932) 2024-09-19T09:39:35.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.065+0000 7f771bfff640 1 -- 172.21.15.1:0/3306927345 learned_addr learned my addr 172.21.15.1:0/3306927345 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:35.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.065+0000 7f771b7fe640 1 --2- 172.21.15.1:0/3306927345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d38b09e4a0 0x55d38b0b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:35.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.065+0000 7f771bfff640 1 -- 172.21.15.1:0/3306927345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d38b09e4a0 msgr2=0x55d38b0b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:35.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.065+0000 7f771bfff640 1 --2- 172.21.15.1:0/3306927345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d38b09e4a0 0x55d38b0b54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.065+0000 7f771bfff640 1 -- 172.21.15.1:0/3306927345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d38b09edc0 msgr2=0x55d38b0c0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:35.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.065+0000 7f771bfff640 1 --2- 172.21.15.1:0/3306927345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d38b09edc0 0x55d38b0c0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.065+0000 7f771bfff640 1 -- 172.21.15.1:0/3306927345 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d38b09ebb0 con 0x55d38b0a9680 2024-09-19T09:39:35.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.065+0000 7f771b7fe640 1 --2- 172.21.15.1:0/3306927345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d38b09e4a0 0x55d38b0b54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:35.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.065+0000 7f771bfff640 1 --2- 172.21.15.1:0/3306927345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d38b0a9680 0x55d38b0c0f70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f771400b870 tx=0x7f7714004130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa323b56e720631 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:35.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.065+0000 7f77117fa640 1 -- 172.21.15.1:0/3306927345 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7714021680 con 0x55d38b0a9680 2024-09-19T09:39:35.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.065+0000 7f77117fa640 1 -- 172.21.15.1:0/3306927345 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7714021d00 con 0x55d38b0a9680 2024-09-19T09:39:35.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.065+0000 7f77117fa640 1 -- 172.21.15.1:0/3306927345 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7714010ca0 con 0x55d38b0a9680 2024-09-19T09:39:35.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.066+0000 7f77245a0740 1 -- 172.21.15.1:0/3306927345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d38b0a9680 msgr2=0x55d38b0c0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:35.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.066+0000 7f77245a0740 1 --2- 172.21.15.1:0/3306927345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d38b0a9680 0x55d38b0c0f70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f771400b870 tx=0x7f7714004130 comp rx=0 tx=0).stop 2024-09-19T09:39:35.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.066+0000 7f77245a0740 1 -- 172.21.15.1:0/3306927345 shutdown_connections 2024-09-19T09:39:35.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.066+0000 7f77245a0740 1 --2- 172.21.15.1:0/3306927345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d38b0a9680 0x55d38b0c0f70 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.066+0000 7f77245a0740 1 --2- 172.21.15.1:0/3306927345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d38b09edc0 0x55d38b0c0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.066+0000 7f77245a0740 1 --2- 172.21.15.1:0/3306927345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d38b09e4a0 0x55d38b0b54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.066+0000 7f77245a0740 1 -- 172.21.15.1:0/3306927345 >> 172.21.15.1:0/3306927345 conn(0x55d38b09aa30 msgr2=0x55d38b0a1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:35.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.066+0000 7f77245a0740 1 -- 172.21.15.1:0/3306927345 shutdown_connections 2024-09-19T09:39:35.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.066+0000 7f77245a0740 1 -- 172.21.15.1:0/3306927345 wait complete. 2024-09-19T09:39:35.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.066+0000 7f77245a0740 1 -- start start 2024-09-19T09:39:35.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.067+0000 7f77245a0740 1 Processor -- start 2024-09-19T09:39:35.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.067+0000 7f77245a0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d38b09e4a0 0x55d38b0ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:35.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.067+0000 7f77245a0740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d38b09edc0 0x55d38b0ad7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:35.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.067+0000 7f77245a0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d38b0a9680 0x55d38b0add30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:35.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.067+0000 7f77245a0740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f771c1ae510 con 0x55d38b09edc0 2024-09-19T09:39:35.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.067+0000 7f77245a0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f771c1af980 con 0x55d38b09e4a0 2024-09-19T09:39:35.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.067+0000 7f77245a0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f771c1aebe0 con 0x55d38b0a9680 2024-09-19T09:39:35.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.067+0000 7f77245a0740 10 client.0 _ll_register_callbacks cb 0x7f770c0bd230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:35.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.067+0000 7f771affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d38b09edc0 0x55d38b0ad7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:35.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.067+0000 7f771affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d38b09edc0 0x55d38b0ad7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48948/0 (socket says 172.21.15.1:48948) 2024-09-19T09:39:35.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.067+0000 7f771affd640 1 -- 172.21.15.1:0/1037406753 learned_addr learned my addr 172.21.15.1:0/1037406753 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:35.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.067+0000 7f771b7fe640 1 --2- 172.21.15.1:0/1037406753 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d38b09e4a0 0x55d38b0ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:35.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.067+0000 7f771bfff640 1 --2- 172.21.15.1:0/1037406753 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d38b0a9680 0x55d38b0add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:35.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.067+0000 7f771affd640 1 -- 172.21.15.1:0/1037406753 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d38b0a9680 msgr2=0x55d38b0add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:35.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.067+0000 7f771affd640 1 --2- 172.21.15.1:0/1037406753 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d38b0a9680 0x55d38b0add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.067+0000 7f771affd640 1 -- 172.21.15.1:0/1037406753 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d38b09e4a0 msgr2=0x55d38b0ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:35.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.067+0000 7f771affd640 1 --2- 172.21.15.1:0/1037406753 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d38b09e4a0 0x55d38b0ad2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.067+0000 7f771affd640 1 -- 172.21.15.1:0/1037406753 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d38b122a00 con 0x55d38b09edc0 2024-09-19T09:39:35.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.067+0000 7f771b7fe640 1 --2- 172.21.15.1:0/1037406753 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d38b09e4a0 0x55d38b0ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:35.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.068+0000 7f771affd640 1 --2- 172.21.15.1:0/1037406753 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d38b09edc0 0x55d38b0ad7f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x55d38b0a78b0 tx=0x7f7704022ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200a501109f47c14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:35.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.068+0000 7f76faffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:39:35.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.068+0000 7f76faffd640 1 -- 172.21.15.1:0/1037406753 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770403b060 con 0x55d38b09edc0 2024-09-19T09:39:35.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.068+0000 7f76faffd640 1 -- 172.21.15.1:0/1037406753 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f770400f420 con 0x55d38b09edc0 2024-09-19T09:39:35.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.068+0000 7f77245a0740 1 -- 172.21.15.1:0/1037406753 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7714021d00 con 0x55d38b09edc0 2024-09-19T09:39:35.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.068+0000 7f76faffd640 1 -- 172.21.15.1:0/1037406753 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7704026040 con 0x55d38b09edc0 2024-09-19T09:39:35.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.068+0000 7f77245a0740 10 client.15555 fetch_fsmap learned FSMap version 19 2024-09-19T09:39:35.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.068+0000 7f77245a0740 1 -- 172.21.15.1:0/1037406753 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d38b123c30 con 0x55d38b09edc0 2024-09-19T09:39:35.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.068+0000 7f76faffd640 1 -- 172.21.15.1:0/1037406753 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7714021d00 con 0x55d38b09edc0 2024-09-19T09:39:35.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.068+0000 7f76faffd640 1 -- 172.21.15.1:0/1037406753 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f7704040070 con 0x55d38b09edc0 2024-09-19T09:39:35.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.068+0000 7f77245a0740 10 client.15555 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:39:35.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.068+0000 7f77245a0740 10 client.15555 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:35.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.068+0000 7f77245a0740 20 client.15555 populate_metadata read hostname 'smithi001' 2024-09-19T09:39:35.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.068+0000 7f77245a0740 1 --2- 172.21.15.1:0/1037406753 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d38b1242f0 0x55d38b126710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:35.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.069+0000 7f77245a0740 4 client.15555 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:39:35.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.069+0000 7f77245a0740 1 -- 172.21.15.1:0/1037406753 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d38b00bd60 con 0x55d38b1242f0 2024-09-19T09:39:35.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.069+0000 7f771b7fe640 1 --2- 172.21.15.1:0/1037406753 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d38b1242f0 0x55d38b126710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:35.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.069+0000 7f771b7fe640 1 --2- 172.21.15.1:0/1037406753 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d38b1242f0 0x55d38b126710 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bbcb520153e6830 server_cookie=b94620d471150629 in_seq=0 out_seq=0 2024-09-19T09:39:35.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.069+0000 7f76faffd640 10 client.15555 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:35.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.069+0000 7f76faffd640 1 -- 172.21.15.1:0/1037406753 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d38b00bd60 con 0x55d38b1242f0 2024-09-19T09:39:35.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.069+0000 7f76faffd640 10 client.15555 handle_command_reply: tid=0 2024-09-19T09:39:35.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.069+0000 7f77245a0740 1 client.15555 shutdown 2024-09-19T09:39:35.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.070+0000 7f77245a0740 1 -- 172.21.15.1:0/1037406753 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d38b09edc0 msgr2=0x55d38b0ad7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:35.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.070+0000 7f77245a0740 1 --2- 172.21.15.1:0/1037406753 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d38b09edc0 0x55d38b0ad7f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x55d38b0a78b0 tx=0x7f7704022ea0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.070+0000 7f77245a0740 1 -- 172.21.15.1:0/1037406753 shutdown_connections 2024-09-19T09:39:35.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.070+0000 7f77245a0740 1 --2- 172.21.15.1:0/1037406753 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d38b1242f0 0x55d38b126710 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.070+0000 7f77245a0740 1 --2- 172.21.15.1:0/1037406753 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d38b0a9680 0x55d38b0add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.070+0000 7f77245a0740 1 --2- 172.21.15.1:0/1037406753 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d38b09edc0 0x55d38b0ad7f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.070+0000 7f77245a0740 1 --2- 172.21.15.1:0/1037406753 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d38b09e4a0 0x55d38b0ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.070+0000 7f77245a0740 1 -- 172.21.15.1:0/1037406753 >> 172.21.15.1:0/1037406753 conn(0x55d38b09aa30 msgr2=0x55d38b099350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:35.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.070+0000 7f76faffd640 0 client.15555 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:35.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.070+0000 7f77245a0740 1 -- 172.21.15.1:0/1037406753 shutdown_connections 2024-09-19T09:39:35.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.070+0000 7f77245a0740 1 -- 172.21.15.1:0/1037406753 wait complete. 2024-09-19T09:39:35.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.070+0000 7f77245a0740 20 client.15555 trim_cache size 0 max 16384 2024-09-19T09:39:35.078 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:39:35.078 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:39:35.078 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": { 2024-09-19T09:39:35.078 INFO:teuthology.orchestra.run.smithi001.stdout: "60ee9271-ccb5-44e1-93df-35a592a08107": { 2024-09-19T09:39:35.078 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-19T09:39:35.078 INFO:teuthology.orchestra.run.smithi001.stdout: "tag": "60ee9271-ccb5-44e1-93df-35a592a08107", 2024-09-19T09:39:35.078 INFO:teuthology.orchestra.run.smithi001.stdout: "options": "recursive,force" 2024-09-19T09:39:35.079 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:39:35.079 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:39:35.079 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:39:35.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.070+0000 7f77221c7640 1 -- 172.21.15.1:0/1643593971 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f77080a32c0 msgr2=0x7f77080a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:35.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.070+0000 7f77221c7640 1 --2- 172.21.15.1:0/1643593971 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f77080a32c0 0x7f77080a5780 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f771400bd30 tx=0x7f7714004730 comp rx=0 tx=0).stop 2024-09-19T09:39:35.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.070+0000 7f77221c7640 1 -- 172.21.15.1:0/1643593971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f771c101de0 msgr2=0x7f771c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:35.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.070+0000 7f77221c7640 1 --2- 172.21.15.1:0/1643593971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f771c101de0 0x7f771c0744f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f770c02ade0 tx=0x7f770c0319f0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.071+0000 7f77221c7640 1 -- 172.21.15.1:0/1643593971 shutdown_connections 2024-09-19T09:39:35.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.071+0000 7f77221c7640 1 --2- 172.21.15.1:0/1643593971 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f771c106f10 0x7f771c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.071+0000 7f77221c7640 1 --2- 172.21.15.1:0/1643593971 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f77080a32c0 0x7f77080a5780 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.071+0000 7f77221c7640 1 --2- 172.21.15.1:0/1643593971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f771c102790 0x7f771c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.071+0000 7f77221c7640 1 --2- 172.21.15.1:0/1643593971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f771c101de0 0x7f771c0744f0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:35.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.071+0000 7f77221c7640 1 -- 172.21.15.1:0/1643593971 >> 172.21.15.1:0/1643593971 conn(0x7f771c0fd8c0 msgr2=0x7f771c0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:35.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.071+0000 7f77221c7640 1 -- 172.21.15.1:0/1643593971 shutdown_connections 2024-09-19T09:39:35.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:35.071+0000 7f77221c7640 1 -- 172.21.15.1:0/1643593971 wait complete. 2024-09-19T09:39:35.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:35 smithi001 ceph-mon[31225]: scrub queued for path: / 2024-09-19T09:39:35.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:35 smithi001 ceph-mon[31225]: scrub summary: idle+waiting paths [/] 2024-09-19T09:39:35.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:35 smithi001 ceph-mon[31225]: scrub summary: active paths [/] 2024-09-19T09:39:35.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:35 smithi001 ceph-mon[31225]: scrub summary: idle+waiting paths [/] 2024-09-19T09:39:35.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:35 smithi022 ceph-mon[35583]: scrub queued for path: / 2024-09-19T09:39:35.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:35 smithi022 ceph-mon[35583]: scrub summary: idle+waiting paths [/] 2024-09-19T09:39:35.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:35 smithi022 ceph-mon[35583]: scrub summary: active paths [/] 2024-09-19T09:39:35.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:35 smithi022 ceph-mon[35583]: scrub summary: idle+waiting paths [/] 2024-09-19T09:39:35.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:35 smithi121 ceph-mon[35577]: scrub queued for path: / 2024-09-19T09:39:35.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:35 smithi121 ceph-mon[35577]: scrub summary: idle+waiting paths [/] 2024-09-19T09:39:35.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:35 smithi121 ceph-mon[35577]: scrub summary: active paths [/] 2024-09-19T09:39:35.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:35 smithi121 ceph-mon[35577]: scrub summary: idle+waiting paths [/] 2024-09-19T09:39:35.790 INFO:tasks.cephfs.filesystem:scrub status for tag:60ee9271-ccb5-44e1-93df-35a592a08107 - {'path': '/', 'tag': '60ee9271-ccb5-44e1-93df-35a592a08107', 'options': 'recursive,force'} 2024-09-19T09:39:36.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:36 smithi022 ceph-mon[35583]: pgmap v383: 97 pgs: 97 active+clean; 665 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 853 B/s wr, 2 op/s 2024-09-19T09:39:36.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:36 smithi121 ceph-mon[35577]: pgmap v383: 97 pgs: 97 active+clean; 665 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 853 B/s wr, 2 op/s 2024-09-19T09:39:36.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:36 smithi001 ceph-mon[31225]: pgmap v383: 97 pgs: 97 active+clean; 665 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 853 B/s wr, 2 op/s 2024-09-19T09:39:38.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:38 smithi022 ceph-mon[35583]: pgmap v384: 97 pgs: 97 active+clean; 665 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-19T09:39:38.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:38 smithi121 ceph-mon[35577]: pgmap v384: 97 pgs: 97 active+clean; 665 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-19T09:39:38.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:38 smithi001 ceph-mon[31225]: pgmap v384: 97 pgs: 97 active+clean; 665 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-19T09:39:39.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:39 smithi022 ceph-mon[35583]: scrub summary: idle 2024-09-19T09:39:39.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:39 smithi121 ceph-mon[35577]: scrub summary: idle 2024-09-19T09:39:39.412 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:39:39.441 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:39 smithi001 ceph-mon[31225]: scrub summary: idle 2024-09-19T09:39:39.683 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:40.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.153+0000 7f49a3843640 1 -- 172.21.15.1:0/1406558409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f499c102d50 msgr2=0x7f499c103130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:40.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.153+0000 7f49a3843640 1 --2- 172.21.15.1:0/1406558409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f499c102d50 0x7f499c103130 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4998009900 tx=0x7f499802a480 comp rx=0 tx=0).stop 2024-09-19T09:39:40.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.153+0000 7f49a3843640 1 -- 172.21.15.1:0/1406558409 shutdown_connections 2024-09-19T09:39:40.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.153+0000 7f49a3843640 1 --2- 172.21.15.1:0/1406558409 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f499c10c180 0x7f499c10e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:40.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.153+0000 7f49a3843640 1 --2- 172.21.15.1:0/1406558409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f499c103670 0x7f499c10bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:40.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.153+0000 7f49a3843640 1 --2- 172.21.15.1:0/1406558409 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f499c102d50 0x7f499c103130 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:40.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.153+0000 7f49a3843640 1 -- 172.21.15.1:0/1406558409 >> 172.21.15.1:0/1406558409 conn(0x7f499c0fc7d0 msgr2=0x7f499c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:40.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.153+0000 7f49a3843640 1 -- 172.21.15.1:0/1406558409 shutdown_connections 2024-09-19T09:39:40.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.153+0000 7f49a3843640 1 -- 172.21.15.1:0/1406558409 wait complete. 2024-09-19T09:39:40.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.154+0000 7f49a3843640 1 Processor -- start 2024-09-19T09:39:40.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.154+0000 7f49a3843640 1 -- start start 2024-09-19T09:39:40.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.154+0000 7f49a3843640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f499c102d50 0x7f499c19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:40.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.154+0000 7f49a3843640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f499c103670 0x7f499c19abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:40.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.154+0000 7f49a3843640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f499c10c180 0x7f499c19ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:40.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.154+0000 7f49a3843640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f499c111f80 con 0x7f499c10c180 2024-09-19T09:39:40.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.154+0000 7f49a3843640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f499c111e00 con 0x7f499c103670 2024-09-19T09:39:40.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.154+0000 7f49a3843640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f499c112100 con 0x7f499c102d50 2024-09-19T09:39:40.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.154+0000 7f49a1de0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f499c10c180 0x7f499c19ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:40.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.154+0000 7f49a0dde640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f499c103670 0x7f499c19abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:40.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.154+0000 7f49a0dde640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f499c103670 0x7f499c19abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:52896/0 (socket says 172.21.15.1:52896) 2024-09-19T09:39:40.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.154+0000 7f49a0dde640 1 -- 172.21.15.1:0/2759401376 learned_addr learned my addr 172.21.15.1:0/2759401376 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:40.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.154+0000 7f49a1de0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f499c10c180 0x7f499c19ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45464/0 (socket says 172.21.15.1:45464) 2024-09-19T09:39:40.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.154+0000 7f49a15df640 1 --2- 172.21.15.1:0/2759401376 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f499c102d50 0x7f499c19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:40.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.154+0000 7f49a1de0640 1 -- 172.21.15.1:0/2759401376 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f499c102d50 msgr2=0x7f499c19a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:40.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.154+0000 7f49a1de0640 1 --2- 172.21.15.1:0/2759401376 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f499c102d50 0x7f499c19a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:40.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.154+0000 7f49a1de0640 1 -- 172.21.15.1:0/2759401376 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f499c103670 msgr2=0x7f499c19abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:40.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.154+0000 7f49a1de0640 1 --2- 172.21.15.1:0/2759401376 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f499c103670 0x7f499c19abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:40.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.154+0000 7f49a1de0640 1 -- 172.21.15.1:0/2759401376 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f499c19f650 con 0x7f499c10c180 2024-09-19T09:39:40.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.154+0000 7f49a0dde640 1 --2- 172.21.15.1:0/2759401376 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f499c103670 0x7f499c19abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:40.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.155+0000 7f49a1de0640 1 --2- 172.21.15.1:0/2759401376 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f499c10c180 0x7f499c19ef70 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f499400e940 tx=0x7f499400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:40.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.155+0000 7f49927fc640 1 -- 172.21.15.1:0/2759401376 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4994004d20 con 0x7f499c10c180 2024-09-19T09:39:40.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.155+0000 7f49927fc640 1 -- 172.21.15.1:0/2759401376 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4994005020 con 0x7f499c10c180 2024-09-19T09:39:40.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.155+0000 7f49a3843640 1 -- 172.21.15.1:0/2759401376 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f499c19f940 con 0x7f499c10c180 2024-09-19T09:39:40.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.155+0000 7f49927fc640 1 -- 172.21.15.1:0/2759401376 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49940116b0 con 0x7f499c10c180 2024-09-19T09:39:40.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.155+0000 7f49a3843640 1 -- 172.21.15.1:0/2759401376 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f499c1a7220 con 0x7f499c10c180 2024-09-19T09:39:40.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.156+0000 7f49a3843640 1 -- 172.21.15.1:0/2759401376 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f499c103130 con 0x7f499c10c180 2024-09-19T09:39:40.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.157+0000 7f49927fc640 1 -- 172.21.15.1:0/2759401376 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f49940054d0 con 0x7f499c10c180 2024-09-19T09:39:40.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.158+0000 7f49927fc640 1 --2- 172.21.15.1:0/2759401376 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f49880a3240 0x7f49880a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:40.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.158+0000 7f49927fc640 1 -- 172.21.15.1:0/2759401376 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f49940cf920 con 0x7f499c10c180 2024-09-19T09:39:40.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.158+0000 7f49a15df640 1 --2- 172.21.15.1:0/2759401376 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f49880a3240 0x7f49880a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:40.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.158+0000 7f49a15df640 1 --2- 172.21.15.1:0/2759401376 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f49880a3240 0x7f49880a5700 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4998009230 tx=0x7f49980058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:40.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.162+0000 7f49927fc640 1 -- 172.21.15.1:0/2759401376 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4994016030 con 0x7f499c10c180 2024-09-19T09:39:40.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:40 smithi022 ceph-mon[35583]: pgmap v385: 97 pgs: 97 active+clean; 665 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 853 B/s wr, 3 op/s 2024-09-19T09:39:40.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:40 smithi121 ceph-mon[35577]: pgmap v385: 97 pgs: 97 active+clean; 665 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 853 B/s wr, 3 op/s 2024-09-19T09:39:40.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.376+0000 7f49a3843640 1 -- 172.21.15.1:0/2759401376 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f499c1a7550 con 0x7f499c10c180 2024-09-19T09:39:40.377 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:40 smithi001 ceph-mon[31225]: pgmap v385: 97 pgs: 97 active+clean; 665 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 853 B/s wr, 3 op/s 2024-09-19T09:39:40.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.377+0000 7f49927fc640 1 -- 172.21.15.1:0/2759401376 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11837 (secure 0 0 0) 0x7f499409bff0 con 0x7f499c10c180 2024-09-19T09:39:40.379 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:39:40.379 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":19,"btime":"2024-09-19T09:36:24:006349+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:36:23.723388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6839/3279971690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3279971690},{"type":"v1","addr":"172.21.15.121:6839","nonce":3279971690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:39:40.379 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 19 2024-09-19T09:39:40.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.380+0000 7f49a3843640 1 -- 172.21.15.1:0/2759401376 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f49880a3240 msgr2=0x7f49880a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:40.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.380+0000 7f49a3843640 1 --2- 172.21.15.1:0/2759401376 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f49880a3240 0x7f49880a5700 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4998009230 tx=0x7f49980058d0 comp rx=0 tx=0).stop 2024-09-19T09:39:40.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.380+0000 7f49a3843640 1 -- 172.21.15.1:0/2759401376 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f499c10c180 msgr2=0x7f499c19ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:40.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.380+0000 7f49a3843640 1 --2- 172.21.15.1:0/2759401376 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f499c10c180 0x7f499c19ef70 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f499400e940 tx=0x7f499400ee00 comp rx=0 tx=0).stop 2024-09-19T09:39:40.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.380+0000 7f49a3843640 1 -- 172.21.15.1:0/2759401376 shutdown_connections 2024-09-19T09:39:40.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.380+0000 7f49a3843640 1 --2- 172.21.15.1:0/2759401376 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f499c10c180 0x7f499c19ef70 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:40.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.380+0000 7f49a3843640 1 --2- 172.21.15.1:0/2759401376 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f49880a3240 0x7f49880a5700 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:40.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.380+0000 7f49a3843640 1 --2- 172.21.15.1:0/2759401376 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f499c103670 0x7f499c19abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:40.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.380+0000 7f49a3843640 1 --2- 172.21.15.1:0/2759401376 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f499c102d50 0x7f499c19a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:40.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.380+0000 7f49a3843640 1 -- 172.21.15.1:0/2759401376 >> 172.21.15.1:0/2759401376 conn(0x7f499c0fc7d0 msgr2=0x7f499c0fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:40.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.380+0000 7f49a3843640 1 -- 172.21.15.1:0/2759401376 shutdown_connections 2024-09-19T09:39:40.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:40.380+0000 7f49a3843640 1 -- 172.21.15.1:0/2759401376 wait complete. 2024-09-19T09:39:41.060 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db --set-id 9e4bf5ad --release --await' 2024-09-19T09:39:41.060 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db --set-id 9e4bf5ad --release --await 2024-09-19T09:39:41.195 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.192+0000 7f345e168640 1 -- 172.21.15.1:0/2640481850 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34581025f0 msgr2=0x7f3458108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:41.195 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.192+0000 7f345e168640 1 --2- 172.21.15.1:0/2640481850 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34581025f0 0x7f3458108e80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3450009ca0 tx=0x7f345002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.192+0000 7f345e168640 1 -- 172.21.15.1:0/2640481850 shutdown_connections 2024-09-19T09:39:41.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.192+0000 7f345e168640 1 --2- 172.21.15.1:0/2640481850 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f34581025f0 0x7f3458108e80 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.192+0000 7f345e168640 1 --2- 172.21.15.1:0/2640481850 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3458101c30 0x7f34581020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.192+0000 7f345e168640 1 --2- 172.21.15.1:0/2640481850 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3458100a40 0x7f3458100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.192+0000 7f345e168640 1 -- 172.21.15.1:0/2640481850 >> 172.21.15.1:0/2640481850 conn(0x7f34580fc1c0 msgr2=0x7f34580fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:41.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.192+0000 7f345e168640 1 -- 172.21.15.1:0/2640481850 shutdown_connections 2024-09-19T09:39:41.196 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.192+0000 7f345e168640 1 -- 172.21.15.1:0/2640481850 wait complete. 2024-09-19T09:39:41.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.192+0000 7f345e168640 1 Processor -- start 2024-09-19T09:39:41.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.192+0000 7f345e168640 1 -- start start 2024-09-19T09:39:41.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.193+0000 7f345e168640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3458100a40 0x7f345806a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.193+0000 7f345e168640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3458101c30 0x7f345819cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.193+0000 7f345e168640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f34581025f0 0x7f345819f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.193+0000 7f345e168640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f345810c6a0 con 0x7f3458100a40 2024-09-19T09:39:41.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.193+0000 7f345e168640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f345810c520 con 0x7f34581025f0 2024-09-19T09:39:41.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.193+0000 7f345e168640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f345810c820 con 0x7f3458101c30 2024-09-19T09:39:41.197 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.193+0000 7f34577fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3458100a40 0x7f345806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.193+0000 7f34577fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3458100a40 0x7f345806a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45486/0 (socket says 172.21.15.1:45486) 2024-09-19T09:39:41.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.193+0000 7f34577fe640 1 -- 172.21.15.1:0/3715469146 learned_addr learned my addr 172.21.15.1:0/3715469146 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:41.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.193+0000 7f344ffff640 1 --2- 172.21.15.1:0/3715469146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3458101c30 0x7f345819cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.193+0000 7f3457fff640 1 --2- 172.21.15.1:0/3715469146 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f34581025f0 0x7f345819f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.193+0000 7f34577fe640 1 -- 172.21.15.1:0/3715469146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3458101c30 msgr2=0x7f345819cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:41.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.193+0000 7f34577fe640 1 --2- 172.21.15.1:0/3715469146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3458101c30 0x7f345819cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.193+0000 7f34577fe640 1 -- 172.21.15.1:0/3715469146 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f34581025f0 msgr2=0x7f345819f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:41.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.193+0000 7f34577fe640 1 --2- 172.21.15.1:0/3715469146 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f34581025f0 0x7f345819f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.193+0000 7f34577fe640 1 -- 172.21.15.1:0/3715469146 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f345819fa70 con 0x7f3458100a40 2024-09-19T09:39:41.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.193+0000 7f34577fe640 1 --2- 172.21.15.1:0/3715469146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3458100a40 0x7f345806a580 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f344800d950 tx=0x7f344800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:41.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.194+0000 7f34557fa640 1 -- 172.21.15.1:0/3715469146 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3448017020 con 0x7f3458100a40 2024-09-19T09:39:41.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.194+0000 7f34557fa640 1 -- 172.21.15.1:0/3715469146 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3448009c30 con 0x7f3458100a40 2024-09-19T09:39:41.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.194+0000 7f345e168640 1 -- 172.21.15.1:0/3715469146 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f345819fd00 con 0x7f3458100a40 2024-09-19T09:39:41.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.194+0000 7f34557fa640 1 -- 172.21.15.1:0/3715469146 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344800f740 con 0x7f3458100a40 2024-09-19T09:39:41.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.194+0000 7f345e168640 1 -- 172.21.15.1:0/3715469146 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34581a01a0 con 0x7f3458100a40 2024-09-19T09:39:41.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.196+0000 7f34557fa640 1 -- 172.21.15.1:0/3715469146 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f344801a020 con 0x7f3458100a40 2024-09-19T09:39:41.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.196+0000 7f3460fda740 1 Processor -- start 2024-09-19T09:39:41.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.196+0000 7f3460fda740 1 -- start start 2024-09-19T09:39:41.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.196+0000 7f3460fda740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e754b359a0 0x55e754b35da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.205 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.196+0000 7f3460fda740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e754b362e0 0x55e754b3ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.206 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.196+0000 7f3460fda740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e754b3b370 0x55e754b3d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.206 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.196+0000 7f3460fda740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e754a992f0 con 0x55e754b3b370 2024-09-19T09:39:41.206 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.196+0000 7f3460fda740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e754a41270 con 0x55e754b359a0 2024-09-19T09:39:41.206 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.196+0000 7f3460fda740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55e754a952b0 con 0x55e754b362e0 2024-09-19T09:39:41.206 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.197+0000 7f344ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e754b3b370 0x55e754b3d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.206 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.197+0000 7f3457fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e754b359a0 0x55e754b35da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.206 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.197+0000 7f344ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e754b3b370 0x55e754b3d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45488/0 (socket says 172.21.15.1:45488) 2024-09-19T09:39:41.206 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.197+0000 7f344ffff640 1 -- 172.21.15.1:0/3570360949 learned_addr learned my addr 172.21.15.1:0/3570360949 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:41.206 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.197+0000 7f34577fe640 1 --2- 172.21.15.1:0/3570360949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e754b362e0 0x55e754b3ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.206 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.197+0000 7f344ffff640 1 -- 172.21.15.1:0/3570360949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e754b362e0 msgr2=0x55e754b3ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:41.206 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.197+0000 7f344ffff640 1 --2- 172.21.15.1:0/3570360949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e754b362e0 0x55e754b3ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.206 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.197+0000 7f344ffff640 1 -- 172.21.15.1:0/3570360949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e754b359a0 msgr2=0x55e754b35da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:41.206 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.197+0000 7f344ffff640 1 --2- 172.21.15.1:0/3570360949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e754b359a0 0x55e754b35da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.207 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.197+0000 7f344ffff640 1 -- 172.21.15.1:0/3570360949 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e754a40340 con 0x55e754b3b370 2024-09-19T09:39:41.207 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.197+0000 7f3457fff640 1 --2- 172.21.15.1:0/3570360949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e754b359a0 0x55e754b35da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:41.207 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.197+0000 7f34557fa640 1 --2- 172.21.15.1:0/3715469146 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f34440a3240 0x7f34440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.207 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.197+0000 7f344ffff640 1 --2- 172.21.15.1:0/3570360949 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e754b3b370 0x55e754b3d830 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3440009c10 tx=0x7f3440011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=358728fe230c8da0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:41.207 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.197+0000 7f3457fff640 1 --2- 172.21.15.1:0/3715469146 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f34440a3240 0x7f34440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.207 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.197+0000 7f344dffb640 1 -- 172.21.15.1:0/3570360949 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3440004230 con 0x55e754b3b370 2024-09-19T09:39:41.207 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.197+0000 7f34557fa640 1 -- 172.21.15.1:0/3715469146 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f34480cf330 con 0x7f3458100a40 2024-09-19T09:39:41.207 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.197+0000 7f344dffb640 1 -- 172.21.15.1:0/3570360949 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34400043d0 con 0x55e754b3b370 2024-09-19T09:39:41.207 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.197+0000 7f344dffb640 1 -- 172.21.15.1:0/3570360949 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3440004e60 con 0x55e754b3b370 2024-09-19T09:39:41.208 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.198+0000 7f3460fda740 1 -- 172.21.15.1:0/3570360949 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e754b3b370 msgr2=0x55e754b3d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:41.208 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.198+0000 7f3457fff640 1 --2- 172.21.15.1:0/3715469146 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f34440a3240 0x7f34440a5700 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3450006010 tx=0x7f3450031bb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:41.208 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.198+0000 7f3460fda740 1 --2- 172.21.15.1:0/3570360949 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e754b3b370 0x55e754b3d830 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3440009c10 tx=0x7f3440011810 comp rx=0 tx=0).stop 2024-09-19T09:39:41.208 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.198+0000 7f3460fda740 1 -- 172.21.15.1:0/3570360949 shutdown_connections 2024-09-19T09:39:41.208 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.198+0000 7f3460fda740 1 --2- 172.21.15.1:0/3570360949 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e754b3b370 0x55e754b3d830 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.208 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.198+0000 7f3460fda740 1 --2- 172.21.15.1:0/3570360949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e754b362e0 0x55e754b3ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.208 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.198+0000 7f3460fda740 1 --2- 172.21.15.1:0/3570360949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e754b359a0 0x55e754b35da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.208 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.198+0000 7f3460fda740 1 -- 172.21.15.1:0/3570360949 >> 172.21.15.1:0/3570360949 conn(0x55e754b31010 msgr2=0x55e754b31410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:41.208 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.198+0000 7f3460fda740 1 -- 172.21.15.1:0/3570360949 shutdown_connections 2024-09-19T09:39:41.208 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.198+0000 7f3460fda740 1 -- 172.21.15.1:0/3570360949 wait complete. 2024-09-19T09:39:41.208 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.199+0000 7f3460fda740 1 -- start start 2024-09-19T09:39:41.208 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.199+0000 7f3460fda740 1 Processor -- start 2024-09-19T09:39:41.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.199+0000 7f3460fda740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e754b359a0 0x55e754b3fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.199+0000 7f3460fda740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e754b362e0 0x55e754b40160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.199+0000 7f3460fda740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e754b3b370 0x55e754b471a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.199+0000 7f3460fda740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e754b3e390 con 0x55e754b3b370 2024-09-19T09:39:41.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.199+0000 7f3460fda740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e754a22290 con 0x55e754b359a0 2024-09-19T09:39:41.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.199+0000 7f3460fda740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55e754b3e510 con 0x55e754b362e0 2024-09-19T09:39:41.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.199+0000 7f3460fda740 10 client.0 _ll_register_callbacks cb 0x55e754a53140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:41.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.199+0000 7f3457fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e754b3b370 0x55e754b471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.199+0000 7f3457fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e754b3b370 0x55e754b471a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45494/0 (socket says 172.21.15.1:45494) 2024-09-19T09:39:41.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.199+0000 7f3457fff640 1 -- 172.21.15.1:0/3673268534 learned_addr learned my addr 172.21.15.1:0/3673268534 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:41.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.199+0000 7f34577fe640 1 --2- 172.21.15.1:0/3673268534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e754b359a0 0x55e754b3fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.199+0000 7f344ffff640 1 --2- 172.21.15.1:0/3673268534 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e754b362e0 0x55e754b40160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.200+0000 7f3457fff640 1 -- 172.21.15.1:0/3673268534 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e754b362e0 msgr2=0x55e754b40160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:41.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.200+0000 7f3457fff640 1 --2- 172.21.15.1:0/3673268534 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e754b362e0 0x55e754b40160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.200+0000 7f3457fff640 1 -- 172.21.15.1:0/3673268534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e754b359a0 msgr2=0x55e754b3fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:41.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.200+0000 7f3457fff640 1 --2- 172.21.15.1:0/3673268534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e754b359a0 0x55e754b3fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.200+0000 7f3457fff640 1 -- 172.21.15.1:0/3673268534 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7547ac210 con 0x55e754b3b370 2024-09-19T09:39:41.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.200+0000 7f3457fff640 1 --2- 172.21.15.1:0/3673268534 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e754b3b370 0x55e754b471a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3450035000 tx=0x7f345002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f92da8ce64b0e73 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:41.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.200+0000 7f3436ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:39:41.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.200+0000 7f3436ffd640 1 -- 172.21.15.1:0/3673268534 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3450031d30 con 0x55e754b3b370 2024-09-19T09:39:41.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.200+0000 7f3436ffd640 1 -- 172.21.15.1:0/3673268534 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f3450003d40 con 0x55e754b3b370 2024-09-19T09:39:41.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.200+0000 7f3460fda740 1 -- 172.21.15.1:0/3673268534 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34400043d0 con 0x55e754b3b370 2024-09-19T09:39:41.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.200+0000 7f3436ffd640 1 -- 172.21.15.1:0/3673268534 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f34500045c0 con 0x55e754b3b370 2024-09-19T09:39:41.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.200+0000 7f3460fda740 10 client.15573 fetch_fsmap learned FSMap version 19 2024-09-19T09:39:41.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.200+0000 7f3460fda740 1 -- 172.21.15.1:0/3673268534 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e754878620 con 0x55e754b3b370 2024-09-19T09:39:41.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.200+0000 7f3436ffd640 1 -- 172.21.15.1:0/3673268534 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34400043d0 con 0x55e754b3b370 2024-09-19T09:39:41.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.201+0000 7f3436ffd640 1 -- 172.21.15.1:0/3673268534 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f34500305c0 con 0x55e754b3b370 2024-09-19T09:39:41.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.201+0000 7f3460fda740 10 client.15573 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:39:41.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.201+0000 7f3460fda740 10 client.15573 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:41.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.201+0000 7f3460fda740 20 client.15573 populate_metadata read hostname 'smithi001' 2024-09-19T09:39:41.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.201+0000 7f3460fda740 1 --2- 172.21.15.1:0/3673268534 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55e754b4b8e0 0x55e754b4dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.201+0000 7f3460fda740 4 client.15573 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:39:41.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.201+0000 7f3460fda740 1 -- 172.21.15.1:0/3673268534 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e754aa6a20 con 0x55e754b4b8e0 2024-09-19T09:39:41.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.201+0000 7f34577fe640 1 --2- 172.21.15.1:0/3673268534 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55e754b4b8e0 0x55e754b4dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.202+0000 7f3436ffd640 10 client.15573 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:41.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.202+0000 7f34577fe640 1 --2- 172.21.15.1:0/3673268534 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55e754b4b8e0 0x55e754b4dd10 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a60e25bd3d8bb5 server_cookie=a14542960f1ab3f9 in_seq=0 out_seq=0 2024-09-19T09:39:41.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.202+0000 7f3436ffd640 1 -- 172.21.15.1:0/3673268534 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e754aa6a20 con 0x55e754b4b8e0 2024-09-19T09:39:41.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.202+0000 7f3436ffd640 10 client.15573 handle_command_reply: tid=0 2024-09-19T09:39:41.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.202+0000 7f3460fda740 1 client.15573 shutdown 2024-09-19T09:39:41.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.203+0000 7f3460fda740 1 -- 172.21.15.1:0/3673268534 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e754b3b370 msgr2=0x55e754b471a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:41.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.203+0000 7f3460fda740 1 --2- 172.21.15.1:0/3673268534 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e754b3b370 0x55e754b471a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3450035000 tx=0x7f345002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.203+0000 7f3460fda740 1 -- 172.21.15.1:0/3673268534 shutdown_connections 2024-09-19T09:39:41.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.203+0000 7f3460fda740 1 --2- 172.21.15.1:0/3673268534 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55e754b4b8e0 0x55e754b4dd10 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.203+0000 7f3460fda740 1 --2- 172.21.15.1:0/3673268534 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e754b3b370 0x55e754b471a0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.203+0000 7f3460fda740 1 --2- 172.21.15.1:0/3673268534 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e754b362e0 0x55e754b40160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.203+0000 7f3436ffd640 0 client.15573 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:41.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.203+0000 7f3460fda740 1 --2- 172.21.15.1:0/3673268534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e754b359a0 0x55e754b3fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.203+0000 7f3460fda740 1 -- 172.21.15.1:0/3673268534 >> 172.21.15.1:0/3673268534 conn(0x55e754b31010 msgr2=0x55e754b32820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:41.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.203+0000 7f3460fda740 1 -- 172.21.15.1:0/3673268534 shutdown_connections 2024-09-19T09:39:41.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.203+0000 7f3460fda740 1 -- 172.21.15.1:0/3673268534 wait complete. 2024-09-19T09:39:41.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.203+0000 7f3460fda740 20 client.15573 trim_cache size 0 max 16384 2024-09-19T09:39:41.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.217+0000 7f3460fda740 1 Processor -- start 2024-09-19T09:39:41.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.217+0000 7f3460fda740 1 -- start start 2024-09-19T09:39:41.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.217+0000 7f3460fda740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e754b359a0 0x55e754b3aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.217+0000 7f3460fda740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e754b362e0 0x55e754b47160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.218+0000 7f3460fda740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e754b3b370 0x55e754b31ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.218+0000 7f3460fda740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f34581a6fe0 con 0x55e754b3b370 2024-09-19T09:39:41.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.218+0000 7f3460fda740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f34581a9880 con 0x55e754b359a0 2024-09-19T09:39:41.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.218+0000 7f3460fda740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f34581a7670 con 0x55e754b362e0 2024-09-19T09:39:41.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.218+0000 7f3457fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e754b3b370 0x55e754b31ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.218+0000 7f3457fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e754b3b370 0x55e754b31ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45508/0 (socket says 172.21.15.1:45508) 2024-09-19T09:39:41.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.218+0000 7f3457fff640 1 -- 172.21.15.1:0/3978664670 learned_addr learned my addr 172.21.15.1:0/3978664670 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:41.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.218+0000 7f34577fe640 1 --2- 172.21.15.1:0/3978664670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e754b359a0 0x55e754b3aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.218+0000 7f344ffff640 1 --2- 172.21.15.1:0/3978664670 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e754b362e0 0x55e754b47160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.218+0000 7f3457fff640 1 -- 172.21.15.1:0/3978664670 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e754b362e0 msgr2=0x55e754b47160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:41.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.218+0000 7f3457fff640 1 --2- 172.21.15.1:0/3978664670 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e754b362e0 0x55e754b47160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.218+0000 7f3457fff640 1 -- 172.21.15.1:0/3978664670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e754b359a0 msgr2=0x55e754b3aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:41.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.218+0000 7f3457fff640 1 --2- 172.21.15.1:0/3978664670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e754b359a0 0x55e754b3aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.218+0000 7f3457fff640 1 -- 172.21.15.1:0/3978664670 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e754b36f70 con 0x55e754b3b370 2024-09-19T09:39:41.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.218+0000 7f344ffff640 1 --2- 172.21.15.1:0/3978664670 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e754b362e0 0x55e754b47160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:41.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.218+0000 7f3457fff640 1 --2- 172.21.15.1:0/3978664670 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e754b3b370 0x55e754b31ec0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f345002ade0 tx=0x7f345002afc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a40c7ef5d24723 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:41.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.218+0000 7f344d7fa640 1 -- 172.21.15.1:0/3978664670 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3450004820 con 0x55e754b3b370 2024-09-19T09:39:41.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.218+0000 7f344d7fa640 1 -- 172.21.15.1:0/3978664670 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f345004d070 con 0x55e754b3b370 2024-09-19T09:39:41.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.218+0000 7f344d7fa640 1 -- 172.21.15.1:0/3978664670 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345002faf0 con 0x55e754b3b370 2024-09-19T09:39:41.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.219+0000 7f3460fda740 1 -- 172.21.15.1:0/3978664670 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e754b3b370 msgr2=0x55e754b31ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:41.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.219+0000 7f3460fda740 1 --2- 172.21.15.1:0/3978664670 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e754b3b370 0x55e754b31ec0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f345002ade0 tx=0x7f345002afc0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.219+0000 7f3460fda740 1 -- 172.21.15.1:0/3978664670 shutdown_connections 2024-09-19T09:39:41.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.219+0000 7f3460fda740 1 --2- 172.21.15.1:0/3978664670 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e754b3b370 0x55e754b31ec0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.219+0000 7f3460fda740 1 --2- 172.21.15.1:0/3978664670 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e754b362e0 0x55e754b47160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.219+0000 7f3460fda740 1 --2- 172.21.15.1:0/3978664670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e754b359a0 0x55e754b3aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.219+0000 7f3460fda740 1 -- 172.21.15.1:0/3978664670 >> 172.21.15.1:0/3978664670 conn(0x55e754b31010 msgr2=0x55e754b3fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:41.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.219+0000 7f3460fda740 1 -- 172.21.15.1:0/3978664670 shutdown_connections 2024-09-19T09:39:41.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.219+0000 7f3460fda740 1 -- 172.21.15.1:0/3978664670 wait complete. 2024-09-19T09:39:41.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.219+0000 7f3460fda740 1 -- start start 2024-09-19T09:39:41.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.220+0000 7f3460fda740 1 Processor -- start 2024-09-19T09:39:41.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.220+0000 7f3460fda740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e754b359a0 0x55e754b444e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.220+0000 7f3460fda740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e754b362e0 0x55e754b44a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.220+0000 7f3460fda740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e754b3b370 0x55e754b45a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.220+0000 7f3460fda740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f34581a7d40 con 0x55e754b362e0 2024-09-19T09:39:41.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.220+0000 7f3460fda740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f34581a91b0 con 0x55e754b3b370 2024-09-19T09:39:41.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.220+0000 7f3460fda740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f34581a8410 con 0x55e754b359a0 2024-09-19T09:39:41.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.220+0000 7f3460fda740 10 client.0 _ll_register_callbacks cb 0x7f3450009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:41.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.220+0000 7f344ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e754b362e0 0x55e754b44a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.220+0000 7f344ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e754b362e0 0x55e754b44a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45516/0 (socket says 172.21.15.1:45516) 2024-09-19T09:39:41.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.220+0000 7f344ffff640 1 -- 172.21.15.1:0/3943860105 learned_addr learned my addr 172.21.15.1:0/3943860105 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:41.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.220+0000 7f3457fff640 1 --2- 172.21.15.1:0/3943860105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e754b3b370 0x55e754b45a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.220+0000 7f34577fe640 1 --2- 172.21.15.1:0/3943860105 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e754b359a0 0x55e754b444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.220+0000 7f344ffff640 1 -- 172.21.15.1:0/3943860105 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e754b359a0 msgr2=0x55e754b444e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:41.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.220+0000 7f344ffff640 1 --2- 172.21.15.1:0/3943860105 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e754b359a0 0x55e754b444e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.220+0000 7f344ffff640 1 -- 172.21.15.1:0/3943860105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e754b3b370 msgr2=0x55e754b45a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:41.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.220+0000 7f344ffff640 1 --2- 172.21.15.1:0/3943860105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e754b3b370 0x55e754b45a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.220+0000 7f344ffff640 1 -- 172.21.15.1:0/3943860105 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e754b46040 con 0x55e754b362e0 2024-09-19T09:39:41.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.220+0000 7f34577fe640 1 --2- 172.21.15.1:0/3943860105 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e754b359a0 0x55e754b444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:41.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.220+0000 7f344ffff640 1 --2- 172.21.15.1:0/3943860105 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e754b362e0 0x55e754b44a20 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f34400058c0 tx=0x7f3440009e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edea33559dfb5d64 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:41.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.220+0000 7f3436ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:39:41.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.221+0000 7f3436ffd640 1 -- 172.21.15.1:0/3943860105 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34400045c0 con 0x55e754b362e0 2024-09-19T09:39:41.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.221+0000 7f3436ffd640 1 -- 172.21.15.1:0/3943860105 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f3440004760 con 0x55e754b362e0 2024-09-19T09:39:41.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.221+0000 7f3460fda740 1 -- 172.21.15.1:0/3943860105 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f345004d070 con 0x55e754b362e0 2024-09-19T09:39:41.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.221+0000 7f3436ffd640 1 -- 172.21.15.1:0/3943860105 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3440004960 con 0x55e754b362e0 2024-09-19T09:39:41.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.221+0000 7f3460fda740 10 client.15579 fetch_fsmap learned FSMap version 19 2024-09-19T09:39:41.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.221+0000 7f3460fda740 1 -- 172.21.15.1:0/3943860105 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e754b47330 con 0x55e754b362e0 2024-09-19T09:39:41.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.221+0000 7f3436ffd640 1 -- 172.21.15.1:0/3943860105 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f345004d070 con 0x55e754b362e0 2024-09-19T09:39:41.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.221+0000 7f3436ffd640 1 -- 172.21.15.1:0/3943860105 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f344002c030 con 0x55e754b362e0 2024-09-19T09:39:41.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.221+0000 7f3460fda740 10 client.15579 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:39:41.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.221+0000 7f3460fda740 10 client.15579 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:41.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.221+0000 7f3460fda740 20 client.15579 populate_metadata read hostname 'smithi001' 2024-09-19T09:39:41.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.221+0000 7f3460fda740 1 --2- 172.21.15.1:0/3943860105 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55e754bb6b00 0x55e754bb8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.221+0000 7f3460fda740 4 client.15579 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:39:41.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.221+0000 7f3460fda740 1 -- 172.21.15.1:0/3943860105 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e754aa0d70 con 0x55e754bb6b00 2024-09-19T09:39:41.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.221+0000 7f34577fe640 1 --2- 172.21.15.1:0/3943860105 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55e754bb6b00 0x55e754bb8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.222+0000 7f34577fe640 1 --2- 172.21.15.1:0/3943860105 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55e754bb6b00 0x55e754bb8f20 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b73fe11228a65002 server_cookie=92664945a912204d in_seq=0 out_seq=0 2024-09-19T09:39:41.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.222+0000 7f3436ffd640 10 client.15579 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.226+0000 7f3436ffd640 1 -- 172.21.15.1:0/3943860105 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e754aa0d70 con 0x55e754bb6b00 2024-09-19T09:39:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.226+0000 7f3436ffd640 10 client.15579 handle_command_reply: tid=0 2024-09-19T09:39:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.226+0000 7f3460fda740 1 client.15579 shutdown 2024-09-19T09:39:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.226+0000 7f3460fda740 1 -- 172.21.15.1:0/3943860105 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e754b362e0 msgr2=0x55e754b44a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.226+0000 7f3460fda740 1 --2- 172.21.15.1:0/3943860105 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e754b362e0 0x55e754b44a20 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f34400058c0 tx=0x7f3440009e80 comp rx=0 tx=0).stop 2024-09-19T09:39:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.226+0000 7f3460fda740 1 -- 172.21.15.1:0/3943860105 shutdown_connections 2024-09-19T09:39:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.226+0000 7f3460fda740 1 --2- 172.21.15.1:0/3943860105 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55e754bb6b00 0x55e754bb8f20 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.226+0000 7f3460fda740 1 --2- 172.21.15.1:0/3943860105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e754b3b370 0x55e754b45a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.226+0000 7f3460fda740 1 --2- 172.21.15.1:0/3943860105 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e754b362e0 0x55e754b44a20 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.226+0000 7f3436ffd640 0 client.15579 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.226+0000 7f3460fda740 1 --2- 172.21.15.1:0/3943860105 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e754b359a0 0x55e754b444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.226+0000 7f3460fda740 1 -- 172.21.15.1:0/3943860105 >> 172.21.15.1:0/3943860105 conn(0x55e754b31010 msgr2=0x55e754b3fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.226+0000 7f3460fda740 1 -- 172.21.15.1:0/3943860105 shutdown_connections 2024-09-19T09:39:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.226+0000 7f3460fda740 1 -- 172.21.15.1:0/3943860105 wait complete. 2024-09-19T09:39:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.226+0000 7f3460fda740 20 client.15579 trim_cache size 0 max 16384 2024-09-19T09:39:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:39:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:39:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:39:41.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:39:41.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.227+0000 7f345e168640 1 -- 172.21.15.1:0/3715469146 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f34440a3240 msgr2=0x7f34440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:41.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.227+0000 7f345e168640 1 --2- 172.21.15.1:0/3715469146 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f34440a3240 0x7f34440a5700 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3450006010 tx=0x7f3450031bb0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.227+0000 7f345e168640 1 -- 172.21.15.1:0/3715469146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3458100a40 msgr2=0x7f345806a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:41.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.227+0000 7f345e168640 1 --2- 172.21.15.1:0/3715469146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3458100a40 0x7f345806a580 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f344800d950 tx=0x7f344800de10 comp rx=0 tx=0).stop 2024-09-19T09:39:41.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.227+0000 7f345e168640 1 -- 172.21.15.1:0/3715469146 shutdown_connections 2024-09-19T09:39:41.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.227+0000 7f345e168640 1 --2- 172.21.15.1:0/3715469146 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f34440a3240 0x7f34440a5700 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.227+0000 7f345e168640 1 --2- 172.21.15.1:0/3715469146 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f34581025f0 0x7f345819f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.227+0000 7f345e168640 1 --2- 172.21.15.1:0/3715469146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3458101c30 0x7f345819cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.227+0000 7f345e168640 1 --2- 172.21.15.1:0/3715469146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3458100a40 0x7f345806a580 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.227+0000 7f345e168640 1 -- 172.21.15.1:0/3715469146 >> 172.21.15.1:0/3715469146 conn(0x7f34580fc1c0 msgr2=0x7f3458104f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:41.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.227+0000 7f345e168640 1 -- 172.21.15.1:0/3715469146 shutdown_connections 2024-09-19T09:39:41.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:41.227+0000 7f345e168640 1 -- 172.21.15.1:0/3715469146 wait complete. 2024-09-19T09:39:41.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:41 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/2759401376' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:41.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:41 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/2759401376' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:41.367 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:41.488 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:41 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/2759401376' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:41.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.836+0000 7fd93de59640 1 -- 172.21.15.1:0/3730792236 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd938106f10 msgr2=0x7fd93810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:41.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.836+0000 7fd93de59640 1 --2- 172.21.15.1:0/3730792236 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd938106f10 0x7fd93810ea90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd930009ca0 tx=0x7fd93002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.836+0000 7fd93de59640 1 -- 172.21.15.1:0/3730792236 shutdown_connections 2024-09-19T09:39:41.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.836+0000 7fd93de59640 1 --2- 172.21.15.1:0/3730792236 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd938106f10 0x7fd93810ea90 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.836+0000 7fd93de59640 1 --2- 172.21.15.1:0/3730792236 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd938102790 0x7fd9381067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.836+0000 7fd93de59640 1 --2- 172.21.15.1:0/3730792236 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd938101de0 0x7fd9381021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.836+0000 7fd93de59640 1 -- 172.21.15.1:0/3730792236 >> 172.21.15.1:0/3730792236 conn(0x7fd9380fd8c0 msgr2=0x7fd9380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:41.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.836+0000 7fd93de59640 1 -- 172.21.15.1:0/3730792236 shutdown_connections 2024-09-19T09:39:41.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.836+0000 7fd93de59640 1 -- 172.21.15.1:0/3730792236 wait complete. 2024-09-19T09:39:41.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.836+0000 7fd93de59640 1 Processor -- start 2024-09-19T09:39:41.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.836+0000 7fd93de59640 1 -- start start 2024-09-19T09:39:41.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.837+0000 7fd93de59640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd938101de0 0x7fd9381982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.837+0000 7fd93de59640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd938102790 0x7fd938198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.837+0000 7fd93de59640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd938106f10 0x7fd93819cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.837+0000 7fd93de59640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd938111f70 con 0x7fd938102790 2024-09-19T09:39:41.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.837+0000 7fd93de59640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd938111df0 con 0x7fd938106f10 2024-09-19T09:39:41.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.837+0000 7fd93de59640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd9381120f0 con 0x7fd938101de0 2024-09-19T09:39:41.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.837+0000 7fd936ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd938102790 0x7fd938198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.837+0000 7fd936ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd938102790 0x7fd938198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45540/0 (socket says 172.21.15.1:45540) 2024-09-19T09:39:41.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.837+0000 7fd936ffd640 1 -- 172.21.15.1:0/3305584667 learned_addr learned my addr 172.21.15.1:0/3305584667 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:41.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.837+0000 7fd9377fe640 1 --2- 172.21.15.1:0/3305584667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd938101de0 0x7fd9381982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.837+0000 7fd937fff640 1 --2- 172.21.15.1:0/3305584667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd938106f10 0x7fd93819cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.837+0000 7fd936ffd640 1 -- 172.21.15.1:0/3305584667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd938101de0 msgr2=0x7fd9381982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:41.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.837+0000 7fd936ffd640 1 --2- 172.21.15.1:0/3305584667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd938101de0 0x7fd9381982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.837+0000 7fd936ffd640 1 -- 172.21.15.1:0/3305584667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd938106f10 msgr2=0x7fd93819cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:41.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.837+0000 7fd936ffd640 1 --2- 172.21.15.1:0/3305584667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd938106f10 0x7fd93819cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.837+0000 7fd936ffd640 1 -- 172.21.15.1:0/3305584667 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd93819d280 con 0x7fd938102790 2024-09-19T09:39:41.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.837+0000 7fd936ffd640 1 --2- 172.21.15.1:0/3305584667 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd938102790 0x7fd938198810 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00c920 tx=0x7fd92c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:41.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.837+0000 7fd934ff9640 1 -- 172.21.15.1:0/3305584667 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c007c70 con 0x7fd938102790 2024-09-19T09:39:41.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.837+0000 7fd934ff9640 1 -- 172.21.15.1:0/3305584667 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd92c007e10 con 0x7fd938102790 2024-09-19T09:39:41.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.837+0000 7fd93de59640 1 -- 172.21.15.1:0/3305584667 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd93819d570 con 0x7fd938102790 2024-09-19T09:39:41.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.837+0000 7fd934ff9640 1 -- 172.21.15.1:0/3305584667 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c018890 con 0x7fd938102790 2024-09-19T09:39:41.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.838+0000 7fd93de59640 1 -- 172.21.15.1:0/3305584667 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9381a4e50 con 0x7fd938102790 2024-09-19T09:39:41.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.840+0000 7fd934ff9640 1 -- 172.21.15.1:0/3305584667 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fd92c018a70 con 0x7fd938102790 2024-09-19T09:39:41.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.840+0000 7fd940232740 1 Processor -- start 2024-09-19T09:39:41.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.840+0000 7fd940232740 1 -- start start 2024-09-19T09:39:41.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.841+0000 7fd940232740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe8945060 0x558fe8945440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.841+0000 7fd940232740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558fe8945980 0x558fe894fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.841+0000 7fd940232740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe8950240 0x558fe8952630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.841+0000 7fd940232740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558fe88aa620 con 0x558fe8945060 2024-09-19T09:39:41.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.841+0000 7fd940232740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558fe8851e50 con 0x558fe8950240 2024-09-19T09:39:41.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.841+0000 7fd940232740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558fe88a65e0 con 0x558fe8945980 2024-09-19T09:39:41.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.841+0000 7fd937fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe8945060 0x558fe8945440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.841+0000 7fd937fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe8945060 0x558fe8945440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45556/0 (socket says 172.21.15.1:45556) 2024-09-19T09:39:41.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.841+0000 7fd937fff640 1 -- 172.21.15.1:0/3553104221 learned_addr learned my addr 172.21.15.1:0/3553104221 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:41.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.841+0000 7fd9377fe640 1 --2- 172.21.15.1:0/3553104221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558fe8945980 0x558fe894fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.841+0000 7fd934ff9640 1 --2- 172.21.15.1:0/3305584667 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd9200a3240 0x7fd9200a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.841+0000 7fd936ffd640 1 --2- 172.21.15.1:0/3553104221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe8950240 0x558fe8952630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.841+0000 7fd937fff640 1 --2- 172.21.15.1:0/3305584667 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd9200a3240 0x7fd9200a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.841+0000 7fd934ff9640 1 -- 172.21.15.1:0/3305584667 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fd92c0cfad0 con 0x7fd938102790 2024-09-19T09:39:41.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.841+0000 7fd9377fe640 1 -- 172.21.15.1:0/3553104221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe8950240 msgr2=0x558fe8952630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:41.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.841+0000 7fd9377fe640 1 --2- 172.21.15.1:0/3553104221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe8950240 0x558fe8952630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.841+0000 7fd9377fe640 1 -- 172.21.15.1:0/3553104221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe8945060 msgr2=0x558fe8945440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:41.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.841+0000 7fd9377fe640 1 --2- 172.21.15.1:0/3553104221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe8945060 0x558fe8945440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.841+0000 7fd9377fe640 1 -- 172.21.15.1:0/3553104221 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fe8842d40 con 0x558fe8945980 2024-09-19T09:39:41.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.841+0000 7fd9377fe640 1 --2- 172.21.15.1:0/3553104221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558fe8945980 0x558fe894fd00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd92800cba0 tx=0x7fd92800e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34195031835b3b8c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:41.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.842+0000 7fd91dffb640 1 -- 172.21.15.1:0/3553104221 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd928004220 con 0x558fe8945980 2024-09-19T09:39:41.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.842+0000 7fd937fff640 1 --2- 172.21.15.1:0/3305584667 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd9200a3240 0x7fd9200a5700 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd930005fe0 tx=0x7fd93002a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:41.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.842+0000 7fd91dffb640 1 -- 172.21.15.1:0/3553104221 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9280043c0 con 0x558fe8945980 2024-09-19T09:39:41.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.842+0000 7fd91dffb640 1 -- 172.21.15.1:0/3553104221 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9280108f0 con 0x558fe8945980 2024-09-19T09:39:41.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.842+0000 7fd940232740 1 -- 172.21.15.1:0/3553104221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558fe8945980 msgr2=0x558fe894fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:41.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.842+0000 7fd940232740 1 --2- 172.21.15.1:0/3553104221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558fe8945980 0x558fe894fd00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd92800cba0 tx=0x7fd92800e720 comp rx=0 tx=0).stop 2024-09-19T09:39:41.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.842+0000 7fd940232740 1 -- 172.21.15.1:0/3553104221 shutdown_connections 2024-09-19T09:39:41.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.842+0000 7fd940232740 1 --2- 172.21.15.1:0/3553104221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe8950240 0x558fe8952630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.842+0000 7fd940232740 1 --2- 172.21.15.1:0/3553104221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558fe8945980 0x558fe894fd00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.842+0000 7fd940232740 1 --2- 172.21.15.1:0/3553104221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe8945060 0x558fe8945440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.842+0000 7fd940232740 1 -- 172.21.15.1:0/3553104221 >> 172.21.15.1:0/3553104221 conn(0x558fe89415f0 msgr2=0x558fe89419d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:41.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.842+0000 7fd940232740 1 -- 172.21.15.1:0/3553104221 shutdown_connections 2024-09-19T09:39:41.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.842+0000 7fd940232740 1 -- 172.21.15.1:0/3553104221 wait complete. 2024-09-19T09:39:41.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.843+0000 7fd940232740 1 -- start start 2024-09-19T09:39:41.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.843+0000 7fd940232740 1 Processor -- start 2024-09-19T09:39:41.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.843+0000 7fd940232740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe8945060 0x558fe894d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.843+0000 7fd940232740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558fe8945980 0x558fe894d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.843+0000 7fd940232740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe8950240 0x558fe894db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.843+0000 7fd940232740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x558fe8952e10 con 0x558fe8950240 2024-09-19T09:39:41.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.843+0000 7fd940232740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558fe8832f10 con 0x558fe8945060 2024-09-19T09:39:41.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.843+0000 7fd940232740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558fe8952f90 con 0x558fe8945980 2024-09-19T09:39:41.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.843+0000 7fd940232740 10 client.0 _ll_register_callbacks cb 0x558fe8856db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:41.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.843+0000 7fd937fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe8950240 0x558fe894db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.843+0000 7fd937fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe8950240 0x558fe894db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45570/0 (socket says 172.21.15.1:45570) 2024-09-19T09:39:41.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.843+0000 7fd937fff640 1 -- 172.21.15.1:0/2935948840 learned_addr learned my addr 172.21.15.1:0/2935948840 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:41.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.843+0000 7fd9377fe640 1 --2- 172.21.15.1:0/2935948840 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe8945060 0x558fe894d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.844+0000 7fd936ffd640 1 --2- 172.21.15.1:0/2935948840 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558fe8945980 0x558fe894d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.844+0000 7fd937fff640 1 -- 172.21.15.1:0/2935948840 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558fe8945980 msgr2=0x558fe894d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:41.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.844+0000 7fd937fff640 1 --2- 172.21.15.1:0/2935948840 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558fe8945980 0x558fe894d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.844+0000 7fd937fff640 1 -- 172.21.15.1:0/2935948840 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe8945060 msgr2=0x558fe894d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:41.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.844+0000 7fd937fff640 1 --2- 172.21.15.1:0/2935948840 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe8945060 0x558fe894d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.844+0000 7fd937fff640 1 -- 172.21.15.1:0/2935948840 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fe85b9580 con 0x558fe8950240 2024-09-19T09:39:41.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.844+0000 7fd9377fe640 1 --2- 172.21.15.1:0/2935948840 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe8945060 0x558fe894d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:41.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.844+0000 7fd936ffd640 1 --2- 172.21.15.1:0/2935948840 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558fe8945980 0x558fe894d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:41.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.844+0000 7fd937fff640 1 --2- 172.21.15.1:0/2935948840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe8950240 0x558fe894db20 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd930006010 tx=0x7fd9300095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a448aad2ac73b40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:41.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.844+0000 7fd916ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:39:41.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.844+0000 7fd916ffd640 1 -- 172.21.15.1:0/2935948840 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93004e020 con 0x558fe8950240 2024-09-19T09:39:41.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.844+0000 7fd916ffd640 1 -- 172.21.15.1:0/2935948840 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fd9300044c0 con 0x558fe8950240 2024-09-19T09:39:41.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.844+0000 7fd940232740 1 -- 172.21.15.1:0/2935948840 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9280043c0 con 0x558fe8950240 2024-09-19T09:39:41.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.844+0000 7fd916ffd640 1 -- 172.21.15.1:0/2935948840 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd9300046c0 con 0x558fe8950240 2024-09-19T09:39:41.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.845+0000 7fd940232740 10 client.15591 fetch_fsmap learned FSMap version 19 2024-09-19T09:39:41.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.845+0000 7fd940232740 1 -- 172.21.15.1:0/2935948840 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558fe8683960 con 0x558fe8950240 2024-09-19T09:39:41.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.845+0000 7fd916ffd640 1 -- 172.21.15.1:0/2935948840 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9280043c0 con 0x558fe8950240 2024-09-19T09:39:41.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.845+0000 7fd916ffd640 1 -- 172.21.15.1:0/2935948840 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fd930049040 con 0x558fe8950240 2024-09-19T09:39:41.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.845+0000 7fd940232740 10 client.15591 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:39:41.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.845+0000 7fd940232740 10 client.15591 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:39:41.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.845+0000 7fd940232740 20 client.15591 populate_metadata read hostname 'smithi001' 2024-09-19T09:39:41.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.845+0000 7fd940232740 1 --2- 172.21.15.1:0/2935948840 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x558fe895fd70 0x558fe89621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.845+0000 7fd940232740 4 client.15591 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:39:41.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.845+0000 7fd940232740 1 -- 172.21.15.1:0/2935948840 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558fe88b7b90 con 0x558fe895fd70 2024-09-19T09:39:41.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.845+0000 7fd9377fe640 1 --2- 172.21.15.1:0/2935948840 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x558fe895fd70 0x558fe89621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.846+0000 7fd916ffd640 10 client.15591 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:41.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.846+0000 7fd9377fe640 1 --2- 172.21.15.1:0/2935948840 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x558fe895fd70 0x558fe89621e0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4a8fc33b1eb5021 server_cookie=83bef5c2ccf7e467 in_seq=0 out_seq=0 2024-09-19T09:39:41.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.846+0000 7fd916ffd640 1 -- 172.21.15.1:0/2935948840 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558fe88b7b90 con 0x558fe895fd70 2024-09-19T09:39:41.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.846+0000 7fd916ffd640 10 client.15591 handle_command_reply: tid=0 2024-09-19T09:39:41.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.846+0000 7fd940232740 1 client.15591 shutdown 2024-09-19T09:39:41.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.847+0000 7fd940232740 1 -- 172.21.15.1:0/2935948840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe8950240 msgr2=0x558fe894db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:41.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.847+0000 7fd940232740 1 --2- 172.21.15.1:0/2935948840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe8950240 0x558fe894db20 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd930006010 tx=0x7fd9300095c0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.847+0000 7fd940232740 1 -- 172.21.15.1:0/2935948840 shutdown_connections 2024-09-19T09:39:41.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.847+0000 7fd940232740 1 --2- 172.21.15.1:0/2935948840 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x558fe895fd70 0x558fe89621e0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.847+0000 7fd940232740 1 --2- 172.21.15.1:0/2935948840 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe8950240 0x558fe894db20 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.847+0000 7fd940232740 1 --2- 172.21.15.1:0/2935948840 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558fe8945980 0x558fe894d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.847+0000 7fd940232740 1 --2- 172.21.15.1:0/2935948840 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe8945060 0x558fe894d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.847+0000 7fd940232740 1 -- 172.21.15.1:0/2935948840 >> 172.21.15.1:0/2935948840 conn(0x558fe89415f0 msgr2=0x558fe8947320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:41.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.847+0000 7fd916ffd640 0 client.15591 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:41.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.847+0000 7fd940232740 1 -- 172.21.15.1:0/2935948840 shutdown_connections 2024-09-19T09:39:41.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.847+0000 7fd940232740 1 -- 172.21.15.1:0/2935948840 wait complete. 2024-09-19T09:39:41.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.847+0000 7fd940232740 20 client.15591 trim_cache size 0 max 16384 2024-09-19T09:39:41.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.864+0000 7fd940232740 1 Processor -- start 2024-09-19T09:39:41.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.864+0000 7fd940232740 1 -- start start 2024-09-19T09:39:41.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.864+0000 7fd940232740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe8945060 0x558fe894f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.864+0000 7fd940232740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558fe8945980 0x558fe8967ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.864+0000 7fd940232740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe8950240 0x558fe8967ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.864+0000 7fd940232740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd9381ab470 con 0x558fe8950240 2024-09-19T09:39:41.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.864+0000 7fd940232740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd9381add10 con 0x558fe8945060 2024-09-19T09:39:41.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.864+0000 7fd940232740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd9381abb00 con 0x558fe8945980 2024-09-19T09:39:41.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.865+0000 7fd937fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe8950240 0x558fe8967ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.865+0000 7fd937fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe8950240 0x558fe8967ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45582/0 (socket says 172.21.15.1:45582) 2024-09-19T09:39:41.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.865+0000 7fd937fff640 1 -- 172.21.15.1:0/1899826203 learned_addr learned my addr 172.21.15.1:0/1899826203 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:41.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.865+0000 7fd9377fe640 1 --2- 172.21.15.1:0/1899826203 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe8945060 0x558fe894f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.865+0000 7fd936ffd640 1 --2- 172.21.15.1:0/1899826203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558fe8945980 0x558fe8967ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.865+0000 7fd937fff640 1 -- 172.21.15.1:0/1899826203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558fe8945980 msgr2=0x558fe8967ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:41.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.865+0000 7fd937fff640 1 --2- 172.21.15.1:0/1899826203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558fe8945980 0x558fe8967ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.865+0000 7fd937fff640 1 -- 172.21.15.1:0/1899826203 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe8945060 msgr2=0x558fe894f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:41.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.865+0000 7fd937fff640 1 --2- 172.21.15.1:0/1899826203 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe8945060 0x558fe894f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.865+0000 7fd937fff640 1 -- 172.21.15.1:0/1899826203 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fe894c050 con 0x558fe8950240 2024-09-19T09:39:41.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.865+0000 7fd937fff640 1 --2- 172.21.15.1:0/1899826203 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe8950240 0x558fe8967ff0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd9300307f0 tx=0x7fd93002f4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f178ea5b2ce41921 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:41.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.865+0000 7fd91d7fa640 1 -- 172.21.15.1:0/1899826203 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd930063070 con 0x558fe8950240 2024-09-19T09:39:41.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.865+0000 7fd91d7fa640 1 -- 172.21.15.1:0/1899826203 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd930036040 con 0x558fe8950240 2024-09-19T09:39:41.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.865+0000 7fd91d7fa640 1 -- 172.21.15.1:0/1899826203 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93004e070 con 0x558fe8950240 2024-09-19T09:39:41.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.866+0000 7fd940232740 1 -- 172.21.15.1:0/1899826203 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe8950240 msgr2=0x558fe8967ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:41.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.866+0000 7fd940232740 1 --2- 172.21.15.1:0/1899826203 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe8950240 0x558fe8967ff0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd9300307f0 tx=0x7fd93002f4e0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.866+0000 7fd940232740 1 -- 172.21.15.1:0/1899826203 shutdown_connections 2024-09-19T09:39:41.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.866+0000 7fd940232740 1 --2- 172.21.15.1:0/1899826203 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe8950240 0x558fe8967ff0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.866+0000 7fd940232740 1 --2- 172.21.15.1:0/1899826203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558fe8945980 0x558fe8967ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.866+0000 7fd940232740 1 --2- 172.21.15.1:0/1899826203 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe8945060 0x558fe894f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.866+0000 7fd940232740 1 -- 172.21.15.1:0/1899826203 >> 172.21.15.1:0/1899826203 conn(0x558fe89415f0 msgr2=0x558fe894e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:41.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.866+0000 7fd940232740 1 -- 172.21.15.1:0/1899826203 shutdown_connections 2024-09-19T09:39:41.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.866+0000 7fd940232740 1 -- 172.21.15.1:0/1899826203 wait complete. 2024-09-19T09:39:41.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.866+0000 7fd940232740 1 -- start start 2024-09-19T09:39:41.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.867+0000 7fd940232740 1 Processor -- start 2024-09-19T09:39:41.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.867+0000 7fd940232740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558fe8945060 0x558fe8951390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.867+0000 7fd940232740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe8945980 0x558fe89518d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.867+0000 7fd940232740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe8950240 0x558fe8951e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.867+0000 7fd940232740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd9381ac1d0 con 0x558fe8950240 2024-09-19T09:39:41.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.867+0000 7fd940232740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd9381ad640 con 0x558fe8945980 2024-09-19T09:39:41.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.867+0000 7fd940232740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd9381ac8a0 con 0x558fe8945060 2024-09-19T09:39:41.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.867+0000 7fd940232740 10 client.0 _ll_register_callbacks cb 0x7fd930003d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:41.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.867+0000 7fd937fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe8950240 0x558fe8951e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.867+0000 7fd937fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe8950240 0x558fe8951e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45596/0 (socket says 172.21.15.1:45596) 2024-09-19T09:39:41.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.867+0000 7fd937fff640 1 -- 172.21.15.1:0/1500553497 learned_addr learned my addr 172.21.15.1:0/1500553497 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:41.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.867+0000 7fd9377fe640 1 --2- 172.21.15.1:0/1500553497 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558fe8945060 0x558fe8951390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.867+0000 7fd936ffd640 1 --2- 172.21.15.1:0/1500553497 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe8945980 0x558fe89518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.868+0000 7fd937fff640 1 -- 172.21.15.1:0/1500553497 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558fe8945060 msgr2=0x558fe8951390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:41.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.868+0000 7fd937fff640 1 --2- 172.21.15.1:0/1500553497 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558fe8945060 0x558fe8951390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.868+0000 7fd937fff640 1 -- 172.21.15.1:0/1500553497 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe8945980 msgr2=0x558fe89518d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:41.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.868+0000 7fd937fff640 1 --2- 172.21.15.1:0/1500553497 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe8945980 0x558fe89518d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.868+0000 7fd937fff640 1 -- 172.21.15.1:0/1500553497 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fe8956730 con 0x558fe8950240 2024-09-19T09:39:41.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.868+0000 7fd9377fe640 1 --2- 172.21.15.1:0/1500553497 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558fe8945060 0x558fe8951390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:41.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.868+0000 7fd937fff640 1 --2- 172.21.15.1:0/1500553497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe8950240 0x558fe8951e10 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd930009ca0 tx=0x7fd930004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f2faa0ce7cd36fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:41.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.868+0000 7fd916ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:39:41.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.868+0000 7fd916ffd640 1 -- 172.21.15.1:0/1500553497 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93004e070 con 0x558fe8950240 2024-09-19T09:39:41.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.868+0000 7fd916ffd640 1 -- 172.21.15.1:0/1500553497 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fd930030df0 con 0x558fe8950240 2024-09-19T09:39:41.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.868+0000 7fd940232740 1 -- 172.21.15.1:0/1500553497 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd930036040 con 0x558fe8950240 2024-09-19T09:39:41.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.868+0000 7fd916ffd640 1 -- 172.21.15.1:0/1500553497 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd93006f050 con 0x558fe8950240 2024-09-19T09:39:41.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.868+0000 7fd940232740 10 client.15597 fetch_fsmap learned FSMap version 19 2024-09-19T09:39:41.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.868+0000 7fd940232740 1 -- 172.21.15.1:0/1500553497 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x558fe89cad70 con 0x558fe8950240 2024-09-19T09:39:41.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.868+0000 7fd916ffd640 1 -- 172.21.15.1:0/1500553497 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd930036040 con 0x558fe8950240 2024-09-19T09:39:41.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.869+0000 7fd916ffd640 1 -- 172.21.15.1:0/1500553497 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fd930049040 con 0x558fe8950240 2024-09-19T09:39:41.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.869+0000 7fd940232740 10 client.15597 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:39:41.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.869+0000 7fd940232740 10 client.15597 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:39:41.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.869+0000 7fd940232740 20 client.15597 populate_metadata read hostname 'smithi001' 2024-09-19T09:39:41.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.869+0000 7fd940232740 1 --2- 172.21.15.1:0/1500553497 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x558fe89cb3d0 0x558fe89cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:41.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.869+0000 7fd940232740 4 client.15597 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9e4bf5ad", "release": true, "await": true}] 2024-09-19T09:39:41.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.869+0000 7fd940232740 1 -- 172.21.15.1:0/1500553497 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9e4bf5ad", "release": true, "await": true}) -- 0x558fe88b20a0 con 0x558fe89cb3d0 2024-09-19T09:39:41.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.869+0000 7fd9377fe640 1 --2- 172.21.15.1:0/1500553497 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x558fe89cb3d0 0x558fe89cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:41.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.869+0000 7fd9377fe640 1 --2- 172.21.15.1:0/1500553497 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x558fe89cb3d0 0x558fe89cd7f0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=304f6e281c55046a server_cookie=ce15a21024326c81 in_seq=0 out_seq=0 2024-09-19T09:39:41.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.869+0000 7fd916ffd640 10 client.15597 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:41.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.872+0000 7fd916ffd640 1 -- 172.21.15.1:0/1500553497 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x558fe88b20a0 con 0x558fe89cb3d0 2024-09-19T09:39:41.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.872+0000 7fd916ffd640 10 client.15597 handle_command_reply: tid=0 2024-09-19T09:39:41.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.872+0000 7fd940232740 1 client.15597 shutdown 2024-09-19T09:39:41.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.872+0000 7fd940232740 1 -- 172.21.15.1:0/1500553497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe8950240 msgr2=0x558fe8951e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:41.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.872+0000 7fd940232740 1 --2- 172.21.15.1:0/1500553497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe8950240 0x558fe8951e10 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd930009ca0 tx=0x7fd930004ab0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.872+0000 7fd940232740 1 -- 172.21.15.1:0/1500553497 shutdown_connections 2024-09-19T09:39:41.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.872+0000 7fd940232740 1 --2- 172.21.15.1:0/1500553497 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x558fe89cb3d0 0x558fe89cd7f0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.872+0000 7fd940232740 1 --2- 172.21.15.1:0/1500553497 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x558fe8950240 0x558fe8951e10 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.880 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.872+0000 7fd940232740 1 --2- 172.21.15.1:0/1500553497 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558fe8945980 0x558fe89518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.872+0000 7fd916ffd640 0 client.15597 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:41.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.872+0000 7fd940232740 1 --2- 172.21.15.1:0/1500553497 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558fe8945060 0x558fe8951390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.872+0000 7fd940232740 1 -- 172.21.15.1:0/1500553497 >> 172.21.15.1:0/1500553497 conn(0x558fe89415f0 msgr2=0x558fe8940750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:41.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.872+0000 7fd940232740 1 -- 172.21.15.1:0/1500553497 shutdown_connections 2024-09-19T09:39:41.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.872+0000 7fd940232740 1 -- 172.21.15.1:0/1500553497 wait complete. 2024-09-19T09:39:41.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.872+0000 7fd940232740 20 client.15597 trim_cache size 0 max 16384 2024-09-19T09:39:41.881 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:39:41.882 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 19, 2024-09-19T09:39:41.882 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24497, 2024-09-19T09:39:41.882 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 8, 2024-09-19T09:39:41.882 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T09:39:41.882 INFO:teuthology.orchestra.run.smithi001.stdout: "9e4bf5ad": { 2024-09-19T09:39:41.882 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 8, 2024-09-19T09:39:41.882 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T09:39:41.882 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:39:41.882 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T09:39:41.882 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:39:41.882 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:39:41.882 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T09:39:41.882 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 140.3, 2024-09-19T09:39:41.883 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T09:39:41.883 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T09:39:41.883 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T09:39:41.883 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:39:41.883 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T09:39:41.883 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:39:41.883 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:39:41.883 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:39:41.883 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:39:41.883 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:39:41.883 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:39:41.883 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:39:41.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.873+0000 7fd93de59640 1 -- 172.21.15.1:0/3305584667 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd9200a3240 msgr2=0x7fd9200a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:41.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.873+0000 7fd93de59640 1 --2- 172.21.15.1:0/3305584667 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd9200a3240 0x7fd9200a5700 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd930005fe0 tx=0x7fd93002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.873+0000 7fd93de59640 1 -- 172.21.15.1:0/3305584667 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd938102790 msgr2=0x7fd938198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:41.884 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.873+0000 7fd93de59640 1 --2- 172.21.15.1:0/3305584667 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd938102790 0x7fd938198810 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00c920 tx=0x7fd92c00cde0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.873+0000 7fd93de59640 1 -- 172.21.15.1:0/3305584667 shutdown_connections 2024-09-19T09:39:41.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.873+0000 7fd93de59640 1 --2- 172.21.15.1:0/3305584667 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fd9200a3240 0x7fd9200a5700 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.873+0000 7fd93de59640 1 --2- 172.21.15.1:0/3305584667 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd938106f10 0x7fd93819cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.873+0000 7fd93de59640 1 --2- 172.21.15.1:0/3305584667 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd938102790 0x7fd938198810 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.873+0000 7fd93de59640 1 --2- 172.21.15.1:0/3305584667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd938101de0 0x7fd9381982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:41.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.873+0000 7fd93de59640 1 -- 172.21.15.1:0/3305584667 >> 172.21.15.1:0/3305584667 conn(0x7fd9380fd8c0 msgr2=0x7fd9380fe350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:41.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.873+0000 7fd93de59640 1 -- 172.21.15.1:0/3305584667 shutdown_connections 2024-09-19T09:39:41.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:41.873+0000 7fd93de59640 1 -- 172.21.15.1:0/3305584667 wait complete. 2024-09-19T09:39:41.886 INFO:tasks.workunit.client.0.smithi001.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-19T09:39:41.886 INFO:tasks.workunit.client.0.smithi001.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/suites 2024-09-19T09:39:41.886 INFO:tasks.workunit.client.0.smithi001.stderr:+ trap -- retry EXIT 2024-09-19T09:39:41.886 INFO:tasks.workunit.client.0.smithi001.stderr:+ rm -rf ffsb 2024-09-19T09:39:41.886 INFO:tasks.workunit.client.0.smithi001.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2024-09-19T09:39:41.886 INFO:tasks.workunit.client.0.smithi001.stderr:Cloning into 'ffsb'... 2024-09-19T09:39:42.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:42 smithi022 ceph-mon[35583]: pgmap v386: 97 pgs: 97 active+clean; 665 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 853 B/s wr, 3 op/s 2024-09-19T09:39:42.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:42 smithi121 ceph-mon[35577]: pgmap v386: 97 pgs: 97 active+clean; 665 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 853 B/s wr, 3 op/s 2024-09-19T09:39:42.369 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:42 smithi001 ceph-mon[31225]: pgmap v386: 97 pgs: 97 active+clean; 665 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 853 B/s wr, 3 op/s 2024-09-19T09:39:42.682 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '9e4bf5ad', total seconds elapsed: 23.7 2024-09-19T09:39:42.682 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T09:39:42.683 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:39:42.797 INFO:tasks.workunit.client.0.smithi001.stderr:+ trap - EXIT 2024-09-19T09:39:42.797 INFO:tasks.workunit.client.0.smithi001.stderr:+ cd ffsb 2024-09-19T09:39:42.797 INFO:tasks.workunit.client.0.smithi001.stderr:+ ./configure 2024-09-19T09:39:42.932 INFO:tasks.workunit.client.0.smithi001.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-19T09:39:42.943 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:43.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.405+0000 7f77f206e640 1 -- 172.21.15.1:0/1419430427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77ec1037a0 msgr2=0x7f77ec10bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:43.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.405+0000 7f77f206e640 1 --2- 172.21.15.1:0/1419430427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77ec1037a0 0x7f77ec10bc00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f77e0009900 tx=0x7f77e002a410 comp rx=0 tx=0).stop 2024-09-19T09:39:43.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.405+0000 7f77f206e640 1 -- 172.21.15.1:0/1419430427 shutdown_connections 2024-09-19T09:39:43.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.405+0000 7f77f206e640 1 --2- 172.21.15.1:0/1419430427 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77ec10c2f0 0x7f77ec10e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:43.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.405+0000 7f77f206e640 1 --2- 172.21.15.1:0/1419430427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77ec1037a0 0x7f77ec10bc00 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:43.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.405+0000 7f77f206e640 1 --2- 172.21.15.1:0/1419430427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77ec102df0 0x7f77ec1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:43.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.405+0000 7f77f206e640 1 -- 172.21.15.1:0/1419430427 >> 172.21.15.1:0/1419430427 conn(0x7f77ec0fc7d0 msgr2=0x7f77ec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:43.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.405+0000 7f77f206e640 1 -- 172.21.15.1:0/1419430427 shutdown_connections 2024-09-19T09:39:43.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.405+0000 7f77f206e640 1 -- 172.21.15.1:0/1419430427 wait complete. 2024-09-19T09:39:43.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.405+0000 7f77f206e640 1 Processor -- start 2024-09-19T09:39:43.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.406+0000 7f77f206e640 1 -- start start 2024-09-19T09:39:43.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.406+0000 7f77f206e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77ec102df0 0x7f77ec100a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:43.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.406+0000 7f77f206e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77ec1037a0 0x7f77ec100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:43.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.406+0000 7f77f206e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77ec10c2f0 0x7f77ec1014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:43.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.406+0000 7f77f206e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f77ec1120b0 con 0x7f77ec10c2f0 2024-09-19T09:39:43.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.406+0000 7f77f206e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f77ec111f30 con 0x7f77ec102df0 2024-09-19T09:39:43.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.406+0000 7f77f206e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f77ec112230 con 0x7f77ec1037a0 2024-09-19T09:39:43.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.406+0000 7f77ebfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77ec10c2f0 0x7f77ec1014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:43.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.406+0000 7f77ebfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77ec10c2f0 0x7f77ec1014d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45626/0 (socket says 172.21.15.1:45626) 2024-09-19T09:39:43.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.406+0000 7f77ebfff640 1 -- 172.21.15.1:0/1177452577 learned_addr learned my addr 172.21.15.1:0/1177452577 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:43.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.406+0000 7f77eaffd640 1 --2- 172.21.15.1:0/1177452577 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77ec1037a0 0x7f77ec100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:43.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.406+0000 7f77eb7fe640 1 --2- 172.21.15.1:0/1177452577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77ec102df0 0x7f77ec100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:43.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.406+0000 7f77ebfff640 1 -- 172.21.15.1:0/1177452577 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77ec1037a0 msgr2=0x7f77ec100f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:43.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.406+0000 7f77ebfff640 1 --2- 172.21.15.1:0/1177452577 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77ec1037a0 0x7f77ec100f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:43.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.406+0000 7f77ebfff640 1 -- 172.21.15.1:0/1177452577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77ec102df0 msgr2=0x7f77ec100a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:43.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.406+0000 7f77ebfff640 1 --2- 172.21.15.1:0/1177452577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77ec102df0 0x7f77ec100a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:43.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.406+0000 7f77ebfff640 1 -- 172.21.15.1:0/1177452577 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77ec1a6af0 con 0x7f77ec10c2f0 2024-09-19T09:39:43.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.406+0000 7f77eb7fe640 1 --2- 172.21.15.1:0/1177452577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77ec102df0 0x7f77ec100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:43.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.406+0000 7f77ebfff640 1 --2- 172.21.15.1:0/1177452577 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77ec10c2f0 0x7f77ec1014d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f77e400eaa0 tx=0x7f77e400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:43.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.407+0000 7f77e8ff9640 1 -- 172.21.15.1:0/1177452577 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e400cdb0 con 0x7f77ec10c2f0 2024-09-19T09:39:43.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.407+0000 7f77e8ff9640 1 -- 172.21.15.1:0/1177452577 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77e4005020 con 0x7f77ec10c2f0 2024-09-19T09:39:43.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.407+0000 7f77f206e640 1 -- 172.21.15.1:0/1177452577 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77ec1a6de0 con 0x7f77ec10c2f0 2024-09-19T09:39:43.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.407+0000 7f77e8ff9640 1 -- 172.21.15.1:0/1177452577 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e40116b0 con 0x7f77ec10c2f0 2024-09-19T09:39:43.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.407+0000 7f77f206e640 1 -- 172.21.15.1:0/1177452577 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77ec1a72a0 con 0x7f77ec10c2f0 2024-09-19T09:39:43.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.408+0000 7f77f206e640 1 -- 172.21.15.1:0/1177452577 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77ec1031d0 con 0x7f77ec10c2f0 2024-09-19T09:39:43.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.409+0000 7f77e8ff9640 1 -- 172.21.15.1:0/1177452577 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f77e4005560 con 0x7f77ec10c2f0 2024-09-19T09:39:43.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.409+0000 7f77e8ff9640 1 --2- 172.21.15.1:0/1177452577 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f77d40a3240 0x7f77d40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:43.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.410+0000 7f77e8ff9640 1 -- 172.21.15.1:0/1177452577 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f77e40cfb00 con 0x7f77ec10c2f0 2024-09-19T09:39:43.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.410+0000 7f77eb7fe640 1 --2- 172.21.15.1:0/1177452577 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f77d40a3240 0x7f77d40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:43.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.410+0000 7f77eb7fe640 1 --2- 172.21.15.1:0/1177452577 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f77d40a3240 0x7f77d40a5700 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f77dc005fd0 tx=0x7f77dc00b5f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:43.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.414+0000 7f77e8ff9640 1 -- 172.21.15.1:0/1177452577 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f77e4016030 con 0x7f77ec10c2f0 2024-09-19T09:39:43.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.625+0000 7f77f206e640 1 -- 172.21.15.1:0/1177452577 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77ec1072c0 con 0x7f77ec10c2f0 2024-09-19T09:39:43.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.625+0000 7f77e8ff9640 1 -- 172.21.15.1:0/1177452577 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11837 (secure 0 0 0) 0x7f77e409c820 con 0x7f77ec10c2f0 2024-09-19T09:39:43.627 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:39:43.627 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":19,"btime":"2024-09-19T09:36:24:006349+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:36:23.723388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6839/3279971690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3279971690},{"type":"v1","addr":"172.21.15.121:6839","nonce":3279971690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:39:43.628 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 19 2024-09-19T09:39:43.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.627+0000 7f77f206e640 1 -- 172.21.15.1:0/1177452577 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f77d40a3240 msgr2=0x7f77d40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:43.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.627+0000 7f77f206e640 1 --2- 172.21.15.1:0/1177452577 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f77d40a3240 0x7f77d40a5700 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f77dc005fd0 tx=0x7f77dc00b5f0 comp rx=0 tx=0).stop 2024-09-19T09:39:43.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.627+0000 7f77f206e640 1 -- 172.21.15.1:0/1177452577 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77ec10c2f0 msgr2=0x7f77ec1014d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:43.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.627+0000 7f77f206e640 1 --2- 172.21.15.1:0/1177452577 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77ec10c2f0 0x7f77ec1014d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f77e400eaa0 tx=0x7f77e400ef60 comp rx=0 tx=0).stop 2024-09-19T09:39:43.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.628+0000 7f77f206e640 1 -- 172.21.15.1:0/1177452577 shutdown_connections 2024-09-19T09:39:43.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.628+0000 7f77f206e640 1 --2- 172.21.15.1:0/1177452577 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77ec10c2f0 0x7f77ec1014d0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:43.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.628+0000 7f77f206e640 1 --2- 172.21.15.1:0/1177452577 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f77ec1037a0 0x7f77ec100f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:43.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.628+0000 7f77f206e640 1 --2- 172.21.15.1:0/1177452577 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f77d40a3240 0x7f77d40a5700 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:43.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.628+0000 7f77f206e640 1 --2- 172.21.15.1:0/1177452577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f77ec102df0 0x7f77ec100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:43.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.628+0000 7f77f206e640 1 -- 172.21.15.1:0/1177452577 >> 172.21.15.1:0/1177452577 conn(0x7f77ec0fc7d0 msgr2=0x7f77ec0fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:43.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.628+0000 7f77f206e640 1 -- 172.21.15.1:0/1177452577 shutdown_connections 2024-09-19T09:39:43.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:43.628+0000 7f77f206e640 1 -- 172.21.15.1:0/1177452577 wait complete. 2024-09-19T09:39:43.940 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether build environment is sane... yes 2024-09-19T09:39:43.949 INFO:tasks.workunit.client.0.smithi001.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-19T09:39:43.949 INFO:tasks.workunit.client.0.smithi001.stdout:checking for gawk... gawk 2024-09-19T09:39:43.964 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether make sets $(MAKE)... yes 2024-09-19T09:39:43.995 INFO:tasks.workunit.client.0.smithi001.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-19T09:39:43.995 INFO:tasks.workunit.client.0.smithi001.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-19T09:39:44.007 INFO:tasks.workunit.client.0.smithi001.stdout:checking for style of include used by make... GNU 2024-09-19T09:39:44.011 INFO:tasks.workunit.client.0.smithi001.stdout:checking for gcc... gcc 2024-09-19T09:39:44.063 INFO:tasks.workunit.client.0.smithi001.stdout:checking for C compiler default output file name... a.out 2024-09-19T09:39:44.064 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether the C compiler works... yes 2024-09-19T09:39:44.066 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether we are cross compiling... no 2024-09-19T09:39:44.104 INFO:tasks.workunit.client.0.smithi001.stdout:checking for suffix of executables... 2024-09-19T09:39:44.136 INFO:tasks.workunit.client.0.smithi001.stdout:checking for suffix of object files... o 2024-09-19T09:39:44.175 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether we are using the GNU C compiler... yes 2024-09-19T09:39:44.212 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether gcc accepts -g... yes 2024-09-19T09:39:44.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:44 smithi001 ceph-mon[31225]: pgmap v387: 97 pgs: 97 active+clean; 665 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-19T09:39:44.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:44 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1177452577' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:44.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:44 smithi022 ceph-mon[35583]: pgmap v387: 97 pgs: 97 active+clean; 665 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-19T09:39:44.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:44 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1177452577' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:44.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:44 smithi121 ceph-mon[35577]: pgmap v387: 97 pgs: 97 active+clean; 665 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-19T09:39:44.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:44 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1177452577' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:39:44.392 INFO:tasks.workunit.client.0.smithi001.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-19T09:39:44.394 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T09:39:44.394 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T09:39:44.491 INFO:tasks.workunit.client.0.smithi001.stdout:checking dependency style of gcc... gcc3 2024-09-19T09:39:44.577 INFO:tasks.workunit.client.0.smithi001.stdout:checking how to run the C preprocessor... gcc -E 2024-09-19T09:39:44.619 INFO:tasks.workunit.client.0.smithi001.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-19T09:39:44.620 INFO:tasks.workunit.client.0.smithi001.stdout:checking for egrep... /usr/bin/grep -E 2024-09-19T09:39:44.630 INFO:tasks.workunit.client.0.smithi001.stdout:checking for AIX... no 2024-09-19T09:39:44.648 INFO:tasks.workunit.client.0.smithi001.stdout:checking for gcc... (cached) gcc 2024-09-19T09:39:44.656 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:39:44.657 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-19T09:39:44.657 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-19T09:39:44.657 INFO:tasks.workunit.client.0.smithi001.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-19T09:39:44.657 INFO:tasks.workunit.client.0.smithi001.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-19T09:39:44.712 INFO:tasks.workunit.client.0.smithi001.stdout:checking for main in -lm... yes 2024-09-19T09:39:44.792 INFO:tasks.workunit.client.0.smithi001.stdout:checking for main in -lpthread... yes 2024-09-19T09:39:44.972 INFO:tasks.workunit.client.0.smithi001.stdout:checking for ANSI C header files... yes 2024-09-19T09:39:45.166 INFO:tasks.workunit.client.0.smithi001.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-19T09:39:45.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.195+0000 7f2a8ded5640 1 -- 172.21.15.1:0/2416922455 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a88106f10 msgr2=0x7f2a8810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:45.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.195+0000 7f2a8ded5640 1 --2- 172.21.15.1:0/2416922455 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a88106f10 0x7f2a8810ea90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2a80009ca0 tx=0x7f2a8002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.195+0000 7f2a8ded5640 1 -- 172.21.15.1:0/2416922455 shutdown_connections 2024-09-19T09:39:45.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.195+0000 7f2a8ded5640 1 --2- 172.21.15.1:0/2416922455 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a88106f10 0x7f2a8810ea90 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.195+0000 7f2a8ded5640 1 --2- 172.21.15.1:0/2416922455 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a88102790 0x7f2a881067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.195+0000 7f2a8ded5640 1 --2- 172.21.15.1:0/2416922455 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a88101de0 0x7f2a881021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.195+0000 7f2a8ded5640 1 -- 172.21.15.1:0/2416922455 >> 172.21.15.1:0/2416922455 conn(0x7f2a880fd8c0 msgr2=0x7f2a880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:45.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.195+0000 7f2a8ded5640 1 -- 172.21.15.1:0/2416922455 shutdown_connections 2024-09-19T09:39:45.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.195+0000 7f2a8ded5640 1 -- 172.21.15.1:0/2416922455 wait complete. 2024-09-19T09:39:45.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.196+0000 7f2a8ded5640 1 Processor -- start 2024-09-19T09:39:45.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.196+0000 7f2a8ded5640 1 -- start start 2024-09-19T09:39:45.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.196+0000 7f2a8ded5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a88101de0 0x7f2a88198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.196+0000 7f2a8ded5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a88102790 0x7f2a88198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.196+0000 7f2a8ded5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a88106f10 0x7f2a8819cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.197+0000 7f2a8ded5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2a88111f70 con 0x7f2a88106f10 2024-09-19T09:39:45.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.197+0000 7f2a8ded5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2a88111df0 con 0x7f2a88101de0 2024-09-19T09:39:45.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.197+0000 7f2a8ded5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2a881120f0 con 0x7f2a88102790 2024-09-19T09:39:45.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.197+0000 7f2a87fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a88106f10 0x7f2a8819cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.197+0000 7f2a87fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a88106f10 0x7f2a8819cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45654/0 (socket says 172.21.15.1:45654) 2024-09-19T09:39:45.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.197+0000 7f2a87fff640 1 -- 172.21.15.1:0/3907292924 learned_addr learned my addr 172.21.15.1:0/3907292924 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:45.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.197+0000 7f2a877fe640 1 --2- 172.21.15.1:0/3907292924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a88101de0 0x7f2a88198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.197+0000 7f2a86ffd640 1 --2- 172.21.15.1:0/3907292924 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a88102790 0x7f2a88198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.197+0000 7f2a87fff640 1 -- 172.21.15.1:0/3907292924 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a88102790 msgr2=0x7f2a88198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:45.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.197+0000 7f2a87fff640 1 --2- 172.21.15.1:0/3907292924 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a88102790 0x7f2a88198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.197+0000 7f2a87fff640 1 -- 172.21.15.1:0/3907292924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a88101de0 msgr2=0x7f2a88198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:45.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.197+0000 7f2a87fff640 1 --2- 172.21.15.1:0/3907292924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a88101de0 0x7f2a88198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.197+0000 7f2a87fff640 1 -- 172.21.15.1:0/3907292924 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a8819d2f0 con 0x7f2a88106f10 2024-09-19T09:39:45.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.197+0000 7f2a86ffd640 1 --2- 172.21.15.1:0/3907292924 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a88102790 0x7f2a88198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:45.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.197+0000 7f2a87fff640 1 --2- 172.21.15.1:0/3907292924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a88106f10 0x7f2a8819cc10 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2a80031a20 tx=0x7f2a80031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:45.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.198+0000 7f2a84ff9640 1 -- 172.21.15.1:0/3907292924 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a80003c30 con 0x7f2a88106f10 2024-09-19T09:39:45.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.198+0000 7f2a8ded5640 1 -- 172.21.15.1:0/3907292924 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a8819d580 con 0x7f2a88106f10 2024-09-19T09:39:45.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.198+0000 7f2a84ff9640 1 -- 172.21.15.1:0/3907292924 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a80003dd0 con 0x7f2a88106f10 2024-09-19T09:39:45.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.198+0000 7f2a84ff9640 1 -- 172.21.15.1:0/3907292924 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8002fcf0 con 0x7f2a88106f10 2024-09-19T09:39:45.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.198+0000 7f2a8ded5640 1 -- 172.21.15.1:0/3907292924 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a881a4ec0 con 0x7f2a88106f10 2024-09-19T09:39:45.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.201+0000 7f2a84ff9640 1 -- 172.21.15.1:0/3907292924 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f2a800305c0 con 0x7f2a88106f10 2024-09-19T09:39:45.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.201+0000 7f2a902ae740 1 Processor -- start 2024-09-19T09:39:45.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.201+0000 7f2a902ae740 1 -- start start 2024-09-19T09:39:45.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.201+0000 7f2a902ae740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562286112750 0x562286112b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.201+0000 7f2a902ae740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562286113070 0x562286121900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.201+0000 7f2a902ae740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562286121e40 0x562286124230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.201+0000 7f2a902ae740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562286077160 con 0x562286121e40 2024-09-19T09:39:45.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.201+0000 7f2a902ae740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56228601e720 con 0x562286113070 2024-09-19T09:39:45.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.201+0000 7f2a902ae740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562286073120 con 0x562286112750 2024-09-19T09:39:45.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.201+0000 7f2a86ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562286121e40 0x562286124230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.201+0000 7f2a877fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562286113070 0x562286121900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.201+0000 7f2a86ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562286121e40 0x562286124230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45656/0 (socket says 172.21.15.1:45656) 2024-09-19T09:39:45.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.201+0000 7f2a877fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562286113070 0x562286121900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:53032/0 (socket says 172.21.15.1:53032) 2024-09-19T09:39:45.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.201+0000 7f2a86ffd640 1 -- 172.21.15.1:0/411174368 learned_addr learned my addr 172.21.15.1:0/411174368 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:45.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.201+0000 7f2a86ffd640 1 --2- 172.21.15.1:0/411174368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562286112750 0x562286112b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.202+0000 7f2a877fe640 1 -- 172.21.15.1:0/411174368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562286112750 msgr2=0x562286112b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:45.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.202+0000 7f2a877fe640 1 --2- 172.21.15.1:0/411174368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562286112750 0x562286112b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.202+0000 7f2a877fe640 1 -- 172.21.15.1:0/411174368 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562286121e40 msgr2=0x562286124230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:45.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.202+0000 7f2a877fe640 1 --2- 172.21.15.1:0/411174368 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562286121e40 0x562286124230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.202+0000 7f2a877fe640 1 -- 172.21.15.1:0/411174368 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562285de8ba0 con 0x562286113070 2024-09-19T09:39:45.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.202+0000 7f2a86ffd640 1 --2- 172.21.15.1:0/411174368 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562286121e40 0x562286124230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:45.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.202+0000 7f2a84ff9640 1 --2- 172.21.15.1:0/3907292924 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f2a700a3240 0x7f2a700a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.202+0000 7f2a86ffd640 1 --2- 172.21.15.1:0/3907292924 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f2a700a3240 0x7f2a700a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.202+0000 7f2a877fe640 1 --2- 172.21.15.1:0/411174368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562286113070 0x562286121900 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2a78004630 tx=0x7f2a7800bb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=400b7d85648e9fbc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:45.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.202+0000 7f2a84ff9640 1 -- 172.21.15.1:0/3907292924 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f2a800f0c40 con 0x7f2a88106f10 2024-09-19T09:39:45.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.202+0000 7f2a6dffb640 1 -- 172.21.15.1:0/411174368 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a78003bd0 con 0x562286113070 2024-09-19T09:39:45.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.202+0000 7f2a6dffb640 1 -- 172.21.15.1:0/411174368 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a78015070 con 0x562286113070 2024-09-19T09:39:45.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.202+0000 7f2a6dffb640 1 -- 172.21.15.1:0/411174368 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a78004d90 con 0x562286113070 2024-09-19T09:39:45.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.203+0000 7f2a86ffd640 1 --2- 172.21.15.1:0/3907292924 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f2a700a3240 0x7f2a700a5700 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x5622861142f0 tx=0x7f2a7c00b660 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:45.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.203+0000 7f2a902ae740 1 -- 172.21.15.1:0/411174368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562286113070 msgr2=0x562286121900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:45.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.203+0000 7f2a902ae740 1 --2- 172.21.15.1:0/411174368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562286113070 0x562286121900 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2a78004630 tx=0x7f2a7800bb20 comp rx=0 tx=0).stop 2024-09-19T09:39:45.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.203+0000 7f2a902ae740 1 -- 172.21.15.1:0/411174368 shutdown_connections 2024-09-19T09:39:45.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.203+0000 7f2a902ae740 1 --2- 172.21.15.1:0/411174368 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562286121e40 0x562286124230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.203+0000 7f2a902ae740 1 --2- 172.21.15.1:0/411174368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562286113070 0x562286121900 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.203+0000 7f2a902ae740 1 --2- 172.21.15.1:0/411174368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562286112750 0x562286112b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.203+0000 7f2a902ae740 1 -- 172.21.15.1:0/411174368 >> 172.21.15.1:0/411174368 conn(0x56228610ede0 msgr2=0x56228610f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:45.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.203+0000 7f2a902ae740 1 -- 172.21.15.1:0/411174368 shutdown_connections 2024-09-19T09:39:45.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.203+0000 7f2a902ae740 1 -- 172.21.15.1:0/411174368 wait complete. 2024-09-19T09:39:45.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.204+0000 7f2a902ae740 1 -- start start 2024-09-19T09:39:45.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.204+0000 7f2a902ae740 1 Processor -- start 2024-09-19T09:39:45.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.204+0000 7f2a902ae740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562286112750 0x56228611ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.204+0000 7f2a902ae740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562286113070 0x56228611f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.204+0000 7f2a902ae740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562286121e40 0x56228611f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.204+0000 7f2a902ae740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562286124a70 con 0x562286121e40 2024-09-19T09:39:45.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.204+0000 7f2a902ae740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562285fff900 con 0x562286113070 2024-09-19T09:39:45.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.204+0000 7f2a902ae740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562286124bf0 con 0x562286112750 2024-09-19T09:39:45.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.204+0000 7f2a902ae740 10 client.0 _ll_register_callbacks cb 0x562285ffd780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:45.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.204+0000 7f2a86ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562286113070 0x56228611f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.205+0000 7f2a87fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562286121e40 0x56228611f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.205+0000 7f2a86ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562286113070 0x56228611f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:53036/0 (socket says 172.21.15.1:53036) 2024-09-19T09:39:45.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.205+0000 7f2a86ffd640 1 -- 172.21.15.1:0/643748000 learned_addr learned my addr 172.21.15.1:0/643748000 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:45.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.205+0000 7f2a877fe640 1 --2- 172.21.15.1:0/643748000 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562286112750 0x56228611ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.205+0000 7f2a86ffd640 1 -- 172.21.15.1:0/643748000 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562286112750 msgr2=0x56228611ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:45.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.205+0000 7f2a86ffd640 1 --2- 172.21.15.1:0/643748000 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562286112750 0x56228611ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.205+0000 7f2a86ffd640 1 -- 172.21.15.1:0/643748000 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562286121e40 msgr2=0x56228611f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:45.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.205+0000 7f2a86ffd640 1 --2- 172.21.15.1:0/643748000 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562286121e40 0x56228611f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.205+0000 7f2a86ffd640 1 -- 172.21.15.1:0/643748000 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56228603fc50 con 0x562286113070 2024-09-19T09:39:45.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.205+0000 7f2a87fff640 1 --2- 172.21.15.1:0/643748000 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562286121e40 0x56228611f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:45.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.205+0000 7f2a86ffd640 1 --2- 172.21.15.1:0/643748000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562286113070 0x56228611f2c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c005de0 tx=0x7f2a7c005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6f6b39f813d430f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:45.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.205+0000 7f2a66ffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:39:45.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.205+0000 7f2a66ffd640 1 -- 172.21.15.1:0/643748000 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c021610 con 0x562286113070 2024-09-19T09:39:45.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.205+0000 7f2a902ae740 1 -- 172.21.15.1:0/643748000 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a78015070 con 0x562286113070 2024-09-19T09:39:45.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.205+0000 7f2a66ffd640 1 -- 172.21.15.1:0/643748000 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f2a7c0217b0 con 0x562286113070 2024-09-19T09:39:45.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.206+0000 7f2a66ffd640 1 -- 172.21.15.1:0/643748000 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2a7c0219b0 con 0x562286113070 2024-09-19T09:39:45.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.206+0000 7f2a902ae740 10 client.25292 fetch_fsmap learned FSMap version 19 2024-09-19T09:39:45.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.206+0000 7f2a902ae740 1 -- 172.21.15.1:0/643748000 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x562286130810 con 0x562286113070 2024-09-19T09:39:45.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.206+0000 7f2a66ffd640 1 -- 172.21.15.1:0/643748000 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a78015070 con 0x562286113070 2024-09-19T09:39:45.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.206+0000 7f2a66ffd640 1 -- 172.21.15.1:0/643748000 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f2a7c01d070 con 0x562286113070 2024-09-19T09:39:45.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.206+0000 7f2a902ae740 10 client.25292 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:39:45.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.206+0000 7f2a902ae740 10 client.25292 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:39:45.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.206+0000 7f2a902ae740 20 client.25292 populate_metadata read hostname 'smithi001' 2024-09-19T09:39:45.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.206+0000 7f2a902ae740 1 --2- 172.21.15.1:0/643748000 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x562286131d20 0x562286134160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.206+0000 7f2a902ae740 4 client.25292 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:39:45.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.206+0000 7f2a902ae740 1 -- 172.21.15.1:0/643748000 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562286084890 con 0x562286131d20 2024-09-19T09:39:45.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.206+0000 7f2a877fe640 1 --2- 172.21.15.1:0/643748000 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x562286131d20 0x562286134160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.207+0000 7f2a66ffd640 10 client.25292 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:45.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.207+0000 7f2a877fe640 1 --2- 172.21.15.1:0/643748000 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x562286131d20 0x562286134160 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df9a07dc748ecc3 server_cookie=51f772935129f3d0 in_seq=0 out_seq=0 2024-09-19T09:39:45.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.207+0000 7f2a66ffd640 1 -- 172.21.15.1:0/643748000 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562286084890 con 0x562286131d20 2024-09-19T09:39:45.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.207+0000 7f2a66ffd640 10 client.25292 handle_command_reply: tid=0 2024-09-19T09:39:45.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.207+0000 7f2a902ae740 1 client.25292 shutdown 2024-09-19T09:39:45.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.207+0000 7f2a902ae740 1 -- 172.21.15.1:0/643748000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562286113070 msgr2=0x56228611f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:45.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.207+0000 7f2a902ae740 1 --2- 172.21.15.1:0/643748000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562286113070 0x56228611f2c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c005de0 tx=0x7f2a7c005f90 comp rx=0 tx=0).stop 2024-09-19T09:39:45.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.208+0000 7f2a902ae740 1 -- 172.21.15.1:0/643748000 shutdown_connections 2024-09-19T09:39:45.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.208+0000 7f2a902ae740 1 --2- 172.21.15.1:0/643748000 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x562286131d20 0x562286134160 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.208+0000 7f2a902ae740 1 --2- 172.21.15.1:0/643748000 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562286121e40 0x56228611f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.208+0000 7f2a902ae740 1 --2- 172.21.15.1:0/643748000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562286113070 0x56228611f2c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.208+0000 7f2a66ffd640 0 client.25292 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:45.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.208+0000 7f2a902ae740 1 --2- 172.21.15.1:0/643748000 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562286112750 0x56228611ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.208+0000 7f2a902ae740 1 -- 172.21.15.1:0/643748000 >> 172.21.15.1:0/643748000 conn(0x56228610ede0 msgr2=0x562286114b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:45.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.208+0000 7f2a902ae740 1 -- 172.21.15.1:0/643748000 shutdown_connections 2024-09-19T09:39:45.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.208+0000 7f2a902ae740 1 -- 172.21.15.1:0/643748000 wait complete. 2024-09-19T09:39:45.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.208+0000 7f2a902ae740 20 client.25292 trim_cache size 0 max 16384 2024-09-19T09:39:45.217 INFO:tasks.workunit.client.0.smithi001.stdout:checking for sys/types.h... yes 2024-09-19T09:39:45.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.225+0000 7f2a902ae740 1 Processor -- start 2024-09-19T09:39:45.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.225+0000 7f2a902ae740 1 -- start start 2024-09-19T09:39:45.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.225+0000 7f2a902ae740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562286112750 0x56228611dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.225+0000 7f2a902ae740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562286113070 0x562286139a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.225+0000 7f2a902ae740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562286121e40 0x562286139f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.225+0000 7f2a902ae740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2a881a9280 con 0x562286113070 2024-09-19T09:39:45.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.225+0000 7f2a902ae740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2a881abb20 con 0x562286112750 2024-09-19T09:39:45.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.225+0000 7f2a902ae740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2a881a9910 con 0x562286121e40 2024-09-19T09:39:45.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.226+0000 7f2a86ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562286113070 0x562286139a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.226+0000 7f2a86ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562286113070 0x562286139a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45672/0 (socket says 172.21.15.1:45672) 2024-09-19T09:39:45.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.226+0000 7f2a877fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562286112750 0x56228611dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.226+0000 7f2a86ffd640 1 -- 172.21.15.1:0/1327850171 learned_addr learned my addr 172.21.15.1:0/1327850171 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:45.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.226+0000 7f2a87fff640 1 --2- 172.21.15.1:0/1327850171 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562286121e40 0x562286139f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.226+0000 7f2a86ffd640 1 -- 172.21.15.1:0/1327850171 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562286121e40 msgr2=0x562286139f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:45.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.226+0000 7f2a86ffd640 1 --2- 172.21.15.1:0/1327850171 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562286121e40 0x562286139f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.226+0000 7f2a86ffd640 1 -- 172.21.15.1:0/1327850171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562286112750 msgr2=0x56228611dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:45.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.226+0000 7f2a86ffd640 1 --2- 172.21.15.1:0/1327850171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562286112750 0x56228611dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.226+0000 7f2a86ffd640 1 -- 172.21.15.1:0/1327850171 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56228610a3f0 con 0x562286113070 2024-09-19T09:39:45.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.226+0000 7f2a877fe640 1 --2- 172.21.15.1:0/1327850171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562286112750 0x56228611dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:45.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.226+0000 7f2a86ffd640 1 --2- 172.21.15.1:0/1327850171 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562286113070 0x562286139a30 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c005e10 tx=0x7f2a7c034f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42197af7254b3acc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:45.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.226+0000 7f2a6d7fa640 1 -- 172.21.15.1:0/1327850171 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c021d50 con 0x562286113070 2024-09-19T09:39:45.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.226+0000 7f2a6d7fa640 1 -- 172.21.15.1:0/1327850171 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a7c01a070 con 0x562286113070 2024-09-19T09:39:45.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.226+0000 7f2a6d7fa640 1 -- 172.21.15.1:0/1327850171 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c034660 con 0x562286113070 2024-09-19T09:39:45.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.227+0000 7f2a902ae740 1 -- 172.21.15.1:0/1327850171 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562286113070 msgr2=0x562286139a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:45.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.227+0000 7f2a902ae740 1 --2- 172.21.15.1:0/1327850171 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562286113070 0x562286139a30 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c005e10 tx=0x7f2a7c034f40 comp rx=0 tx=0).stop 2024-09-19T09:39:45.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.227+0000 7f2a902ae740 1 -- 172.21.15.1:0/1327850171 shutdown_connections 2024-09-19T09:39:45.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.227+0000 7f2a902ae740 1 --2- 172.21.15.1:0/1327850171 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562286121e40 0x562286139f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.227+0000 7f2a902ae740 1 --2- 172.21.15.1:0/1327850171 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562286113070 0x562286139a30 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.227+0000 7f2a902ae740 1 --2- 172.21.15.1:0/1327850171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562286112750 0x56228611dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.227+0000 7f2a902ae740 1 -- 172.21.15.1:0/1327850171 >> 172.21.15.1:0/1327850171 conn(0x56228610ede0 msgr2=0x562286114b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:45.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.227+0000 7f2a902ae740 1 -- 172.21.15.1:0/1327850171 shutdown_connections 2024-09-19T09:39:45.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.227+0000 7f2a902ae740 1 -- 172.21.15.1:0/1327850171 wait complete. 2024-09-19T09:39:45.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.228+0000 7f2a902ae740 1 -- start start 2024-09-19T09:39:45.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.228+0000 7f2a902ae740 1 Processor -- start 2024-09-19T09:39:45.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.228+0000 7f2a902ae740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562286112750 0x56228612a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.228+0000 7f2a902ae740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562286113070 0x562286125a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.228+0000 7f2a902ae740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562286121e40 0x562286126010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.228+0000 7f2a902ae740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2a881a9fe0 con 0x562286121e40 2024-09-19T09:39:45.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.228+0000 7f2a902ae740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2a881ab450 con 0x562286113070 2024-09-19T09:39:45.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.228+0000 7f2a902ae740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2a881aa6b0 con 0x562286112750 2024-09-19T09:39:45.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.228+0000 7f2a902ae740 10 client.0 _ll_register_callbacks cb 0x7f2a7c00b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:45.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.228+0000 7f2a87fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562286121e40 0x562286126010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.229+0000 7f2a86ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562286113070 0x562286125a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.229+0000 7f2a87fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562286121e40 0x562286126010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45682/0 (socket says 172.21.15.1:45682) 2024-09-19T09:39:45.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.229+0000 7f2a87fff640 1 -- 172.21.15.1:0/4286265084 learned_addr learned my addr 172.21.15.1:0/4286265084 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:45.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.229+0000 7f2a877fe640 1 --2- 172.21.15.1:0/4286265084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562286112750 0x56228612a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.229+0000 7f2a86ffd640 1 -- 172.21.15.1:0/4286265084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562286112750 msgr2=0x56228612a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:45.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.229+0000 7f2a86ffd640 1 --2- 172.21.15.1:0/4286265084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562286112750 0x56228612a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.229+0000 7f2a86ffd640 1 -- 172.21.15.1:0/4286265084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562286121e40 msgr2=0x562286126010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.229+0000 7f2a86ffd640 1 --2- 172.21.15.1:0/4286265084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562286121e40 0x562286126010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.229+0000 7f2a86ffd640 1 -- 172.21.15.1:0/4286265084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562286113d50 con 0x562286113070 2024-09-19T09:39:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.229+0000 7f2a87fff640 1 --2- 172.21.15.1:0/4286265084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562286121e40 0x562286126010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.229+0000 7f2a86ffd640 1 --2- 172.21.15.1:0/4286265084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562286113070 0x562286125a20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x56228611ec50 tx=0x7f2a7c022d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42ef3998c3a0fad6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.229+0000 7f2a66ffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:39:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.229+0000 7f2a66ffd640 1 -- 172.21.15.1:0/4286265084 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c00dc10 con 0x562286113070 2024-09-19T09:39:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.229+0000 7f2a66ffd640 1 -- 172.21.15.1:0/4286265084 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f2a7c034400 con 0x562286113070 2024-09-19T09:39:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.229+0000 7f2a902ae740 1 -- 172.21.15.1:0/4286265084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a7c01a070 con 0x562286113070 2024-09-19T09:39:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.229+0000 7f2a66ffd640 1 -- 172.21.15.1:0/4286265084 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f2a7c04c050 con 0x562286113070 2024-09-19T09:39:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.229+0000 7f2a902ae740 10 client.25298 fetch_fsmap learned FSMap version 19 2024-09-19T09:39:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.229+0000 7f2a902ae740 1 -- 172.21.15.1:0/4286265084 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56228619c920 con 0x562286113070 2024-09-19T09:39:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.230+0000 7f2a66ffd640 1 -- 172.21.15.1:0/4286265084 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a7c01a070 con 0x562286113070 2024-09-19T09:39:45.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.230+0000 7f2a66ffd640 1 -- 172.21.15.1:0/4286265084 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f2a7c01d040 con 0x562286113070 2024-09-19T09:39:45.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.230+0000 7f2a902ae740 10 client.25298 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:39:45.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.230+0000 7f2a902ae740 10 client.25298 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:39:45.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.230+0000 7f2a902ae740 20 client.25298 populate_metadata read hostname 'smithi001' 2024-09-19T09:39:45.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.230+0000 7f2a902ae740 1 --2- 172.21.15.1:0/4286265084 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56228619cff0 0x56228619f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:45.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.230+0000 7f2a902ae740 4 client.25298 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T09:39:45.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.230+0000 7f2a902ae740 1 -- 172.21.15.1:0/4286265084 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x56228607ebe0 con 0x56228619cff0 2024-09-19T09:39:45.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.230+0000 7f2a877fe640 1 --2- 172.21.15.1:0/4286265084 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56228619cff0 0x56228619f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:45.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.230+0000 7f2a877fe640 1 --2- 172.21.15.1:0/4286265084 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56228619cff0 0x56228619f410 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb4092182b715d7 server_cookie=b28a4719de5d9fd8 in_seq=0 out_seq=0 2024-09-19T09:39:45.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:45.230+0000 7f2a66ffd640 10 client.25298 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:46.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:46 smithi022 ceph-mon[35583]: pgmap v388: 97 pgs: 97 active+clean; 665 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-19T09:39:46.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:46 smithi121 ceph-mon[35577]: pgmap v388: 97 pgs: 97 active+clean; 665 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-19T09:39:46.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:46 smithi001 ceph-mon[31225]: pgmap v388: 97 pgs: 97 active+clean; 665 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2 op/s 2024-09-19T09:39:47.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:47.671+0000 7f2a66ffd640 1 -- 172.21.15.1:0/4286265084 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56228607ebe0 con 0x56228619cff0 2024-09-19T09:39:47.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:47.671+0000 7f2a66ffd640 10 client.25298 handle_command_reply: tid=0 2024-09-19T09:39:47.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:47.671+0000 7f2a902ae740 1 client.25298 shutdown 2024-09-19T09:39:47.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:47.672+0000 7f2a902ae740 1 -- 172.21.15.1:0/4286265084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562286113070 msgr2=0x562286125a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:47.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:47.672+0000 7f2a902ae740 1 --2- 172.21.15.1:0/4286265084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562286113070 0x562286125a20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x56228611ec50 tx=0x7f2a7c022d90 comp rx=0 tx=0).stop 2024-09-19T09:39:47.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:47.672+0000 7f2a902ae740 1 -- 172.21.15.1:0/4286265084 shutdown_connections 2024-09-19T09:39:47.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:47.672+0000 7f2a902ae740 1 --2- 172.21.15.1:0/4286265084 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56228619cff0 0x56228619f410 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:47.672+0000 7f2a902ae740 1 --2- 172.21.15.1:0/4286265084 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562286121e40 0x562286126010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:47.672+0000 7f2a902ae740 1 --2- 172.21.15.1:0/4286265084 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562286113070 0x562286125a20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:47.672+0000 7f2a902ae740 1 --2- 172.21.15.1:0/4286265084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562286112750 0x56228612a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:47.672+0000 7f2a66ffd640 0 client.25298 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:47.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:47.672+0000 7f2a902ae740 1 -- 172.21.15.1:0/4286265084 >> 172.21.15.1:0/4286265084 conn(0x56228610ede0 msgr2=0x5622861205e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:47.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:47.672+0000 7f2a902ae740 1 -- 172.21.15.1:0/4286265084 shutdown_connections 2024-09-19T09:39:47.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:47.672+0000 7f2a902ae740 1 -- 172.21.15.1:0/4286265084 wait complete. 2024-09-19T09:39:47.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:47.672+0000 7f2a902ae740 20 client.25298 trim_cache size 0 max 16384 2024-09-19T09:39:47.675 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:39:47.675 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 19, 2024-09-19T09:39:47.675 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24497, 2024-09-19T09:39:47.675 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 10, 2024-09-19T09:39:47.676 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T09:39:47.676 INFO:teuthology.orchestra.run.smithi001.stdout: "bf630493": { 2024-09-19T09:39:47.676 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 10, 2024-09-19T09:39:47.676 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T09:39:47.676 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:39:47.676 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T09:39:47.676 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:39:47.676 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:39:47.676 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T09:39:47.676 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 140.3, 2024-09-19T09:39:47.676 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T09:39:47.676 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T09:39:47.676 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T09:39:47.676 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:39:47.676 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T09:39:47.677 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:39:47.677 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:39:47.677 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:39:47.677 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:39:47.677 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:39:47.677 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:39:47.677 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:39:47.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:47.673+0000 7f2a8ded5640 1 -- 172.21.15.1:0/3907292924 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f2a700a3240 msgr2=0x7f2a700a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:47.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:47.673+0000 7f2a8ded5640 1 --2- 172.21.15.1:0/3907292924 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f2a700a3240 0x7f2a700a5700 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x5622861142f0 tx=0x7f2a7c00b660 comp rx=0 tx=0).stop 2024-09-19T09:39:47.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:47.673+0000 7f2a8ded5640 1 -- 172.21.15.1:0/3907292924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a88106f10 msgr2=0x7f2a8819cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:47.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:47.673+0000 7f2a8ded5640 1 --2- 172.21.15.1:0/3907292924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a88106f10 0x7f2a8819cc10 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2a80031a20 tx=0x7f2a80031a50 comp rx=0 tx=0).stop 2024-09-19T09:39:47.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:47.673+0000 7f2a8ded5640 1 -- 172.21.15.1:0/3907292924 shutdown_connections 2024-09-19T09:39:47.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:47.673+0000 7f2a8ded5640 1 --2- 172.21.15.1:0/3907292924 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2a88106f10 0x7f2a8819cc10 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:47.673+0000 7f2a8ded5640 1 --2- 172.21.15.1:0/3907292924 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2a88102790 0x7f2a88198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:47.673+0000 7f2a8ded5640 1 --2- 172.21.15.1:0/3907292924 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f2a700a3240 0x7f2a700a5700 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:47.673+0000 7f2a8ded5640 1 --2- 172.21.15.1:0/3907292924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a88101de0 0x7f2a88198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:47.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:47.673+0000 7f2a8ded5640 1 -- 172.21.15.1:0/3907292924 >> 172.21.15.1:0/3907292924 conn(0x7f2a880fd8c0 msgr2=0x7f2a880febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:47.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:47.673+0000 7f2a8ded5640 1 -- 172.21.15.1:0/3907292924 shutdown_connections 2024-09-19T09:39:47.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:39:47.673+0000 7f2a8ded5640 1 -- 172.21.15.1:0/3907292924 wait complete. 2024-09-19T09:39:48.335 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:48 smithi001 ceph-mon[31225]: pgmap v389: 97 pgs: 97 active+clean; 2.5 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 167 KiB/s wr, 12 op/s 2024-09-19T09:39:48.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:48 smithi022 ceph-mon[35583]: pgmap v389: 97 pgs: 97 active+clean; 2.5 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 167 KiB/s wr, 12 op/s 2024-09-19T09:39:48.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:48 smithi121 ceph-mon[35577]: pgmap v389: 97 pgs: 97 active+clean; 2.5 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 167 KiB/s wr, 12 op/s 2024-09-19T09:39:48.370 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'bf630493', quiesce took 5.7 seconds. Will release after: 14.650000000000002 2024-09-19T09:39:50.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:50 smithi121 ceph-mon[35577]: pgmap v390: 97 pgs: 97 active+clean; 2.6 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 177 KiB/s wr, 12 op/s 2024-09-19T09:39:50.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:50 smithi001 ceph-mon[31225]: pgmap v390: 97 pgs: 97 active+clean; 2.6 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 177 KiB/s wr, 12 op/s 2024-09-19T09:39:50.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:50 smithi022 ceph-mon[35583]: pgmap v390: 97 pgs: 97 active+clean; 2.6 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 177 KiB/s wr, 12 op/s 2024-09-19T09:39:52.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:52 smithi001 ceph-mon[31225]: pgmap v391: 97 pgs: 97 active+clean; 3.2 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 242 KiB/s wr, 27 op/s 2024-09-19T09:39:52.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:52 smithi022 ceph-mon[35583]: pgmap v391: 97 pgs: 97 active+clean; 3.2 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 242 KiB/s wr, 27 op/s 2024-09-19T09:39:52.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:52 smithi121 ceph-mon[35577]: pgmap v391: 97 pgs: 97 active+clean; 3.2 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 242 KiB/s wr, 27 op/s 2024-09-19T09:39:54.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.327+0000 7fb6cd959640 1 -- 172.21.15.1:0/3898422020 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6c8100a70 msgr2=0x7fb6c8100e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:54.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.327+0000 7fb6cd959640 1 --2- 172.21.15.1:0/3898422020 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6c8100a70 0x7fb6c8100e70 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8009900 tx=0x7fb6b802a410 comp rx=0 tx=0).stop 2024-09-19T09:39:54.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.327+0000 7fb6cd959640 1 -- 172.21.15.1:0/3898422020 shutdown_connections 2024-09-19T09:39:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.327+0000 7fb6cd959640 1 --2- 172.21.15.1:0/3898422020 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6c8102620 0x7fb6c8108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.327+0000 7fb6cd959640 1 --2- 172.21.15.1:0/3898422020 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6c8101c60 0x7fb6c81020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.327+0000 7fb6cd959640 1 --2- 172.21.15.1:0/3898422020 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6c8100a70 0x7fb6c8100e70 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.327+0000 7fb6cd959640 1 -- 172.21.15.1:0/3898422020 >> 172.21.15.1:0/3898422020 conn(0x7fb6c80fc1f0 msgr2=0x7fb6c80fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.327+0000 7fb6cd959640 1 -- 172.21.15.1:0/3898422020 shutdown_connections 2024-09-19T09:39:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.327+0000 7fb6cd959640 1 -- 172.21.15.1:0/3898422020 wait complete. 2024-09-19T09:39:54.330 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.328+0000 7fb6cd959640 1 Processor -- start 2024-09-19T09:39:54.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.328+0000 7fb6cd959640 1 -- start start 2024-09-19T09:39:54.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.328+0000 7fb6cd959640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6c8100a70 0x7fb6c8197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.328+0000 7fb6cd959640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6c8101c60 0x7fb6c81983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.328+0000 7fb6cd959640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6c8102620 0x7fb6c819f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.329+0000 7fb6cd959640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c810c6d0 con 0x7fb6c8101c60 2024-09-19T09:39:54.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.329+0000 7fb6cd959640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c810c550 con 0x7fb6c8102620 2024-09-19T09:39:54.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.329+0000 7fb6cd959640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c810c850 con 0x7fb6c8100a70 2024-09-19T09:39:54.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.329+0000 7fb6c67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6c8101c60 0x7fb6c81983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.329+0000 7fb6c67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6c8101c60 0x7fb6c81983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40196/0 (socket says 172.21.15.1:40196) 2024-09-19T09:39:54.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.329+0000 7fb6c67fc640 1 -- 172.21.15.1:0/3021613447 learned_addr learned my addr 172.21.15.1:0/3021613447 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:54.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.329+0000 7fb6c77fe640 1 --2- 172.21.15.1:0/3021613447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6c8102620 0x7fb6c819f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.329+0000 7fb6c6ffd640 1 --2- 172.21.15.1:0/3021613447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6c8100a70 0x7fb6c8197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.329+0000 7fb6c67fc640 1 -- 172.21.15.1:0/3021613447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6c8100a70 msgr2=0x7fb6c8197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:54.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.329+0000 7fb6c67fc640 1 --2- 172.21.15.1:0/3021613447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6c8100a70 0x7fb6c8197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.329+0000 7fb6c67fc640 1 -- 172.21.15.1:0/3021613447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6c8102620 msgr2=0x7fb6c819f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:54.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.329+0000 7fb6c67fc640 1 --2- 172.21.15.1:0/3021613447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6c8102620 0x7fb6c819f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.334 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.329+0000 7fb6c67fc640 1 -- 172.21.15.1:0/3021613447 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c819fac0 con 0x7fb6c8101c60 2024-09-19T09:39:54.334 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.329+0000 7fb6c6ffd640 1 --2- 172.21.15.1:0/3021613447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6c8100a70 0x7fb6c8197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:39:54.334 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.329+0000 7fb6c67fc640 1 --2- 172.21.15.1:0/3021613447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6c8101c60 0x7fb6c81983e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc00e9f0 tx=0x7fb6bc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:54.334 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.329+0000 7fb6cc957640 1 -- 172.21.15.1:0/3021613447 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc00cd80 con 0x7fb6c8101c60 2024-09-19T09:39:54.334 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.329+0000 7fb6cd959640 1 -- 172.21.15.1:0/3021613447 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c819fdb0 con 0x7fb6c8101c60 2024-09-19T09:39:54.334 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.329+0000 7fb6cc957640 1 -- 172.21.15.1:0/3021613447 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6bc010910 con 0x7fb6c8101c60 2024-09-19T09:39:54.334 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.330+0000 7fb6cd959640 1 -- 172.21.15.1:0/3021613447 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c81a0280 con 0x7fb6c8101c60 2024-09-19T09:39:54.334 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.330+0000 7fb6cc957640 1 -- 172.21.15.1:0/3021613447 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc018910 con 0x7fb6c8101c60 2024-09-19T09:39:54.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.332+0000 7fb6cc957640 1 -- 172.21.15.1:0/3021613447 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fb6bc010ac0 con 0x7fb6c8101c60 2024-09-19T09:39:54.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.332+0000 7fb6d07d1740 1 Processor -- start 2024-09-19T09:39:54.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.332+0000 7fb6d07d1740 1 -- start start 2024-09-19T09:39:54.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.332+0000 7fb6d07d1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a888e2a9a0 0x55a888e2ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.332+0000 7fb6d07d1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a888e2b2e0 0x55a888e2fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.341 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.332+0000 7fb6d07d1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a888e30370 0x55a888e32830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.332+0000 7fb6d07d1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a888d8e2f0 con 0x55a888e30370 2024-09-19T09:39:54.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.332+0000 7fb6d07d1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a888d36270 con 0x55a888e2b2e0 2024-09-19T09:39:54.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.332+0000 7fb6d07d1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a888d8a2b0 con 0x55a888e2a9a0 2024-09-19T09:39:54.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.333+0000 7fb6c67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a888e30370 0x55a888e32830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.333+0000 7fb6c67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a888e30370 0x55a888e32830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40212/0 (socket says 172.21.15.1:40212) 2024-09-19T09:39:54.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.333+0000 7fb6c67fc640 1 -- 172.21.15.1:0/1974171351 learned_addr learned my addr 172.21.15.1:0/1974171351 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:54.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.333+0000 7fb6c6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a888e2b2e0 0x55a888e2fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.333+0000 7fb6c77fe640 1 --2- 172.21.15.1:0/1974171351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a888e2a9a0 0x55a888e2ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.333+0000 7fb6cc957640 1 --2- 172.21.15.1:0/3021613447 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb6b00a3240 0x7fb6b00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.333+0000 7fb6c67fc640 1 -- 172.21.15.1:0/1974171351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a888e2a9a0 msgr2=0x55a888e2ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:54.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.333+0000 7fb6c67fc640 1 --2- 172.21.15.1:0/1974171351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a888e2a9a0 0x55a888e2ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.333+0000 7fb6c67fc640 1 -- 172.21.15.1:0/1974171351 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a888e2b2e0 msgr2=0x55a888e2fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:54.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.333+0000 7fb6c67fc640 1 --2- 172.21.15.1:0/1974171351 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a888e2b2e0 0x55a888e2fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.333+0000 7fb6c67fc640 1 -- 172.21.15.1:0/1974171351 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a888d35340 con 0x55a888e30370 2024-09-19T09:39:54.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.333+0000 7fb6c6ffd640 1 --2- 172.21.15.1:0/1974171351 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a888e2b2e0 0x55a888e2fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:54.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.333+0000 7fb6c77fe640 1 --2- 172.21.15.1:0/3021613447 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb6b00a3240 0x7fb6b00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.333+0000 7fb6cc957640 1 -- 172.21.15.1:0/3021613447 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fb6bc0cfd40 con 0x7fb6c8101c60 2024-09-19T09:39:54.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.333+0000 7fb6c67fc640 1 --2- 172.21.15.1:0/1974171351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a888e30370 0x55a888e32830 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc064d40 tx=0x7fb6bc066e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b4aa69716e4758 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:54.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.333+0000 7fb6adffb640 1 -- 172.21.15.1:0/1974171351 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc09bea0 con 0x55a888e30370 2024-09-19T09:39:54.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.334+0000 7fb6adffb640 1 -- 172.21.15.1:0/1974171351 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6bc026050 con 0x55a888e30370 2024-09-19T09:39:54.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.334+0000 7fb6c77fe640 1 --2- 172.21.15.1:0/3021613447 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb6b00a3240 0x7fb6b00a5700 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0007310 tx=0x7fb6c0004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:54.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.334+0000 7fb6adffb640 1 -- 172.21.15.1:0/1974171351 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc09bcc0 con 0x55a888e30370 2024-09-19T09:39:54.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.334+0000 7fb6d07d1740 1 -- 172.21.15.1:0/1974171351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a888e30370 msgr2=0x55a888e32830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:54.343 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.334+0000 7fb6d07d1740 1 --2- 172.21.15.1:0/1974171351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a888e30370 0x55a888e32830 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc064d40 tx=0x7fb6bc066e60 comp rx=0 tx=0).stop 2024-09-19T09:39:54.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.334+0000 7fb6d07d1740 1 -- 172.21.15.1:0/1974171351 shutdown_connections 2024-09-19T09:39:54.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.334+0000 7fb6d07d1740 1 --2- 172.21.15.1:0/1974171351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a888e30370 0x55a888e32830 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.334+0000 7fb6d07d1740 1 --2- 172.21.15.1:0/1974171351 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a888e2b2e0 0x55a888e2fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.334+0000 7fb6d07d1740 1 --2- 172.21.15.1:0/1974171351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a888e2a9a0 0x55a888e2ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.334+0000 7fb6d07d1740 1 -- 172.21.15.1:0/1974171351 >> 172.21.15.1:0/1974171351 conn(0x55a888e26010 msgr2=0x55a888e26410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:54.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.334+0000 7fb6d07d1740 1 -- 172.21.15.1:0/1974171351 shutdown_connections 2024-09-19T09:39:54.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.334+0000 7fb6d07d1740 1 -- 172.21.15.1:0/1974171351 wait complete. 2024-09-19T09:39:54.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.335+0000 7fb6d07d1740 1 -- start start 2024-09-19T09:39:54.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.335+0000 7fb6d07d1740 1 Processor -- start 2024-09-19T09:39:54.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.335+0000 7fb6d07d1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a888e2a9a0 0x55a888e34a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.335+0000 7fb6d07d1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a888e2b2e0 0x55a888e34fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.335+0000 7fb6d07d1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a888e30370 0x55a888e3c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.335+0000 7fb6d07d1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a888e33280 con 0x55a888e2b2e0 2024-09-19T09:39:54.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.335+0000 7fb6d07d1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a888d17290 con 0x55a888e2a9a0 2024-09-19T09:39:54.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.335+0000 7fb6d07d1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a888e33400 con 0x55a888e30370 2024-09-19T09:39:54.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.335+0000 7fb6d07d1740 10 client.0 _ll_register_callbacks cb 0x55a888d48140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:54.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.335+0000 7fb6c67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a888e2b2e0 0x55a888e34fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.335+0000 7fb6c67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a888e2b2e0 0x55a888e34fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40224/0 (socket says 172.21.15.1:40224) 2024-09-19T09:39:54.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.335+0000 7fb6c67fc640 1 -- 172.21.15.1:0/1017355490 learned_addr learned my addr 172.21.15.1:0/1017355490 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:54.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.335+0000 7fb6c6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a888e2a9a0 0x55a888e34a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.336+0000 7fb6c77fe640 1 --2- 172.21.15.1:0/1017355490 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a888e30370 0x55a888e3c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.336+0000 7fb6c67fc640 1 -- 172.21.15.1:0/1017355490 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a888e30370 msgr2=0x55a888e3c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:54.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.336+0000 7fb6c67fc640 1 --2- 172.21.15.1:0/1017355490 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a888e30370 0x55a888e3c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.336+0000 7fb6c67fc640 1 -- 172.21.15.1:0/1017355490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a888e2a9a0 msgr2=0x55a888e34a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:54.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.336+0000 7fb6c67fc640 1 --2- 172.21.15.1:0/1017355490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a888e2a9a0 0x55a888e34a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.336+0000 7fb6c67fc640 1 -- 172.21.15.1:0/1017355490 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a888aa1210 con 0x55a888e2b2e0 2024-09-19T09:39:54.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.336+0000 7fb6c6ffd640 1 --2- 172.21.15.1:0/1017355490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a888e2a9a0 0x55a888e34a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:54.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.336+0000 7fb6c67fc640 1 --2- 172.21.15.1:0/1017355490 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a888e2b2e0 0x55a888e34fc0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc09c2f0 tx=0x7fb6bc0d0030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b90ce039147b570 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:54.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.336+0000 7fb6a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:39:54.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.336+0000 7fb6a6ffd640 1 -- 172.21.15.1:0/1017355490 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc09bea0 con 0x55a888e2b2e0 2024-09-19T09:39:54.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.336+0000 7fb6a6ffd640 1 -- 172.21.15.1:0/1017355490 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fb6bc064ab0 con 0x55a888e2b2e0 2024-09-19T09:39:54.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.336+0000 7fb6d07d1740 1 -- 172.21.15.1:0/1017355490 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6bc026050 con 0x55a888e2b2e0 2024-09-19T09:39:54.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.336+0000 7fb6a6ffd640 1 -- 172.21.15.1:0/1017355490 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb6bc09c360 con 0x55a888e2b2e0 2024-09-19T09:39:54.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.336+0000 7fb6d07d1740 10 client.15633 fetch_fsmap learned FSMap version 19 2024-09-19T09:39:54.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.336+0000 7fb6d07d1740 1 -- 172.21.15.1:0/1017355490 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55a888b6d620 con 0x55a888e2b2e0 2024-09-19T09:39:54.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.336+0000 7fb6a6ffd640 1 -- 172.21.15.1:0/1017355490 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6bc026050 con 0x55a888e2b2e0 2024-09-19T09:39:54.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.337+0000 7fb6a6ffd640 1 -- 172.21.15.1:0/1017355490 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb6bc0d4040 con 0x55a888e2b2e0 2024-09-19T09:39:54.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.337+0000 7fb6d07d1740 10 client.15633 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:39:54.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.337+0000 7fb6d07d1740 10 client.15633 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:54.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.337+0000 7fb6d07d1740 20 client.15633 populate_metadata read hostname 'smithi001' 2024-09-19T09:39:54.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.337+0000 7fb6d07d1740 1 --2- 172.21.15.1:0/1017355490 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55a888e40300 0x55a888e426f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.337+0000 7fb6d07d1740 4 client.15633 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:39:54.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.337+0000 7fb6d07d1740 1 -- 172.21.15.1:0/1017355490 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a888d9ba20 con 0x55a888e40300 2024-09-19T09:39:54.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.337+0000 7fb6c6ffd640 1 --2- 172.21.15.1:0/1017355490 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55a888e40300 0x55a888e426f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.338+0000 7fb6c6ffd640 1 --2- 172.21.15.1:0/1017355490 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55a888e40300 0x55a888e426f0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15f64221dd06dc02 server_cookie=5c58588ce6db2514 in_seq=0 out_seq=0 2024-09-19T09:39:54.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.338+0000 7fb6a6ffd640 10 client.15633 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:54.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.338+0000 7fb6a6ffd640 1 -- 172.21.15.1:0/1017355490 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a888d9ba20 con 0x55a888e40300 2024-09-19T09:39:54.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.338+0000 7fb6a6ffd640 10 client.15633 handle_command_reply: tid=0 2024-09-19T09:39:54.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.338+0000 7fb6d07d1740 1 client.15633 shutdown 2024-09-19T09:39:54.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.338+0000 7fb6d07d1740 1 -- 172.21.15.1:0/1017355490 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a888e2b2e0 msgr2=0x55a888e34fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:54.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.338+0000 7fb6d07d1740 1 --2- 172.21.15.1:0/1017355490 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a888e2b2e0 0x55a888e34fc0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc09c2f0 tx=0x7fb6bc0d0030 comp rx=0 tx=0).stop 2024-09-19T09:39:54.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.338+0000 7fb6d07d1740 1 -- 172.21.15.1:0/1017355490 shutdown_connections 2024-09-19T09:39:54.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.338+0000 7fb6d07d1740 1 --2- 172.21.15.1:0/1017355490 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55a888e40300 0x55a888e426f0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.338+0000 7fb6d07d1740 1 --2- 172.21.15.1:0/1017355490 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a888e30370 0x55a888e3c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.339+0000 7fb6d07d1740 1 --2- 172.21.15.1:0/1017355490 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a888e2b2e0 0x55a888e34fc0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.339+0000 7fb6d07d1740 1 --2- 172.21.15.1:0/1017355490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a888e2a9a0 0x55a888e34a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.339+0000 7fb6a6ffd640 0 client.15633 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:54.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.339+0000 7fb6d07d1740 1 -- 172.21.15.1:0/1017355490 >> 172.21.15.1:0/1017355490 conn(0x55a888e26010 msgr2=0x55a888e27820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:54.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.339+0000 7fb6d07d1740 1 -- 172.21.15.1:0/1017355490 shutdown_connections 2024-09-19T09:39:54.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.339+0000 7fb6d07d1740 1 -- 172.21.15.1:0/1017355490 wait complete. 2024-09-19T09:39:54.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.339+0000 7fb6d07d1740 20 client.15633 trim_cache size 0 max 16384 2024-09-19T09:39:54.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.353+0000 7fb6d07d1740 1 Processor -- start 2024-09-19T09:39:54.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.353+0000 7fb6d07d1740 1 -- start start 2024-09-19T09:39:54.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.353+0000 7fb6d07d1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a888e2a9a0 0x55a888e250b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.354+0000 7fb6d07d1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a888e2b2e0 0x55a888e3bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.354+0000 7fb6d07d1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a888e30370 0x55a888e27400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.354+0000 7fb6d07d1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c81a7050 con 0x55a888e2b2e0 2024-09-19T09:39:54.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.354+0000 7fb6d07d1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c81a98f0 con 0x55a888e30370 2024-09-19T09:39:54.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.354+0000 7fb6d07d1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c81a76e0 con 0x55a888e2a9a0 2024-09-19T09:39:54.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.354+0000 7fb6c67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a888e2b2e0 0x55a888e3bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.354+0000 7fb6c67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a888e2b2e0 0x55a888e3bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40226/0 (socket says 172.21.15.1:40226) 2024-09-19T09:39:54.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.354+0000 7fb6c67fc640 1 -- 172.21.15.1:0/2212572369 learned_addr learned my addr 172.21.15.1:0/2212572369 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.354+0000 7fb6c77fe640 1 --2- 172.21.15.1:0/2212572369 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a888e30370 0x55a888e27400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.354+0000 7fb6c6ffd640 1 --2- 172.21.15.1:0/2212572369 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a888e2a9a0 0x55a888e250b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.354+0000 7fb6c67fc640 1 -- 172.21.15.1:0/2212572369 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a888e2a9a0 msgr2=0x55a888e250b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.354+0000 7fb6c67fc640 1 --2- 172.21.15.1:0/2212572369 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a888e2a9a0 0x55a888e250b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.354+0000 7fb6c67fc640 1 -- 172.21.15.1:0/2212572369 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a888e30370 msgr2=0x55a888e27400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.354+0000 7fb6c67fc640 1 --2- 172.21.15.1:0/2212572369 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a888e30370 0x55a888e27400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.354+0000 7fb6c67fc640 1 -- 172.21.15.1:0/2212572369 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a888e33540 con 0x55a888e2b2e0 2024-09-19T09:39:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.354+0000 7fb6c77fe640 1 --2- 172.21.15.1:0/2212572369 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a888e30370 0x55a888e27400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:39:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.354+0000 7fb6c67fc640 1 --2- 172.21.15.1:0/2212572369 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a888e2b2e0 0x55a888e3bfc0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc009380 tx=0x7fb6bc0d37c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e19f92f3e06193b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.354+0000 7fb6ad7fa640 1 -- 172.21.15.1:0/2212572369 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc0d3330 con 0x55a888e2b2e0 2024-09-19T09:39:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.354+0000 7fb6ad7fa640 1 -- 172.21.15.1:0/2212572369 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6bc0a0710 con 0x55a888e2b2e0 2024-09-19T09:39:54.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.354+0000 7fb6ad7fa640 1 -- 172.21.15.1:0/2212572369 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc0a4c10 con 0x55a888e2b2e0 2024-09-19T09:39:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.355+0000 7fb6d07d1740 1 -- 172.21.15.1:0/2212572369 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a888e2b2e0 msgr2=0x55a888e3bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.355+0000 7fb6d07d1740 1 --2- 172.21.15.1:0/2212572369 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a888e2b2e0 0x55a888e3bfc0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc009380 tx=0x7fb6bc0d37c0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.355+0000 7fb6d07d1740 1 -- 172.21.15.1:0/2212572369 shutdown_connections 2024-09-19T09:39:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.355+0000 7fb6d07d1740 1 --2- 172.21.15.1:0/2212572369 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a888e30370 0x55a888e27400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.355+0000 7fb6d07d1740 1 --2- 172.21.15.1:0/2212572369 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a888e2b2e0 0x55a888e3bfc0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.355+0000 7fb6d07d1740 1 --2- 172.21.15.1:0/2212572369 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a888e2a9a0 0x55a888e250b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.355+0000 7fb6d07d1740 1 -- 172.21.15.1:0/2212572369 >> 172.21.15.1:0/2212572369 conn(0x55a888e26010 msgr2=0x55a888e249a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.355+0000 7fb6d07d1740 1 -- 172.21.15.1:0/2212572369 shutdown_connections 2024-09-19T09:39:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.355+0000 7fb6d07d1740 1 -- 172.21.15.1:0/2212572369 wait complete. 2024-09-19T09:39:54.359 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.355+0000 7fb6d07d1740 1 -- start start 2024-09-19T09:39:54.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.356+0000 7fb6d07d1740 1 Processor -- start 2024-09-19T09:39:54.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.356+0000 7fb6d07d1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a888e2a9a0 0x55a888e39060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.356+0000 7fb6d07d1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a888e2b2e0 0x55a888e395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.356+0000 7fb6d07d1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a888e30370 0x55a888e3a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.356+0000 7fb6d07d1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c81a7db0 con 0x55a888e2b2e0 2024-09-19T09:39:54.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.356+0000 7fb6d07d1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c81a9220 con 0x55a888e30370 2024-09-19T09:39:54.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.356+0000 7fb6d07d1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c81a8480 con 0x55a888e2a9a0 2024-09-19T09:39:54.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.356+0000 7fb6d07d1740 10 client.0 _ll_register_callbacks cb 0x7fb6bc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:39:54.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.356+0000 7fb6c67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a888e2b2e0 0x55a888e395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.356+0000 7fb6c67fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a888e2b2e0 0x55a888e395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40236/0 (socket says 172.21.15.1:40236) 2024-09-19T09:39:54.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.356+0000 7fb6c67fc640 1 -- 172.21.15.1:0/2581317707 learned_addr learned my addr 172.21.15.1:0/2581317707 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:39:54.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.356+0000 7fb6c77fe640 1 --2- 172.21.15.1:0/2581317707 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a888e30370 0x55a888e3a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.356+0000 7fb6c67fc640 1 -- 172.21.15.1:0/2581317707 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a888e2a9a0 msgr2=0x55a888e39060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:54.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.356+0000 7fb6c6ffd640 1 --2- 172.21.15.1:0/2581317707 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a888e2a9a0 0x55a888e39060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.356+0000 7fb6c67fc640 1 --2- 172.21.15.1:0/2581317707 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a888e2a9a0 0x55a888e39060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.356+0000 7fb6c67fc640 1 -- 172.21.15.1:0/2581317707 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a888e30370 msgr2=0x55a888e3a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:39:54.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.356+0000 7fb6c67fc640 1 --2- 172.21.15.1:0/2581317707 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a888e30370 0x55a888e3a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.356+0000 7fb6c67fc640 1 -- 172.21.15.1:0/2581317707 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a888e3abc0 con 0x55a888e2b2e0 2024-09-19T09:39:54.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.356+0000 7fb6c77fe640 1 --2- 172.21.15.1:0/2581317707 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a888e30370 0x55a888e3a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:54.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.356+0000 7fb6c6ffd640 1 --2- 172.21.15.1:0/2581317707 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a888e2a9a0 0x55a888e39060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:39:54.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.357+0000 7fb6c67fc640 1 --2- 172.21.15.1:0/2581317707 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a888e2b2e0 0x55a888e395a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc0cdad0 tx=0x7fb6bc00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65130559733e084b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:39:54.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.357+0000 7fb6a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:39:54.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.357+0000 7fb6a6ffd640 1 -- 172.21.15.1:0/2581317707 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc0b2200 con 0x55a888e2b2e0 2024-09-19T09:39:54.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.357+0000 7fb6a6ffd640 1 -- 172.21.15.1:0/2581317707 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fb6bc09c5c0 con 0x55a888e2b2e0 2024-09-19T09:39:54.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.357+0000 7fb6d07d1740 1 -- 172.21.15.1:0/2581317707 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6bc0a0710 con 0x55a888e2b2e0 2024-09-19T09:39:54.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.357+0000 7fb6a6ffd640 1 -- 172.21.15.1:0/2581317707 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb6bc09c800 con 0x55a888e2b2e0 2024-09-19T09:39:54.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.357+0000 7fb6d07d1740 10 client.15639 fetch_fsmap learned FSMap version 19 2024-09-19T09:39:54.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.357+0000 7fb6d07d1740 1 -- 172.21.15.1:0/2581317707 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55a888e3abc0 con 0x55a888e2b2e0 2024-09-19T09:39:54.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.357+0000 7fb6a6ffd640 1 -- 172.21.15.1:0/2581317707 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6bc0a0710 con 0x55a888e2b2e0 2024-09-19T09:39:54.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.357+0000 7fb6a6ffd640 1 -- 172.21.15.1:0/2581317707 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb6bc018ab0 con 0x55a888e2b2e0 2024-09-19T09:39:54.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.357+0000 7fb6d07d1740 10 client.15639 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:39:54.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.357+0000 7fb6d07d1740 10 client.15639 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:39:54.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.357+0000 7fb6d07d1740 20 client.15639 populate_metadata read hostname 'smithi001' 2024-09-19T09:39:54.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.357+0000 7fb6d07d1740 1 --2- 172.21.15.1:0/2581317707 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55a888eaaef0 0x55a888ead2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:39:54.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.357+0000 7fb6d07d1740 4 client.15639 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:39:54.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.357+0000 7fb6d07d1740 1 -- 172.21.15.1:0/2581317707 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a888d95d70 con 0x55a888eaaef0 2024-09-19T09:39:54.366 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.358+0000 7fb6c6ffd640 1 --2- 172.21.15.1:0/2581317707 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55a888eaaef0 0x55a888ead2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:39:54.366 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.358+0000 7fb6c6ffd640 1 --2- 172.21.15.1:0/2581317707 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55a888eaaef0 0x55a888ead2e0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d96ef28c203371a3 server_cookie=c4cd3149e38c361a in_seq=0 out_seq=0 2024-09-19T09:39:54.366 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.358+0000 7fb6a6ffd640 10 client.15639 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:54.418 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:54 smithi121 ceph-mon[35577]: pgmap v392: 97 pgs: 97 active+clean; 3.8 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 302 KiB/s wr, 35 op/s 2024-09-19T09:39:54.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.431+0000 7fb6a6ffd640 1 -- 172.21.15.1:0/2581317707 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a888d95d70 con 0x55a888eaaef0 2024-09-19T09:39:54.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.431+0000 7fb6a6ffd640 10 client.15639 handle_command_reply: tid=0 2024-09-19T09:39:54.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.431+0000 7fb6d07d1740 1 client.15639 shutdown 2024-09-19T09:39:54.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.431+0000 7fb6d07d1740 1 -- 172.21.15.1:0/2581317707 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a888e2b2e0 msgr2=0x55a888e395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:54.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.431+0000 7fb6d07d1740 1 --2- 172.21.15.1:0/2581317707 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a888e2b2e0 0x55a888e395a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc0cdad0 tx=0x7fb6bc00c7d0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.431+0000 7fb6d07d1740 1 -- 172.21.15.1:0/2581317707 shutdown_connections 2024-09-19T09:39:54.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.431+0000 7fb6d07d1740 1 --2- 172.21.15.1:0/2581317707 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55a888eaaef0 0x55a888ead2e0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.431+0000 7fb6d07d1740 1 --2- 172.21.15.1:0/2581317707 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a888e30370 0x55a888e3a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.431+0000 7fb6a6ffd640 0 client.15639 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:39:54.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.431+0000 7fb6d07d1740 1 --2- 172.21.15.1:0/2581317707 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a888e2b2e0 0x55a888e395a0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.431+0000 7fb6d07d1740 1 --2- 172.21.15.1:0/2581317707 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a888e2a9a0 0x55a888e39060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.431+0000 7fb6d07d1740 1 -- 172.21.15.1:0/2581317707 >> 172.21.15.1:0/2581317707 conn(0x55a888e26010 msgr2=0x55a888e251c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:54.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.431+0000 7fb6d07d1740 1 -- 172.21.15.1:0/2581317707 shutdown_connections 2024-09-19T09:39:54.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.431+0000 7fb6d07d1740 1 -- 172.21.15.1:0/2581317707 wait complete. 2024-09-19T09:39:54.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.431+0000 7fb6d07d1740 20 client.15639 trim_cache size 0 max 16384 2024-09-19T09:39:54.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:39:54.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:39:54.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:39:54.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:39:54.436 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.432+0000 7fb6cd959640 1 -- 172.21.15.1:0/3021613447 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb6b00a3240 msgr2=0x7fb6b00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:54.436 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.432+0000 7fb6cd959640 1 --2- 172.21.15.1:0/3021613447 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb6b00a3240 0x7fb6b00a5700 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0007310 tx=0x7fb6c0004a40 comp rx=0 tx=0).stop 2024-09-19T09:39:54.436 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.432+0000 7fb6cd959640 1 -- 172.21.15.1:0/3021613447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6c8101c60 msgr2=0x7fb6c81983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:39:54.436 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.432+0000 7fb6cd959640 1 --2- 172.21.15.1:0/3021613447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6c8101c60 0x7fb6c81983e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc00e9f0 tx=0x7fb6bc00eeb0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.436 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.432+0000 7fb6cd959640 1 -- 172.21.15.1:0/3021613447 shutdown_connections 2024-09-19T09:39:54.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.432+0000 7fb6cd959640 1 --2- 172.21.15.1:0/3021613447 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb6b00a3240 0x7fb6b00a5700 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.432+0000 7fb6cd959640 1 --2- 172.21.15.1:0/3021613447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6c8102620 0x7fb6c819f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.432+0000 7fb6cd959640 1 --2- 172.21.15.1:0/3021613447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6c8101c60 0x7fb6c81983e0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.432+0000 7fb6cd959640 1 --2- 172.21.15.1:0/3021613447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6c8100a70 0x7fb6c8197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:39:54.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.432+0000 7fb6cd959640 1 -- 172.21.15.1:0/3021613447 >> 172.21.15.1:0/3021613447 conn(0x7fb6c80fc1f0 msgr2=0x7fb6c80fc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:39:54.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.432+0000 7fb6cd959640 1 -- 172.21.15.1:0/3021613447 shutdown_connections 2024-09-19T09:39:54.437 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:39:54.432+0000 7fb6cd959640 1 -- 172.21.15.1:0/3021613447 wait complete. 2024-09-19T09:39:54.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:54 smithi001 ceph-mon[31225]: pgmap v392: 97 pgs: 97 active+clean; 3.8 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 302 KiB/s wr, 35 op/s 2024-09-19T09:39:54.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:54 smithi022 ceph-mon[35583]: pgmap v392: 97 pgs: 97 active+clean; 3.8 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 302 KiB/s wr, 35 op/s 2024-09-19T09:39:56.416 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:56 smithi022 ceph-mon[35583]: pgmap v393: 97 pgs: 97 active+clean; 3.8 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 302 KiB/s wr, 35 op/s 2024-09-19T09:39:56.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:56 smithi001 ceph-mon[31225]: pgmap v393: 97 pgs: 97 active+clean; 3.8 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 302 KiB/s wr, 35 op/s 2024-09-19T09:39:56.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:56 smithi121 ceph-mon[35577]: pgmap v393: 97 pgs: 97 active+clean; 3.8 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 302 KiB/s wr, 35 op/s 2024-09-19T09:39:58.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:39:58 smithi001 ceph-mon[31225]: pgmap v394: 97 pgs: 97 active+clean; 3.9 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 315 KiB/s wr, 72 op/s 2024-09-19T09:39:58.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:39:58 smithi022 ceph-mon[35583]: pgmap v394: 97 pgs: 97 active+clean; 3.9 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 315 KiB/s wr, 72 op/s 2024-09-19T09:39:58.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:39:58 smithi121 ceph-mon[35577]: pgmap v394: 97 pgs: 97 active+clean; 3.9 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 315 KiB/s wr, 72 op/s 2024-09-19T09:40:00.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:00 smithi001 ceph-mon[31225]: pgmap v395: 97 pgs: 97 active+clean; 3.9 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 152 KiB/s wr, 75 op/s 2024-09-19T09:40:00.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:00 smithi001 ceph-mon[31225]: overall HEALTH_OK 2024-09-19T09:40:00.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:00 smithi022 ceph-mon[35583]: pgmap v395: 97 pgs: 97 active+clean; 3.9 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 152 KiB/s wr, 75 op/s 2024-09-19T09:40:00.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:00 smithi022 ceph-mon[35583]: overall HEALTH_OK 2024-09-19T09:40:00.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:00 smithi121 ceph-mon[35577]: pgmap v395: 97 pgs: 97 active+clean; 3.9 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 152 KiB/s wr, 75 op/s 2024-09-19T09:40:00.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:00 smithi121 ceph-mon[35577]: overall HEALTH_OK 2024-09-19T09:40:02.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:02 smithi001 ceph-mon[31225]: pgmap v396: 97 pgs: 97 active+clean; 3.9 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 143 KiB/s wr, 84 op/s 2024-09-19T09:40:02.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:02 smithi022 ceph-mon[35583]: pgmap v396: 97 pgs: 97 active+clean; 3.9 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 143 KiB/s wr, 84 op/s 2024-09-19T09:40:02.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:02 smithi121 ceph-mon[35577]: pgmap v396: 97 pgs: 97 active+clean; 3.9 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 143 KiB/s wr, 84 op/s 2024-09-19T09:40:03.020 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:40:03.293 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:03.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.806+0000 7f992aa6f640 1 -- 172.21.15.1:0/3877341124 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9924101400 msgr2=0x7f992410d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:03.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.806+0000 7f992aa6f640 1 --2- 172.21.15.1:0/3877341124 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9924101400 0x7f992410d930 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f991c009930 tx=0x7f991c02a420 comp rx=0 tx=0).stop 2024-09-19T09:40:03.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.806+0000 7f992aa6f640 1 -- 172.21.15.1:0/3877341124 shutdown_connections 2024-09-19T09:40:03.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.806+0000 7f992aa6f640 1 --2- 172.21.15.1:0/3877341124 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9924101400 0x7f992410d930 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:03.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.806+0000 7f992aa6f640 1 --2- 172.21.15.1:0/3877341124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9924100a60 0x7f9924100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:03.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.806+0000 7f992aa6f640 1 --2- 172.21.15.1:0/3877341124 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9924106a60 0x7f9924106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:03.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.806+0000 7f992aa6f640 1 -- 172.21.15.1:0/3877341124 >> 172.21.15.1:0/3877341124 conn(0x7f99240fc780 msgr2=0x7f99240feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:03.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.806+0000 7f992aa6f640 1 -- 172.21.15.1:0/3877341124 shutdown_connections 2024-09-19T09:40:03.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.806+0000 7f992aa6f640 1 -- 172.21.15.1:0/3877341124 wait complete. 2024-09-19T09:40:03.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.807+0000 7f992aa6f640 1 Processor -- start 2024-09-19T09:40:03.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.807+0000 7f992aa6f640 1 -- start start 2024-09-19T09:40:03.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.807+0000 7f992aa6f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9924100a60 0x7f992419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:03.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.807+0000 7f992aa6f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9924101400 0x7f992419abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:03.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.807+0000 7f992aa6f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9924106a60 0x7f992419ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:03.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.807+0000 7f992aa6f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9924111f80 con 0x7f9924106a60 2024-09-19T09:40:03.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.807+0000 7f992aa6f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9924111e00 con 0x7f9924100a60 2024-09-19T09:40:03.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.807+0000 7f992aa6f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9924112100 con 0x7f9924101400 2024-09-19T09:40:03.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.807+0000 7f992900c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9924106a60 0x7f992419ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:03.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.807+0000 7f992900c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9924106a60 0x7f992419ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54824/0 (socket says 172.21.15.1:54824) 2024-09-19T09:40:03.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.807+0000 7f992900c640 1 -- 172.21.15.1:0/1318123871 learned_addr learned my addr 172.21.15.1:0/1318123871 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:03.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.807+0000 7f992880b640 1 --2- 172.21.15.1:0/1318123871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9924100a60 0x7f992419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:03.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.807+0000 7f9923fff640 1 --2- 172.21.15.1:0/1318123871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9924101400 0x7f992419abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:03.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.807+0000 7f992900c640 1 -- 172.21.15.1:0/1318123871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9924101400 msgr2=0x7f992419abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:03.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.807+0000 7f992900c640 1 --2- 172.21.15.1:0/1318123871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9924101400 0x7f992419abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:03.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.807+0000 7f992900c640 1 -- 172.21.15.1:0/1318123871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9924100a60 msgr2=0x7f992419a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:03.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.807+0000 7f992900c640 1 --2- 172.21.15.1:0/1318123871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9924100a60 0x7f992419a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:03.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.807+0000 7f992900c640 1 -- 172.21.15.1:0/1318123871 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f992419f660 con 0x7f9924106a60 2024-09-19T09:40:03.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.807+0000 7f992900c640 1 --2- 172.21.15.1:0/1318123871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9924106a60 0x7f992419ef80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f991c005ab0 tx=0x7f991c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:03.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.808+0000 7f9921ffb640 1 -- 172.21.15.1:0/1318123871 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c03f030 con 0x7f9924106a60 2024-09-19T09:40:03.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.808+0000 7f9921ffb640 1 -- 172.21.15.1:0/1318123871 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f991c003ce0 con 0x7f9924106a60 2024-09-19T09:40:03.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.808+0000 7f992aa6f640 1 -- 172.21.15.1:0/1318123871 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f992419f8f0 con 0x7f9924106a60 2024-09-19T09:40:03.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.808+0000 7f9921ffb640 1 -- 172.21.15.1:0/1318123871 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c035070 con 0x7f9924106a60 2024-09-19T09:40:03.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.808+0000 7f992aa6f640 1 -- 172.21.15.1:0/1318123871 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99241a7230 con 0x7f9924106a60 2024-09-19T09:40:03.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.809+0000 7f992aa6f640 1 -- 172.21.15.1:0/1318123871 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9924100ec0 con 0x7f9924106a60 2024-09-19T09:40:03.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.810+0000 7f9921ffb640 1 -- 172.21.15.1:0/1318123871 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f991c042030 con 0x7f9924106a60 2024-09-19T09:40:03.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.811+0000 7f9921ffb640 1 --2- 172.21.15.1:0/1318123871 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f99100a32c0 0x7f99100a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:03.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.811+0000 7f9921ffb640 1 -- 172.21.15.1:0/1318123871 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f991c0efee0 con 0x7f9924106a60 2024-09-19T09:40:03.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.811+0000 7f992880b640 1 --2- 172.21.15.1:0/1318123871 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f99100a32c0 0x7f99100a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:03.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.811+0000 7f992880b640 1 --2- 172.21.15.1:0/1318123871 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f99100a32c0 0x7f99100a5780 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f990c009f20 tx=0x7f990c0094f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:03.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:03.815+0000 7f9921ffb640 1 -- 172.21.15.1:0/1318123871 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f991c0bcc00 con 0x7f9924106a60 2024-09-19T09:40:04.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:04.031+0000 7f992aa6f640 1 -- 172.21.15.1:0/1318123871 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99241a7400 con 0x7f9924106a60 2024-09-19T09:40:04.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:04.031+0000 7f9921ffb640 1 -- 172.21.15.1:0/1318123871 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11837 (secure 0 0 0) 0x7f991c0bc500 con 0x7f9924106a60 2024-09-19T09:40:04.034 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:40:04.034 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":19,"btime":"2024-09-19T09:36:24:006349+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:36:23.723388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6839/3279971690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3279971690},{"type":"v1","addr":"172.21.15.121:6839","nonce":3279971690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:40:04.035 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 19 2024-09-19T09:40:04.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:04.034+0000 7f992aa6f640 1 -- 172.21.15.1:0/1318123871 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f99100a32c0 msgr2=0x7f99100a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:04.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:04.034+0000 7f992aa6f640 1 --2- 172.21.15.1:0/1318123871 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f99100a32c0 0x7f99100a5780 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f990c009f20 tx=0x7f990c0094f0 comp rx=0 tx=0).stop 2024-09-19T09:40:04.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:04.034+0000 7f992aa6f640 1 -- 172.21.15.1:0/1318123871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9924106a60 msgr2=0x7f992419ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:04.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:04.034+0000 7f992aa6f640 1 --2- 172.21.15.1:0/1318123871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9924106a60 0x7f992419ef80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f991c005ab0 tx=0x7f991c0042f0 comp rx=0 tx=0).stop 2024-09-19T09:40:04.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:04.034+0000 7f992aa6f640 1 -- 172.21.15.1:0/1318123871 shutdown_connections 2024-09-19T09:40:04.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:04.034+0000 7f992aa6f640 1 --2- 172.21.15.1:0/1318123871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9924106a60 0x7f992419ef80 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:04.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:04.034+0000 7f992aa6f640 1 --2- 172.21.15.1:0/1318123871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9924101400 0x7f992419abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:04.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:04.034+0000 7f992aa6f640 1 --2- 172.21.15.1:0/1318123871 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f99100a32c0 0x7f99100a5780 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:04.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:04.034+0000 7f992aa6f640 1 --2- 172.21.15.1:0/1318123871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9924100a60 0x7f992419a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:04.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:04.034+0000 7f992aa6f640 1 -- 172.21.15.1:0/1318123871 >> 172.21.15.1:0/1318123871 conn(0x7f99240fc780 msgr2=0x7f99240fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:04.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:04.034+0000 7f992aa6f640 1 -- 172.21.15.1:0/1318123871 shutdown_connections 2024-09-19T09:40:04.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:04.034+0000 7f992aa6f640 1 -- 172.21.15.1:0/1318123871 wait complete. 2024-09-19T09:40:04.329 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:04 smithi001 ceph-mon[31225]: pgmap v397: 97 pgs: 97 active+clean; 3.9 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 79 KiB/s wr, 69 op/s 2024-09-19T09:40:04.329 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:04 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1318123871' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:40:04.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:04 smithi022 ceph-mon[35583]: pgmap v397: 97 pgs: 97 active+clean; 3.9 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 79 KiB/s wr, 69 op/s 2024-09-19T09:40:04.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:04 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1318123871' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:40:04.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:04 smithi121 ceph-mon[35577]: pgmap v397: 97 pgs: 97 active+clean; 3.9 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 79 KiB/s wr, 69 op/s 2024-09-19T09:40:04.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:04 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1318123871' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:40:04.675 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db --set-id bf630493 --release --await' 2024-09-19T09:40:04.675 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db --set-id bf630493 --release --await 2024-09-19T09:40:04.941 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:05.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.456+0000 7fc63a04d640 1 -- 172.21.15.1:0/1121099934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc634100e30 msgr2=0x7fc634104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:05.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.456+0000 7fc63a04d640 1 --2- 172.21.15.1:0/1121099934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc634100e30 0x7fc634104e80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc62800aa10 tx=0x7fc62802b720 comp rx=0 tx=0).stop 2024-09-19T09:40:05.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.457+0000 7fc63a04d640 1 -- 172.21.15.1:0/1121099934 shutdown_connections 2024-09-19T09:40:05.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.457+0000 7fc63a04d640 1 --2- 172.21.15.1:0/1121099934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6341055b0 0x7fc63410d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.457+0000 7fc63a04d640 1 --2- 172.21.15.1:0/1121099934 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc634100e30 0x7fc634104e80 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.457+0000 7fc63a04d640 1 --2- 172.21.15.1:0/1121099934 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc634100480 0x7fc634100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.457+0000 7fc63a04d640 1 -- 172.21.15.1:0/1121099934 >> 172.21.15.1:0/1121099934 conn(0x7fc634077210 msgr2=0x7fc6340fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:05.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.457+0000 7fc63a04d640 1 -- 172.21.15.1:0/1121099934 shutdown_connections 2024-09-19T09:40:05.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.457+0000 7fc63a04d640 1 -- 172.21.15.1:0/1121099934 wait complete. 2024-09-19T09:40:05.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.457+0000 7fc63a04d640 1 Processor -- start 2024-09-19T09:40:05.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.457+0000 7fc63a04d640 1 -- start start 2024-09-19T09:40:05.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.458+0000 7fc63a04d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc634100480 0x7fc6340fc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:05.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.458+0000 7fc63a04d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc634100e30 0x7fc6340fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:05.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.458+0000 7fc63a04d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc6341055b0 0x7fc6340fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:05.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.458+0000 7fc63a04d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc63410fde0 con 0x7fc634100e30 2024-09-19T09:40:05.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.458+0000 7fc63a04d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc63410fc60 con 0x7fc634100480 2024-09-19T09:40:05.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.458+0000 7fc63a04d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc63410ff60 con 0x7fc6341055b0 2024-09-19T09:40:05.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.458+0000 7fc632ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc634100e30 0x7fc6340fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:05.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.458+0000 7fc632ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc634100e30 0x7fc6340fcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40148/0 (socket says 172.21.15.1:40148) 2024-09-19T09:40:05.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.458+0000 7fc632ffd640 1 -- 172.21.15.1:0/2286799235 learned_addr learned my addr 172.21.15.1:0/2286799235 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:05.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.458+0000 7fc6337fe640 1 --2- 172.21.15.1:0/2286799235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc634100480 0x7fc6340fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:05.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.458+0000 7fc633fff640 1 --2- 172.21.15.1:0/2286799235 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc6341055b0 0x7fc6340fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:05.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.458+0000 7fc632ffd640 1 -- 172.21.15.1:0/2286799235 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc6341055b0 msgr2=0x7fc6340fd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:05.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.458+0000 7fc632ffd640 1 --2- 172.21.15.1:0/2286799235 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc6341055b0 0x7fc6340fd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.458+0000 7fc632ffd640 1 -- 172.21.15.1:0/2286799235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc634100480 msgr2=0x7fc6340fc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:05.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.458+0000 7fc632ffd640 1 --2- 172.21.15.1:0/2286799235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc634100480 0x7fc6340fc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.458+0000 7fc632ffd640 1 -- 172.21.15.1:0/2286799235 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6341a6910 con 0x7fc634100e30 2024-09-19T09:40:05.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.458+0000 7fc6337fe640 1 --2- 172.21.15.1:0/2286799235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc634100480 0x7fc6340fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:05.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.458+0000 7fc632ffd640 1 --2- 172.21.15.1:0/2286799235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc634100e30 0x7fc6340fcbd0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fc628004770 tx=0x7fc628030ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:05.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.459+0000 7fc630ff9640 1 -- 172.21.15.1:0/2286799235 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62803f070 con 0x7fc634100e30 2024-09-19T09:40:05.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.459+0000 7fc630ff9640 1 -- 172.21.15.1:0/2286799235 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc628032400 con 0x7fc634100e30 2024-09-19T09:40:05.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.459+0000 7fc63a04d640 1 -- 172.21.15.1:0/2286799235 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6341a6ba0 con 0x7fc634100e30 2024-09-19T09:40:05.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.459+0000 7fc630ff9640 1 -- 172.21.15.1:0/2286799235 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc628036040 con 0x7fc634100e30 2024-09-19T09:40:05.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.459+0000 7fc63a04d640 1 -- 172.21.15.1:0/2286799235 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6341a70d0 con 0x7fc634100e30 2024-09-19T09:40:05.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.461+0000 7fc630ff9640 1 -- 172.21.15.1:0/2286799235 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fc628042070 con 0x7fc634100e30 2024-09-19T09:40:05.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.461+0000 7fc63c426740 1 Processor -- start 2024-09-19T09:40:05.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.461+0000 7fc63c426740 1 -- start start 2024-09-19T09:40:05.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.462+0000 7fc63c426740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e02b8ef060 0x55e02b8ef440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:05.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.462+0000 7fc630ff9640 1 --2- 172.21.15.1:0/2286799235 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc61c0a32c0 0x7fc61c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:05.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.462+0000 7fc63c426740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e02b8ef980 0x55e02b8f9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:05.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.462+0000 7fc63c426740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e02b8fa240 0x55e02b8fc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:05.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.462+0000 7fc63c426740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e02b854620 con 0x55e02b8ef060 2024-09-19T09:40:05.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.462+0000 7fc63c426740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e02b7fbe50 con 0x55e02b8ef980 2024-09-19T09:40:05.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.462+0000 7fc63c426740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55e02b8505e0 con 0x55e02b8fa240 2024-09-19T09:40:05.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.462+0000 7fc633fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e02b8ef060 0x55e02b8ef440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:05.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.462+0000 7fc6337fe640 1 --2- 172.21.15.1:0/2286799235 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc61c0a32c0 0x7fc61c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:05.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.462+0000 7fc633fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e02b8ef060 0x55e02b8ef440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40164/0 (socket says 172.21.15.1:40164) 2024-09-19T09:40:05.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.462+0000 7fc633fff640 1 -- 172.21.15.1:0/57782606 learned_addr learned my addr 172.21.15.1:0/57782606 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:05.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.462+0000 7fc630ff9640 1 -- 172.21.15.1:0/2286799235 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fc6280eff70 con 0x7fc634100e30 2024-09-19T09:40:05.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.462+0000 7fc632ffd640 1 --2- 172.21.15.1:0/57782606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e02b8ef980 0x55e02b8f9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:05.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.462+0000 7fc633fff640 1 --2- 172.21.15.1:0/57782606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e02b8fa240 0x55e02b8fc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:05.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.462+0000 7fc633fff640 1 -- 172.21.15.1:0/57782606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e02b8fa240 msgr2=0x55e02b8fc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:05.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.462+0000 7fc633fff640 1 --2- 172.21.15.1:0/57782606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e02b8fa240 0x55e02b8fc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.462+0000 7fc633fff640 1 -- 172.21.15.1:0/57782606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e02b8ef980 msgr2=0x55e02b8f9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:05.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.462+0000 7fc633fff640 1 --2- 172.21.15.1:0/57782606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e02b8ef980 0x55e02b8f9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.462+0000 7fc633fff640 1 -- 172.21.15.1:0/57782606 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e02b7ecd40 con 0x55e02b8ef060 2024-09-19T09:40:05.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.462+0000 7fc632ffd640 1 --2- 172.21.15.1:0/57782606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e02b8ef980 0x55e02b8f9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:05.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.462+0000 7fc633fff640 1 --2- 172.21.15.1:0/57782606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e02b8ef060 0x55e02b8ef440 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc62c005c20 tx=0x7fc62c009b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb743d4ecafc455f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:05.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.462+0000 7fc6337fe640 1 --2- 172.21.15.1:0/2286799235 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc61c0a32c0 0x7fc61c0a5780 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc6240058c0 tx=0x7fc624005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:05.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.463+0000 7fc619ffb640 1 -- 172.21.15.1:0/57782606 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c0127d0 con 0x55e02b8ef060 2024-09-19T09:40:05.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.463+0000 7fc619ffb640 1 -- 172.21.15.1:0/57782606 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc62c018070 con 0x55e02b8ef060 2024-09-19T09:40:05.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.463+0000 7fc619ffb640 1 -- 172.21.15.1:0/57782606 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c01dda0 con 0x55e02b8ef060 2024-09-19T09:40:05.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.463+0000 7fc63c426740 1 -- 172.21.15.1:0/57782606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e02b8ef060 msgr2=0x55e02b8ef440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:05.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.463+0000 7fc63c426740 1 --2- 172.21.15.1:0/57782606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e02b8ef060 0x55e02b8ef440 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc62c005c20 tx=0x7fc62c009b10 comp rx=0 tx=0).stop 2024-09-19T09:40:05.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.463+0000 7fc63c426740 1 -- 172.21.15.1:0/57782606 shutdown_connections 2024-09-19T09:40:05.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.463+0000 7fc63c426740 1 --2- 172.21.15.1:0/57782606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e02b8fa240 0x55e02b8fc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.463+0000 7fc63c426740 1 --2- 172.21.15.1:0/57782606 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e02b8ef980 0x55e02b8f9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.463+0000 7fc63c426740 1 --2- 172.21.15.1:0/57782606 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e02b8ef060 0x55e02b8ef440 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.463+0000 7fc63c426740 1 -- 172.21.15.1:0/57782606 >> 172.21.15.1:0/57782606 conn(0x55e02b8eb5f0 msgr2=0x55e02b8eb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:05.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.463+0000 7fc63c426740 1 -- 172.21.15.1:0/57782606 shutdown_connections 2024-09-19T09:40:05.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.463+0000 7fc63c426740 1 -- 172.21.15.1:0/57782606 wait complete. 2024-09-19T09:40:05.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.464+0000 7fc63c426740 1 -- start start 2024-09-19T09:40:05.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.464+0000 7fc63c426740 1 Processor -- start 2024-09-19T09:40:05.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.464+0000 7fc63c426740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e02b8ef060 0x55e02b8f7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:05.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.464+0000 7fc63c426740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e02b8ef980 0x55e02b8f75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:05.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.464+0000 7fc63c426740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e02b8fa240 0x55e02b8f7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:05.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.464+0000 7fc63c426740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e02b8fce10 con 0x55e02b8fa240 2024-09-19T09:40:05.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.464+0000 7fc63c426740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e02b7dcf10 con 0x55e02b8ef980 2024-09-19T09:40:05.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.464+0000 7fc63c426740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55e02b8fcf90 con 0x55e02b8ef060 2024-09-19T09:40:05.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.464+0000 7fc63c426740 10 client.0 _ll_register_callbacks cb 0x55e02b800db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:05.472 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.465+0000 7fc633fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e02b8fa240 0x55e02b8f7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:05.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.465+0000 7fc633fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e02b8fa240 0x55e02b8f7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40180/0 (socket says 172.21.15.1:40180) 2024-09-19T09:40:05.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.465+0000 7fc633fff640 1 -- 172.21.15.1:0/241995684 learned_addr learned my addr 172.21.15.1:0/241995684 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:05.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.465+0000 7fc6337fe640 1 --2- 172.21.15.1:0/241995684 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e02b8ef060 0x55e02b8f7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:05.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.465+0000 7fc632ffd640 1 --2- 172.21.15.1:0/241995684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e02b8ef980 0x55e02b8f75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:05.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.465+0000 7fc633fff640 1 -- 172.21.15.1:0/241995684 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e02b8ef060 msgr2=0x55e02b8f7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:05.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.465+0000 7fc633fff640 1 --2- 172.21.15.1:0/241995684 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e02b8ef060 0x55e02b8f7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.465+0000 7fc633fff640 1 -- 172.21.15.1:0/241995684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e02b8ef980 msgr2=0x55e02b8f75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:05.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.465+0000 7fc633fff640 1 --2- 172.21.15.1:0/241995684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e02b8ef980 0x55e02b8f75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.465+0000 7fc633fff640 1 -- 172.21.15.1:0/241995684 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e02b563580 con 0x55e02b8fa240 2024-09-19T09:40:05.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.465+0000 7fc632ffd640 1 --2- 172.21.15.1:0/241995684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e02b8ef980 0x55e02b8f75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:05.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.465+0000 7fc633fff640 1 --2- 172.21.15.1:0/241995684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e02b8fa240 0x55e02b8f7b00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc62c005f40 tx=0x7fc62c01d6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1484e253f0bb97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:05.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.465+0000 7fc612ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:40:05.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.465+0000 7fc612ffd640 1 -- 172.21.15.1:0/241995684 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c02b060 con 0x55e02b8fa240 2024-09-19T09:40:05.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.465+0000 7fc612ffd640 1 -- 172.21.15.1:0/241995684 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fc62c004a40 con 0x55e02b8fa240 2024-09-19T09:40:05.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.465+0000 7fc63c426740 1 -- 172.21.15.1:0/241995684 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc62c018070 con 0x55e02b8fa240 2024-09-19T09:40:05.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.466+0000 7fc612ffd640 1 -- 172.21.15.1:0/241995684 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc62c01de30 con 0x55e02b8fa240 2024-09-19T09:40:05.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.466+0000 7fc63c426740 10 client.15657 fetch_fsmap learned FSMap version 19 2024-09-19T09:40:05.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.466+0000 7fc63c426740 1 -- 172.21.15.1:0/241995684 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e02b62d960 con 0x55e02b8fa240 2024-09-19T09:40:05.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.466+0000 7fc612ffd640 1 -- 172.21.15.1:0/241995684 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc62c018070 con 0x55e02b8fa240 2024-09-19T09:40:05.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.466+0000 7fc612ffd640 1 -- 172.21.15.1:0/241995684 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fc62c030070 con 0x55e02b8fa240 2024-09-19T09:40:05.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.466+0000 7fc63c426740 10 client.15657 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:40:05.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.466+0000 7fc63c426740 10 client.15657 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:40:05.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.466+0000 7fc63c426740 20 client.15657 populate_metadata read hostname 'smithi001' 2024-09-19T09:40:05.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.466+0000 7fc63c426740 1 --2- 172.21.15.1:0/241995684 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55e02b909c70 0x55e02b90c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:05.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.466+0000 7fc63c426740 4 client.15657 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:05.475 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.466+0000 7fc63c426740 1 -- 172.21.15.1:0/241995684 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e02b861b90 con 0x55e02b909c70 2024-09-19T09:40:05.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.466+0000 7fc6337fe640 1 --2- 172.21.15.1:0/241995684 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55e02b909c70 0x55e02b90c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:05.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.467+0000 7fc6337fe640 1 --2- 172.21.15.1:0/241995684 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55e02b909c70 0x55e02b90c060 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30c0e60a4d7a93d8 server_cookie=d1521a3b052b2d41 in_seq=0 out_seq=0 2024-09-19T09:40:05.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.467+0000 7fc612ffd640 10 client.15657 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:05.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.468+0000 7fc612ffd640 1 -- 172.21.15.1:0/241995684 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e02b861b90 con 0x55e02b909c70 2024-09-19T09:40:05.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.468+0000 7fc612ffd640 10 client.15657 handle_command_reply: tid=0 2024-09-19T09:40:05.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.468+0000 7fc63c426740 1 client.15657 shutdown 2024-09-19T09:40:05.476 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.468+0000 7fc63c426740 1 -- 172.21.15.1:0/241995684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e02b8fa240 msgr2=0x55e02b8f7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:05.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.468+0000 7fc63c426740 1 --2- 172.21.15.1:0/241995684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e02b8fa240 0x55e02b8f7b00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc62c005f40 tx=0x7fc62c01d6a0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.468+0000 7fc63c426740 1 -- 172.21.15.1:0/241995684 shutdown_connections 2024-09-19T09:40:05.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.468+0000 7fc63c426740 1 --2- 172.21.15.1:0/241995684 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55e02b909c70 0x55e02b90c060 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.468+0000 7fc63c426740 1 --2- 172.21.15.1:0/241995684 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e02b8fa240 0x55e02b8f7b00 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.468+0000 7fc63c426740 1 --2- 172.21.15.1:0/241995684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e02b8ef980 0x55e02b8f75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.468+0000 7fc612ffd640 0 client.15657 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:05.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.468+0000 7fc63c426740 1 --2- 172.21.15.1:0/241995684 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e02b8ef060 0x55e02b8f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.468+0000 7fc63c426740 1 -- 172.21.15.1:0/241995684 >> 172.21.15.1:0/241995684 conn(0x55e02b8eb5f0 msgr2=0x55e02b8f1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:05.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.468+0000 7fc63c426740 1 -- 172.21.15.1:0/241995684 shutdown_connections 2024-09-19T09:40:05.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.468+0000 7fc63c426740 1 -- 172.21.15.1:0/241995684 wait complete. 2024-09-19T09:40:05.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.468+0000 7fc63c426740 20 client.15657 trim_cache size 0 max 16384 2024-09-19T09:40:05.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.485+0000 7fc63c426740 1 Processor -- start 2024-09-19T09:40:05.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.485+0000 7fc63c426740 1 -- start start 2024-09-19T09:40:05.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.486+0000 7fc63c426740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e02b8ef060 0x55e02b8f1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:05.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.486+0000 7fc63c426740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e02b8ef980 0x55e02b8f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:05.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.486+0000 7fc63c426740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e02b8fa240 0x55e02b8f42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:05.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.486+0000 7fc63c426740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc6341ad720 con 0x55e02b8fa240 2024-09-19T09:40:05.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.486+0000 7fc63c426740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc6341affc0 con 0x55e02b8ef060 2024-09-19T09:40:05.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.486+0000 7fc63c426740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc6341addb0 con 0x55e02b8ef980 2024-09-19T09:40:05.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.486+0000 7fc633fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e02b8fa240 0x55e02b8f42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:05.490 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.486+0000 7fc633fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e02b8fa240 0x55e02b8f42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40198/0 (socket says 172.21.15.1:40198) 2024-09-19T09:40:05.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.486+0000 7fc633fff640 1 -- 172.21.15.1:0/4199958885 learned_addr learned my addr 172.21.15.1:0/4199958885 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:05.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.486+0000 7fc6337fe640 1 --2- 172.21.15.1:0/4199958885 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e02b8ef060 0x55e02b8f1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:05.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.486+0000 7fc632ffd640 1 --2- 172.21.15.1:0/4199958885 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e02b8ef980 0x55e02b8f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:05.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.486+0000 7fc633fff640 1 -- 172.21.15.1:0/4199958885 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e02b8ef980 msgr2=0x55e02b8f5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:05.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.486+0000 7fc633fff640 1 --2- 172.21.15.1:0/4199958885 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e02b8ef980 0x55e02b8f5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.486+0000 7fc633fff640 1 -- 172.21.15.1:0/4199958885 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e02b8ef060 msgr2=0x55e02b8f1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:05.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.486+0000 7fc633fff640 1 --2- 172.21.15.1:0/4199958885 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e02b8ef060 0x55e02b8f1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.486+0000 7fc633fff640 1 -- 172.21.15.1:0/4199958885 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e02b8eb420 con 0x55e02b8fa240 2024-09-19T09:40:05.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.486+0000 7fc633fff640 1 --2- 172.21.15.1:0/4199958885 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e02b8fa240 0x55e02b8f42e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc62c006010 tx=0x7fc62c01daf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88c7ac9db70e52a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:05.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.486+0000 7fc6197fa640 1 -- 172.21.15.1:0/4199958885 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c02b040 con 0x55e02b8fa240 2024-09-19T09:40:05.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.487+0000 7fc6197fa640 1 -- 172.21.15.1:0/4199958885 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc62c018040 con 0x55e02b8fa240 2024-09-19T09:40:05.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.487+0000 7fc6197fa640 1 -- 172.21.15.1:0/4199958885 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c0058d0 con 0x55e02b8fa240 2024-09-19T09:40:05.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.487+0000 7fc63c426740 1 -- 172.21.15.1:0/4199958885 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e02b8fa240 msgr2=0x55e02b8f42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:05.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.487+0000 7fc63c426740 1 --2- 172.21.15.1:0/4199958885 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e02b8fa240 0x55e02b8f42e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc62c006010 tx=0x7fc62c01daf0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.487+0000 7fc63c426740 1 -- 172.21.15.1:0/4199958885 shutdown_connections 2024-09-19T09:40:05.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.487+0000 7fc63c426740 1 --2- 172.21.15.1:0/4199958885 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e02b8fa240 0x55e02b8f42e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.487+0000 7fc63c426740 1 --2- 172.21.15.1:0/4199958885 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e02b8ef980 0x55e02b8f5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.487+0000 7fc63c426740 1 --2- 172.21.15.1:0/4199958885 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e02b8ef060 0x55e02b8f1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.487+0000 7fc63c426740 1 -- 172.21.15.1:0/4199958885 >> 172.21.15.1:0/4199958885 conn(0x55e02b8eb5f0 msgr2=0x55e02b8f5820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:05.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.487+0000 7fc63c426740 1 -- 172.21.15.1:0/4199958885 shutdown_connections 2024-09-19T09:40:05.492 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.487+0000 7fc63c426740 1 -- 172.21.15.1:0/4199958885 wait complete. 2024-09-19T09:40:05.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.487+0000 7fc63c426740 1 -- start start 2024-09-19T09:40:05.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.488+0000 7fc63c426740 1 Processor -- start 2024-09-19T09:40:05.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.488+0000 7fc63c426740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e02b8ef060 0x55e02b90d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:05.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.488+0000 7fc63c426740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e02b8ef980 0x55e02b90db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:05.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.488+0000 7fc63c426740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e02b8fa240 0x55e02b9735b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:05.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.488+0000 7fc63c426740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc6341ae480 con 0x55e02b8fa240 2024-09-19T09:40:05.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.488+0000 7fc63c426740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc6341af8f0 con 0x55e02b8ef060 2024-09-19T09:40:05.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.488+0000 7fc63c426740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc6341aeb50 con 0x55e02b8ef980 2024-09-19T09:40:05.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.488+0000 7fc63c426740 10 client.0 _ll_register_callbacks cb 0x7fc62c01d740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:05.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.488+0000 7fc633fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e02b8fa240 0x55e02b9735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:05.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.488+0000 7fc633fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e02b8fa240 0x55e02b9735b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40206/0 (socket says 172.21.15.1:40206) 2024-09-19T09:40:05.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.488+0000 7fc633fff640 1 -- 172.21.15.1:0/2613659944 learned_addr learned my addr 172.21.15.1:0/2613659944 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:05.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.488+0000 7fc6337fe640 1 --2- 172.21.15.1:0/2613659944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e02b8ef060 0x55e02b90d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:05.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.488+0000 7fc632ffd640 1 --2- 172.21.15.1:0/2613659944 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e02b8ef980 0x55e02b90db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:05.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.489+0000 7fc633fff640 1 -- 172.21.15.1:0/2613659944 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e02b8ef980 msgr2=0x55e02b90db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:05.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.489+0000 7fc633fff640 1 --2- 172.21.15.1:0/2613659944 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e02b8ef980 0x55e02b90db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.489+0000 7fc633fff640 1 -- 172.21.15.1:0/2613659944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e02b8ef060 msgr2=0x55e02b90d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:05.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.489+0000 7fc633fff640 1 --2- 172.21.15.1:0/2613659944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e02b8ef060 0x55e02b90d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.489+0000 7fc633fff640 1 -- 172.21.15.1:0/2613659944 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e02b8ec6a0 con 0x55e02b8fa240 2024-09-19T09:40:05.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.489+0000 7fc6337fe640 1 --2- 172.21.15.1:0/2613659944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e02b8ef060 0x55e02b90d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:40:05.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.489+0000 7fc633fff640 1 --2- 172.21.15.1:0/2613659944 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e02b8fa240 0x55e02b9735b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc62c004bb0 tx=0x7fc62c004be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8eb21d7e64caf05 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:05.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.489+0000 7fc612ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:40:05.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.489+0000 7fc612ffd640 1 -- 172.21.15.1:0/2613659944 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62c036070 con 0x55e02b8fa240 2024-09-19T09:40:05.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.489+0000 7fc612ffd640 1 -- 172.21.15.1:0/2613659944 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fc62c0125d0 con 0x55e02b8fa240 2024-09-19T09:40:05.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.489+0000 7fc63c426740 1 -- 172.21.15.1:0/2613659944 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc62c018040 con 0x55e02b8fa240 2024-09-19T09:40:05.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.489+0000 7fc612ffd640 1 -- 172.21.15.1:0/2613659944 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc62c02b040 con 0x55e02b8fa240 2024-09-19T09:40:05.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.489+0000 7fc63c426740 10 client.15663 fetch_fsmap learned FSMap version 19 2024-09-19T09:40:05.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.489+0000 7fc63c426740 1 -- 172.21.15.1:0/2613659944 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e02b974cd0 con 0x55e02b8fa240 2024-09-19T09:40:05.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.489+0000 7fc612ffd640 1 -- 172.21.15.1:0/2613659944 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc62c018040 con 0x55e02b8fa240 2024-09-19T09:40:05.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.490+0000 7fc612ffd640 1 -- 172.21.15.1:0/2613659944 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fc62c045050 con 0x55e02b8fa240 2024-09-19T09:40:05.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.490+0000 7fc63c426740 10 client.15663 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:40:05.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.490+0000 7fc63c426740 10 client.15663 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:40:05.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.490+0000 7fc63c426740 20 client.15663 populate_metadata read hostname 'smithi001' 2024-09-19T09:40:05.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.490+0000 7fc63c426740 1 --2- 172.21.15.1:0/2613659944 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55e02b975370 0x55e02b977790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:05.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.490+0000 7fc63c426740 4 client.15663 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "bf630493", "release": true, "await": true}] 2024-09-19T09:40:05.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.490+0000 7fc63c426740 1 -- 172.21.15.1:0/2613659944 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "quiesce db", "set_id": "bf630493", "release": true, "await": true}) -- 0x55e02b85c0a0 con 0x55e02b975370 2024-09-19T09:40:05.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.490+0000 7fc6337fe640 1 --2- 172.21.15.1:0/2613659944 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55e02b975370 0x55e02b977790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:05.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.490+0000 7fc6337fe640 1 --2- 172.21.15.1:0/2613659944 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55e02b975370 0x55e02b977790 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7c10c4107162b2d server_cookie=b239fff3b2c05ae4 in_seq=0 out_seq=0 2024-09-19T09:40:05.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.490+0000 7fc612ffd640 10 client.15663 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:05.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.529+0000 7fc612ffd640 1 -- 172.21.15.1:0/2613659944 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55e02b85c0a0 con 0x55e02b975370 2024-09-19T09:40:05.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.529+0000 7fc612ffd640 10 client.15663 handle_command_reply: tid=0 2024-09-19T09:40:05.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.529+0000 7fc63c426740 1 client.15663 shutdown 2024-09-19T09:40:05.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.529+0000 7fc63c426740 1 -- 172.21.15.1:0/2613659944 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e02b8fa240 msgr2=0x55e02b9735b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:05.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.529+0000 7fc63c426740 1 --2- 172.21.15.1:0/2613659944 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e02b8fa240 0x55e02b9735b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc62c004bb0 tx=0x7fc62c004be0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.529+0000 7fc63c426740 1 -- 172.21.15.1:0/2613659944 shutdown_connections 2024-09-19T09:40:05.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.529+0000 7fc63c426740 1 --2- 172.21.15.1:0/2613659944 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55e02b975370 0x55e02b977790 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.529+0000 7fc63c426740 1 --2- 172.21.15.1:0/2613659944 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e02b8fa240 0x55e02b9735b0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.529+0000 7fc63c426740 1 --2- 172.21.15.1:0/2613659944 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e02b8ef980 0x55e02b90db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.529+0000 7fc63c426740 1 --2- 172.21.15.1:0/2613659944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e02b8ef060 0x55e02b90d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.529+0000 7fc63c426740 1 -- 172.21.15.1:0/2613659944 >> 172.21.15.1:0/2613659944 conn(0x55e02b8eb5f0 msgr2=0x55e02b8f6040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:05.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.529+0000 7fc612ffd640 0 client.15663 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:05.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.530+0000 7fc63c426740 1 -- 172.21.15.1:0/2613659944 shutdown_connections 2024-09-19T09:40:05.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.530+0000 7fc63c426740 1 -- 172.21.15.1:0/2613659944 wait complete. 2024-09-19T09:40:05.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.530+0000 7fc63c426740 20 client.15663 trim_cache size 0 max 16384 2024-09-19T09:40:05.535 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:40:05.535 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 19, 2024-09-19T09:40:05.535 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24497, 2024-09-19T09:40:05.535 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 12, 2024-09-19T09:40:05.535 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T09:40:05.535 INFO:teuthology.orchestra.run.smithi001.stdout: "bf630493": { 2024-09-19T09:40:05.535 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 12, 2024-09-19T09:40:05.535 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T09:40:05.535 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:40:05.536 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T09:40:05.536 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:40:05.536 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:40:05.536 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T09:40:05.536 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 140.3, 2024-09-19T09:40:05.536 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T09:40:05.536 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T09:40:05.536 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T09:40:05.536 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:40:05.536 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T09:40:05.536 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:40:05.536 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:40:05.536 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:40:05.536 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:40:05.537 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:40:05.537 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:40:05.537 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:40:05.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.530+0000 7fc63a04d640 1 -- 172.21.15.1:0/2286799235 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc61c0a32c0 msgr2=0x7fc61c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:05.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.530+0000 7fc63a04d640 1 --2- 172.21.15.1:0/2286799235 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc61c0a32c0 0x7fc61c0a5780 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc6240058c0 tx=0x7fc624005850 comp rx=0 tx=0).stop 2024-09-19T09:40:05.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.530+0000 7fc63a04d640 1 -- 172.21.15.1:0/2286799235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc634100e30 msgr2=0x7fc6340fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:05.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.530+0000 7fc63a04d640 1 --2- 172.21.15.1:0/2286799235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc634100e30 0x7fc6340fcbd0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fc628004770 tx=0x7fc628030ce0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.530+0000 7fc63a04d640 1 -- 172.21.15.1:0/2286799235 shutdown_connections 2024-09-19T09:40:05.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.530+0000 7fc63a04d640 1 --2- 172.21.15.1:0/2286799235 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc6341055b0 0x7fc6340fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.530+0000 7fc63a04d640 1 --2- 172.21.15.1:0/2286799235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc634100e30 0x7fc6340fcbd0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.530+0000 7fc63a04d640 1 --2- 172.21.15.1:0/2286799235 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc61c0a32c0 0x7fc61c0a5780 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.530+0000 7fc63a04d640 1 --2- 172.21.15.1:0/2286799235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc634100480 0x7fc6340fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:05.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.530+0000 7fc63a04d640 1 -- 172.21.15.1:0/2286799235 >> 172.21.15.1:0/2286799235 conn(0x7fc634077210 msgr2=0x7fc634103b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:05.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.531+0000 7fc63a04d640 1 -- 172.21.15.1:0/2286799235 shutdown_connections 2024-09-19T09:40:05.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:05.531+0000 7fc63a04d640 1 -- 172.21.15.1:0/2286799235 wait complete. 2024-09-19T09:40:05.548 INFO:tasks.workunit.client.0.smithi001.stdout:checking for sys/stat.h... yes 2024-09-19T09:40:05.596 INFO:tasks.workunit.client.0.smithi001.stdout:checking for stdlib.h... yes 2024-09-19T09:40:05.647 INFO:tasks.workunit.client.0.smithi001.stdout:checking for string.h... yes 2024-09-19T09:40:05.697 INFO:tasks.workunit.client.0.smithi001.stdout:checking for memory.h... yes 2024-09-19T09:40:05.744 INFO:tasks.workunit.client.0.smithi001.stdout:checking for strings.h... yes 2024-09-19T09:40:05.791 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:40:05.805 INFO:tasks.workunit.client.0.smithi001.stdout:checking for inttypes.h... yes 2024-09-19T09:40:05.852 INFO:tasks.workunit.client.0.smithi001.stdout:checking for stdint.h... yes 2024-09-19T09:40:05.907 INFO:tasks.workunit.client.0.smithi001.stdout:checking for unistd.h... yes 2024-09-19T09:40:06.042 INFO:tasks.workunit.client.0.smithi001.stdout:checking pthread.h usability... yes 2024-09-19T09:40:06.063 INFO:tasks.workunit.client.0.smithi001.stdout:checking pthread.h presence... yes 2024-09-19T09:40:06.064 INFO:tasks.workunit.client.0.smithi001.stdout:checking for pthread.h... yes 2024-09-19T09:40:06.118 INFO:tasks.workunit.client.0.smithi001.stdout:checking fcntl.h usability... yes 2024-09-19T09:40:06.140 INFO:tasks.workunit.client.0.smithi001.stdout:checking fcntl.h presence... yes 2024-09-19T09:40:06.140 INFO:tasks.workunit.client.0.smithi001.stdout:checking for fcntl.h... yes 2024-09-19T09:40:06.193 INFO:tasks.workunit.client.0.smithi001.stdout:checking limits.h usability... yes 2024-09-19T09:40:06.212 INFO:tasks.workunit.client.0.smithi001.stdout:checking limits.h presence... yes 2024-09-19T09:40:06.213 INFO:tasks.workunit.client.0.smithi001.stdout:checking for limits.h... yes 2024-09-19T09:40:06.227 INFO:tasks.workunit.client.0.smithi001.stdout:checking for stdint.h... (cached) yes 2024-09-19T09:40:06.304 INFO:tasks.workunit.client.0.smithi001.stdout:checking sys/time.h usability... yes 2024-09-19T09:40:06.323 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'bf630493', total seconds elapsed: 23.6 2024-09-19T09:40:06.323 INFO:tasks.workunit.client.0.smithi001.stdout:checking sys/time.h presence... yes 2024-09-19T09:40:06.324 INFO:tasks.workunit.client.0.smithi001.stdout:checking for sys/time.h... yes 2024-09-19T09:40:06.338 INFO:tasks.workunit.client.0.smithi001.stdout:checking for unistd.h... (cached) yes 2024-09-19T09:40:06.385 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:06.392 INFO:tasks.workunit.client.0.smithi001.stdout:checking sys/vfs.h usability... yes 2024-09-19T09:40:06.412 INFO:tasks.workunit.client.0.smithi001.stdout:checking sys/vfs.h presence... yes 2024-09-19T09:40:06.412 INFO:tasks.workunit.client.0.smithi001.stdout:checking for sys/vfs.h... yes 2024-09-19T09:40:06.462 INFO:tasks.workunit.client.0.smithi001.stdout:checking sys/limits.h usability... no 2024-09-19T09:40:06.483 INFO:tasks.workunit.client.0.smithi001.stdout:checking sys/limits.h presence... no 2024-09-19T09:40:06.483 INFO:tasks.workunit.client.0.smithi001.stdout:checking for sys/limits.h... no 2024-09-19T09:40:06.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:06 smithi001 ceph-mon[31225]: pgmap v398: 97 pgs: 97 active+clean; 3.9 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 19 KiB/s wr, 61 op/s 2024-09-19T09:40:06.516 INFO:tasks.workunit.client.0.smithi001.stdout:checking for an ANSI C-conforming const... yes 2024-09-19T09:40:06.551 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-19T09:40:06.551 INFO:tasks.workunit.client.0.smithi001.stdout:checking for function prototypes... yes 2024-09-19T09:40:06.590 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether setvbuf arguments are reversed... no 2024-09-19T09:40:06.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:06 smithi022 ceph-mon[35583]: pgmap v398: 97 pgs: 97 active+clean; 3.9 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 19 KiB/s wr, 61 op/s 2024-09-19T09:40:06.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:06 smithi121 ceph-mon[35577]: pgmap v398: 97 pgs: 97 active+clean; 3.9 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 19 KiB/s wr, 61 op/s 2024-09-19T09:40:06.675 INFO:tasks.workunit.client.0.smithi001.stdout:checking for system... yes 2024-09-19T09:40:06.744 INFO:tasks.workunit.client.0.smithi001.stdout:checking for gettimeofday... yes 2024-09-19T09:40:06.822 INFO:tasks.workunit.client.0.smithi001.stdout:checking for mkdir... yes 2024-09-19T09:40:06.884 INFO:tasks.workunit.client.0.smithi001.stdout:checking for strerror... yes 2024-09-19T09:40:06.946 INFO:tasks.workunit.client.0.smithi001.stdout:checking for open64... yes 2024-09-19T09:40:06.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.926+0000 7f1e9a7a5640 1 -- 172.21.15.1:0/1674271543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e94102ef0 msgr2=0x7f1e9410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:06.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.926+0000 7f1e9a7a5640 1 --2- 172.21.15.1:0/1674271543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e94102ef0 0x7f1e9410da40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c009be0 tx=0x7f1e8c02a750 comp rx=0 tx=0).stop 2024-09-19T09:40:06.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.926+0000 7f1e9a7a5640 1 -- 172.21.15.1:0/1674271543 shutdown_connections 2024-09-19T09:40:06.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.926+0000 7f1e9a7a5640 1 --2- 172.21.15.1:0/1674271543 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e94102ef0 0x7f1e9410da40 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.926+0000 7f1e9a7a5640 1 --2- 172.21.15.1:0/1674271543 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e94102570 0x7f1e941029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.926+0000 7f1e9a7a5640 1 --2- 172.21.15.1:0/1674271543 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e94100e20 0x7f1e94101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.926+0000 7f1e9a7a5640 1 -- 172.21.15.1:0/1674271543 >> 172.21.15.1:0/1674271543 conn(0x7f1e940fc7d0 msgr2=0x7f1e940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:06.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.926+0000 7f1e9a7a5640 1 -- 172.21.15.1:0/1674271543 shutdown_connections 2024-09-19T09:40:06.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.926+0000 7f1e9a7a5640 1 -- 172.21.15.1:0/1674271543 wait complete. 2024-09-19T09:40:06.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.927+0000 7f1e9a7a5640 1 Processor -- start 2024-09-19T09:40:06.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.927+0000 7f1e9a7a5640 1 -- start start 2024-09-19T09:40:06.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.927+0000 7f1e9a7a5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e94100e20 0x7f1e94198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.927+0000 7f1e9a7a5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e94102570 0x7f1e941989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.927+0000 7f1e9a7a5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e94102ef0 0x7f1e9419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.927+0000 7f1e9a7a5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1e94110f30 con 0x7f1e94102ef0 2024-09-19T09:40:06.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.927+0000 7f1e9a7a5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1e94110db0 con 0x7f1e94100e20 2024-09-19T09:40:06.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.927+0000 7f1e9a7a5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1e941110b0 con 0x7f1e94102570 2024-09-19T09:40:06.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.927+0000 7f1e93fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e94100e20 0x7f1e94198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.927+0000 7f1e98d42640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e94102ef0 0x7f1e9419cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.927+0000 7f1e93fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e94100e20 0x7f1e94198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:59784/0 (socket says 172.21.15.1:59784) 2024-09-19T09:40:06.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.927+0000 7f1e98d42640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e94102ef0 0x7f1e9419cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40220/0 (socket says 172.21.15.1:40220) 2024-09-19T09:40:06.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.927+0000 7f1e93fff640 1 -- 172.21.15.1:0/2961018938 learned_addr learned my addr 172.21.15.1:0/2961018938 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:06.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.928+0000 7f1e8bfff640 1 --2- 172.21.15.1:0/2961018938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e94102570 0x7f1e941989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.928+0000 7f1e93fff640 1 -- 172.21.15.1:0/2961018938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e94102570 msgr2=0x7f1e941989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:06.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.928+0000 7f1e93fff640 1 --2- 172.21.15.1:0/2961018938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e94102570 0x7f1e941989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.928+0000 7f1e93fff640 1 -- 172.21.15.1:0/2961018938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e94102ef0 msgr2=0x7f1e9419cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:06.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.928+0000 7f1e93fff640 1 --2- 172.21.15.1:0/2961018938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e94102ef0 0x7f1e9419cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.928+0000 7f1e93fff640 1 -- 172.21.15.1:0/2961018938 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e9419d430 con 0x7f1e94100e20 2024-09-19T09:40:06.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.928+0000 7f1e93fff640 1 --2- 172.21.15.1:0/2961018938 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e94100e20 0x7f1e94198480 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1e8400e9c0 tx=0x7f1e8400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:06.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.928+0000 7f1e91ffb640 1 -- 172.21.15.1:0/2961018938 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8400cde0 con 0x7f1e94100e20 2024-09-19T09:40:06.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.928+0000 7f1e91ffb640 1 -- 172.21.15.1:0/2961018938 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e840035f0 con 0x7f1e94100e20 2024-09-19T09:40:06.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.928+0000 7f1e9a7a5640 1 -- 172.21.15.1:0/2961018938 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e9419d720 con 0x7f1e94100e20 2024-09-19T09:40:06.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.928+0000 7f1e91ffb640 1 -- 172.21.15.1:0/2961018938 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e84010690 con 0x7f1e94100e20 2024-09-19T09:40:06.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.928+0000 7f1e9a7a5640 1 -- 172.21.15.1:0/2961018938 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e941a5000 con 0x7f1e94100e20 2024-09-19T09:40:06.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.931+0000 7f1e91ffb640 1 -- 172.21.15.1:0/2961018938 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f1e840037a0 con 0x7f1e94100e20 2024-09-19T09:40:06.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.931+0000 7f1e9cb7e740 1 Processor -- start 2024-09-19T09:40:06.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.931+0000 7f1e9cb7e740 1 -- start start 2024-09-19T09:40:06.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.932+0000 7f1e9cb7e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b524a23a0 0x561b524a2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.932+0000 7f1e9cb7e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b524a2cc0 0x561b524b1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.932+0000 7f1e9cb7e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b524b1a90 0x561b524b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.932+0000 7f1e9cb7e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561b524082e0 con 0x561b524a2cc0 2024-09-19T09:40:06.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.932+0000 7f1e9cb7e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561b523afce0 con 0x561b524b1a90 2024-09-19T09:40:06.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.932+0000 7f1e9cb7e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561b524042a0 con 0x561b524a23a0 2024-09-19T09:40:06.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.932+0000 7f1e93fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b524a2cc0 0x561b524b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.932+0000 7f1e98d42640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b524a23a0 0x561b524a2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.932+0000 7f1e98d42640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b524a23a0 0x561b524a2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:53604/0 (socket says 172.21.15.1:53604) 2024-09-19T09:40:06.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.932+0000 7f1e98d42640 1 -- 172.21.15.1:0/2918508014 learned_addr learned my addr 172.21.15.1:0/2918508014 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:06.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.932+0000 7f1e93fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b524a2cc0 0x561b524b1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40228/0 (socket says 172.21.15.1:40228) 2024-09-19T09:40:06.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.932+0000 7f1e8bfff640 1 --2- 172.21.15.1:0/2918508014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b524b1a90 0x561b524b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.932+0000 7f1e91ffb640 1 --2- 172.21.15.1:0/2961018938 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f1e800a3240 0x7f1e800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.932+0000 7f1e98d42640 1 -- 172.21.15.1:0/2918508014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b524b1a90 msgr2=0x561b524b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:06.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.932+0000 7f1e98d42640 1 --2- 172.21.15.1:0/2918508014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b524b1a90 0x561b524b3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.932+0000 7f1e98d42640 1 -- 172.21.15.1:0/2918508014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b524a2cc0 msgr2=0x561b524b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:06.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.932+0000 7f1e98d42640 1 --2- 172.21.15.1:0/2918508014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b524a2cc0 0x561b524b1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.932+0000 7f1e98d42640 1 -- 172.21.15.1:0/2918508014 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b52394440 con 0x561b524a23a0 2024-09-19T09:40:06.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.933+0000 7f1e91ffb640 1 -- 172.21.15.1:0/2961018938 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f1e840cfcb0 con 0x7f1e94100e20 2024-09-19T09:40:06.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.933+0000 7f1e98d42640 1 --2- 172.21.15.1:0/2961018938 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f1e800a3240 0x7f1e800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.933+0000 7f1e98d42640 1 --2- 172.21.15.1:0/2918508014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b524a23a0 0x561b524a2780 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c0303a0 tx=0x7f1e8c0303d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c616795cc2b7b30 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:06.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.933+0000 7f1e8a7fc640 1 -- 172.21.15.1:0/2918508014 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c04f070 con 0x561b524a23a0 2024-09-19T09:40:06.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.933+0000 7f1e8a7fc640 1 -- 172.21.15.1:0/2918508014 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e8c037040 con 0x561b524a23a0 2024-09-19T09:40:06.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.933+0000 7f1e98d42640 1 --2- 172.21.15.1:0/2961018938 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f1e800a3240 0x7f1e800a5700 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c04c000 tx=0x7f1e8c04d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:06.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.933+0000 7f1e8a7fc640 1 -- 172.21.15.1:0/2918508014 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c036070 con 0x561b524a23a0 2024-09-19T09:40:06.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.934+0000 7f1e9cb7e740 1 -- 172.21.15.1:0/2918508014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b524a23a0 msgr2=0x561b524a2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:06.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.934+0000 7f1e9cb7e740 1 --2- 172.21.15.1:0/2918508014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b524a23a0 0x561b524a2780 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c0303a0 tx=0x7f1e8c0303d0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.934+0000 7f1e9cb7e740 1 -- 172.21.15.1:0/2918508014 shutdown_connections 2024-09-19T09:40:06.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.934+0000 7f1e9cb7e740 1 --2- 172.21.15.1:0/2918508014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b524b1a90 0x561b524b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.934+0000 7f1e9cb7e740 1 --2- 172.21.15.1:0/2918508014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b524a2cc0 0x561b524b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.934+0000 7f1e9cb7e740 1 --2- 172.21.15.1:0/2918508014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b524a23a0 0x561b524a2780 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.934+0000 7f1e9cb7e740 1 -- 172.21.15.1:0/2918508014 >> 172.21.15.1:0/2918508014 conn(0x561b5249ea30 msgr2=0x561b5249ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:06.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.934+0000 7f1e9cb7e740 1 -- 172.21.15.1:0/2918508014 shutdown_connections 2024-09-19T09:40:06.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.934+0000 7f1e9cb7e740 1 -- 172.21.15.1:0/2918508014 wait complete. 2024-09-19T09:40:06.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.935+0000 7f1e9cb7e740 1 -- start start 2024-09-19T09:40:06.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.935+0000 7f1e9cb7e740 1 Processor -- start 2024-09-19T09:40:06.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.935+0000 7f1e9cb7e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b524a23a0 0x561b524b1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.935+0000 7f1e9cb7e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b524a2cc0 0x561b524ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.935+0000 7f1e9cb7e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b524b1a90 0x561b524aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.935+0000 7f1e9cb7e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561b524b46c0 con 0x561b524a23a0 2024-09-19T09:40:06.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.935+0000 7f1e9cb7e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561b523c3050 con 0x561b524a2cc0 2024-09-19T09:40:06.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.935+0000 7f1e9cb7e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561b524b4840 con 0x561b524b1a90 2024-09-19T09:40:06.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.935+0000 7f1e9cb7e740 10 client.0 _ll_register_callbacks cb 0x561b52403160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:06.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.935+0000 7f1e8bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b524a2cc0 0x561b524ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.935+0000 7f1e93fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b524a23a0 0x561b524b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.935+0000 7f1e8bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b524a2cc0 0x561b524ae6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:59790/0 (socket says 172.21.15.1:59790) 2024-09-19T09:40:06.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.935+0000 7f1e8bfff640 1 -- 172.21.15.1:0/1128105746 learned_addr learned my addr 172.21.15.1:0/1128105746 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:06.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.936+0000 7f1e98d42640 1 --2- 172.21.15.1:0/1128105746 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b524b1a90 0x561b524aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.936+0000 7f1e8bfff640 1 -- 172.21.15.1:0/1128105746 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b524b1a90 msgr2=0x561b524aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:06.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.936+0000 7f1e8bfff640 1 --2- 172.21.15.1:0/1128105746 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b524b1a90 0x561b524aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.936+0000 7f1e8bfff640 1 -- 172.21.15.1:0/1128105746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b524a23a0 msgr2=0x561b524b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:06.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.936+0000 7f1e8bfff640 1 --2- 172.21.15.1:0/1128105746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b524a23a0 0x561b524b1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.936+0000 7f1e8bfff640 1 -- 172.21.15.1:0/1128105746 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b521793c0 con 0x561b524a2cc0 2024-09-19T09:40:06.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.936+0000 7f1e93fff640 1 --2- 172.21.15.1:0/1128105746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b524a23a0 0x561b524b1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:40:06.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.936+0000 7f1e8bfff640 1 --2- 172.21.15.1:0/1128105746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b524a2cc0 0x561b524ae6f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c012700 tx=0x7f1e7c012b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6dab2fb6cce828a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:06.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.936+0000 7f1e737fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:40:06.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.936+0000 7f1e737fe640 1 -- 172.21.15.1:0/1128105746 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c004260 con 0x561b524a2cc0 2024-09-19T09:40:06.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.936+0000 7f1e737fe640 1 -- 172.21.15.1:0/1128105746 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f1e7c004400 con 0x561b524a2cc0 2024-09-19T09:40:06.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.936+0000 7f1e9cb7e740 1 -- 172.21.15.1:0/1128105746 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e8c037040 con 0x561b524a2cc0 2024-09-19T09:40:06.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.936+0000 7f1e737fe640 1 -- 172.21.15.1:0/1128105746 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1e7c011660 con 0x561b524a2cc0 2024-09-19T09:40:06.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.936+0000 7f1e9cb7e740 10 client.25346 fetch_fsmap learned FSMap version 19 2024-09-19T09:40:06.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.936+0000 7f1e9cb7e740 1 -- 172.21.15.1:0/1128105746 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x561b524c01a0 con 0x561b524a2cc0 2024-09-19T09:40:06.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.937+0000 7f1e737fe640 1 -- 172.21.15.1:0/1128105746 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e8c037040 con 0x561b524a2cc0 2024-09-19T09:40:06.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.937+0000 7f1e737fe640 1 -- 172.21.15.1:0/1128105746 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1e7c003be0 con 0x561b524a2cc0 2024-09-19T09:40:06.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.937+0000 7f1e9cb7e740 10 client.25346 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:40:06.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.937+0000 7f1e9cb7e740 10 client.25346 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:06.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.937+0000 7f1e9cb7e740 20 client.25346 populate_metadata read hostname 'smithi001' 2024-09-19T09:40:06.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.937+0000 7f1e9cb7e740 1 --2- 172.21.15.1:0/1128105746 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x561b524c16b0 0x561b524c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.937+0000 7f1e9cb7e740 4 client.25346 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:06.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.937+0000 7f1e9cb7e740 1 -- 172.21.15.1:0/1128105746 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b52415850 con 0x561b524c16b0 2024-09-19T09:40:06.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.937+0000 7f1e93fff640 1 --2- 172.21.15.1:0/1128105746 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x561b524c16b0 0x561b524c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.937+0000 7f1e737fe640 10 client.25346 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:06.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.938+0000 7f1e93fff640 1 --2- 172.21.15.1:0/1128105746 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x561b524c16b0 0x561b524c3ac0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f97ce4cb8732175f server_cookie=52c171e0693227e1 in_seq=0 out_seq=0 2024-09-19T09:40:06.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.939+0000 7f1e737fe640 1 -- 172.21.15.1:0/1128105746 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561b52415850 con 0x561b524c16b0 2024-09-19T09:40:06.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.939+0000 7f1e737fe640 10 client.25346 handle_command_reply: tid=0 2024-09-19T09:40:06.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.939+0000 7f1e9cb7e740 1 client.25346 shutdown 2024-09-19T09:40:06.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.939+0000 7f1e9cb7e740 1 -- 172.21.15.1:0/1128105746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b524a2cc0 msgr2=0x561b524ae6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:06.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.939+0000 7f1e9cb7e740 1 --2- 172.21.15.1:0/1128105746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b524a2cc0 0x561b524ae6f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c012700 tx=0x7f1e7c012b00 comp rx=0 tx=0).stop 2024-09-19T09:40:06.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.939+0000 7f1e9cb7e740 1 -- 172.21.15.1:0/1128105746 shutdown_connections 2024-09-19T09:40:06.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.939+0000 7f1e9cb7e740 1 --2- 172.21.15.1:0/1128105746 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x561b524c16b0 0x561b524c3ac0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.939+0000 7f1e9cb7e740 1 --2- 172.21.15.1:0/1128105746 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b524b1a90 0x561b524aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.939+0000 7f1e9cb7e740 1 --2- 172.21.15.1:0/1128105746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b524a2cc0 0x561b524ae6f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.939+0000 7f1e9cb7e740 1 --2- 172.21.15.1:0/1128105746 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b524a23a0 0x561b524b1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.939+0000 7f1e737fe640 0 client.25346 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:06.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.939+0000 7f1e9cb7e740 1 -- 172.21.15.1:0/1128105746 >> 172.21.15.1:0/1128105746 conn(0x561b5249ea30 msgr2=0x561b524a4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:06.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.939+0000 7f1e9cb7e740 1 -- 172.21.15.1:0/1128105746 shutdown_connections 2024-09-19T09:40:06.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.939+0000 7f1e9cb7e740 1 -- 172.21.15.1:0/1128105746 wait complete. 2024-09-19T09:40:06.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.939+0000 7f1e9cb7e740 20 client.25346 trim_cache size 0 max 16384 2024-09-19T09:40:06.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.958+0000 7f1e9cb7e740 1 Processor -- start 2024-09-19T09:40:06.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.958+0000 7f1e9cb7e740 1 -- start start 2024-09-19T09:40:06.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.958+0000 7f1e9cb7e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b524a23a0 0x561b524bd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.958+0000 7f1e9cb7e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b524a2cc0 0x561b524acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.958+0000 7f1e9cb7e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b524b1a90 0x561b524c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.958+0000 7f1e9cb7e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1e941a9350 con 0x561b524a2cc0 2024-09-19T09:40:06.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.958+0000 7f1e9cb7e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1e941abbf0 con 0x561b524a23a0 2024-09-19T09:40:06.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.958+0000 7f1e9cb7e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1e941a99e0 con 0x561b524b1a90 2024-09-19T09:40:06.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.958+0000 7f1e8bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b524a2cc0 0x561b524acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.958+0000 7f1e8bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b524a2cc0 0x561b524acfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40234/0 (socket says 172.21.15.1:40234) 2024-09-19T09:40:06.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.958+0000 7f1e8bfff640 1 -- 172.21.15.1:0/210289773 learned_addr learned my addr 172.21.15.1:0/210289773 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:06.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.958+0000 7f1e93fff640 1 --2- 172.21.15.1:0/210289773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b524a23a0 0x561b524bd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.958+0000 7f1e98d42640 1 --2- 172.21.15.1:0/210289773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b524b1a90 0x561b524c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.958+0000 7f1e8bfff640 1 -- 172.21.15.1:0/210289773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b524b1a90 msgr2=0x561b524c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:06.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.958+0000 7f1e8bfff640 1 --2- 172.21.15.1:0/210289773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b524b1a90 0x561b524c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.958+0000 7f1e8bfff640 1 -- 172.21.15.1:0/210289773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b524a23a0 msgr2=0x561b524bd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:06.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.958+0000 7f1e8bfff640 1 --2- 172.21.15.1:0/210289773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b524a23a0 0x561b524bd990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.958+0000 7f1e8bfff640 1 -- 172.21.15.1:0/210289773 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b524ad6a0 con 0x561b524a2cc0 2024-09-19T09:40:06.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.959+0000 7f1e98d42640 1 --2- 172.21.15.1:0/210289773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b524b1a90 0x561b524c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:06.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.958+0000 7f1e93fff640 1 --2- 172.21.15.1:0/210289773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b524a23a0 0x561b524bd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:40:06.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.959+0000 7f1e8bfff640 1 --2- 172.21.15.1:0/210289773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b524a2cc0 0x561b524acfc0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c00f440 tx=0x7f1e7c0096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4bd91ce406c9e5f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:06.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.959+0000 7f1e89ffb640 1 -- 172.21.15.1:0/210289773 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c0052d0 con 0x561b524a2cc0 2024-09-19T09:40:06.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.959+0000 7f1e89ffb640 1 -- 172.21.15.1:0/210289773 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e7c00fd10 con 0x561b524a2cc0 2024-09-19T09:40:06.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.959+0000 7f1e89ffb640 1 -- 172.21.15.1:0/210289773 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c0035f0 con 0x561b524a2cc0 2024-09-19T09:40:06.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.960+0000 7f1e9cb7e740 1 -- 172.21.15.1:0/210289773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b524a2cc0 msgr2=0x561b524acfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:06.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.960+0000 7f1e9cb7e740 1 --2- 172.21.15.1:0/210289773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b524a2cc0 0x561b524acfc0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c00f440 tx=0x7f1e7c0096c0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.960+0000 7f1e9cb7e740 1 -- 172.21.15.1:0/210289773 shutdown_connections 2024-09-19T09:40:06.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.960+0000 7f1e9cb7e740 1 --2- 172.21.15.1:0/210289773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b524b1a90 0x561b524c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.960+0000 7f1e9cb7e740 1 --2- 172.21.15.1:0/210289773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b524a2cc0 0x561b524acfc0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.960+0000 7f1e9cb7e740 1 --2- 172.21.15.1:0/210289773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b524a23a0 0x561b524bd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.960+0000 7f1e9cb7e740 1 -- 172.21.15.1:0/210289773 >> 172.21.15.1:0/210289773 conn(0x561b5249ea30 msgr2=0x561b524a9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:06.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.960+0000 7f1e9cb7e740 1 -- 172.21.15.1:0/210289773 shutdown_connections 2024-09-19T09:40:06.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.960+0000 7f1e9cb7e740 1 -- 172.21.15.1:0/210289773 wait complete. 2024-09-19T09:40:06.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.960+0000 7f1e9cb7e740 1 -- start start 2024-09-19T09:40:06.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.960+0000 7f1e9cb7e740 1 Processor -- start 2024-09-19T09:40:06.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.961+0000 7f1e9cb7e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b524a23a0 0x561b524b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.961+0000 7f1e9cb7e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b524a2cc0 0x561b524b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.961+0000 7f1e9cb7e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b524b1a90 0x561b524b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.961+0000 7f1e9cb7e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1e941aa0b0 con 0x561b524a23a0 2024-09-19T09:40:06.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.961+0000 7f1e9cb7e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1e941ab520 con 0x561b524b1a90 2024-09-19T09:40:06.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.961+0000 7f1e9cb7e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1e941aa780 con 0x561b524a2cc0 2024-09-19T09:40:06.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.961+0000 7f1e93fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b524a23a0 0x561b524b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.961+0000 7f1e9cb7e740 10 client.0 _ll_register_callbacks cb 0x7f1e7c0097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:06.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.961+0000 7f1e93fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b524a23a0 0x561b524b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40248/0 (socket says 172.21.15.1:40248) 2024-09-19T09:40:06.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.961+0000 7f1e98d42640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b524b1a90 0x561b524b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.961+0000 7f1e93fff640 1 -- 172.21.15.1:0/366735998 learned_addr learned my addr 172.21.15.1:0/366735998 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:06.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.961+0000 7f1e8bfff640 1 --2- 172.21.15.1:0/366735998 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b524a2cc0 0x561b524b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.961+0000 7f1e98d42640 1 -- 172.21.15.1:0/366735998 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b524a2cc0 msgr2=0x561b524b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:06.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.961+0000 7f1e98d42640 1 --2- 172.21.15.1:0/366735998 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b524a2cc0 0x561b524b5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.961+0000 7f1e98d42640 1 -- 172.21.15.1:0/366735998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b524a23a0 msgr2=0x561b524b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:06.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.961+0000 7f1e98d42640 1 --2- 172.21.15.1:0/366735998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b524a23a0 0x561b524b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.961+0000 7f1e98d42640 1 -- 172.21.15.1:0/366735998 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b524a2af0 con 0x561b524b1a90 2024-09-19T09:40:06.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.961+0000 7f1e98d42640 1 --2- 172.21.15.1:0/366735998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b524b1a90 0x561b524b63d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c009be0 tx=0x7f1e8c02a750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54c25cd975b380e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:06.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.961+0000 7f1e737fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:40:06.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.962+0000 7f1e737fe640 1 -- 172.21.15.1:0/366735998 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c036030 con 0x561b524b1a90 2024-09-19T09:40:06.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.962+0000 7f1e737fe640 1 -- 172.21.15.1:0/366735998 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f1e8c003c40 con 0x561b524b1a90 2024-09-19T09:40:06.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.962+0000 7f1e9cb7e740 1 -- 172.21.15.1:0/366735998 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e7c00fd10 con 0x561b524b1a90 2024-09-19T09:40:06.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.962+0000 7f1e737fe640 1 -- 172.21.15.1:0/366735998 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1e8c066050 con 0x561b524b1a90 2024-09-19T09:40:06.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.962+0000 7f1e9cb7e740 10 client.25352 fetch_fsmap learned FSMap version 19 2024-09-19T09:40:06.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.962+0000 7f1e9cb7e740 1 -- 172.21.15.1:0/366735998 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x561b5252c5c0 con 0x561b524b1a90 2024-09-19T09:40:06.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.962+0000 7f1e737fe640 1 -- 172.21.15.1:0/366735998 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e7c00fd10 con 0x561b524b1a90 2024-09-19T09:40:06.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.962+0000 7f1e737fe640 1 -- 172.21.15.1:0/366735998 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1e8c046040 con 0x561b524b1a90 2024-09-19T09:40:06.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.962+0000 7f1e9cb7e740 10 client.25352 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:40:06.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.962+0000 7f1e9cb7e740 10 client.25352 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:06.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.962+0000 7f1e9cb7e740 20 client.25352 populate_metadata read hostname 'smithi001' 2024-09-19T09:40:06.990 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:40:06.990 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "no active scrubs running", 2024-09-19T09:40:06.990 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": {} 2024-09-19T09:40:06.990 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:40:06.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.962+0000 7f1e9cb7e740 1 --2- 172.21.15.1:0/366735998 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x561b5252c8f0 0x561b5252ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:06.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.962+0000 7f1e9cb7e740 4 client.25352 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:40:06.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.962+0000 7f1e9cb7e740 1 -- 172.21.15.1:0/366735998 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561b5240fd60 con 0x561b5252c8f0 2024-09-19T09:40:06.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.962+0000 7f1e93fff640 1 --2- 172.21.15.1:0/366735998 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x561b5252c8f0 0x561b5252ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:06.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.963+0000 7f1e737fe640 10 client.25352 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:06.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.963+0000 7f1e93fff640 1 --2- 172.21.15.1:0/366735998 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x561b5252c8f0 0x561b5252ece0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94a7ce8fd737c9a7 server_cookie=b5ef0cb46a9cd17c in_seq=0 out_seq=0 2024-09-19T09:40:06.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.963+0000 7f1e737fe640 1 -- 172.21.15.1:0/366735998 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561b5240fd60 con 0x561b5252c8f0 2024-09-19T09:40:06.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.963+0000 7f1e737fe640 10 client.25352 handle_command_reply: tid=0 2024-09-19T09:40:06.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.963+0000 7f1e9cb7e740 1 client.25352 shutdown 2024-09-19T09:40:06.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.963+0000 7f1e9cb7e740 1 -- 172.21.15.1:0/366735998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b524b1a90 msgr2=0x561b524b63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:06.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.963+0000 7f1e9cb7e740 1 --2- 172.21.15.1:0/366735998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b524b1a90 0x561b524b63d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c009be0 tx=0x7f1e8c02a750 comp rx=0 tx=0).stop 2024-09-19T09:40:06.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.963+0000 7f1e9cb7e740 1 -- 172.21.15.1:0/366735998 shutdown_connections 2024-09-19T09:40:06.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.963+0000 7f1e9cb7e740 1 --2- 172.21.15.1:0/366735998 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x561b5252c8f0 0x561b5252ece0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.963+0000 7f1e9cb7e740 1 --2- 172.21.15.1:0/366735998 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b524b1a90 0x561b524b63d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.963+0000 7f1e737fe640 0 client.25352 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:06.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.963+0000 7f1e9cb7e740 1 --2- 172.21.15.1:0/366735998 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b524a2cc0 0x561b524b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.963+0000 7f1e9cb7e740 1 --2- 172.21.15.1:0/366735998 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561b524a23a0 0x561b524b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.963+0000 7f1e9cb7e740 1 -- 172.21.15.1:0/366735998 >> 172.21.15.1:0/366735998 conn(0x561b5249ea30 msgr2=0x561b524a9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:06.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.963+0000 7f1e9cb7e740 1 -- 172.21.15.1:0/366735998 shutdown_connections 2024-09-19T09:40:06.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.963+0000 7f1e9cb7e740 1 -- 172.21.15.1:0/366735998 wait complete. 2024-09-19T09:40:06.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.963+0000 7f1e9cb7e740 20 client.25352 trim_cache size 0 max 16384 2024-09-19T09:40:06.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.964+0000 7f1e9a7a5640 1 -- 172.21.15.1:0/2961018938 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f1e800a3240 msgr2=0x7f1e800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:06.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.964+0000 7f1e9a7a5640 1 --2- 172.21.15.1:0/2961018938 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f1e800a3240 0x7f1e800a5700 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c04c000 tx=0x7f1e8c04d000 comp rx=0 tx=0).stop 2024-09-19T09:40:06.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.964+0000 7f1e9a7a5640 1 -- 172.21.15.1:0/2961018938 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e94100e20 msgr2=0x7f1e94198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:06.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.964+0000 7f1e9a7a5640 1 --2- 172.21.15.1:0/2961018938 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e94100e20 0x7f1e94198480 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1e8400e9c0 tx=0x7f1e8400ee80 comp rx=0 tx=0).stop 2024-09-19T09:40:06.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.964+0000 7f1e9a7a5640 1 -- 172.21.15.1:0/2961018938 shutdown_connections 2024-09-19T09:40:06.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.964+0000 7f1e9a7a5640 1 --2- 172.21.15.1:0/2961018938 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1e94102ef0 0x7f1e9419cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.964+0000 7f1e9a7a5640 1 --2- 172.21.15.1:0/2961018938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1e94102570 0x7f1e941989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.964+0000 7f1e9a7a5640 1 --2- 172.21.15.1:0/2961018938 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f1e800a3240 0x7f1e800a5700 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.964+0000 7f1e9a7a5640 1 --2- 172.21.15.1:0/2961018938 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e94100e20 0x7f1e94198480 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:06.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.964+0000 7f1e9a7a5640 1 -- 172.21.15.1:0/2961018938 >> 172.21.15.1:0/2961018938 conn(0x7f1e940fc7d0 msgr2=0x7f1e9406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:06.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.964+0000 7f1e9a7a5640 1 -- 172.21.15.1:0/2961018938 shutdown_connections 2024-09-19T09:40:06.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:06.964+0000 7f1e9a7a5640 1 -- 172.21.15.1:0/2961018938 wait complete. 2024-09-19T09:40:07.014 INFO:tasks.workunit.client.0.smithi001.stdout:checking for stat64... yes 2024-09-19T09:40:07.075 INFO:tasks.workunit.client.0.smithi001.stdout:checking for fseeko64... yes 2024-09-19T09:40:07.136 INFO:tasks.workunit.client.0.smithi001.stdout:checking for lrand48_r... yes 2024-09-19T09:40:07.198 INFO:tasks.workunit.client.0.smithi001.stdout:checking for srand48_r... yes 2024-09-19T09:40:07.222 INFO:tasks.workunit.client.0.smithi001.stdout:configure: creating ./config.status 2024-09-19T09:40:07.319 INFO:tasks.workunit.client.0.smithi001.stdout:config.status: creating Makefile 2024-09-19T09:40:07.332 INFO:tasks.workunit.client.0.smithi001.stdout:config.status: creating config.h 2024-09-19T09:40:07.349 INFO:tasks.workunit.client.0.smithi001.stdout:config.status: executing depfiles commands 2024-09-19T09:40:07.396 INFO:tasks.workunit.client.0.smithi001.stdout:config.status: executing default commands 2024-09-19T09:40:07.439 INFO:tasks.workunit.client.0.smithi001.stderr:+ make 2024-09-19T09:40:07.446 INFO:tasks.workunit.client.0.smithi001.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2024-09-19T09:40:07.449 INFO:tasks.workunit.client.0.smithi001.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-09-19T09:40:07.450 INFO:tasks.workunit.client.0.smithi001.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-09-19T09:40:07.450 INFO:tasks.workunit.client.0.smithi001.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-09-19T09:40:07.450 INFO:tasks.workunit.client.0.smithi001.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-09-19T09:40:07.450 INFO:tasks.workunit.client.0.smithi001.stderr: any GNU archive site. 2024-09-19T09:40:07.452 INFO:tasks.workunit.client.0.smithi001.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2024-09-19T09:40:07.453 INFO:tasks.workunit.client.0.smithi001.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-09-19T09:40:07.454 INFO:tasks.workunit.client.0.smithi001.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-09-19T09:40:07.454 INFO:tasks.workunit.client.0.smithi001.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-09-19T09:40:07.454 INFO:tasks.workunit.client.0.smithi001.stderr: You might want to install the `Automake' and `Perl' packages. 2024-09-19T09:40:07.454 INFO:tasks.workunit.client.0.smithi001.stderr: Grab them from any GNU archive site. 2024-09-19T09:40:07.493 INFO:tasks.workunit.client.0.smithi001.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2024-09-19T09:40:07.526 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.522+0000 7fe10f217640 1 -- 172.21.15.1:0/3275883039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe108107820 msgr2=0x7fe108109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:07.526 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.522+0000 7fe10f217640 1 --2- 172.21.15.1:0/3275883039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe108107820 0x7fe108109c90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe100009be0 tx=0x7fe10002a6c0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.527 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.522+0000 7fe10f217640 1 -- 172.21.15.1:0/3275883039 shutdown_connections 2024-09-19T09:40:07.527 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.522+0000 7fe10f217640 1 --2- 172.21.15.1:0/3275883039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe108107820 0x7fe108109c90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.527 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.522+0000 7fe10f217640 1 --2- 172.21.15.1:0/3275883039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe108104ef0 0x7fe1081072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.527 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.522+0000 7fe10f217640 1 --2- 172.21.15.1:0/3275883039 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1081025c0 0x7fe1081049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.527 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.522+0000 7fe10f217640 1 -- 172.21.15.1:0/3275883039 >> 172.21.15.1:0/3275883039 conn(0x7fe1080fc1c0 msgr2=0x7fe1080fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:07.527 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.522+0000 7fe10f217640 1 -- 172.21.15.1:0/3275883039 shutdown_connections 2024-09-19T09:40:07.527 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.522+0000 7fe10f217640 1 -- 172.21.15.1:0/3275883039 wait complete. 2024-09-19T09:40:07.527 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.522+0000 7fe10f217640 1 Processor -- start 2024-09-19T09:40:07.527 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.522+0000 7fe10f217640 1 -- start start 2024-09-19T09:40:07.527 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.523+0000 7fe10f217640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1081025c0 0x7fe108197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.527 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.523+0000 7fe10f217640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe108104ef0 0x7fe108198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.527 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.523+0000 7fe10f217640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe108107820 0x7fe10819f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.527 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.523+0000 7fe10f217640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe10810d7b0 con 0x7fe108104ef0 2024-09-19T09:40:07.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.523+0000 7fe10f217640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe10810d630 con 0x7fe108107820 2024-09-19T09:40:07.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.523+0000 7fe10f217640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe10810d930 con 0x7fe1081025c0 2024-09-19T09:40:07.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.523+0000 7fe107fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe108104ef0 0x7fe108198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.523+0000 7fe107fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe108104ef0 0x7fe108198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40276/0 (socket says 172.21.15.1:40276) 2024-09-19T09:40:07.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.523+0000 7fe107fff640 1 -- 172.21.15.1:0/2436144773 learned_addr learned my addr 172.21.15.1:0/2436144773 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:07.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.523+0000 7fe10d7b4640 1 --2- 172.21.15.1:0/2436144773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe108107820 0x7fe10819f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.523+0000 7fe10cfb3640 1 --2- 172.21.15.1:0/2436144773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1081025c0 0x7fe108197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.523+0000 7fe107fff640 1 -- 172.21.15.1:0/2436144773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1081025c0 msgr2=0x7fe108197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:07.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.523+0000 7fe107fff640 1 --2- 172.21.15.1:0/2436144773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1081025c0 0x7fe108197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.523+0000 7fe107fff640 1 -- 172.21.15.1:0/2436144773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe108107820 msgr2=0x7fe10819f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:07.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.523+0000 7fe107fff640 1 --2- 172.21.15.1:0/2436144773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe108107820 0x7fe10819f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.523+0000 7fe107fff640 1 -- 172.21.15.1:0/2436144773 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10819faf0 con 0x7fe108104ef0 2024-09-19T09:40:07.528 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.523+0000 7fe10cfb3640 1 --2- 172.21.15.1:0/2436144773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1081025c0 0x7fe108197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:40:07.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.523+0000 7fe107fff640 1 --2- 172.21.15.1:0/2436144773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe108104ef0 0x7fe108198410 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000e9a0 tx=0x7fe0f000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:07.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.523+0000 7fe105ffb640 1 -- 172.21.15.1:0/2436144773 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f000cd80 con 0x7fe108104ef0 2024-09-19T09:40:07.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.523+0000 7fe10f217640 1 -- 172.21.15.1:0/2436144773 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe10819fde0 con 0x7fe108104ef0 2024-09-19T09:40:07.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.523+0000 7fe105ffb640 1 -- 172.21.15.1:0/2436144773 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0f00035f0 con 0x7fe108104ef0 2024-09-19T09:40:07.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.523+0000 7fe105ffb640 1 -- 172.21.15.1:0/2436144773 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f0010670 con 0x7fe108104ef0 2024-09-19T09:40:07.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.524+0000 7fe10f217640 1 -- 172.21.15.1:0/2436144773 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1081a02f0 con 0x7fe108104ef0 2024-09-19T09:40:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.526+0000 7fe105ffb640 1 -- 172.21.15.1:0/2436144773 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fe0f00037a0 con 0x7fe108104ef0 2024-09-19T09:40:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.526+0000 7fe112088740 1 Processor -- start 2024-09-19T09:40:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.526+0000 7fe112088740 1 -- start start 2024-09-19T09:40:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.526+0000 7fe112088740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55980ffc3db0 0x55980ffc41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.526+0000 7fe112088740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55980ffc46f0 0x55980ffc91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.526+0000 7fe112088740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55980ffc9780 0x55980ffcbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.526+0000 7fe112088740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55980ff232f0 con 0x55980ffc3db0 2024-09-19T09:40:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.526+0000 7fe112088740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55980fecb270 con 0x55980ffc46f0 2024-09-19T09:40:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.526+0000 7fe112088740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55980ff1f2b0 con 0x55980ffc9780 2024-09-19T09:40:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.527+0000 7fe10d7b4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55980ffc3db0 0x55980ffc41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.527+0000 7fe10d7b4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55980ffc3db0 0x55980ffc41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40288/0 (socket says 172.21.15.1:40288) 2024-09-19T09:40:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.527+0000 7fe10d7b4640 1 -- 172.21.15.1:0/3012119378 learned_addr learned my addr 172.21.15.1:0/3012119378 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.527+0000 7fe105ffb640 1 --2- 172.21.15.1:0/2436144773 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe0f40a3240 0x7fe0f40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.527+0000 7fe10cfb3640 1 --2- 172.21.15.1:0/3012119378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55980ffc46f0 0x55980ffc91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.527+0000 7fe107fff640 1 --2- 172.21.15.1:0/3012119378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55980ffc9780 0x55980ffcbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.527+0000 7fe10d7b4640 1 --2- 172.21.15.1:0/2436144773 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe0f40a3240 0x7fe0f40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.527+0000 7fe105ffb640 1 -- 172.21.15.1:0/2436144773 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fe0f00cfc00 con 0x7fe108104ef0 2024-09-19T09:40:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.527+0000 7fe10d7b4640 1 -- 172.21.15.1:0/3012119378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55980ffc9780 msgr2=0x55980ffcbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:07.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.527+0000 7fe10d7b4640 1 --2- 172.21.15.1:0/3012119378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55980ffc9780 0x55980ffcbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.527+0000 7fe10d7b4640 1 -- 172.21.15.1:0/3012119378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55980ffc46f0 msgr2=0x55980ffc91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.527+0000 7fe10d7b4640 1 --2- 172.21.15.1:0/3012119378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55980ffc46f0 0x55980ffc91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.527+0000 7fe10d7b4640 1 -- 172.21.15.1:0/3012119378 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55980feca340 con 0x55980ffc3db0 2024-09-19T09:40:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.527+0000 7fe107fff640 1 --2- 172.21.15.1:0/3012119378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55980ffc9780 0x55980ffcbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.527+0000 7fe10d7b4640 1 --2- 172.21.15.1:0/3012119378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55980ffc3db0 0x55980ffc41b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fe100004ad0 tx=0x7fe1000303a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ddadd23a0967ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.527+0000 7fe0feffd640 1 -- 172.21.15.1:0/3012119378 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe100050070 con 0x55980ffc3db0 2024-09-19T09:40:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.528+0000 7fe0feffd640 1 -- 172.21.15.1:0/3012119378 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe100037040 con 0x55980ffc3db0 2024-09-19T09:40:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.528+0000 7fe0feffd640 1 -- 172.21.15.1:0/3012119378 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe100036070 con 0x55980ffc3db0 2024-09-19T09:40:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.528+0000 7fe10d7b4640 1 --2- 172.21.15.1:0/2436144773 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe0f40a3240 0x7fe0f40a5700 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe100005cc0 tx=0x7fe100049000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.528+0000 7fe112088740 1 -- 172.21.15.1:0/3012119378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55980ffc3db0 msgr2=0x55980ffc41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.528+0000 7fe112088740 1 --2- 172.21.15.1:0/3012119378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55980ffc3db0 0x55980ffc41b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fe100004ad0 tx=0x7fe1000303a0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.537 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.528+0000 7fe112088740 1 -- 172.21.15.1:0/3012119378 shutdown_connections 2024-09-19T09:40:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.528+0000 7fe112088740 1 --2- 172.21.15.1:0/3012119378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55980ffc9780 0x55980ffcbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.528+0000 7fe112088740 1 --2- 172.21.15.1:0/3012119378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55980ffc46f0 0x55980ffc91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.528+0000 7fe112088740 1 --2- 172.21.15.1:0/3012119378 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55980ffc3db0 0x55980ffc41b0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.528+0000 7fe112088740 1 -- 172.21.15.1:0/3012119378 >> 172.21.15.1:0/3012119378 conn(0x55980ffbb010 msgr2=0x55980ffbb410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.528+0000 7fe112088740 1 -- 172.21.15.1:0/3012119378 shutdown_connections 2024-09-19T09:40:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.528+0000 7fe112088740 1 -- 172.21.15.1:0/3012119378 wait complete. 2024-09-19T09:40:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.529+0000 7fe112088740 1 -- start start 2024-09-19T09:40:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.529+0000 7fe112088740 1 Processor -- start 2024-09-19T09:40:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.529+0000 7fe112088740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55980ffc3db0 0x55980ffce000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.529+0000 7fe112088740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55980ffc46f0 0x55980ffce540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.529+0000 7fe112088740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55980ffc9780 0x55980ffd5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.529+0000 7fe112088740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55980ffcc750 con 0x55980ffc3db0 2024-09-19T09:40:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.529+0000 7fe112088740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55980feac290 con 0x55980ffc46f0 2024-09-19T09:40:07.538 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.529+0000 7fe112088740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55980ffcc8d0 con 0x55980ffc9780 2024-09-19T09:40:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.529+0000 7fe112088740 10 client.0 _ll_register_callbacks cb 0x55980fedd140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.529+0000 7fe10cfb3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55980ffc3db0 0x55980ffce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.529+0000 7fe10cfb3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55980ffc3db0 0x55980ffce000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40300/0 (socket says 172.21.15.1:40300) 2024-09-19T09:40:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.529+0000 7fe10cfb3640 1 -- 172.21.15.1:0/3944448828 learned_addr learned my addr 172.21.15.1:0/3944448828 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.529+0000 7fe107fff640 1 --2- 172.21.15.1:0/3944448828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55980ffc46f0 0x55980ffce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.529+0000 7fe10d7b4640 1 --2- 172.21.15.1:0/3944448828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55980ffc9780 0x55980ffd5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.529+0000 7fe10cfb3640 1 -- 172.21.15.1:0/3944448828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55980ffc9780 msgr2=0x55980ffd5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.529+0000 7fe10cfb3640 1 --2- 172.21.15.1:0/3944448828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55980ffc9780 0x55980ffd5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.529+0000 7fe10cfb3640 1 -- 172.21.15.1:0/3944448828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55980ffc46f0 msgr2=0x55980ffce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.529+0000 7fe10cfb3640 1 --2- 172.21.15.1:0/3944448828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55980ffc46f0 0x55980ffce540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.529+0000 7fe10cfb3640 1 -- 172.21.15.1:0/3944448828 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55980fc36210 con 0x55980ffc3db0 2024-09-19T09:40:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.530+0000 7fe10cfb3640 1 --2- 172.21.15.1:0/3944448828 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55980ffc3db0 0x55980ffce000 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8013710 tx=0x7fe0f8013bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e74e931f92036501 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.530+0000 7fe0e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:40:07.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.530+0000 7fe0e7fff640 1 -- 172.21.15.1:0/3944448828 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f8011dd0 con 0x55980ffc3db0 2024-09-19T09:40:07.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.530+0000 7fe0e7fff640 1 -- 172.21.15.1:0/3944448828 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fe0f8004020 con 0x55980ffc3db0 2024-09-19T09:40:07.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.530+0000 7fe112088740 1 -- 172.21.15.1:0/3944448828 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe100037040 con 0x55980ffc3db0 2024-09-19T09:40:07.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.530+0000 7fe0e7fff640 1 -- 172.21.15.1:0/3944448828 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe0f8004220 con 0x55980ffc3db0 2024-09-19T09:40:07.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.530+0000 7fe112088740 10 client.15693 fetch_fsmap learned FSMap version 19 2024-09-19T09:40:07.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.530+0000 7fe112088740 1 -- 172.21.15.1:0/3944448828 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55980fd02620 con 0x55980ffc3db0 2024-09-19T09:40:07.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.530+0000 7fe0e7fff640 1 -- 172.21.15.1:0/3944448828 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe100037040 con 0x55980ffc3db0 2024-09-19T09:40:07.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.530+0000 7fe0e7fff640 1 -- 172.21.15.1:0/3944448828 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe0f801a070 con 0x55980ffc3db0 2024-09-19T09:40:07.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.530+0000 7fe112088740 10 client.15693 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:40:07.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.530+0000 7fe112088740 10 client.15693 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:07.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.530+0000 7fe112088740 20 client.15693 populate_metadata read hostname 'smithi001' 2024-09-19T09:40:07.540 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.530+0000 7fe112088740 1 --2- 172.21.15.1:0/3944448828 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55980ffd9c40 0x55980ffdc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.530+0000 7fe112088740 4 client.15693 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:07.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.530+0000 7fe112088740 1 -- 172.21.15.1:0/3944448828 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55980ff30a20 con 0x55980ffd9c40 2024-09-19T09:40:07.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.531+0000 7fe107fff640 1 --2- 172.21.15.1:0/3944448828 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55980ffd9c40 0x55980ffdc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.531+0000 7fe0e7fff640 10 client.15693 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:07.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.531+0000 7fe107fff640 1 --2- 172.21.15.1:0/3944448828 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55980ffd9c40 0x55980ffdc090 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40c41ace12687294 server_cookie=e589995ac343613e in_seq=0 out_seq=0 2024-09-19T09:40:07.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.532+0000 7fe0e7fff640 1 -- 172.21.15.1:0/3944448828 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fe0f007ae50 con 0x55980ffd9c40 2024-09-19T09:40:07.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.532+0000 7fe0e7fff640 10 client.15693 handle_command_reply: tid=0 2024-09-19T09:40:07.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.532+0000 7fe112088740 1 client.15693 shutdown 2024-09-19T09:40:07.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.532+0000 7fe112088740 1 -- 172.21.15.1:0/3944448828 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55980ffc3db0 msgr2=0x55980ffce000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:07.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.532+0000 7fe112088740 1 --2- 172.21.15.1:0/3944448828 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55980ffc3db0 0x55980ffce000 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8013710 tx=0x7fe0f8013bd0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.532+0000 7fe112088740 1 -- 172.21.15.1:0/3944448828 shutdown_connections 2024-09-19T09:40:07.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.532+0000 7fe112088740 1 --2- 172.21.15.1:0/3944448828 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55980ffd9c40 0x55980ffdc090 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.532+0000 7fe112088740 1 --2- 172.21.15.1:0/3944448828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55980ffc9780 0x55980ffd5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.532+0000 7fe112088740 1 --2- 172.21.15.1:0/3944448828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55980ffc46f0 0x55980ffce540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.532+0000 7fe0e7fff640 0 client.15693 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:07.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.532+0000 7fe112088740 1 --2- 172.21.15.1:0/3944448828 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55980ffc3db0 0x55980ffce000 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.532+0000 7fe112088740 1 -- 172.21.15.1:0/3944448828 >> 172.21.15.1:0/3944448828 conn(0x55980ffbb010 msgr2=0x55980ffbc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:07.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.532+0000 7fe112088740 1 -- 172.21.15.1:0/3944448828 shutdown_connections 2024-09-19T09:40:07.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.532+0000 7fe112088740 1 -- 172.21.15.1:0/3944448828 wait complete. 2024-09-19T09:40:07.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.532+0000 7fe112088740 20 client.15693 trim_cache size 0 max 16384 2024-09-19T09:40:07.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.546+0000 7fe112088740 1 Processor -- start 2024-09-19T09:40:07.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.546+0000 7fe112088740 1 -- start start 2024-09-19T09:40:07.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.547+0000 7fe112088740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55980ffc3db0 0x55980ffbc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.547+0000 7fe112088740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55980ffc46f0 0x55980ffd5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.547+0000 7fe112088740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55980ffc9780 0x55980ffbc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.553 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.547+0000 7fe112088740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe1081a4f00 con 0x55980ffc46f0 2024-09-19T09:40:07.554 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.547+0000 7fe112088740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe1081a77a0 con 0x55980ffc9780 2024-09-19T09:40:07.554 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.547+0000 7fe112088740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe1081a5590 con 0x55980ffc3db0 2024-09-19T09:40:07.554 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.547+0000 7fe107fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55980ffc46f0 0x55980ffd5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.554 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.547+0000 7fe107fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55980ffc46f0 0x55980ffd5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40302/0 (socket says 172.21.15.1:40302) 2024-09-19T09:40:07.554 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.547+0000 7fe107fff640 1 -- 172.21.15.1:0/1015923073 learned_addr learned my addr 172.21.15.1:0/1015923073 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:07.554 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.547+0000 7fe10d7b4640 1 --2- 172.21.15.1:0/1015923073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55980ffc9780 0x55980ffbc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.554 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.547+0000 7fe107fff640 1 -- 172.21.15.1:0/1015923073 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55980ffc3db0 msgr2=0x55980ffbc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:07.554 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.547+0000 7fe107fff640 1 --2- 172.21.15.1:0/1015923073 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55980ffc3db0 0x55980ffbc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.554 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.547+0000 7fe107fff640 1 -- 172.21.15.1:0/1015923073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55980ffc9780 msgr2=0x55980ffbc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:07.554 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.547+0000 7fe107fff640 1 --2- 172.21.15.1:0/1015923073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55980ffc9780 0x55980ffbc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.554 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.547+0000 7fe107fff640 1 -- 172.21.15.1:0/1015923073 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55980ffc4bd0 con 0x55980ffc46f0 2024-09-19T09:40:07.554 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.547+0000 7fe10d7b4640 1 --2- 172.21.15.1:0/1015923073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55980ffc9780 0x55980ffbc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:07.554 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.547+0000 7fe107fff640 1 --2- 172.21.15.1:0/1015923073 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55980ffc46f0 0x55980ffd5540 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fe0f00cd700 tx=0x7fe0f0014fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4718703f8e824061 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.547+0000 7fe0fe7fc640 1 -- 172.21.15.1:0/1015923073 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f00bae60 con 0x55980ffc46f0 2024-09-19T09:40:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.547+0000 7fe0fe7fc640 1 -- 172.21.15.1:0/1015923073 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55980ff30a20 con 0x55980ffc46f0 2024-09-19T09:40:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.547+0000 7fe0fe7fc640 1 -- 172.21.15.1:0/1015923073 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f0003b10 con 0x55980ffc46f0 2024-09-19T09:40:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.548+0000 7fe112088740 1 -- 172.21.15.1:0/1015923073 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55980ffc46f0 msgr2=0x55980ffd5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.548+0000 7fe112088740 1 --2- 172.21.15.1:0/1015923073 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55980ffc46f0 0x55980ffd5540 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fe0f00cd700 tx=0x7fe0f0014fe0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.548+0000 7fe112088740 1 -- 172.21.15.1:0/1015923073 shutdown_connections 2024-09-19T09:40:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.548+0000 7fe112088740 1 --2- 172.21.15.1:0/1015923073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55980ffc9780 0x55980ffbc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.548+0000 7fe112088740 1 --2- 172.21.15.1:0/1015923073 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55980ffc46f0 0x55980ffd5540 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.548+0000 7fe112088740 1 --2- 172.21.15.1:0/1015923073 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55980ffc3db0 0x55980ffbc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.548+0000 7fe112088740 1 -- 172.21.15.1:0/1015923073 >> 172.21.15.1:0/1015923073 conn(0x55980ffbb010 msgr2=0x55980ffba1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.548+0000 7fe112088740 1 -- 172.21.15.1:0/1015923073 shutdown_connections 2024-09-19T09:40:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.548+0000 7fe112088740 1 -- 172.21.15.1:0/1015923073 wait complete. 2024-09-19T09:40:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.548+0000 7fe112088740 1 -- start start 2024-09-19T09:40:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.548+0000 7fe112088740 1 Processor -- start 2024-09-19T09:40:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.549+0000 7fe112088740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55980ffc3db0 0x55980ffd4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.549+0000 7fe112088740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55980ffc46f0 0x55980ffd5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.549+0000 7fe112088740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55980ffc9780 0x55980ffd32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.549+0000 7fe112088740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe1081a5c60 con 0x55980ffc3db0 2024-09-19T09:40:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.549+0000 7fe112088740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe1081a70d0 con 0x55980ffc9780 2024-09-19T09:40:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.549+0000 7fe112088740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe1081a6330 con 0x55980ffc46f0 2024-09-19T09:40:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.549+0000 7fe112088740 10 client.0 _ll_register_callbacks cb 0x7fe0f8005850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.549+0000 7fe10cfb3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55980ffc3db0 0x55980ffd4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.549+0000 7fe10cfb3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55980ffc3db0 0x55980ffd4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40316/0 (socket says 172.21.15.1:40316) 2024-09-19T09:40:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.549+0000 7fe10cfb3640 1 -- 172.21.15.1:0/2981400128 learned_addr learned my addr 172.21.15.1:0/2981400128 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.549+0000 7fe107fff640 1 --2- 172.21.15.1:0/2981400128 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55980ffc46f0 0x55980ffd5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.549+0000 7fe10d7b4640 1 --2- 172.21.15.1:0/2981400128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55980ffc9780 0x55980ffd32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.549+0000 7fe10cfb3640 1 -- 172.21.15.1:0/2981400128 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55980ffc46f0 msgr2=0x55980ffd5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.549+0000 7fe10cfb3640 1 --2- 172.21.15.1:0/2981400128 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55980ffc46f0 0x55980ffd5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.549+0000 7fe10cfb3640 1 -- 172.21.15.1:0/2981400128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55980ffc9780 msgr2=0x55980ffd32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.549+0000 7fe10cfb3640 1 --2- 172.21.15.1:0/2981400128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55980ffc9780 0x55980ffd32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.549+0000 7fe10cfb3640 1 -- 172.21.15.1:0/2981400128 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55980ffd3920 con 0x55980ffc3db0 2024-09-19T09:40:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.549+0000 7fe10d7b4640 1 --2- 172.21.15.1:0/2981400128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55980ffc9780 0x55980ffd32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:40:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.549+0000 7fe10cfb3640 1 --2- 172.21.15.1:0/2981400128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55980ffc3db0 0x55980ffd4cd0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8025690 tx=0x7fe0f80254f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd6475a327761a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.549+0000 7fe0e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:40:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.549+0000 7fe0e7fff640 1 -- 172.21.15.1:0/2981400128 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f8005640 con 0x55980ffc3db0 2024-09-19T09:40:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.549+0000 7fe0e7fff640 1 -- 172.21.15.1:0/2981400128 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fe0f8011bd0 con 0x55980ffc3db0 2024-09-19T09:40:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.549+0000 7fe112088740 1 -- 172.21.15.1:0/2981400128 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55980ff30a20 con 0x55980ffc3db0 2024-09-19T09:40:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.550+0000 7fe0e7fff640 1 -- 172.21.15.1:0/2981400128 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe0f8011dd0 con 0x55980ffc3db0 2024-09-19T09:40:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.550+0000 7fe112088740 10 client.15699 fetch_fsmap learned FSMap version 19 2024-09-19T09:40:07.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.550+0000 7fe112088740 1 -- 172.21.15.1:0/2981400128 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x559810045370 con 0x55980ffc3db0 2024-09-19T09:40:07.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.550+0000 7fe0e7fff640 1 -- 172.21.15.1:0/2981400128 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55980ff30a20 con 0x55980ffc3db0 2024-09-19T09:40:07.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.550+0000 7fe0e7fff640 1 -- 172.21.15.1:0/2981400128 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe0f801a070 con 0x55980ffc3db0 2024-09-19T09:40:07.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.550+0000 7fe112088740 10 client.15699 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:40:07.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.550+0000 7fe112088740 10 client.15699 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:07.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.550+0000 7fe112088740 20 client.15699 populate_metadata read hostname 'smithi001' 2024-09-19T09:40:07.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.550+0000 7fe112088740 1 --2- 172.21.15.1:0/2981400128 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x559810045d50 0x559810048170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:07.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.550+0000 7fe112088740 4 client.15699 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:40:07.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.550+0000 7fe112088740 1 -- 172.21.15.1:0/2981400128 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55980ff2ad70 con 0x559810045d50 2024-09-19T09:40:07.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.550+0000 7fe107fff640 1 --2- 172.21.15.1:0/2981400128 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x559810045d50 0x559810048170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:07.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.551+0000 7fe0e7fff640 10 client.15699 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:07.558 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.551+0000 7fe107fff640 1 --2- 172.21.15.1:0/2981400128 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x559810045d50 0x559810048170 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3ae02a17ba93346 server_cookie=55c0161614d502ea in_seq=0 out_seq=0 2024-09-19T09:40:07.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.590+0000 7fe0e7fff640 1 -- 172.21.15.1:0/2981400128 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55980ff2ad70 con 0x559810045d50 2024-09-19T09:40:07.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.590+0000 7fe0e7fff640 10 client.15699 handle_command_reply: tid=0 2024-09-19T09:40:07.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.590+0000 7fe112088740 1 client.15699 shutdown 2024-09-19T09:40:07.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.590+0000 7fe112088740 1 -- 172.21.15.1:0/2981400128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55980ffc3db0 msgr2=0x55980ffd4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.590+0000 7fe112088740 1 --2- 172.21.15.1:0/2981400128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55980ffc3db0 0x55980ffd4cd0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8025690 tx=0x7fe0f80254f0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.590+0000 7fe112088740 1 -- 172.21.15.1:0/2981400128 shutdown_connections 2024-09-19T09:40:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.590+0000 7fe112088740 1 --2- 172.21.15.1:0/2981400128 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x559810045d50 0x559810048170 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.590+0000 7fe112088740 1 --2- 172.21.15.1:0/2981400128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55980ffc9780 0x55980ffd32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.590+0000 7fe112088740 1 --2- 172.21.15.1:0/2981400128 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55980ffc46f0 0x55980ffd5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.590+0000 7fe112088740 1 --2- 172.21.15.1:0/2981400128 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55980ffc3db0 0x55980ffd4cd0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.590+0000 7fe0e7fff640 0 client.15699 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.590+0000 7fe112088740 1 -- 172.21.15.1:0/2981400128 >> 172.21.15.1:0/2981400128 conn(0x55980ffbb010 msgr2=0x55980ffbb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.590+0000 7fe112088740 1 -- 172.21.15.1:0/2981400128 shutdown_connections 2024-09-19T09:40:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.590+0000 7fe112088740 1 -- 172.21.15.1:0/2981400128 wait complete. 2024-09-19T09:40:07.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.590+0000 7fe112088740 20 client.15699 trim_cache size 0 max 16384 2024-09-19T09:40:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:40:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:40:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:40:07.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:40:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.591+0000 7fe10f217640 1 -- 172.21.15.1:0/2436144773 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe0f40a3240 msgr2=0x7fe0f40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.591+0000 7fe10f217640 1 --2- 172.21.15.1:0/2436144773 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe0f40a3240 0x7fe0f40a5700 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe100005cc0 tx=0x7fe100049000 comp rx=0 tx=0).stop 2024-09-19T09:40:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.591+0000 7fe10f217640 1 -- 172.21.15.1:0/2436144773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe108104ef0 msgr2=0x7fe108198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.591+0000 7fe10f217640 1 --2- 172.21.15.1:0/2436144773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe108104ef0 0x7fe108198410 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000e9a0 tx=0x7fe0f000ee60 comp rx=0 tx=0).stop 2024-09-19T09:40:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.591+0000 7fe10f217640 1 -- 172.21.15.1:0/2436144773 shutdown_connections 2024-09-19T09:40:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.591+0000 7fe10f217640 1 --2- 172.21.15.1:0/2436144773 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe0f40a3240 0x7fe0f40a5700 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.591+0000 7fe10f217640 1 --2- 172.21.15.1:0/2436144773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe108107820 0x7fe10819f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.591+0000 7fe10f217640 1 --2- 172.21.15.1:0/2436144773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe108104ef0 0x7fe108198410 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.591+0000 7fe10f217640 1 --2- 172.21.15.1:0/2436144773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1081025c0 0x7fe108197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.591+0000 7fe10f217640 1 -- 172.21.15.1:0/2436144773 >> 172.21.15.1:0/2436144773 conn(0x7fe1080fc1c0 msgr2=0x7fe108102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:07.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.591+0000 7fe10f217640 1 -- 172.21.15.1:0/2436144773 shutdown_connections 2024-09-19T09:40:07.597 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:07.591+0000 7fe10f217640 1 -- 172.21.15.1:0/2436144773 wait complete. 2024-09-19T09:40:07.859 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:40:07.860 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:40:08.052 INFO:tasks.workunit.client.0.smithi001.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-09-19T09:40:08.053 INFO:tasks.workunit.client.0.smithi001.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-09-19T09:40:08.053 INFO:tasks.workunit.client.0.smithi001.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-09-19T09:40:08.053 INFO:tasks.workunit.client.0.smithi001.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-09-19T09:40:08.140 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:08 smithi001 ceph-mon[31225]: pgmap v399: 97 pgs: 97 active+clean; 4.1 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 40 KiB/s wr, 63 op/s 2024-09-19T09:40:08.159 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:08.177 INFO:tasks.workunit.client.0.smithi001.stdout:/bin/sh ./config.status --recheck 2024-09-19T09:40:08.230 INFO:tasks.workunit.client.0.smithi001.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2024-09-19T09:40:08.332 INFO:tasks.workunit.client.0.smithi001.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-19T09:40:08.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:08 smithi022 ceph-mon[35583]: pgmap v399: 97 pgs: 97 active+clean; 4.1 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 40 KiB/s wr, 63 op/s 2024-09-19T09:40:08.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:08 smithi121 ceph-mon[35577]: pgmap v399: 97 pgs: 97 active+clean; 4.1 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 40 KiB/s wr, 63 op/s 2024-09-19T09:40:08.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.608+0000 7f29259e3640 1 -- 172.21.15.1:0/3337836869 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2920101de0 msgr2=0x7f29201021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:08.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.608+0000 7f29259e3640 1 --2- 172.21.15.1:0/3337836869 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2920101de0 0x7f29201021c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2910009ca0 tx=0x7f291002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:40:08.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.609+0000 7f29259e3640 1 -- 172.21.15.1:0/3337836869 shutdown_connections 2024-09-19T09:40:08.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.609+0000 7f29259e3640 1 --2- 172.21.15.1:0/3337836869 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2920106f10 0x7f292010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:08.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.609+0000 7f29259e3640 1 --2- 172.21.15.1:0/3337836869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2920102790 0x7f29201067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:08.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.609+0000 7f29259e3640 1 --2- 172.21.15.1:0/3337836869 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2920101de0 0x7f29201021c0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:08.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.609+0000 7f29259e3640 1 -- 172.21.15.1:0/3337836869 >> 172.21.15.1:0/3337836869 conn(0x7f29200fd8c0 msgr2=0x7f29200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:08.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.609+0000 7f29259e3640 1 -- 172.21.15.1:0/3337836869 shutdown_connections 2024-09-19T09:40:08.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.609+0000 7f29259e3640 1 -- 172.21.15.1:0/3337836869 wait complete. 2024-09-19T09:40:08.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.609+0000 7f29259e3640 1 Processor -- start 2024-09-19T09:40:08.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.609+0000 7f29259e3640 1 -- start start 2024-09-19T09:40:08.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.610+0000 7f29259e3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2920101de0 0x7f2920198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:08.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.610+0000 7f29259e3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2920102790 0x7f2920198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:08.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.610+0000 7f29259e3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2920106f10 0x7f292019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:08.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.610+0000 7f29259e3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2920111fc0 con 0x7f2920102790 2024-09-19T09:40:08.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.610+0000 7f29259e3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2920111e40 con 0x7f2920106f10 2024-09-19T09:40:08.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.610+0000 7f29259e3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2920112140 con 0x7f2920101de0 2024-09-19T09:40:08.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.610+0000 7f291e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2920102790 0x7f2920198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:08.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.610+0000 7f291e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2920102790 0x7f2920198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40340/0 (socket says 172.21.15.1:40340) 2024-09-19T09:40:08.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.610+0000 7f291e7fc640 1 -- 172.21.15.1:0/647625204 learned_addr learned my addr 172.21.15.1:0/647625204 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:08.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.610+0000 7f291f7fe640 1 --2- 172.21.15.1:0/647625204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2920106f10 0x7f292019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:08.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.610+0000 7f291effd640 1 --2- 172.21.15.1:0/647625204 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2920101de0 0x7f2920198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:08.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.610+0000 7f291e7fc640 1 -- 172.21.15.1:0/647625204 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2920101de0 msgr2=0x7f2920198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:08.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.610+0000 7f291e7fc640 1 --2- 172.21.15.1:0/647625204 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2920101de0 0x7f2920198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:08.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.610+0000 7f291e7fc640 1 -- 172.21.15.1:0/647625204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2920106f10 msgr2=0x7f292019cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:08.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.610+0000 7f291e7fc640 1 --2- 172.21.15.1:0/647625204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2920106f10 0x7f292019cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:08.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.610+0000 7f291e7fc640 1 -- 172.21.15.1:0/647625204 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f292019d3f0 con 0x7f2920102790 2024-09-19T09:40:08.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.610+0000 7f291e7fc640 1 --2- 172.21.15.1:0/647625204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2920102790 0x7f2920198980 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f290800d950 tx=0x7f290800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:08.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.610+0000 7f29249e1640 1 -- 172.21.15.1:0/647625204 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2908017070 con 0x7f2920102790 2024-09-19T09:40:08.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.610+0000 7f29249e1640 1 -- 172.21.15.1:0/647625204 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2908009c30 con 0x7f2920102790 2024-09-19T09:40:08.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.610+0000 7f29249e1640 1 -- 172.21.15.1:0/647625204 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290800f6b0 con 0x7f2920102790 2024-09-19T09:40:08.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.611+0000 7f29259e3640 1 -- 172.21.15.1:0/647625204 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f292019d6e0 con 0x7f2920102790 2024-09-19T09:40:08.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.611+0000 7f29259e3640 1 -- 172.21.15.1:0/647625204 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29201a4fc0 con 0x7f2920102790 2024-09-19T09:40:08.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.612+0000 7f29259e3640 1 -- 172.21.15.1:0/647625204 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29201021c0 con 0x7f2920102790 2024-09-19T09:40:08.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.613+0000 7f29249e1640 1 -- 172.21.15.1:0/647625204 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f29080109d0 con 0x7f2920102790 2024-09-19T09:40:08.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.614+0000 7f29249e1640 1 --2- 172.21.15.1:0/647625204 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f290c0a3240 0x7f290c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:08.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.614+0000 7f291effd640 1 --2- 172.21.15.1:0/647625204 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f290c0a3240 0x7f290c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:08.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.614+0000 7f29249e1640 1 -- 172.21.15.1:0/647625204 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f29080cf5e0 con 0x7f2920102790 2024-09-19T09:40:08.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.614+0000 7f291effd640 1 --2- 172.21.15.1:0/647625204 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f290c0a3240 0x7f290c0a5700 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2910000f80 tx=0x7f2910009940 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:08.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.618+0000 7f29249e1640 1 -- 172.21.15.1:0/647625204 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2908009de0 con 0x7f2920102790 2024-09-19T09:40:08.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.830+0000 7f29259e3640 1 -- 172.21.15.1:0/647625204 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29201997a0 con 0x7f2920102790 2024-09-19T09:40:08.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.831+0000 7f29249e1640 1 -- 172.21.15.1:0/647625204 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11837 (secure 0 0 0) 0x7f290809c2c0 con 0x7f2920102790 2024-09-19T09:40:08.834 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:40:08.834 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":19,"btime":"2024-09-19T09:36:24:006349+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:36:23.723388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6839/3279971690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3279971690},{"type":"v1","addr":"172.21.15.121:6839","nonce":3279971690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:40:08.834 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 19 2024-09-19T09:40:08.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.833+0000 7f29259e3640 1 -- 172.21.15.1:0/647625204 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f290c0a3240 msgr2=0x7f290c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:08.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.833+0000 7f29259e3640 1 --2- 172.21.15.1:0/647625204 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f290c0a3240 0x7f290c0a5700 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2910000f80 tx=0x7f2910009940 comp rx=0 tx=0).stop 2024-09-19T09:40:08.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.833+0000 7f29259e3640 1 -- 172.21.15.1:0/647625204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2920102790 msgr2=0x7f2920198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:08.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.833+0000 7f29259e3640 1 --2- 172.21.15.1:0/647625204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2920102790 0x7f2920198980 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f290800d950 tx=0x7f290800de10 comp rx=0 tx=0).stop 2024-09-19T09:40:08.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.833+0000 7f29259e3640 1 -- 172.21.15.1:0/647625204 shutdown_connections 2024-09-19T09:40:08.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.833+0000 7f29259e3640 1 --2- 172.21.15.1:0/647625204 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f290c0a3240 0x7f290c0a5700 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:08.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.833+0000 7f29259e3640 1 --2- 172.21.15.1:0/647625204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2920106f10 0x7f292019cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:08.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.833+0000 7f29259e3640 1 --2- 172.21.15.1:0/647625204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2920102790 0x7f2920198980 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:08.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.833+0000 7f29259e3640 1 --2- 172.21.15.1:0/647625204 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2920101de0 0x7f2920198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:08.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.833+0000 7f29259e3640 1 -- 172.21.15.1:0/647625204 >> 172.21.15.1:0/647625204 conn(0x7f29200fd8c0 msgr2=0x7f29200febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:08.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.833+0000 7f29259e3640 1 -- 172.21.15.1:0/647625204 shutdown_connections 2024-09-19T09:40:08.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:08.833+0000 7f29259e3640 1 -- 172.21.15.1:0/647625204 wait complete. 2024-09-19T09:40:09.342 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether build environment is sane... yes 2024-09-19T09:40:09.347 INFO:tasks.workunit.client.0.smithi001.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-19T09:40:09.347 INFO:tasks.workunit.client.0.smithi001.stdout:checking for gawk... gawk 2024-09-19T09:40:09.369 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether make sets $(MAKE)... yes 2024-09-19T09:40:09.400 INFO:tasks.workunit.client.0.smithi001.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-19T09:40:09.401 INFO:tasks.workunit.client.0.smithi001.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-19T09:40:09.413 INFO:tasks.workunit.client.0.smithi001.stdout:checking for style of include used by make... GNU 2024-09-19T09:40:09.419 INFO:tasks.workunit.client.0.smithi001.stdout:checking for gcc... gcc 2024-09-19T09:40:09.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:09 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/647625204' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:40:09.522 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether the C compiler works... yes 2024-09-19T09:40:09.523 INFO:tasks.workunit.client.0.smithi001.stdout:checking for C compiler default output file name... a.out 2024-09-19T09:40:09.562 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:40:09.565 INFO:tasks.workunit.client.0.smithi001.stdout:checking for suffix of executables... 2024-09-19T09:40:09.606 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether we are cross compiling... no 2024-09-19T09:40:09.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:09 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/647625204' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:40:09.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:09 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/647625204' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:40:09.645 INFO:tasks.workunit.client.0.smithi001.stdout:checking for suffix of object files... o 2024-09-19T09:40:09.668 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether we are using the GNU C compiler... yes 2024-09-19T09:40:09.692 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether gcc accepts -g... yes 2024-09-19T09:40:09.735 INFO:tasks.workunit.client.0.smithi001.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-19T09:40:09.823 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:09.828 INFO:tasks.workunit.client.0.smithi001.stdout:checking dependency style of gcc... gcc3 2024-09-19T09:40:09.874 INFO:tasks.workunit.client.0.smithi001.stdout:checking how to run the C preprocessor... gcc -E 2024-09-19T09:40:09.929 INFO:tasks.workunit.client.0.smithi001.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-19T09:40:09.930 INFO:tasks.workunit.client.0.smithi001.stdout:checking for egrep... /usr/bin/grep -E 2024-09-19T09:40:10.119 INFO:tasks.workunit.client.0.smithi001.stdout:checking for ANSI C header files... yes 2024-09-19T09:40:10.157 INFO:tasks.workunit.client.0.smithi001.stdout:checking for sys/types.h... yes 2024-09-19T09:40:10.202 INFO:tasks.workunit.client.0.smithi001.stdout:checking for sys/stat.h... yes 2024-09-19T09:40:10.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:10 smithi001 ceph-mon[31225]: pgmap v400: 97 pgs: 97 active+clean; 4.1 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 29 KiB/s wr, 29 op/s 2024-09-19T09:40:10.253 INFO:tasks.workunit.client.0.smithi001.stdout:checking for stdlib.h... yes 2024-09-19T09:40:10.304 INFO:tasks.workunit.client.0.smithi001.stdout:checking for string.h... yes 2024-09-19T09:40:10.345 INFO:tasks.workunit.client.0.smithi001.stdout:checking for memory.h... yes 2024-09-19T09:40:10.387 INFO:tasks.workunit.client.0.smithi001.stdout:checking for strings.h... yes 2024-09-19T09:40:10.438 INFO:tasks.workunit.client.0.smithi001.stdout:checking for inttypes.h... yes 2024-09-19T09:40:10.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.397+0000 7f5720a0d640 1 -- 172.21.15.1:0/2078534288 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f571c1036e0 msgr2=0x7f571c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:10.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.397+0000 7f5720a0d640 1 --2- 172.21.15.1:0/2078534288 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f571c1036e0 0x7f571c107b90 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f5704009930 tx=0x7f570402a420 comp rx=0 tx=0).stop 2024-09-19T09:40:10.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.397+0000 7f5720a0d640 1 -- 172.21.15.1:0/2078534288 shutdown_connections 2024-09-19T09:40:10.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.397+0000 7f5720a0d640 1 --2- 172.21.15.1:0/2078534288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f571c1082a0 0x7f571c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.397+0000 7f5720a0d640 1 --2- 172.21.15.1:0/2078534288 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f571c1036e0 0x7f571c107b90 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.397+0000 7f5720a0d640 1 --2- 172.21.15.1:0/2078534288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f571c102d30 0x7f571c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.397+0000 7f5720a0d640 1 -- 172.21.15.1:0/2078534288 >> 172.21.15.1:0/2078534288 conn(0x7f571c0fc7d0 msgr2=0x7f571c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:10.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.397+0000 7f5720a0d640 1 -- 172.21.15.1:0/2078534288 shutdown_connections 2024-09-19T09:40:10.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.397+0000 7f5720a0d640 1 -- 172.21.15.1:0/2078534288 wait complete. 2024-09-19T09:40:10.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.398+0000 7f5720a0d640 1 Processor -- start 2024-09-19T09:40:10.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.398+0000 7f5720a0d640 1 -- start start 2024-09-19T09:40:10.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.398+0000 7f5720a0d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f571c102d30 0x7f571c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:10.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.398+0000 7f5720a0d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f571c1036e0 0x7f571c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:10.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.398+0000 7f5720a0d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f571c1082a0 0x7f571c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:10.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.398+0000 7f5720a0d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f571c112060 con 0x7f571c102d30 2024-09-19T09:40:10.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.398+0000 7f5720a0d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f571c111ee0 con 0x7f571c1082a0 2024-09-19T09:40:10.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.398+0000 7f5720a0d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f571c1121e0 con 0x7f571c1036e0 2024-09-19T09:40:10.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.398+0000 7f571a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f571c102d30 0x7f571c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:10.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.398+0000 7f571a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f571c102d30 0x7f571c100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40362/0 (socket says 172.21.15.1:40362) 2024-09-19T09:40:10.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.398+0000 7f571a59c640 1 -- 172.21.15.1:0/2337378609 learned_addr learned my addr 172.21.15.1:0/2337378609 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:10.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.398+0000 7f571ad9d640 1 --2- 172.21.15.1:0/2337378609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f571c1082a0 0x7f571c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:10.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.398+0000 7f5713fff640 1 --2- 172.21.15.1:0/2337378609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f571c1036e0 0x7f571c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:10.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.398+0000 7f571ad9d640 1 -- 172.21.15.1:0/2337378609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f571c1036e0 msgr2=0x7f571c100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:10.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.398+0000 7f571ad9d640 1 --2- 172.21.15.1:0/2337378609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f571c1036e0 0x7f571c100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.398+0000 7f571ad9d640 1 -- 172.21.15.1:0/2337378609 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f571c102d30 msgr2=0x7f571c100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:10.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.398+0000 7f571ad9d640 1 --2- 172.21.15.1:0/2337378609 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f571c102d30 0x7f571c100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.398+0000 7f571ad9d640 1 -- 172.21.15.1:0/2337378609 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571c1a6a60 con 0x7f571c1082a0 2024-09-19T09:40:10.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.398+0000 7f571a59c640 1 --2- 172.21.15.1:0/2337378609 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f571c102d30 0x7f571c100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:40:10.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.399+0000 7f571ad9d640 1 --2- 172.21.15.1:0/2337378609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f571c1082a0 0x7f571c101410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5714009fd0 tx=0x7f571400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:10.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.399+0000 7f57137fe640 1 -- 172.21.15.1:0/2337378609 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571400ce20 con 0x7f571c1082a0 2024-09-19T09:40:10.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.399+0000 7f57137fe640 1 -- 172.21.15.1:0/2337378609 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5714005020 con 0x7f571c1082a0 2024-09-19T09:40:10.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.399+0000 7f57137fe640 1 -- 172.21.15.1:0/2337378609 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5714010720 con 0x7f571c1082a0 2024-09-19T09:40:10.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.399+0000 7f5720a0d640 1 -- 172.21.15.1:0/2337378609 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f571c1a6d50 con 0x7f571c1082a0 2024-09-19T09:40:10.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.399+0000 7f5720a0d640 1 -- 172.21.15.1:0/2337378609 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f571c1a7210 con 0x7f571c1082a0 2024-09-19T09:40:10.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.401+0000 7f57137fe640 1 -- 172.21.15.1:0/2337378609 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f5714005540 con 0x7f571c1082a0 2024-09-19T09:40:10.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.402+0000 7f5722de6740 1 Processor -- start 2024-09-19T09:40:10.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.402+0000 7f5722de6740 1 -- start start 2024-09-19T09:40:10.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.402+0000 7f57137fe640 1 --2- 172.21.15.1:0/2337378609 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f57080a3240 0x7f57080a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:10.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.402+0000 7f5722de6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647ab148b40 0x5647ab147090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:10.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.402+0000 7f5722de6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5647ab1475d0 0x5647ab147a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:10.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.402+0000 7f5722de6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647ab152370 0x5647ab154760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:10.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.402+0000 7f5722de6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5647ab0ad2f0 con 0x5647ab152370 2024-09-19T09:40:10.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.402+0000 7f5722de6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5647ab054cf0 con 0x5647ab1475d0 2024-09-19T09:40:10.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.402+0000 7f5722de6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5647ab0a92b0 con 0x5647ab148b40 2024-09-19T09:40:10.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.402+0000 7f571ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647ab152370 0x5647ab154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:10.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.402+0000 7f5713fff640 1 --2- 172.21.15.1:0/2337378609 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f57080a3240 0x7f57080a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:10.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.402+0000 7f571ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647ab152370 0x5647ab154760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40370/0 (socket says 172.21.15.1:40370) 2024-09-19T09:40:10.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.402+0000 7f571ad9d640 1 -- 172.21.15.1:0/115103676 learned_addr learned my addr 172.21.15.1:0/115103676 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:10.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.403+0000 7f5713fff640 1 --2- 172.21.15.1:0/115103676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5647ab1475d0 0x5647ab147a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:10.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.403+0000 7f57137fe640 1 -- 172.21.15.1:0/2337378609 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f57140cffc0 con 0x7f571c1082a0 2024-09-19T09:40:10.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.403+0000 7f571a59c640 1 --2- 172.21.15.1:0/115103676 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647ab148b40 0x5647ab147090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:10.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.403+0000 7f571ad9d640 1 -- 172.21.15.1:0/115103676 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647ab148b40 msgr2=0x5647ab147090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:10.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.403+0000 7f571ad9d640 1 --2- 172.21.15.1:0/115103676 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647ab148b40 0x5647ab147090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.403+0000 7f571ad9d640 1 -- 172.21.15.1:0/115103676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5647ab1475d0 msgr2=0x5647ab147a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:10.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.403+0000 7f571ad9d640 1 --2- 172.21.15.1:0/115103676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5647ab1475d0 0x5647ab147a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.403+0000 7f571ad9d640 1 -- 172.21.15.1:0/115103676 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647ab0393a0 con 0x5647ab152370 2024-09-19T09:40:10.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.403+0000 7f5713fff640 1 --2- 172.21.15.1:0/2337378609 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f57080a3240 0x7f57080a5700 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5704005940 tx=0x7f5704005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:10.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.403+0000 7f571ad9d640 1 --2- 172.21.15.1:0/115103676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647ab152370 0x5647ab154760 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f57140cd9f0 tx=0x7f57140054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9788854aa9e678b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:10.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.403+0000 7f5710ff9640 1 -- 172.21.15.1:0/115103676 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5714061960 con 0x5647ab152370 2024-09-19T09:40:10.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.403+0000 7f5710ff9640 1 -- 172.21.15.1:0/115103676 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f571409cca0 con 0x5647ab152370 2024-09-19T09:40:10.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.403+0000 7f5710ff9640 1 -- 172.21.15.1:0/115103676 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57140051d0 con 0x5647ab152370 2024-09-19T09:40:10.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.404+0000 7f5722de6740 1 -- 172.21.15.1:0/115103676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647ab152370 msgr2=0x5647ab154760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:10.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.404+0000 7f5722de6740 1 --2- 172.21.15.1:0/115103676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647ab152370 0x5647ab154760 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f57140cd9f0 tx=0x7f57140054b0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.404+0000 7f5722de6740 1 -- 172.21.15.1:0/115103676 shutdown_connections 2024-09-19T09:40:10.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.404+0000 7f5722de6740 1 --2- 172.21.15.1:0/115103676 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647ab152370 0x5647ab154760 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.404+0000 7f5722de6740 1 --2- 172.21.15.1:0/115103676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5647ab1475d0 0x5647ab147a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.404+0000 7f5722de6740 1 --2- 172.21.15.1:0/115103676 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647ab148b40 0x5647ab147090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.404+0000 7f5722de6740 1 -- 172.21.15.1:0/115103676 >> 172.21.15.1:0/115103676 conn(0x5647ab110310 msgr2=0x5647ab143c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:10.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.404+0000 7f5722de6740 1 -- 172.21.15.1:0/115103676 shutdown_connections 2024-09-19T09:40:10.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.404+0000 7f5722de6740 1 -- 172.21.15.1:0/115103676 wait complete. 2024-09-19T09:40:10.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.404+0000 7f5722de6740 1 -- start start 2024-09-19T09:40:10.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.405+0000 7f5722de6740 1 Processor -- start 2024-09-19T09:40:10.456 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.405+0000 7f5722de6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647ab1475d0 0x5647ab151d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:10.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.405+0000 7f5722de6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647ab148b40 0x5647ab14efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:10.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.405+0000 7f5722de6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5647ab152370 0x5647ab14f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:10.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.405+0000 7f5722de6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5647ab155070 con 0x5647ab148b40 2024-09-19T09:40:10.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.405+0000 7f5722de6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5647ab068060 con 0x5647ab152370 2024-09-19T09:40:10.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.405+0000 7f5722de6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5647ab1551f0 con 0x5647ab1475d0 2024-09-19T09:40:10.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.405+0000 7f5722de6740 10 client.0 _ll_register_callbacks cb 0x5647aadbb8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:10.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.405+0000 7f5713fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647ab148b40 0x5647ab14efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:10.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.405+0000 7f5713fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647ab148b40 0x5647ab14efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40386/0 (socket says 172.21.15.1:40386) 2024-09-19T09:40:10.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.405+0000 7f5713fff640 1 -- 172.21.15.1:0/1312838794 learned_addr learned my addr 172.21.15.1:0/1312838794 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:10.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.405+0000 7f571ad9d640 1 --2- 172.21.15.1:0/1312838794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5647ab152370 0x5647ab14f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:10.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.405+0000 7f571a59c640 1 --2- 172.21.15.1:0/1312838794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647ab1475d0 0x5647ab151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:10.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.405+0000 7f5713fff640 1 -- 172.21.15.1:0/1312838794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647ab1475d0 msgr2=0x5647ab151d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:10.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.405+0000 7f5713fff640 1 --2- 172.21.15.1:0/1312838794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647ab1475d0 0x5647ab151d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.405+0000 7f5713fff640 1 -- 172.21.15.1:0/1312838794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5647ab152370 msgr2=0x5647ab14f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:10.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.405+0000 7f5713fff640 1 --2- 172.21.15.1:0/1312838794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5647ab152370 0x5647ab14f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.405+0000 7f5713fff640 1 -- 172.21.15.1:0/1312838794 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647aae1e3c0 con 0x5647ab148b40 2024-09-19T09:40:10.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.405+0000 7f571ad9d640 1 --2- 172.21.15.1:0/1312838794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5647ab152370 0x5647ab14f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:40:10.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.406+0000 7f5713fff640 1 --2- 172.21.15.1:0/1312838794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647ab148b40 0x5647ab14efb0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5704032fd0 tx=0x7f570402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d442206b31b7cbca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:10.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.406+0000 7f5701ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:40:10.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.406+0000 7f5701ffb640 1 -- 172.21.15.1:0/1312838794 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570404f030 con 0x5647ab148b40 2024-09-19T09:40:10.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.406+0000 7f5701ffb640 1 -- 172.21.15.1:0/1312838794 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f5704005310 con 0x5647ab148b40 2024-09-19T09:40:10.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.406+0000 7f5722de6740 1 -- 172.21.15.1:0/1312838794 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f571409cca0 con 0x5647ab148b40 2024-09-19T09:40:10.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.406+0000 7f5701ffb640 1 -- 172.21.15.1:0/1312838794 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f5704005510 con 0x5647ab148b40 2024-09-19T09:40:10.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.406+0000 7f5722de6740 10 client.15717 fetch_fsmap learned FSMap version 19 2024-09-19T09:40:10.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.406+0000 7f5722de6740 1 -- 172.21.15.1:0/1312838794 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5647ab160aa0 con 0x5647ab148b40 2024-09-19T09:40:10.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.406+0000 7f5701ffb640 1 -- 172.21.15.1:0/1312838794 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f571409cca0 con 0x5647ab148b40 2024-09-19T09:40:10.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.406+0000 7f5701ffb640 1 -- 172.21.15.1:0/1312838794 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f57040038f0 con 0x5647ab148b40 2024-09-19T09:40:10.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.406+0000 7f5722de6740 10 client.15717 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:40:10.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.406+0000 7f5722de6740 10 client.15717 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:10.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.406+0000 7f5722de6740 20 client.15717 populate_metadata read hostname 'smithi001' 2024-09-19T09:40:10.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.406+0000 7f5722de6740 1 --2- 172.21.15.1:0/1312838794 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5647ab161f00 0x5647ab164340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:10.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.406+0000 7f5722de6740 4 client.15717 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:10.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.406+0000 7f5722de6740 1 -- 172.21.15.1:0/1312838794 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5647ab0ba860 con 0x5647ab161f00 2024-09-19T09:40:10.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.407+0000 7f571a59c640 1 --2- 172.21.15.1:0/1312838794 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5647ab161f00 0x5647ab164340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:10.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.407+0000 7f571a59c640 1 --2- 172.21.15.1:0/1312838794 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5647ab161f00 0x5647ab164340 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b680aa059834be7b server_cookie=a9df754e73a4a1d in_seq=0 out_seq=0 2024-09-19T09:40:10.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.407+0000 7f5701ffb640 10 client.15717 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:10.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.408+0000 7f5701ffb640 1 -- 172.21.15.1:0/1312838794 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5647ab0ba860 con 0x5647ab161f00 2024-09-19T09:40:10.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.408+0000 7f5701ffb640 10 client.15717 handle_command_reply: tid=0 2024-09-19T09:40:10.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.408+0000 7f5722de6740 1 client.15717 shutdown 2024-09-19T09:40:10.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.408+0000 7f5722de6740 1 -- 172.21.15.1:0/1312838794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647ab148b40 msgr2=0x5647ab14efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:10.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.408+0000 7f5722de6740 1 --2- 172.21.15.1:0/1312838794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647ab148b40 0x5647ab14efb0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5704032fd0 tx=0x7f570402a420 comp rx=0 tx=0).stop 2024-09-19T09:40:10.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.408+0000 7f5722de6740 1 -- 172.21.15.1:0/1312838794 shutdown_connections 2024-09-19T09:40:10.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.408+0000 7f5722de6740 1 --2- 172.21.15.1:0/1312838794 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5647ab161f00 0x5647ab164340 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.408+0000 7f5722de6740 1 --2- 172.21.15.1:0/1312838794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5647ab152370 0x5647ab14f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.408+0000 7f5701ffb640 0 client.15717 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:10.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.408+0000 7f5722de6740 1 --2- 172.21.15.1:0/1312838794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647ab148b40 0x5647ab14efb0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.408+0000 7f5722de6740 1 --2- 172.21.15.1:0/1312838794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647ab1475d0 0x5647ab151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.408+0000 7f5722de6740 1 -- 172.21.15.1:0/1312838794 >> 172.21.15.1:0/1312838794 conn(0x5647ab110310 msgr2=0x5647ab149960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:10.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.408+0000 7f5722de6740 1 -- 172.21.15.1:0/1312838794 shutdown_connections 2024-09-19T09:40:10.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.408+0000 7f5722de6740 1 -- 172.21.15.1:0/1312838794 wait complete. 2024-09-19T09:40:10.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.408+0000 7f5722de6740 20 client.15717 trim_cache size 0 max 16384 2024-09-19T09:40:10.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.421+0000 7f5722de6740 1 Processor -- start 2024-09-19T09:40:10.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.421+0000 7f5722de6740 1 -- start start 2024-09-19T09:40:10.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.422+0000 7f5722de6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5647ab1475d0 0x5647ab15e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:10.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.422+0000 7f5722de6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647ab148b40 0x5647ab14e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:10.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.422+0000 7f5722de6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647ab152370 0x5647ab14df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:10.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.422+0000 7f5722de6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f571c1ad780 con 0x5647ab152370 2024-09-19T09:40:10.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.422+0000 7f5722de6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f571c1b0020 con 0x5647ab1475d0 2024-09-19T09:40:10.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.422+0000 7f5722de6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f571c1ade10 con 0x5647ab148b40 2024-09-19T09:40:10.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.422+0000 7f571ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647ab152370 0x5647ab14df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:10.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.422+0000 7f571a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5647ab1475d0 0x5647ab15e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:10.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.422+0000 7f571a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5647ab1475d0 0x5647ab15e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:59926/0 (socket says 172.21.15.1:59926) 2024-09-19T09:40:10.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.422+0000 7f571ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647ab152370 0x5647ab14df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40388/0 (socket says 172.21.15.1:40388) 2024-09-19T09:40:10.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.422+0000 7f571a59c640 1 -- 172.21.15.1:0/375602486 learned_addr learned my addr 172.21.15.1:0/375602486 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:10.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.422+0000 7f5713fff640 1 --2- 172.21.15.1:0/375602486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647ab148b40 0x5647ab14e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:10.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.422+0000 7f571a59c640 1 -- 172.21.15.1:0/375602486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647ab148b40 msgr2=0x5647ab14e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:10.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.422+0000 7f571a59c640 1 --2- 172.21.15.1:0/375602486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647ab148b40 0x5647ab14e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.422+0000 7f571a59c640 1 -- 172.21.15.1:0/375602486 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647ab152370 msgr2=0x5647ab14df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:10.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.422+0000 7f571a59c640 1 --2- 172.21.15.1:0/375602486 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647ab152370 0x5647ab14df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.422+0000 7f571a59c640 1 -- 172.21.15.1:0/375602486 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647ab14a120 con 0x5647ab1475d0 2024-09-19T09:40:10.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.422+0000 7f571a59c640 1 --2- 172.21.15.1:0/375602486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5647ab1475d0 0x5647ab15e310 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f570c004360 tx=0x7f570c00b4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=937fd9920f4cfd0b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:10.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.422+0000 7f5703fff640 1 -- 172.21.15.1:0/375602486 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c003cd0 con 0x5647ab1475d0 2024-09-19T09:40:10.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.422+0000 7f5703fff640 1 -- 172.21.15.1:0/375602486 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f570c026920 con 0x5647ab1475d0 2024-09-19T09:40:10.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.423+0000 7f5703fff640 1 -- 172.21.15.1:0/375602486 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c01e820 con 0x5647ab1475d0 2024-09-19T09:40:10.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.423+0000 7f5722de6740 1 -- 172.21.15.1:0/375602486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5647ab1475d0 msgr2=0x5647ab15e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:10.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.423+0000 7f5722de6740 1 --2- 172.21.15.1:0/375602486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5647ab1475d0 0x5647ab15e310 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f570c004360 tx=0x7f570c00b4a0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.423+0000 7f5722de6740 1 -- 172.21.15.1:0/375602486 shutdown_connections 2024-09-19T09:40:10.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.423+0000 7f5722de6740 1 --2- 172.21.15.1:0/375602486 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647ab152370 0x5647ab14df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.423+0000 7f5722de6740 1 --2- 172.21.15.1:0/375602486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647ab148b40 0x5647ab14e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.423+0000 7f5722de6740 1 --2- 172.21.15.1:0/375602486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5647ab1475d0 0x5647ab15e310 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.423+0000 7f5722de6740 1 -- 172.21.15.1:0/375602486 >> 172.21.15.1:0/375602486 conn(0x5647ab110310 msgr2=0x5647ab14d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:10.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.423+0000 7f5722de6740 1 -- 172.21.15.1:0/375602486 shutdown_connections 2024-09-19T09:40:10.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.423+0000 7f5722de6740 1 -- 172.21.15.1:0/375602486 wait complete. 2024-09-19T09:40:10.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.424+0000 7f5722de6740 1 -- start start 2024-09-19T09:40:10.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.424+0000 7f5722de6740 1 Processor -- start 2024-09-19T09:40:10.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.424+0000 7f5722de6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5647ab1475d0 0x5647ab15ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:10.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.424+0000 7f5722de6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647ab148b40 0x5647ab156080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:10.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.424+0000 7f5722de6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647ab152370 0x5647ab156810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:10.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.424+0000 7f5722de6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f571c1ae4e0 con 0x5647ab152370 2024-09-19T09:40:10.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.424+0000 7f5722de6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f571c1af950 con 0x5647ab1475d0 2024-09-19T09:40:10.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.424+0000 7f5722de6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f571c1aebb0 con 0x5647ab148b40 2024-09-19T09:40:10.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.424+0000 7f5722de6740 10 client.0 _ll_register_callbacks cb 0x7f5704009520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:10.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.424+0000 7f571ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647ab152370 0x5647ab156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:10.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.424+0000 7f571a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5647ab1475d0 0x5647ab15ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:10.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.424+0000 7f571ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647ab152370 0x5647ab156810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40404/0 (socket says 172.21.15.1:40404) 2024-09-19T09:40:10.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.424+0000 7f571ad9d640 1 -- 172.21.15.1:0/4069980242 learned_addr learned my addr 172.21.15.1:0/4069980242 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:10.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.424+0000 7f571a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5647ab1475d0 0x5647ab15ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:59928/0 (socket says 172.21.15.1:59928) 2024-09-19T09:40:10.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.424+0000 7f5713fff640 1 --2- 172.21.15.1:0/4069980242 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647ab148b40 0x5647ab156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:10.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.424+0000 7f571ad9d640 1 -- 172.21.15.1:0/4069980242 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647ab148b40 msgr2=0x5647ab156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:10.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.424+0000 7f571ad9d640 1 --2- 172.21.15.1:0/4069980242 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647ab148b40 0x5647ab156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.424+0000 7f571ad9d640 1 -- 172.21.15.1:0/4069980242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5647ab1475d0 msgr2=0x5647ab15ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:10.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.424+0000 7f571ad9d640 1 --2- 172.21.15.1:0/4069980242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5647ab1475d0 0x5647ab15ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.424+0000 7f571ad9d640 1 -- 172.21.15.1:0/4069980242 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647ab1cbbe0 con 0x5647ab152370 2024-09-19T09:40:10.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.424+0000 7f571a59c640 1 --2- 172.21.15.1:0/4069980242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5647ab1475d0 0x5647ab15ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:40:10.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.424+0000 7f5713fff640 1 --2- 172.21.15.1:0/4069980242 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647ab148b40 0x5647ab156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:10.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.425+0000 7f571ad9d640 1 --2- 172.21.15.1:0/4069980242 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647ab152370 0x5647ab156810 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5714005ba0 tx=0x7f571409c160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=960403efeb2f58cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:10.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.425+0000 7f5701ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:40:10.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.425+0000 7f5701ffb640 1 -- 172.21.15.1:0/4069980242 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571409cca0 con 0x5647ab152370 2024-09-19T09:40:10.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.425+0000 7f5722de6740 1 -- 172.21.15.1:0/4069980242 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f570c026920 con 0x5647ab152370 2024-09-19T09:40:10.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.425+0000 7f5701ffb640 1 -- 172.21.15.1:0/4069980242 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f57140cdb00 con 0x5647ab152370 2024-09-19T09:40:10.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.425+0000 7f5701ffb640 1 -- 172.21.15.1:0/4069980242 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f571409c5a0 con 0x5647ab152370 2024-09-19T09:40:10.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.425+0000 7f5722de6740 10 client.15723 fetch_fsmap learned FSMap version 19 2024-09-19T09:40:10.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.425+0000 7f5722de6740 1 -- 172.21.15.1:0/4069980242 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5647ab1ccd70 con 0x5647ab152370 2024-09-19T09:40:10.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.425+0000 7f5701ffb640 1 -- 172.21.15.1:0/4069980242 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f570c026920 con 0x5647ab152370 2024-09-19T09:40:10.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.425+0000 7f5701ffb640 1 -- 172.21.15.1:0/4069980242 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f571409b9f0 con 0x5647ab152370 2024-09-19T09:40:10.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.425+0000 7f5722de6740 10 client.15723 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:40:10.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.425+0000 7f5722de6740 10 client.15723 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:10.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.425+0000 7f5722de6740 20 client.15723 populate_metadata read hostname 'smithi001' 2024-09-19T09:40:10.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.425+0000 7f5722de6740 1 --2- 172.21.15.1:0/4069980242 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5647ab161f00 0x5647ab1cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:10.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.425+0000 7f5722de6740 4 client.15723 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:40:10.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.425+0000 7f5722de6740 1 -- 172.21.15.1:0/4069980242 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5647ab0b4d70 con 0x5647ab161f00 2024-09-19T09:40:10.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.426+0000 7f571a59c640 1 --2- 172.21.15.1:0/4069980242 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5647ab161f00 0x5647ab1cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:10.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.426+0000 7f571a59c640 1 --2- 172.21.15.1:0/4069980242 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5647ab161f00 0x5647ab1cf0c0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d75d783e95902af7 server_cookie=88384f2330c82063 in_seq=0 out_seq=0 2024-09-19T09:40:10.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.426+0000 7f5701ffb640 10 client.15723 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:10.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.426+0000 7f5701ffb640 1 -- 172.21.15.1:0/4069980242 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5647ab0b4d70 con 0x5647ab161f00 2024-09-19T09:40:10.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.426+0000 7f5701ffb640 10 client.15723 handle_command_reply: tid=0 2024-09-19T09:40:10.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.426+0000 7f5722de6740 1 client.15723 shutdown 2024-09-19T09:40:10.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.426+0000 7f5722de6740 1 -- 172.21.15.1:0/4069980242 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647ab152370 msgr2=0x5647ab156810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:10.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.426+0000 7f5722de6740 1 --2- 172.21.15.1:0/4069980242 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647ab152370 0x5647ab156810 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5714005ba0 tx=0x7f571409c160 comp rx=0 tx=0).stop 2024-09-19T09:40:10.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.426+0000 7f5722de6740 1 -- 172.21.15.1:0/4069980242 shutdown_connections 2024-09-19T09:40:10.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.426+0000 7f5722de6740 1 --2- 172.21.15.1:0/4069980242 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5647ab161f00 0x5647ab1cf0c0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.426+0000 7f5722de6740 1 --2- 172.21.15.1:0/4069980242 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5647ab152370 0x5647ab156810 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.426+0000 7f5722de6740 1 --2- 172.21.15.1:0/4069980242 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5647ab148b40 0x5647ab156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.426+0000 7f5722de6740 1 --2- 172.21.15.1:0/4069980242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5647ab1475d0 0x5647ab15ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.426+0000 7f5722de6740 1 -- 172.21.15.1:0/4069980242 >> 172.21.15.1:0/4069980242 conn(0x5647ab110310 msgr2=0x5647ab14e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:10.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.426+0000 7f5701ffb640 0 client.15723 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:10.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.426+0000 7f5722de6740 1 -- 172.21.15.1:0/4069980242 shutdown_connections 2024-09-19T09:40:10.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.426+0000 7f5722de6740 1 -- 172.21.15.1:0/4069980242 wait complete. 2024-09-19T09:40:10.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.426+0000 7f5722de6740 20 client.15723 trim_cache size 0 max 16384 2024-09-19T09:40:10.467 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-19T09:40:10.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.427+0000 7f5720a0d640 1 -- 172.21.15.1:0/2337378609 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f57080a3240 msgr2=0x7f57080a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:10.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.427+0000 7f5720a0d640 1 --2- 172.21.15.1:0/2337378609 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f57080a3240 0x7f57080a5700 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5704005940 tx=0x7f5704005fd0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.427+0000 7f5720a0d640 1 -- 172.21.15.1:0/2337378609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f571c1082a0 msgr2=0x7f571c101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:10.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.427+0000 7f5720a0d640 1 --2- 172.21.15.1:0/2337378609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f571c1082a0 0x7f571c101410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5714009fd0 tx=0x7f571400ef10 comp rx=0 tx=0).stop 2024-09-19T09:40:10.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.427+0000 7f5720a0d640 1 -- 172.21.15.1:0/2337378609 shutdown_connections 2024-09-19T09:40:10.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.427+0000 7f5720a0d640 1 --2- 172.21.15.1:0/2337378609 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f57080a3240 0x7f57080a5700 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.427+0000 7f5720a0d640 1 --2- 172.21.15.1:0/2337378609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f571c1082a0 0x7f571c101410 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.427+0000 7f5720a0d640 1 --2- 172.21.15.1:0/2337378609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f571c1036e0 0x7f571c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.427+0000 7f5720a0d640 1 --2- 172.21.15.1:0/2337378609 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f571c102d30 0x7f571c100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:10.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.427+0000 7f5720a0d640 1 -- 172.21.15.1:0/2337378609 >> 172.21.15.1:0/2337378609 conn(0x7f571c0fc7d0 msgr2=0x7f571c105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:10.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.427+0000 7f5720a0d640 1 -- 172.21.15.1:0/2337378609 shutdown_connections 2024-09-19T09:40:10.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:10.427+0000 7f5720a0d640 1 -- 172.21.15.1:0/2337378609 wait complete. 2024-09-19T09:40:10.479 INFO:tasks.workunit.client.0.smithi001.stdout:checking for stdint.h... yes 2024-09-19T09:40:10.531 INFO:tasks.workunit.client.0.smithi001.stdout:checking for unistd.h... yes 2024-09-19T09:40:10.581 INFO:tasks.workunit.client.0.smithi001.stdout:checking minix/config.h usability... no 2024-09-19T09:40:10.606 INFO:tasks.workunit.client.0.smithi001.stdout:checking minix/config.h presence... no 2024-09-19T09:40:10.607 INFO:tasks.workunit.client.0.smithi001.stdout:checking for minix/config.h... no 2024-09-19T09:40:10.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:10 smithi022 ceph-mon[35583]: pgmap v400: 97 pgs: 97 active+clean; 4.1 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 29 KiB/s wr, 29 op/s 2024-09-19T09:40:10.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:10 smithi121 ceph-mon[35577]: pgmap v400: 97 pgs: 97 active+clean; 4.1 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 29 KiB/s wr, 29 op/s 2024-09-19T09:40:10.642 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-09-19T09:40:10.642 INFO:tasks.workunit.client.0.smithi001.stdout:checking for gcc... (cached) gcc 2024-09-19T09:40:10.674 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-19T09:40:10.674 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-19T09:40:10.674 INFO:tasks.workunit.client.0.smithi001.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-19T09:40:10.674 INFO:tasks.workunit.client.0.smithi001.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-19T09:40:10.716 INFO:tasks.workunit.client.0.smithi001.stdout:checking for main in -lm... yes 2024-09-19T09:40:10.759 INFO:tasks.workunit.client.0.smithi001.stdout:checking for main in -lpthread... yes 2024-09-19T09:40:10.760 INFO:tasks.workunit.client.0.smithi001.stdout:checking for ANSI C header files... (cached) yes 2024-09-19T09:40:10.812 INFO:tasks.workunit.client.0.smithi001.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-19T09:40:10.873 INFO:tasks.workunit.client.0.smithi001.stdout:checking pthread.h usability... yes 2024-09-19T09:40:10.890 INFO:tasks.workunit.client.0.smithi001.stdout:checking pthread.h presence... yes 2024-09-19T09:40:10.890 INFO:tasks.workunit.client.0.smithi001.stdout:checking for pthread.h... yes 2024-09-19T09:40:10.962 INFO:tasks.workunit.client.0.smithi001.stdout:checking fcntl.h usability... yes 2024-09-19T09:40:11.037 INFO:tasks.workunit.client.0.smithi001.stdout:checking fcntl.h presence... yes 2024-09-19T09:40:11.037 INFO:tasks.workunit.client.0.smithi001.stdout:checking for fcntl.h... yes 2024-09-19T09:40:11.061 INFO:tasks.workunit.client.0.smithi001.stdout:checking limits.h usability... yes 2024-09-19T09:40:11.076 INFO:tasks.workunit.client.0.smithi001.stdout:checking limits.h presence... yes 2024-09-19T09:40:11.076 INFO:tasks.workunit.client.0.smithi001.stdout:checking for limits.h... yes 2024-09-19T09:40:11.089 INFO:tasks.workunit.client.0.smithi001.stdout:checking for stdint.h... (cached) yes 2024-09-19T09:40:11.128 INFO:tasks.workunit.client.0.smithi001.stdout:checking sys/time.h usability... yes 2024-09-19T09:40:11.144 INFO:tasks.workunit.client.0.smithi001.stdout:checking sys/time.h presence... yes 2024-09-19T09:40:11.144 INFO:tasks.workunit.client.0.smithi001.stdout:checking for sys/time.h... yes 2024-09-19T09:40:11.157 INFO:tasks.workunit.client.0.smithi001.stdout:checking for unistd.h... (cached) yes 2024-09-19T09:40:11.204 INFO:tasks.workunit.client.0.smithi001.stdout:checking sys/vfs.h usability... yes 2024-09-19T09:40:11.220 INFO:tasks.workunit.client.0.smithi001.stdout:checking sys/vfs.h presence... yes 2024-09-19T09:40:11.221 INFO:tasks.workunit.client.0.smithi001.stdout:checking for sys/vfs.h... yes 2024-09-19T09:40:11.270 INFO:tasks.workunit.client.0.smithi001.stdout:checking sys/limits.h usability... no 2024-09-19T09:40:11.296 INFO:tasks.workunit.client.0.smithi001.stdout:checking sys/limits.h presence... no 2024-09-19T09:40:11.297 INFO:tasks.workunit.client.0.smithi001.stdout:checking for sys/limits.h... no 2024-09-19T09:40:11.322 INFO:tasks.workunit.client.0.smithi001.stdout:checking for an ANSI C-conforming const... yes 2024-09-19T09:40:11.351 INFO:tasks.workunit.client.0.smithi001.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-19T09:40:11.408 INFO:tasks.workunit.client.0.smithi001.stdout:checking for system... yes 2024-09-19T09:40:11.463 INFO:tasks.workunit.client.0.smithi001.stdout:checking for gettimeofday... yes 2024-09-19T09:40:11.518 INFO:tasks.workunit.client.0.smithi001.stdout:checking for mkdir... yes 2024-09-19T09:40:11.573 INFO:tasks.workunit.client.0.smithi001.stdout:checking for strerror... yes 2024-09-19T09:40:11.628 INFO:tasks.workunit.client.0.smithi001.stdout:checking for open64... yes 2024-09-19T09:40:11.683 INFO:tasks.workunit.client.0.smithi001.stdout:checking for stat64... yes 2024-09-19T09:40:11.738 INFO:tasks.workunit.client.0.smithi001.stdout:checking for fseeko64... yes 2024-09-19T09:40:11.794 INFO:tasks.workunit.client.0.smithi001.stdout:checking for lrand48_r... yes 2024-09-19T09:40:11.848 INFO:tasks.workunit.client.0.smithi001.stdout:checking for srand48_r... yes 2024-09-19T09:40:11.871 INFO:tasks.workunit.client.0.smithi001.stdout:configure: creating ./config.status 2024-09-19T09:40:11.930 INFO:tasks.workunit.client.0.smithi001.stdout: /bin/sh ./config.status 2024-09-19T09:40:11.976 INFO:tasks.workunit.client.0.smithi001.stdout:config.status: creating Makefile 2024-09-19T09:40:11.988 INFO:tasks.workunit.client.0.smithi001.stdout:config.status: creating config.h 2024-09-19T09:40:12.011 INFO:tasks.workunit.client.0.smithi001.stdout:config.status: executing depfiles commands 2024-09-19T09:40:12.022 INFO:tasks.workunit.client.0.smithi001.stdout:config.status: executing default commands 2024-09-19T09:40:12.045 INFO:tasks.workunit.client.0.smithi001.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2024-09-19T09:40:12.195 INFO:tasks.workunit.client.0.smithi001.stdout:rm -f stamp-h1 2024-09-19T09:40:12.197 INFO:tasks.workunit.client.0.smithi001.stdout:touch config.h.in 2024-09-19T09:40:12.199 INFO:tasks.workunit.client.0.smithi001.stdout:cd . && /bin/sh ./config.status config.h 2024-09-19T09:40:12.239 INFO:tasks.workunit.client.0.smithi001.stdout:config.status: creating config.h 2024-09-19T09:40:12.264 INFO:tasks.workunit.client.0.smithi001.stdout:make all-am 2024-09-19T09:40:12.269 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-19T09:40:12.269 INFO:tasks.workunit.client.0.smithi001.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-09-19T09:40:12.279 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:40:12.280 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:40:12.444 INFO:tasks.workunit.client.0.smithi001.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-09-19T09:40:12.447 INFO:tasks.workunit.client.0.smithi001.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-09-19T09:40:12.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:12 smithi001 ceph-mon[31225]: pgmap v401: 97 pgs: 97 active+clean; 3.9 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 36 KiB/s wr, 41 op/s 2024-09-19T09:40:12.547 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:12.553 INFO:tasks.workunit.client.0.smithi001.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-09-19T09:40:12.557 INFO:tasks.workunit.client.0.smithi001.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-09-19T09:40:12.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:12 smithi022 ceph-mon[35583]: pgmap v401: 97 pgs: 97 active+clean; 3.9 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 36 KiB/s wr, 41 op/s 2024-09-19T09:40:12.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:12 smithi121 ceph-mon[35577]: pgmap v401: 97 pgs: 97 active+clean; 3.9 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 36 KiB/s wr, 41 op/s 2024-09-19T09:40:12.652 INFO:tasks.workunit.client.0.smithi001.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-09-19T09:40:12.656 INFO:tasks.workunit.client.0.smithi001.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-09-19T09:40:12.747 INFO:tasks.workunit.client.0.smithi001.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-09-19T09:40:12.751 INFO:tasks.workunit.client.0.smithi001.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-09-19T09:40:12.883 INFO:tasks.workunit.client.0.smithi001.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-09-19T09:40:12.886 INFO:tasks.workunit.client.0.smithi001.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-09-19T09:40:12.946 INFO:tasks.workunit.client.0.smithi001.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-09-19T09:40:12.950 INFO:tasks.workunit.client.0.smithi001.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-09-19T09:40:12.996 INFO:tasks.workunit.client.0.smithi001.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-09-19T09:40:13.000 INFO:tasks.workunit.client.0.smithi001.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-09-19T09:40:13.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.011+0000 7f7ec71f1640 1 -- 172.21.15.1:0/2996580032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ec0103670 msgr2=0x7f7ec010bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:13.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.011+0000 7f7ec71f1640 1 --2- 172.21.15.1:0/2996580032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ec0103670 0x7f7ec010bb60 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7eac009900 tx=0x7f7eac02a480 comp rx=0 tx=0).stop 2024-09-19T09:40:13.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.011+0000 7f7ec71f1640 1 -- 172.21.15.1:0/2996580032 shutdown_connections 2024-09-19T09:40:13.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.011+0000 7f7ec71f1640 1 --2- 172.21.15.1:0/2996580032 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ec010c180 0x7f7ec010e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.011+0000 7f7ec71f1640 1 --2- 172.21.15.1:0/2996580032 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ec0103670 0x7f7ec010bb60 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.011+0000 7f7ec71f1640 1 --2- 172.21.15.1:0/2996580032 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ec0102d50 0x7f7ec0103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.011+0000 7f7ec71f1640 1 -- 172.21.15.1:0/2996580032 >> 172.21.15.1:0/2996580032 conn(0x7f7ec00fc7d0 msgr2=0x7f7ec00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:13.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.011+0000 7f7ec71f1640 1 -- 172.21.15.1:0/2996580032 shutdown_connections 2024-09-19T09:40:13.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.011+0000 7f7ec71f1640 1 -- 172.21.15.1:0/2996580032 wait complete. 2024-09-19T09:40:13.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.011+0000 7f7ec71f1640 1 Processor -- start 2024-09-19T09:40:13.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.012+0000 7f7ec71f1640 1 -- start start 2024-09-19T09:40:13.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.012+0000 7f7ec71f1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ec0102d50 0x7f7ec019adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.012+0000 7f7ec71f1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ec0103670 0x7f7ec019b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.012+0000 7f7ec71f1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ec010c180 0x7f7ec019ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.012+0000 7f7ec71f1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec0100d90 con 0x7f7ec010c180 2024-09-19T09:40:13.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.012+0000 7f7ec71f1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec0100c10 con 0x7f7ec0103670 2024-09-19T09:40:13.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.012+0000 7f7ec71f1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec0100f10 con 0x7f7ec0102d50 2024-09-19T09:40:13.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.012+0000 7f7ec578e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ec010c180 0x7f7ec019ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:13.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.012+0000 7f7ec4f8d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ec0102d50 0x7f7ec019adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:13.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.012+0000 7f7ec578e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ec010c180 0x7f7ec019ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40432/0 (socket says 172.21.15.1:40432) 2024-09-19T09:40:13.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.012+0000 7f7ec578e640 1 -- 172.21.15.1:0/62128961 learned_addr learned my addr 172.21.15.1:0/62128961 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:13.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.012+0000 7f7ebffff640 1 --2- 172.21.15.1:0/62128961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ec0103670 0x7f7ec019b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:13.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.012+0000 7f7ec578e640 1 -- 172.21.15.1:0/62128961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ec0102d50 msgr2=0x7f7ec019adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:13.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.012+0000 7f7ec578e640 1 --2- 172.21.15.1:0/62128961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ec0102d50 0x7f7ec019adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.012+0000 7f7ec578e640 1 -- 172.21.15.1:0/62128961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ec0103670 msgr2=0x7f7ec019b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:13.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.012+0000 7f7ec578e640 1 --2- 172.21.15.1:0/62128961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ec0103670 0x7f7ec019b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.012+0000 7f7ec578e640 1 -- 172.21.15.1:0/62128961 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec019f570 con 0x7f7ec010c180 2024-09-19T09:40:13.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.012+0000 7f7ebffff640 1 --2- 172.21.15.1:0/62128961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ec0103670 0x7f7ec019b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:40:13.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.013+0000 7f7ec578e640 1 --2- 172.21.15.1:0/62128961 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ec010c180 0x7f7ec019ee90 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7eb800cce0 tx=0x7f7eb800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:13.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.013+0000 7f7ebdffb640 1 -- 172.21.15.1:0/62128961 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb800f450 con 0x7f7ec010c180 2024-09-19T09:40:13.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.013+0000 7f7ec71f1640 1 -- 172.21.15.1:0/62128961 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ec019f860 con 0x7f7ec010c180 2024-09-19T09:40:13.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.013+0000 7f7ebdffb640 1 -- 172.21.15.1:0/62128961 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7eb800fad0 con 0x7f7ec010c180 2024-09-19T09:40:13.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.013+0000 7f7ebdffb640 1 -- 172.21.15.1:0/62128961 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8018c10 con 0x7f7ec010c180 2024-09-19T09:40:13.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.013+0000 7f7ec71f1640 1 -- 172.21.15.1:0/62128961 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ec01a7140 con 0x7f7ec010c180 2024-09-19T09:40:13.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.015+0000 7f7ebdffb640 1 -- 172.21.15.1:0/62128961 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f7eb800f5f0 con 0x7f7ec010c180 2024-09-19T09:40:13.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.016+0000 7f7ec95ca740 1 Processor -- start 2024-09-19T09:40:13.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.016+0000 7f7ec95ca740 1 -- start start 2024-09-19T09:40:13.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.016+0000 7f7ec95ca740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b32958b60 0x563b32958f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.016+0000 7f7ec95ca740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563b32959480 0x563b32963800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.016+0000 7f7ec95ca740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b32963d40 0x563b32966130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.016+0000 7f7ec95ca740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563b328be280 con 0x563b32959480 2024-09-19T09:40:13.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.016+0000 7f7ec95ca740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563b32865b10 con 0x563b32958b60 2024-09-19T09:40:13.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.016+0000 7f7ec95ca740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563b328ba240 con 0x563b32963d40 2024-09-19T09:40:13.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.016+0000 7f7ec4f8d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563b32959480 0x563b32963800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:13.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.016+0000 7f7ec4f8d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563b32959480 0x563b32963800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40436/0 (socket says 172.21.15.1:40436) 2024-09-19T09:40:13.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.016+0000 7f7ec4f8d640 1 -- 172.21.15.1:0/3593739769 learned_addr learned my addr 172.21.15.1:0/3593739769 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:13.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.016+0000 7f7ebdffb640 1 --2- 172.21.15.1:0/62128961 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f7eb00a3240 0x7f7eb00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.016+0000 7f7ebffff640 1 --2- 172.21.15.1:0/3593739769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b32958b60 0x563b32958f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:13.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.016+0000 7f7ebffff640 1 --2- 172.21.15.1:0/3593739769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b32963d40 0x563b32966130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:13.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.016+0000 7f7ec578e640 1 --2- 172.21.15.1:0/62128961 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f7eb00a3240 0x7f7eb00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:13.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.017+0000 7f7ec4f8d640 1 -- 172.21.15.1:0/3593739769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b32963d40 msgr2=0x563b32966130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:13.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.017+0000 7f7ec4f8d640 1 --2- 172.21.15.1:0/3593739769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b32963d40 0x563b32966130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.017+0000 7f7ec4f8d640 1 -- 172.21.15.1:0/3593739769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b32958b60 msgr2=0x563b32958f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:13.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.017+0000 7f7ec4f8d640 1 --2- 172.21.15.1:0/3593739769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b32958b60 0x563b32958f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.017+0000 7f7ec4f8d640 1 -- 172.21.15.1:0/3593739769 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b328721f0 con 0x563b32959480 2024-09-19T09:40:13.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.017+0000 7f7ebdffb640 1 -- 172.21.15.1:0/62128961 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f7eb80cfed0 con 0x7f7ec010c180 2024-09-19T09:40:13.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.017+0000 7f7ebffff640 1 --2- 172.21.15.1:0/3593739769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b32958b60 0x563b32958f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:13.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.017+0000 7f7ec4f8d640 1 --2- 172.21.15.1:0/3593739769 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563b32959480 0x563b32963800 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7eb400bcd0 tx=0x7f7eb40107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835a93d451d6898f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:13.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.017+0000 7f7ec578e640 1 --2- 172.21.15.1:0/62128961 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f7eb00a3240 0x7f7eb00a5700 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7eb800ab20 tx=0x7f7eb800af30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:13.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.017+0000 7f7eaaffd640 1 -- 172.21.15.1:0/3593739769 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb4005220 con 0x563b32959480 2024-09-19T09:40:13.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.017+0000 7f7eaaffd640 1 -- 172.21.15.1:0/3593739769 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7eb4004c80 con 0x563b32959480 2024-09-19T09:40:13.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.017+0000 7f7eaaffd640 1 -- 172.21.15.1:0/3593739769 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb40117a0 con 0x563b32959480 2024-09-19T09:40:13.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.018+0000 7f7ec95ca740 1 -- 172.21.15.1:0/3593739769 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563b32959480 msgr2=0x563b32963800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:13.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.018+0000 7f7ec95ca740 1 --2- 172.21.15.1:0/3593739769 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563b32959480 0x563b32963800 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7eb400bcd0 tx=0x7f7eb40107a0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.018+0000 7f7ec95ca740 1 -- 172.21.15.1:0/3593739769 shutdown_connections 2024-09-19T09:40:13.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.018+0000 7f7ec95ca740 1 --2- 172.21.15.1:0/3593739769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b32963d40 0x563b32966130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.018+0000 7f7ec95ca740 1 --2- 172.21.15.1:0/3593739769 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563b32959480 0x563b32963800 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.018+0000 7f7ec95ca740 1 --2- 172.21.15.1:0/3593739769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b32958b60 0x563b32958f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.018+0000 7f7ec95ca740 1 -- 172.21.15.1:0/3593739769 >> 172.21.15.1:0/3593739769 conn(0x563b329550f0 msgr2=0x563b329554d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:13.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.018+0000 7f7ec95ca740 1 -- 172.21.15.1:0/3593739769 shutdown_connections 2024-09-19T09:40:13.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.018+0000 7f7ec95ca740 1 -- 172.21.15.1:0/3593739769 wait complete. 2024-09-19T09:40:13.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.018+0000 7f7ec95ca740 1 -- start start 2024-09-19T09:40:13.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.018+0000 7f7ec95ca740 1 Processor -- start 2024-09-19T09:40:13.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.019+0000 7f7ec95ca740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b32958b60 0x563b32960bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.019+0000 7f7ec95ca740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563b32959480 0x563b32961110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.019+0000 7f7ec95ca740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b32963d40 0x563b32961650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.019+0000 7f7ec95ca740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563b32966910 con 0x563b32959480 2024-09-19T09:40:13.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.019+0000 7f7ec95ca740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563b32878f10 con 0x563b32958b60 2024-09-19T09:40:13.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.019+0000 7f7ec95ca740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563b32966a90 con 0x563b32963d40 2024-09-19T09:40:13.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.019+0000 7f7ec95ca740 10 client.0 _ll_register_callbacks cb 0x563b32841a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:13.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.019+0000 7f7ec4f8d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563b32959480 0x563b32961110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:13.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.019+0000 7f7ec4f8d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563b32959480 0x563b32961110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40450/0 (socket says 172.21.15.1:40450) 2024-09-19T09:40:13.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.019+0000 7f7ec4f8d640 1 -- 172.21.15.1:0/1613000806 learned_addr learned my addr 172.21.15.1:0/1613000806 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:13.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.019+0000 7f7ebffff640 1 --2- 172.21.15.1:0/1613000806 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b32963d40 0x563b32961650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:13.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.019+0000 7f7ebffff640 1 --2- 172.21.15.1:0/1613000806 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b32958b60 0x563b32960bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:13.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.019+0000 7f7ec4f8d640 1 -- 172.21.15.1:0/1613000806 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b32963d40 msgr2=0x563b32961650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:13.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.019+0000 7f7ec4f8d640 1 --2- 172.21.15.1:0/1613000806 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b32963d40 0x563b32961650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.019+0000 7f7ec4f8d640 1 -- 172.21.15.1:0/1613000806 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b32958b60 msgr2=0x563b32960bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:13.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.019+0000 7f7ec4f8d640 1 --2- 172.21.15.1:0/1613000806 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b32958b60 0x563b32960bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.019+0000 7f7ec4f8d640 1 -- 172.21.15.1:0/1613000806 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b3262f6a0 con 0x563b32959480 2024-09-19T09:40:13.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.019+0000 7f7ebffff640 1 --2- 172.21.15.1:0/1613000806 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b32958b60 0x563b32960bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:13.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.020+0000 7f7ec4f8d640 1 --2- 172.21.15.1:0/1613000806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563b32959480 0x563b32961110 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4010ca0 tx=0x7f7eb4005230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2678dc7477c001f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:13.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.020+0000 7f7e9ffff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:40:13.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.020+0000 7f7e9ffff640 1 -- 172.21.15.1:0/1613000806 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb402a060 con 0x563b32959480 2024-09-19T09:40:13.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.020+0000 7f7e9ffff640 1 -- 172.21.15.1:0/1613000806 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f7eb40048d0 con 0x563b32959480 2024-09-19T09:40:13.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.020+0000 7f7ec95ca740 1 -- 172.21.15.1:0/1613000806 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7eb4004c80 con 0x563b32959480 2024-09-19T09:40:13.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.020+0000 7f7e9ffff640 1 -- 172.21.15.1:0/1613000806 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7eb4004ad0 con 0x563b32959480 2024-09-19T09:40:13.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.020+0000 7f7ec95ca740 10 client.15735 fetch_fsmap learned FSMap version 19 2024-09-19T09:40:13.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.020+0000 7f7ec95ca740 1 -- 172.21.15.1:0/1613000806 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x563b329724c0 con 0x563b32959480 2024-09-19T09:40:13.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.020+0000 7f7e9ffff640 1 -- 172.21.15.1:0/1613000806 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7eb4004c80 con 0x563b32959480 2024-09-19T09:40:13.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.020+0000 7f7e9ffff640 1 -- 172.21.15.1:0/1613000806 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f7eb402f070 con 0x563b32959480 2024-09-19T09:40:13.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.020+0000 7f7ec95ca740 10 client.15735 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:40:13.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.020+0000 7f7ec95ca740 10 client.15735 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:13.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.020+0000 7f7ec95ca740 20 client.15735 populate_metadata read hostname 'smithi001' 2024-09-19T09:40:13.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.020+0000 7f7ec95ca740 1 --2- 172.21.15.1:0/1613000806 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563b32973980 0x563b32975d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.020+0000 7f7ec95ca740 4 client.15735 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:13.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.020+0000 7f7ec95ca740 1 -- 172.21.15.1:0/1613000806 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b328cb7f0 con 0x563b32973980 2024-09-19T09:40:13.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.021+0000 7f7ebffff640 1 --2- 172.21.15.1:0/1613000806 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563b32973980 0x563b32975d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:13.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.021+0000 7f7e9ffff640 10 client.15735 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:13.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.021+0000 7f7ebffff640 1 --2- 172.21.15.1:0/1613000806 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563b32973980 0x563b32975d70 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38ece9622fe99baa server_cookie=b85c296e73da4fbd in_seq=0 out_seq=0 2024-09-19T09:40:13.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.022+0000 7f7e9ffff640 1 -- 172.21.15.1:0/1613000806 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563b328cb7f0 con 0x563b32973980 2024-09-19T09:40:13.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.022+0000 7f7e9ffff640 10 client.15735 handle_command_reply: tid=0 2024-09-19T09:40:13.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.022+0000 7f7ec95ca740 1 client.15735 shutdown 2024-09-19T09:40:13.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.022+0000 7f7ec95ca740 1 -- 172.21.15.1:0/1613000806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563b32959480 msgr2=0x563b32961110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:13.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.022+0000 7f7ec95ca740 1 --2- 172.21.15.1:0/1613000806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563b32959480 0x563b32961110 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4010ca0 tx=0x7f7eb4005230 comp rx=0 tx=0).stop 2024-09-19T09:40:13.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.022+0000 7f7ec95ca740 1 -- 172.21.15.1:0/1613000806 shutdown_connections 2024-09-19T09:40:13.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.022+0000 7f7ec95ca740 1 --2- 172.21.15.1:0/1613000806 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563b32973980 0x563b32975d70 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.022+0000 7f7e9ffff640 0 client.15735 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:13.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.022+0000 7f7ec95ca740 1 --2- 172.21.15.1:0/1613000806 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b32963d40 0x563b32961650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.022+0000 7f7ec95ca740 1 --2- 172.21.15.1:0/1613000806 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563b32959480 0x563b32961110 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.022+0000 7f7ec95ca740 1 --2- 172.21.15.1:0/1613000806 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b32958b60 0x563b32960bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.022+0000 7f7ec95ca740 1 -- 172.21.15.1:0/1613000806 >> 172.21.15.1:0/1613000806 conn(0x563b329550f0 msgr2=0x563b32954270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:13.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.022+0000 7f7ec95ca740 1 -- 172.21.15.1:0/1613000806 shutdown_connections 2024-09-19T09:40:13.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.022+0000 7f7ec95ca740 1 -- 172.21.15.1:0/1613000806 wait complete. 2024-09-19T09:40:13.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.022+0000 7f7ec95ca740 20 client.15735 trim_cache size 0 max 16384 2024-09-19T09:40:13.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.040+0000 7f7ec95ca740 1 Processor -- start 2024-09-19T09:40:13.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.040+0000 7f7ec95ca740 1 -- start start 2024-09-19T09:40:13.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.040+0000 7f7ec95ca740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563b32958b60 0x563b3295de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.040+0000 7f7ec95ca740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b32959480 0x563b3295e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.040+0000 7f7ec95ca740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b32963d40 0x563b32962320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.040+0000 7f7ec95ca740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec01ad6f0 con 0x563b32958b60 2024-09-19T09:40:13.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.040+0000 7f7ec95ca740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec01aff90 con 0x563b32963d40 2024-09-19T09:40:13.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.040+0000 7f7ec95ca740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec01add80 con 0x563b32959480 2024-09-19T09:40:13.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.040+0000 7f7ebffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563b32958b60 0x563b3295de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:13.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.040+0000 7f7ebffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563b32958b60 0x563b3295de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40460/0 (socket says 172.21.15.1:40460) 2024-09-19T09:40:13.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.040+0000 7f7ebffff640 1 -- 172.21.15.1:0/61310527 learned_addr learned my addr 172.21.15.1:0/61310527 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:13.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.040+0000 7f7ebffff640 1 --2- 172.21.15.1:0/61310527 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b32963d40 0x563b32962320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:13.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.040+0000 7f7ec4f8d640 1 --2- 172.21.15.1:0/61310527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b32959480 0x563b3295e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:13.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.040+0000 7f7ebffff640 1 -- 172.21.15.1:0/61310527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b32959480 msgr2=0x563b3295e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:13.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.040+0000 7f7ebffff640 1 --2- 172.21.15.1:0/61310527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b32959480 0x563b3295e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.040+0000 7f7ebffff640 1 -- 172.21.15.1:0/61310527 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b32963d40 msgr2=0x563b32962320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:13.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.040+0000 7f7ebffff640 1 --2- 172.21.15.1:0/61310527 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b32963d40 0x563b32962320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.040+0000 7f7ebffff640 1 -- 172.21.15.1:0/61310527 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b3294f680 con 0x563b32958b60 2024-09-19T09:40:13.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.041+0000 7f7ebffff640 1 --2- 172.21.15.1:0/61310527 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563b32958b60 0x563b3295de70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f7eac009230 tx=0x7f7eac02a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=271f65005fc2dd6d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:13.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.041+0000 7f7eaa7fc640 1 -- 172.21.15.1:0/61310527 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac035040 con 0x563b32958b60 2024-09-19T09:40:13.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.041+0000 7f7eaa7fc640 1 -- 172.21.15.1:0/61310527 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7eac003ad0 con 0x563b32958b60 2024-09-19T09:40:13.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.041+0000 7f7eaa7fc640 1 -- 172.21.15.1:0/61310527 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac04b960 con 0x563b32958b60 2024-09-19T09:40:13.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.042+0000 7f7ec95ca740 1 -- 172.21.15.1:0/61310527 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563b32958b60 msgr2=0x563b3295de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:13.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.042+0000 7f7ec95ca740 1 --2- 172.21.15.1:0/61310527 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563b32958b60 0x563b3295de70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f7eac009230 tx=0x7f7eac02a480 comp rx=0 tx=0).stop 2024-09-19T09:40:13.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.042+0000 7f7ec95ca740 1 -- 172.21.15.1:0/61310527 shutdown_connections 2024-09-19T09:40:13.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.042+0000 7f7ec95ca740 1 --2- 172.21.15.1:0/61310527 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b32963d40 0x563b32962320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.042+0000 7f7ec95ca740 1 --2- 172.21.15.1:0/61310527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b32959480 0x563b3295e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.042+0000 7f7ec95ca740 1 --2- 172.21.15.1:0/61310527 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563b32958b60 0x563b3295de70 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.042+0000 7f7ec95ca740 1 -- 172.21.15.1:0/61310527 >> 172.21.15.1:0/61310527 conn(0x563b329550f0 msgr2=0x563b3295fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:13.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.042+0000 7f7ec95ca740 1 -- 172.21.15.1:0/61310527 shutdown_connections 2024-09-19T09:40:13.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.042+0000 7f7ec95ca740 1 -- 172.21.15.1:0/61310527 wait complete. 2024-09-19T09:40:13.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.042+0000 7f7ec95ca740 1 -- start start 2024-09-19T09:40:13.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.042+0000 7f7ec95ca740 1 Processor -- start 2024-09-19T09:40:13.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.043+0000 7f7ec95ca740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563b32958b60 0x563b329791c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.043+0000 7f7ec95ca740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b32959480 0x563b32976510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.043+0000 7f7ec95ca740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b32963d40 0x563b32976a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.043+0000 7f7ec95ca740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec01ae450 con 0x563b32958b60 2024-09-19T09:40:13.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.043+0000 7f7ec95ca740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec01af8c0 con 0x563b32959480 2024-09-19T09:40:13.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.043+0000 7f7ec95ca740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec01aeb20 con 0x563b32963d40 2024-09-19T09:40:13.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.043+0000 7f7ec95ca740 10 client.0 _ll_register_callbacks cb 0x7f7eb400bb20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:13.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.043+0000 7f7ebffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563b32958b60 0x563b329791c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:13.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.043+0000 7f7ebffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563b32958b60 0x563b329791c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40468/0 (socket says 172.21.15.1:40468) 2024-09-19T09:40:13.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.043+0000 7f7ebffff640 1 -- 172.21.15.1:0/3618323325 learned_addr learned my addr 172.21.15.1:0/3618323325 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:13.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.043+0000 7f7ec4f8d640 1 --2- 172.21.15.1:0/3618323325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b32959480 0x563b32976510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:13.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.043+0000 7f7ebffff640 1 --2- 172.21.15.1:0/3618323325 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b32963d40 0x563b32976a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:13.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.043+0000 7f7ebffff640 1 -- 172.21.15.1:0/3618323325 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b32963d40 msgr2=0x563b32976a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:13.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.043+0000 7f7ebffff640 1 --2- 172.21.15.1:0/3618323325 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b32963d40 0x563b32976a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.043+0000 7f7ebffff640 1 -- 172.21.15.1:0/3618323325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b32959480 msgr2=0x563b32976510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:13.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.043+0000 7f7ebffff640 1 --2- 172.21.15.1:0/3618323325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b32959480 0x563b32976510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.043+0000 7f7ebffff640 1 -- 172.21.15.1:0/3618323325 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b32976f90 con 0x563b32958b60 2024-09-19T09:40:13.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.043+0000 7f7ebffff640 1 --2- 172.21.15.1:0/3618323325 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563b32958b60 0x563b329791c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7eac009900 tx=0x7f7eac04b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f627590bc9f4b019 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:13.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.043+0000 7f7e9ffff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:40:13.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.044+0000 7f7e9ffff640 1 -- 172.21.15.1:0/3618323325 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eac05c060 con 0x563b32958b60 2024-09-19T09:40:13.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.044+0000 7f7e9ffff640 1 -- 172.21.15.1:0/3618323325 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f7eac003c80 con 0x563b32958b60 2024-09-19T09:40:13.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.044+0000 7f7ec95ca740 1 -- 172.21.15.1:0/3618323325 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7eac003ad0 con 0x563b32958b60 2024-09-19T09:40:13.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.044+0000 7f7e9ffff640 1 -- 172.21.15.1:0/3618323325 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7eac035070 con 0x563b32958b60 2024-09-19T09:40:13.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.044+0000 7f7ec95ca740 10 client.15741 fetch_fsmap learned FSMap version 19 2024-09-19T09:40:13.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.044+0000 7f7ec95ca740 1 -- 172.21.15.1:0/3618323325 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x563b329ddfd0 con 0x563b32958b60 2024-09-19T09:40:13.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.044+0000 7f7e9ffff640 1 -- 172.21.15.1:0/3618323325 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7eac003ad0 con 0x563b32958b60 2024-09-19T09:40:13.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.044+0000 7f7e9ffff640 1 -- 172.21.15.1:0/3618323325 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f7eac04b070 con 0x563b32958b60 2024-09-19T09:40:13.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.044+0000 7f7ec95ca740 10 client.15741 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:40:13.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.044+0000 7f7ec95ca740 10 client.15741 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:13.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.044+0000 7f7ec95ca740 20 client.15741 populate_metadata read hostname 'smithi001' 2024-09-19T09:40:13.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.044+0000 7f7ec95ca740 1 --2- 172.21.15.1:0/3618323325 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563b32973980 0x563b329e0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:13.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.044+0000 7f7ec95ca740 4 client.15741 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:40:13.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.044+0000 7f7ec95ca740 1 -- 172.21.15.1:0/3618323325 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563b328c5d00 con 0x563b32973980 2024-09-19T09:40:13.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.045+0000 7f7ec4f8d640 1 --2- 172.21.15.1:0/3618323325 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563b32973980 0x563b329e0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:13.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.045+0000 7f7ec4f8d640 1 --2- 172.21.15.1:0/3618323325 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563b32973980 0x563b329e0590 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27406335cb61b986 server_cookie=4e1f3bda90a97364 in_seq=0 out_seq=0 2024-09-19T09:40:13.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.045+0000 7f7e9ffff640 10 client.15741 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:13.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.046+0000 7f7e9ffff640 1 -- 172.21.15.1:0/3618323325 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563b328c5d00 con 0x563b32973980 2024-09-19T09:40:13.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.046+0000 7f7e9ffff640 10 client.15741 handle_command_reply: tid=0 2024-09-19T09:40:13.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.046+0000 7f7ec95ca740 1 client.15741 shutdown 2024-09-19T09:40:13.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.046+0000 7f7ec95ca740 1 -- 172.21.15.1:0/3618323325 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563b32958b60 msgr2=0x563b329791c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:13.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.046+0000 7f7ec95ca740 1 --2- 172.21.15.1:0/3618323325 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563b32958b60 0x563b329791c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7eac009900 tx=0x7f7eac04b540 comp rx=0 tx=0).stop 2024-09-19T09:40:13.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.046+0000 7f7ec95ca740 1 -- 172.21.15.1:0/3618323325 shutdown_connections 2024-09-19T09:40:13.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.046+0000 7f7ec95ca740 1 --2- 172.21.15.1:0/3618323325 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563b32973980 0x563b329e0590 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.046+0000 7f7ec95ca740 1 --2- 172.21.15.1:0/3618323325 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563b32963d40 0x563b32976a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.046+0000 7f7ec95ca740 1 --2- 172.21.15.1:0/3618323325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b32959480 0x563b32976510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.046+0000 7f7ec95ca740 1 --2- 172.21.15.1:0/3618323325 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563b32958b60 0x563b329791c0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.046+0000 7f7ec95ca740 1 -- 172.21.15.1:0/3618323325 >> 172.21.15.1:0/3618323325 conn(0x563b329550f0 msgr2=0x563b32960b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:13.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.046+0000 7f7e9ffff640 0 client.15741 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:13.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.046+0000 7f7ec95ca740 1 -- 172.21.15.1:0/3618323325 shutdown_connections 2024-09-19T09:40:13.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.046+0000 7f7ec95ca740 1 -- 172.21.15.1:0/3618323325 wait complete. 2024-09-19T09:40:13.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.047+0000 7f7ec95ca740 20 client.15741 trim_cache size 0 max 16384 2024-09-19T09:40:13.066 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:40:13.066 INFO:teuthology.orchestra.run.smithi001.stdout: "return_code": 0, 2024-09-19T09:40:13.066 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_tag": "17059385-e18d-4526-aeb4-133a1fdbd457", 2024-09-19T09:40:13.066 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": "asynchronous" 2024-09-19T09:40:13.066 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:40:13.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.047+0000 7f7ec71f1640 1 -- 172.21.15.1:0/62128961 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f7eb00a3240 msgr2=0x7f7eb00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:13.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.047+0000 7f7ec71f1640 1 --2- 172.21.15.1:0/62128961 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f7eb00a3240 0x7f7eb00a5700 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7eb800ab20 tx=0x7f7eb800af30 comp rx=0 tx=0).stop 2024-09-19T09:40:13.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.047+0000 7f7ec71f1640 1 -- 172.21.15.1:0/62128961 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ec010c180 msgr2=0x7f7ec019ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:13.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.047+0000 7f7ec71f1640 1 --2- 172.21.15.1:0/62128961 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ec010c180 0x7f7ec019ee90 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7eb800cce0 tx=0x7f7eb800a620 comp rx=0 tx=0).stop 2024-09-19T09:40:13.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.047+0000 7f7ec71f1640 1 -- 172.21.15.1:0/62128961 shutdown_connections 2024-09-19T09:40:13.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.047+0000 7f7ec71f1640 1 --2- 172.21.15.1:0/62128961 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7ec010c180 0x7f7ec019ee90 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.047+0000 7f7ec71f1640 1 --2- 172.21.15.1:0/62128961 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f7eb00a3240 0x7f7eb00a5700 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.047+0000 7f7ec71f1640 1 --2- 172.21.15.1:0/62128961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ec0103670 0x7f7ec019b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.047+0000 7f7ec71f1640 1 --2- 172.21.15.1:0/62128961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7ec0102d50 0x7f7ec019adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:13.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.047+0000 7f7ec71f1640 1 -- 172.21.15.1:0/62128961 >> 172.21.15.1:0/62128961 conn(0x7f7ec00fc7d0 msgr2=0x7f7ec010c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:13.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.047+0000 7f7ec71f1640 1 -- 172.21.15.1:0/62128961 shutdown_connections 2024-09-19T09:40:13.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:13.047+0000 7f7ec71f1640 1 -- 172.21.15.1:0/62128961 wait complete. 2024-09-19T09:40:13.068 INFO:tasks.workunit.client.0.smithi001.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-09-19T09:40:13.068 INFO:tasks.workunit.client.0.smithi001.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-09-19T09:40:13.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:13 smithi001 ceph-mon[31225]: scrub queued for path: / 2024-09-19T09:40:13.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:13 smithi001 ceph-mon[31225]: scrub summary: idle+waiting paths [/] 2024-09-19T09:40:13.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:13 smithi001 ceph-mon[31225]: scrub summary: active paths [/] 2024-09-19T09:40:13.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:13 smithi001 ceph-mon[31225]: scrub summary: idle+waiting paths [/] 2024-09-19T09:40:13.270 INFO:tasks.workunit.client.0.smithi001.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-09-19T09:40:13.272 INFO:tasks.workunit.client.0.smithi001.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-09-19T09:40:13.398 INFO:tasks.workunit.client.0.smithi001.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-09-19T09:40:13.401 INFO:tasks.workunit.client.0.smithi001.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-09-19T09:40:13.573 INFO:tasks.workunit.client.0.smithi001.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-09-19T09:40:13.576 INFO:tasks.workunit.client.0.smithi001.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-09-19T09:40:13.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:13 smithi022 ceph-mon[35583]: scrub queued for path: / 2024-09-19T09:40:13.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:13 smithi022 ceph-mon[35583]: scrub summary: idle+waiting paths [/] 2024-09-19T09:40:13.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:13 smithi022 ceph-mon[35583]: scrub summary: active paths [/] 2024-09-19T09:40:13.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:13 smithi022 ceph-mon[35583]: scrub summary: idle+waiting paths [/] 2024-09-19T09:40:13.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:13 smithi121 ceph-mon[35577]: scrub queued for path: / 2024-09-19T09:40:13.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:13 smithi121 ceph-mon[35577]: scrub summary: idle+waiting paths [/] 2024-09-19T09:40:13.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:13 smithi121 ceph-mon[35577]: scrub summary: active paths [/] 2024-09-19T09:40:13.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:13 smithi121 ceph-mon[35577]: scrub summary: idle+waiting paths [/] 2024-09-19T09:40:13.646 INFO:tasks.workunit.client.0.smithi001.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-09-19T09:40:13.650 INFO:tasks.workunit.client.0.smithi001.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-09-19T09:40:13.730 INFO:tasks.workunit.client.0.smithi001.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-09-19T09:40:13.734 INFO:tasks.workunit.client.0.smithi001.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-09-19T09:40:13.790 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:40:13.842 INFO:tasks.workunit.client.0.smithi001.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-09-19T09:40:13.845 INFO:tasks.workunit.client.0.smithi001.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-09-19T09:40:13.873 INFO:tasks.workunit.client.0.smithi001.stderr:In file included from parser.h:22, 2024-09-19T09:40:13.874 INFO:tasks.workunit.client.0.smithi001.stderr: from parser.c:25: 2024-09-19T09:40:13.874 INFO:tasks.workunit.client.0.smithi001.stderr:parser.c: In function ‘init_filesys’: 2024-09-19T09:40:13.874 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T09:40:13.874 INFO:tasks.workunit.client.0.smithi001.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T09:40:13.874 INFO:tasks.workunit.client.0.smithi001.stderr: | ^ 2024-09-19T09:40:13.874 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T09:40:13.874 INFO:tasks.workunit.client.0.smithi001.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T09:40:13.874 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~ 2024-09-19T09:40:13.874 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T09:40:13.874 INFO:tasks.workunit.client.0.smithi001.stderr: 36 | container_of(ptr, type, member) 2024-09-19T09:40:13.874 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~~~~~ 2024-09-19T09:40:13.875 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-19T09:40:13.875 INFO:tasks.workunit.client.0.smithi001.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-19T09:40:13.875 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~~~ 2024-09-19T09:40:13.875 INFO:tasks.workunit.client.0.smithi001.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T09:40:13.875 INFO:tasks.workunit.client.0.smithi001.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-19T09:40:13.875 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T09:40:13.875 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T09:40:13.875 INFO:tasks.workunit.client.0.smithi001.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T09:40:13.875 INFO:tasks.workunit.client.0.smithi001.stderr: | ^ 2024-09-19T09:40:13.875 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T09:40:13.875 INFO:tasks.workunit.client.0.smithi001.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T09:40:13.875 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~ 2024-09-19T09:40:13.875 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T09:40:13.875 INFO:tasks.workunit.client.0.smithi001.stderr: 36 | container_of(ptr, type, member) 2024-09-19T09:40:13.876 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~~~~~ 2024-09-19T09:40:13.876 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-19T09:40:13.876 INFO:tasks.workunit.client.0.smithi001.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-19T09:40:13.876 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~~~ 2024-09-19T09:40:13.876 INFO:tasks.workunit.client.0.smithi001.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T09:40:13.876 INFO:tasks.workunit.client.0.smithi001.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-19T09:40:13.876 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T09:40:13.876 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T09:40:13.876 INFO:tasks.workunit.client.0.smithi001.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T09:40:13.876 INFO:tasks.workunit.client.0.smithi001.stderr: | ^ 2024-09-19T09:40:13.876 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T09:40:13.876 INFO:tasks.workunit.client.0.smithi001.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T09:40:13.876 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~ 2024-09-19T09:40:13.877 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T09:40:13.877 INFO:tasks.workunit.client.0.smithi001.stderr: 36 | container_of(ptr, type, member) 2024-09-19T09:40:13.877 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~~~~~ 2024-09-19T09:40:13.877 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-19T09:40:13.877 INFO:tasks.workunit.client.0.smithi001.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-19T09:40:13.877 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~~~ 2024-09-19T09:40:13.877 INFO:tasks.workunit.client.0.smithi001.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T09:40:13.877 INFO:tasks.workunit.client.0.smithi001.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-19T09:40:13.877 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T09:40:13.877 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T09:40:13.877 INFO:tasks.workunit.client.0.smithi001.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T09:40:13.877 INFO:tasks.workunit.client.0.smithi001.stderr: | ^ 2024-09-19T09:40:13.877 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T09:40:13.877 INFO:tasks.workunit.client.0.smithi001.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T09:40:13.878 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~ 2024-09-19T09:40:13.878 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T09:40:13.878 INFO:tasks.workunit.client.0.smithi001.stderr: 36 | container_of(ptr, type, member) 2024-09-19T09:40:13.878 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~~~~~ 2024-09-19T09:40:13.878 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-19T09:40:13.878 INFO:tasks.workunit.client.0.smithi001.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-19T09:40:13.878 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~~~ 2024-09-19T09:40:13.878 INFO:tasks.workunit.client.0.smithi001.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T09:40:13.878 INFO:tasks.workunit.client.0.smithi001.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-19T09:40:13.878 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T09:40:13.878 INFO:tasks.workunit.client.0.smithi001.stderr:parser.c: In function ‘init_tg_stats’: 2024-09-19T09:40:13.878 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T09:40:13.878 INFO:tasks.workunit.client.0.smithi001.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T09:40:13.878 INFO:tasks.workunit.client.0.smithi001.stderr: | ^ 2024-09-19T09:40:13.879 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T09:40:13.879 INFO:tasks.workunit.client.0.smithi001.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T09:40:13.879 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~ 2024-09-19T09:40:13.879 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T09:40:13.879 INFO:tasks.workunit.client.0.smithi001.stderr: 36 | container_of(ptr, type, member) 2024-09-19T09:40:13.879 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~~~~~ 2024-09-19T09:40:13.879 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-19T09:40:13.879 INFO:tasks.workunit.client.0.smithi001.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-19T09:40:13.879 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~~~ 2024-09-19T09:40:13.879 INFO:tasks.workunit.client.0.smithi001.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T09:40:13.879 INFO:tasks.workunit.client.0.smithi001.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-19T09:40:13.879 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T09:40:13.879 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T09:40:13.879 INFO:tasks.workunit.client.0.smithi001.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T09:40:13.879 INFO:tasks.workunit.client.0.smithi001.stderr: | ^ 2024-09-19T09:40:13.880 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T09:40:13.880 INFO:tasks.workunit.client.0.smithi001.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T09:40:13.880 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~ 2024-09-19T09:40:13.880 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T09:40:13.880 INFO:tasks.workunit.client.0.smithi001.stderr: 36 | container_of(ptr, type, member) 2024-09-19T09:40:13.880 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~~~~~ 2024-09-19T09:40:13.880 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-19T09:40:13.880 INFO:tasks.workunit.client.0.smithi001.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-19T09:40:13.880 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~~~ 2024-09-19T09:40:13.880 INFO:tasks.workunit.client.0.smithi001.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T09:40:13.880 INFO:tasks.workunit.client.0.smithi001.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-19T09:40:13.880 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T09:40:13.880 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T09:40:13.881 INFO:tasks.workunit.client.0.smithi001.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T09:40:13.881 INFO:tasks.workunit.client.0.smithi001.stderr: | ^ 2024-09-19T09:40:13.881 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T09:40:13.881 INFO:tasks.workunit.client.0.smithi001.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T09:40:13.881 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~ 2024-09-19T09:40:13.881 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T09:40:13.881 INFO:tasks.workunit.client.0.smithi001.stderr: 36 | container_of(ptr, type, member) 2024-09-19T09:40:13.881 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~~~~~ 2024-09-19T09:40:13.881 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-19T09:40:13.881 INFO:tasks.workunit.client.0.smithi001.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-19T09:40:13.882 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~~~ 2024-09-19T09:40:13.882 INFO:tasks.workunit.client.0.smithi001.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T09:40:13.882 INFO:tasks.workunit.client.0.smithi001.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-19T09:40:13.882 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T09:40:13.882 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-19T09:40:13.882 INFO:tasks.workunit.client.0.smithi001.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-19T09:40:13.882 INFO:tasks.workunit.client.0.smithi001.stderr: | ^ 2024-09-19T09:40:13.882 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-19T09:40:13.882 INFO:tasks.workunit.client.0.smithi001.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-19T09:40:13.882 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~ 2024-09-19T09:40:13.882 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-19T09:40:13.882 INFO:tasks.workunit.client.0.smithi001.stderr: 36 | container_of(ptr, type, member) 2024-09-19T09:40:13.882 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~~~~~ 2024-09-19T09:40:13.882 INFO:tasks.workunit.client.0.smithi001.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-19T09:40:13.883 INFO:tasks.workunit.client.0.smithi001.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-19T09:40:13.883 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~~~ 2024-09-19T09:40:13.883 INFO:tasks.workunit.client.0.smithi001.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-19T09:40:13.883 INFO:tasks.workunit.client.0.smithi001.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-19T09:40:13.883 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T09:40:13.921 INFO:tasks.workunit.client.0.smithi001.stderr:parser.c: In function ‘get_optstr’: 2024-09-19T09:40:13.921 INFO:tasks.workunit.client.0.smithi001.stderr:parser.c:206:23: warning: ‘strnlen’ specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-09-19T09:40:13.921 INFO:tasks.workunit.client.0.smithi001.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-09-19T09:40:13.921 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-19T09:40:13.921 INFO:tasks.workunit.client.0.smithi001.stderr:parser.c:200:14: note: source object declared here 2024-09-19T09:40:13.921 INFO:tasks.workunit.client.0.smithi001.stderr: 200 | char temp[BUFSIZE]; 2024-09-19T09:40:13.922 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~ 2024-09-19T09:40:13.928 INFO:tasks.workunit.client.0.smithi001.stderr:parser.c: In function ‘size64_convert’: 2024-09-19T09:40:13.928 INFO:tasks.workunit.client.0.smithi001.stderr:parser.c:119:9: warning: ‘memcpy’ reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-09-19T09:40:13.928 INFO:tasks.workunit.client.0.smithi001.stderr: 119 | memcpy(unit, "\0", 3); 2024-09-19T09:40:13.928 INFO:tasks.workunit.client.0.smithi001.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-09-19T09:40:14.051 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:14.247 INFO:tasks.workunit.client.0.smithi001.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-09-19T09:40:14.249 INFO:tasks.workunit.client.0.smithi001.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-09-19T09:40:14.308 INFO:tasks.workunit.client.0.smithi001.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-09-19T09:40:14.311 INFO:tasks.workunit.client.0.smithi001.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-09-19T09:40:14.402 INFO:tasks.workunit.client.0.smithi001.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-09-19T09:40:14.405 INFO:tasks.workunit.client.0.smithi001.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-09-19T09:40:14.436 INFO:tasks.workunit.client.0.smithi001.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-09-19T09:40:14.440 INFO:tasks.workunit.client.0.smithi001.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-09-19T09:40:14.448 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:14 smithi001 ceph-mon[31225]: pgmap v402: 97 pgs: 97 active+clean; 5.2 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 149 KiB/s wr, 44 op/s 2024-09-19T09:40:14.474 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-19T09:40:14.475 INFO:tasks.workunit.client.0.smithi001.stderr:+ cd .. 2024-09-19T09:40:14.475 INFO:tasks.workunit.client.0.smithi001.stderr:+ mkdir tmp 2024-09-19T09:40:14.477 INFO:tasks.workunit.client.0.smithi001.stderr:+ cd tmp 2024-09-19T09:40:14.477 INFO:tasks.workunit.client.0.smithi001.stderr:+ for f in $mydir/*.ffsb 2024-09-19T09:40:14.477 INFO:tasks.workunit.client.0.smithi001.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/random_write.32.ffsb 2024-09-19T09:40:14.477 INFO:tasks.workunit.client.0.smithi001.stdout:FFSB version 6.0-RC2 started 2024-09-19T09:40:14.477 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-09-19T09:40:14.480 INFO:tasks.workunit.client.0.smithi001.stdout:benchmark time = 300 2024-09-19T09:40:14.480 INFO:tasks.workunit.client.0.smithi001.stdout:ThreadGroup 0 2024-09-19T09:40:14.480 INFO:tasks.workunit.client.0.smithi001.stdout:================ 2024-09-19T09:40:14.481 INFO:tasks.workunit.client.0.smithi001.stdout: num_threads = 32 2024-09-19T09:40:14.481 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-09-19T09:40:14.481 INFO:tasks.workunit.client.0.smithi001.stdout: read_random = off 2024-09-19T09:40:14.481 INFO:tasks.workunit.client.0.smithi001.stdout: read_size = 0 (0B) 2024-09-19T09:40:14.481 INFO:tasks.workunit.client.0.smithi001.stdout: read_blocksize = 0 (0B) 2024-09-19T09:40:14.481 INFO:tasks.workunit.client.0.smithi001.stdout: read_skip = off 2024-09-19T09:40:14.481 INFO:tasks.workunit.client.0.smithi001.stdout: read_skipsize = 0 (0B) 2024-09-19T09:40:14.481 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-09-19T09:40:14.481 INFO:tasks.workunit.client.0.smithi001.stdout: write_random = on 2024-09-19T09:40:14.481 INFO:tasks.workunit.client.0.smithi001.stdout: write_size = 5242880 (5MB) 2024-09-19T09:40:14.481 INFO:tasks.workunit.client.0.smithi001.stdout: fsync_file = 0 2024-09-19T09:40:14.481 INFO:tasks.workunit.client.0.smithi001.stdout: write_blocksize = 4096 (4KB) 2024-09-19T09:40:14.481 INFO:tasks.workunit.client.0.smithi001.stdout: wait time = 0 2024-09-19T09:40:14.481 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-09-19T09:40:14.482 INFO:tasks.workunit.client.0.smithi001.stdout: op weights 2024-09-19T09:40:14.482 INFO:tasks.workunit.client.0.smithi001.stdout: read = 0 (0.00%) 2024-09-19T09:40:14.482 INFO:tasks.workunit.client.0.smithi001.stdout: readall = 0 (0.00%) 2024-09-19T09:40:14.482 INFO:tasks.workunit.client.0.smithi001.stdout: write = 1 (100.00%) 2024-09-19T09:40:14.482 INFO:tasks.workunit.client.0.smithi001.stdout: create = 0 (0.00%) 2024-09-19T09:40:14.482 INFO:tasks.workunit.client.0.smithi001.stdout: append = 0 (0.00%) 2024-09-19T09:40:14.482 INFO:tasks.workunit.client.0.smithi001.stdout: delete = 0 (0.00%) 2024-09-19T09:40:14.482 INFO:tasks.workunit.client.0.smithi001.stdout: metaop = 0 (0.00%) 2024-09-19T09:40:14.482 INFO:tasks.workunit.client.0.smithi001.stdout: createdir = 0 (0.00%) 2024-09-19T09:40:14.482 INFO:tasks.workunit.client.0.smithi001.stdout: stat = 0 (0.00%) 2024-09-19T09:40:14.482 INFO:tasks.workunit.client.0.smithi001.stdout: writeall = 0 (0.00%) 2024-09-19T09:40:14.482 INFO:tasks.workunit.client.0.smithi001.stdout: writeall_fsync = 0 (0.00%) 2024-09-19T09:40:14.482 INFO:tasks.workunit.client.0.smithi001.stdout: open_close = 0 (0.00%) 2024-09-19T09:40:14.482 INFO:tasks.workunit.client.0.smithi001.stdout: write_fsync = 0 (0.00%) 2024-09-19T09:40:14.483 INFO:tasks.workunit.client.0.smithi001.stdout: create_fsync = 0 (0.00%) 2024-09-19T09:40:14.483 INFO:tasks.workunit.client.0.smithi001.stdout: append_fsync = 0 (0.00%) 2024-09-19T09:40:14.483 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-09-19T09:40:14.483 INFO:tasks.workunit.client.0.smithi001.stdout:FileSystem . 2024-09-19T09:40:14.483 INFO:tasks.workunit.client.0.smithi001.stdout:========== 2024-09-19T09:40:14.483 INFO:tasks.workunit.client.0.smithi001.stdout: num_dirs = 0 2024-09-19T09:40:14.483 INFO:tasks.workunit.client.0.smithi001.stdout: starting files = 128 2024-09-19T09:40:14.483 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-09-19T09:40:14.483 INFO:tasks.workunit.client.0.smithi001.stdout: min file size = 104857600 (100MB) 2024-09-19T09:40:14.483 INFO:tasks.workunit.client.0.smithi001.stdout: max file size = 104857600 (100MB) 2024-09-19T09:40:14.483 INFO:tasks.workunit.client.0.smithi001.stdout: directio = off 2024-09-19T09:40:14.483 INFO:tasks.workunit.client.0.smithi001.stdout: alignedio = on 2024-09-19T09:40:14.483 INFO:tasks.workunit.client.0.smithi001.stdout: bufferedio = off 2024-09-19T09:40:14.483 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-09-19T09:40:14.484 INFO:tasks.workunit.client.0.smithi001.stdout: aging is off 2024-09-19T09:40:14.484 INFO:tasks.workunit.client.0.smithi001.stdout: current utilization = 0.00% 2024-09-19T09:40:14.484 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-09-19T09:40:14.484 INFO:tasks.workunit.client.0.smithi001.stdout:checking existing fs: . 2024-09-19T09:40:14.484 INFO:tasks.workunit.client.0.smithi001.stdout:recreating new fileset 2024-09-19T09:40:14.484 INFO:tasks.workunit.client.0.smithi001.stderr:opendir: No such file or directory 2024-09-19T09:40:14.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.534+0000 7f916efc1640 1 -- 172.21.15.1:0/3753720941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9168102570 msgr2=0x7f91681029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:14.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.534+0000 7f916efc1640 1 --2- 172.21.15.1:0/3753720941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9168102570 0x7f91681029b0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9154009900 tx=0x7f915402a480 comp rx=0 tx=0).stop 2024-09-19T09:40:14.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.534+0000 7f916efc1640 1 -- 172.21.15.1:0/3753720941 shutdown_connections 2024-09-19T09:40:14.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.534+0000 7f916efc1640 1 --2- 172.21.15.1:0/3753720941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9168102ef0 0x7f916810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.534+0000 7f916efc1640 1 --2- 172.21.15.1:0/3753720941 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9168102570 0x7f91681029b0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.534+0000 7f916efc1640 1 --2- 172.21.15.1:0/3753720941 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9168100e20 0x7f9168101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.534+0000 7f916efc1640 1 -- 172.21.15.1:0/3753720941 >> 172.21.15.1:0/3753720941 conn(0x7f91680fc7d0 msgr2=0x7f91680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:14.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.534+0000 7f916efc1640 1 -- 172.21.15.1:0/3753720941 shutdown_connections 2024-09-19T09:40:14.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.534+0000 7f916efc1640 1 -- 172.21.15.1:0/3753720941 wait complete. 2024-09-19T09:40:14.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.535+0000 7f916efc1640 1 Processor -- start 2024-09-19T09:40:14.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.535+0000 7f916efc1640 1 -- start start 2024-09-19T09:40:14.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.535+0000 7f916efc1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9168100e20 0x7f91680fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:14.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.535+0000 7f916efc1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9168102570 0x7f91680fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:14.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.535+0000 7f916efc1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9168102ef0 0x7f91680fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:14.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.535+0000 7f916efc1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9168110f80 con 0x7f9168100e20 2024-09-19T09:40:14.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.535+0000 7f916efc1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9168110e00 con 0x7f9168102570 2024-09-19T09:40:14.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.535+0000 7f916efc1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9168111100 con 0x7f9168102ef0 2024-09-19T09:40:14.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.535+0000 7f916cd5d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9168100e20 0x7f91680fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:14.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.536+0000 7f916cd5d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9168100e20 0x7f91680fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40492/0 (socket says 172.21.15.1:40492) 2024-09-19T09:40:14.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.536+0000 7f916cd5d640 1 -- 172.21.15.1:0/1194376355 learned_addr learned my addr 172.21.15.1:0/1194376355 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:14.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.536+0000 7f9167fff640 1 --2- 172.21.15.1:0/1194376355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9168102570 0x7f91680fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:14.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.536+0000 7f916d55e640 1 --2- 172.21.15.1:0/1194376355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9168102ef0 0x7f91680fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:14.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.536+0000 7f916cd5d640 1 -- 172.21.15.1:0/1194376355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9168102ef0 msgr2=0x7f91680fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:14.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.536+0000 7f916cd5d640 1 --2- 172.21.15.1:0/1194376355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9168102ef0 0x7f91680fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.536+0000 7f916cd5d640 1 -- 172.21.15.1:0/1194376355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9168102570 msgr2=0x7f91680fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:14.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.536+0000 7f916cd5d640 1 --2- 172.21.15.1:0/1194376355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9168102570 0x7f91680fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.536+0000 7f916cd5d640 1 -- 172.21.15.1:0/1194376355 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91681a6a10 con 0x7f9168100e20 2024-09-19T09:40:14.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.536+0000 7f916cd5d640 1 --2- 172.21.15.1:0/1194376355 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9168100e20 0x7f91680fcc80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f915c00d950 tx=0x7f915c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:14.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.536+0000 7f9165ffb640 1 -- 172.21.15.1:0/1194376355 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915c017070 con 0x7f9168100e20 2024-09-19T09:40:14.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.536+0000 7f916efc1640 1 -- 172.21.15.1:0/1194376355 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91681a6d00 con 0x7f9168100e20 2024-09-19T09:40:14.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.536+0000 7f9165ffb640 1 -- 172.21.15.1:0/1194376355 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f915c009c30 con 0x7f9168100e20 2024-09-19T09:40:14.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.536+0000 7f9165ffb640 1 -- 172.21.15.1:0/1194376355 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915c00f6b0 con 0x7f9168100e20 2024-09-19T09:40:14.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.537+0000 7f916efc1640 1 -- 172.21.15.1:0/1194376355 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91681a71c0 con 0x7f9168100e20 2024-09-19T09:40:14.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.539+0000 7f9165ffb640 1 -- 172.21.15.1:0/1194376355 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f915c0109d0 con 0x7f9168100e20 2024-09-19T09:40:14.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.539+0000 7f917139a740 1 Processor -- start 2024-09-19T09:40:14.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.539+0000 7f917139a740 1 -- start start 2024-09-19T09:40:14.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.539+0000 7f917139a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7f92674a0 0x55d7f9267880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:14.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.540+0000 7f917139a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d7f9267dc0 0x55d7f9272140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:14.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.540+0000 7f917139a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d7f9272680 0x55d7f9274a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:14.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.540+0000 7f917139a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d7f91cd2e0 con 0x55d7f9267dc0 2024-09-19T09:40:14.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.540+0000 7f917139a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d7f9174ce0 con 0x55d7f9272680 2024-09-19T09:40:14.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.540+0000 7f917139a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d7f91c92a0 con 0x55d7f92674a0 2024-09-19T09:40:14.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.540+0000 7f916cd5d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d7f9267dc0 0x55d7f9272140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:14.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.540+0000 7f916d55e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7f92674a0 0x55d7f9267880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:14.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.540+0000 7f9165ffb640 1 --2- 172.21.15.1:0/1194376355 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f91580a3240 0x7f91580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:14.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.540+0000 7f916d55e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7f92674a0 0x55d7f9267880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:53820/0 (socket says 172.21.15.1:53820) 2024-09-19T09:40:14.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.540+0000 7f916d55e640 1 -- 172.21.15.1:0/2634475800 learned_addr learned my addr 172.21.15.1:0/2634475800 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:14.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.540+0000 7f9167fff640 1 --2- 172.21.15.1:0/2634475800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d7f9272680 0x55d7f9274a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:14.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.540+0000 7f916d55e640 1 --2- 172.21.15.1:0/1194376355 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f91580a3240 0x7f91580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:14.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.540+0000 7f9165ffb640 1 -- 172.21.15.1:0/1194376355 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f915c0cf560 con 0x7f9168100e20 2024-09-19T09:40:14.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.540+0000 7f9167fff640 1 -- 172.21.15.1:0/2634475800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7f92674a0 msgr2=0x55d7f9267880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:14.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.540+0000 7f9167fff640 1 --2- 172.21.15.1:0/2634475800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7f92674a0 0x55d7f9267880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.540+0000 7f9167fff640 1 -- 172.21.15.1:0/2634475800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d7f9267dc0 msgr2=0x55d7f9272140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:14.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.540+0000 7f9167fff640 1 --2- 172.21.15.1:0/2634475800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d7f9267dc0 0x55d7f9272140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.540+0000 7f9167fff640 1 -- 172.21.15.1:0/2634475800 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7f9159440 con 0x55d7f9272680 2024-09-19T09:40:14.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.540+0000 7f916cd5d640 1 --2- 172.21.15.1:0/2634475800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d7f9267dc0 0x55d7f9272140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:40:14.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.541+0000 7f9167fff640 1 --2- 172.21.15.1:0/2634475800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d7f9272680 0x55d7f9274a70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9154005940 tx=0x7f91540040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a959449c21ec63fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:14.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.541+0000 7f916d55e640 1 --2- 172.21.15.1:0/1194376355 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f91580a3240 0x7f91580a5700 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9160013b50 tx=0x7f9160009940 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:14.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.541+0000 7f9152ffd640 1 -- 172.21.15.1:0/2634475800 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9154035030 con 0x55d7f9272680 2024-09-19T09:40:14.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.541+0000 7f9152ffd640 1 -- 172.21.15.1:0/2634475800 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9154040070 con 0x55d7f9272680 2024-09-19T09:40:14.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.541+0000 7f9152ffd640 1 -- 172.21.15.1:0/2634475800 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9154004e40 con 0x55d7f9272680 2024-09-19T09:40:14.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.541+0000 7f917139a740 1 -- 172.21.15.1:0/2634475800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d7f9272680 msgr2=0x55d7f9274a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:14.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.541+0000 7f917139a740 1 --2- 172.21.15.1:0/2634475800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d7f9272680 0x55d7f9274a70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9154005940 tx=0x7f91540040c0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.542+0000 7f917139a740 1 -- 172.21.15.1:0/2634475800 shutdown_connections 2024-09-19T09:40:14.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.542+0000 7f917139a740 1 --2- 172.21.15.1:0/2634475800 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d7f9272680 0x55d7f9274a70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.542+0000 7f917139a740 1 --2- 172.21.15.1:0/2634475800 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d7f9267dc0 0x55d7f9272140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.542+0000 7f917139a740 1 --2- 172.21.15.1:0/2634475800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7f92674a0 0x55d7f9267880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.542+0000 7f917139a740 1 -- 172.21.15.1:0/2634475800 >> 172.21.15.1:0/2634475800 conn(0x55d7f9263a30 msgr2=0x55d7f9263e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:14.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.542+0000 7f917139a740 1 -- 172.21.15.1:0/2634475800 shutdown_connections 2024-09-19T09:40:14.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.542+0000 7f917139a740 1 -- 172.21.15.1:0/2634475800 wait complete. 2024-09-19T09:40:14.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.542+0000 7f917139a740 1 -- start start 2024-09-19T09:40:14.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.542+0000 7f917139a740 1 Processor -- start 2024-09-19T09:40:14.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.542+0000 7f917139a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7f92674a0 0x55d7f9271f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:14.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.542+0000 7f917139a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d7f9267dc0 0x55d7f926f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:14.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.542+0000 7f917139a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d7f9272680 0x55d7f926f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:14.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.542+0000 7f917139a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d7f9275250 con 0x55d7f9272680 2024-09-19T09:40:14.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.543+0000 7f917139a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d7f9188050 con 0x55d7f9267dc0 2024-09-19T09:40:14.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.543+0000 7f917139a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d7f92753d0 con 0x55d7f92674a0 2024-09-19T09:40:14.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.543+0000 7f917139a740 10 client.0 _ll_register_callbacks cb 0x55d7f91c8160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:14.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.543+0000 7f916d55e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d7f9272680 0x55d7f926f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:14.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.543+0000 7f916d55e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d7f9272680 0x55d7f926f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40498/0 (socket says 172.21.15.1:40498) 2024-09-19T09:40:14.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.543+0000 7f9167fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d7f9267dc0 0x55d7f926f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:14.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.543+0000 7f916d55e640 1 -- 172.21.15.1:0/874459536 learned_addr learned my addr 172.21.15.1:0/874459536 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:14.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.543+0000 7f916cd5d640 1 --2- 172.21.15.1:0/874459536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7f92674a0 0x55d7f9271f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:14.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.543+0000 7f9167fff640 1 -- 172.21.15.1:0/874459536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7f92674a0 msgr2=0x55d7f9271f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:14.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.543+0000 7f9167fff640 1 --2- 172.21.15.1:0/874459536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7f92674a0 0x55d7f9271f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.543+0000 7f9167fff640 1 -- 172.21.15.1:0/874459536 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d7f9272680 msgr2=0x55d7f926f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:14.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.543+0000 7f9167fff640 1 --2- 172.21.15.1:0/874459536 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d7f9272680 0x55d7f926f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.543+0000 7f9167fff640 1 -- 172.21.15.1:0/874459536 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7f8f3e3c0 con 0x55d7f9267dc0 2024-09-19T09:40:14.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.543+0000 7f916d55e640 1 --2- 172.21.15.1:0/874459536 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d7f9272680 0x55d7f926f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:40:14.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.543+0000 7f9167fff640 1 --2- 172.21.15.1:0/874459536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d7f9267dc0 0x55d7f926f220 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f91540314e0 tx=0x7f915402a480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=130275a640ea8ac8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:14.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.543+0000 7f9147fff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:40:14.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.543+0000 7f9147fff640 1 -- 172.21.15.1:0/874459536 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9154052060 con 0x55d7f9267dc0 2024-09-19T09:40:14.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.543+0000 7f917139a740 1 -- 172.21.15.1:0/874459536 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9154040070 con 0x55d7f9267dc0 2024-09-19T09:40:14.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.543+0000 7f9147fff640 1 -- 172.21.15.1:0/874459536 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f9154004da0 con 0x55d7f9267dc0 2024-09-19T09:40:14.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.544+0000 7f9147fff640 1 -- 172.21.15.1:0/874459536 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9154035050 con 0x55d7f9267dc0 2024-09-19T09:40:14.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.544+0000 7f917139a740 10 client.25421 fetch_fsmap learned FSMap version 19 2024-09-19T09:40:14.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.544+0000 7f917139a740 1 -- 172.21.15.1:0/874459536 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d7f9280bc0 con 0x55d7f9267dc0 2024-09-19T09:40:14.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.544+0000 7f9147fff640 1 -- 172.21.15.1:0/874459536 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9154040070 con 0x55d7f9267dc0 2024-09-19T09:40:14.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.544+0000 7f9147fff640 1 -- 172.21.15.1:0/874459536 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f9154057070 con 0x55d7f9267dc0 2024-09-19T09:40:14.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.544+0000 7f917139a740 10 client.25421 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:40:14.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.544+0000 7f917139a740 10 client.25421 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:14.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.544+0000 7f917139a740 20 client.25421 populate_metadata read hostname 'smithi001' 2024-09-19T09:40:14.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.544+0000 7f917139a740 1 --2- 172.21.15.1:0/874459536 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d7f9281f10 0x55d7f9284300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:14.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.544+0000 7f917139a740 4 client.25421 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:14.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.544+0000 7f917139a740 1 -- 172.21.15.1:0/874459536 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7f91da850 con 0x55d7f9281f10 2024-09-19T09:40:14.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.544+0000 7f916cd5d640 1 --2- 172.21.15.1:0/874459536 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d7f9281f10 0x55d7f9284300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:14.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.545+0000 7f916cd5d640 1 --2- 172.21.15.1:0/874459536 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d7f9281f10 0x55d7f9284300 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abdcb1f39cddc85d server_cookie=c8890e8b9a12f503 in_seq=0 out_seq=0 2024-09-19T09:40:14.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.545+0000 7f9147fff640 10 client.25421 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:14.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.545+0000 7f9147fff640 1 -- 172.21.15.1:0/874459536 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d7f91da850 con 0x55d7f9281f10 2024-09-19T09:40:14.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.545+0000 7f9147fff640 10 client.25421 handle_command_reply: tid=0 2024-09-19T09:40:14.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.545+0000 7f917139a740 1 client.25421 shutdown 2024-09-19T09:40:14.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.545+0000 7f917139a740 1 -- 172.21.15.1:0/874459536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d7f9267dc0 msgr2=0x55d7f926f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:14.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.545+0000 7f917139a740 1 --2- 172.21.15.1:0/874459536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d7f9267dc0 0x55d7f926f220 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f91540314e0 tx=0x7f915402a480 comp rx=0 tx=0).stop 2024-09-19T09:40:14.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.546+0000 7f917139a740 1 -- 172.21.15.1:0/874459536 shutdown_connections 2024-09-19T09:40:14.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.546+0000 7f917139a740 1 --2- 172.21.15.1:0/874459536 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d7f9281f10 0x55d7f9284300 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.546+0000 7f917139a740 1 --2- 172.21.15.1:0/874459536 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d7f9272680 0x55d7f926f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.546+0000 7f9147fff640 0 client.25421 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:14.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.546+0000 7f917139a740 1 --2- 172.21.15.1:0/874459536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d7f9267dc0 0x55d7f926f220 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.546+0000 7f917139a740 1 --2- 172.21.15.1:0/874459536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7f92674a0 0x55d7f9271f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.546+0000 7f917139a740 1 -- 172.21.15.1:0/874459536 >> 172.21.15.1:0/874459536 conn(0x55d7f9263a30 msgr2=0x55d7f9269760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:14.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.546+0000 7f917139a740 1 -- 172.21.15.1:0/874459536 shutdown_connections 2024-09-19T09:40:14.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.546+0000 7f917139a740 1 -- 172.21.15.1:0/874459536 wait complete. 2024-09-19T09:40:14.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.546+0000 7f917139a740 20 client.25421 trim_cache size 0 max 16384 2024-09-19T09:40:14.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.581+0000 7f917139a740 1 Processor -- start 2024-09-19T09:40:14.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.582+0000 7f917139a740 1 -- start start 2024-09-19T09:40:14.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.582+0000 7f917139a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d7f92674a0 0x55d7f927e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:14.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.582+0000 7f917139a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d7f9267dc0 0x55d7f926a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:14.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.582+0000 7f917139a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7f9272680 0x55d7f926e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:14.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.582+0000 7f917139a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f91681ad6d0 con 0x55d7f92674a0 2024-09-19T09:40:14.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.582+0000 7f917139a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f91681aff70 con 0x55d7f9267dc0 2024-09-19T09:40:14.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.582+0000 7f917139a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f91681add60 con 0x55d7f9272680 2024-09-19T09:40:14.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.582+0000 7f916cd5d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d7f92674a0 0x55d7f927e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:14.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.582+0000 7f9167fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d7f9267dc0 0x55d7f926a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:14.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.582+0000 7f916cd5d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d7f92674a0 0x55d7f927e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40504/0 (socket says 172.21.15.1:40504) 2024-09-19T09:40:14.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.582+0000 7f916cd5d640 1 -- 172.21.15.1:0/1958864427 learned_addr learned my addr 172.21.15.1:0/1958864427 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:14.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.582+0000 7f9167fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d7f9267dc0 0x55d7f926a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:60044/0 (socket says 172.21.15.1:60044) 2024-09-19T09:40:14.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.582+0000 7f916d55e640 1 --2- 172.21.15.1:0/1958864427 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7f9272680 0x55d7f926e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:14.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.582+0000 7f916cd5d640 1 -- 172.21.15.1:0/1958864427 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7f9272680 msgr2=0x55d7f926e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:14.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.582+0000 7f916cd5d640 1 --2- 172.21.15.1:0/1958864427 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7f9272680 0x55d7f926e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.582+0000 7f916cd5d640 1 -- 172.21.15.1:0/1958864427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d7f9267dc0 msgr2=0x55d7f926a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:14.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.582+0000 7f916cd5d640 1 --2- 172.21.15.1:0/1958864427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d7f9267dc0 0x55d7f926a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.582+0000 7f916cd5d640 1 -- 172.21.15.1:0/1958864427 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7f926d770 con 0x55d7f92674a0 2024-09-19T09:40:14.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.583+0000 7f916cd5d640 1 --2- 172.21.15.1:0/1958864427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d7f92674a0 0x55d7f927e4b0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f915c09b880 tx=0x7f915c086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13dacb703359b60a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:14.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.583+0000 7f91527fc640 1 -- 172.21.15.1:0/1958864427 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915c020040 con 0x55d7f92674a0 2024-09-19T09:40:14.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.583+0000 7f91527fc640 1 -- 172.21.15.1:0/1958864427 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f915c09bb80 con 0x55d7f92674a0 2024-09-19T09:40:14.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.583+0000 7f91527fc640 1 -- 172.21.15.1:0/1958864427 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915c0cf0e0 con 0x55d7f92674a0 2024-09-19T09:40:14.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.584+0000 7f917139a740 1 -- 172.21.15.1:0/1958864427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d7f92674a0 msgr2=0x55d7f927e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:14.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.584+0000 7f917139a740 1 --2- 172.21.15.1:0/1958864427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d7f92674a0 0x55d7f927e4b0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f915c09b880 tx=0x7f915c086040 comp rx=0 tx=0).stop 2024-09-19T09:40:14.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.584+0000 7f917139a740 1 -- 172.21.15.1:0/1958864427 shutdown_connections 2024-09-19T09:40:14.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.584+0000 7f917139a740 1 --2- 172.21.15.1:0/1958864427 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7f9272680 0x55d7f926e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.584+0000 7f917139a740 1 --2- 172.21.15.1:0/1958864427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d7f9267dc0 0x55d7f926a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.584+0000 7f917139a740 1 --2- 172.21.15.1:0/1958864427 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d7f92674a0 0x55d7f927e4b0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.584+0000 7f917139a740 1 -- 172.21.15.1:0/1958864427 >> 172.21.15.1:0/1958864427 conn(0x55d7f9263a30 msgr2=0x55d7f926daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:14.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.584+0000 7f917139a740 1 -- 172.21.15.1:0/1958864427 shutdown_connections 2024-09-19T09:40:14.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.584+0000 7f917139a740 1 -- 172.21.15.1:0/1958864427 wait complete. 2024-09-19T09:40:14.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.584+0000 7f917139a740 1 -- start start 2024-09-19T09:40:14.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.584+0000 7f917139a740 1 Processor -- start 2024-09-19T09:40:14.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.584+0000 7f917139a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d7f92674a0 0x55d7f927aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:14.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.584+0000 7f917139a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d7f9267dc0 0x55d7f9275ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:14.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.584+0000 7f917139a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7f9272680 0x55d7f9276410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:14.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.584+0000 7f917139a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f91681ae430 con 0x55d7f92674a0 2024-09-19T09:40:14.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.584+0000 7f917139a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f91681af8a0 con 0x55d7f9267dc0 2024-09-19T09:40:14.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.584+0000 7f917139a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f91681aeb00 con 0x55d7f9272680 2024-09-19T09:40:14.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.584+0000 7f917139a740 10 client.0 _ll_register_callbacks cb 0x7f915c09b950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:14.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.585+0000 7f916cd5d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d7f92674a0 0x55d7f927aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:14.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.585+0000 7f9167fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d7f9267dc0 0x55d7f9275ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:14.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.585+0000 7f916cd5d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d7f92674a0 0x55d7f927aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40518/0 (socket says 172.21.15.1:40518) 2024-09-19T09:40:14.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.585+0000 7f916cd5d640 1 -- 172.21.15.1:0/355718457 learned_addr learned my addr 172.21.15.1:0/355718457 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:14.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.585+0000 7f916d55e640 1 --2- 172.21.15.1:0/355718457 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7f9272680 0x55d7f9276410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:14.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.585+0000 7f9167fff640 1 -- 172.21.15.1:0/355718457 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7f9272680 msgr2=0x55d7f9276410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:14.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.585+0000 7f9167fff640 1 --2- 172.21.15.1:0/355718457 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7f9272680 0x55d7f9276410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.585+0000 7f9167fff640 1 -- 172.21.15.1:0/355718457 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d7f92674a0 msgr2=0x55d7f927aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:14.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.585+0000 7f9167fff640 1 --2- 172.21.15.1:0/355718457 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d7f92674a0 0x55d7f927aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.585+0000 7f9167fff640 1 -- 172.21.15.1:0/355718457 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7f9276a50 con 0x55d7f9267dc0 2024-09-19T09:40:14.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.585+0000 7f916cd5d640 1 --2- 172.21.15.1:0/355718457 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d7f92674a0 0x55d7f927aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:40:14.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.585+0000 7f9167fff640 1 --2- 172.21.15.1:0/355718457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d7f9267dc0 0x55d7f9275ed0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x55d7f92707d0 tx=0x7f9154004000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41ad386f1ff4670d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:14.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.585+0000 7f9147fff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:40:14.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.585+0000 7f9147fff640 1 -- 172.21.15.1:0/355718457 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915405d020 con 0x55d7f9267dc0 2024-09-19T09:40:14.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.585+0000 7f9147fff640 1 -- 172.21.15.1:0/355718457 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f9154031a20 con 0x55d7f9267dc0 2024-09-19T09:40:14.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.585+0000 7f917139a740 1 -- 172.21.15.1:0/355718457 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f915c09bb80 con 0x55d7f9267dc0 2024-09-19T09:40:14.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.585+0000 7f9147fff640 1 -- 172.21.15.1:0/355718457 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9154052040 con 0x55d7f9267dc0 2024-09-19T09:40:14.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.586+0000 7f917139a740 10 client.25427 fetch_fsmap learned FSMap version 19 2024-09-19T09:40:14.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.586+0000 7f917139a740 1 -- 172.21.15.1:0/355718457 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d7f92ec710 con 0x55d7f9267dc0 2024-09-19T09:40:14.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.586+0000 7f9147fff640 1 -- 172.21.15.1:0/355718457 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f915c09bb80 con 0x55d7f9267dc0 2024-09-19T09:40:14.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.586+0000 7f9147fff640 1 -- 172.21.15.1:0/355718457 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f9154057070 con 0x55d7f9267dc0 2024-09-19T09:40:14.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.586+0000 7f917139a740 10 client.25427 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:40:14.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.586+0000 7f917139a740 10 client.25427 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:14.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.586+0000 7f917139a740 20 client.25427 populate_metadata read hostname 'smithi001' 2024-09-19T09:40:14.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.586+0000 7f917139a740 1 --2- 172.21.15.1:0/355718457 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d7f92ecda0 0x55d7f92ef1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:14.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.586+0000 7f917139a740 4 client.25427 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:40:14.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.586+0000 7f917139a740 1 -- 172.21.15.1:0/355718457 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d7f91d4d60 con 0x55d7f92ecda0 2024-09-19T09:40:14.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.586+0000 7f916cd5d640 1 --2- 172.21.15.1:0/355718457 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d7f92ecda0 0x55d7f92ef1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:14.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.586+0000 7f9147fff640 10 client.25427 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:14.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.586+0000 7f916cd5d640 1 --2- 172.21.15.1:0/355718457 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d7f92ecda0 0x55d7f92ef1c0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56601eb927832d52 server_cookie=82c87c24e57ce1be in_seq=0 out_seq=0 2024-09-19T09:40:14.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.587+0000 7f9147fff640 1 -- 172.21.15.1:0/355718457 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d7f91d4d60 con 0x55d7f92ecda0 2024-09-19T09:40:14.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.587+0000 7f9147fff640 10 client.25427 handle_command_reply: tid=0 2024-09-19T09:40:14.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.587+0000 7f917139a740 1 client.25427 shutdown 2024-09-19T09:40:14.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.587+0000 7f917139a740 1 -- 172.21.15.1:0/355718457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d7f9267dc0 msgr2=0x55d7f9275ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:14.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.587+0000 7f917139a740 1 --2- 172.21.15.1:0/355718457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d7f9267dc0 0x55d7f9275ed0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x55d7f92707d0 tx=0x7f9154004000 comp rx=0 tx=0).stop 2024-09-19T09:40:14.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.587+0000 7f917139a740 1 -- 172.21.15.1:0/355718457 shutdown_connections 2024-09-19T09:40:14.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.587+0000 7f917139a740 1 --2- 172.21.15.1:0/355718457 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d7f92ecda0 0x55d7f92ef1c0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.587+0000 7f917139a740 1 --2- 172.21.15.1:0/355718457 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7f9272680 0x55d7f9276410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.587+0000 7f917139a740 1 --2- 172.21.15.1:0/355718457 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d7f9267dc0 0x55d7f9275ed0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.587+0000 7f9147fff640 0 client.25427 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:14.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.587+0000 7f917139a740 1 --2- 172.21.15.1:0/355718457 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d7f92674a0 0x55d7f927aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.621 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:40:14.622 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:40:14.622 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": { 2024-09-19T09:40:14.622 INFO:teuthology.orchestra.run.smithi001.stdout: "17059385-e18d-4526-aeb4-133a1fdbd457": { 2024-09-19T09:40:14.622 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-19T09:40:14.622 INFO:teuthology.orchestra.run.smithi001.stdout: "tag": "17059385-e18d-4526-aeb4-133a1fdbd457", 2024-09-19T09:40:14.622 INFO:teuthology.orchestra.run.smithi001.stdout: "options": "recursive,force" 2024-09-19T09:40:14.622 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:40:14.622 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:40:14.622 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:40:14.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.587+0000 7f917139a740 1 -- 172.21.15.1:0/355718457 >> 172.21.15.1:0/355718457 conn(0x55d7f9263a30 msgr2=0x55d7f9262350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:14.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.587+0000 7f917139a740 1 -- 172.21.15.1:0/355718457 shutdown_connections 2024-09-19T09:40:14.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.587+0000 7f917139a740 1 -- 172.21.15.1:0/355718457 wait complete. 2024-09-19T09:40:14.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.587+0000 7f917139a740 20 client.25427 trim_cache size 0 max 16384 2024-09-19T09:40:14.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.588+0000 7f916efc1640 1 -- 172.21.15.1:0/1194376355 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f91580a3240 msgr2=0x7f91580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:14.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.588+0000 7f916efc1640 1 --2- 172.21.15.1:0/1194376355 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f91580a3240 0x7f91580a5700 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9160013b50 tx=0x7f9160009940 comp rx=0 tx=0).stop 2024-09-19T09:40:14.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.588+0000 7f916efc1640 1 -- 172.21.15.1:0/1194376355 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9168100e20 msgr2=0x7f91680fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:14.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.588+0000 7f916efc1640 1 --2- 172.21.15.1:0/1194376355 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9168100e20 0x7f91680fcc80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f915c00d950 tx=0x7f915c00de10 comp rx=0 tx=0).stop 2024-09-19T09:40:14.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.588+0000 7f916efc1640 1 -- 172.21.15.1:0/1194376355 shutdown_connections 2024-09-19T09:40:14.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.588+0000 7f916efc1640 1 --2- 172.21.15.1:0/1194376355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9168102ef0 0x7f91680fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.588+0000 7f916efc1640 1 --2- 172.21.15.1:0/1194376355 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f91580a3240 0x7f91580a5700 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.588+0000 7f916efc1640 1 --2- 172.21.15.1:0/1194376355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9168102570 0x7f91680fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.588+0000 7f916efc1640 1 --2- 172.21.15.1:0/1194376355 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9168100e20 0x7f91680fcc80 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:14.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.588+0000 7f916efc1640 1 -- 172.21.15.1:0/1194376355 >> 172.21.15.1:0/1194376355 conn(0x7f91680fc7d0 msgr2=0x7f916806a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:14.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.588+0000 7f916efc1640 1 -- 172.21.15.1:0/1194376355 shutdown_connections 2024-09-19T09:40:14.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:14.588+0000 7f916efc1640 1 -- 172.21.15.1:0/1194376355 wait complete. 2024-09-19T09:40:14.624 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:14 smithi121 ceph-mon[35577]: pgmap v402: 97 pgs: 97 active+clean; 5.2 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 149 KiB/s wr, 44 op/s 2024-09-19T09:40:14.624 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:14 smithi022 ceph-mon[35583]: pgmap v402: 97 pgs: 97 active+clean; 5.2 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 149 KiB/s wr, 44 op/s 2024-09-19T09:40:15.321 INFO:tasks.cephfs.filesystem:scrub status for tag:17059385-e18d-4526-aeb4-133a1fdbd457 - {'path': '/', 'tag': '17059385-e18d-4526-aeb4-133a1fdbd457', 'options': 'recursive,force'} 2024-09-19T09:40:15.418 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:15 smithi001 ceph-mon[31225]: pgmap v403: 97 pgs: 97 active+clean; 6.2 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 237 KiB/s wr, 54 op/s 2024-09-19T09:40:15.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:15 smithi022 ceph-mon[35583]: pgmap v403: 97 pgs: 97 active+clean; 6.2 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 237 KiB/s wr, 54 op/s 2024-09-19T09:40:15.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:15 smithi121 ceph-mon[35577]: pgmap v403: 97 pgs: 97 active+clean; 6.2 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 237 KiB/s wr, 54 op/s 2024-09-19T09:40:17.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:17 smithi022 ceph-mon[35583]: pgmap v404: 97 pgs: 97 active+clean; 6.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 242 KiB/s wr, 70 op/s 2024-09-19T09:40:17.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:17 smithi121 ceph-mon[35577]: pgmap v404: 97 pgs: 97 active+clean; 6.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 242 KiB/s wr, 70 op/s 2024-09-19T09:40:17.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:17 smithi001 ceph-mon[31225]: pgmap v404: 97 pgs: 97 active+clean; 6.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 242 KiB/s wr, 70 op/s 2024-09-19T09:40:18.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:18 smithi022 ceph-mon[35583]: scrub summary: idle 2024-09-19T09:40:18.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:18 smithi121 ceph-mon[35577]: scrub summary: idle 2024-09-19T09:40:18.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:18 smithi001 ceph-mon[31225]: scrub summary: idle 2024-09-19T09:40:19.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:19 smithi022 ceph-mon[35583]: pgmap v405: 97 pgs: 97 active+clean; 168 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 14 MiB/s wr, 118 op/s 2024-09-19T09:40:19.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:19 smithi121 ceph-mon[35577]: pgmap v405: 97 pgs: 97 active+clean; 168 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 14 MiB/s wr, 118 op/s 2024-09-19T09:40:19.749 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:19 smithi001 ceph-mon[31225]: pgmap v405: 97 pgs: 97 active+clean; 168 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 14 MiB/s wr, 118 op/s 2024-09-19T09:40:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.755+0000 7fe2e5731640 1 -- 172.21.15.1:0/3473148106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2e0101c70 msgr2=0x7fe2e01020f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.755+0000 7fe2e5731640 1 --2- 172.21.15.1:0/3473148106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2e0101c70 0x7fe2e01020f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4009900 tx=0x7fe2d402a410 comp rx=0 tx=0).stop 2024-09-19T09:40:20.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.756+0000 7fe2e5731640 1 -- 172.21.15.1:0/3473148106 shutdown_connections 2024-09-19T09:40:20.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.756+0000 7fe2e5731640 1 --2- 172.21.15.1:0/3473148106 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2e0102630 0x7fe2e0108ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.756+0000 7fe2e5731640 1 --2- 172.21.15.1:0/3473148106 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2e0101c70 0x7fe2e01020f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.756+0000 7fe2e5731640 1 --2- 172.21.15.1:0/3473148106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2e0100a80 0x7fe2e0100e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.756+0000 7fe2e5731640 1 -- 172.21.15.1:0/3473148106 >> 172.21.15.1:0/3473148106 conn(0x7fe2e00fc1c0 msgr2=0x7fe2e00fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:20.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.757+0000 7fe2e5731640 1 -- 172.21.15.1:0/3473148106 shutdown_connections 2024-09-19T09:40:20.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.757+0000 7fe2e5731640 1 -- 172.21.15.1:0/3473148106 wait complete. 2024-09-19T09:40:20.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.758+0000 7fe2e5731640 1 Processor -- start 2024-09-19T09:40:20.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.758+0000 7fe2e5731640 1 -- start start 2024-09-19T09:40:20.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.758+0000 7fe2e5731640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2e0100a80 0x7fe2e0071e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:20.760 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.759+0000 7fe2e5731640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2e0101c70 0x7fe2e0072340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:20.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.759+0000 7fe2e5731640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2e0102630 0x7fe2e0073380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:20.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.759+0000 7fe2deffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2e0100a80 0x7fe2e0071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:20.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.759+0000 7fe2deffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2e0100a80 0x7fe2e0071e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48038/0 (socket says 172.21.15.1:48038) 2024-09-19T09:40:20.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.759+0000 7fe2deffd640 1 -- 172.21.15.1:0/2858557550 learned_addr learned my addr 172.21.15.1:0/2858557550 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:20.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.759+0000 7fe2e5731640 1 -- 172.21.15.1:0/2858557550 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e006c4f0 con 0x7fe2e0100a80 2024-09-19T09:40:20.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.759+0000 7fe2e5731640 1 -- 172.21.15.1:0/2858557550 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e006c370 con 0x7fe2e0102630 2024-09-19T09:40:20.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.759+0000 7fe2e5731640 1 -- 172.21.15.1:0/2858557550 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e006c670 con 0x7fe2e0101c70 2024-09-19T09:40:20.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.760+0000 7fe2deffd640 1 -- 172.21.15.1:0/2858557550 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2e0101c70 msgr2=0x7fe2e0072340 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:40:20.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.760+0000 7fe2deffd640 1 --2- 172.21.15.1:0/2858557550 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2e0101c70 0x7fe2e0072340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.760+0000 7fe2deffd640 1 -- 172.21.15.1:0/2858557550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2e0102630 msgr2=0x7fe2e0073380 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:40:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.760+0000 7fe2deffd640 1 --2- 172.21.15.1:0/2858557550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2e0102630 0x7fe2e0073380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.760+0000 7fe2deffd640 1 -- 172.21.15.1:0/2858557550 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e00739f0 con 0x7fe2e0100a80 2024-09-19T09:40:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.760+0000 7fe2deffd640 1 --2- 172.21.15.1:0/2858557550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2e0100a80 0x7fe2e0071e00 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe2d000d770 tx=0x7fe2d000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.761+0000 7fe2c7fff640 1 -- 172.21.15.1:0/2858557550 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0017070 con 0x7fe2e0100a80 2024-09-19T09:40:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.761+0000 7fe2c7fff640 1 -- 172.21.15.1:0/2858557550 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2d0009c30 con 0x7fe2e0100a80 2024-09-19T09:40:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.761+0000 7fe2c7fff640 1 -- 172.21.15.1:0/2858557550 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0003dd0 con 0x7fe2e0100a80 2024-09-19T09:40:20.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.763+0000 7fe2e5731640 1 -- 172.21.15.1:0/2858557550 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2e0073ce0 con 0x7fe2e0100a80 2024-09-19T09:40:20.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.763+0000 7fe2e5731640 1 -- 172.21.15.1:0/2858557550 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2e01a7c20 con 0x7fe2e0100a80 2024-09-19T09:40:20.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.768+0000 7fe2e84d2740 1 Processor -- start 2024-09-19T09:40:20.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.768+0000 7fe2e84d2740 1 -- start start 2024-09-19T09:40:20.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.768+0000 7fe2e84d2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c68a8acf10 0x55c68a8ab750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:20.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.769+0000 7fe2e84d2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c68a8ad310 0x55c68a8abc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:20.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.769+0000 7fe2e84d2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c68a8ac1d0 0x55c68a8bc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:20.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.769+0000 7fe2e84d2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c68a80f2f0 con 0x55c68a8ad310 2024-09-19T09:40:20.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.769+0000 7fe2e84d2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55c68a7b7270 con 0x55c68a8acf10 2024-09-19T09:40:20.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.769+0000 7fe2df7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c68a8acf10 0x55c68a8ab750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:20.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.769+0000 7fe2df7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c68a8acf10 0x55c68a8ab750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:45078/0 (socket says 172.21.15.1:45078) 2024-09-19T09:40:20.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.769+0000 7fe2df7fe640 1 -- 172.21.15.1:0/1466414118 learned_addr learned my addr 172.21.15.1:0/1466414118 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:20.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.769+0000 7fe2e84d2740 1 -- 172.21.15.1:0/1466414118 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c68a80b2b0 con 0x55c68a8ac1d0 2024-09-19T09:40:20.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.769+0000 7fe2de7fc640 1 --2- 172.21.15.1:0/1466414118 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c68a8ac1d0 0x55c68a8bc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:20.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.769+0000 7fe2c7fff640 1 -- 172.21.15.1:0/2858557550 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fe2d0003f70 con 0x7fe2e0100a80 2024-09-19T09:40:20.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.769+0000 7fe2df7fe640 1 -- 172.21.15.1:0/1466414118 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c68a8ac1d0 msgr2=0x55c68a8bc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:20.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.769+0000 7fe2df7fe640 1 --2- 172.21.15.1:0/1466414118 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c68a8ac1d0 0x55c68a8bc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.770+0000 7fe2df7fe640 1 -- 172.21.15.1:0/1466414118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c68a8ad310 msgr2=0x55c68a8abc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:20.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.770+0000 7fe2df7fe640 1 --2- 172.21.15.1:0/1466414118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c68a8ad310 0x55c68a8abc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.770+0000 7fe2df7fe640 1 -- 172.21.15.1:0/1466414118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c68a7b6340 con 0x55c68a8acf10 2024-09-19T09:40:20.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.770+0000 7fe2df7fe640 1 --2- 172.21.15.1:0/1466414118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c68a8acf10 0x55c68a8ab750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8009d00 tx=0x7fe2d800b420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ccc1666e275e006 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:20.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.770+0000 7fe2c57fa640 1 -- 172.21.15.1:0/1466414118 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d800bcc0 con 0x55c68a8acf10 2024-09-19T09:40:20.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.770+0000 7fe2c57fa640 1 -- 172.21.15.1:0/1466414118 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2d8017070 con 0x55c68a8acf10 2024-09-19T09:40:20.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.770+0000 7fe2c57fa640 1 -- 172.21.15.1:0/1466414118 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d8011630 con 0x55c68a8acf10 2024-09-19T09:40:20.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.771+0000 7fe2c7fff640 1 --2- 172.21.15.1:0/2858557550 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe2c80a3300 0x7fe2c80a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:20.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.771+0000 7fe2c7fff640 1 -- 172.21.15.1:0/2858557550 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fe2d00cf2f0 con 0x7fe2e0100a80 2024-09-19T09:40:20.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.771+0000 7fe2deffd640 1 --2- 172.21.15.1:0/2858557550 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe2c80a3300 0x7fe2c80a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:20.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.771+0000 7fe2e84d2740 1 -- 172.21.15.1:0/1466414118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c68a8acf10 msgr2=0x55c68a8ab750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:20.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.771+0000 7fe2e84d2740 1 --2- 172.21.15.1:0/1466414118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c68a8acf10 0x55c68a8ab750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8009d00 tx=0x7fe2d800b420 comp rx=0 tx=0).stop 2024-09-19T09:40:20.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.772+0000 7fe2e84d2740 1 -- 172.21.15.1:0/1466414118 shutdown_connections 2024-09-19T09:40:20.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.772+0000 7fe2e84d2740 1 --2- 172.21.15.1:0/1466414118 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c68a8ac1d0 0x55c68a8bc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.776 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.772+0000 7fe2e84d2740 1 --2- 172.21.15.1:0/1466414118 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c68a8ad310 0x55c68a8abc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.772+0000 7fe2e84d2740 1 --2- 172.21.15.1:0/1466414118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c68a8acf10 0x55c68a8ab750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.772+0000 7fe2e84d2740 1 -- 172.21.15.1:0/1466414118 >> 172.21.15.1:0/1466414118 conn(0x55c68a8a7010 msgr2=0x55c68a8a7410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:20.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.772+0000 7fe2deffd640 1 --2- 172.21.15.1:0/2858557550 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe2c80a3300 0x7fe2c80a57c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe2d00cf5d0 tx=0x7fe2d0004590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:20.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.772+0000 7fe2e84d2740 1 -- 172.21.15.1:0/1466414118 shutdown_connections 2024-09-19T09:40:20.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.772+0000 7fe2e84d2740 1 -- 172.21.15.1:0/1466414118 wait complete. 2024-09-19T09:40:20.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.772+0000 7fe2e84d2740 1 -- start start 2024-09-19T09:40:20.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.772+0000 7fe2e84d2740 1 Processor -- start 2024-09-19T09:40:20.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.773+0000 7fe2e84d2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c68a8ac1d0 0x55c68a8be3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:20.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.773+0000 7fe2e84d2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c68a8acf10 0x55c68a8be8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:20.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.773+0000 7fe2e84d2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c68a8ad310 0x55c68a8c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:20.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.773+0000 7fe2df7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c68a8ac1d0 0x55c68a8be3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:20.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.773+0000 7fe2e84d2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c68a8bcb80 con 0x55c68a8ac1d0 2024-09-19T09:40:20.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.773+0000 7fe2e84d2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55c68a798290 con 0x55c68a8acf10 2024-09-19T09:40:20.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.773+0000 7fe2df7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c68a8ac1d0 0x55c68a8be3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48054/0 (socket says 172.21.15.1:48054) 2024-09-19T09:40:20.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.773+0000 7fe2df7fe640 1 -- 172.21.15.1:0/3417773561 learned_addr learned my addr 172.21.15.1:0/3417773561 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:20.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.773+0000 7fe2e84d2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c68a8bcd00 con 0x55c68a8ad310 2024-09-19T09:40:20.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.773+0000 7fe2e84d2740 10 client.0 _ll_register_callbacks cb 0x55c68a7c9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:20.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.773+0000 7fe2de7fc640 1 --2- 172.21.15.1:0/3417773561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c68a8acf10 0x55c68a8be8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:20.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.774+0000 7fe2df7fe640 1 -- 172.21.15.1:0/3417773561 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c68a8ad310 msgr2=0x55c68a8c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:20.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.774+0000 7fe2df7fe640 1 --2- 172.21.15.1:0/3417773561 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c68a8ad310 0x55c68a8c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.774+0000 7fe2df7fe640 1 -- 172.21.15.1:0/3417773561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c68a8acf10 msgr2=0x55c68a8be8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:20.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.774+0000 7fe2df7fe640 1 --2- 172.21.15.1:0/3417773561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c68a8acf10 0x55c68a8be8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.774+0000 7fe2df7fe640 1 -- 172.21.15.1:0/3417773561 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c68a522210 con 0x55c68a8ac1d0 2024-09-19T09:40:20.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.774+0000 7fe2de7fc640 1 --2- 172.21.15.1:0/3417773561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c68a8acf10 0x55c68a8be8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:20.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.774+0000 7fe2df7fe640 1 --2- 172.21.15.1:0/3417773561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c68a8ac1d0 0x55c68a8be3b0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8009aa0 tx=0x7fe2d8009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac51c43da73c46d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:20.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.774+0000 7fe2c2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:40:20.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.774+0000 7fe2c2ff5640 1 -- 172.21.15.1:0/3417773561 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d8027680 con 0x55c68a8ac1d0 2024-09-19T09:40:20.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.774+0000 7fe2c2ff5640 1 -- 172.21.15.1:0/3417773561 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fe2d801b400 con 0x55c68a8ac1d0 2024-09-19T09:40:20.779 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.774+0000 7fe2e84d2740 1 -- 172.21.15.1:0/3417773561 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2d8017070 con 0x55c68a8ac1d0 2024-09-19T09:40:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.775+0000 7fe2c2ff5640 1 -- 172.21.15.1:0/3417773561 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe2d8027820 con 0x55c68a8ac1d0 2024-09-19T09:40:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.775+0000 7fe2e84d2740 10 client.15768 fetch_fsmap learned FSMap version 19 2024-09-19T09:40:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.775+0000 7fe2e84d2740 1 -- 172.21.15.1:0/3417773561 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55c68a5ee620 con 0x55c68a8ac1d0 2024-09-19T09:40:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.775+0000 7fe2c2ff5640 1 -- 172.21.15.1:0/3417773561 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2d8017070 con 0x55c68a8ac1d0 2024-09-19T09:40:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.776+0000 7fe2c2ff5640 1 -- 172.21.15.1:0/3417773561 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe2d8011070 con 0x55c68a8ac1d0 2024-09-19T09:40:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.776+0000 7fe2e84d2740 10 client.15768 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:40:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.776+0000 7fe2e84d2740 10 client.15768 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.776+0000 7fe2e84d2740 20 client.15768 populate_metadata read hostname 'smithi001' 2024-09-19T09:40:20.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.776+0000 7fe2e84d2740 1 --2- 172.21.15.1:0/3417773561 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55c68a8c9da0 0x55c68a8cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:20.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.776+0000 7fe2e84d2740 4 client.15768 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:20.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.776+0000 7fe2e84d2740 1 -- 172.21.15.1:0/3417773561 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c68a81ca20 con 0x55c68a8c9da0 2024-09-19T09:40:20.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.776+0000 7fe2de7fc640 1 --2- 172.21.15.1:0/3417773561 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55c68a8c9da0 0x55c68a8cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:20.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.778+0000 7fe2c2ff5640 10 client.15768 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:20.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.778+0000 7fe2de7fc640 1 --2- 172.21.15.1:0/3417773561 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55c68a8c9da0 0x55c68a8cc190 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=510eb3ebf4531ff6 server_cookie=b2c6263e12db8c7d in_seq=0 out_seq=0 2024-09-19T09:40:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.779+0000 7fe2c2ff5640 1 -- 172.21.15.1:0/3417773561 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c68a81ca20 con 0x55c68a8c9da0 2024-09-19T09:40:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.779+0000 7fe2c2ff5640 10 client.15768 handle_command_reply: tid=0 2024-09-19T09:40:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.779+0000 7fe2e84d2740 1 client.15768 shutdown 2024-09-19T09:40:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.780+0000 7fe2e84d2740 1 -- 172.21.15.1:0/3417773561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c68a8ac1d0 msgr2=0x55c68a8be3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.780+0000 7fe2e84d2740 1 --2- 172.21.15.1:0/3417773561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c68a8ac1d0 0x55c68a8be3b0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8009aa0 tx=0x7fe2d8009ad0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.780+0000 7fe2e84d2740 1 -- 172.21.15.1:0/3417773561 shutdown_connections 2024-09-19T09:40:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.780+0000 7fe2e84d2740 1 --2- 172.21.15.1:0/3417773561 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55c68a8c9da0 0x55c68a8cc190 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.780+0000 7fe2c2ff5640 0 client.15768 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.780+0000 7fe2e84d2740 1 --2- 172.21.15.1:0/3417773561 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c68a8ad310 0x55c68a8c58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.780+0000 7fe2e84d2740 1 --2- 172.21.15.1:0/3417773561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c68a8acf10 0x55c68a8be8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.780+0000 7fe2e84d2740 1 --2- 172.21.15.1:0/3417773561 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c68a8ac1d0 0x55c68a8be3b0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.780+0000 7fe2e84d2740 1 -- 172.21.15.1:0/3417773561 >> 172.21.15.1:0/3417773561 conn(0x55c68a8a7010 msgr2=0x55c68a8a8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.780+0000 7fe2e84d2740 1 -- 172.21.15.1:0/3417773561 shutdown_connections 2024-09-19T09:40:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.780+0000 7fe2e84d2740 1 -- 172.21.15.1:0/3417773561 wait complete. 2024-09-19T09:40:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.781+0000 7fe2e84d2740 20 client.15768 trim_cache size 0 max 16384 2024-09-19T09:40:20.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.811+0000 7fe2e84d2740 1 Processor -- start 2024-09-19T09:40:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.811+0000 7fe2e84d2740 1 -- start start 2024-09-19T09:40:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.811+0000 7fe2e84d2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c68a8ac1d0 0x55c68a8adad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.812+0000 7fe2e84d2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c68a8acf10 0x55c68a8c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.812+0000 7fe2e84d2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c68a8ad310 0x55c68a8a8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.812+0000 7fe2e84d2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e01ad820 con 0x55c68a8acf10 2024-09-19T09:40:20.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.812+0000 7fe2e84d2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e01b00c0 con 0x55c68a8ac1d0 2024-09-19T09:40:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.812+0000 7fe2e84d2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e01adeb0 con 0x55c68a8ad310 2024-09-19T09:40:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.812+0000 7fe2de7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c68a8acf10 0x55c68a8c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.812+0000 7fe2de7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c68a8acf10 0x55c68a8c57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48064/0 (socket says 172.21.15.1:48064) 2024-09-19T09:40:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.812+0000 7fe2de7fc640 1 -- 172.21.15.1:0/3563504078 learned_addr learned my addr 172.21.15.1:0/3563504078 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.812+0000 7fe2df7fe640 1 --2- 172.21.15.1:0/3563504078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c68a8ac1d0 0x55c68a8adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.812+0000 7fe2df7fe640 1 --2- 172.21.15.1:0/3563504078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c68a8ad310 0x55c68a8a8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.813+0000 7fe2de7fc640 1 -- 172.21.15.1:0/3563504078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c68a8ad310 msgr2=0x55c68a8a8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.813+0000 7fe2de7fc640 1 --2- 172.21.15.1:0/3563504078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c68a8ad310 0x55c68a8a8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.813+0000 7fe2de7fc640 1 -- 172.21.15.1:0/3563504078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c68a8ac1d0 msgr2=0x55c68a8adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.813+0000 7fe2de7fc640 1 --2- 172.21.15.1:0/3563504078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c68a8ac1d0 0x55c68a8adad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.813+0000 7fe2de7fc640 1 -- 172.21.15.1:0/3563504078 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c68a8bc790 con 0x55c68a8acf10 2024-09-19T09:40:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.813+0000 7fe2de7fc640 1 --2- 172.21.15.1:0/3563504078 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c68a8acf10 0x55c68a8c57e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4031440 tx=0x7fe2d4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd6cfa3805c1571 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.813+0000 7fe2c4ff9640 1 -- 172.21.15.1:0/3563504078 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4035040 con 0x55c68a8acf10 2024-09-19T09:40:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.813+0000 7fe2c4ff9640 1 -- 172.21.15.1:0/3563504078 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2d4049070 con 0x55c68a8acf10 2024-09-19T09:40:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.813+0000 7fe2c4ff9640 1 -- 172.21.15.1:0/3563504078 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4004d70 con 0x55c68a8acf10 2024-09-19T09:40:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.814+0000 7fe2e84d2740 1 -- 172.21.15.1:0/3563504078 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c68a8acf10 msgr2=0x55c68a8c57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.814+0000 7fe2e84d2740 1 --2- 172.21.15.1:0/3563504078 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c68a8acf10 0x55c68a8c57e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4031440 tx=0x7fe2d4000bc0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.814+0000 7fe2e84d2740 1 -- 172.21.15.1:0/3563504078 shutdown_connections 2024-09-19T09:40:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.814+0000 7fe2e84d2740 1 --2- 172.21.15.1:0/3563504078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c68a8ad310 0x55c68a8a8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.814+0000 7fe2e84d2740 1 --2- 172.21.15.1:0/3563504078 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c68a8acf10 0x55c68a8c57e0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.815+0000 7fe2e84d2740 1 --2- 172.21.15.1:0/3563504078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c68a8ac1d0 0x55c68a8adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.815+0000 7fe2e84d2740 1 -- 172.21.15.1:0/3563504078 >> 172.21.15.1:0/3563504078 conn(0x55c68a8a7010 msgr2=0x55c68a8a7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.815+0000 7fe2e84d2740 1 -- 172.21.15.1:0/3563504078 shutdown_connections 2024-09-19T09:40:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.815+0000 7fe2e84d2740 1 -- 172.21.15.1:0/3563504078 wait complete. 2024-09-19T09:40:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.815+0000 7fe2e84d2740 1 -- start start 2024-09-19T09:40:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.815+0000 7fe2e84d2740 1 Processor -- start 2024-09-19T09:40:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.816+0000 7fe2e84d2740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c68a8ac1d0 0x55c68a8c30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.816+0000 7fe2e84d2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c68a8acf10 0x55c68a8c3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.816+0000 7fe2e84d2740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c68a8ad310 0x55c68a8c4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.816+0000 7fe2e84d2740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e01ae580 con 0x55c68a8ad310 2024-09-19T09:40:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.816+0000 7fe2e84d2740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e01af9f0 con 0x55c68a8ac1d0 2024-09-19T09:40:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.816+0000 7fe2e84d2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e01aec50 con 0x55c68a8acf10 2024-09-19T09:40:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.816+0000 7fe2e84d2740 10 client.0 _ll_register_callbacks cb 0x7fe2d4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.816+0000 7fe2df7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c68a8ad310 0x55c68a8c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.816+0000 7fe2df7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c68a8ad310 0x55c68a8c4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48076/0 (socket says 172.21.15.1:48076) 2024-09-19T09:40:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.816+0000 7fe2df7fe640 1 -- 172.21.15.1:0/3150085545 learned_addr learned my addr 172.21.15.1:0/3150085545 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.817+0000 7fe2de7fc640 1 --2- 172.21.15.1:0/3150085545 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c68a8acf10 0x55c68a8c3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.817+0000 7fe2df7fe640 1 --2- 172.21.15.1:0/3150085545 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c68a8ac1d0 0x55c68a8c30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.817+0000 7fe2df7fe640 1 -- 172.21.15.1:0/3150085545 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c68a8acf10 msgr2=0x55c68a8c3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.817+0000 7fe2df7fe640 1 --2- 172.21.15.1:0/3150085545 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c68a8acf10 0x55c68a8c3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.817+0000 7fe2df7fe640 1 -- 172.21.15.1:0/3150085545 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c68a8ac1d0 msgr2=0x55c68a8c30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.817+0000 7fe2df7fe640 1 --2- 172.21.15.1:0/3150085545 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c68a8ac1d0 0x55c68a8c30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.817+0000 7fe2df7fe640 1 -- 172.21.15.1:0/3150085545 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c68a8c4c50 con 0x55c68a8ad310 2024-09-19T09:40:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.817+0000 7fe2df7fe640 1 --2- 172.21.15.1:0/3150085545 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c68a8ad310 0x55c68a8c4640 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe2d800b020 tx=0x7fe2d8007190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba3f81b855c7a83 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.817+0000 7fe2c2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:40:20.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.818+0000 7fe2c2ff5640 1 -- 172.21.15.1:0/3150085545 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d8027bd0 con 0x55c68a8ad310 2024-09-19T09:40:20.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.818+0000 7fe2c2ff5640 1 -- 172.21.15.1:0/3150085545 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fe2d800f040 con 0x55c68a8ad310 2024-09-19T09:40:20.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.818+0000 7fe2e84d2740 1 -- 172.21.15.1:0/3150085545 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2d4049070 con 0x55c68a8ad310 2024-09-19T09:40:20.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.818+0000 7fe2c2ff5640 1 -- 172.21.15.1:0/3150085545 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe2d8027d70 con 0x55c68a8ad310 2024-09-19T09:40:20.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.818+0000 7fe2e84d2740 10 client.15774 fetch_fsmap learned FSMap version 19 2024-09-19T09:40:20.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.818+0000 7fe2e84d2740 1 -- 172.21.15.1:0/3150085545 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55c68a934c20 con 0x55c68a8ad310 2024-09-19T09:40:20.824 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.819+0000 7fe2c2ff5640 1 -- 172.21.15.1:0/3150085545 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2d4049070 con 0x55c68a8ad310 2024-09-19T09:40:20.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.819+0000 7fe2c2ff5640 1 -- 172.21.15.1:0/3150085545 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe2d8011040 con 0x55c68a8ad310 2024-09-19T09:40:20.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.819+0000 7fe2e84d2740 10 client.15774 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:40:20.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.819+0000 7fe2e84d2740 10 client.15774 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:20.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.819+0000 7fe2e84d2740 20 client.15774 populate_metadata read hostname 'smithi001' 2024-09-19T09:40:20.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.819+0000 7fe2e84d2740 1 --2- 172.21.15.1:0/3150085545 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55c68a8c9da0 0x55c68a937460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:20.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.820+0000 7fe2e84d2740 4 client.15774 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:40:20.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.820+0000 7fe2e84d2740 1 -- 172.21.15.1:0/3150085545 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c68a816d70 con 0x55c68a8c9da0 2024-09-19T09:40:20.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.821+0000 7fe2de7fc640 1 --2- 172.21.15.1:0/3150085545 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55c68a8c9da0 0x55c68a937460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:20.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.823+0000 7fe2de7fc640 1 --2- 172.21.15.1:0/3150085545 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55c68a8c9da0 0x55c68a937460 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f1a155616773920 server_cookie=8bedeb5432345d5b in_seq=0 out_seq=0 2024-09-19T09:40:20.825 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.823+0000 7fe2c2ff5640 10 client.15774 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:20.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.897+0000 7fe2c2ff5640 1 -- 172.21.15.1:0/3150085545 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c68a816d70 con 0x55c68a8c9da0 2024-09-19T09:40:20.900 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.897+0000 7fe2c2ff5640 10 client.15774 handle_command_reply: tid=0 2024-09-19T09:40:20.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.897+0000 7fe2e84d2740 1 client.15774 shutdown 2024-09-19T09:40:20.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.898+0000 7fe2e84d2740 1 -- 172.21.15.1:0/3150085545 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c68a8ad310 msgr2=0x55c68a8c4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:20.901 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.898+0000 7fe2e84d2740 1 --2- 172.21.15.1:0/3150085545 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c68a8ad310 0x55c68a8c4640 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe2d800b020 tx=0x7fe2d8007190 comp rx=0 tx=0).stop 2024-09-19T09:40:20.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.901+0000 7fe2e84d2740 1 -- 172.21.15.1:0/3150085545 shutdown_connections 2024-09-19T09:40:20.903 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.901+0000 7fe2e84d2740 1 --2- 172.21.15.1:0/3150085545 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55c68a8c9da0 0x55c68a937460 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.901+0000 7fe2e84d2740 1 --2- 172.21.15.1:0/3150085545 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c68a8ad310 0x55c68a8c4640 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.901+0000 7fe2c2ff5640 0 client.15774 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:20.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.901+0000 7fe2e84d2740 1 --2- 172.21.15.1:0/3150085545 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c68a8acf10 0x55c68a8c3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.902+0000 7fe2e84d2740 1 --2- 172.21.15.1:0/3150085545 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c68a8ac1d0 0x55c68a8c30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.902+0000 7fe2e84d2740 1 -- 172.21.15.1:0/3150085545 >> 172.21.15.1:0/3150085545 conn(0x55c68a8a7010 msgr2=0x55c68a8a8740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:20.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.902+0000 7fe2e84d2740 1 -- 172.21.15.1:0/3150085545 shutdown_connections 2024-09-19T09:40:20.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.902+0000 7fe2e84d2740 1 -- 172.21.15.1:0/3150085545 wait complete. 2024-09-19T09:40:20.905 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.903+0000 7fe2e84d2740 20 client.15774 trim_cache size 0 max 16384 2024-09-19T09:40:20.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:40:20.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:40:20.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:40:20.906 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:40:20.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.904+0000 7fe2e5731640 1 -- 172.21.15.1:0/2858557550 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe2c80a3300 msgr2=0x7fe2c80a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:20.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.904+0000 7fe2e5731640 1 --2- 172.21.15.1:0/2858557550 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe2c80a3300 0x7fe2c80a57c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe2d00cf5d0 tx=0x7fe2d0004590 comp rx=0 tx=0).stop 2024-09-19T09:40:20.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.904+0000 7fe2e5731640 1 -- 172.21.15.1:0/2858557550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2e0100a80 msgr2=0x7fe2e0071e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:20.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.904+0000 7fe2e5731640 1 --2- 172.21.15.1:0/2858557550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2e0100a80 0x7fe2e0071e00 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe2d000d770 tx=0x7fe2d000dc30 comp rx=0 tx=0).stop 2024-09-19T09:40:20.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.904+0000 7fe2e5731640 1 -- 172.21.15.1:0/2858557550 shutdown_connections 2024-09-19T09:40:20.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.904+0000 7fe2e5731640 1 --2- 172.21.15.1:0/2858557550 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe2c80a3300 0x7fe2c80a57c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.907 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.904+0000 7fe2e5731640 1 --2- 172.21.15.1:0/2858557550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2e0102630 0x7fe2e0073380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.904+0000 7fe2e5731640 1 --2- 172.21.15.1:0/2858557550 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2e0101c70 0x7fe2e0072340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.904+0000 7fe2e5731640 1 --2- 172.21.15.1:0/2858557550 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe2e0100a80 0x7fe2e0071e00 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:20.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.905+0000 7fe2e5731640 1 -- 172.21.15.1:0/2858557550 >> 172.21.15.1:0/2858557550 conn(0x7fe2e00fc1c0 msgr2=0x7fe2e00fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:20.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.905+0000 7fe2e5731640 1 -- 172.21.15.1:0/2858557550 shutdown_connections 2024-09-19T09:40:20.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:20.905+0000 7fe2e5731640 1 -- 172.21.15.1:0/2858557550 wait complete. 2024-09-19T09:40:21.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:21 smithi022 ceph-mon[35583]: pgmap v406: 97 pgs: 97 active+clean; 1.7 GiB data, 677 MiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 144 MiB/s wr, 178 op/s 2024-09-19T09:40:21.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:21 smithi121 ceph-mon[35577]: pgmap v406: 97 pgs: 97 active+clean; 1.7 GiB data, 677 MiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 144 MiB/s wr, 178 op/s 2024-09-19T09:40:21.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:21 smithi001 ceph-mon[31225]: pgmap v406: 97 pgs: 97 active+clean; 1.7 GiB data, 677 MiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 144 MiB/s wr, 178 op/s 2024-09-19T09:40:22.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:22 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:40:22.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:22 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:40:22.649 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:22 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:40:23.607 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:23 smithi001 ceph-mon[31225]: pgmap v407: 97 pgs: 97 active+clean; 2.8 GiB data, 856 MiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 239 MiB/s wr, 191 op/s 2024-09-19T09:40:23.607 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:23 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:40:23.607 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:23 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:40:23.607 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:23 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:40:23.607 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:23 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:40:23.607 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:23 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:40:23.608 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:23 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:40:23.608 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:23 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:40:23.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:23 smithi022 ceph-mon[35583]: pgmap v407: 97 pgs: 97 active+clean; 2.8 GiB data, 856 MiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 239 MiB/s wr, 191 op/s 2024-09-19T09:40:23.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:23 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:40:23.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:23 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:40:23.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:23 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:40:23.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:23 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:40:23.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:23 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:40:23.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:23 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:40:23.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:23 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:40:23.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:23 smithi121 ceph-mon[35577]: pgmap v407: 97 pgs: 97 active+clean; 2.8 GiB data, 856 MiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 239 MiB/s wr, 191 op/s 2024-09-19T09:40:23.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:23 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:40:23.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:23 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:40:23.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:23 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:40:23.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:23 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:40:23.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:23 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:40:23.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:23 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:40:23.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:23 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:40:25.668 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:25 smithi121 ceph-mon[35577]: pgmap v408: 97 pgs: 97 active+clean; 4.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 344 MiB/s wr, 249 op/s 2024-09-19T09:40:25.752 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:25 smithi001 ceph-mon[31225]: pgmap v408: 97 pgs: 97 active+clean; 4.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 344 MiB/s wr, 249 op/s 2024-09-19T09:40:25.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:25 smithi022 ceph-mon[35583]: pgmap v408: 97 pgs: 97 active+clean; 4.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 344 MiB/s wr, 249 op/s 2024-09-19T09:40:27.677 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:27 smithi022 ceph-mon[35583]: pgmap v409: 97 pgs: 97 active+clean; 6.4 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 544 MiB/s wr, 309 op/s 2024-09-19T09:40:27.749 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:27 smithi001 ceph-mon[31225]: pgmap v409: 97 pgs: 97 active+clean; 6.4 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 544 MiB/s wr, 309 op/s 2024-09-19T09:40:27.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:27 smithi121 ceph-mon[35577]: pgmap v409: 97 pgs: 97 active+clean; 6.4 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 544 MiB/s wr, 309 op/s 2024-09-19T09:40:28.323 INFO:tasks.workunit.client.0.smithi001.stdout:fs setup took 13 secs 2024-09-19T09:40:29.752 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:29 smithi001 ceph-mon[31225]: pgmap v410: 97 pgs: 97 active+clean; 7.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 616 MiB/s wr, 315 op/s 2024-09-19T09:40:29.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:29 smithi022 ceph-mon[35583]: pgmap v410: 97 pgs: 97 active+clean; 7.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 616 MiB/s wr, 315 op/s 2024-09-19T09:40:29.866 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:29 smithi121 ceph-mon[35577]: pgmap v410: 97 pgs: 97 active+clean; 7.2 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 616 MiB/s wr, 315 op/s 2024-09-19T09:40:31.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:31 smithi022 ceph-mon[35583]: pgmap v411: 97 pgs: 97 active+clean; 9.6 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 807 MiB/s wr, 347 op/s 2024-09-19T09:40:31.866 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:31 smithi121 ceph-mon[35577]: pgmap v411: 97 pgs: 97 active+clean; 9.6 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 807 MiB/s wr, 347 op/s 2024-09-19T09:40:31.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:31 smithi001 ceph-mon[31225]: pgmap v411: 97 pgs: 97 active+clean; 9.6 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 807 MiB/s wr, 347 op/s 2024-09-19T09:40:32.019 INFO:tasks.workunit.client.0.smithi001.stdout:Syncing()...3 sec 2024-09-19T09:40:32.020 INFO:tasks.workunit.client.0.smithi001.stdout:Starting Actual Benchmark At: Thu Sep 19 09:40:32 2024 2024-09-19T09:40:32.021 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-09-19T09:40:33.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:33 smithi001 ceph-mon[31225]: pgmap v412: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 779 MiB/s wr, 312 op/s 2024-09-19T09:40:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.099+0000 7f336b3d8640 1 -- 172.21.15.1:0/2074918548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3364072d10 msgr2=0x7f3364073170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:34.101 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.099+0000 7f336b3d8640 1 --2- 172.21.15.1:0/2074918548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3364072d10 0x7f3364073170 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3358009860 tx=0x7f335802a360 comp rx=0 tx=0).stop 2024-09-19T09:40:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.101+0000 7f336b3d8640 1 -- 172.21.15.1:0/2074918548 shutdown_connections 2024-09-19T09:40:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.101+0000 7f336b3d8640 1 --2- 172.21.15.1:0/2074918548 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f33640736b0 0x7f3364119130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.101+0000 7f336b3d8640 1 --2- 172.21.15.1:0/2074918548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3364072d10 0x7f3364073170 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.101+0000 7f336b3d8640 1 --2- 172.21.15.1:0/2074918548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3364109700 0x7f3364109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.103 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.101+0000 7f336b3d8640 1 -- 172.21.15.1:0/2074918548 >> 172.21.15.1:0/2074918548 conn(0x7f336406ecd0 msgr2=0x7f3364071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:34.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.104+0000 7f336b3d8640 1 -- 172.21.15.1:0/2074918548 shutdown_connections 2024-09-19T09:40:34.105 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.104+0000 7f336b3d8640 1 -- 172.21.15.1:0/2074918548 wait complete. 2024-09-19T09:40:34.106 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.105+0000 7f336b3d8640 1 Processor -- start 2024-09-19T09:40:34.107 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.105+0000 7f336b3d8640 1 -- start start 2024-09-19T09:40:34.107 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.106+0000 7f336b3d8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3364072d10 0x7f33641a6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.108 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.106+0000 7f336b3d8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33640736b0 0x7f33641a7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.108 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.106+0000 7f336b3d8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3364109700 0x7f33641ae260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.106+0000 7f3369174640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3364072d10 0x7f33641a6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.106+0000 7f3369174640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3364072d10 0x7f33641a6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:39832/0 (socket says 172.21.15.1:39832) 2024-09-19T09:40:34.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.106+0000 7f3368973640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33640736b0 0x7f33641a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.107+0000 7f3369174640 1 -- 172.21.15.1:0/4174404935 learned_addr learned my addr 172.21.15.1:0/4174404935 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:34.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.107+0000 7f3369975640 1 --2- 172.21.15.1:0/4174404935 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3364109700 0x7f33641ae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.107+0000 7f336b3d8640 1 -- 172.21.15.1:0/4174404935 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f336411c600 con 0x7f3364109700 2024-09-19T09:40:34.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.107+0000 7f336b3d8640 1 -- 172.21.15.1:0/4174404935 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f336411c480 con 0x7f33640736b0 2024-09-19T09:40:34.109 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.107+0000 7f336b3d8640 1 -- 172.21.15.1:0/4174404935 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f336411c780 con 0x7f3364072d10 2024-09-19T09:40:34.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.109+0000 7f3369174640 1 -- 172.21.15.1:0/4174404935 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33640736b0 msgr2=0x7f33641a7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:34.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.109+0000 7f3369174640 1 --2- 172.21.15.1:0/4174404935 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33640736b0 0x7f33641a7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.109+0000 7f3369174640 1 -- 172.21.15.1:0/4174404935 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3364109700 msgr2=0x7f33641ae260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:34.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.109+0000 7f3369174640 1 --2- 172.21.15.1:0/4174404935 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3364109700 0x7f33641ae260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.111 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.109+0000 7f3369174640 1 -- 172.21.15.1:0/4174404935 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33641ae900 con 0x7f3364072d10 2024-09-19T09:40:34.113 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.110+0000 7f3369174640 1 --2- 172.21.15.1:0/4174404935 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3364072d10 0x7f33641a6cc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f336000e9f0 tx=0x7f336000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:34.113 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.111+0000 7f33567fc640 1 -- 172.21.15.1:0/4174404935 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336000cd80 con 0x7f3364072d10 2024-09-19T09:40:34.113 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.111+0000 7f33567fc640 1 -- 172.21.15.1:0/4174404935 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3360005500 con 0x7f3364072d10 2024-09-19T09:40:34.113 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.111+0000 7f336b3d8640 1 -- 172.21.15.1:0/4174404935 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33641aebf0 con 0x7f3364072d10 2024-09-19T09:40:34.114 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.111+0000 7f336b3d8640 1 -- 172.21.15.1:0/4174404935 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33641af0c0 con 0x7f3364072d10 2024-09-19T09:40:34.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:33 smithi022 ceph-mon[35583]: pgmap v412: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 779 MiB/s wr, 312 op/s 2024-09-19T09:40:34.115 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.112+0000 7f33567fc640 1 -- 172.21.15.1:0/4174404935 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336000cd80 con 0x7f3364072d10 2024-09-19T09:40:34.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:33 smithi121 ceph-mon[35577]: pgmap v412: 97 pgs: 97 active+clean; 11 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 779 MiB/s wr, 312 op/s 2024-09-19T09:40:34.117 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.115+0000 7f336e24c740 1 Processor -- start 2024-09-19T09:40:34.118 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.116+0000 7f336e24c740 1 -- start start 2024-09-19T09:40:34.118 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.116+0000 7f336e24c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d622a8c9a0 0x55d622a8cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.118 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.116+0000 7f336e24c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d622a8d2e0 0x55d622a91da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.118 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.116+0000 7f336e24c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d622a92370 0x55d622a94830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.118 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.116+0000 7f336e24c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d6229f02f0 con 0x55d622a92370 2024-09-19T09:40:34.119 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.116+0000 7f336e24c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d622998270 con 0x55d622a8c9a0 2024-09-19T09:40:34.119 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.116+0000 7f3368973640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d622a92370 0x55d622a94830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.119 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.116+0000 7f3368973640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d622a92370 0x55d622a94830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43064/0 (socket says 172.21.15.1:43064) 2024-09-19T09:40:34.119 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.116+0000 7f3368973640 1 -- 172.21.15.1:0/3378139338 learned_addr learned my addr 172.21.15.1:0/3378139338 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:34.119 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.117+0000 7f336e24c740 1 -- 172.21.15.1:0/3378139338 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d6229ec2b0 con 0x55d622a8d2e0 2024-09-19T09:40:34.119 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.117+0000 7f3369975640 1 --2- 172.21.15.1:0/3378139338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d622a8c9a0 0x55d622a8cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.119 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.118+0000 7f33567fc640 1 -- 172.21.15.1:0/4174404935 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f33600046c0 con 0x7f3364072d10 2024-09-19T09:40:34.121 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.119+0000 7f3369975640 1 -- 172.21.15.1:0/3378139338 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d622a8d2e0 msgr2=0x55d622a91da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:34.121 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.119+0000 7f3369174640 1 --2- 172.21.15.1:0/3378139338 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d622a8d2e0 0x55d622a91da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.122 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.119+0000 7f3369975640 1 --2- 172.21.15.1:0/3378139338 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d622a8d2e0 0x55d622a91da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.122 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.119+0000 7f3369975640 1 -- 172.21.15.1:0/3378139338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d622a92370 msgr2=0x55d622a94830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:34.122 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.119+0000 7f3369975640 1 --2- 172.21.15.1:0/3378139338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d622a92370 0x55d622a94830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.122 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.119+0000 7f3369975640 1 -- 172.21.15.1:0/3378139338 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d622997340 con 0x55d622a8c9a0 2024-09-19T09:40:34.122 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.119+0000 7f3369174640 1 --2- 172.21.15.1:0/3378139338 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d622a8d2e0 0x55d622a91da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:40:34.122 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.119+0000 7f33567fc640 1 --2- 172.21.15.1:0/4174404935 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f33500a3510 0x7f33500a59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.122 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.120+0000 7f33567fc640 1 -- 172.21.15.1:0/4174404935 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f33600cf950 con 0x7f3364072d10 2024-09-19T09:40:34.122 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.120+0000 7f3369975640 1 --2- 172.21.15.1:0/3378139338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d622a8c9a0 0x55d622a8cda0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f335c00e450 tx=0x7f335c0095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3147623dc5e9592 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:34.122 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.120+0000 7f3369174640 1 --2- 172.21.15.1:0/4174404935 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f33500a3510 0x7f33500a59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.123+0000 7f334f7fe640 1 -- 172.21.15.1:0/3378139338 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c004b20 con 0x55d622a8c9a0 2024-09-19T09:40:34.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.123+0000 7f334f7fe640 1 -- 172.21.15.1:0/3378139338 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f335c004cc0 con 0x55d622a8c9a0 2024-09-19T09:40:34.127 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.124+0000 7f336e24c740 1 -- 172.21.15.1:0/3378139338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d622a8c9a0 msgr2=0x55d622a8cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:34.127 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.125+0000 7f334f7fe640 1 -- 172.21.15.1:0/3378139338 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c004b20 con 0x55d622a8c9a0 2024-09-19T09:40:34.127 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.125+0000 7f336e24c740 1 --2- 172.21.15.1:0/3378139338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d622a8c9a0 0x55d622a8cda0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f335c00e450 tx=0x7f335c0095c0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.127 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.125+0000 7f336e24c740 1 -- 172.21.15.1:0/3378139338 shutdown_connections 2024-09-19T09:40:34.127 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.125+0000 7f336e24c740 1 --2- 172.21.15.1:0/3378139338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d622a92370 0x55d622a94830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.127 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.125+0000 7f336e24c740 1 --2- 172.21.15.1:0/3378139338 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d622a8d2e0 0x55d622a91da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.127 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.125+0000 7f336e24c740 1 --2- 172.21.15.1:0/3378139338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d622a8c9a0 0x55d622a8cda0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.127 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.125+0000 7f336e24c740 1 -- 172.21.15.1:0/3378139338 >> 172.21.15.1:0/3378139338 conn(0x55d622a88010 msgr2=0x55d622a88410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:34.128 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.126+0000 7f3369174640 1 --2- 172.21.15.1:0/4174404935 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f33500a3510 0x7f33500a59d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3360098390 tx=0x7f33600cfba0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:34.130 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.128+0000 7f336e24c740 1 -- 172.21.15.1:0/3378139338 shutdown_connections 2024-09-19T09:40:34.131 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.130+0000 7f336e24c740 1 -- 172.21.15.1:0/3378139338 wait complete. 2024-09-19T09:40:34.132 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.130+0000 7f336e24c740 1 -- start start 2024-09-19T09:40:34.132 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.130+0000 7f336e24c740 1 Processor -- start 2024-09-19T09:40:34.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.131+0000 7f336e24c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d622a8c9a0 0x55d622a96be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.131+0000 7f336e24c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d622a8d2e0 0x55d622a97120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.132+0000 7f336e24c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d622a92370 0x55d622a9e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.133 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.132+0000 7f336e24c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55d622a95390 con 0x55d622a92370 2024-09-19T09:40:34.134 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.132+0000 7f336e24c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d622979290 con 0x55d622a8c9a0 2024-09-19T09:40:34.134 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.132+0000 7f336e24c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d622a95510 con 0x55d622a8d2e0 2024-09-19T09:40:34.134 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.132+0000 7f336e24c740 10 client.0 _ll_register_callbacks cb 0x55d6229aa140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:34.135 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.133+0000 7f3369975640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d622a8c9a0 0x55d622a96be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.135 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.133+0000 7f3369975640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d622a8c9a0 0x55d622a96be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:51576/0 (socket says 172.21.15.1:51576) 2024-09-19T09:40:34.135 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.133+0000 7f3369975640 1 -- 172.21.15.1:0/3430707588 learned_addr learned my addr 172.21.15.1:0/3430707588 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:34.135 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.134+0000 7f3369975640 1 --2- 172.21.15.1:0/3430707588 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d622a92370 0x55d622a9e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.135 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.134+0000 7f3368973640 1 --2- 172.21.15.1:0/3430707588 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d622a8d2e0 0x55d622a97120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.143 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.138+0000 7f3369975640 1 -- 172.21.15.1:0/3430707588 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d622a8d2e0 msgr2=0x55d622a97120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:34.144 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.138+0000 7f3369975640 1 --2- 172.21.15.1:0/3430707588 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d622a8d2e0 0x55d622a97120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.144 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.138+0000 7f3369975640 1 -- 172.21.15.1:0/3430707588 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d622a92370 msgr2=0x55d622a9e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:34.144 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.138+0000 7f3369975640 1 --2- 172.21.15.1:0/3430707588 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d622a92370 0x55d622a9e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.144 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.139+0000 7f3369975640 1 -- 172.21.15.1:0/3430707588 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d622703210 con 0x55d622a8c9a0 2024-09-19T09:40:34.144 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.142+0000 7f3369975640 1 --2- 172.21.15.1:0/3430707588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d622a8c9a0 0x55d622a96be0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f335c004c40 tx=0x7f335c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e4f20c520a59ede server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:34.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.144+0000 7f334cff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:40:34.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.145+0000 7f334cff9640 1 -- 172.21.15.1:0/3430707588 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c00d7d0 con 0x55d622a8c9a0 2024-09-19T09:40:34.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.145+0000 7f336e24c740 1 -- 172.21.15.1:0/3430707588 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f335c004cc0 con 0x55d622a8c9a0 2024-09-19T09:40:34.146 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.145+0000 7f334cff9640 1 -- 172.21.15.1:0/3430707588 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f335c00d970 con 0x55d622a8c9a0 2024-09-19T09:40:34.149 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.148+0000 7f334cff9640 1 -- 172.21.15.1:0/3430707588 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f335c00db70 con 0x55d622a8c9a0 2024-09-19T09:40:34.149 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.148+0000 7f336e24c740 10 client.25454 fetch_fsmap learned FSMap version 19 2024-09-19T09:40:34.149 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.148+0000 7f336e24c740 1 -- 172.21.15.1:0/3430707588 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d6227cf620 con 0x55d622a8c9a0 2024-09-19T09:40:34.153 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.149+0000 7f334cff9640 1 -- 172.21.15.1:0/3430707588 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f335c004cc0 con 0x55d622a8c9a0 2024-09-19T09:40:34.153 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.149+0000 7f334cff9640 1 -- 172.21.15.1:0/3430707588 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f335c00b040 con 0x55d622a8c9a0 2024-09-19T09:40:34.153 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.152+0000 7f336e24c740 10 client.25454 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:40:34.153 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.152+0000 7f336e24c740 10 client.25454 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:34.153 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.152+0000 7f336e24c740 20 client.25454 populate_metadata read hostname 'smithi001' 2024-09-19T09:40:34.153 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.152+0000 7f336e24c740 1 --2- 172.21.15.1:0/3430707588 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d622aa24d0 0x55d622aa48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.153 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.152+0000 7f336e24c740 4 client.25454 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:34.154 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.152+0000 7f336e24c740 1 -- 172.21.15.1:0/3430707588 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6229fda20 con 0x55d622aa24d0 2024-09-19T09:40:34.160 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.157+0000 7f3368973640 1 --2- 172.21.15.1:0/3430707588 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d622aa24d0 0x55d622aa48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.163+0000 7f3368973640 1 --2- 172.21.15.1:0/3430707588 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d622aa24d0 0x55d622aa48c0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16e776f390c75608 server_cookie=ec1302c1f7ebd65e in_seq=0 out_seq=0 2024-09-19T09:40:34.165 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.163+0000 7f334cff9640 10 client.25454 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.171+0000 7f334cff9640 1 -- 172.21.15.1:0/3430707588 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d6229fda20 con 0x55d622aa24d0 2024-09-19T09:40:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.171+0000 7f334cff9640 10 client.25454 handle_command_reply: tid=0 2024-09-19T09:40:34.175 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.174+0000 7f336e24c740 1 client.25454 shutdown 2024-09-19T09:40:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.202+0000 7f336e24c740 1 -- 172.21.15.1:0/3430707588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d622a8c9a0 msgr2=0x55d622a96be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.202+0000 7f336e24c740 1 --2- 172.21.15.1:0/3430707588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d622a8c9a0 0x55d622a96be0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f335c004c40 tx=0x7f335c009780 comp rx=0 tx=0).stop 2024-09-19T09:40:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.206+0000 7f336e24c740 1 -- 172.21.15.1:0/3430707588 shutdown_connections 2024-09-19T09:40:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.206+0000 7f336e24c740 1 --2- 172.21.15.1:0/3430707588 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d622aa24d0 0x55d622aa48c0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.206+0000 7f336e24c740 1 --2- 172.21.15.1:0/3430707588 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d622a92370 0x55d622a9e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.206+0000 7f336e24c740 1 --2- 172.21.15.1:0/3430707588 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d622a8d2e0 0x55d622a97120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.206+0000 7f336e24c740 1 --2- 172.21.15.1:0/3430707588 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d622a8c9a0 0x55d622a96be0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.206+0000 7f336e24c740 1 -- 172.21.15.1:0/3430707588 >> 172.21.15.1:0/3430707588 conn(0x55d622a88010 msgr2=0x55d622a89820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.206+0000 7f334cff9640 0 client.25454 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:34.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.207+0000 7f336e24c740 1 -- 172.21.15.1:0/3430707588 shutdown_connections 2024-09-19T09:40:34.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.207+0000 7f336e24c740 1 -- 172.21.15.1:0/3430707588 wait complete. 2024-09-19T09:40:34.209 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.207+0000 7f336e24c740 20 client.25454 trim_cache size 0 max 16384 2024-09-19T09:40:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.251+0000 7f336e24c740 1 Processor -- start 2024-09-19T09:40:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.251+0000 7f336e24c740 1 -- start start 2024-09-19T09:40:34.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.252+0000 7f336e24c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d622a8c9a0 0x55d622a870b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.252+0000 7f336e24c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d622a8d2e0 0x55d622a9e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.252+0000 7f336e24c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d622a92370 0x55d622aa8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.252+0000 7f3369975640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d622a8c9a0 0x55d622a870b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.252+0000 7f3369975640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d622a8c9a0 0x55d622a870b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:51584/0 (socket says 172.21.15.1:51584) 2024-09-19T09:40:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.252+0000 7f3369975640 1 -- 172.21.15.1:0/2883732816 learned_addr learned my addr 172.21.15.1:0/2883732816 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:34.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.252+0000 7f336e24c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f33641b60d0 con 0x55d622a8d2e0 2024-09-19T09:40:34.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.252+0000 7f336e24c740 1 -- 172.21.15.1:0/2883732816 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f33641b8970 con 0x55d622a8c9a0 2024-09-19T09:40:34.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.252+0000 7f336e24c740 1 -- 172.21.15.1:0/2883732816 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f33641b6760 con 0x55d622a92370 2024-09-19T09:40:34.261 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.252+0000 7f3369975640 1 --2- 172.21.15.1:0/2883732816 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d622a92370 0x55d622aa8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.261 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.252+0000 7f3369975640 1 -- 172.21.15.1:0/2883732816 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d622a92370 msgr2=0x55d622aa8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:34.261 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.252+0000 7f3369975640 1 --2- 172.21.15.1:0/2883732816 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d622a92370 0x55d622aa8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.262 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.252+0000 7f3369975640 1 -- 172.21.15.1:0/2883732816 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d622a8d2e0 msgr2=0x55d622a9e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:34.262 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.252+0000 7f3369975640 1 --2- 172.21.15.1:0/2883732816 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d622a8d2e0 0x55d622a9e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.262 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.252+0000 7f3369975640 1 -- 172.21.15.1:0/2883732816 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d622a8df70 con 0x55d622a8c9a0 2024-09-19T09:40:34.262 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.255+0000 7f3369975640 1 --2- 172.21.15.1:0/2883732816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d622a8c9a0 0x55d622a870b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f335c00e450 tx=0x7f335c009d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a98a922ceade031b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:34.262 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.260+0000 7f334effd640 1 -- 172.21.15.1:0/2883732816 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c035040 con 0x55d622a8c9a0 2024-09-19T09:40:34.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.260+0000 7f334effd640 1 -- 172.21.15.1:0/2883732816 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f335c036040 con 0x55d622a8c9a0 2024-09-19T09:40:34.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.260+0000 7f334effd640 1 -- 172.21.15.1:0/2883732816 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c029040 con 0x55d622a8c9a0 2024-09-19T09:40:34.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.264+0000 7f336e24c740 1 -- 172.21.15.1:0/2883732816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d622a8c9a0 msgr2=0x55d622a870b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:34.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.264+0000 7f336e24c740 1 --2- 172.21.15.1:0/2883732816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d622a8c9a0 0x55d622a870b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f335c00e450 tx=0x7f335c009d90 comp rx=0 tx=0).stop 2024-09-19T09:40:34.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.265+0000 7f336e24c740 1 -- 172.21.15.1:0/2883732816 shutdown_connections 2024-09-19T09:40:34.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.265+0000 7f336e24c740 1 --2- 172.21.15.1:0/2883732816 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d622a92370 0x55d622aa8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.265+0000 7f336e24c740 1 --2- 172.21.15.1:0/2883732816 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d622a8d2e0 0x55d622a9e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.265+0000 7f336e24c740 1 --2- 172.21.15.1:0/2883732816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d622a8c9a0 0x55d622a870b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.270 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.265+0000 7f336e24c740 1 -- 172.21.15.1:0/2883732816 >> 172.21.15.1:0/2883732816 conn(0x55d622a88010 msgr2=0x55d622a869a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:34.277 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.272+0000 7f336e24c740 1 -- 172.21.15.1:0/2883732816 shutdown_connections 2024-09-19T09:40:34.278 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.277+0000 7f336e24c740 1 -- 172.21.15.1:0/2883732816 wait complete. 2024-09-19T09:40:34.279 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.278+0000 7f336e24c740 1 -- start start 2024-09-19T09:40:34.279 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.278+0000 7f336e24c740 1 Processor -- start 2024-09-19T09:40:34.280 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.279+0000 7f336e24c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d622a8c9a0 0x55d622a9b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.280 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.279+0000 7f336e24c740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d622a8d2e0 0x55d622a9b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.280 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.279+0000 7f336e24c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d622a92370 0x55d622a9c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.281 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.279+0000 7f336e24c740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f33641b6e30 con 0x55d622a8d2e0 2024-09-19T09:40:34.281 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.279+0000 7f336e24c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f33641b82a0 con 0x55d622a8c9a0 2024-09-19T09:40:34.281 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.279+0000 7f336e24c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f33641b7500 con 0x55d622a92370 2024-09-19T09:40:34.281 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.279+0000 7f336e24c740 10 client.0 _ll_register_callbacks cb 0x7f335c009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:34.281 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.279+0000 7f3369975640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d622a8c9a0 0x55d622a9b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.279+0000 7f3369975640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d622a8c9a0 0x55d622a9b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:51598/0 (socket says 172.21.15.1:51598) 2024-09-19T09:40:34.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.279+0000 7f3368973640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d622a8d2e0 0x55d622a9b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.279+0000 7f3369975640 1 -- 172.21.15.1:0/2676649230 learned_addr learned my addr 172.21.15.1:0/2676649230 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:34.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.279+0000 7f3369975640 1 --2- 172.21.15.1:0/2676649230 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d622a92370 0x55d622a9c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.280+0000 7f3369975640 1 -- 172.21.15.1:0/2676649230 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d622a92370 msgr2=0x55d622a9c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:34.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.280+0000 7f3369975640 1 --2- 172.21.15.1:0/2676649230 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d622a92370 0x55d622a9c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.280+0000 7f3369975640 1 -- 172.21.15.1:0/2676649230 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d622a8d2e0 msgr2=0x55d622a9b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:34.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.280+0000 7f3369975640 1 --2- 172.21.15.1:0/2676649230 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d622a8d2e0 0x55d622a9b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:34.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.280+0000 7f3369975640 1 -- 172.21.15.1:0/2676649230 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d622a9ce60 con 0x55d622a8c9a0 2024-09-19T09:40:34.288 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.286+0000 7f3369975640 1 --2- 172.21.15.1:0/2676649230 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d622a8c9a0 0x55d622a9b300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f335c00a010 tx=0x7f335c000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dc977b6747fc0ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:34.288 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.286+0000 7f334cff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:40:34.296 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.295+0000 7f334cff9640 1 -- 172.21.15.1:0/2676649230 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c029030 con 0x55d622a8c9a0 2024-09-19T09:40:34.296 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.295+0000 7f336e24c740 1 -- 172.21.15.1:0/2676649230 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f335c036040 con 0x55d622a8c9a0 2024-09-19T09:40:34.297 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.295+0000 7f334cff9640 1 -- 172.21.15.1:0/2676649230 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f335c02d040 con 0x55d622a8c9a0 2024-09-19T09:40:34.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.304+0000 7f334cff9640 1 -- 172.21.15.1:0/2676649230 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f335c044050 con 0x55d622a8c9a0 2024-09-19T09:40:34.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.305+0000 7f336e24c740 10 client.25460 fetch_fsmap learned FSMap version 19 2024-09-19T09:40:34.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.305+0000 7f336e24c740 1 -- 172.21.15.1:0/2676649230 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55d622a9e170 con 0x55d622a8c9a0 2024-09-19T09:40:34.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.309+0000 7f334cff9640 1 -- 172.21.15.1:0/2676649230 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f335c036040 con 0x55d622a8c9a0 2024-09-19T09:40:34.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.309+0000 7f334cff9640 1 -- 172.21.15.1:0/2676649230 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f335c00b040 con 0x55d622a8c9a0 2024-09-19T09:40:34.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.310+0000 7f336e24c740 10 client.25460 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:40:34.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.310+0000 7f336e24c740 10 client.25460 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:34.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.310+0000 7f336e24c740 20 client.25460 populate_metadata read hostname 'smithi001' 2024-09-19T09:40:34.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.310+0000 7f336e24c740 1 --2- 172.21.15.1:0/2676649230 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d622b0d390 0x55d622b0f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:34.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.310+0000 7f336e24c740 4 client.25460 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:40:34.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.310+0000 7f336e24c740 1 -- 172.21.15.1:0/2676649230 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d6229f7d70 con 0x55d622b0d390 2024-09-19T09:40:34.314 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.312+0000 7f3368973640 1 --2- 172.21.15.1:0/2676649230 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d622b0d390 0x55d622b0f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:34.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.324+0000 7f3368973640 1 --2- 172.21.15.1:0/2676649230 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d622b0d390 0x55d622b0f7b0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=387ab08a1bce631f server_cookie=f3823d72091b269 in_seq=0 out_seq=0 2024-09-19T09:40:34.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:34.327+0000 7f334cff9640 10 client.25460 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:35.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:35 smithi001 ceph-mon[31225]: pgmap v413: 97 pgs: 97 active+clean; 11 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 733 MiB/s wr, 761 op/s 2024-09-19T09:40:36.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:35 smithi022 ceph-mon[35583]: pgmap v413: 97 pgs: 97 active+clean; 11 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 733 MiB/s wr, 761 op/s 2024-09-19T09:40:36.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:35 smithi121 ceph-mon[35577]: pgmap v413: 97 pgs: 97 active+clean; 11 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 733 MiB/s wr, 761 op/s 2024-09-19T09:40:37.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:37 smithi001 ceph-mon[31225]: pgmap v414: 97 pgs: 97 active+clean; 13 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 753 MiB/s wr, 4.86k op/s 2024-09-19T09:40:38.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:37 smithi022 ceph-mon[35583]: pgmap v414: 97 pgs: 97 active+clean; 13 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 753 MiB/s wr, 4.86k op/s 2024-09-19T09:40:38.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:37 smithi121 ceph-mon[35577]: pgmap v414: 97 pgs: 97 active+clean; 13 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 753 MiB/s wr, 4.86k op/s 2024-09-19T09:40:39.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:39 smithi022 ceph-mon[35583]: pgmap v415: 97 pgs: 97 active+clean; 13 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 582 MiB/s wr, 8.92k op/s 2024-09-19T09:40:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:39.875+0000 7f334cff9640 1 -- 172.21.15.1:0/2676649230 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d6229f7d70 con 0x55d622b0d390 2024-09-19T09:40:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:39.875+0000 7f334cff9640 10 client.25460 handle_command_reply: tid=0 2024-09-19T09:40:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:39.875+0000 7f336e24c740 1 client.25460 shutdown 2024-09-19T09:40:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:39.875+0000 7f336e24c740 1 -- 172.21.15.1:0/2676649230 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d622a8c9a0 msgr2=0x55d622a9b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:39.875+0000 7f336e24c740 1 --2- 172.21.15.1:0/2676649230 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d622a8c9a0 0x55d622a9b300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f335c00a010 tx=0x7f335c000f40 comp rx=0 tx=0).stop 2024-09-19T09:40:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:39.875+0000 7f336e24c740 1 -- 172.21.15.1:0/2676649230 shutdown_connections 2024-09-19T09:40:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:39.875+0000 7f336e24c740 1 --2- 172.21.15.1:0/2676649230 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55d622b0d390 0x55d622b0f7b0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:39.875+0000 7f336e24c740 1 --2- 172.21.15.1:0/2676649230 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d622a92370 0x55d622a9c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:39.875+0000 7f336e24c740 1 --2- 172.21.15.1:0/2676649230 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55d622a8d2e0 0x55d622a9b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:39.875+0000 7f336e24c740 1 --2- 172.21.15.1:0/2676649230 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d622a8c9a0 0x55d622a9b300 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:39.875+0000 7f336e24c740 1 -- 172.21.15.1:0/2676649230 >> 172.21.15.1:0/2676649230 conn(0x55d622a88010 msgr2=0x55d622a871c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:39.875+0000 7f334cff9640 0 client.25460 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:39.876+0000 7f336e24c740 1 -- 172.21.15.1:0/2676649230 shutdown_connections 2024-09-19T09:40:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:39.876+0000 7f336e24c740 1 -- 172.21.15.1:0/2676649230 wait complete. 2024-09-19T09:40:39.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:39.876+0000 7f336e24c740 20 client.25460 trim_cache size 0 max 16384 2024-09-19T09:40:39.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:40:39.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:40:39.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:40:39.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:40:39.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:39.877+0000 7f336b3d8640 1 -- 172.21.15.1:0/4174404935 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f33500a3510 msgr2=0x7f33500a59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:39.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:39.877+0000 7f336b3d8640 1 --2- 172.21.15.1:0/4174404935 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f33500a3510 0x7f33500a59d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3360098390 tx=0x7f33600cfba0 comp rx=0 tx=0).stop 2024-09-19T09:40:39.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:39.877+0000 7f336b3d8640 1 -- 172.21.15.1:0/4174404935 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3364072d10 msgr2=0x7f33641a6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:39.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:39.877+0000 7f336b3d8640 1 --2- 172.21.15.1:0/4174404935 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3364072d10 0x7f33641a6cc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f336000e9f0 tx=0x7f336000edf0 comp rx=0 tx=0).stop 2024-09-19T09:40:39.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:39.877+0000 7f336b3d8640 1 -- 172.21.15.1:0/4174404935 shutdown_connections 2024-09-19T09:40:39.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:39.877+0000 7f336b3d8640 1 --2- 172.21.15.1:0/4174404935 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3364109700 0x7f33641ae260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:39.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:39.877+0000 7f336b3d8640 1 --2- 172.21.15.1:0/4174404935 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f33500a3510 0x7f33500a59d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:39.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:39.877+0000 7f336b3d8640 1 --2- 172.21.15.1:0/4174404935 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33640736b0 0x7f33641a7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:39.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:39.877+0000 7f336b3d8640 1 --2- 172.21.15.1:0/4174404935 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3364072d10 0x7f33641a6cc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:39.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:39.877+0000 7f336b3d8640 1 -- 172.21.15.1:0/4174404935 >> 172.21.15.1:0/4174404935 conn(0x7f336406ecd0 msgr2=0x7f33640717e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:39.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:39.877+0000 7f336b3d8640 1 -- 172.21.15.1:0/4174404935 shutdown_connections 2024-09-19T09:40:39.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:39.877+0000 7f336b3d8640 1 -- 172.21.15.1:0/4174404935 wait complete. 2024-09-19T09:40:39.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:39 smithi001 ceph-mon[31225]: pgmap v415: 97 pgs: 97 active+clean; 13 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 582 MiB/s wr, 8.92k op/s 2024-09-19T09:40:40.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:39 smithi121 ceph-mon[35577]: pgmap v415: 97 pgs: 97 active+clean; 13 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 582 MiB/s wr, 8.92k op/s 2024-09-19T09:40:42.005 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:41 smithi001 ceph-mon[31225]: pgmap v416: 97 pgs: 97 active+clean; 13 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 567 MiB/s wr, 16.33k op/s 2024-09-19T09:40:42.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:41 smithi022 ceph-mon[35583]: pgmap v416: 97 pgs: 97 active+clean; 13 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 567 MiB/s wr, 16.33k op/s 2024-09-19T09:40:42.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:41 smithi121 ceph-mon[35577]: pgmap v416: 97 pgs: 97 active+clean; 13 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 567 MiB/s wr, 16.33k op/s 2024-09-19T09:40:43.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:43 smithi001 ceph-mon[31225]: pgmap v417: 97 pgs: 97 active+clean; 13 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 412 MiB/s wr, 22.55k op/s 2024-09-19T09:40:44.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:43 smithi022 ceph-mon[35583]: pgmap v417: 97 pgs: 97 active+clean; 13 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 412 MiB/s wr, 22.55k op/s 2024-09-19T09:40:44.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:43 smithi121 ceph-mon[35577]: pgmap v417: 97 pgs: 97 active+clean; 13 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 412 MiB/s wr, 22.55k op/s 2024-09-19T09:40:45.322 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:40:45.871 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:40:45.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:45 smithi001 ceph-mon[31225]: pgmap v418: 97 pgs: 97 active+clean; 13 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 329 MiB/s wr, 24.86k op/s 2024-09-19T09:40:46.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:45 smithi022 ceph-mon[35583]: pgmap v418: 97 pgs: 97 active+clean; 13 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 329 MiB/s wr, 24.86k op/s 2024-09-19T09:40:46.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:45 smithi121 ceph-mon[35577]: pgmap v418: 97 pgs: 97 active+clean; 13 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 329 MiB/s wr, 24.86k op/s 2024-09-19T09:40:47.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:47 smithi001 ceph-mon[31225]: pgmap v419: 97 pgs: 97 active+clean; 13 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 347 MiB/s wr, 32.22k op/s 2024-09-19T09:40:48.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:47 smithi022 ceph-mon[35583]: pgmap v419: 97 pgs: 97 active+clean; 13 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 347 MiB/s wr, 32.22k op/s 2024-09-19T09:40:48.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:47 smithi121 ceph-mon[35577]: pgmap v419: 97 pgs: 97 active+clean; 13 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 347 MiB/s wr, 32.22k op/s 2024-09-19T09:40:49.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:49 smithi001 ceph-mon[31225]: pgmap v420: 97 pgs: 97 active+clean; 13 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 254 MiB/s wr, 31.58k op/s 2024-09-19T09:40:50.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:49 smithi022 ceph-mon[35583]: pgmap v420: 97 pgs: 97 active+clean; 13 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 254 MiB/s wr, 31.58k op/s 2024-09-19T09:40:50.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:49 smithi121 ceph-mon[35577]: pgmap v420: 97 pgs: 97 active+clean; 13 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 254 MiB/s wr, 31.58k op/s 2024-09-19T09:40:51.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:51 smithi001 ceph-mon[31225]: pgmap v421: 97 pgs: 97 active+clean; 13 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 284 MiB/s wr, 33.58k op/s 2024-09-19T09:40:52.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:51 smithi022 ceph-mon[35583]: pgmap v421: 97 pgs: 97 active+clean; 13 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 284 MiB/s wr, 33.58k op/s 2024-09-19T09:40:52.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:51 smithi121 ceph-mon[35577]: pgmap v421: 97 pgs: 97 active+clean; 13 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 284 MiB/s wr, 33.58k op/s 2024-09-19T09:40:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.016+0000 7f6bccc5a640 1 -- 172.21.15.1:0/1860997129 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bc8101710 msgr2=0x7f6bc8101bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.016+0000 7f6bccc5a640 1 --2- 172.21.15.1:0/1860997129 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bc8101710 0x7f6bc8101bc0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0009ca0 tx=0x7f6bc002a950 comp rx=0 tx=0).stop 2024-09-19T09:40:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.016+0000 7f6bccc5a640 1 -- 172.21.15.1:0/1860997129 shutdown_connections 2024-09-19T09:40:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.016+0000 7f6bccc5a640 1 --2- 172.21.15.1:0/1860997129 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bc8101710 0x7f6bc8101bc0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.016+0000 7f6bccc5a640 1 --2- 172.21.15.1:0/1860997129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bc8100d70 0x7f6bc81011d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.016+0000 7f6bccc5a640 1 --2- 172.21.15.1:0/1860997129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bc8100430 0x7f6bc8100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.016+0000 7f6bccc5a640 1 -- 172.21.15.1:0/1860997129 >> 172.21.15.1:0/1860997129 conn(0x7f6bc80fc1c0 msgr2=0x7f6bc80fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.016+0000 7f6bccc5a640 1 -- 172.21.15.1:0/1860997129 shutdown_connections 2024-09-19T09:40:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.016+0000 7f6bccc5a640 1 -- 172.21.15.1:0/1860997129 wait complete. 2024-09-19T09:40:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.017+0000 7f6bccc5a640 1 Processor -- start 2024-09-19T09:40:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.017+0000 7f6bccc5a640 1 -- start start 2024-09-19T09:40:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.017+0000 7f6bccc5a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bc8100430 0x7f6bc819a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.017+0000 7f6bccc5a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bc8100d70 0x7f6bc819a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.017+0000 7f6bccc5a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bc8101710 0x7f6bc81a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.017+0000 7f6bccc5a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc810f9a0 con 0x7f6bc8100430 2024-09-19T09:40:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.017+0000 7f6bccc5a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc810f820 con 0x7f6bc8100d70 2024-09-19T09:40:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.017+0000 7f6bccc5a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc810fb20 con 0x7f6bc8101710 2024-09-19T09:40:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.017+0000 7f6bc659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bc8100430 0x7f6bc819a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.017+0000 7f6bc659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bc8100430 0x7f6bc819a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34574/0 (socket says 172.21.15.1:34574) 2024-09-19T09:40:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.017+0000 7f6bc659c640 1 -- 172.21.15.1:0/1612472821 learned_addr learned my addr 172.21.15.1:0/1612472821 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:53.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.017+0000 7f6bc6d9d640 1 --2- 172.21.15.1:0/1612472821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bc8101710 0x7f6bc81a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.017+0000 7f6bc5d9b640 1 --2- 172.21.15.1:0/1612472821 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bc8100d70 0x7f6bc819a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.017+0000 7f6bc659c640 1 -- 172.21.15.1:0/1612472821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bc8101710 msgr2=0x7f6bc81a15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:53.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.017+0000 7f6bc659c640 1 --2- 172.21.15.1:0/1612472821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bc8101710 0x7f6bc81a15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.017+0000 7f6bc659c640 1 -- 172.21.15.1:0/1612472821 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bc8100d70 msgr2=0x7f6bc819a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:53.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.017+0000 7f6bc659c640 1 --2- 172.21.15.1:0/1612472821 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bc8100d70 0x7f6bc819a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.018+0000 7f6bc659c640 1 -- 172.21.15.1:0/1612472821 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc81a1c40 con 0x7f6bc8100430 2024-09-19T09:40:53.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.018+0000 7f6bc5d9b640 1 --2- 172.21.15.1:0/1612472821 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bc8100d70 0x7f6bc819a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:53.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.018+0000 7f6bc6d9d640 1 --2- 172.21.15.1:0/1612472821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bc8101710 0x7f6bc81a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:53.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.018+0000 7f6bc659c640 1 --2- 172.21.15.1:0/1612472821 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bc8100430 0x7f6bc819a020 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800d950 tx=0x7f6bb800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:53.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.018+0000 7f6bb77fe640 1 -- 172.21.15.1:0/1612472821 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8017070 con 0x7f6bc8100430 2024-09-19T09:40:53.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.018+0000 7f6bccc5a640 1 -- 172.21.15.1:0/1612472821 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bc81a1f30 con 0x7f6bc8100430 2024-09-19T09:40:53.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.018+0000 7f6bccc5a640 1 -- 172.21.15.1:0/1612472821 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bc81a23f0 con 0x7f6bc8100430 2024-09-19T09:40:53.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.018+0000 7f6bb77fe640 1 -- 172.21.15.1:0/1612472821 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bb8009c30 con 0x7f6bc8100430 2024-09-19T09:40:53.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.018+0000 7f6bb77fe640 1 -- 172.21.15.1:0/1612472821 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8020060 con 0x7f6bc8100430 2024-09-19T09:40:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.021+0000 7f6bb77fe640 1 -- 172.21.15.1:0/1612472821 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f6bb8010460 con 0x7f6bc8100430 2024-09-19T09:40:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.021+0000 7f6bcf9f5740 1 Processor -- start 2024-09-19T09:40:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.021+0000 7f6bcf9f5740 1 -- start start 2024-09-19T09:40:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.021+0000 7f6bcf9f5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618f5dc79a0 0x5618f5dc7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.021+0000 7f6bcf9f5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618f5dc82e0 0x5618f5dccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.021+0000 7f6bcf9f5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618f5dcd370 0x5618f5dcf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.021+0000 7f6bcf9f5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5618f5d2b2f0 con 0x5618f5dcd370 2024-09-19T09:40:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.021+0000 7f6bcf9f5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5618f5cd3270 con 0x5618f5dc82e0 2024-09-19T09:40:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.021+0000 7f6bcf9f5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5618f5d272b0 con 0x5618f5dc79a0 2024-09-19T09:40:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.021+0000 7f6bc5d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618f5dcd370 0x5618f5dcf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.021+0000 7f6bc5d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618f5dcd370 0x5618f5dcf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34576/0 (socket says 172.21.15.1:34576) 2024-09-19T09:40:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.021+0000 7f6bc5d9b640 1 -- 172.21.15.1:0/1531017373 learned_addr learned my addr 172.21.15.1:0/1531017373 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.021+0000 7f6bc6d9d640 1 --2- 172.21.15.1:0/1531017373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618f5dc79a0 0x5618f5dc7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.021+0000 7f6bc659c640 1 --2- 172.21.15.1:0/1531017373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618f5dc82e0 0x5618f5dccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.022+0000 7f6bc5d9b640 1 -- 172.21.15.1:0/1531017373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618f5dc79a0 msgr2=0x5618f5dc7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.022+0000 7f6bc5d9b640 1 --2- 172.21.15.1:0/1531017373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618f5dc79a0 0x5618f5dc7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.022+0000 7f6bc5d9b640 1 -- 172.21.15.1:0/1531017373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618f5dc82e0 msgr2=0x5618f5dccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.022+0000 7f6bc5d9b640 1 --2- 172.21.15.1:0/1531017373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618f5dc82e0 0x5618f5dccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.022+0000 7f6bc5d9b640 1 -- 172.21.15.1:0/1531017373 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618f5cd2340 con 0x5618f5dcd370 2024-09-19T09:40:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.022+0000 7f6bc659c640 1 --2- 172.21.15.1:0/1531017373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618f5dc82e0 0x5618f5dccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.022+0000 7f6bc5d9b640 1 --2- 172.21.15.1:0/1531017373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618f5dcd370 0x5618f5dcf830 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc00bd30 tx=0x7f6bbc00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ed402d2c6de3cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.022+0000 7f6bb77fe640 1 --2- 172.21.15.1:0/1612472821 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f6bb00a3240 0x7f6bb00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.022+0000 7f6bb4ff9640 1 -- 172.21.15.1:0/1531017373 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc015070 con 0x5618f5dcd370 2024-09-19T09:40:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.022+0000 7f6bb4ff9640 1 -- 172.21.15.1:0/1531017373 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bbc00be20 con 0x5618f5dcd370 2024-09-19T09:40:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.022+0000 7f6bb4ff9640 1 -- 172.21.15.1:0/1531017373 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc011aa0 con 0x5618f5dcd370 2024-09-19T09:40:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.022+0000 7f6bc6d9d640 1 --2- 172.21.15.1:0/1612472821 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f6bb00a3240 0x7f6bb00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.022+0000 7f6bb77fe640 1 -- 172.21.15.1:0/1612472821 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f6bb80cf1f0 con 0x7f6bc8100430 2024-09-19T09:40:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.023+0000 7f6bcf9f5740 1 -- 172.21.15.1:0/1531017373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618f5dcd370 msgr2=0x5618f5dcf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.023+0000 7f6bc6d9d640 1 --2- 172.21.15.1:0/1612472821 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f6bb00a3240 0x7f6bb00a5700 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0004af0 tx=0x7f6bc002fe10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.023+0000 7f6bcf9f5740 1 --2- 172.21.15.1:0/1531017373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618f5dcd370 0x5618f5dcf830 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc00bd30 tx=0x7f6bbc00f730 comp rx=0 tx=0).stop 2024-09-19T09:40:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.023+0000 7f6bcf9f5740 1 -- 172.21.15.1:0/1531017373 shutdown_connections 2024-09-19T09:40:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.023+0000 7f6bcf9f5740 1 --2- 172.21.15.1:0/1531017373 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618f5dcd370 0x5618f5dcf830 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.023+0000 7f6bcf9f5740 1 --2- 172.21.15.1:0/1531017373 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618f5dc82e0 0x5618f5dccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.023+0000 7f6bcf9f5740 1 --2- 172.21.15.1:0/1531017373 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618f5dc79a0 0x5618f5dc7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.023+0000 7f6bcf9f5740 1 -- 172.21.15.1:0/1531017373 >> 172.21.15.1:0/1531017373 conn(0x5618f5dc3010 msgr2=0x5618f5dc3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.023+0000 7f6bcf9f5740 1 -- 172.21.15.1:0/1531017373 shutdown_connections 2024-09-19T09:40:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.023+0000 7f6bcf9f5740 1 -- 172.21.15.1:0/1531017373 wait complete. 2024-09-19T09:40:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.023+0000 7f6bcf9f5740 1 -- start start 2024-09-19T09:40:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.023+0000 7f6bcf9f5740 1 Processor -- start 2024-09-19T09:40:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.024+0000 7f6bcf9f5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618f5dc79a0 0x5618f5dd1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.024+0000 7f6bcf9f5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618f5dc82e0 0x5618f5dd2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.024+0000 7f6bcf9f5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618f5dcd370 0x5618f5dd9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.024+0000 7f6bcf9f5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5618f5dd0340 con 0x5618f5dcd370 2024-09-19T09:40:53.031 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.024+0000 7f6bcf9f5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5618f5cb4290 con 0x5618f5dc82e0 2024-09-19T09:40:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.024+0000 7f6bcf9f5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5618f5dd04c0 con 0x5618f5dc79a0 2024-09-19T09:40:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.024+0000 7f6bcf9f5740 10 client.0 _ll_register_callbacks cb 0x5618f5ce5140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.024+0000 7f6bc6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618f5dcd370 0x5618f5dd9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.024+0000 7f6bc6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618f5dcd370 0x5618f5dd9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34580/0 (socket says 172.21.15.1:34580) 2024-09-19T09:40:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.024+0000 7f6bc6d9d640 1 -- 172.21.15.1:0/4033460558 learned_addr learned my addr 172.21.15.1:0/4033460558 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.024+0000 7f6bc659c640 1 --2- 172.21.15.1:0/4033460558 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618f5dc79a0 0x5618f5dd1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.024+0000 7f6bc5d9b640 1 --2- 172.21.15.1:0/4033460558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618f5dc82e0 0x5618f5dd2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.024+0000 7f6bc6d9d640 1 -- 172.21.15.1:0/4033460558 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618f5dc79a0 msgr2=0x5618f5dd1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.024+0000 7f6bc6d9d640 1 --2- 172.21.15.1:0/4033460558 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618f5dc79a0 0x5618f5dd1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.024+0000 7f6bc6d9d640 1 -- 172.21.15.1:0/4033460558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618f5dc82e0 msgr2=0x5618f5dd2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.024+0000 7f6bc6d9d640 1 --2- 172.21.15.1:0/4033460558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618f5dc82e0 0x5618f5dd2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.032 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.024+0000 7f6bc6d9d640 1 -- 172.21.15.1:0/4033460558 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618f5a3e210 con 0x5618f5dcd370 2024-09-19T09:40:53.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.024+0000 7f6bc5d9b640 1 --2- 172.21.15.1:0/4033460558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618f5dc82e0 0x5618f5dd2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:53.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.024+0000 7f6bc6d9d640 1 --2- 172.21.15.1:0/4033460558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618f5dcd370 0x5618f5dd9170 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0009ca0 tx=0x7f6bc002a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d30b1ccdb1656c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:53.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.024+0000 7f6badffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:40:53.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.025+0000 7f6badffb640 1 -- 172.21.15.1:0/4033460558 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0034040 con 0x5618f5dcd370 2024-09-19T09:40:53.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.025+0000 7f6badffb640 1 -- 172.21.15.1:0/4033460558 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f6bc0003e40 con 0x5618f5dcd370 2024-09-19T09:40:53.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.025+0000 7f6bcf9f5740 1 -- 172.21.15.1:0/4033460558 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bbc00be20 con 0x5618f5dcd370 2024-09-19T09:40:53.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.025+0000 7f6badffb640 1 -- 172.21.15.1:0/4033460558 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6bc0004250 con 0x5618f5dcd370 2024-09-19T09:40:53.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.025+0000 7f6bcf9f5740 10 client.15816 fetch_fsmap learned FSMap version 19 2024-09-19T09:40:53.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.025+0000 7f6bcf9f5740 1 -- 172.21.15.1:0/4033460558 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5618f5b0a620 con 0x5618f5dcd370 2024-09-19T09:40:53.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.025+0000 7f6badffb640 1 -- 172.21.15.1:0/4033460558 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bbc00be20 con 0x5618f5dcd370 2024-09-19T09:40:53.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.025+0000 7f6badffb640 1 -- 172.21.15.1:0/4033460558 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f6bc0052bf0 con 0x5618f5dcd370 2024-09-19T09:40:53.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.025+0000 7f6bcf9f5740 10 client.15816 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:40:53.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.025+0000 7f6bcf9f5740 10 client.15816 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:53.033 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.025+0000 7f6bcf9f5740 20 client.15816 populate_metadata read hostname 'smithi001' 2024-09-19T09:40:53.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.025+0000 7f6bcf9f5740 1 --2- 172.21.15.1:0/4033460558 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5618f5ddd940 0x5618f5ddfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.025+0000 7f6bcf9f5740 4 client.15816 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:53.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.025+0000 7f6bcf9f5740 1 -- 172.21.15.1:0/4033460558 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618f5d38a20 con 0x5618f5ddd940 2024-09-19T09:40:53.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.025+0000 7f6bc659c640 1 --2- 172.21.15.1:0/4033460558 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5618f5ddd940 0x5618f5ddfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.026+0000 7f6bc659c640 1 --2- 172.21.15.1:0/4033460558 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5618f5ddd940 0x5618f5ddfd50 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da6f408e1237542 server_cookie=f109182cd403cd63 in_seq=0 out_seq=0 2024-09-19T09:40:53.034 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.026+0000 7f6badffb640 10 client.15816 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:53.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.027+0000 7f6badffb640 1 -- 172.21.15.1:0/4033460558 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5618f5d38a20 con 0x5618f5ddd940 2024-09-19T09:40:53.035 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.027+0000 7f6badffb640 10 client.15816 handle_command_reply: tid=0 2024-09-19T09:40:53.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.027+0000 7f6bcf9f5740 1 client.15816 shutdown 2024-09-19T09:40:53.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.027+0000 7f6bcf9f5740 1 -- 172.21.15.1:0/4033460558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618f5dcd370 msgr2=0x5618f5dd9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:53.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.027+0000 7f6bcf9f5740 1 --2- 172.21.15.1:0/4033460558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618f5dcd370 0x5618f5dd9170 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0009ca0 tx=0x7f6bc002a950 comp rx=0 tx=0).stop 2024-09-19T09:40:53.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.027+0000 7f6bcf9f5740 1 -- 172.21.15.1:0/4033460558 shutdown_connections 2024-09-19T09:40:53.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.027+0000 7f6bcf9f5740 1 --2- 172.21.15.1:0/4033460558 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5618f5ddd940 0x5618f5ddfd50 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.027+0000 7f6bcf9f5740 1 --2- 172.21.15.1:0/4033460558 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618f5dcd370 0x5618f5dd9170 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.027+0000 7f6bcf9f5740 1 --2- 172.21.15.1:0/4033460558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618f5dc82e0 0x5618f5dd2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.027+0000 7f6bcf9f5740 1 --2- 172.21.15.1:0/4033460558 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618f5dc79a0 0x5618f5dd1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.027+0000 7f6bcf9f5740 1 -- 172.21.15.1:0/4033460558 >> 172.21.15.1:0/4033460558 conn(0x5618f5dc3010 msgr2=0x5618f5dc4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:53.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.027+0000 7f6badffb640 0 client.15816 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:53.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.027+0000 7f6bcf9f5740 1 -- 172.21.15.1:0/4033460558 shutdown_connections 2024-09-19T09:40:53.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.027+0000 7f6bcf9f5740 1 -- 172.21.15.1:0/4033460558 wait complete. 2024-09-19T09:40:53.036 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.027+0000 7f6bcf9f5740 20 client.15816 trim_cache size 0 max 16384 2024-09-19T09:40:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.042+0000 7f6bcf9f5740 1 Processor -- start 2024-09-19T09:40:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.042+0000 7f6bcf9f5740 1 -- start start 2024-09-19T09:40:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.042+0000 7f6bcf9f5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618f5dc79a0 0x5618f5dc3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.042+0000 7f6bcf9f5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618f5dc82e0 0x5618f5dd9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.042+0000 7f6bcf9f5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618f5dcd370 0x5618f5dc4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.042+0000 7f6bcf9f5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba800c490 con 0x5618f5dcd370 2024-09-19T09:40:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.042+0000 7f6bcf9f5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba800ed30 con 0x5618f5dc82e0 2024-09-19T09:40:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.042+0000 7f6bcf9f5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba800cb20 con 0x5618f5dc79a0 2024-09-19T09:40:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.042+0000 7f6bc6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618f5dcd370 0x5618f5dc4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.042+0000 7f6bc6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618f5dcd370 0x5618f5dc4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34594/0 (socket says 172.21.15.1:34594) 2024-09-19T09:40:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.042+0000 7f6bc6d9d640 1 -- 172.21.15.1:0/2002518379 learned_addr learned my addr 172.21.15.1:0/2002518379 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.042+0000 7f6bc659c640 1 --2- 172.21.15.1:0/2002518379 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618f5dc79a0 0x5618f5dc3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.042+0000 7f6bc5d9b640 1 --2- 172.21.15.1:0/2002518379 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618f5dc82e0 0x5618f5dd9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.042+0000 7f6bc6d9d640 1 -- 172.21.15.1:0/2002518379 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618f5dc79a0 msgr2=0x5618f5dc3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.042+0000 7f6bc6d9d640 1 --2- 172.21.15.1:0/2002518379 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618f5dc79a0 0x5618f5dc3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.042+0000 7f6bc6d9d640 1 -- 172.21.15.1:0/2002518379 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618f5dc82e0 msgr2=0x5618f5dd9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:53.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.042+0000 7f6bc6d9d640 1 --2- 172.21.15.1:0/2002518379 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618f5dc82e0 0x5618f5dd9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.042+0000 7f6bc6d9d640 1 -- 172.21.15.1:0/2002518379 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618f5dbe2d0 con 0x5618f5dcd370 2024-09-19T09:40:53.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.042+0000 7f6bc5d9b640 1 --2- 172.21.15.1:0/2002518379 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618f5dc82e0 0x5618f5dd9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:40:53.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.043+0000 7f6bc6d9d640 1 --2- 172.21.15.1:0/2002518379 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618f5dcd370 0x5618f5dc4400 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6bc002ae70 tx=0x7f6bc002fd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbfd697d843e84cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:53.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.043+0000 7f6baffff640 1 -- 172.21.15.1:0/2002518379 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0061020 con 0x5618f5dcd370 2024-09-19T09:40:53.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.043+0000 7f6baffff640 1 -- 172.21.15.1:0/2002518379 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bc004d070 con 0x5618f5dcd370 2024-09-19T09:40:53.046 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.043+0000 7f6baffff640 1 -- 172.21.15.1:0/2002518379 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0034070 con 0x5618f5dcd370 2024-09-19T09:40:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.043+0000 7f6bcf9f5740 1 -- 172.21.15.1:0/2002518379 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618f5dcd370 msgr2=0x5618f5dc4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.043+0000 7f6bcf9f5740 1 --2- 172.21.15.1:0/2002518379 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618f5dcd370 0x5618f5dc4400 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6bc002ae70 tx=0x7f6bc002fd50 comp rx=0 tx=0).stop 2024-09-19T09:40:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.043+0000 7f6bcf9f5740 1 -- 172.21.15.1:0/2002518379 shutdown_connections 2024-09-19T09:40:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.043+0000 7f6bcf9f5740 1 --2- 172.21.15.1:0/2002518379 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618f5dcd370 0x5618f5dc4400 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.043+0000 7f6bcf9f5740 1 --2- 172.21.15.1:0/2002518379 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618f5dc82e0 0x5618f5dd9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.043+0000 7f6bcf9f5740 1 --2- 172.21.15.1:0/2002518379 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618f5dc79a0 0x5618f5dc3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.043+0000 7f6bcf9f5740 1 -- 172.21.15.1:0/2002518379 >> 172.21.15.1:0/2002518379 conn(0x5618f5dc3010 msgr2=0x5618f5dc9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.043+0000 7f6bcf9f5740 1 -- 172.21.15.1:0/2002518379 shutdown_connections 2024-09-19T09:40:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.043+0000 7f6bcf9f5740 1 -- 172.21.15.1:0/2002518379 wait complete. 2024-09-19T09:40:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.044+0000 7f6bcf9f5740 1 -- start start 2024-09-19T09:40:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.044+0000 7f6bcf9f5740 1 Processor -- start 2024-09-19T09:40:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.044+0000 7f6bcf9f5740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618f5dc79a0 0x5618f5dd5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.044+0000 7f6bcf9f5740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618f5dc82e0 0x5618f5dd63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.044+0000 7f6bcf9f5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618f5dcd370 0x5618f5e46620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.044+0000 7f6bcf9f5740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba800d1f0 con 0x5618f5dc79a0 2024-09-19T09:40:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.044+0000 7f6bcf9f5740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba800e660 con 0x5618f5dc82e0 2024-09-19T09:40:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.044+0000 7f6bcf9f5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba800d8c0 con 0x5618f5dcd370 2024-09-19T09:40:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.044+0000 7f6bcf9f5740 10 client.0 _ll_register_callbacks cb 0x7f6bc0009800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.044+0000 7f6bc659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618f5dc79a0 0x5618f5dd5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.044+0000 7f6bc659c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618f5dc79a0 0x5618f5dd5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34596/0 (socket says 172.21.15.1:34596) 2024-09-19T09:40:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.044+0000 7f6bc659c640 1 -- 172.21.15.1:0/1970433503 learned_addr learned my addr 172.21.15.1:0/1970433503 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.044+0000 7f6bc5d9b640 1 --2- 172.21.15.1:0/1970433503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618f5dc82e0 0x5618f5dd63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.044+0000 7f6bc6d9d640 1 --2- 172.21.15.1:0/1970433503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618f5dcd370 0x5618f5e46620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.044+0000 7f6bc659c640 1 -- 172.21.15.1:0/1970433503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618f5dcd370 msgr2=0x5618f5e46620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.044+0000 7f6bc659c640 1 --2- 172.21.15.1:0/1970433503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618f5dcd370 0x5618f5e46620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.052 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.044+0000 7f6bc659c640 1 -- 172.21.15.1:0/1970433503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618f5dc82e0 msgr2=0x5618f5dd63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.044+0000 7f6bc659c640 1 --2- 172.21.15.1:0/1970433503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618f5dc82e0 0x5618f5dd63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.044+0000 7f6bc659c640 1 -- 172.21.15.1:0/1970433503 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618f5e46b60 con 0x5618f5dc79a0 2024-09-19T09:40:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.045+0000 7f6bc659c640 1 --2- 172.21.15.1:0/1970433503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618f5dc79a0 0x5618f5dd5ea0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009610 tx=0x7f6bb800bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ca38e9a597a081 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.045+0000 7f6badffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:40:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.045+0000 7f6badffb640 1 -- 172.21.15.1:0/1970433503 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb809b810 con 0x5618f5dc79a0 2024-09-19T09:40:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.045+0000 7f6bcf9f5740 1 -- 172.21.15.1:0/1970433503 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bc004d070 con 0x5618f5dc79a0 2024-09-19T09:40:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.045+0000 7f6badffb640 1 -- 172.21.15.1:0/1970433503 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f6bb8097e80 con 0x5618f5dc79a0 2024-09-19T09:40:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.045+0000 7f6badffb640 1 -- 172.21.15.1:0/1970433503 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f6bb809fbc0 con 0x5618f5dc79a0 2024-09-19T09:40:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.045+0000 7f6bcf9f5740 10 client.15822 fetch_fsmap learned FSMap version 19 2024-09-19T09:40:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.045+0000 7f6bcf9f5740 1 -- 172.21.15.1:0/1970433503 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5618f5e47db0 con 0x5618f5dc79a0 2024-09-19T09:40:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.045+0000 7f6badffb640 1 -- 172.21.15.1:0/1970433503 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bc004d070 con 0x5618f5dc79a0 2024-09-19T09:40:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.045+0000 7f6badffb640 1 -- 172.21.15.1:0/1970433503 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f6bb8023060 con 0x5618f5dc79a0 2024-09-19T09:40:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.045+0000 7f6bcf9f5740 10 client.15822 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:40:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.045+0000 7f6bcf9f5740 10 client.15822 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.045+0000 7f6bcf9f5740 20 client.15822 populate_metadata read hostname 'smithi001' 2024-09-19T09:40:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.045+0000 7f6bcf9f5740 1 --2- 172.21.15.1:0/1970433503 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5618f5e48730 0x5618f5e4ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.045+0000 7f6bcf9f5740 4 client.15822 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:40:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.045+0000 7f6bcf9f5740 1 -- 172.21.15.1:0/1970433503 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5618f5d32d70 con 0x5618f5e48730 2024-09-19T09:40:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.046+0000 7f6bc5d9b640 1 --2- 172.21.15.1:0/1970433503 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5618f5e48730 0x5618f5e4ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.046+0000 7f6bc5d9b640 1 --2- 172.21.15.1:0/1970433503 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5618f5e48730 0x5618f5e4ab50 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d614069e2138e7d server_cookie=9e6bd21177ac1b9a in_seq=0 out_seq=0 2024-09-19T09:40:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.046+0000 7f6badffb640 10 client.15822 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:53.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.424+0000 7f6badffb640 1 -- 172.21.15.1:0/1970433503 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5618f5d32d70 con 0x5618f5e48730 2024-09-19T09:40:53.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.424+0000 7f6badffb640 10 client.15822 handle_command_reply: tid=0 2024-09-19T09:40:53.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.424+0000 7f6bcf9f5740 1 client.15822 shutdown 2024-09-19T09:40:53.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.424+0000 7f6bcf9f5740 1 -- 172.21.15.1:0/1970433503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618f5dc79a0 msgr2=0x5618f5dd5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.425+0000 7f6bcf9f5740 1 --2- 172.21.15.1:0/1970433503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618f5dc79a0 0x5618f5dd5ea0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009610 tx=0x7f6bb800bf60 comp rx=0 tx=0).stop 2024-09-19T09:40:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.425+0000 7f6bcf9f5740 1 -- 172.21.15.1:0/1970433503 shutdown_connections 2024-09-19T09:40:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.425+0000 7f6bcf9f5740 1 --2- 172.21.15.1:0/1970433503 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5618f5e48730 0x5618f5e4ab50 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.425+0000 7f6bcf9f5740 1 --2- 172.21.15.1:0/1970433503 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618f5dcd370 0x5618f5e46620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.425+0000 7f6badffb640 0 client.15822 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.425+0000 7f6bcf9f5740 1 --2- 172.21.15.1:0/1970433503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618f5dc82e0 0x5618f5dd63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.425+0000 7f6bcf9f5740 1 --2- 172.21.15.1:0/1970433503 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618f5dc79a0 0x5618f5dd5ea0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.425+0000 7f6bcf9f5740 1 -- 172.21.15.1:0/1970433503 >> 172.21.15.1:0/1970433503 conn(0x5618f5dc3010 msgr2=0x5618f5dd08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.425+0000 7f6bcf9f5740 1 -- 172.21.15.1:0/1970433503 shutdown_connections 2024-09-19T09:40:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.426+0000 7f6bcf9f5740 1 -- 172.21.15.1:0/1970433503 wait complete. 2024-09-19T09:40:53.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.426+0000 7f6bcf9f5740 20 client.15822 trim_cache size 0 max 16384 2024-09-19T09:40:53.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:40:53.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:40:53.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:40:53.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:40:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.427+0000 7f6bccc5a640 1 -- 172.21.15.1:0/1612472821 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f6bb00a3240 msgr2=0x7f6bb00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.427+0000 7f6bccc5a640 1 --2- 172.21.15.1:0/1612472821 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f6bb00a3240 0x7f6bb00a5700 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0004af0 tx=0x7f6bc002fe10 comp rx=0 tx=0).stop 2024-09-19T09:40:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.427+0000 7f6bccc5a640 1 -- 172.21.15.1:0/1612472821 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bc8100430 msgr2=0x7f6bc819a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.427+0000 7f6bccc5a640 1 --2- 172.21.15.1:0/1612472821 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bc8100430 0x7f6bc819a020 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800d950 tx=0x7f6bb800de10 comp rx=0 tx=0).stop 2024-09-19T09:40:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.427+0000 7f6bccc5a640 1 -- 172.21.15.1:0/1612472821 shutdown_connections 2024-09-19T09:40:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.427+0000 7f6bccc5a640 1 --2- 172.21.15.1:0/1612472821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bc8101710 0x7f6bc81a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.427+0000 7f6bccc5a640 1 --2- 172.21.15.1:0/1612472821 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f6bb00a3240 0x7f6bb00a5700 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.427+0000 7f6bccc5a640 1 --2- 172.21.15.1:0/1612472821 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bc8100d70 0x7f6bc819a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.427+0000 7f6bccc5a640 1 --2- 172.21.15.1:0/1612472821 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6bc8100430 0x7f6bc819a020 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.427+0000 7f6bccc5a640 1 -- 172.21.15.1:0/1612472821 >> 172.21.15.1:0/1612472821 conn(0x7f6bc80fc1c0 msgr2=0x7f6bc80fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.427+0000 7f6bccc5a640 1 -- 172.21.15.1:0/1612472821 shutdown_connections 2024-09-19T09:40:53.431 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:40:53.427+0000 7f6bccc5a640 1 -- 172.21.15.1:0/1612472821 wait complete. 2024-09-19T09:40:53.716 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:40:53.717 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "no active scrubs running", 2024-09-19T09:40:53.717 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": {} 2024-09-19T09:40:53.717 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:40:53.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.057+0000 7fdae5365640 1 -- 172.21.15.1:0/1685676721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdae0109450 msgr2=0x7fdae0110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:53.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.057+0000 7fdae5365640 1 --2- 172.21.15.1:0/1685676721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdae0109450 0x7fdae0110250 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdad0009900 tx=0x7fdad002a420 comp rx=0 tx=0).stop 2024-09-19T09:40:53.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.059+0000 7fdae5365640 1 -- 172.21.15.1:0/1685676721 shutdown_connections 2024-09-19T09:40:53.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.059+0000 7fdae5365640 1 --2- 172.21.15.1:0/1685676721 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdae011b140 0x7fdae011d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.059+0000 7fdae5365640 1 --2- 172.21.15.1:0/1685676721 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdae0109830 0x7fdae0109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.059+0000 7fdae5365640 1 --2- 172.21.15.1:0/1685676721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdae0109450 0x7fdae0110250 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.059+0000 7fdae5365640 1 -- 172.21.15.1:0/1685676721 >> 172.21.15.1:0/1685676721 conn(0x7fdae006e140 msgr2=0x7fdae006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:53.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.060+0000 7fdae5365640 1 -- 172.21.15.1:0/1685676721 shutdown_connections 2024-09-19T09:40:53.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.060+0000 7fdae5365640 1 -- 172.21.15.1:0/1685676721 wait complete. 2024-09-19T09:40:53.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.060+0000 7fdae5365640 1 Processor -- start 2024-09-19T09:40:53.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.061+0000 7fdae5365640 1 -- start start 2024-09-19T09:40:53.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.061+0000 7fdae5365640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdae0109450 0x7fdae01a73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.062+0000 7fdae5365640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdae0109830 0x7fdae01a7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.062+0000 7fdadeffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdae0109450 0x7fdae01a73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.062+0000 7fdadeffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdae0109450 0x7fdae01a73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:41802/0 (socket says 172.21.15.1:41802) 2024-09-19T09:40:53.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.062+0000 7fdadeffd640 1 -- 172.21.15.1:0/664426339 learned_addr learned my addr 172.21.15.1:0/664426339 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:53.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.062+0000 7fdae5365640 1 --2- 172.21.15.1:0/664426339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdae011b140 0x7fdae01abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.062+0000 7fdade7fc640 1 --2- 172.21.15.1:0/664426339 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdae0109830 0x7fdae01a7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.062+0000 7fdae5365640 1 -- 172.21.15.1:0/664426339 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdae0120eb0 con 0x7fdae011b140 2024-09-19T09:40:53.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.062+0000 7fdae5365640 1 -- 172.21.15.1:0/664426339 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdae0120d30 con 0x7fdae0109450 2024-09-19T09:40:53.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.062+0000 7fdae5365640 1 -- 172.21.15.1:0/664426339 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdae0121030 con 0x7fdae0109830 2024-09-19T09:40:53.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.062+0000 7fdadf7fe640 1 --2- 172.21.15.1:0/664426339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdae011b140 0x7fdae01abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.063+0000 7fdadf7fe640 1 -- 172.21.15.1:0/664426339 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdae0109830 msgr2=0x7fdae01a7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:53.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.063+0000 7fdadf7fe640 1 --2- 172.21.15.1:0/664426339 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdae0109830 0x7fdae01a7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.063+0000 7fdadf7fe640 1 -- 172.21.15.1:0/664426339 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdae0109450 msgr2=0x7fdae01a73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:53.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.063+0000 7fdadf7fe640 1 --2- 172.21.15.1:0/664426339 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdae0109450 0x7fdae01a73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.063+0000 7fdadf7fe640 1 -- 172.21.15.1:0/664426339 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdae01ac3a0 con 0x7fdae011b140 2024-09-19T09:40:53.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.064+0000 7fdadf7fe640 1 --2- 172.21.15.1:0/664426339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdae011b140 0x7fdae01abcc0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fdad800caf0 tx=0x7fdad80020e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:53.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.065+0000 7fdac7fff640 1 -- 172.21.15.1:0/664426339 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad8016030 con 0x7fdae011b140 2024-09-19T09:40:53.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.065+0000 7fdac7fff640 1 -- 172.21.15.1:0/664426339 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdad8003e50 con 0x7fdae011b140 2024-09-19T09:40:53.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.065+0000 7fdac7fff640 1 -- 172.21.15.1:0/664426339 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad8004690 con 0x7fdae011b140 2024-09-19T09:40:53.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.065+0000 7fdae5365640 1 -- 172.21.15.1:0/664426339 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdae01ac690 con 0x7fdae011b140 2024-09-19T09:40:53.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.065+0000 7fdae5365640 1 -- 172.21.15.1:0/664426339 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdae01b3f70 con 0x7fdae011b140 2024-09-19T09:40:53.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.072+0000 7fdae773e740 1 Processor -- start 2024-09-19T09:40:53.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.074+0000 7fdac7fff640 1 -- 172.21.15.1:0/664426339 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fdad8019070 con 0x7fdae011b140 2024-09-19T09:40:53.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.074+0000 7fdae773e740 1 -- start start 2024-09-19T09:40:53.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.074+0000 7fdae773e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f22f1be4a0 0x55f22f1be880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.075+0000 7fdae773e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f22f1bedc0 0x55f22f1c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.075+0000 7fdae773e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f22f1c9680 0x55f22f1cba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.075+0000 7fdae773e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f22f1242e0 con 0x55f22f1c9680 2024-09-19T09:40:53.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.075+0000 7fdae773e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f22f0cbce0 con 0x55f22f1bedc0 2024-09-19T09:40:53.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.075+0000 7fdae773e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f22f1202a0 con 0x55f22f1be4a0 2024-09-19T09:40:53.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.075+0000 7fdadeffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f22f1bedc0 0x55f22f1c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.075+0000 7fdade7fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f22f1be4a0 0x55f22f1be880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.075+0000 7fdade7fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f22f1be4a0 0x55f22f1be880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:53006/0 (socket says 172.21.15.1:53006) 2024-09-19T09:40:53.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.075+0000 7fdade7fc640 1 -- 172.21.15.1:0/914165728 learned_addr learned my addr 172.21.15.1:0/914165728 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:53.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.076+0000 7fdade7fc640 1 --2- 172.21.15.1:0/914165728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f22f1c9680 0x55f22f1cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.076+0000 7fdac7fff640 1 --2- 172.21.15.1:0/664426339 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fdac80a3450 0x7fdac80a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.076+0000 7fdade7fc640 1 -- 172.21.15.1:0/914165728 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f22f1bedc0 msgr2=0x55f22f1c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:53.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.076+0000 7fdade7fc640 1 --2- 172.21.15.1:0/914165728 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f22f1bedc0 0x55f22f1c9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.076+0000 7fdade7fc640 1 -- 172.21.15.1:0/914165728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f22f1c9680 msgr2=0x55f22f1cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:53.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.076+0000 7fdade7fc640 1 --2- 172.21.15.1:0/914165728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f22f1c9680 0x55f22f1cba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.076+0000 7fdade7fc640 1 -- 172.21.15.1:0/914165728 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f22f0b0440 con 0x55f22f1be4a0 2024-09-19T09:40:53.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.076+0000 7fdade7fc640 1 --2- 172.21.15.1:0/914165728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f22f1be4a0 0x55f22f1be880 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdad4017700 tx=0x7fdad4009590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5482111a7c5ade71 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:53.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.077+0000 7fdac7fff640 1 -- 172.21.15.1:0/664426339 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fdad80cf330 con 0x7fdae011b140 2024-09-19T09:40:53.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.077+0000 7fdac57fa640 1 -- 172.21.15.1:0/914165728 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad4010650 con 0x55f22f1be4a0 2024-09-19T09:40:53.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.077+0000 7fdadf7fe640 1 --2- 172.21.15.1:0/664426339 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fdac80a3450 0x7fdac80a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.077+0000 7fdac57fa640 1 -- 172.21.15.1:0/914165728 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdad401d070 con 0x55f22f1be4a0 2024-09-19T09:40:53.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.078+0000 7fdac57fa640 1 -- 172.21.15.1:0/914165728 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad4015ac0 con 0x55f22f1be4a0 2024-09-19T09:40:53.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.078+0000 7fdadf7fe640 1 --2- 172.21.15.1:0/664426339 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fdac80a3450 0x7fdac80a5910 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdad8004a80 tx=0x7fdad80040b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:53.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.078+0000 7fdae773e740 1 -- 172.21.15.1:0/914165728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f22f1be4a0 msgr2=0x55f22f1be880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:53.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.079+0000 7fdae773e740 1 --2- 172.21.15.1:0/914165728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f22f1be4a0 0x55f22f1be880 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdad4017700 tx=0x7fdad4009590 comp rx=0 tx=0).stop 2024-09-19T09:40:53.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.079+0000 7fdae773e740 1 -- 172.21.15.1:0/914165728 shutdown_connections 2024-09-19T09:40:53.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.079+0000 7fdae773e740 1 --2- 172.21.15.1:0/914165728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f22f1c9680 0x55f22f1cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.079+0000 7fdae773e740 1 --2- 172.21.15.1:0/914165728 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f22f1bedc0 0x55f22f1c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.079+0000 7fdae773e740 1 --2- 172.21.15.1:0/914165728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f22f1be4a0 0x55f22f1be880 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.079+0000 7fdae773e740 1 -- 172.21.15.1:0/914165728 >> 172.21.15.1:0/914165728 conn(0x55f22f1baa30 msgr2=0x55f22f1bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:53.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.079+0000 7fdae773e740 1 -- 172.21.15.1:0/914165728 shutdown_connections 2024-09-19T09:40:53.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.079+0000 7fdae773e740 1 -- 172.21.15.1:0/914165728 wait complete. 2024-09-19T09:40:53.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.079+0000 7fdae773e740 1 -- start start 2024-09-19T09:40:53.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.079+0000 7fdae773e740 1 Processor -- start 2024-09-19T09:40:53.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.080+0000 7fdae773e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f22f1be4a0 0x55f22f1c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.080+0000 7fdae773e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f22f1bedc0 0x55f22f1c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.080+0000 7fdae773e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f22f1c9680 0x55f22f1c6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.080+0000 7fdae773e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f22f1cc2a0 con 0x55f22f1bedc0 2024-09-19T09:40:53.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.080+0000 7fdae773e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f22f0df050 con 0x55f22f1be4a0 2024-09-19T09:40:53.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.080+0000 7fdae773e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f22f1cc420 con 0x55f22f1c9680 2024-09-19T09:40:53.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.080+0000 7fdae773e740 10 client.0 _ll_register_callbacks cb 0x55f22f11f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:53.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.080+0000 7fdadeffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f22f1bedc0 0x55f22f1c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.080+0000 7fdade7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f22f1be4a0 0x55f22f1c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.080+0000 7fdadeffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f22f1bedc0 0x55f22f1c61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34538/0 (socket says 172.21.15.1:34538) 2024-09-19T09:40:53.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.080+0000 7fdadeffd640 1 -- 172.21.15.1:0/4056690865 learned_addr learned my addr 172.21.15.1:0/4056690865 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:53.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.080+0000 7fdade7fc640 1 --2- 172.21.15.1:0/4056690865 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f22f1c9680 0x55f22f1c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.080+0000 7fdadeffd640 1 -- 172.21.15.1:0/4056690865 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f22f1c9680 msgr2=0x55f22f1c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:53.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.080+0000 7fdadeffd640 1 --2- 172.21.15.1:0/4056690865 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f22f1c9680 0x55f22f1c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.080+0000 7fdadeffd640 1 -- 172.21.15.1:0/4056690865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f22f1be4a0 msgr2=0x55f22f1c8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:53.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.080+0000 7fdadeffd640 1 --2- 172.21.15.1:0/4056690865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f22f1be4a0 0x55f22f1c8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.080+0000 7fdadeffd640 1 -- 172.21.15.1:0/4056690865 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f22ee953c0 con 0x55f22f1bedc0 2024-09-19T09:40:53.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.081+0000 7fdadeffd640 1 --2- 172.21.15.1:0/4056690865 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f22f1bedc0 0x55f22f1c61f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fdad0003800 tx=0x7fdad0003830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c80a44c6942cd28f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:53.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.081+0000 7fdac2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:40:53.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.081+0000 7fdac2ff5640 1 -- 172.21.15.1:0/4056690865 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad003f070 con 0x55f22f1bedc0 2024-09-19T09:40:53.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.081+0000 7fdac2ff5640 1 -- 172.21.15.1:0/4056690865 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fdad0003de0 con 0x55f22f1bedc0 2024-09-19T09:40:53.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.081+0000 7fdae773e740 1 -- 172.21.15.1:0/4056690865 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdad401d070 con 0x55f22f1bedc0 2024-09-19T09:40:53.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.081+0000 7fdac2ff5640 1 -- 172.21.15.1:0/4056690865 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fdad0035070 con 0x55f22f1bedc0 2024-09-19T09:40:53.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.081+0000 7fdae773e740 10 client.15798 fetch_fsmap learned FSMap version 19 2024-09-19T09:40:53.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.081+0000 7fdae773e740 1 -- 172.21.15.1:0/4056690865 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f22f1d7c40 con 0x55f22f1bedc0 2024-09-19T09:40:53.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.081+0000 7fdac2ff5640 1 -- 172.21.15.1:0/4056690865 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdad0005500 con 0x55f22f1bedc0 2024-09-19T09:40:53.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.082+0000 7fdac2ff5640 1 -- 172.21.15.1:0/4056690865 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fdad00315b0 con 0x55f22f1bedc0 2024-09-19T09:40:53.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.082+0000 7fdae773e740 10 client.15798 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:40:53.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.082+0000 7fdae773e740 10 client.15798 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:53.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.082+0000 7fdae773e740 20 client.15798 populate_metadata read hostname 'smithi001' 2024-09-19T09:40:53.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.082+0000 7fdae773e740 1 --2- 172.21.15.1:0/4056690865 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55f22f1d90a0 0x55f22f1db4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.082+0000 7fdae773e740 4 client.15798 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:40:53.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.082+0000 7fdae773e740 1 -- 172.21.15.1:0/4056690865 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fdad401d070 con 0x55f22f1d90a0 2024-09-19T09:40:53.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.082+0000 7fdade7fc640 1 --2- 172.21.15.1:0/4056690865 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55f22f1d90a0 0x55f22f1db4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.082+0000 7fdade7fc640 1 --2- 172.21.15.1:0/4056690865 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55f22f1d90a0 0x55f22f1db4e0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df5b9d85f21a9055 server_cookie=7e7c7c4543954694 in_seq=0 out_seq=0 2024-09-19T09:40:53.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.082+0000 7fdac2ff5640 10 client.15798 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:53.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.083+0000 7fdac2ff5640 1 -- 172.21.15.1:0/4056690865 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fdad401d070 con 0x55f22f1d90a0 2024-09-19T09:40:53.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.083+0000 7fdac2ff5640 10 client.15798 handle_command_reply: tid=0 2024-09-19T09:40:53.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.083+0000 7fdae773e740 1 client.15798 shutdown 2024-09-19T09:40:53.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.083+0000 7fdae773e740 1 -- 172.21.15.1:0/4056690865 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f22f1bedc0 msgr2=0x55f22f1c61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:53.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.083+0000 7fdae773e740 1 --2- 172.21.15.1:0/4056690865 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f22f1bedc0 0x55f22f1c61f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fdad0003800 tx=0x7fdad0003830 comp rx=0 tx=0).stop 2024-09-19T09:40:53.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.083+0000 7fdae773e740 1 -- 172.21.15.1:0/4056690865 shutdown_connections 2024-09-19T09:40:53.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.083+0000 7fdae773e740 1 --2- 172.21.15.1:0/4056690865 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55f22f1d90a0 0x55f22f1db4e0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.083+0000 7fdae773e740 1 --2- 172.21.15.1:0/4056690865 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f22f1c9680 0x55f22f1c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.084+0000 7fdae773e740 1 --2- 172.21.15.1:0/4056690865 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f22f1bedc0 0x55f22f1c61f0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.084+0000 7fdae773e740 1 --2- 172.21.15.1:0/4056690865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f22f1be4a0 0x55f22f1c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.083+0000 7fdac2ff5640 0 client.15798 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:53.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.084+0000 7fdae773e740 1 -- 172.21.15.1:0/4056690865 >> 172.21.15.1:0/4056690865 conn(0x55f22f1baa30 msgr2=0x55f22f1c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:53.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.084+0000 7fdae773e740 1 -- 172.21.15.1:0/4056690865 shutdown_connections 2024-09-19T09:40:53.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.084+0000 7fdae773e740 1 -- 172.21.15.1:0/4056690865 wait complete. 2024-09-19T09:40:53.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.084+0000 7fdae773e740 20 client.15798 trim_cache size 0 max 16384 2024-09-19T09:40:53.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.102+0000 7fdae773e740 1 Processor -- start 2024-09-19T09:40:53.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.102+0000 7fdae773e740 1 -- start start 2024-09-19T09:40:53.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.102+0000 7fdae773e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f22f1be4a0 0x55f22f1d5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.102+0000 7fdae773e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f22f1bedc0 0x55f22f1e0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.102+0000 7fdae773e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f22f1c9680 0x55f22f1e12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.102+0000 7fdae773e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdae01ba4b0 con 0x55f22f1c9680 2024-09-19T09:40:53.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.102+0000 7fdae773e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdae01bcd50 con 0x55f22f1be4a0 2024-09-19T09:40:53.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.102+0000 7fdae773e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdae01bab40 con 0x55f22f1bedc0 2024-09-19T09:40:53.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.102+0000 7fdade7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f22f1c9680 0x55f22f1e12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.102+0000 7fdade7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f22f1c9680 0x55f22f1e12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34542/0 (socket says 172.21.15.1:34542) 2024-09-19T09:40:53.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.102+0000 7fdade7fc640 1 -- 172.21.15.1:0/3827491247 learned_addr learned my addr 172.21.15.1:0/3827491247 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:53.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.102+0000 7fdade7fc640 1 --2- 172.21.15.1:0/3827491247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f22f1be4a0 0x55f22f1d5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.102+0000 7fdadeffd640 1 --2- 172.21.15.1:0/3827491247 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f22f1bedc0 0x55f22f1e0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.102+0000 7fdade7fc640 1 -- 172.21.15.1:0/3827491247 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f22f1bedc0 msgr2=0x55f22f1e0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:53.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.102+0000 7fdade7fc640 1 --2- 172.21.15.1:0/3827491247 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f22f1bedc0 0x55f22f1e0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.102+0000 7fdade7fc640 1 -- 172.21.15.1:0/3827491247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f22f1be4a0 msgr2=0x55f22f1d5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:53.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.102+0000 7fdade7fc640 1 --2- 172.21.15.1:0/3827491247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f22f1be4a0 0x55f22f1d5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.102+0000 7fdade7fc640 1 -- 172.21.15.1:0/3827491247 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f22f1bb720 con 0x55f22f1c9680 2024-09-19T09:40:53.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.103+0000 7fdade7fc640 1 --2- 172.21.15.1:0/3827491247 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f22f1c9680 0x55f22f1e12f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fdad4006ae0 tx=0x7fdad40156a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba2f2ac37487332e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:53.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.103+0000 7fdac4ff9640 1 -- 172.21.15.1:0/3827491247 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad4005b70 con 0x55f22f1c9680 2024-09-19T09:40:53.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.103+0000 7fdac4ff9640 1 -- 172.21.15.1:0/3827491247 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdad401d040 con 0x55f22f1c9680 2024-09-19T09:40:53.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.103+0000 7fdac4ff9640 1 -- 172.21.15.1:0/3827491247 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad4015e10 con 0x55f22f1c9680 2024-09-19T09:40:53.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.103+0000 7fdae773e740 1 -- 172.21.15.1:0/3827491247 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f22f1c9680 msgr2=0x55f22f1e12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:53.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.103+0000 7fdae773e740 1 --2- 172.21.15.1:0/3827491247 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f22f1c9680 0x55f22f1e12f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fdad4006ae0 tx=0x7fdad40156a0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.103+0000 7fdae773e740 1 -- 172.21.15.1:0/3827491247 shutdown_connections 2024-09-19T09:40:53.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.103+0000 7fdae773e740 1 --2- 172.21.15.1:0/3827491247 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f22f1c9680 0x55f22f1e12f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.103+0000 7fdae773e740 1 --2- 172.21.15.1:0/3827491247 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f22f1bedc0 0x55f22f1e0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.103+0000 7fdae773e740 1 --2- 172.21.15.1:0/3827491247 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f22f1be4a0 0x55f22f1d5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.103+0000 7fdae773e740 1 -- 172.21.15.1:0/3827491247 >> 172.21.15.1:0/3827491247 conn(0x55f22f1baa30 msgr2=0x55f22f1c52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:53.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.103+0000 7fdae773e740 1 -- 172.21.15.1:0/3827491247 shutdown_connections 2024-09-19T09:40:53.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.103+0000 7fdae773e740 1 -- 172.21.15.1:0/3827491247 wait complete. 2024-09-19T09:40:53.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.104+0000 7fdae773e740 1 -- start start 2024-09-19T09:40:53.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.104+0000 7fdae773e740 1 Processor -- start 2024-09-19T09:40:53.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.104+0000 7fdae773e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f22f1be4a0 0x55f22f1d1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.104+0000 7fdae773e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f22f1bedc0 0x55f22f1cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.104+0000 7fdae773e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f22f1c9680 0x55f22f1cf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.104+0000 7fdae773e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdae01bb210 con 0x55f22f1be4a0 2024-09-19T09:40:53.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.104+0000 7fdae773e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdae01bc680 con 0x55f22f1c9680 2024-09-19T09:40:53.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.104+0000 7fdae773e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdae01bb8e0 con 0x55f22f1bedc0 2024-09-19T09:40:53.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.104+0000 7fdae773e740 10 client.0 _ll_register_callbacks cb 0x7fdad0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:40:53.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.104+0000 7fdade7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f22f1be4a0 0x55f22f1d1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.104+0000 7fdade7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f22f1be4a0 0x55f22f1d1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34556/0 (socket says 172.21.15.1:34556) 2024-09-19T09:40:53.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.104+0000 7fdade7fc640 1 -- 172.21.15.1:0/1237908282 learned_addr learned my addr 172.21.15.1:0/1237908282 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:40:53.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.104+0000 7fdadeffd640 1 --2- 172.21.15.1:0/1237908282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f22f1bedc0 0x55f22f1cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.104+0000 7fdade7fc640 1 --2- 172.21.15.1:0/1237908282 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f22f1c9680 0x55f22f1cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.105+0000 7fdade7fc640 1 -- 172.21.15.1:0/1237908282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f22f1bedc0 msgr2=0x55f22f1cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:53.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.105+0000 7fdade7fc640 1 --2- 172.21.15.1:0/1237908282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f22f1bedc0 0x55f22f1cf1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.105+0000 7fdade7fc640 1 -- 172.21.15.1:0/1237908282 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f22f1c9680 msgr2=0x55f22f1cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:40:53.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.105+0000 7fdade7fc640 1 --2- 172.21.15.1:0/1237908282 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f22f1c9680 0x55f22f1cf700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.105+0000 7fdade7fc640 1 -- 172.21.15.1:0/1237908282 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f22f1cff30 con 0x55f22f1be4a0 2024-09-19T09:40:53.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.105+0000 7fdade7fc640 1 --2- 172.21.15.1:0/1237908282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f22f1be4a0 0x55f22f1d1e70 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009630 tx=0x7fdad40094b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab898a62f7ab749 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:40:53.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.105+0000 7fdac2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:40:53.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.105+0000 7fdac2ff5640 1 -- 172.21.15.1:0/1237908282 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad4005970 con 0x55f22f1be4a0 2024-09-19T09:40:53.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.105+0000 7fdae773e740 1 -- 172.21.15.1:0/1237908282 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdad401d040 con 0x55f22f1be4a0 2024-09-19T09:40:53.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.105+0000 7fdac2ff5640 1 -- 172.21.15.1:0/1237908282 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fdad4005b10 con 0x55f22f1be4a0 2024-09-19T09:40:53.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.105+0000 7fdac2ff5640 1 -- 172.21.15.1:0/1237908282 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fdad4005d10 con 0x55f22f1be4a0 2024-09-19T09:40:53.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.105+0000 7fdae773e740 10 client.15804 fetch_fsmap learned FSMap version 19 2024-09-19T09:40:53.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.105+0000 7fdae773e740 1 -- 172.21.15.1:0/1237908282 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55f22f243e00 con 0x55f22f1be4a0 2024-09-19T09:40:53.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.105+0000 7fdac2ff5640 1 -- 172.21.15.1:0/1237908282 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdad401d040 con 0x55f22f1be4a0 2024-09-19T09:40:53.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.106+0000 7fdac2ff5640 1 -- 172.21.15.1:0/1237908282 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fdad4003990 con 0x55f22f1be4a0 2024-09-19T09:40:53.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.106+0000 7fdae773e740 10 client.15804 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:40:53.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.106+0000 7fdae773e740 10 client.15804 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:40:53.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.106+0000 7fdae773e740 20 client.15804 populate_metadata read hostname 'smithi001' 2024-09-19T09:40:53.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.106+0000 7fdae773e740 1 --2- 172.21.15.1:0/1237908282 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55f22f244150 0x55f22f246540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:40:53.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.106+0000 7fdae773e740 4 client.15804 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:40:53.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.106+0000 7fdae773e740 1 -- 172.21.15.1:0/1237908282 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f22f131850 con 0x55f22f244150 2024-09-19T09:40:53.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.106+0000 7fdadeffd640 1 --2- 172.21.15.1:0/1237908282 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55f22f244150 0x55f22f246540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:40:53.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.106+0000 7fdadeffd640 1 --2- 172.21.15.1:0/1237908282 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55f22f244150 0x55f22f246540 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfeb0f1562adc27a server_cookie=73a9b15d44d1dc6a in_seq=0 out_seq=0 2024-09-19T09:40:53.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.106+0000 7fdac2ff5640 10 client.15804 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:53.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.106+0000 7fdac2ff5640 1 -- 172.21.15.1:0/1237908282 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f22f131850 con 0x55f22f244150 2024-09-19T09:40:53.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.106+0000 7fdac2ff5640 10 client.15804 handle_command_reply: tid=0 2024-09-19T09:40:53.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.106+0000 7fdae773e740 1 client.15804 shutdown 2024-09-19T09:40:53.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.107+0000 7fdae773e740 1 -- 172.21.15.1:0/1237908282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f22f1be4a0 msgr2=0x55f22f1d1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:53.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.107+0000 7fdae773e740 1 --2- 172.21.15.1:0/1237908282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f22f1be4a0 0x55f22f1d1e70 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009630 tx=0x7fdad40094b0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.107+0000 7fdae773e740 1 -- 172.21.15.1:0/1237908282 shutdown_connections 2024-09-19T09:40:53.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.107+0000 7fdae773e740 1 --2- 172.21.15.1:0/1237908282 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55f22f244150 0x55f22f246540 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.107+0000 7fdae773e740 1 --2- 172.21.15.1:0/1237908282 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f22f1c9680 0x55f22f1cf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.107+0000 7fdae773e740 1 --2- 172.21.15.1:0/1237908282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f22f1bedc0 0x55f22f1cf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.107+0000 7fdac2ff5640 0 client.15804 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:40:53.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.107+0000 7fdae773e740 1 --2- 172.21.15.1:0/1237908282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f22f1be4a0 0x55f22f1d1e70 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.107+0000 7fdae773e740 1 -- 172.21.15.1:0/1237908282 >> 172.21.15.1:0/1237908282 conn(0x55f22f1baa30 msgr2=0x55f22f1c7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:53.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.107+0000 7fdae773e740 1 -- 172.21.15.1:0/1237908282 shutdown_connections 2024-09-19T09:40:53.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.107+0000 7fdae773e740 1 -- 172.21.15.1:0/1237908282 wait complete. 2024-09-19T09:40:53.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.107+0000 7fdae773e740 20 client.15804 trim_cache size 0 max 16384 2024-09-19T09:40:53.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.107+0000 7fdae5365640 1 -- 172.21.15.1:0/664426339 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fdac80a3450 msgr2=0x7fdac80a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:53.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.107+0000 7fdae5365640 1 --2- 172.21.15.1:0/664426339 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fdac80a3450 0x7fdac80a5910 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdad8004a80 tx=0x7fdad80040b0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.107+0000 7fdae5365640 1 -- 172.21.15.1:0/664426339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdae011b140 msgr2=0x7fdae01abcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:40:53.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.107+0000 7fdae5365640 1 --2- 172.21.15.1:0/664426339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdae011b140 0x7fdae01abcc0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fdad800caf0 tx=0x7fdad80020e0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.107+0000 7fdae5365640 1 -- 172.21.15.1:0/664426339 shutdown_connections 2024-09-19T09:40:53.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.107+0000 7fdae5365640 1 --2- 172.21.15.1:0/664426339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdae011b140 0x7fdae01abcc0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.107+0000 7fdae5365640 1 --2- 172.21.15.1:0/664426339 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdae0109830 0x7fdae01a7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.107+0000 7fdae5365640 1 --2- 172.21.15.1:0/664426339 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fdac80a3450 0x7fdac80a5910 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.107+0000 7fdae5365640 1 --2- 172.21.15.1:0/664426339 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdae0109450 0x7fdae01a73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:40:53.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.107+0000 7fdae5365640 1 -- 172.21.15.1:0/664426339 >> 172.21.15.1:0/664426339 conn(0x7fdae006e140 msgr2=0x7fdae011bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:40:53.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.107+0000 7fdae5365640 1 -- 172.21.15.1:0/664426339 shutdown_connections 2024-09-19T09:40:53.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:40:52.107+0000 7fdae5365640 1 -- 172.21.15.1:0/664426339 wait complete. 2024-09-19T09:40:53.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:53 smithi001 ceph-mon[31225]: pgmap v422: 97 pgs: 97 active+clean; 13 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 282 MiB/s wr, 31.67k op/s 2024-09-19T09:40:54.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:53 smithi022 ceph-mon[35583]: pgmap v422: 97 pgs: 97 active+clean; 13 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 282 MiB/s wr, 31.67k op/s 2024-09-19T09:40:54.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:53 smithi121 ceph-mon[35577]: pgmap v422: 97 pgs: 97 active+clean; 13 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 282 MiB/s wr, 31.67k op/s 2024-09-19T09:40:55.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:55 smithi001 ceph-mon[31225]: pgmap v423: 97 pgs: 97 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 256 MiB/s wr, 27.68k op/s 2024-09-19T09:40:56.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:55 smithi022 ceph-mon[35583]: pgmap v423: 97 pgs: 97 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 256 MiB/s wr, 27.68k op/s 2024-09-19T09:40:56.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:55 smithi121 ceph-mon[35577]: pgmap v423: 97 pgs: 97 active+clean; 13 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 256 MiB/s wr, 27.68k op/s 2024-09-19T09:40:57.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:57 smithi001 ceph-mon[31225]: pgmap v424: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 284 MiB/s wr, 29.84k op/s 2024-09-19T09:40:58.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:57 smithi022 ceph-mon[35583]: pgmap v424: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 284 MiB/s wr, 29.84k op/s 2024-09-19T09:40:58.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:57 smithi121 ceph-mon[35577]: pgmap v424: 97 pgs: 97 active+clean; 13 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 284 MiB/s wr, 29.84k op/s 2024-09-19T09:40:59.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:40:59 smithi001 ceph-mon[31225]: pgmap v425: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 271 MiB/s wr, 27.19k op/s 2024-09-19T09:41:00.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:40:59 smithi022 ceph-mon[35583]: pgmap v425: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 271 MiB/s wr, 27.19k op/s 2024-09-19T09:41:00.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:40:59 smithi121 ceph-mon[35577]: pgmap v425: 97 pgs: 97 active+clean; 13 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 271 MiB/s wr, 27.19k op/s 2024-09-19T09:41:01.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:01 smithi001 ceph-mon[31225]: pgmap v426: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 285 MiB/s wr, 28.37k op/s 2024-09-19T09:41:02.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:01 smithi022 ceph-mon[35583]: pgmap v426: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 285 MiB/s wr, 28.37k op/s 2024-09-19T09:41:02.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:01 smithi121 ceph-mon[35577]: pgmap v426: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 285 MiB/s wr, 28.37k op/s 2024-09-19T09:41:04.000 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:03 smithi001 ceph-mon[31225]: pgmap v427: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 255 MiB/s wr, 25.46k op/s 2024-09-19T09:41:04.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:03 smithi022 ceph-mon[35583]: pgmap v427: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 255 MiB/s wr, 25.46k op/s 2024-09-19T09:41:04.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:03 smithi121 ceph-mon[35577]: pgmap v427: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 255 MiB/s wr, 25.46k op/s 2024-09-19T09:41:05.028 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:41:05.028 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:41:05.591 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:41:05.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:05 smithi001 ceph-mon[31225]: pgmap v428: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 219 MiB/s wr, 21.91k op/s 2024-09-19T09:41:06.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:05 smithi022 ceph-mon[35583]: pgmap v428: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 219 MiB/s wr, 21.91k op/s 2024-09-19T09:41:06.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:05 smithi121 ceph-mon[35577]: pgmap v428: 97 pgs: 97 active+clean; 13 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 219 MiB/s wr, 21.91k op/s 2024-09-19T09:41:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.588+0000 7fed3688d640 1 -- 172.21.15.1:0/343174669 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed30074c50 msgr2=0x7fed300750b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.588+0000 7fed3688d640 1 --2- 172.21.15.1:0/343174669 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed30074c50 0x7fed300750b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fed1c009900 tx=0x7fed1c02a410 comp rx=0 tx=0).stop 2024-09-19T09:41:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.588+0000 7fed3688d640 1 -- 172.21.15.1:0/343174669 shutdown_connections 2024-09-19T09:41:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.588+0000 7fed3688d640 1 --2- 172.21.15.1:0/343174669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed3010e120 0x7fed30110510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.588+0000 7fed3688d640 1 --2- 172.21.15.1:0/343174669 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed30074c50 0x7fed300750b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.588+0000 7fed3688d640 1 --2- 172.21.15.1:0/343174669 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed30076230 0x7fed30074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.588+0000 7fed3688d640 1 -- 172.21.15.1:0/343174669 >> 172.21.15.1:0/343174669 conn(0x7fed300fd2f0 msgr2=0x7fed300ff710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.589+0000 7fed3688d640 1 -- 172.21.15.1:0/343174669 shutdown_connections 2024-09-19T09:41:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.590+0000 7fed3688d640 1 -- 172.21.15.1:0/343174669 wait complete. 2024-09-19T09:41:06.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.591+0000 7fed3688d640 1 Processor -- start 2024-09-19T09:41:06.592 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.591+0000 7fed3688d640 1 -- start start 2024-09-19T09:41:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.591+0000 7fed3688d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed30074c50 0x7fed30070b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.593 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.591+0000 7fed3688d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed30076230 0x7fed300710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.591+0000 7fed3688d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed3010e120 0x7fed301ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.591+0000 7fed3688d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fed30113de0 con 0x7fed30074c50 2024-09-19T09:41:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.591+0000 7fed3688d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fed30113c60 con 0x7fed3010e120 2024-09-19T09:41:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.591+0000 7fed3688d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fed30113f60 con 0x7fed30076230 2024-09-19T09:41:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.591+0000 7fed34e2a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed3010e120 0x7fed301ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.592+0000 7fed34e2a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed3010e120 0x7fed301ae4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:53360/0 (socket says 172.21.15.1:53360) 2024-09-19T09:41:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.592+0000 7fed34e2a640 1 -- 172.21.15.1:0/3255691933 learned_addr learned my addr 172.21.15.1:0/3255691933 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:41:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.592+0000 7fed2ffff640 1 --2- 172.21.15.1:0/3255691933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed30074c50 0x7fed30070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.592+0000 7fed2f7fe640 1 --2- 172.21.15.1:0/3255691933 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed30076230 0x7fed300710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.592+0000 7fed34e2a640 1 -- 172.21.15.1:0/3255691933 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed30076230 msgr2=0x7fed300710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.592+0000 7fed34e2a640 1 --2- 172.21.15.1:0/3255691933 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed30076230 0x7fed300710b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.592+0000 7fed34e2a640 1 -- 172.21.15.1:0/3255691933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed30074c50 msgr2=0x7fed30070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:06.594 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.592+0000 7fed34e2a640 1 --2- 172.21.15.1:0/3255691933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed30074c50 0x7fed30070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.592+0000 7fed34e2a640 1 -- 172.21.15.1:0/3255691933 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed301aea10 con 0x7fed3010e120 2024-09-19T09:41:06.595 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.593+0000 7fed34e2a640 1 --2- 172.21.15.1:0/3255691933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed3010e120 0x7fed301ae4d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fed2800eb10 tx=0x7fed2800c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:06.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.594+0000 7fed2d7fa640 1 -- 172.21.15.1:0/3255691933 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed28004b20 con 0x7fed3010e120 2024-09-19T09:41:06.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.594+0000 7fed2d7fa640 1 -- 172.21.15.1:0/3255691933 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed28004cc0 con 0x7fed3010e120 2024-09-19T09:41:06.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.594+0000 7fed2d7fa640 1 -- 172.21.15.1:0/3255691933 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed28010760 con 0x7fed3010e120 2024-09-19T09:41:06.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.595+0000 7fed3688d640 1 -- 172.21.15.1:0/3255691933 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed301aebe0 con 0x7fed3010e120 2024-09-19T09:41:06.596 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.595+0000 7fed3688d640 1 -- 172.21.15.1:0/3255691933 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed301af050 con 0x7fed3010e120 2024-09-19T09:41:06.601 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.600+0000 7fed2d7fa640 1 -- 172.21.15.1:0/3255691933 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fed28005020 con 0x7fed3010e120 2024-09-19T09:41:06.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.604+0000 7fed3962a740 1 Processor -- start 2024-09-19T09:41:06.606 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.604+0000 7fed3962a740 1 -- start start 2024-09-19T09:41:06.607 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.605+0000 7fed2d7fa640 1 --2- 172.21.15.1:0/3255691933 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fed140a3410 0x7fed140a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.605+0000 7fed2d7fa640 1 -- 172.21.15.1:0/3255691933 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fed280d00d0 con 0x7fed3010e120 2024-09-19T09:41:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.605+0000 7fed2f7fe640 1 --2- 172.21.15.1:0/3255691933 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fed140a3410 0x7fed140a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.605+0000 7fed3962a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56120c8f09a0 0x56120c8f0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.605+0000 7fed3962a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56120c8f12e0 0x56120c8f5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.606+0000 7fed3962a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56120c8f6370 0x56120c8f8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.606+0000 7fed3962a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56120c8542f0 con 0x56120c8f6370 2024-09-19T09:41:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.606+0000 7fed3962a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56120c7fc270 con 0x56120c8f09a0 2024-09-19T09:41:06.608 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.606+0000 7fed3962a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56120c8502b0 con 0x56120c8f12e0 2024-09-19T09:41:06.609 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.607+0000 7fed2ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56120c8f09a0 0x56120c8f0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.609 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.607+0000 7fed2ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56120c8f09a0 0x56120c8f0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:53368/0 (socket says 172.21.15.1:53368) 2024-09-19T09:41:06.609 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.607+0000 7fed2ffff640 1 -- 172.21.15.1:0/3810659771 learned_addr learned my addr 172.21.15.1:0/3810659771 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:41:06.609 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.607+0000 7fed34e2a640 1 --2- 172.21.15.1:0/3810659771 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56120c8f6370 0x56120c8f8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.609 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.608+0000 7fed2f7fe640 1 --2- 172.21.15.1:0/3810659771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56120c8f12e0 0x56120c8f5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.609 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.608+0000 7fed2ffff640 1 -- 172.21.15.1:0/3810659771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56120c8f12e0 msgr2=0x56120c8f5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:06.610 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.608+0000 7fed2ffff640 1 --2- 172.21.15.1:0/3810659771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56120c8f12e0 0x56120c8f5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.610 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.608+0000 7fed2ffff640 1 -- 172.21.15.1:0/3810659771 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56120c8f6370 msgr2=0x56120c8f8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:06.610 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.608+0000 7fed2ffff640 1 --2- 172.21.15.1:0/3810659771 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56120c8f6370 0x56120c8f8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.610 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.608+0000 7fed2ffff640 1 -- 172.21.15.1:0/3810659771 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56120c7fb340 con 0x56120c8f09a0 2024-09-19T09:41:06.610 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.609+0000 7fed2ffff640 1 --2- 172.21.15.1:0/3810659771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56120c8f09a0 0x56120c8f0da0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fed20009c80 tx=0x7fed200117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9d712e6c6dd082 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:06.610 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.609+0000 7fed2f7fe640 1 --2- 172.21.15.1:0/3255691933 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fed140a3410 0x7fed140a58d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fed30072080 tx=0x7fed1c005220 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:06.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.611+0000 7fed267fc640 1 -- 172.21.15.1:0/3810659771 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed20012450 con 0x56120c8f09a0 2024-09-19T09:41:06.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.611+0000 7fed267fc640 1 -- 172.21.15.1:0/3810659771 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed20012ad0 con 0x56120c8f09a0 2024-09-19T09:41:06.612 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.611+0000 7fed267fc640 1 -- 172.21.15.1:0/3810659771 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2000fbc0 con 0x56120c8f09a0 2024-09-19T09:41:06.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.612+0000 7fed3962a740 1 -- 172.21.15.1:0/3810659771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56120c8f09a0 msgr2=0x56120c8f0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:06.614 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.612+0000 7fed3962a740 1 --2- 172.21.15.1:0/3810659771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56120c8f09a0 0x56120c8f0da0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fed20009c80 tx=0x7fed200117b0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.616+0000 7fed3962a740 1 -- 172.21.15.1:0/3810659771 shutdown_connections 2024-09-19T09:41:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.616+0000 7fed3962a740 1 --2- 172.21.15.1:0/3810659771 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56120c8f6370 0x56120c8f8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.616+0000 7fed3962a740 1 --2- 172.21.15.1:0/3810659771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56120c8f12e0 0x56120c8f5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.616+0000 7fed3962a740 1 --2- 172.21.15.1:0/3810659771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56120c8f09a0 0x56120c8f0da0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.618 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.616+0000 7fed3962a740 1 -- 172.21.15.1:0/3810659771 >> 172.21.15.1:0/3810659771 conn(0x56120c8ec010 msgr2=0x56120c8ec410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:06.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.617+0000 7fed3962a740 1 -- 172.21.15.1:0/3810659771 shutdown_connections 2024-09-19T09:41:06.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.618+0000 7fed3962a740 1 -- 172.21.15.1:0/3810659771 wait complete. 2024-09-19T09:41:06.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.619+0000 7fed3962a740 1 -- start start 2024-09-19T09:41:06.621 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.619+0000 7fed3962a740 1 Processor -- start 2024-09-19T09:41:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.620+0000 7fed3962a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56120c8f09a0 0x56120c8fab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.620+0000 7fed3962a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56120c8f12e0 0x56120c8fb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.620+0000 7fed3962a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56120c8f6370 0x56120c9020b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.620+0000 7fed3962a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56120c8f9340 con 0x56120c8f12e0 2024-09-19T09:41:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.620+0000 7fed3962a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56120c7dd290 con 0x56120c8f09a0 2024-09-19T09:41:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.620+0000 7fed3962a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56120c8f94c0 con 0x56120c8f6370 2024-09-19T09:41:06.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.620+0000 7fed3962a740 10 client.0 _ll_register_callbacks cb 0x56120c80e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:06.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.622+0000 7fed2f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56120c8f12e0 0x56120c8fb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.622+0000 7fed2f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56120c8f12e0 0x56120c8fb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45982/0 (socket says 172.21.15.1:45982) 2024-09-19T09:41:06.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.622+0000 7fed2f7fe640 1 -- 172.21.15.1:0/2141608046 learned_addr learned my addr 172.21.15.1:0/2141608046 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:41:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.623+0000 7fed2f7fe640 1 -- 172.21.15.1:0/2141608046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56120c8f6370 msgr2=0x56120c9020b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.623+0000 7fed2f7fe640 1 --2- 172.21.15.1:0/2141608046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56120c8f6370 0x56120c9020b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.623+0000 7fed2f7fe640 1 -- 172.21.15.1:0/2141608046 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56120c8f09a0 msgr2=0x56120c8fab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.623+0000 7fed2f7fe640 1 --2- 172.21.15.1:0/2141608046 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56120c8f09a0 0x56120c8fab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.623+0000 7fed2f7fe640 1 -- 172.21.15.1:0/2141608046 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56120c567210 con 0x56120c8f12e0 2024-09-19T09:41:06.626 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.625+0000 7fed2f7fe640 1 --2- 172.21.15.1:0/2141608046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56120c8f12e0 0x56120c8fb070 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fed1c005ec0 tx=0x7fed1c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0633dba2549be11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:06.626 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.625+0000 7fed137fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:41:06.627 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.626+0000 7fed137fe640 1 -- 172.21.15.1:0/2141608046 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1c035020 con 0x56120c8f12e0 2024-09-19T09:41:06.627 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.626+0000 7fed137fe640 1 -- 172.21.15.1:0/2141608046 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fed1c0317a0 con 0x56120c8f12e0 2024-09-19T09:41:06.628 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.626+0000 7fed3962a740 1 -- 172.21.15.1:0/2141608046 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed20012ad0 con 0x56120c8f12e0 2024-09-19T09:41:06.628 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.627+0000 7fed137fe640 1 -- 172.21.15.1:0/2141608046 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fed1c0319a0 con 0x56120c8f12e0 2024-09-19T09:41:06.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.627+0000 7fed3962a740 10 client.15834 fetch_fsmap learned FSMap version 19 2024-09-19T09:41:06.629 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.627+0000 7fed3962a740 1 -- 172.21.15.1:0/2141608046 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56120c633620 con 0x56120c8f12e0 2024-09-19T09:41:06.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.628+0000 7fed137fe640 1 -- 172.21.15.1:0/2141608046 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed20012ad0 con 0x56120c8f12e0 2024-09-19T09:41:06.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.628+0000 7fed137fe640 1 -- 172.21.15.1:0/2141608046 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fed1c03a040 con 0x56120c8f12e0 2024-09-19T09:41:06.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.628+0000 7fed3962a740 10 client.15834 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:41:06.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.628+0000 7fed3962a740 10 client.15834 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:41:06.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.628+0000 7fed3962a740 20 client.15834 populate_metadata read hostname 'smithi001' 2024-09-19T09:41:06.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.628+0000 7fed3962a740 1 --2- 172.21.15.1:0/2141608046 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56120c906c30 0x56120c9090f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.628+0000 7fed3962a740 4 client.15834 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:41:06.630 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.628+0000 7fed3962a740 1 -- 172.21.15.1:0/2141608046 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56120c861a20 con 0x56120c906c30 2024-09-19T09:41:06.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.629+0000 7fed2ffff640 1 --2- 172.21.15.1:0/2141608046 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56120c906c30 0x56120c9090f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.631+0000 7fed137fe640 10 client.15834 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:41:06.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.632+0000 7fed2ffff640 1 --2- 172.21.15.1:0/2141608046 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56120c906c30 0x56120c9090f0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1e0447a2de20381 server_cookie=7f42616dc10d3e94 in_seq=0 out_seq=0 2024-09-19T09:41:06.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.634+0000 7fed137fe640 1 -- 172.21.15.1:0/2141608046 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56120c861a20 con 0x56120c906c30 2024-09-19T09:41:06.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.635+0000 7fed137fe640 10 client.15834 handle_command_reply: tid=0 2024-09-19T09:41:06.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.635+0000 7fed3962a740 1 client.15834 shutdown 2024-09-19T09:41:06.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.637+0000 7fed3962a740 1 -- 172.21.15.1:0/2141608046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56120c8f12e0 msgr2=0x56120c8fb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:06.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.637+0000 7fed3962a740 1 --2- 172.21.15.1:0/2141608046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56120c8f12e0 0x56120c8fb070 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fed1c005ec0 tx=0x7fed1c02a410 comp rx=0 tx=0).stop 2024-09-19T09:41:06.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.637+0000 7fed3962a740 1 -- 172.21.15.1:0/2141608046 shutdown_connections 2024-09-19T09:41:06.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.637+0000 7fed3962a740 1 --2- 172.21.15.1:0/2141608046 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56120c906c30 0x56120c9090f0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.637+0000 7fed3962a740 1 --2- 172.21.15.1:0/2141608046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56120c8f6370 0x56120c9020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.639 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.637+0000 7fed3962a740 1 --2- 172.21.15.1:0/2141608046 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56120c8f12e0 0x56120c8fb070 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.637+0000 7fed3962a740 1 --2- 172.21.15.1:0/2141608046 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56120c8f09a0 0x56120c8fab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.637+0000 7fed137fe640 0 client.15834 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:41:06.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.637+0000 7fed3962a740 1 -- 172.21.15.1:0/2141608046 >> 172.21.15.1:0/2141608046 conn(0x56120c8ec010 msgr2=0x56120c8ed820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:06.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.638+0000 7fed3962a740 1 -- 172.21.15.1:0/2141608046 shutdown_connections 2024-09-19T09:41:06.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.638+0000 7fed3962a740 1 -- 172.21.15.1:0/2141608046 wait complete. 2024-09-19T09:41:06.640 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.638+0000 7fed3962a740 20 client.15834 trim_cache size 0 max 16384 2024-09-19T09:41:06.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.675+0000 7fed3962a740 1 Processor -- start 2024-09-19T09:41:06.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.675+0000 7fed3962a740 1 -- start start 2024-09-19T09:41:06.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.675+0000 7fed3962a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56120c8f09a0 0x56120c8ecec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.675+0000 7fed3962a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56120c8f12e0 0x56120c902070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.676+0000 7fed3962a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56120c8f6370 0x56120c8ed400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.676+0000 7fed2ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56120c8f09a0 0x56120c8ecec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.676+0000 7fed2ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56120c8f09a0 0x56120c8ecec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:53392/0 (socket says 172.21.15.1:53392) 2024-09-19T09:41:06.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.676+0000 7fed34e2a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56120c8f6370 0x56120c8ed400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.676+0000 7fed34e2a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56120c8f6370 0x56120c8ed400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45988/0 (socket says 172.21.15.1:45988) 2024-09-19T09:41:06.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.676+0000 7fed2ffff640 1 -- 172.21.15.1:0/171097771 learned_addr learned my addr 172.21.15.1:0/171097771 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:41:06.678 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.676+0000 7fed3962a740 1 -- 172.21.15.1:0/171097771 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fed301b5fc0 con 0x56120c8f6370 2024-09-19T09:41:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.676+0000 7fed3962a740 1 -- 172.21.15.1:0/171097771 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fed301b8860 con 0x56120c8f09a0 2024-09-19T09:41:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.676+0000 7fed3962a740 1 -- 172.21.15.1:0/171097771 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fed301b6650 con 0x56120c8f12e0 2024-09-19T09:41:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.677+0000 7fed34e2a640 1 -- 172.21.15.1:0/171097771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56120c8f12e0 msgr2=0x56120c902070 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:41:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.677+0000 7fed34e2a640 1 --2- 172.21.15.1:0/171097771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56120c8f12e0 0x56120c902070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.677+0000 7fed34e2a640 1 -- 172.21.15.1:0/171097771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56120c8f09a0 msgr2=0x56120c8ecec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.677+0000 7fed34e2a640 1 --2- 172.21.15.1:0/171097771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56120c8f09a0 0x56120c8ecec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.677+0000 7fed34e2a640 1 -- 172.21.15.1:0/171097771 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56120c8f1f70 con 0x56120c8f6370 2024-09-19T09:41:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.678+0000 7fed34e2a640 1 --2- 172.21.15.1:0/171097771 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56120c8f6370 0x56120c8ed400 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fed2809c640 tx=0x7fed28098350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b88e190c11a146 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:06.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.678+0000 7fed25ffb640 1 -- 172.21.15.1:0/171097771 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2809c010 con 0x56120c8f6370 2024-09-19T09:41:06.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.678+0000 7fed25ffb640 1 -- 172.21.15.1:0/171097771 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed2809cdb0 con 0x56120c8f6370 2024-09-19T09:41:06.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.678+0000 7fed25ffb640 1 -- 172.21.15.1:0/171097771 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed280b0bd0 con 0x56120c8f6370 2024-09-19T09:41:06.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.680+0000 7fed3962a740 1 -- 172.21.15.1:0/171097771 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56120c8f6370 msgr2=0x56120c8ed400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:06.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.680+0000 7fed3962a740 1 --2- 172.21.15.1:0/171097771 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56120c8f6370 0x56120c8ed400 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fed2809c640 tx=0x7fed28098350 comp rx=0 tx=0).stop 2024-09-19T09:41:06.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.680+0000 7fed3962a740 1 -- 172.21.15.1:0/171097771 shutdown_connections 2024-09-19T09:41:06.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.680+0000 7fed3962a740 1 --2- 172.21.15.1:0/171097771 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56120c8f6370 0x56120c8ed400 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.680+0000 7fed3962a740 1 --2- 172.21.15.1:0/171097771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56120c8f12e0 0x56120c902070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.680+0000 7fed3962a740 1 --2- 172.21.15.1:0/171097771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56120c8f09a0 0x56120c8ecec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.680+0000 7fed3962a740 1 -- 172.21.15.1:0/171097771 >> 172.21.15.1:0/171097771 conn(0x56120c8ec010 msgr2=0x56120c8fab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:06.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.684+0000 7fed3962a740 1 -- 172.21.15.1:0/171097771 shutdown_connections 2024-09-19T09:41:06.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.685+0000 7fed3962a740 1 -- 172.21.15.1:0/171097771 wait complete. 2024-09-19T09:41:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.686+0000 7fed3962a740 1 -- start start 2024-09-19T09:41:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.686+0000 7fed3962a740 1 Processor -- start 2024-09-19T09:41:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.687+0000 7fed3962a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56120c8f09a0 0x56120c8ff820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.687+0000 7fed3962a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56120c8f12e0 0x56120c8ffd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.687+0000 7fed3962a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56120c8f6370 0x56120c900d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.687+0000 7fed3962a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fed301b6d20 con 0x56120c8f6370 2024-09-19T09:41:06.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.687+0000 7fed3962a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fed301b8190 con 0x56120c8f12e0 2024-09-19T09:41:06.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.687+0000 7fed34e2a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56120c8f6370 0x56120c900d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.687+0000 7fed3962a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fed301b73f0 con 0x56120c8f09a0 2024-09-19T09:41:06.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.687+0000 7fed3962a740 10 client.0 _ll_register_callbacks cb 0x7fed20005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.688+0000 7fed2f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56120c8f12e0 0x56120c8ffd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.688+0000 7fed2f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56120c8f12e0 0x56120c8ffd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:53394/0 (socket says 172.21.15.1:53394) 2024-09-19T09:41:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.688+0000 7fed2f7fe640 1 -- 172.21.15.1:0/4032458475 learned_addr learned my addr 172.21.15.1:0/4032458475 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:41:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.688+0000 7fed2ffff640 1 --2- 172.21.15.1:0/4032458475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56120c8f09a0 0x56120c8ff820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.689+0000 7fed2ffff640 1 -- 172.21.15.1:0/4032458475 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56120c8f12e0 msgr2=0x56120c8ffd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.689+0000 7fed2ffff640 1 --2- 172.21.15.1:0/4032458475 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56120c8f12e0 0x56120c8ffd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.689+0000 7fed2ffff640 1 -- 172.21.15.1:0/4032458475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56120c8f6370 msgr2=0x56120c900d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:06.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.689+0000 7fed2ffff640 1 --2- 172.21.15.1:0/4032458475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56120c8f6370 0x56120c900d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:06.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.689+0000 7fed2ffff640 1 -- 172.21.15.1:0/4032458475 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56120c901380 con 0x56120c8f09a0 2024-09-19T09:41:06.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.689+0000 7fed2ffff640 1 --2- 172.21.15.1:0/4032458475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56120c8f09a0 0x56120c8ff820 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fed20000c00 tx=0x7fed20005270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b89a0cf0b129db36 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:06.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.689+0000 7fed137fe640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-19T09:41:06.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.689+0000 7fed137fe640 1 -- 172.21.15.1:0/4032458475 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2000f440 con 0x56120c8f09a0 2024-09-19T09:41:06.692 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.689+0000 7fed3962a740 1 -- 172.21.15.1:0/4032458475 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed2809cdb0 con 0x56120c8f09a0 2024-09-19T09:41:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.691+0000 7fed137fe640 1 -- 172.21.15.1:0/4032458475 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fed20009e40 con 0x56120c8f09a0 2024-09-19T09:41:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.691+0000 7fed137fe640 1 -- 172.21.15.1:0/4032458475 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fed20012450 con 0x56120c8f09a0 2024-09-19T09:41:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.691+0000 7fed3962a740 10 client.25384 fetch_fsmap learned FSMap version 19 2024-09-19T09:41:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.691+0000 7fed3962a740 1 -- 172.21.15.1:0/4032458475 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56120c971a80 con 0x56120c8f09a0 2024-09-19T09:41:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.691+0000 7fed137fe640 1 -- 172.21.15.1:0/4032458475 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed2809cdb0 con 0x56120c8f09a0 2024-09-19T09:41:06.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.693+0000 7fed137fe640 1 -- 172.21.15.1:0/4032458475 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fed200125f0 con 0x56120c8f09a0 2024-09-19T09:41:06.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.693+0000 7fed3962a740 10 client.25384 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:41:06.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.693+0000 7fed3962a740 10 client.25384 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:41:06.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.693+0000 7fed3962a740 20 client.25384 populate_metadata read hostname 'smithi001' 2024-09-19T09:41:06.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.693+0000 7fed3962a740 1 --2- 172.21.15.1:0/4032458475 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56120c972230 0x56120c974620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:06.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.693+0000 7fed3962a740 4 client.25384 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:41:06.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.693+0000 7fed3962a740 1 -- 172.21.15.1:0/4032458475 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56120c85bd70 con 0x56120c972230 2024-09-19T09:41:06.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.693+0000 7fed2f7fe640 1 --2- 172.21.15.1:0/4032458475 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56120c972230 0x56120c974620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:06.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.694+0000 7fed2f7fe640 1 --2- 172.21.15.1:0/4032458475 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56120c972230 0x56120c974620 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25bc0a4ba1a04654 server_cookie=b050142c717b5c68 in_seq=0 out_seq=0 2024-09-19T09:41:06.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:06.694+0000 7fed137fe640 10 client.25384 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:41:07.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:07 smithi001 ceph-mon[31225]: pgmap v429: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 233 MiB/s wr, 24.30k op/s 2024-09-19T09:41:08.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:07 smithi022 ceph-mon[35583]: pgmap v429: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 233 MiB/s wr, 24.30k op/s 2024-09-19T09:41:08.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:07 smithi121 ceph-mon[35577]: pgmap v429: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 233 MiB/s wr, 24.30k op/s 2024-09-19T09:41:08.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:08.508+0000 7fed137fe640 1 -- 172.21.15.1:0/4032458475 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56120c85bd70 con 0x56120c972230 2024-09-19T09:41:08.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:08.508+0000 7fed137fe640 10 client.25384 handle_command_reply: tid=0 2024-09-19T09:41:08.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:08.508+0000 7fed3962a740 1 client.25384 shutdown 2024-09-19T09:41:08.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:08.508+0000 7fed3962a740 1 -- 172.21.15.1:0/4032458475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56120c8f09a0 msgr2=0x56120c8ff820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:08.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:08.508+0000 7fed3962a740 1 --2- 172.21.15.1:0/4032458475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56120c8f09a0 0x56120c8ff820 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fed20000c00 tx=0x7fed20005270 comp rx=0 tx=0).stop 2024-09-19T09:41:08.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:08.508+0000 7fed3962a740 1 -- 172.21.15.1:0/4032458475 shutdown_connections 2024-09-19T09:41:08.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:08.508+0000 7fed3962a740 1 --2- 172.21.15.1:0/4032458475 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56120c972230 0x56120c974620 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:08.508+0000 7fed3962a740 1 --2- 172.21.15.1:0/4032458475 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56120c8f6370 0x56120c900d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:08.508+0000 7fed3962a740 1 --2- 172.21.15.1:0/4032458475 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56120c8f12e0 0x56120c8ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:08.508+0000 7fed3962a740 1 --2- 172.21.15.1:0/4032458475 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56120c8f09a0 0x56120c8ff820 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:08.508+0000 7fed137fe640 0 client.25384 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:41:08.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:08.508+0000 7fed3962a740 1 -- 172.21.15.1:0/4032458475 >> 172.21.15.1:0/4032458475 conn(0x56120c8ec010 msgr2=0x56120c8ea9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:08.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:08.509+0000 7fed3962a740 1 -- 172.21.15.1:0/4032458475 shutdown_connections 2024-09-19T09:41:08.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:08.509+0000 7fed3962a740 1 -- 172.21.15.1:0/4032458475 wait complete. 2024-09-19T09:41:08.511 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:08.509+0000 7fed3962a740 20 client.25384 trim_cache size 0 max 16384 2024-09-19T09:41:08.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:41:08.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:41:08.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:41:08.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:41:08.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:08.510+0000 7fed3688d640 1 -- 172.21.15.1:0/3255691933 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fed140a3410 msgr2=0x7fed140a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:08.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:08.510+0000 7fed3688d640 1 --2- 172.21.15.1:0/3255691933 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fed140a3410 0x7fed140a58d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fed30072080 tx=0x7fed1c005220 comp rx=0 tx=0).stop 2024-09-19T09:41:08.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:08.510+0000 7fed3688d640 1 -- 172.21.15.1:0/3255691933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed3010e120 msgr2=0x7fed301ae4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:08.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:08.510+0000 7fed3688d640 1 --2- 172.21.15.1:0/3255691933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed3010e120 0x7fed301ae4d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fed2800eb10 tx=0x7fed2800c2d0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:08.510+0000 7fed3688d640 1 -- 172.21.15.1:0/3255691933 shutdown_connections 2024-09-19T09:41:08.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:08.510+0000 7fed3688d640 1 --2- 172.21.15.1:0/3255691933 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fed140a3410 0x7fed140a58d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:08.510+0000 7fed3688d640 1 --2- 172.21.15.1:0/3255691933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed3010e120 0x7fed301ae4d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:08.510+0000 7fed3688d640 1 --2- 172.21.15.1:0/3255691933 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed30076230 0x7fed300710b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:08.510+0000 7fed3688d640 1 --2- 172.21.15.1:0/3255691933 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed30074c50 0x7fed30070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:08.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:08.510+0000 7fed3688d640 1 -- 172.21.15.1:0/3255691933 >> 172.21.15.1:0/3255691933 conn(0x7fed300fd2f0 msgr2=0x7fed301014c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:08.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:08.510+0000 7fed3688d640 1 -- 172.21.15.1:0/3255691933 shutdown_connections 2024-09-19T09:41:08.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:08.510+0000 7fed3688d640 1 -- 172.21.15.1:0/3255691933 wait complete. 2024-09-19T09:41:10.000 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:09 smithi001 ceph-mon[31225]: pgmap v430: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 209 MiB/s wr, 22.71k op/s 2024-09-19T09:41:10.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:09 smithi022 ceph-mon[35583]: pgmap v430: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 209 MiB/s wr, 22.71k op/s 2024-09-19T09:41:10.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:09 smithi121 ceph-mon[35577]: pgmap v430: 97 pgs: 97 active+clean; 13 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 209 MiB/s wr, 22.71k op/s 2024-09-19T09:41:11.976 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:11 smithi001 ceph-mon[31225]: pgmap v431: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 193 MiB/s wr, 22.52k op/s 2024-09-19T09:41:12.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:11 smithi022 ceph-mon[35583]: pgmap v431: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 193 MiB/s wr, 22.52k op/s 2024-09-19T09:41:12.116 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:11 smithi121 ceph-mon[35577]: pgmap v431: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 193 MiB/s wr, 22.52k op/s 2024-09-19T09:41:12.896 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:41:12.896 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":19,"btime":"2024-09-19T09:36:24:006349+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:36:23.723388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6839/3279971690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3279971690},{"type":"v1","addr":"172.21.15.121:6839","nonce":3279971690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:41:12.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.677+0000 7f10ad6ef640 1 -- 172.21.15.1:0/3009442893 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10a8102ef0 msgr2=0x7f10a810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:12.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.677+0000 7f10ad6ef640 1 --2- 172.21.15.1:0/3009442893 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10a8102ef0 0x7f10a810da40 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f10a0009ca0 tx=0x7f10a002a950 comp rx=0 tx=0).stop 2024-09-19T09:41:12.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.678+0000 7f10ad6ef640 1 -- 172.21.15.1:0/3009442893 shutdown_connections 2024-09-19T09:41:12.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.678+0000 7f10ad6ef640 1 --2- 172.21.15.1:0/3009442893 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10a8102ef0 0x7f10a810da40 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.678+0000 7f10ad6ef640 1 --2- 172.21.15.1:0/3009442893 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10a8102570 0x7f10a81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.678+0000 7f10ad6ef640 1 --2- 172.21.15.1:0/3009442893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10a8100e20 0x7f10a8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.678+0000 7f10ad6ef640 1 -- 172.21.15.1:0/3009442893 >> 172.21.15.1:0/3009442893 conn(0x7f10a80fc7d0 msgr2=0x7f10a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:12.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.678+0000 7f10ad6ef640 1 -- 172.21.15.1:0/3009442893 shutdown_connections 2024-09-19T09:41:12.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.678+0000 7f10ad6ef640 1 -- 172.21.15.1:0/3009442893 wait complete. 2024-09-19T09:41:12.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.678+0000 7f10ad6ef640 1 Processor -- start 2024-09-19T09:41:12.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.678+0000 7f10ad6ef640 1 -- start start 2024-09-19T09:41:12.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.679+0000 7f10ad6ef640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10a8100e20 0x7f10a810e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:12.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.679+0000 7f10ad6ef640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10a8102570 0x7f10a810e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:12.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.679+0000 7f10ad6ef640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10a8102ef0 0x7f10a810ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:12.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.679+0000 7f10ad6ef640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f10a81120e0 con 0x7f10a8100e20 2024-09-19T09:41:12.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.679+0000 7f10ad6ef640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f10a8111f60 con 0x7f10a8102ef0 2024-09-19T09:41:12.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.679+0000 7f10ad6ef640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f10a8112260 con 0x7f10a8102570 2024-09-19T09:41:12.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.679+0000 7f10a6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10a8100e20 0x7f10a810e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:12.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.679+0000 7f10a6ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10a8100e20 0x7f10a810e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46018/0 (socket says 172.21.15.1:46018) 2024-09-19T09:41:12.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.679+0000 7f10a6ffd640 1 -- 172.21.15.1:0/1406590337 learned_addr learned my addr 172.21.15.1:0/1406590337 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:41:12.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.679+0000 7f10a67fc640 1 --2- 172.21.15.1:0/1406590337 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10a8102570 0x7f10a810e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:12.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.679+0000 7f10a77fe640 1 --2- 172.21.15.1:0/1406590337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10a8102ef0 0x7f10a810ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:12.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.679+0000 7f10a6ffd640 1 -- 172.21.15.1:0/1406590337 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10a8102570 msgr2=0x7f10a810e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:12.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.679+0000 7f10a6ffd640 1 --2- 172.21.15.1:0/1406590337 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10a8102570 0x7f10a810e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.679+0000 7f10a6ffd640 1 -- 172.21.15.1:0/1406590337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10a8102ef0 msgr2=0x7f10a810ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:12.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.679+0000 7f10a6ffd640 1 --2- 172.21.15.1:0/1406590337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10a8102ef0 0x7f10a810ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.679+0000 7f10a6ffd640 1 -- 172.21.15.1:0/1406590337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a81a69e0 con 0x7f10a8100e20 2024-09-19T09:41:12.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.679+0000 7f10a67fc640 1 --2- 172.21.15.1:0/1406590337 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10a8102570 0x7f10a810e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:41:12.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.679+0000 7f10a6ffd640 1 --2- 172.21.15.1:0/1406590337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10a8100e20 0x7f10a810e1d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f109800d950 tx=0x7f109800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:12.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.680+0000 7f108ffff640 1 -- 172.21.15.1:0/1406590337 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1098017030 con 0x7f10a8100e20 2024-09-19T09:41:12.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.680+0000 7f108ffff640 1 -- 172.21.15.1:0/1406590337 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1098004020 con 0x7f10a8100e20 2024-09-19T09:41:12.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.680+0000 7f108ffff640 1 -- 172.21.15.1:0/1406590337 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10980047a0 con 0x7f10a8100e20 2024-09-19T09:41:12.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.680+0000 7f10ad6ef640 1 -- 172.21.15.1:0/1406590337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a81a6cd0 con 0x7f10a8100e20 2024-09-19T09:41:12.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.680+0000 7f10ad6ef640 1 -- 172.21.15.1:0/1406590337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a81a7190 con 0x7f10a8100e20 2024-09-19T09:41:12.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.682+0000 7f10ad6ef640 1 -- 172.21.15.1:0/1406590337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10a8101200 con 0x7f10a8100e20 2024-09-19T09:41:12.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.683+0000 7f108ffff640 1 -- 172.21.15.1:0/1406590337 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f10980041d0 con 0x7f10a8100e20 2024-09-19T09:41:12.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.683+0000 7f108ffff640 1 --2- 172.21.15.1:0/1406590337 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f10900a3240 0x7f10900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:12.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.684+0000 7f10a67fc640 1 --2- 172.21.15.1:0/1406590337 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f10900a3240 0x7f10900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:12.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.684+0000 7f108ffff640 1 -- 172.21.15.1:0/1406590337 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f10980ce9f0 con 0x7f10a8100e20 2024-09-19T09:41:12.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.684+0000 7f10a67fc640 1 --2- 172.21.15.1:0/1406590337 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f10900a3240 0x7f10900a5700 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f109c005fd0 tx=0x7f109c00b5d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:12.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.688+0000 7f108ffff640 1 -- 172.21.15.1:0/1406590337 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f109804e210 con 0x7f10a8100e20 2024-09-19T09:41:12.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.974+0000 7f10ad6ef640 1 -- 172.21.15.1:0/1406590337 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10a81a73c0 con 0x7f10a8100e20 2024-09-19T09:41:12.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.977+0000 7f108ffff640 1 -- 172.21.15.1:0/1406590337 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11837 (secure 0 0 0) 0x7f109809b710 con 0x7f10a8100e20 2024-09-19T09:41:12.900 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 19 2024-09-19T09:41:12.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.983+0000 7f10ad6ef640 1 -- 172.21.15.1:0/1406590337 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f10900a3240 msgr2=0x7f10900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:12.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.983+0000 7f10ad6ef640 1 --2- 172.21.15.1:0/1406590337 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f10900a3240 0x7f10900a5700 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f109c005fd0 tx=0x7f109c00b5d0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.983+0000 7f10ad6ef640 1 -- 172.21.15.1:0/1406590337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10a8100e20 msgr2=0x7f10a810e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:12.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.983+0000 7f10ad6ef640 1 --2- 172.21.15.1:0/1406590337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10a8100e20 0x7f10a810e1d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f109800d950 tx=0x7f109800de10 comp rx=0 tx=0).stop 2024-09-19T09:41:12.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.985+0000 7f10ad6ef640 1 -- 172.21.15.1:0/1406590337 shutdown_connections 2024-09-19T09:41:12.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.985+0000 7f10ad6ef640 1 --2- 172.21.15.1:0/1406590337 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f10900a3240 0x7f10900a5700 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.985+0000 7f10ad6ef640 1 --2- 172.21.15.1:0/1406590337 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f10a8102ef0 0x7f10a810ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.985+0000 7f10ad6ef640 1 --2- 172.21.15.1:0/1406590337 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10a8102570 0x7f10a810e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.985+0000 7f10ad6ef640 1 --2- 172.21.15.1:0/1406590337 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f10a8100e20 0x7f10a810e1d0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:12.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.985+0000 7f10ad6ef640 1 -- 172.21.15.1:0/1406590337 >> 172.21.15.1:0/1406590337 conn(0x7f10a80fc7d0 msgr2=0x7f10a8106810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:12.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.987+0000 7f10ad6ef640 1 -- 172.21.15.1:0/1406590337 shutdown_connections 2024-09-19T09:41:12.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:11.987+0000 7f10ad6ef640 1 -- 172.21.15.1:0/1406590337 wait complete. 2024-09-19T09:41:12.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:12 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1406590337' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:41:13.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:12 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1406590337' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:41:13.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:12 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1406590337' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:41:13.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:13 smithi001 ceph-mon[31225]: pgmap v432: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 165 MiB/s wr, 20.52k op/s 2024-09-19T09:41:14.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:13 smithi022 ceph-mon[35583]: pgmap v432: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 165 MiB/s wr, 20.52k op/s 2024-09-19T09:41:14.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:13 smithi121 ceph-mon[35577]: pgmap v432: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 165 MiB/s wr, 20.52k op/s 2024-09-19T09:41:16.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:15 smithi022 ceph-mon[35583]: pgmap v433: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 158 MiB/s wr, 20.31k op/s 2024-09-19T09:41:16.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:15 smithi121 ceph-mon[35577]: pgmap v433: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 158 MiB/s wr, 20.31k op/s 2024-09-19T09:41:16.250 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:15 smithi001 ceph-mon[31225]: pgmap v433: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 158 MiB/s wr, 20.31k op/s 2024-09-19T09:41:18.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:17 smithi022 ceph-mon[35583]: pgmap v434: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 173 MiB/s wr, 22.98k op/s 2024-09-19T09:41:18.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:17 smithi121 ceph-mon[35577]: pgmap v434: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 173 MiB/s wr, 22.98k op/s 2024-09-19T09:41:18.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:17 smithi001 ceph-mon[31225]: pgmap v434: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 173 MiB/s wr, 22.98k op/s 2024-09-19T09:41:20.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:19 smithi022 ceph-mon[35583]: pgmap v435: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 155 MiB/s wr, 21.30k op/s 2024-09-19T09:41:20.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:19 smithi121 ceph-mon[35577]: pgmap v435: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 155 MiB/s wr, 21.30k op/s 2024-09-19T09:41:20.247 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:19 smithi001 ceph-mon[31225]: pgmap v435: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 155 MiB/s wr, 21.30k op/s 2024-09-19T09:41:21.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.649+0000 7f4cd0342640 1 -- 172.21.15.1:0/3429767888 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4cc810c570 msgr2=0x7f4cc810c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:21.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.650+0000 7f4cd0342640 1 --2- 172.21.15.1:0/3429767888 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4cc810c570 0x7f4cc810c970 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4009860 tx=0x7f4cc402a340 comp rx=0 tx=0).stop 2024-09-19T09:41:21.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.653+0000 7f4cd0342640 1 -- 172.21.15.1:0/3429767888 shutdown_connections 2024-09-19T09:41:21.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.653+0000 7f4cd0342640 1 --2- 172.21.15.1:0/3429767888 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cc810e0f0 0x7f4cc8114980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.653+0000 7f4cd0342640 1 --2- 172.21.15.1:0/3429767888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4cc810d730 0x7f4cc810dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.653+0000 7f4cd0342640 1 --2- 172.21.15.1:0/3429767888 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4cc810c570 0x7f4cc810c970 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.653+0000 7f4cd0342640 1 -- 172.21.15.1:0/3429767888 >> 172.21.15.1:0/3429767888 conn(0x7f4cc806c2b0 msgr2=0x7f4cc806c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:21.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.654+0000 7f4cd0342640 1 -- 172.21.15.1:0/3429767888 shutdown_connections 2024-09-19T09:41:21.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.654+0000 7f4cd0342640 1 -- 172.21.15.1:0/3429767888 wait complete. 2024-09-19T09:41:21.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.655+0000 7f4cd0342640 1 Processor -- start 2024-09-19T09:41:21.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.655+0000 7f4cd0342640 1 -- start start 2024-09-19T09:41:21.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.656+0000 7f4cd0342640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4cc810c570 0x7f4cc81a2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.656+0000 7f4cd0342640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4cc810d730 0x7f4cc81a2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.656+0000 7f4cd0342640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cc810e0f0 0x7f4cc81a9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.656+0000 7f4cd0342640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc81181c0 con 0x7f4cc810d730 2024-09-19T09:41:21.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.656+0000 7f4cd0342640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc8118040 con 0x7f4cc810c570 2024-09-19T09:41:21.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.656+0000 7f4ccd8dd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4cc810d730 0x7f4cc81a2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.656+0000 7f4ccd8dd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4cc810d730 0x7f4cc81a2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43662/0 (socket says 172.21.15.1:43662) 2024-09-19T09:41:21.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.656+0000 7f4ccd8dd640 1 -- 172.21.15.1:0/3853209728 learned_addr learned my addr 172.21.15.1:0/3853209728 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:41:21.659 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.656+0000 7f4cd0342640 1 -- 172.21.15.1:0/3853209728 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc8118340 con 0x7f4cc810e0f0 2024-09-19T09:41:21.660 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.656+0000 7f4cce0de640 1 --2- 172.21.15.1:0/3853209728 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4cc810c570 0x7f4cc81a2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.657+0000 7f4cce8df640 1 --2- 172.21.15.1:0/3853209728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cc810e0f0 0x7f4cc81a9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.657+0000 7f4ccd8dd640 1 -- 172.21.15.1:0/3853209728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cc810e0f0 msgr2=0x7f4cc81a9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:21.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.657+0000 7f4ccd8dd640 1 --2- 172.21.15.1:0/3853209728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cc810e0f0 0x7f4cc81a9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.657+0000 7f4ccd8dd640 1 -- 172.21.15.1:0/3853209728 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4cc810c570 msgr2=0x7f4cc81a2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:21.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.657+0000 7f4ccd8dd640 1 --2- 172.21.15.1:0/3853209728 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4cc810c570 0x7f4cc81a2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.657+0000 7f4ccd8dd640 1 -- 172.21.15.1:0/3853209728 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc81aa550 con 0x7f4cc810d730 2024-09-19T09:41:21.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.657+0000 7f4cce8df640 1 --2- 172.21.15.1:0/3853209728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cc810e0f0 0x7f4cc81a9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:41:21.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.657+0000 7f4cce0de640 1 --2- 172.21.15.1:0/3853209728 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4cc810c570 0x7f4cc81a2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:41:21.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.657+0000 7f4ccd8dd640 1 --2- 172.21.15.1:0/3853209728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4cc810d730 0x7f4cc81a2e70 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800e9c0 tx=0x7f4cb800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:21.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.658+0000 7f4cbf7fe640 1 -- 172.21.15.1:0/3853209728 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8004220 con 0x7f4cc810d730 2024-09-19T09:41:21.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.658+0000 7f4cbf7fe640 1 -- 172.21.15.1:0/3853209728 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cb800cd90 con 0x7f4cc810d730 2024-09-19T09:41:21.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.658+0000 7f4cbf7fe640 1 -- 172.21.15.1:0/3853209728 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8003de0 con 0x7f4cc810d730 2024-09-19T09:41:21.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.658+0000 7f4cd0342640 1 -- 172.21.15.1:0/3853209728 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc806d6a0 con 0x7f4cc810d730 2024-09-19T09:41:21.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.658+0000 7f4cd0342640 1 -- 172.21.15.1:0/3853209728 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc806dc70 con 0x7f4cc810d730 2024-09-19T09:41:21.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.663+0000 7f4cd30da740 1 Processor -- start 2024-09-19T09:41:21.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.663+0000 7f4cd30da740 1 -- start start 2024-09-19T09:41:21.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.663+0000 7f4cd30da740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570d173f9a0 0x5570d173fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.663+0000 7f4cd30da740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570d17402e0 0x5570d1744da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.663+0000 7f4cd30da740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5570d1745370 0x5570d1747830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.664+0000 7f4cd30da740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5570d16a32f0 con 0x5570d17402e0 2024-09-19T09:41:21.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.664+0000 7f4cd30da740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5570d164b270 con 0x5570d173f9a0 2024-09-19T09:41:21.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.664+0000 7f4cd30da740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5570d169f2b0 con 0x5570d1745370 2024-09-19T09:41:21.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.664+0000 7f4cce8df640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570d173f9a0 0x5570d173fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.664+0000 7f4cce8df640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570d173f9a0 0x5570d173fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:51164/0 (socket says 172.21.15.1:51164) 2024-09-19T09:41:21.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.664+0000 7f4cce8df640 1 -- 172.21.15.1:0/3395525544 learned_addr learned my addr 172.21.15.1:0/3395525544 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:41:21.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.664+0000 7f4cce0de640 1 --2- 172.21.15.1:0/3395525544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570d17402e0 0x5570d1744da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.664+0000 7f4cce0de640 1 -- 172.21.15.1:0/3395525544 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5570d1745370 msgr2=0x5570d1747830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:41:21.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.664+0000 7f4cce0de640 1 --2- 172.21.15.1:0/3395525544 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5570d1745370 0x5570d1747830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.664+0000 7f4cce0de640 1 -- 172.21.15.1:0/3395525544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570d173f9a0 msgr2=0x5570d173fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:21.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.664+0000 7f4cce0de640 1 --2- 172.21.15.1:0/3395525544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570d173f9a0 0x5570d173fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.664+0000 7f4cce0de640 1 -- 172.21.15.1:0/3395525544 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570d164a340 con 0x5570d17402e0 2024-09-19T09:41:21.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.666+0000 7f4cbf7fe640 1 -- 172.21.15.1:0/3853209728 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f4cb8026020 con 0x7f4cc810d730 2024-09-19T09:41:21.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.666+0000 7f4cce0de640 1 --2- 172.21.15.1:0/3395525544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570d17402e0 0x5570d1744da0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4035040 tx=0x7f4cc4005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9baf04478ffe0b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:21.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.668+0000 7f4cbf7fe640 1 --2- 172.21.15.1:0/3853209728 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4cb40a3450 0x7f4cb40a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.668+0000 7f4cbf7fe640 1 -- 172.21.15.1:0/3853209728 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f4cb80d7ef0 con 0x7f4cc810d730 2024-09-19T09:41:21.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.668+0000 7f4cbcbfe640 1 -- 172.21.15.1:0/3395525544 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc4037040 con 0x5570d17402e0 2024-09-19T09:41:21.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.668+0000 7f4cbcbfe640 1 -- 172.21.15.1:0/3395525544 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cc4030dd0 con 0x5570d17402e0 2024-09-19T09:41:21.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.668+0000 7f4cbcbfe640 1 -- 172.21.15.1:0/3395525544 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc40054b0 con 0x5570d17402e0 2024-09-19T09:41:21.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.669+0000 7f4cce8df640 1 --2- 172.21.15.1:0/3853209728 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4cb40a3450 0x7f4cb40a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.670+0000 7f4cce8df640 1 --2- 172.21.15.1:0/3853209728 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4cb40a3450 0x7f4cb40a5910 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000f4e0 tx=0x7f4cc0007800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:21.674 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.672+0000 7f4cd30da740 1 -- 172.21.15.1:0/3395525544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570d17402e0 msgr2=0x5570d1744da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:21.674 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.672+0000 7f4cd30da740 1 --2- 172.21.15.1:0/3395525544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570d17402e0 0x5570d1744da0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4035040 tx=0x7f4cc4005d90 comp rx=0 tx=0).stop 2024-09-19T09:41:21.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.674+0000 7f4cd30da740 1 -- 172.21.15.1:0/3395525544 shutdown_connections 2024-09-19T09:41:21.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.674+0000 7f4cd30da740 1 --2- 172.21.15.1:0/3395525544 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5570d1745370 0x5570d1747830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.674+0000 7f4cd30da740 1 --2- 172.21.15.1:0/3395525544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570d17402e0 0x5570d1744da0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.674+0000 7f4cd30da740 1 --2- 172.21.15.1:0/3395525544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570d173f9a0 0x5570d173fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.676 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.674+0000 7f4cd30da740 1 -- 172.21.15.1:0/3395525544 >> 172.21.15.1:0/3395525544 conn(0x5570d173b010 msgr2=0x5570d173b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:21.677 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.674+0000 7f4cd30da740 1 -- 172.21.15.1:0/3395525544 shutdown_connections 2024-09-19T09:41:21.679 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.677+0000 7f4cd30da740 1 -- 172.21.15.1:0/3395525544 wait complete. 2024-09-19T09:41:21.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.677+0000 7f4cd30da740 1 -- start start 2024-09-19T09:41:21.680 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.677+0000 7f4cd30da740 1 Processor -- start 2024-09-19T09:41:21.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.678+0000 7f4cd30da740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5570d173f9a0 0x5570d1749c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.678+0000 7f4cd30da740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570d17402e0 0x5570d174a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.678+0000 7f4cd30da740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570d1745370 0x5570d17511b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.678+0000 7f4cd30da740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5570d17482e0 con 0x5570d1745370 2024-09-19T09:41:21.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.678+0000 7f4cd30da740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5570d162c290 con 0x5570d17402e0 2024-09-19T09:41:21.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.678+0000 7f4cd30da740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5570d1748460 con 0x5570d173f9a0 2024-09-19T09:41:21.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.678+0000 7f4cd30da740 10 client.0 _ll_register_callbacks cb 0x5570d165d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:21.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.678+0000 7f4ccd8dd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570d17402e0 0x5570d174a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.679+0000 7f4cce8df640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570d1745370 0x5570d17511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.679+0000 7f4cce8df640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570d1745370 0x5570d17511b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43678/0 (socket says 172.21.15.1:43678) 2024-09-19T09:41:21.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.679+0000 7f4cce8df640 1 -- 172.21.15.1:0/88114130 learned_addr learned my addr 172.21.15.1:0/88114130 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:41:21.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.679+0000 7f4cce8df640 1 -- 172.21.15.1:0/88114130 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5570d173f9a0 msgr2=0x5570d1749c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:21.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.679+0000 7f4cce8df640 1 --2- 172.21.15.1:0/88114130 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5570d173f9a0 0x5570d1749c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.679+0000 7f4cce8df640 1 -- 172.21.15.1:0/88114130 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570d17402e0 msgr2=0x5570d174a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:21.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.679+0000 7f4cce8df640 1 --2- 172.21.15.1:0/88114130 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570d17402e0 0x5570d174a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.679+0000 7f4cce8df640 1 -- 172.21.15.1:0/88114130 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570d13b6210 con 0x5570d1745370 2024-09-19T09:41:21.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.680+0000 7f4cce8df640 1 --2- 172.21.15.1:0/88114130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570d1745370 0x5570d17511b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0010010 tx=0x7f4cc0004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c46c534239267 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:21.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.680+0000 7f4cb1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:41:21.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.681+0000 7f4cb1ffb640 1 -- 172.21.15.1:0/88114130 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc001d620 con 0x5570d1745370 2024-09-19T09:41:21.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.681+0000 7f4cd30da740 1 -- 172.21.15.1:0/88114130 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4cc4030dd0 con 0x5570d1745370 2024-09-19T09:41:21.684 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.681+0000 7f4cb1ffb640 1 -- 172.21.15.1:0/88114130 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f4cc001d7c0 con 0x5570d1745370 2024-09-19T09:41:21.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.684+0000 7f4cb1ffb640 1 -- 172.21.15.1:0/88114130 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4cc000de70 con 0x5570d1745370 2024-09-19T09:41:21.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.684+0000 7f4cd30da740 10 client.15855 fetch_fsmap learned FSMap version 19 2024-09-19T09:41:21.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.684+0000 7f4cd30da740 1 -- 172.21.15.1:0/88114130 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5570d1482620 con 0x5570d1745370 2024-09-19T09:41:21.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.686+0000 7f4cb1ffb640 1 -- 172.21.15.1:0/88114130 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cc4030dd0 con 0x5570d1745370 2024-09-19T09:41:21.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.687+0000 7f4cb1ffb640 1 -- 172.21.15.1:0/88114130 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4cc002fc00 con 0x5570d1745370 2024-09-19T09:41:21.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.688+0000 7f4cd30da740 10 client.15855 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:41:21.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.688+0000 7f4cd30da740 10 client.15855 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:41:21.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.688+0000 7f4cd30da740 20 client.15855 populate_metadata read hostname 'smithi001' 2024-09-19T09:41:21.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.688+0000 7f4cd30da740 1 --2- 172.21.15.1:0/88114130 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5570d1755950 0x5570d1757da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.688+0000 7f4cd30da740 4 client.15855 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:41:21.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.688+0000 7f4cd30da740 1 -- 172.21.15.1:0/88114130 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570d16b0a20 con 0x5570d1755950 2024-09-19T09:41:21.691 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.688+0000 7f4cce0de640 1 --2- 172.21.15.1:0/88114130 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5570d1755950 0x5570d1757da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.690+0000 7f4cce0de640 1 --2- 172.21.15.1:0/88114130 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5570d1755950 0x5570d1757da0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45df3e2fef5bd825 server_cookie=a55642cfef2276e9 in_seq=0 out_seq=0 2024-09-19T09:41:21.693 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.690+0000 7f4cb1ffb640 10 client.15855 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:41:21.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.691+0000 7f4cb1ffb640 1 -- 172.21.15.1:0/88114130 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5570d16b0a20 con 0x5570d1755950 2024-09-19T09:41:21.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.691+0000 7f4cb1ffb640 10 client.15855 handle_command_reply: tid=0 2024-09-19T09:41:21.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.691+0000 7f4cd30da740 1 client.15855 shutdown 2024-09-19T09:41:21.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.693+0000 7f4cd30da740 1 -- 172.21.15.1:0/88114130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570d1745370 msgr2=0x5570d17511b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:21.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.693+0000 7f4cd30da740 1 --2- 172.21.15.1:0/88114130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570d1745370 0x5570d17511b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0010010 tx=0x7f4cc0004b50 comp rx=0 tx=0).stop 2024-09-19T09:41:21.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.693+0000 7f4cd30da740 1 -- 172.21.15.1:0/88114130 shutdown_connections 2024-09-19T09:41:21.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.693+0000 7f4cd30da740 1 --2- 172.21.15.1:0/88114130 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5570d1755950 0x5570d1757da0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.693+0000 7f4cd30da740 1 --2- 172.21.15.1:0/88114130 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570d1745370 0x5570d17511b0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.693+0000 7f4cd30da740 1 --2- 172.21.15.1:0/88114130 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570d17402e0 0x5570d174a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.693+0000 7f4cd30da740 1 --2- 172.21.15.1:0/88114130 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5570d173f9a0 0x5570d1749c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.693+0000 7f4cd30da740 1 -- 172.21.15.1:0/88114130 >> 172.21.15.1:0/88114130 conn(0x5570d173b010 msgr2=0x5570d173c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:21.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.693+0000 7f4cb1ffb640 0 client.15855 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:41:21.702 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.699+0000 7f4cd30da740 1 -- 172.21.15.1:0/88114130 shutdown_connections 2024-09-19T09:41:21.707 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.705+0000 7f4cd30da740 1 -- 172.21.15.1:0/88114130 wait complete. 2024-09-19T09:41:21.709 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.707+0000 7f4cd30da740 20 client.15855 trim_cache size 0 max 16384 2024-09-19T09:41:21.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.750+0000 7f4cd30da740 1 Processor -- start 2024-09-19T09:41:21.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.754+0000 7f4cd30da740 1 -- start start 2024-09-19T09:41:21.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.755+0000 7f4cd30da740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5570d173f9a0 0x5570d173fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.755+0000 7f4cd30da740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570d17402e0 0x5570d1751170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.755+0000 7f4cd30da740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570d1745370 0x5570d173bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.755+0000 7f4ccd8dd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570d17402e0 0x5570d1751170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.755+0000 7f4ccd8dd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570d17402e0 0x5570d1751170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:51176/0 (socket says 172.21.15.1:51176) 2024-09-19T09:41:21.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.755+0000 7f4cce8df640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570d1745370 0x5570d173bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.756+0000 7f4cce8df640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570d1745370 0x5570d173bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:43684/0 (socket says 172.21.15.1:43684) 2024-09-19T09:41:21.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.756+0000 7f4ccd8dd640 1 -- 172.21.15.1:0/2169195852 learned_addr learned my addr 172.21.15.1:0/2169195852 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:41:21.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.756+0000 7f4cd30da740 1 -- 172.21.15.1:0/2169195852 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc81ad880 con 0x5570d1745370 2024-09-19T09:41:21.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.756+0000 7f4cd30da740 1 -- 172.21.15.1:0/2169195852 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc81b0120 con 0x5570d17402e0 2024-09-19T09:41:21.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.756+0000 7f4cd30da740 1 -- 172.21.15.1:0/2169195852 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc81adf10 con 0x5570d173f9a0 2024-09-19T09:41:21.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.757+0000 7f4cce0de640 1 --2- 172.21.15.1:0/2169195852 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5570d173f9a0 0x5570d173fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.758+0000 7f4ccd8dd640 1 -- 172.21.15.1:0/2169195852 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5570d173f9a0 msgr2=0x5570d173fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:21.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.758+0000 7f4ccd8dd640 1 --2- 172.21.15.1:0/2169195852 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5570d173f9a0 0x5570d173fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.758+0000 7f4ccd8dd640 1 -- 172.21.15.1:0/2169195852 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570d1745370 msgr2=0x5570d173bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:21.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.758+0000 7f4ccd8dd640 1 --2- 172.21.15.1:0/2169195852 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570d1745370 0x5570d173bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.758+0000 7f4ccd8dd640 1 -- 172.21.15.1:0/2169195852 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570d173ae30 con 0x5570d17402e0 2024-09-19T09:41:21.761 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.758+0000 7f4cce8df640 1 --2- 172.21.15.1:0/2169195852 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570d1745370 0x5570d173bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:21.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.761+0000 7f4ccd8dd640 1 --2- 172.21.15.1:0/2169195852 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570d17402e0 0x5570d1751170 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800f010 tx=0x7f4cb8019040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3361f2adf9a7663 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:21.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.763+0000 7f4cb3fff640 1 -- 172.21.15.1:0/2169195852 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb80bd070 con 0x5570d17402e0 2024-09-19T09:41:21.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.764+0000 7f4cb3fff640 1 -- 172.21.15.1:0/2169195852 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cb80a44d0 con 0x5570d17402e0 2024-09-19T09:41:21.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.764+0000 7f4cb3fff640 1 -- 172.21.15.1:0/2169195852 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb80a0b40 con 0x5570d17402e0 2024-09-19T09:41:21.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.766+0000 7f4cd30da740 1 -- 172.21.15.1:0/2169195852 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570d17402e0 msgr2=0x5570d1751170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:21.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.766+0000 7f4cd30da740 1 --2- 172.21.15.1:0/2169195852 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570d17402e0 0x5570d1751170 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800f010 tx=0x7f4cb8019040 comp rx=0 tx=0).stop 2024-09-19T09:41:21.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.768+0000 7f4cd30da740 1 -- 172.21.15.1:0/2169195852 shutdown_connections 2024-09-19T09:41:21.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.769+0000 7f4cd30da740 1 --2- 172.21.15.1:0/2169195852 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570d1745370 0x5570d173bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.769+0000 7f4cd30da740 1 --2- 172.21.15.1:0/2169195852 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570d17402e0 0x5570d1751170 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.769+0000 7f4cd30da740 1 --2- 172.21.15.1:0/2169195852 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5570d173f9a0 0x5570d173fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.769+0000 7f4cd30da740 1 -- 172.21.15.1:0/2169195852 >> 172.21.15.1:0/2169195852 conn(0x5570d173b010 msgr2=0x5570d17499e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:21.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.773+0000 7f4cd30da740 1 -- 172.21.15.1:0/2169195852 shutdown_connections 2024-09-19T09:41:21.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.775+0000 7f4cd30da740 1 -- 172.21.15.1:0/2169195852 wait complete. 2024-09-19T09:41:21.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.775+0000 7f4cd30da740 1 -- start start 2024-09-19T09:41:21.780 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.775+0000 7f4cd30da740 1 Processor -- start 2024-09-19T09:41:21.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.779+0000 7f4cd30da740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5570d173f9a0 0x5570d174e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.780+0000 7f4cd30da740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570d17402e0 0x5570d174ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.780+0000 7f4cd30da740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570d1745370 0x5570d174f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.780+0000 7f4cd30da740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc81ae5e0 con 0x5570d1745370 2024-09-19T09:41:21.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.780+0000 7f4cd30da740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc81afa50 con 0x5570d17402e0 2024-09-19T09:41:21.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.780+0000 7f4cd30da740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc81aecb0 con 0x5570d173f9a0 2024-09-19T09:41:21.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.780+0000 7f4cce0de640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5570d173f9a0 0x5570d174e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.780+0000 7f4cce0de640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5570d173f9a0 0x5570d174e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:52638/0 (socket says 172.21.15.1:52638) 2024-09-19T09:41:21.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.780+0000 7f4cce0de640 1 -- 172.21.15.1:0/3028901601 learned_addr learned my addr 172.21.15.1:0/3028901601 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:41:21.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.780+0000 7f4cd30da740 10 client.0 _ll_register_callbacks cb 0x7f4cc0007280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:21.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.782+0000 7f4cce8df640 1 --2- 172.21.15.1:0/3028901601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570d1745370 0x5570d174f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.782+0000 7f4ccd8dd640 1 --2- 172.21.15.1:0/3028901601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570d17402e0 0x5570d174ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.784+0000 7f4cce8df640 1 -- 172.21.15.1:0/3028901601 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5570d173f9a0 msgr2=0x5570d174e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.784+0000 7f4cce8df640 1 --2- 172.21.15.1:0/3028901601 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5570d173f9a0 0x5570d174e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.784+0000 7f4cce8df640 1 -- 172.21.15.1:0/3028901601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570d17402e0 msgr2=0x5570d174ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.784+0000 7f4cce8df640 1 --2- 172.21.15.1:0/3028901601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570d17402e0 0x5570d174ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.784+0000 7f4cce8df640 1 -- 172.21.15.1:0/3028901601 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570d174fff0 con 0x5570d1745370 2024-09-19T09:41:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.785+0000 7f4cce8df640 1 --2- 172.21.15.1:0/3028901601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570d1745370 0x5570d174f9e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0007350 tx=0x7f4cc0025c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=370a6ae63db795e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:21.787 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.785+0000 7f4cb1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:41:21.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.787+0000 7f4cb1ffb640 1 -- 172.21.15.1:0/3028901601 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc003e020 con 0x5570d1745370 2024-09-19T09:41:21.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.788+0000 7f4cb1ffb640 1 -- 172.21.15.1:0/3028901601 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f4cc002f830 con 0x5570d1745370 2024-09-19T09:41:21.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.788+0000 7f4cd30da740 1 -- 172.21.15.1:0/3028901601 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4cb80a44d0 con 0x5570d1745370 2024-09-19T09:41:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.789+0000 7f4cb1ffb640 1 -- 172.21.15.1:0/3028901601 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4cc0025e10 con 0x5570d1745370 2024-09-19T09:41:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.790+0000 7f4cd30da740 10 client.15861 fetch_fsmap learned FSMap version 19 2024-09-19T09:41:21.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.790+0000 7f4cd30da740 1 -- 172.21.15.1:0/3028901601 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5570d1751370 con 0x5570d1745370 2024-09-19T09:41:21.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.792+0000 7f4cb1ffb640 1 -- 172.21.15.1:0/3028901601 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cb80a44d0 con 0x5570d1745370 2024-09-19T09:41:21.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.792+0000 7f4cb1ffb640 1 -- 172.21.15.1:0/3028901601 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f4cc0045b40 con 0x5570d1745370 2024-09-19T09:41:21.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.793+0000 7f4cd30da740 10 client.15861 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:41:21.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.793+0000 7f4cd30da740 10 client.15861 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:41:21.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.793+0000 7f4cd30da740 20 client.15861 populate_metadata read hostname 'smithi001' 2024-09-19T09:41:21.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.793+0000 7f4cd30da740 1 --2- 172.21.15.1:0/3028901601 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5570d17c0b50 0x5570d17c2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:21.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.793+0000 7f4cd30da740 4 client.15861 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:41:21.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.793+0000 7f4cd30da740 1 -- 172.21.15.1:0/3028901601 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5570d16aad70 con 0x5570d17c0b50 2024-09-19T09:41:21.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.795+0000 7f4cce0de640 1 --2- 172.21.15.1:0/3028901601 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5570d17c0b50 0x5570d17c2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:21.802 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.800+0000 7f4cce0de640 1 --2- 172.21.15.1:0/3028901601 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5570d17c0b50 0x5570d17c2f70 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=add7be8a26e07166 server_cookie=9d7f086708078fde in_seq=0 out_seq=0 2024-09-19T09:41:21.803 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:21.800+0000 7f4cb1ffb640 10 client.15861 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:41:21.909 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 16.6 2024-09-19T09:41:21.910 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:41:22.052 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:21 smithi001 ceph-mon[31225]: pgmap v436: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 156 MiB/s wr, 21.96k op/s 2024-09-19T09:41:22.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:21 smithi022 ceph-mon[35583]: pgmap v436: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 156 MiB/s wr, 21.96k op/s 2024-09-19T09:41:22.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:21 smithi121 ceph-mon[35577]: pgmap v436: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 156 MiB/s wr, 21.96k op/s 2024-09-19T09:41:23.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:23.383+0000 7f4cb1ffb640 1 -- 172.21.15.1:0/3028901601 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5570d16aad70 con 0x5570d17c0b50 2024-09-19T09:41:23.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:23.383+0000 7f4cb1ffb640 10 client.15861 handle_command_reply: tid=0 2024-09-19T09:41:23.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:23.383+0000 7f4cd30da740 1 client.15861 shutdown 2024-09-19T09:41:23.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:23.384+0000 7f4cd30da740 1 -- 172.21.15.1:0/3028901601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570d1745370 msgr2=0x5570d174f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:23.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:23.384+0000 7f4cd30da740 1 --2- 172.21.15.1:0/3028901601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570d1745370 0x5570d174f9e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0007350 tx=0x7f4cc0025c20 comp rx=0 tx=0).stop 2024-09-19T09:41:23.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:23.384+0000 7f4cd30da740 1 -- 172.21.15.1:0/3028901601 shutdown_connections 2024-09-19T09:41:23.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:23.384+0000 7f4cd30da740 1 --2- 172.21.15.1:0/3028901601 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5570d17c0b50 0x5570d17c2f70 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:23.384+0000 7f4cd30da740 1 --2- 172.21.15.1:0/3028901601 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5570d1745370 0x5570d174f9e0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:23.384+0000 7f4cd30da740 1 --2- 172.21.15.1:0/3028901601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570d17402e0 0x5570d174ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:23.384+0000 7f4cd30da740 1 --2- 172.21.15.1:0/3028901601 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5570d173f9a0 0x5570d174e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.388 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:23.384+0000 7f4cd30da740 1 -- 172.21.15.1:0/3028901601 >> 172.21.15.1:0/3028901601 conn(0x5570d173b010 msgr2=0x5570d17399a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:23.388 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:23.384+0000 7f4cb1ffb640 0 client.15861 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:41:23.388 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:23.384+0000 7f4cd30da740 1 -- 172.21.15.1:0/3028901601 shutdown_connections 2024-09-19T09:41:23.388 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:23.384+0000 7f4cd30da740 1 -- 172.21.15.1:0/3028901601 wait complete. 2024-09-19T09:41:23.388 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:23.385+0000 7f4cd30da740 20 client.15861 trim_cache size 0 max 16384 2024-09-19T09:41:23.388 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:41:23.389 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:41:23.389 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:41:23.389 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:41:23.390 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:23.387+0000 7f4cd0342640 1 -- 172.21.15.1:0/3853209728 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4cb40a3450 msgr2=0x7f4cb40a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:23.390 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:23.387+0000 7f4cd0342640 1 --2- 172.21.15.1:0/3853209728 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4cb40a3450 0x7f4cb40a5910 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000f4e0 tx=0x7f4cc0007800 comp rx=0 tx=0).stop 2024-09-19T09:41:23.390 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:23.387+0000 7f4cd0342640 1 -- 172.21.15.1:0/3853209728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4cc810d730 msgr2=0x7f4cc81a2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:23.390 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:23.387+0000 7f4cd0342640 1 --2- 172.21.15.1:0/3853209728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4cc810d730 0x7f4cc81a2e70 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800e9c0 tx=0x7f4cb800ee80 comp rx=0 tx=0).stop 2024-09-19T09:41:23.392 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:23.389+0000 7f4cd0342640 1 -- 172.21.15.1:0/3853209728 shutdown_connections 2024-09-19T09:41:23.392 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:23.389+0000 7f4cd0342640 1 --2- 172.21.15.1:0/3853209728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cc810e0f0 0x7f4cc81a9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.392 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:23.389+0000 7f4cd0342640 1 --2- 172.21.15.1:0/3853209728 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4cc810d730 0x7f4cc81a2e70 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.392 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:23.389+0000 7f4cd0342640 1 --2- 172.21.15.1:0/3853209728 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f4cb40a3450 0x7f4cb40a5910 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.392 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:23.389+0000 7f4cd0342640 1 --2- 172.21.15.1:0/3853209728 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4cc810c570 0x7f4cc81a2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:23.392 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:23.389+0000 7f4cd0342640 1 -- 172.21.15.1:0/3853209728 >> 172.21.15.1:0/3853209728 conn(0x7f4cc806c2b0 msgr2=0x7f4cc8110bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:23.393 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:23.390+0000 7f4cd0342640 1 -- 172.21.15.1:0/3853209728 shutdown_connections 2024-09-19T09:41:23.393 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:23.390+0000 7f4cd0342640 1 -- 172.21.15.1:0/3853209728 wait complete. 2024-09-19T09:41:23.562 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:41:23.703 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:41:23.771 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:23 smithi001 ceph-mon[31225]: pgmap v437: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 148 MiB/s wr, 21.30k op/s 2024-09-19T09:41:23.771 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:23 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:41:24.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:23 smithi022 ceph-mon[35583]: pgmap v437: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 148 MiB/s wr, 21.30k op/s 2024-09-19T09:41:24.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:23 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:41:24.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:23 smithi121 ceph-mon[35577]: pgmap v437: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 148 MiB/s wr, 21.30k op/s 2024-09-19T09:41:24.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:23 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:41:25.116 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:24 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:41:25.117 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:24 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:41:25.117 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:24 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:41:25.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:24 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:41:25.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:24 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:41:25.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:24 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:41:25.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:24 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:41:25.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:24 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:41:25.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:24 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:41:26.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:26 smithi001 ceph-mon[31225]: pgmap v438: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 150 MiB/s wr, 21.88k op/s 2024-09-19T09:41:26.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:26 smithi022 ceph-mon[35583]: pgmap v438: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 150 MiB/s wr, 21.88k op/s 2024-09-19T09:41:26.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:26 smithi121 ceph-mon[35577]: pgmap v438: 97 pgs: 97 active+clean; 13 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 150 MiB/s wr, 21.88k op/s 2024-09-19T09:41:28.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:28 smithi022 ceph-mon[35583]: pgmap v439: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 157 MiB/s wr, 23.46k op/s 2024-09-19T09:41:28.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:28 smithi121 ceph-mon[35577]: pgmap v439: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 157 MiB/s wr, 23.46k op/s 2024-09-19T09:41:28.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:28 smithi001 ceph-mon[31225]: pgmap v439: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 157 MiB/s wr, 23.46k op/s 2024-09-19T09:41:30.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:30 smithi022 ceph-mon[35583]: pgmap v440: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 142 MiB/s wr, 21.60k op/s 2024-09-19T09:41:30.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:30 smithi121 ceph-mon[35577]: pgmap v440: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 142 MiB/s wr, 21.60k op/s 2024-09-19T09:41:30.374 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:30 smithi001 ceph-mon[31225]: pgmap v440: 97 pgs: 97 active+clean; 13 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 142 MiB/s wr, 21.60k op/s 2024-09-19T09:41:31.215 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:41:31.216 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":19,"btime":"2024-09-19T09:36:24:006349+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:36:23.723388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6839/3279971690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3279971690},{"type":"v1","addr":"172.21.15.121:6839","nonce":3279971690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:41:31.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.903+0000 7f3ed13bd640 1 -- 172.21.15.1:0/1382933464 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ecc109450 msgr2=0x7f3ecc110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:31.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.903+0000 7f3ed13bd640 1 --2- 172.21.15.1:0/1382933464 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ecc109450 0x7f3ecc110250 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc009860 tx=0x7f3ebc02a380 comp rx=0 tx=0).stop 2024-09-19T09:41:31.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.906+0000 7f3ed13bd640 1 -- 172.21.15.1:0/1382933464 shutdown_connections 2024-09-19T09:41:31.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.906+0000 7f3ed13bd640 1 --2- 172.21.15.1:0/1382933464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ecc11b140 0x7f3ecc11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.906+0000 7f3ed13bd640 1 --2- 172.21.15.1:0/1382933464 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ecc109830 0x7f3ecc109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.906+0000 7f3ed13bd640 1 --2- 172.21.15.1:0/1382933464 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ecc109450 0x7f3ecc110250 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.907+0000 7f3ed13bd640 1 -- 172.21.15.1:0/1382933464 >> 172.21.15.1:0/1382933464 conn(0x7f3ecc06e140 msgr2=0x7f3ecc06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:31.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.908+0000 7f3ed13bd640 1 -- 172.21.15.1:0/1382933464 shutdown_connections 2024-09-19T09:41:31.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.909+0000 7f3ed13bd640 1 -- 172.21.15.1:0/1382933464 wait complete. 2024-09-19T09:41:31.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.910+0000 7f3ed13bd640 1 Processor -- start 2024-09-19T09:41:31.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.911+0000 7f3ed13bd640 1 -- start start 2024-09-19T09:41:31.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.914+0000 7f3ed13bd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ecc109450 0x7f3ecc11a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:31.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.914+0000 7f3ed13bd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ecc109830 0x7f3ecc1168c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:31.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.914+0000 7f3ed13bd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ecc11b140 0x7f3ecc116e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:31.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.914+0000 7f3ed13bd640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3ecc113300 con 0x7f3ecc109830 2024-09-19T09:41:31.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.914+0000 7f3ed13bd640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3ecc113180 con 0x7f3ecc109450 2024-09-19T09:41:31.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.914+0000 7f3ed13bd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3ecc113480 con 0x7f3ecc11b140 2024-09-19T09:41:31.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.915+0000 7f3eca7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ecc109830 0x7f3ecc1168c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:31.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.915+0000 7f3ecb7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ecc11b140 0x7f3ecc116e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:31.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.915+0000 7f3ecb7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ecc11b140 0x7f3ecc116e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:52580/0 (socket says 172.21.15.1:52580) 2024-09-19T09:41:31.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.915+0000 7f3ecb7fe640 1 -- 172.21.15.1:0/2279637382 learned_addr learned my addr 172.21.15.1:0/2279637382 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:41:31.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.916+0000 7f3ecaffd640 1 --2- 172.21.15.1:0/2279637382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ecc109450 0x7f3ecc11a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:31.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.916+0000 7f3ecb7fe640 1 -- 172.21.15.1:0/2279637382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ecc109450 msgr2=0x7f3ecc11a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:31.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.916+0000 7f3ecb7fe640 1 --2- 172.21.15.1:0/2279637382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ecc109450 0x7f3ecc11a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.916+0000 7f3ecb7fe640 1 -- 172.21.15.1:0/2279637382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ecc109830 msgr2=0x7f3ecc1168c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:31.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.916+0000 7f3ecb7fe640 1 --2- 172.21.15.1:0/2279637382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ecc109830 0x7f3ecc1168c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.916+0000 7f3ecb7fe640 1 -- 172.21.15.1:0/2279637382 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ecc117530 con 0x7f3ecc11b140 2024-09-19T09:41:31.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.917+0000 7f3ecaffd640 1 --2- 172.21.15.1:0/2279637382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ecc109450 0x7f3ecc11a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:41:31.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.917+0000 7f3ecb7fe640 1 --2- 172.21.15.1:0/2279637382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ecc11b140 0x7f3ecc116e00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3ec401fd90 tx=0x7f3ec401d750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:31.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.918+0000 7f3eb3fff640 1 -- 172.21.15.1:0/2279637382 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec401de60 con 0x7f3ecc11b140 2024-09-19T09:41:31.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.918+0000 7f3eb3fff640 1 -- 172.21.15.1:0/2279637382 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ec4003970 con 0x7f3ecc11b140 2024-09-19T09:41:31.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.919+0000 7f3eb3fff640 1 -- 172.21.15.1:0/2279637382 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ec40045f0 con 0x7f3ecc11b140 2024-09-19T09:41:31.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.920+0000 7f3ed13bd640 1 -- 172.21.15.1:0/2279637382 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ecc1ab170 con 0x7f3ecc11b140 2024-09-19T09:41:31.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.920+0000 7f3ed13bd640 1 -- 172.21.15.1:0/2279637382 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ecc1ab510 con 0x7f3ecc11b140 2024-09-19T09:41:31.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.922+0000 7f3ed13bd640 1 -- 172.21.15.1:0/2279637382 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ecc073b00 con 0x7f3ecc11b140 2024-09-19T09:41:31.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.928+0000 7f3eb3fff640 1 -- 172.21.15.1:0/2279637382 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f3ec402e020 con 0x7f3ecc11b140 2024-09-19T09:41:31.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.929+0000 7f3eb3fff640 1 --2- 172.21.15.1:0/2279637382 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3eb40a3200 0x7f3eb40a56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:31.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.929+0000 7f3ecaffd640 1 --2- 172.21.15.1:0/2279637382 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3eb40a3200 0x7f3eb40a56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:31.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.930+0000 7f3eb3fff640 1 -- 172.21.15.1:0/2279637382 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f3ec4004790 con 0x7f3ecc11b140 2024-09-19T09:41:31.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.933+0000 7f3ecaffd640 1 --2- 172.21.15.1:0/2279637382 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3eb40a3200 0x7f3eb40a56c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc035040 tx=0x7f3ebc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:31.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:29.934+0000 7f3eb3fff640 1 -- 172.21.15.1:0/2279637382 <== mon.1 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3ec40ad150 con 0x7f3ecc11b140 2024-09-19T09:41:31.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:30.371+0000 7f3ed13bd640 1 -- 172.21.15.1:0/2279637382 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ecc10d5c0 con 0x7f3ecc11b140 2024-09-19T09:41:31.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:30.374+0000 7f3eb3fff640 1 -- 172.21.15.1:0/2279637382 <== mon.1 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11837 (secure 0 0 0) 0x7f3ec40b0e00 con 0x7f3ecc11b140 2024-09-19T09:41:31.219 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 19 2024-09-19T09:41:31.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:30.377+0000 7f3ed13bd640 1 -- 172.21.15.1:0/2279637382 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3eb40a3200 msgr2=0x7f3eb40a56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:31.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:30.377+0000 7f3ed13bd640 1 --2- 172.21.15.1:0/2279637382 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3eb40a3200 0x7f3eb40a56c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc035040 tx=0x7f3ebc000bc0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:30.377+0000 7f3ed13bd640 1 -- 172.21.15.1:0/2279637382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ecc11b140 msgr2=0x7f3ecc116e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:31.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:30.377+0000 7f3ed13bd640 1 --2- 172.21.15.1:0/2279637382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ecc11b140 0x7f3ecc116e00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3ec401fd90 tx=0x7f3ec401d750 comp rx=0 tx=0).stop 2024-09-19T09:41:31.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:30.378+0000 7f3ed13bd640 1 -- 172.21.15.1:0/2279637382 shutdown_connections 2024-09-19T09:41:31.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:30.378+0000 7f3ed13bd640 1 --2- 172.21.15.1:0/2279637382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ecc11b140 0x7f3ecc116e00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:30.378+0000 7f3ed13bd640 1 --2- 172.21.15.1:0/2279637382 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3ecc109830 0x7f3ecc1168c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:30.378+0000 7f3ed13bd640 1 --2- 172.21.15.1:0/2279637382 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3eb40a3200 0x7f3eb40a56c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:30.378+0000 7f3ed13bd640 1 --2- 172.21.15.1:0/2279637382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ecc109450 0x7f3ecc11a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:31.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:30.378+0000 7f3ed13bd640 1 -- 172.21.15.1:0/2279637382 >> 172.21.15.1:0/2279637382 conn(0x7f3ecc06e140 msgr2=0x7f3ecc070ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:31.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:30.378+0000 7f3ed13bd640 1 -- 172.21.15.1:0/2279637382 shutdown_connections 2024-09-19T09:41:31.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:30.379+0000 7f3ed13bd640 1 -- 172.21.15.1:0/2279637382 wait complete. 2024-09-19T09:41:31.366 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:31 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/2279637382' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:41:31.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:31 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/2279637382' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:41:31.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:31 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/2279637382' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:41:32.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:32 smithi022 ceph-mon[35583]: pgmap v441: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 144 MiB/s wr, 22.09k op/s 2024-09-19T09:41:32.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:32 smithi121 ceph-mon[35577]: pgmap v441: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 144 MiB/s wr, 22.09k op/s 2024-09-19T09:41:32.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:32 smithi001 ceph-mon[31225]: pgmap v441: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 144 MiB/s wr, 22.09k op/s 2024-09-19T09:41:34.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:34 smithi022 ceph-mon[35583]: pgmap v442: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 134 MiB/s wr, 20.84k op/s 2024-09-19T09:41:34.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:34 smithi121 ceph-mon[35577]: pgmap v442: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 134 MiB/s wr, 20.84k op/s 2024-09-19T09:41:34.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:34 smithi001 ceph-mon[31225]: pgmap v442: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 134 MiB/s wr, 20.84k op/s 2024-09-19T09:41:36.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:36 smithi022 ceph-mon[35583]: pgmap v443: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 125 MiB/s wr, 19.73k op/s 2024-09-19T09:41:36.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:36 smithi121 ceph-mon[35577]: pgmap v443: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 125 MiB/s wr, 19.73k op/s 2024-09-19T09:41:36.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:36 smithi001 ceph-mon[31225]: pgmap v443: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 125 MiB/s wr, 19.73k op/s 2024-09-19T09:41:38.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:38 smithi022 ceph-mon[35583]: pgmap v444: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 129 MiB/s wr, 20.55k op/s 2024-09-19T09:41:38.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:38 smithi121 ceph-mon[35577]: pgmap v444: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 129 MiB/s wr, 20.55k op/s 2024-09-19T09:41:38.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:38 smithi001 ceph-mon[31225]: pgmap v444: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 129 MiB/s wr, 20.55k op/s 2024-09-19T09:41:40.198 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.195+0000 7fe50e75f640 1 -- 172.21.15.1:0/1373823899 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5081025f0 msgr2=0x7fe508108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:40.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.195+0000 7fe50e75f640 1 --2- 172.21.15.1:0/1373823899 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5081025f0 0x7fe508108e80 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fe500009ca0 tx=0x7fe50002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:41:40.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.195+0000 7fe50e75f640 1 -- 172.21.15.1:0/1373823899 shutdown_connections 2024-09-19T09:41:40.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.195+0000 7fe50e75f640 1 --2- 172.21.15.1:0/1373823899 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5081025f0 0x7fe508108e80 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:40.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.195+0000 7fe50e75f640 1 --2- 172.21.15.1:0/1373823899 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe508101c30 0x7fe5081020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:40.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.195+0000 7fe50e75f640 1 --2- 172.21.15.1:0/1373823899 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe508100a40 0x7fe508100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:40.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.195+0000 7fe50e75f640 1 -- 172.21.15.1:0/1373823899 >> 172.21.15.1:0/1373823899 conn(0x7fe5080fc1c0 msgr2=0x7fe5080fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:40.199 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.195+0000 7fe50e75f640 1 -- 172.21.15.1:0/1373823899 shutdown_connections 2024-09-19T09:41:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.196+0000 7fe50e75f640 1 -- 172.21.15.1:0/1373823899 wait complete. 2024-09-19T09:41:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.198+0000 7fe50e75f640 1 Processor -- start 2024-09-19T09:41:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.198+0000 7fe50e75f640 1 -- start start 2024-09-19T09:41:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.198+0000 7fe50e75f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe508100a40 0x7fe508110f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.198+0000 7fe50e75f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe508101c30 0x7fe5081114c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.198+0000 7fe50e75f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5081025f0 0x7fe5081ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.198+0000 7fe50e75f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe50810b630 con 0x7fe508101c30 2024-09-19T09:41:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.198+0000 7fe50e75f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe50810b4b0 con 0x7fe5081025f0 2024-09-19T09:41:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.198+0000 7fe50e75f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe50810b7b0 con 0x7fe508100a40 2024-09-19T09:41:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.199+0000 7fe507fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe508100a40 0x7fe508110f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.199+0000 7fe507fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe508100a40 0x7fe508110f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:44418/0 (socket says 172.21.15.1:44418) 2024-09-19T09:41:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.199+0000 7fe507fff640 1 -- 172.21.15.1:0/616496525 learned_addr learned my addr 172.21.15.1:0/616496525 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:41:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.199+0000 7fe50ccfc640 1 --2- 172.21.15.1:0/616496525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5081025f0 0x7fe5081ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.200+0000 7fe507fff640 1 -- 172.21.15.1:0/616496525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5081025f0 msgr2=0x7fe5081ae6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.200+0000 7fe507fff640 1 --2- 172.21.15.1:0/616496525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5081025f0 0x7fe5081ae6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.200+0000 7fe507fff640 1 -- 172.21.15.1:0/616496525 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe508101c30 msgr2=0x7fe5081114c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:41:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.200+0000 7fe507fff640 1 --2- 172.21.15.1:0/616496525 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe508101c30 0x7fe5081114c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.200+0000 7fe507fff640 1 -- 172.21.15.1:0/616496525 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe508118660 con 0x7fe508100a40 2024-09-19T09:41:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.200+0000 7fe507fff640 1 --2- 172.21.15.1:0/616496525 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe508100a40 0x7fe508110f80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc00b450 tx=0x7fe4fc00b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:40.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.216+0000 7fe5057fa640 1 -- 172.21.15.1:0/616496525 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc015020 con 0x7fe508100a40 2024-09-19T09:41:40.218 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.217+0000 7fe50e75f640 1 -- 172.21.15.1:0/616496525 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe50806bc10 con 0x7fe508100a40 2024-09-19T09:41:40.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.217+0000 7fe50e75f640 1 -- 172.21.15.1:0/616496525 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe50806c160 con 0x7fe508100a40 2024-09-19T09:41:40.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.217+0000 7fe5057fa640 1 -- 172.21.15.1:0/616496525 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4fc011d70 con 0x7fe508100a40 2024-09-19T09:41:40.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.217+0000 7fe5057fa640 1 -- 172.21.15.1:0/616496525 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc00f340 con 0x7fe508100a40 2024-09-19T09:41:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.226+0000 7fe5057fa640 1 -- 172.21.15.1:0/616496525 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fe4fc018020 con 0x7fe508100a40 2024-09-19T09:41:40.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.227+0000 7fe5057fa640 1 --2- 172.21.15.1:0/616496525 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe4f00a3450 0x7fe4f00a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:40.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.227+0000 7fe5057fa640 1 -- 172.21.15.1:0/616496525 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fe4fc0cf2d0 con 0x7fe508100a40 2024-09-19T09:41:40.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.229+0000 7fe5077fe640 1 --2- 172.21.15.1:0/616496525 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe4f00a3450 0x7fe4f00a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:40.323 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.322+0000 7fe5077fe640 1 --2- 172.21.15.1:0/616496525 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe4f00a3450 0x7fe4f00a5910 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe508112490 tx=0x7fe4f8005b80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:40.324 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.322+0000 7fe5115d6740 1 Processor -- start 2024-09-19T09:41:40.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.323+0000 7fe5115d6740 1 -- start start 2024-09-19T09:41:40.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.323+0000 7fe5115d6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd198759a0 0x55cd19875da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:40.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.323+0000 7fe5115d6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd198762e0 0x55cd1987ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:40.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.323+0000 7fe5115d6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd1987b370 0x55cd1987d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:40.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.323+0000 7fe5115d6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55cd197d92f0 con 0x55cd198762e0 2024-09-19T09:41:40.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.323+0000 7fe5115d6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55cd19781270 con 0x55cd1987b370 2024-09-19T09:41:40.325 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.323+0000 7fe5115d6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55cd197d52b0 con 0x55cd198759a0 2024-09-19T09:41:40.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.323+0000 7fe50ccfc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd1987b370 0x55cd1987d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:40.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.325+0000 7fe50ccfc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd1987b370 0x55cd1987d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:44618/0 (socket says 172.21.15.1:44618) 2024-09-19T09:41:40.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.325+0000 7fe50ccfc640 1 -- 172.21.15.1:0/2384363750 learned_addr learned my addr 172.21.15.1:0/2384363750 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:41:40.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.325+0000 7fe507fff640 1 --2- 172.21.15.1:0/2384363750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd198759a0 0x55cd19875da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:40.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.325+0000 7fe50ccfc640 1 -- 172.21.15.1:0/2384363750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd198759a0 msgr2=0x55cd19875da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:40.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.325+0000 7fe50ccfc640 1 --2- 172.21.15.1:0/2384363750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd198759a0 0x55cd19875da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:40.328 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.325+0000 7fe50ccfc640 1 -- 172.21.15.1:0/2384363750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd198762e0 msgr2=0x55cd1987ada0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:41:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.325+0000 7fe50ccfc640 1 --2- 172.21.15.1:0/2384363750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd198762e0 0x55cd1987ada0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.325+0000 7fe50ccfc640 1 -- 172.21.15.1:0/2384363750 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd19780340 con 0x55cd1987b370 2024-09-19T09:41:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.327+0000 7fe50ccfc640 1 --2- 172.21.15.1:0/2384363750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd1987b370 0x55cd1987d830 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe500035000 tx=0x7fe500009940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=123d01b07d8022e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:40.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.330+0000 7fe4ee7fc640 1 -- 172.21.15.1:0/2384363750 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe500031790 con 0x55cd1987b370 2024-09-19T09:41:40.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.330+0000 7fe4ee7fc640 1 -- 172.21.15.1:0/2384363750 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe500036040 con 0x55cd1987b370 2024-09-19T09:41:40.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.330+0000 7fe4ee7fc640 1 -- 172.21.15.1:0/2384363750 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50002f610 con 0x55cd1987b370 2024-09-19T09:41:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.332+0000 7fe5115d6740 1 -- 172.21.15.1:0/2384363750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd1987b370 msgr2=0x55cd1987d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.332+0000 7fe5115d6740 1 --2- 172.21.15.1:0/2384363750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd1987b370 0x55cd1987d830 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe500035000 tx=0x7fe500009940 comp rx=0 tx=0).stop 2024-09-19T09:41:40.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.334+0000 7fe5115d6740 1 -- 172.21.15.1:0/2384363750 shutdown_connections 2024-09-19T09:41:40.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.334+0000 7fe5115d6740 1 --2- 172.21.15.1:0/2384363750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd1987b370 0x55cd1987d830 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:40.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.334+0000 7fe5115d6740 1 --2- 172.21.15.1:0/2384363750 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd198762e0 0x55cd1987ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:40.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.334+0000 7fe5115d6740 1 --2- 172.21.15.1:0/2384363750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd198759a0 0x55cd19875da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:40.337 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.334+0000 7fe5115d6740 1 -- 172.21.15.1:0/2384363750 >> 172.21.15.1:0/2384363750 conn(0x55cd19871010 msgr2=0x55cd19871410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:40.342 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.340+0000 7fe5115d6740 1 -- 172.21.15.1:0/2384363750 shutdown_connections 2024-09-19T09:41:40.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.343+0000 7fe5115d6740 1 -- 172.21.15.1:0/2384363750 wait complete. 2024-09-19T09:41:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.344+0000 7fe5115d6740 1 -- start start 2024-09-19T09:41:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.344+0000 7fe5115d6740 1 Processor -- start 2024-09-19T09:41:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.344+0000 7fe5115d6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd198759a0 0x55cd1987fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.344+0000 7fe5115d6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd198762e0 0x55cd19880130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.344+0000 7fe5115d6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd1987b370 0x55cd19887170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.344+0000 7fe5115d6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55cd1987e2e0 con 0x55cd198762e0 2024-09-19T09:41:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.344+0000 7fe5115d6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55cd19762290 con 0x55cd1987b370 2024-09-19T09:41:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.344+0000 7fe5115d6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55cd1987e460 con 0x55cd198759a0 2024-09-19T09:41:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.344+0000 7fe5115d6740 10 client.0 _ll_register_callbacks cb 0x55cd19793140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.346+0000 7fe5077fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd198762e0 0x55cd19880130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.346+0000 7fe5077fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd198762e0 0x55cd19880130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38970/0 (socket says 172.21.15.1:38970) 2024-09-19T09:41:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.346+0000 7fe5077fe640 1 -- 172.21.15.1:0/1694670481 learned_addr learned my addr 172.21.15.1:0/1694670481 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:41:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.346+0000 7fe50ccfc640 1 --2- 172.21.15.1:0/1694670481 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd1987b370 0x55cd19887170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:40.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.347+0000 7fe50ccfc640 1 -- 172.21.15.1:0/1694670481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd198759a0 msgr2=0x55cd1987fbf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:41:40.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.347+0000 7fe50ccfc640 1 --2- 172.21.15.1:0/1694670481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd198759a0 0x55cd1987fbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:40.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.347+0000 7fe50ccfc640 1 -- 172.21.15.1:0/1694670481 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd198762e0 msgr2=0x55cd19880130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:40.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.347+0000 7fe50ccfc640 1 --2- 172.21.15.1:0/1694670481 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd198762e0 0x55cd19880130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:40.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.347+0000 7fe50ccfc640 1 -- 172.21.15.1:0/1694670481 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd194ec210 con 0x55cd1987b370 2024-09-19T09:41:40.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.347+0000 7fe50ccfc640 1 --2- 172.21.15.1:0/1694670481 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd1987b370 0x55cd19887170 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe500009ca0 tx=0x7fe50002f470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c34d864c20250eca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:40.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.347+0000 7fe4e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:41:40.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.348+0000 7fe4e77fe640 1 -- 172.21.15.1:0/1694670481 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50004a040 con 0x55cd1987b370 2024-09-19T09:41:40.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.348+0000 7fe5115d6740 1 -- 172.21.15.1:0/1694670481 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe500036040 con 0x55cd1987b370 2024-09-19T09:41:40.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.348+0000 7fe4e77fe640 1 -- 172.21.15.1:0/1694670481 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fe500031590 con 0x55cd1987b370 2024-09-19T09:41:40.351 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.350+0000 7fe4e77fe640 1 -- 172.21.15.1:0/1694670481 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe500031790 con 0x55cd1987b370 2024-09-19T09:41:40.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.352+0000 7fe5115d6740 10 client.25544 fetch_fsmap learned FSMap version 19 2024-09-19T09:41:40.353 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.352+0000 7fe5115d6740 1 -- 172.21.15.1:0/1694670481 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55cd195b8620 con 0x55cd1987b370 2024-09-19T09:41:40.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.353+0000 7fe4e77fe640 1 -- 172.21.15.1:0/1694670481 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe500036040 con 0x55cd1987b370 2024-09-19T09:41:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.353+0000 7fe4e77fe640 1 -- 172.21.15.1:0/1694670481 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe50004d070 con 0x55cd1987b370 2024-09-19T09:41:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.353+0000 7fe5115d6740 10 client.25544 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:41:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.353+0000 7fe5115d6740 10 client.25544 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:41:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.353+0000 7fe5115d6740 20 client.25544 populate_metadata read hostname 'smithi001' 2024-09-19T09:41:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.353+0000 7fe5115d6740 1 --2- 172.21.15.1:0/1694670481 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55cd198ad810 0x55cd198afc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.353+0000 7fe5115d6740 4 client.25544 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:41:40.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.353+0000 7fe5115d6740 1 -- 172.21.15.1:0/1694670481 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd197e6a20 con 0x55cd198ad810 2024-09-19T09:41:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.358+0000 7fe507fff640 1 --2- 172.21.15.1:0/1694670481 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55cd198ad810 0x55cd198afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:40.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:40 smithi022 ceph-mon[35583]: pgmap v445: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 116 MiB/s wr, 18.80k op/s 2024-09-19T09:41:40.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:40 smithi121 ceph-mon[35577]: pgmap v445: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 116 MiB/s wr, 18.80k op/s 2024-09-19T09:41:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.366+0000 7fe507fff640 1 --2- 172.21.15.1:0/1694670481 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55cd198ad810 0x55cd198afc70 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15ddd724d73877c7 server_cookie=457876e0b9a88c40 in_seq=0 out_seq=0 2024-09-19T09:41:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.367+0000 7fe4e77fe640 10 client.25544 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:41:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.369+0000 7fe4e77fe640 1 -- 172.21.15.1:0/1694670481 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cd197e6a20 con 0x55cd198ad810 2024-09-19T09:41:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.369+0000 7fe4e77fe640 10 client.25544 handle_command_reply: tid=0 2024-09-19T09:41:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.370+0000 7fe5115d6740 1 client.25544 shutdown 2024-09-19T09:41:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.374+0000 7fe5115d6740 1 -- 172.21.15.1:0/1694670481 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd1987b370 msgr2=0x55cd19887170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.374+0000 7fe5115d6740 1 --2- 172.21.15.1:0/1694670481 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd1987b370 0x55cd19887170 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe500009ca0 tx=0x7fe50002f470 comp rx=0 tx=0).stop 2024-09-19T09:41:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.376+0000 7fe5115d6740 1 -- 172.21.15.1:0/1694670481 shutdown_connections 2024-09-19T09:41:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.376+0000 7fe5115d6740 1 --2- 172.21.15.1:0/1694670481 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55cd198ad810 0x55cd198afc70 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.376+0000 7fe5115d6740 1 --2- 172.21.15.1:0/1694670481 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd1987b370 0x55cd19887170 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.376+0000 7fe5115d6740 1 --2- 172.21.15.1:0/1694670481 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd198762e0 0x55cd19880130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.376+0000 7fe5115d6740 1 --2- 172.21.15.1:0/1694670481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd198759a0 0x55cd1987fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.376+0000 7fe5115d6740 1 -- 172.21.15.1:0/1694670481 >> 172.21.15.1:0/1694670481 conn(0x55cd19871010 msgr2=0x55cd19872820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.377+0000 7fe4e77fe640 0 client.25544 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:41:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.379+0000 7fe5115d6740 1 -- 172.21.15.1:0/1694670481 shutdown_connections 2024-09-19T09:41:40.381 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.380+0000 7fe5115d6740 1 -- 172.21.15.1:0/1694670481 wait complete. 2024-09-19T09:41:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.384+0000 7fe5115d6740 20 client.25544 trim_cache size 0 max 16384 2024-09-19T09:41:40.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.415+0000 7fe5115d6740 1 Processor -- start 2024-09-19T09:41:40.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.416+0000 7fe5115d6740 1 -- start start 2024-09-19T09:41:40.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.416+0000 7fe5115d6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd198759a0 0x55cd1987fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:40.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.416+0000 7fe5115d6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd198762e0 0x55cd19887130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:40.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.416+0000 7fe5115d6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd1987b370 0x55cd19880130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:40.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.416+0000 7fe5115d6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f400c480 con 0x55cd198759a0 2024-09-19T09:41:40.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.416+0000 7fe5115d6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f400ed20 con 0x55cd1987b370 2024-09-19T09:41:40.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.416+0000 7fe5115d6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f400cb10 con 0x55cd198762e0 2024-09-19T09:41:40.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.417+0000 7fe507fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd198759a0 0x55cd1987fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:40.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.417+0000 7fe507fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd198759a0 0x55cd1987fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38980/0 (socket says 172.21.15.1:38980) 2024-09-19T09:41:40.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.417+0000 7fe507fff640 1 -- 172.21.15.1:0/3266708501 learned_addr learned my addr 172.21.15.1:0/3266708501 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:41:40.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.418+0000 7fe5077fe640 1 --2- 172.21.15.1:0/3266708501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd198762e0 0x55cd19887130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:40.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.418+0000 7fe50ccfc640 1 --2- 172.21.15.1:0/3266708501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd1987b370 0x55cd19880130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:40.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.418+0000 7fe507fff640 1 -- 172.21.15.1:0/3266708501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd198762e0 msgr2=0x55cd19887130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:40.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.418+0000 7fe507fff640 1 --2- 172.21.15.1:0/3266708501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd198762e0 0x55cd19887130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:40.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.418+0000 7fe507fff640 1 -- 172.21.15.1:0/3266708501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd1987b370 msgr2=0x55cd19880130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:40.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.418+0000 7fe507fff640 1 --2- 172.21.15.1:0/3266708501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd1987b370 0x55cd19880130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:40.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.418+0000 7fe507fff640 1 -- 172.21.15.1:0/3266708501 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd19888610 con 0x55cd198759a0 2024-09-19T09:41:40.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.419+0000 7fe507fff640 1 --2- 172.21.15.1:0/3266708501 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd198759a0 0x55cd1987fbf0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc00be10 tx=0x7fe4fc01c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a830b71d0bcb7f18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:40.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.419+0000 7fe4edffb640 1 -- 172.21.15.1:0/3266708501 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc0b9070 con 0x55cd198759a0 2024-09-19T09:41:40.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.419+0000 7fe4edffb640 1 -- 172.21.15.1:0/3266708501 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4fc0ccea0 con 0x55cd198759a0 2024-09-19T09:41:40.422 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.420+0000 7fe4edffb640 1 -- 172.21.15.1:0/3266708501 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc09ad00 con 0x55cd198759a0 2024-09-19T09:41:40.422 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.420+0000 7fe5115d6740 1 -- 172.21.15.1:0/3266708501 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd198759a0 msgr2=0x55cd1987fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:40.422 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.420+0000 7fe5115d6740 1 --2- 172.21.15.1:0/3266708501 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd198759a0 0x55cd1987fbf0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc00be10 tx=0x7fe4fc01c040 comp rx=0 tx=0).stop 2024-09-19T09:41:40.422 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.420+0000 7fe5115d6740 1 -- 172.21.15.1:0/3266708501 shutdown_connections 2024-09-19T09:41:40.422 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.420+0000 7fe5115d6740 1 --2- 172.21.15.1:0/3266708501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd1987b370 0x55cd19880130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:40.422 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.420+0000 7fe5115d6740 1 --2- 172.21.15.1:0/3266708501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd198762e0 0x55cd19887130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:40.422 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.420+0000 7fe5115d6740 1 --2- 172.21.15.1:0/3266708501 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd198759a0 0x55cd1987fbf0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:40.422 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.420+0000 7fe5115d6740 1 -- 172.21.15.1:0/3266708501 >> 172.21.15.1:0/3266708501 conn(0x55cd19871010 msgr2=0x55cd198774c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.423+0000 7fe5115d6740 1 -- 172.21.15.1:0/3266708501 shutdown_connections 2024-09-19T09:41:40.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.424+0000 7fe5115d6740 1 -- 172.21.15.1:0/3266708501 wait complete. 2024-09-19T09:41:40.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.424+0000 7fe5115d6740 1 -- start start 2024-09-19T09:41:40.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.424+0000 7fe5115d6740 1 Processor -- start 2024-09-19T09:41:40.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.425+0000 7fe5115d6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd198759a0 0x55cd198843d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:40.426 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.425+0000 7fe5115d6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd198762e0 0x55cd19884910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:40.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.425+0000 7fe5115d6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd1987b370 0x55cd19885920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:40.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.425+0000 7fe5115d6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f400d1e0 con 0x55cd1987b370 2024-09-19T09:41:40.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.425+0000 7fe5115d6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f400e650 con 0x55cd198759a0 2024-09-19T09:41:40.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.425+0000 7fe5115d6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f400d8b0 con 0x55cd198762e0 2024-09-19T09:41:40.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.425+0000 7fe5115d6740 10 client.0 _ll_register_callbacks cb 0x7fe500009890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:40.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.425+0000 7fe507fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd198759a0 0x55cd198843d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:40.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.425+0000 7fe507fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd198759a0 0x55cd198843d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:44640/0 (socket says 172.21.15.1:44640) 2024-09-19T09:41:40.427 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.425+0000 7fe507fff640 1 -- 172.21.15.1:0/2322029390 learned_addr learned my addr 172.21.15.1:0/2322029390 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:41:40.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.426+0000 7fe50ccfc640 1 --2- 172.21.15.1:0/2322029390 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd1987b370 0x55cd19885920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:40.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.426+0000 7fe507fff640 1 -- 172.21.15.1:0/2322029390 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd198762e0 msgr2=0x55cd19884910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:41:40.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.426+0000 7fe507fff640 1 --2- 172.21.15.1:0/2322029390 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd198762e0 0x55cd19884910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:40.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.426+0000 7fe507fff640 1 -- 172.21.15.1:0/2322029390 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd1987b370 msgr2=0x55cd19885920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:40.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.426+0000 7fe507fff640 1 --2- 172.21.15.1:0/2322029390 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd1987b370 0x55cd19885920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:40.428 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.426+0000 7fe507fff640 1 -- 172.21.15.1:0/2322029390 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd19885f30 con 0x55cd198759a0 2024-09-19T09:41:40.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.428+0000 7fe507fff640 1 --2- 172.21.15.1:0/2322029390 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd198759a0 0x55cd198843d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc004810 tx=0x7fe4fc0ccda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed9ad5926a0f79b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:40.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.428+0000 7fe4e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:41:40.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.431+0000 7fe4e77fe640 1 -- 172.21.15.1:0/2322029390 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc0a9060 con 0x55cd198759a0 2024-09-19T09:41:40.433 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.431+0000 7fe4e77fe640 1 -- 172.21.15.1:0/2322029390 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fe4fc0ba270 con 0x55cd198759a0 2024-09-19T09:41:40.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.432+0000 7fe5115d6740 1 -- 172.21.15.1:0/2322029390 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4fc0ccea0 con 0x55cd198759a0 2024-09-19T09:41:40.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.434+0000 7fe4e77fe640 1 -- 172.21.15.1:0/2322029390 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe4fc0b9070 con 0x55cd198759a0 2024-09-19T09:41:40.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.439+0000 7fe5115d6740 10 client.25547 fetch_fsmap learned FSMap version 19 2024-09-19T09:41:40.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.439+0000 7fe5115d6740 1 -- 172.21.15.1:0/2322029390 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55cd198872b0 con 0x55cd198759a0 2024-09-19T09:41:40.441 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.440+0000 7fe4e77fe640 1 -- 172.21.15.1:0/2322029390 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4fc0ccea0 con 0x55cd198759a0 2024-09-19T09:41:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.441+0000 7fe4e77fe640 1 -- 172.21.15.1:0/2322029390 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe4fc097700 con 0x55cd198759a0 2024-09-19T09:41:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.441+0000 7fe5115d6740 10 client.25547 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:41:40.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.441+0000 7fe5115d6740 10 client.25547 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:41:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.441+0000 7fe5115d6740 20 client.25547 populate_metadata read hostname 'smithi001' 2024-09-19T09:41:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.441+0000 7fe5115d6740 1 --2- 172.21.15.1:0/2322029390 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55cd19918990 0x55cd1991adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.441+0000 7fe5115d6740 4 client.25547 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:41:40.443 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.441+0000 7fe5115d6740 1 -- 172.21.15.1:0/2322029390 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cd197e0d70 con 0x55cd19918990 2024-09-19T09:41:40.446 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.443+0000 7fe5077fe640 1 --2- 172.21.15.1:0/2322029390 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55cd19918990 0x55cd1991adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.447+0000 7fe5077fe640 1 --2- 172.21.15.1:0/2322029390 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55cd19918990 0x55cd1991adb0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9114f648aa18aad1 server_cookie=33647d30c71cfb2e in_seq=0 out_seq=0 2024-09-19T09:41:40.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:40.447+0000 7fe4e77fe640 10 client.25547 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:41:40.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:40 smithi001 ceph-mon[31225]: pgmap v445: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 116 MiB/s wr, 18.80k op/s 2024-09-19T09:41:41.382 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:41:41.433 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0' 2024-09-19T09:41:41.433 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0 2024-09-19T09:41:42.272 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:42.270+0000 7fe4e77fe640 1 -- 172.21.15.1:0/2322029390 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cd197e0d70 con 0x55cd19918990 2024-09-19T09:41:42.272 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:42.270+0000 7fe4e77fe640 10 client.25547 handle_command_reply: tid=0 2024-09-19T09:41:42.272 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:42.270+0000 7fe5115d6740 1 client.25547 shutdown 2024-09-19T09:41:42.272 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:42.270+0000 7fe5115d6740 1 -- 172.21.15.1:0/2322029390 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd198759a0 msgr2=0x55cd198843d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:42.272 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:42.270+0000 7fe5115d6740 1 --2- 172.21.15.1:0/2322029390 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd198759a0 0x55cd198843d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc004810 tx=0x7fe4fc0ccda0 comp rx=0 tx=0).stop 2024-09-19T09:41:42.272 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:42.270+0000 7fe5115d6740 1 -- 172.21.15.1:0/2322029390 shutdown_connections 2024-09-19T09:41:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:42.270+0000 7fe5115d6740 1 --2- 172.21.15.1:0/2322029390 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55cd19918990 0x55cd1991adb0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:42.270+0000 7fe5115d6740 1 --2- 172.21.15.1:0/2322029390 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55cd1987b370 0x55cd19885920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:42.270+0000 7fe5115d6740 1 --2- 172.21.15.1:0/2322029390 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd198762e0 0x55cd19884910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:42.270+0000 7fe5115d6740 1 --2- 172.21.15.1:0/2322029390 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd198759a0 0x55cd198843d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:42.270+0000 7fe5115d6740 1 -- 172.21.15.1:0/2322029390 >> 172.21.15.1:0/2322029390 conn(0x55cd19871010 msgr2=0x55cd1987a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:42.270+0000 7fe4e77fe640 0 client.25547 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:41:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:42.270+0000 7fe5115d6740 1 -- 172.21.15.1:0/2322029390 shutdown_connections 2024-09-19T09:41:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:42.271+0000 7fe5115d6740 1 -- 172.21.15.1:0/2322029390 wait complete. 2024-09-19T09:41:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:42.271+0000 7fe5115d6740 20 client.25547 trim_cache size 0 max 16384 2024-09-19T09:41:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:41:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:41:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:41:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:41:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:42.272+0000 7fe50e75f640 1 -- 172.21.15.1:0/616496525 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe4f00a3450 msgr2=0x7fe4f00a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:42.272+0000 7fe50e75f640 1 --2- 172.21.15.1:0/616496525 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe4f00a3450 0x7fe4f00a5910 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe508112490 tx=0x7fe4f8005b80 comp rx=0 tx=0).stop 2024-09-19T09:41:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:42.272+0000 7fe50e75f640 1 -- 172.21.15.1:0/616496525 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe508100a40 msgr2=0x7fe508110f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:42.272+0000 7fe50e75f640 1 --2- 172.21.15.1:0/616496525 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe508100a40 0x7fe508110f80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc00b450 tx=0x7fe4fc00b910 comp rx=0 tx=0).stop 2024-09-19T09:41:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:42.272+0000 7fe50e75f640 1 -- 172.21.15.1:0/616496525 shutdown_connections 2024-09-19T09:41:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:42.272+0000 7fe50e75f640 1 --2- 172.21.15.1:0/616496525 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe4f00a3450 0x7fe4f00a5910 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:42.272+0000 7fe50e75f640 1 --2- 172.21.15.1:0/616496525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5081025f0 0x7fe5081ae6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:42.272+0000 7fe50e75f640 1 --2- 172.21.15.1:0/616496525 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe508101c30 0x7fe5081114c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:42.272+0000 7fe50e75f640 1 --2- 172.21.15.1:0/616496525 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe508100a40 0x7fe508110f80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:42.272+0000 7fe50e75f640 1 -- 172.21.15.1:0/616496525 >> 172.21.15.1:0/616496525 conn(0x7fe5080fc1c0 msgr2=0x7fe508104e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:42.272+0000 7fe50e75f640 1 -- 172.21.15.1:0/616496525 shutdown_connections 2024-09-19T09:41:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:42.272+0000 7fe50e75f640 1 -- 172.21.15.1:0/616496525 wait complete. 2024-09-19T09:41:42.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:42 smithi022 ceph-mon[35583]: pgmap v446: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 115 MiB/s wr, 19.05k op/s 2024-09-19T09:41:42.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:42 smithi121 ceph-mon[35577]: pgmap v446: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 115 MiB/s wr, 19.05k op/s 2024-09-19T09:41:42.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:42 smithi001 ceph-mon[31225]: pgmap v446: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 115 MiB/s wr, 19.05k op/s 2024-09-19T09:41:44.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:44 smithi022 ceph-mon[35583]: pgmap v447: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 109 MiB/s wr, 18.25k op/s 2024-09-19T09:41:44.366 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:44 smithi121 ceph-mon[35577]: pgmap v447: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 109 MiB/s wr, 18.25k op/s 2024-09-19T09:41:44.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:44 smithi001 ceph-mon[31225]: pgmap v447: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 109 MiB/s wr, 18.25k op/s 2024-09-19T09:41:46.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:46 smithi022 ceph-mon[35583]: pgmap v448: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 110 MiB/s wr, 18.74k op/s 2024-09-19T09:41:46.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:46 smithi121 ceph-mon[35577]: pgmap v448: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 110 MiB/s wr, 18.74k op/s 2024-09-19T09:41:46.393 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:46 smithi001 ceph-mon[31225]: pgmap v448: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 110 MiB/s wr, 18.74k op/s 2024-09-19T09:41:48.356 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:41:48.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:48 smithi121 ceph-mon[35577]: pgmap v449: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 114 MiB/s wr, 20.01k op/s 2024-09-19T09:41:48.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:48 smithi001 ceph-mon[31225]: pgmap v449: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 114 MiB/s wr, 20.01k op/s 2024-09-19T09:41:48.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:48 smithi022 ceph-mon[35583]: pgmap v449: 97 pgs: 97 active+clean; 13 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 114 MiB/s wr, 20.01k op/s 2024-09-19T09:41:49.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.840+0000 7f1913fff640 1 -- 172.21.15.1:0/4165846351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1914109e00 msgr2=0x7f191410e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:49.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.840+0000 7f1913fff640 1 --2- 172.21.15.1:0/4165846351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1914109e00 0x7f191410e2b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1904009890 tx=0x7f190402a360 comp rx=0 tx=0).stop 2024-09-19T09:41:49.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.841+0000 7f1913fff640 1 -- 172.21.15.1:0/4165846351 shutdown_connections 2024-09-19T09:41:49.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.841+0000 7f1913fff640 1 --2- 172.21.15.1:0/4165846351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f191410ea10 0x7f1914115360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:49.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.841+0000 7f1913fff640 1 --2- 172.21.15.1:0/4165846351 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1914109e00 0x7f191410e2b0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:49.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.841+0000 7f1913fff640 1 --2- 172.21.15.1:0/4165846351 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1914109450 0x7f1914109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:49.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.841+0000 7f1913fff640 1 -- 172.21.15.1:0/4165846351 >> 172.21.15.1:0/4165846351 conn(0x7f1914073660 msgr2=0x7f1914073a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:49.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.842+0000 7f1913fff640 1 -- 172.21.15.1:0/4165846351 shutdown_connections 2024-09-19T09:41:49.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.842+0000 7f1913fff640 1 -- 172.21.15.1:0/4165846351 wait complete. 2024-09-19T09:41:49.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.843+0000 7f1913fff640 1 Processor -- start 2024-09-19T09:41:49.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.843+0000 7f1913fff640 1 -- start start 2024-09-19T09:41:49.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.843+0000 7f1913fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1914109450 0x7f191419e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:49.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.843+0000 7f1913fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1914109e00 0x7f191419e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:49.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.843+0000 7f1913fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f191410ea10 0x7f191419ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:49.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.843+0000 7f1913fff640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f19141183b0 con 0x7f191410ea10 2024-09-19T09:41:49.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.843+0000 7f1913fff640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1914118230 con 0x7f1914109450 2024-09-19T09:41:49.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.843+0000 7f1913fff640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1914118530 con 0x7f1914109e00 2024-09-19T09:41:49.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.844+0000 7f19137fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f191410ea10 0x7f191419ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:49.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.844+0000 7f19137fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f191410ea10 0x7f191419ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38086/0 (socket says 172.21.15.1:38086) 2024-09-19T09:41:49.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.844+0000 7f19137fe640 1 -- 172.21.15.1:0/467111848 learned_addr learned my addr 172.21.15.1:0/467111848 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:41:49.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.845+0000 7f19127fc640 1 --2- 172.21.15.1:0/467111848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1914109e00 0x7f191419e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:49.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.845+0000 7f1912ffd640 1 --2- 172.21.15.1:0/467111848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1914109450 0x7f191419e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:49.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.845+0000 7f19137fe640 1 -- 172.21.15.1:0/467111848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1914109e00 msgr2=0x7f191419e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:49.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.845+0000 7f19137fe640 1 --2- 172.21.15.1:0/467111848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1914109e00 0x7f191419e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:49.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.845+0000 7f19137fe640 1 -- 172.21.15.1:0/467111848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1914109450 msgr2=0x7f191419e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:49.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.845+0000 7f19137fe640 1 --2- 172.21.15.1:0/467111848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1914109450 0x7f191419e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:49.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.845+0000 7f19137fe640 1 -- 172.21.15.1:0/467111848 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19141a6c50 con 0x7f191410ea10 2024-09-19T09:41:49.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.847+0000 7f19137fe640 1 --2- 172.21.15.1:0/467111848 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f191410ea10 0x7f191419ede0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1908009580 tx=0x7f1908009a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:49.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.847+0000 7f18fbfff640 1 -- 172.21.15.1:0/467111848 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1908018030 con 0x7f191410ea10 2024-09-19T09:41:49.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.848+0000 7f18fbfff640 1 -- 172.21.15.1:0/467111848 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1908005500 con 0x7f191410ea10 2024-09-19T09:41:49.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.848+0000 7f1913fff640 1 -- 172.21.15.1:0/467111848 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19141a6f40 con 0x7f191410ea10 2024-09-19T09:41:49.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.848+0000 7f1913fff640 1 -- 172.21.15.1:0/467111848 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19141a7480 con 0x7f191410ea10 2024-09-19T09:41:49.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.848+0000 7f18fbfff640 1 -- 172.21.15.1:0/467111848 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1908014990 con 0x7f191410ea10 2024-09-19T09:41:49.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.852+0000 7f18fbfff640 1 -- 172.21.15.1:0/467111848 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f190801b070 con 0x7f191410ea10 2024-09-19T09:41:49.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.853+0000 7f18fbfff640 1 --2- 172.21.15.1:0/467111848 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f18fc0a3450 0x7f18fc0a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:49.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.854+0000 7f18fbfff640 1 -- 172.21.15.1:0/467111848 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f19080cf0a0 con 0x7f191410ea10 2024-09-19T09:41:49.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.855+0000 7f1912ffd640 1 --2- 172.21.15.1:0/467111848 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f18fc0a3450 0x7f18fc0a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:49.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.855+0000 7f1912ffd640 1 --2- 172.21.15.1:0/467111848 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f18fc0a3450 0x7f18fc0a5910 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f190c005fd0 tx=0x7f190c009870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:49.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.969+0000 7f191bbcc740 1 Processor -- start 2024-09-19T09:41:49.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.969+0000 7f191bbcc740 1 -- start start 2024-09-19T09:41:49.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.970+0000 7f191bbcc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556c89b98d20 0x556c89b97270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:49.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.970+0000 7f191bbcc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c89b977b0 0x556c89b97bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:49.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.970+0000 7f191bbcc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c89ba2550 0x556c89ba4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:49.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.970+0000 7f191bbcc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556c89afd2f0 con 0x556c89b977b0 2024-09-19T09:41:49.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.970+0000 7f191bbcc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556c89aa4cf0 con 0x556c89b98d20 2024-09-19T09:41:49.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.970+0000 7f191bbcc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x556c89af92b0 con 0x556c89ba2550 2024-09-19T09:41:49.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.970+0000 7f19127fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c89b977b0 0x556c89b97bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:49.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.970+0000 7f19137fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c89ba2550 0x556c89ba4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:49.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.970+0000 7f19137fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c89ba2550 0x556c89ba4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:51872/0 (socket says 172.21.15.1:51872) 2024-09-19T09:41:49.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.970+0000 7f19137fe640 1 -- 172.21.15.1:0/1304983345 learned_addr learned my addr 172.21.15.1:0/1304983345 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:41:49.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.970+0000 7f1912ffd640 1 --2- 172.21.15.1:0/1304983345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556c89b98d20 0x556c89b97270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:49.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.971+0000 7f19127fc640 1 -- 172.21.15.1:0/1304983345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c89ba2550 msgr2=0x556c89ba4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:49.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.971+0000 7f19127fc640 1 --2- 172.21.15.1:0/1304983345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c89ba2550 0x556c89ba4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:49.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.971+0000 7f19127fc640 1 -- 172.21.15.1:0/1304983345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556c89b98d20 msgr2=0x556c89b97270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:49.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.971+0000 7f19127fc640 1 --2- 172.21.15.1:0/1304983345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556c89b98d20 0x556c89b97270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:49.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.971+0000 7f19127fc640 1 -- 172.21.15.1:0/1304983345 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c89a893a0 con 0x556c89b977b0 2024-09-19T09:41:49.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.971+0000 7f19127fc640 1 --2- 172.21.15.1:0/1304983345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c89b977b0 0x556c89b97bf0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f19141a4c10 tx=0x7f1904030340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8229c268fe920a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:49.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.972+0000 7f18f97fa640 1 -- 172.21.15.1:0/1304983345 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1904037040 con 0x556c89b977b0 2024-09-19T09:41:49.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.972+0000 7f18f97fa640 1 -- 172.21.15.1:0/1304983345 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1904041070 con 0x556c89b977b0 2024-09-19T09:41:49.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.973+0000 7f191bbcc740 1 -- 172.21.15.1:0/1304983345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c89b977b0 msgr2=0x556c89b97bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:49.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.973+0000 7f191bbcc740 1 --2- 172.21.15.1:0/1304983345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c89b977b0 0x556c89b97bf0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f19141a4c10 tx=0x7f1904030340 comp rx=0 tx=0).stop 2024-09-19T09:41:49.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.974+0000 7f191bbcc740 1 -- 172.21.15.1:0/1304983345 shutdown_connections 2024-09-19T09:41:49.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.974+0000 7f191bbcc740 1 --2- 172.21.15.1:0/1304983345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c89ba2550 0x556c89ba4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:49.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.974+0000 7f191bbcc740 1 --2- 172.21.15.1:0/1304983345 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c89b977b0 0x556c89b97bf0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:49.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.974+0000 7f191bbcc740 1 --2- 172.21.15.1:0/1304983345 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556c89b98d20 0x556c89b97270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:49.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.974+0000 7f191bbcc740 1 -- 172.21.15.1:0/1304983345 >> 172.21.15.1:0/1304983345 conn(0x556c89b60310 msgr2=0x556c89b93e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:49.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.976+0000 7f191bbcc740 1 -- 172.21.15.1:0/1304983345 shutdown_connections 2024-09-19T09:41:49.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.976+0000 7f191bbcc740 1 -- 172.21.15.1:0/1304983345 wait complete. 2024-09-19T09:41:49.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.977+0000 7f191bbcc740 1 -- start start 2024-09-19T09:41:49.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.977+0000 7f191bbcc740 1 Processor -- start 2024-09-19T09:41:49.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.977+0000 7f191bbcc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556c89b977b0 0x556c89ba1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:49.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.977+0000 7f191bbcc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c89b98d20 0x556c89b9f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:49.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.977+0000 7f191bbcc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c89ba2550 0x556c89b9f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:49.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.977+0000 7f191bbcc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556c89ba5240 con 0x556c89ba2550 2024-09-19T09:41:49.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.977+0000 7f191bbcc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556c89ab8060 con 0x556c89b977b0 2024-09-19T09:41:49.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.977+0000 7f191bbcc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x556c89ba53c0 con 0x556c89b98d20 2024-09-19T09:41:49.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.977+0000 7f191bbcc740 10 client.0 _ll_register_callbacks cb 0x556c8980b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:49.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.979+0000 7f19127fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c89b98d20 0x556c89b9f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:49.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.979+0000 7f19127fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c89b98d20 0x556c89b9f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:51882/0 (socket says 172.21.15.1:51882) 2024-09-19T09:41:49.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.979+0000 7f19127fc640 1 -- 172.21.15.1:0/2891944419 learned_addr learned my addr 172.21.15.1:0/2891944419 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:41:49.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.980+0000 7f19137fe640 1 --2- 172.21.15.1:0/2891944419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c89ba2550 0x556c89b9f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:49.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.981+0000 7f19127fc640 1 -- 172.21.15.1:0/2891944419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556c89b977b0 msgr2=0x556c89ba1e00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:41:49.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.981+0000 7f19127fc640 1 --2- 172.21.15.1:0/2891944419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556c89b977b0 0x556c89ba1e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:49.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.981+0000 7f19127fc640 1 -- 172.21.15.1:0/2891944419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c89ba2550 msgr2=0x556c89b9f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:49.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.981+0000 7f19127fc640 1 --2- 172.21.15.1:0/2891944419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c89ba2550 0x556c89b9f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:49.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.981+0000 7f19127fc640 1 -- 172.21.15.1:0/2891944419 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c8986e3c0 con 0x556c89b98d20 2024-09-19T09:41:49.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.983+0000 7f19127fc640 1 --2- 172.21.15.1:0/2891944419 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c89b98d20 0x556c89b9f100 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1904000c00 tx=0x7f1904030c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e702d81d3b8671b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:49.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.983+0000 7f18f6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-19T09:41:49.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.985+0000 7f18f6ff5640 1 -- 172.21.15.1:0/2891944419 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1904037040 con 0x556c89b98d20 2024-09-19T09:41:49.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.985+0000 7f191bbcc740 1 -- 172.21.15.1:0/2891944419 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1904041070 con 0x556c89b98d20 2024-09-19T09:41:49.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.985+0000 7f18f6ff5640 1 -- 172.21.15.1:0/2891944419 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f1904030780 con 0x556c89b98d20 2024-09-19T09:41:49.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.986+0000 7f18f6ff5640 1 -- 172.21.15.1:0/2891944419 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1904004030 con 0x556c89b98d20 2024-09-19T09:41:49.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.986+0000 7f191bbcc740 10 client.25414 fetch_fsmap learned FSMap version 19 2024-09-19T09:41:49.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.986+0000 7f191bbcc740 1 -- 172.21.15.1:0/2891944419 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x556c89ba5240 con 0x556c89b98d20 2024-09-19T09:41:49.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.987+0000 7f18f6ff5640 1 -- 172.21.15.1:0/2891944419 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1904041070 con 0x556c89b98d20 2024-09-19T09:41:49.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.987+0000 7f18f6ff5640 1 -- 172.21.15.1:0/2891944419 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f19040035f0 con 0x556c89b98d20 2024-09-19T09:41:49.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.987+0000 7f191bbcc740 10 client.25414 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:41:49.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.987+0000 7f191bbcc740 10 client.25414 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:41:49.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.987+0000 7f191bbcc740 20 client.25414 populate_metadata read hostname 'smithi001' 2024-09-19T09:41:49.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.987+0000 7f191bbcc740 1 --2- 172.21.15.1:0/2891944419 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x556c89bb20e0 0x556c89bb4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:49.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.987+0000 7f191bbcc740 4 client.25414 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:41:49.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.987+0000 7f191bbcc740 1 -- 172.21.15.1:0/2891944419 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c89b0a860 con 0x556c89bb20e0 2024-09-19T09:41:49.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.987+0000 7f1912ffd640 1 --2- 172.21.15.1:0/2891944419 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x556c89bb20e0 0x556c89bb4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:49.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.989+0000 7f1912ffd640 1 --2- 172.21.15.1:0/2891944419 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x556c89bb20e0 0x556c89bb4520 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d3959604b519d9e server_cookie=4879aa0a352f95d4 in_seq=0 out_seq=0 2024-09-19T09:41:49.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.990+0000 7f18f6ff5640 10 client.25414 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:41:49.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.991+0000 7f18f6ff5640 1 -- 172.21.15.1:0/2891944419 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556c89b0a860 con 0x556c89bb20e0 2024-09-19T09:41:49.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.991+0000 7f18f6ff5640 10 client.25414 handle_command_reply: tid=0 2024-09-19T09:41:49.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.991+0000 7f191bbcc740 1 client.25414 shutdown 2024-09-19T09:41:49.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.991+0000 7f191bbcc740 1 -- 172.21.15.1:0/2891944419 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c89b98d20 msgr2=0x556c89b9f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:49.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.991+0000 7f191bbcc740 1 --2- 172.21.15.1:0/2891944419 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c89b98d20 0x556c89b9f100 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1904000c00 tx=0x7f1904030c80 comp rx=0 tx=0).stop 2024-09-19T09:41:49.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.992+0000 7f191bbcc740 1 -- 172.21.15.1:0/2891944419 shutdown_connections 2024-09-19T09:41:49.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.992+0000 7f191bbcc740 1 --2- 172.21.15.1:0/2891944419 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x556c89bb20e0 0x556c89bb4520 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:49.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.992+0000 7f191bbcc740 1 --2- 172.21.15.1:0/2891944419 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c89ba2550 0x556c89b9f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:49.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.992+0000 7f191bbcc740 1 --2- 172.21.15.1:0/2891944419 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c89b98d20 0x556c89b9f100 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1904000c00 tx=0x7f1904030c80 comp rx=0 tx=0).stop 2024-09-19T09:41:49.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.992+0000 7f191bbcc740 1 --2- 172.21.15.1:0/2891944419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556c89b977b0 0x556c89ba1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:49.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.992+0000 7f191bbcc740 1 -- 172.21.15.1:0/2891944419 >> 172.21.15.1:0/2891944419 conn(0x556c89b60310 msgr2=0x556c89b99b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:49.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.992+0000 7f18f6ff5640 0 client.25414 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:41:49.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.994+0000 7f191bbcc740 1 -- 172.21.15.1:0/2891944419 shutdown_connections 2024-09-19T09:41:49.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.995+0000 7f191bbcc740 1 -- 172.21.15.1:0/2891944419 wait complete. 2024-09-19T09:41:49.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:49.995+0000 7f191bbcc740 20 client.25414 trim_cache size 0 max 16384 2024-09-19T09:41:50.026 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.024+0000 7f191bbcc740 1 Processor -- start 2024-09-19T09:41:50.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.025+0000 7f191bbcc740 1 -- start start 2024-09-19T09:41:50.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.026+0000 7f191bbcc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556c89b977b0 0x556c89bae560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:50.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.026+0000 7f191bbcc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c89ba2550 0x556c89ba3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:50.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.026+0000 7f191bbcc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c89ba3e80 0x556c89b92780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:50.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.027+0000 7f191bbcc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f19141ac860 con 0x556c89ba3e80 2024-09-19T09:41:50.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.027+0000 7f191bbcc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f19141c5340 con 0x556c89b977b0 2024-09-19T09:41:50.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.027+0000 7f191bbcc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f19141acef0 con 0x556c89ba2550 2024-09-19T09:41:50.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.027+0000 7f1912ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556c89b977b0 0x556c89bae560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:50.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.027+0000 7f19137fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c89ba3e80 0x556c89b92780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:50.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.027+0000 7f19137fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c89ba3e80 0x556c89b92780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38118/0 (socket says 172.21.15.1:38118) 2024-09-19T09:41:50.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.027+0000 7f19137fe640 1 -- 172.21.15.1:0/4198311717 learned_addr learned my addr 172.21.15.1:0/4198311717 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:41:50.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.028+0000 7f19137fe640 1 -- 172.21.15.1:0/4198311717 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c89ba2550 msgr2=0x556c89ba3940 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:41:50.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.028+0000 7f19137fe640 1 --2- 172.21.15.1:0/4198311717 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c89ba2550 0x556c89ba3940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:50.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.028+0000 7f19137fe640 1 -- 172.21.15.1:0/4198311717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556c89b977b0 msgr2=0x556c89bae560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:50.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.028+0000 7f19137fe640 1 --2- 172.21.15.1:0/4198311717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556c89b977b0 0x556c89bae560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:50.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.028+0000 7f19137fe640 1 -- 172.21.15.1:0/4198311717 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c89b94b40 con 0x556c89ba3e80 2024-09-19T09:41:50.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.029+0000 7f19137fe640 1 --2- 172.21.15.1:0/4198311717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c89ba3e80 0x556c89b92780 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1908009f40 tx=0x7f19080a2040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12acb48cc650ac91 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:50.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.033+0000 7f18f8ff9640 1 -- 172.21.15.1:0/4198311717 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190809be10 con 0x556c89ba3e80 2024-09-19T09:41:50.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.034+0000 7f18f8ff9640 1 -- 172.21.15.1:0/4198311717 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f190809b710 con 0x556c89ba3e80 2024-09-19T09:41:50.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.034+0000 7f18f8ff9640 1 -- 172.21.15.1:0/4198311717 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1908097d80 con 0x556c89ba3e80 2024-09-19T09:41:50.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.035+0000 7f191bbcc740 1 -- 172.21.15.1:0/4198311717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c89ba3e80 msgr2=0x556c89b92780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:50.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.036+0000 7f191bbcc740 1 --2- 172.21.15.1:0/4198311717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c89ba3e80 0x556c89b92780 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1908009f40 tx=0x7f19080a2040 comp rx=0 tx=0).stop 2024-09-19T09:41:50.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.036+0000 7f191bbcc740 1 -- 172.21.15.1:0/4198311717 shutdown_connections 2024-09-19T09:41:50.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.036+0000 7f191bbcc740 1 --2- 172.21.15.1:0/4198311717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c89ba3e80 0x556c89b92780 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:50.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.036+0000 7f191bbcc740 1 --2- 172.21.15.1:0/4198311717 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c89ba2550 0x556c89ba3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:50.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.036+0000 7f191bbcc740 1 --2- 172.21.15.1:0/4198311717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556c89b977b0 0x556c89bae560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:50.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.036+0000 7f191bbcc740 1 -- 172.21.15.1:0/4198311717 >> 172.21.15.1:0/4198311717 conn(0x556c89b60310 msgr2=0x556c89b9a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:50.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.040+0000 7f191bbcc740 1 -- 172.21.15.1:0/4198311717 shutdown_connections 2024-09-19T09:41:50.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.040+0000 7f191bbcc740 1 -- 172.21.15.1:0/4198311717 wait complete. 2024-09-19T09:41:50.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.040+0000 7f191bbcc740 1 -- start start 2024-09-19T09:41:50.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.040+0000 7f191bbcc740 1 Processor -- start 2024-09-19T09:41:50.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.041+0000 7f191bbcc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556c89b977b0 0x556c89baab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:50.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.041+0000 7f191bbcc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c89ba2550 0x556c89b9c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:50.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.041+0000 7f191bbcc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c89ba3e80 0x556c89b9c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:50.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.041+0000 7f191bbcc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f19141c3800 con 0x556c89ba2550 2024-09-19T09:41:50.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.041+0000 7f191bbcc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f19141c4c70 con 0x556c89b977b0 2024-09-19T09:41:50.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.042+0000 7f191bbcc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f19141c3ed0 con 0x556c89ba3e80 2024-09-19T09:41:50.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.042+0000 7f191bbcc740 10 client.0 _ll_register_callbacks cb 0x7f190c016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:50.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.042+0000 7f19137fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c89ba3e80 0x556c89b9c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:50.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.042+0000 7f19137fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c89ba3e80 0x556c89b9c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:51906/0 (socket says 172.21.15.1:51906) 2024-09-19T09:41:50.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.042+0000 7f19137fe640 1 -- 172.21.15.1:0/3385608630 learned_addr learned my addr 172.21.15.1:0/3385608630 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:41:50.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.042+0000 7f1912ffd640 1 --2- 172.21.15.1:0/3385608630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556c89b977b0 0x556c89baab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:50.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.042+0000 7f19137fe640 1 -- 172.21.15.1:0/3385608630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556c89b977b0 msgr2=0x556c89baab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:50.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.042+0000 7f19137fe640 1 --2- 172.21.15.1:0/3385608630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556c89b977b0 0x556c89baab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:50.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.042+0000 7f19137fe640 1 -- 172.21.15.1:0/3385608630 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c89ba2550 msgr2=0x556c89b9c460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:41:50.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.042+0000 7f19137fe640 1 --2- 172.21.15.1:0/3385608630 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c89ba2550 0x556c89b9c460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:50.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.042+0000 7f19137fe640 1 -- 172.21.15.1:0/3385608630 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c89b9cee0 con 0x556c89ba3e80 2024-09-19T09:41:50.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.046+0000 7f19137fe640 1 --2- 172.21.15.1:0/3385608630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c89ba3e80 0x556c89b9c9a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f19080a2010 tx=0x7f1908004ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1f5119cd8de38b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:50.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.046+0000 7f18f6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-19T09:41:50.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.046+0000 7f18f6ff5640 1 -- 172.21.15.1:0/3385608630 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19080ba020 con 0x556c89ba3e80 2024-09-19T09:41:50.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.046+0000 7f191bbcc740 1 -- 172.21.15.1:0/3385608630 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f190809b710 con 0x556c89ba3e80 2024-09-19T09:41:50.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.046+0000 7f18f6ff5640 1 -- 172.21.15.1:0/3385608630 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f19080afba0 con 0x556c89ba3e80 2024-09-19T09:41:50.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.046+0000 7f18f6ff5640 1 -- 172.21.15.1:0/3385608630 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f19080afda0 con 0x556c89ba3e80 2024-09-19T09:41:50.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.047+0000 7f191bbcc740 10 client.25417 fetch_fsmap learned FSMap version 19 2024-09-19T09:41:50.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.047+0000 7f191bbcc740 1 -- 172.21.15.1:0/3385608630 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x556c89c1ce00 con 0x556c89ba3e80 2024-09-19T09:41:50.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.047+0000 7f18f6ff5640 1 -- 172.21.15.1:0/3385608630 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1908014b30 con 0x556c89ba3e80 2024-09-19T09:41:50.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.047+0000 7f18f6ff5640 1 -- 172.21.15.1:0/3385608630 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1908025060 con 0x556c89ba3e80 2024-09-19T09:41:50.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.047+0000 7f191bbcc740 10 client.25417 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:41:50.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.047+0000 7f191bbcc740 10 client.25417 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:41:50.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.047+0000 7f191bbcc740 20 client.25417 populate_metadata read hostname 'smithi001' 2024-09-19T09:41:50.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.047+0000 7f191bbcc740 1 --2- 172.21.15.1:0/3385608630 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x556c89c1d030 0x556c89c1f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:50.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.047+0000 7f191bbcc740 4 client.25417 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:41:50.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.047+0000 7f191bbcc740 1 -- 172.21.15.1:0/3385608630 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f190809b710 con 0x556c89c1d030 2024-09-19T09:41:50.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.048+0000 7f1912ffd640 1 --2- 172.21.15.1:0/3385608630 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x556c89c1d030 0x556c89c1f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:50.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.058+0000 7f1912ffd640 1 --2- 172.21.15.1:0/3385608630 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x556c89c1d030 0x556c89c1f450 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9853b62adea53a4 server_cookie=e93fb6e2070444b8 in_seq=0 out_seq=0 2024-09-19T09:41:50.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.058+0000 7f18f6ff5640 10 client.25417 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:41:50.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.062+0000 7f18f6ff5640 1 -- 172.21.15.1:0/3385608630 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f190809b710 con 0x556c89c1d030 2024-09-19T09:41:50.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.062+0000 7f18f6ff5640 10 client.25417 handle_command_reply: tid=0 2024-09-19T09:41:50.063 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.062+0000 7f191bbcc740 1 client.25417 shutdown 2024-09-19T09:41:50.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.062+0000 7f191bbcc740 1 -- 172.21.15.1:0/3385608630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c89ba3e80 msgr2=0x556c89b9c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:50.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.062+0000 7f191bbcc740 1 --2- 172.21.15.1:0/3385608630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c89ba3e80 0x556c89b9c9a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f19080a2010 tx=0x7f1908004ce0 comp rx=0 tx=0).stop 2024-09-19T09:41:50.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.062+0000 7f191bbcc740 1 -- 172.21.15.1:0/3385608630 shutdown_connections 2024-09-19T09:41:50.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.062+0000 7f191bbcc740 1 --2- 172.21.15.1:0/3385608630 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x556c89c1d030 0x556c89c1f450 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:50.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.063+0000 7f191bbcc740 1 --2- 172.21.15.1:0/3385608630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556c89ba3e80 0x556c89b9c9a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:50.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.063+0000 7f191bbcc740 1 --2- 172.21.15.1:0/3385608630 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556c89ba2550 0x556c89b9c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:50.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.063+0000 7f191bbcc740 1 --2- 172.21.15.1:0/3385608630 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556c89b977b0 0x556c89baab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:50.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.063+0000 7f191bbcc740 1 -- 172.21.15.1:0/3385608630 >> 172.21.15.1:0/3385608630 conn(0x556c89b60310 msgr2=0x556c89ba0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:50.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.063+0000 7f18f6ff5640 0 client.25417 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:41:50.065 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.063+0000 7f191bbcc740 1 -- 172.21.15.1:0/3385608630 shutdown_connections 2024-09-19T09:41:50.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.063+0000 7f191bbcc740 1 -- 172.21.15.1:0/3385608630 wait complete. 2024-09-19T09:41:50.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.063+0000 7f191bbcc740 20 client.25417 trim_cache size 0 max 16384 2024-09-19T09:41:50.066 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-19T09:41:50.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.064+0000 7f1913fff640 1 -- 172.21.15.1:0/467111848 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f18fc0a3450 msgr2=0x7f18fc0a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:50.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.064+0000 7f1913fff640 1 --2- 172.21.15.1:0/467111848 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f18fc0a3450 0x7f18fc0a5910 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f190c005fd0 tx=0x7f190c009870 comp rx=0 tx=0).stop 2024-09-19T09:41:50.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.064+0000 7f1913fff640 1 -- 172.21.15.1:0/467111848 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f191410ea10 msgr2=0x7f191419ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:50.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.064+0000 7f1913fff640 1 --2- 172.21.15.1:0/467111848 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f191410ea10 0x7f191419ede0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1908009580 tx=0x7f1908009a40 comp rx=0 tx=0).stop 2024-09-19T09:41:50.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.065+0000 7f1913fff640 1 -- 172.21.15.1:0/467111848 shutdown_connections 2024-09-19T09:41:50.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.065+0000 7f1913fff640 1 --2- 172.21.15.1:0/467111848 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f191410ea10 0x7f191419ede0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:50.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.065+0000 7f1913fff640 1 --2- 172.21.15.1:0/467111848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1914109e00 0x7f191419e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:50.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.065+0000 7f1913fff640 1 --2- 172.21.15.1:0/467111848 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f18fc0a3450 0x7f18fc0a5910 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:50.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.065+0000 7f1913fff640 1 --2- 172.21.15.1:0/467111848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1914109450 0x7f191419e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:50.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.065+0000 7f1913fff640 1 -- 172.21.15.1:0/467111848 >> 172.21.15.1:0/467111848 conn(0x7f1914073660 msgr2=0x7f191410c500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:50.067 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.066+0000 7f1913fff640 1 -- 172.21.15.1:0/467111848 shutdown_connections 2024-09-19T09:41:50.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:41:50.066+0000 7f1913fff640 1 -- 172.21.15.1:0/467111848 wait complete. 2024-09-19T09:41:50.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:50 smithi001 ceph-mon[31225]: pgmap v450: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 100 MiB/s wr, 18.13k op/s 2024-09-19T09:41:50.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:50 smithi022 ceph-mon[35583]: pgmap v450: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 100 MiB/s wr, 18.13k op/s 2024-09-19T09:41:50.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:50 smithi121 ceph-mon[35577]: pgmap v450: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 100 MiB/s wr, 18.13k op/s 2024-09-19T09:41:52.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:52 smithi001 ceph-mon[31225]: pgmap v451: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 96 MiB/s wr, 17.67k op/s 2024-09-19T09:41:52.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:52 smithi022 ceph-mon[35583]: pgmap v451: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 96 MiB/s wr, 17.67k op/s 2024-09-19T09:41:52.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:52 smithi121 ceph-mon[35577]: pgmap v451: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 96 MiB/s wr, 17.67k op/s 2024-09-19T09:41:54.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:54 smithi001 ceph-mon[31225]: pgmap v452: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 97 MiB/s wr, 18.23k op/s 2024-09-19T09:41:54.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:54 smithi022 ceph-mon[35583]: pgmap v452: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 97 MiB/s wr, 18.23k op/s 2024-09-19T09:41:54.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:54 smithi121 ceph-mon[35577]: pgmap v452: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 97 MiB/s wr, 18.23k op/s 2024-09-19T09:41:55.474 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.470+0000 7fb74a2c9640 1 -- 172.21.15.1:0/2760461350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb744100a70 msgr2=0x7fb744100e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:55.474 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.470+0000 7fb74a2c9640 1 --2- 172.21.15.1:0/2760461350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb744100a70 0x7fb744100e70 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fb734009900 tx=0x7fb73402a410 comp rx=0 tx=0).stop 2024-09-19T09:41:55.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.470+0000 7fb74a2c9640 1 -- 172.21.15.1:0/2760461350 shutdown_connections 2024-09-19T09:41:55.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.470+0000 7fb74a2c9640 1 --2- 172.21.15.1:0/2760461350 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb744102620 0x7fb744108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.470+0000 7fb74a2c9640 1 --2- 172.21.15.1:0/2760461350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb744101c60 0x7fb7441020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.470+0000 7fb74a2c9640 1 --2- 172.21.15.1:0/2760461350 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb744100a70 0x7fb744100e70 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.470+0000 7fb74a2c9640 1 -- 172.21.15.1:0/2760461350 >> 172.21.15.1:0/2760461350 conn(0x7fb7440fc1f0 msgr2=0x7fb7440fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:55.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.470+0000 7fb74a2c9640 1 -- 172.21.15.1:0/2760461350 shutdown_connections 2024-09-19T09:41:55.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.470+0000 7fb74a2c9640 1 -- 172.21.15.1:0/2760461350 wait complete. 2024-09-19T09:41:55.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.470+0000 7fb74a2c9640 1 Processor -- start 2024-09-19T09:41:55.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.471+0000 7fb74a2c9640 1 -- start start 2024-09-19T09:41:55.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.471+0000 7fb74a2c9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb744100a70 0x7fb744197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:55.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.471+0000 7fb74a2c9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb744101c60 0x7fb744198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:55.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.471+0000 7fb74a2c9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb744102620 0x7fb74419f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:55.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.471+0000 7fb74a2c9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb74410d800 con 0x7fb744102620 2024-09-19T09:41:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.471+0000 7fb74a2c9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb74410d680 con 0x7fb744101c60 2024-09-19T09:41:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.471+0000 7fb74a2c9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb74410d980 con 0x7fb744100a70 2024-09-19T09:41:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.471+0000 7fb748866640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb744102620 0x7fb74419f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.471+0000 7fb748866640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb744102620 0x7fb74419f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60476/0 (socket says 172.21.15.1:60476) 2024-09-19T09:41:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.471+0000 7fb748866640 1 -- 172.21.15.1:0/2492002857 learned_addr learned my addr 172.21.15.1:0/2492002857 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:41:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.471+0000 7fb743fff640 1 --2- 172.21.15.1:0/2492002857 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb744100a70 0x7fb744197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.471+0000 7fb7437fe640 1 --2- 172.21.15.1:0/2492002857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb744101c60 0x7fb744198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.471+0000 7fb748866640 1 -- 172.21.15.1:0/2492002857 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb744100a70 msgr2=0x7fb744197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.471+0000 7fb748866640 1 --2- 172.21.15.1:0/2492002857 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb744100a70 0x7fb744197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.471+0000 7fb748866640 1 -- 172.21.15.1:0/2492002857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb744101c60 msgr2=0x7fb744198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.471+0000 7fb748866640 1 --2- 172.21.15.1:0/2492002857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb744101c60 0x7fb744198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.471+0000 7fb748866640 1 -- 172.21.15.1:0/2492002857 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb74419fb50 con 0x7fb744102620 2024-09-19T09:41:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.472+0000 7fb748866640 1 --2- 172.21.15.1:0/2492002857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb744102620 0x7fb74419f4e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fb73c009fd0 tx=0x7fb73c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:55.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.472+0000 7fb7417fa640 1 -- 172.21.15.1:0/2492002857 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73c017070 con 0x7fb744102620 2024-09-19T09:41:55.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.472+0000 7fb7417fa640 1 -- 172.21.15.1:0/2492002857 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb73c003e50 con 0x7fb744102620 2024-09-19T09:41:55.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.472+0000 7fb74a2c9640 1 -- 172.21.15.1:0/2492002857 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb74419fe40 con 0x7fb744102620 2024-09-19T09:41:55.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.472+0000 7fb7417fa640 1 -- 172.21.15.1:0/2492002857 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73c0106c0 con 0x7fb744102620 2024-09-19T09:41:55.477 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.472+0000 7fb74a2c9640 1 -- 172.21.15.1:0/2492002857 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7441a0300 con 0x7fb744102620 2024-09-19T09:41:55.483 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.474+0000 7fb7417fa640 1 -- 172.21.15.1:0/2492002857 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fb73c003970 con 0x7fb744102620 2024-09-19T09:41:55.483 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.474+0000 7fb74d060740 1 Processor -- start 2024-09-19T09:41:55.483 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.474+0000 7fb74d060740 1 -- start start 2024-09-19T09:41:55.483 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.475+0000 7fb74d060740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56420a4909a0 0x56420a490da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:55.483 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.475+0000 7fb74d060740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56420a4912e0 0x56420a495da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:55.483 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.475+0000 7fb74d060740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56420a496370 0x56420a498830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:55.483 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.475+0000 7fb74d060740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56420a3f42f0 con 0x56420a4909a0 2024-09-19T09:41:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.475+0000 7fb74d060740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56420a39c270 con 0x56420a496370 2024-09-19T09:41:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.475+0000 7fb74d060740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56420a3f02b0 con 0x56420a4912e0 2024-09-19T09:41:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.475+0000 7fb7417fa640 1 --2- 172.21.15.1:0/2492002857 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb72c0a32c0 0x7fb72c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.475+0000 7fb7437fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56420a4909a0 0x56420a490da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.475+0000 7fb7437fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56420a4909a0 0x56420a490da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60488/0 (socket says 172.21.15.1:60488) 2024-09-19T09:41:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.475+0000 7fb7437fe640 1 -- 172.21.15.1:0/1123519633 learned_addr learned my addr 172.21.15.1:0/1123519633 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:41:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.475+0000 7fb743fff640 1 --2- 172.21.15.1:0/1123519633 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56420a4912e0 0x56420a495da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.475+0000 7fb748866640 1 --2- 172.21.15.1:0/2492002857 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb72c0a32c0 0x7fb72c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.475+0000 7fb7417fa640 1 -- 172.21.15.1:0/2492002857 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fb73c0cf660 con 0x7fb744102620 2024-09-19T09:41:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.475+0000 7fb7437fe640 1 --2- 172.21.15.1:0/1123519633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56420a496370 0x56420a498830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.475+0000 7fb7437fe640 1 -- 172.21.15.1:0/1123519633 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56420a4912e0 msgr2=0x56420a495da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.475+0000 7fb7437fe640 1 --2- 172.21.15.1:0/1123519633 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56420a4912e0 0x56420a495da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.475+0000 7fb7437fe640 1 -- 172.21.15.1:0/1123519633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56420a496370 msgr2=0x56420a498830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.475+0000 7fb7437fe640 1 --2- 172.21.15.1:0/1123519633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56420a496370 0x56420a498830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.475+0000 7fb7437fe640 1 -- 172.21.15.1:0/1123519633 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56420a39b340 con 0x56420a4909a0 2024-09-19T09:41:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.475+0000 7fb743fff640 1 --2- 172.21.15.1:0/1123519633 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56420a4912e0 0x56420a495da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:41:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.475+0000 7fb748866640 1 --2- 172.21.15.1:0/2492002857 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb72c0a32c0 0x7fb72c0a5780 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb73c0cd120 tx=0x7fb73c091120 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.475+0000 7fb7437fe640 1 --2- 172.21.15.1:0/1123519633 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56420a4909a0 0x56420a490da0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb738009fa0 tx=0x7fb7380097b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5006429658343e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.476+0000 7fb72a7fc640 1 -- 172.21.15.1:0/1123519633 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb738010490 con 0x56420a4909a0 2024-09-19T09:41:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.476+0000 7fb72a7fc640 1 -- 172.21.15.1:0/1123519633 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb738010b10 con 0x56420a4909a0 2024-09-19T09:41:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.476+0000 7fb72a7fc640 1 -- 172.21.15.1:0/1123519633 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7380119d0 con 0x56420a4909a0 2024-09-19T09:41:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.476+0000 7fb74d060740 1 -- 172.21.15.1:0/1123519633 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56420a4909a0 msgr2=0x56420a490da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.476+0000 7fb74d060740 1 --2- 172.21.15.1:0/1123519633 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56420a4909a0 0x56420a490da0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb738009fa0 tx=0x7fb7380097b0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.476+0000 7fb74d060740 1 -- 172.21.15.1:0/1123519633 shutdown_connections 2024-09-19T09:41:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.476+0000 7fb74d060740 1 --2- 172.21.15.1:0/1123519633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56420a496370 0x56420a498830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.476+0000 7fb74d060740 1 --2- 172.21.15.1:0/1123519633 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56420a4912e0 0x56420a495da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.476+0000 7fb74d060740 1 --2- 172.21.15.1:0/1123519633 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56420a4909a0 0x56420a490da0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.476+0000 7fb74d060740 1 -- 172.21.15.1:0/1123519633 >> 172.21.15.1:0/1123519633 conn(0x56420a48c010 msgr2=0x56420a48c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.476+0000 7fb74d060740 1 -- 172.21.15.1:0/1123519633 shutdown_connections 2024-09-19T09:41:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.476+0000 7fb74d060740 1 -- 172.21.15.1:0/1123519633 wait complete. 2024-09-19T09:41:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.477+0000 7fb74d060740 1 -- start start 2024-09-19T09:41:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.477+0000 7fb74d060740 1 Processor -- start 2024-09-19T09:41:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.477+0000 7fb74d060740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56420a4909a0 0x56420a49ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.477+0000 7fb74d060740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56420a4912e0 0x56420a49b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.477+0000 7fb74d060740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56420a496370 0x56420a4a20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.477+0000 7fb74d060740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56420a499340 con 0x56420a496370 2024-09-19T09:41:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.477+0000 7fb74d060740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56420a37d290 con 0x56420a4912e0 2024-09-19T09:41:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.477+0000 7fb74d060740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56420a4994c0 con 0x56420a4909a0 2024-09-19T09:41:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.477+0000 7fb74d060740 10 client.0 _ll_register_callbacks cb 0x56420a3ae140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.477+0000 7fb7437fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56420a496370 0x56420a4a20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.477+0000 7fb743fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56420a4912e0 0x56420a49b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.477+0000 7fb7437fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56420a496370 0x56420a4a20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60502/0 (socket says 172.21.15.1:60502) 2024-09-19T09:41:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.477+0000 7fb7437fe640 1 -- 172.21.15.1:0/1420898895 learned_addr learned my addr 172.21.15.1:0/1420898895 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:41:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.477+0000 7fb7437fe640 1 --2- 172.21.15.1:0/1420898895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56420a4909a0 0x56420a49ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.478+0000 7fb743fff640 1 -- 172.21.15.1:0/1420898895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56420a4909a0 msgr2=0x56420a49ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.478+0000 7fb743fff640 1 --2- 172.21.15.1:0/1420898895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56420a4909a0 0x56420a49ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.478+0000 7fb743fff640 1 -- 172.21.15.1:0/1420898895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56420a496370 msgr2=0x56420a4a20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.478+0000 7fb743fff640 1 --2- 172.21.15.1:0/1420898895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56420a496370 0x56420a4a20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.478+0000 7fb743fff640 1 -- 172.21.15.1:0/1420898895 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56420a107210 con 0x56420a4912e0 2024-09-19T09:41:55.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.478+0000 7fb743fff640 1 --2- 172.21.15.1:0/1420898895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56420a4912e0 0x56420a49b0b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb734006010 tx=0x7fb7340318e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c39d8606272128e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:55.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.478+0000 7fb7237fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:41:55.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.478+0000 7fb7237fe640 1 -- 172.21.15.1:0/1420898895 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb734035040 con 0x56420a4912e0 2024-09-19T09:41:55.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.478+0000 7fb7237fe640 1 -- 172.21.15.1:0/1420898895 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fb734004240 con 0x56420a4912e0 2024-09-19T09:41:55.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.478+0000 7fb74d060740 1 -- 172.21.15.1:0/1420898895 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb738010b10 con 0x56420a4912e0 2024-09-19T09:41:55.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.478+0000 7fb7237fe640 1 -- 172.21.15.1:0/1420898895 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb734004440 con 0x56420a4912e0 2024-09-19T09:41:55.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.478+0000 7fb74d060740 10 client.25574 fetch_fsmap learned FSMap version 19 2024-09-19T09:41:55.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.478+0000 7fb74d060740 1 -- 172.21.15.1:0/1420898895 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56420a1d3620 con 0x56420a4912e0 2024-09-19T09:41:55.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.479+0000 7fb7237fe640 1 -- 172.21.15.1:0/1420898895 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb738010b10 con 0x56420a4912e0 2024-09-19T09:41:55.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.479+0000 7fb7237fe640 1 -- 172.21.15.1:0/1420898895 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb73403d7c0 con 0x56420a4912e0 2024-09-19T09:41:55.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.479+0000 7fb74d060740 10 client.25574 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:41:55.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.479+0000 7fb74d060740 10 client.25574 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:41:55.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.479+0000 7fb74d060740 20 client.25574 populate_metadata read hostname 'smithi001' 2024-09-19T09:41:55.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.479+0000 7fb74d060740 1 --2- 172.21.15.1:0/1420898895 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56420a4a6770 0x56420a4a8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:55.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.479+0000 7fb74d060740 4 client.25574 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:41:55.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.479+0000 7fb74d060740 1 -- 172.21.15.1:0/1420898895 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56420a401a20 con 0x56420a4a6770 2024-09-19T09:41:55.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.479+0000 7fb7437fe640 1 --2- 172.21.15.1:0/1420898895 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56420a4a6770 0x56420a4a8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:55.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.479+0000 7fb7437fe640 1 --2- 172.21.15.1:0/1420898895 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56420a4a6770 0x56420a4a8b60 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=936a3011f34ec64 server_cookie=5a0917acadc0455 in_seq=0 out_seq=0 2024-09-19T09:41:55.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.479+0000 7fb7237fe640 10 client.25574 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:41:55.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.480+0000 7fb7237fe640 1 -- 172.21.15.1:0/1420898895 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56420a401a20 con 0x56420a4a6770 2024-09-19T09:41:55.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.480+0000 7fb7237fe640 10 client.25574 handle_command_reply: tid=0 2024-09-19T09:41:55.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.480+0000 7fb74d060740 1 client.25574 shutdown 2024-09-19T09:41:55.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.480+0000 7fb74d060740 1 -- 172.21.15.1:0/1420898895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56420a4912e0 msgr2=0x56420a49b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:55.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.480+0000 7fb74d060740 1 --2- 172.21.15.1:0/1420898895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56420a4912e0 0x56420a49b0b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb734006010 tx=0x7fb7340318e0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.480+0000 7fb74d060740 1 -- 172.21.15.1:0/1420898895 shutdown_connections 2024-09-19T09:41:55.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.480+0000 7fb74d060740 1 --2- 172.21.15.1:0/1420898895 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56420a4a6770 0x56420a4a8b60 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.480+0000 7fb74d060740 1 --2- 172.21.15.1:0/1420898895 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56420a496370 0x56420a4a20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.480+0000 7fb74d060740 1 --2- 172.21.15.1:0/1420898895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56420a4912e0 0x56420a49b0b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.480+0000 7fb74d060740 1 --2- 172.21.15.1:0/1420898895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56420a4909a0 0x56420a49ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.480+0000 7fb7237fe640 0 client.25574 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:41:55.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.480+0000 7fb74d060740 1 -- 172.21.15.1:0/1420898895 >> 172.21.15.1:0/1420898895 conn(0x56420a48c010 msgr2=0x56420a48d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:55.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.480+0000 7fb74d060740 1 -- 172.21.15.1:0/1420898895 shutdown_connections 2024-09-19T09:41:55.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.480+0000 7fb74d060740 1 -- 172.21.15.1:0/1420898895 wait complete. 2024-09-19T09:41:55.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.480+0000 7fb74d060740 20 client.25574 trim_cache size 0 max 16384 2024-09-19T09:41:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.496+0000 7fb74d060740 1 Processor -- start 2024-09-19T09:41:55.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.506+0000 7fb74d060740 1 -- start start 2024-09-19T09:41:55.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.507+0000 7fb74d060740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56420a4909a0 0x56420a48b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:55.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.507+0000 7fb74d060740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56420a4912e0 0x56420a4a20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:55.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.507+0000 7fb74d060740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56420a496370 0x56420a4ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:55.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.507+0000 7fb74d060740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb7441a7010 con 0x56420a4909a0 2024-09-19T09:41:55.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.507+0000 7fb74d060740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb7441a98b0 con 0x56420a496370 2024-09-19T09:41:55.510 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.508+0000 7fb74d060740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb7441a76a0 con 0x56420a4912e0 2024-09-19T09:41:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.510+0000 7fb743fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56420a4912e0 0x56420a4a20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.510+0000 7fb743fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56420a4912e0 0x56420a4a20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:44916/0 (socket says 172.21.15.1:44916) 2024-09-19T09:41:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.510+0000 7fb743fff640 1 -- 172.21.15.1:0/1732994542 learned_addr learned my addr 172.21.15.1:0/1732994542 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:41:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.510+0000 7fb7437fe640 1 --2- 172.21.15.1:0/1732994542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56420a496370 0x56420a4ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.510+0000 7fb7437fe640 1 --2- 172.21.15.1:0/1732994542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56420a4909a0 0x56420a48b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.511+0000 7fb743fff640 1 -- 172.21.15.1:0/1732994542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56420a496370 msgr2=0x56420a4ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.511+0000 7fb743fff640 1 --2- 172.21.15.1:0/1732994542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56420a496370 0x56420a4ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.511+0000 7fb743fff640 1 -- 172.21.15.1:0/1732994542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56420a4909a0 msgr2=0x56420a48b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.511+0000 7fb743fff640 1 --2- 172.21.15.1:0/1732994542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56420a4909a0 0x56420a48b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.511+0000 7fb743fff640 1 -- 172.21.15.1:0/1732994542 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56420a4a91e0 con 0x56420a4912e0 2024-09-19T09:41:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.511+0000 7fb743fff640 1 --2- 172.21.15.1:0/1732994542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56420a4912e0 0x56420a4a20b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb73403dbe0 tx=0x7fb73402a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa4d059f4428117d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.512+0000 7fb729ffb640 1 -- 172.21.15.1:0/1732994542 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb734035030 con 0x56420a4912e0 2024-09-19T09:41:55.521 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.516+0000 7fb729ffb640 1 -- 172.21.15.1:0/1732994542 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb73403d650 con 0x56420a4912e0 2024-09-19T09:41:55.521 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.516+0000 7fb729ffb640 1 -- 172.21.15.1:0/1732994542 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb734056490 con 0x56420a4912e0 2024-09-19T09:41:55.521 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.517+0000 7fb74d060740 1 -- 172.21.15.1:0/1732994542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56420a4912e0 msgr2=0x56420a4a20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:55.521 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.517+0000 7fb74d060740 1 --2- 172.21.15.1:0/1732994542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56420a4912e0 0x56420a4a20b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb73403dbe0 tx=0x7fb73402a410 comp rx=0 tx=0).stop 2024-09-19T09:41:55.524 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.520+0000 7fb74d060740 1 -- 172.21.15.1:0/1732994542 shutdown_connections 2024-09-19T09:41:55.525 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.520+0000 7fb74d060740 1 --2- 172.21.15.1:0/1732994542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56420a496370 0x56420a4ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.525 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.520+0000 7fb74d060740 1 --2- 172.21.15.1:0/1732994542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56420a4912e0 0x56420a4a20b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.525 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.520+0000 7fb74d060740 1 --2- 172.21.15.1:0/1732994542 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56420a4909a0 0x56420a48b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.525 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.520+0000 7fb74d060740 1 -- 172.21.15.1:0/1732994542 >> 172.21.15.1:0/1732994542 conn(0x56420a48c010 msgr2=0x56420a48a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:55.526 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.524+0000 7fb74d060740 1 -- 172.21.15.1:0/1732994542 shutdown_connections 2024-09-19T09:41:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.527+0000 7fb74d060740 1 -- 172.21.15.1:0/1732994542 wait complete. 2024-09-19T09:41:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.528+0000 7fb74d060740 1 -- start start 2024-09-19T09:41:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.528+0000 7fb74d060740 1 Processor -- start 2024-09-19T09:41:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.528+0000 7fb74d060740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56420a4909a0 0x56420a49fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.528+0000 7fb74d060740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56420a4912e0 0x56420a4a02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.528+0000 7fb74d060740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56420a496370 0x56420a4a12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.529+0000 7fb7437fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56420a4909a0 0x56420a49fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.529+0000 7fb7437fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56420a4909a0 0x56420a49fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:58644/0 (socket says 172.21.15.1:58644) 2024-09-19T09:41:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.529+0000 7fb7437fe640 1 -- 172.21.15.1:0/3680982009 learned_addr learned my addr 172.21.15.1:0/3680982009 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:41:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.529+0000 7fb74d060740 1 -- 172.21.15.1:0/3680982009 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb7441a7d70 con 0x56420a496370 2024-09-19T09:41:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.529+0000 7fb74d060740 1 -- 172.21.15.1:0/3680982009 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb7441a91e0 con 0x56420a4909a0 2024-09-19T09:41:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.529+0000 7fb74d060740 1 -- 172.21.15.1:0/3680982009 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb7441a8440 con 0x56420a4912e0 2024-09-19T09:41:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.529+0000 7fb7437fe640 1 --2- 172.21.15.1:0/3680982009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56420a496370 0x56420a4a12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:55.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.529+0000 7fb7437fe640 1 -- 172.21.15.1:0/3680982009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56420a4912e0 msgr2=0x56420a4a02e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:41:55.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.529+0000 7fb7437fe640 1 --2- 172.21.15.1:0/3680982009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56420a4912e0 0x56420a4a02e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.529+0000 7fb7437fe640 1 -- 172.21.15.1:0/3680982009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56420a496370 msgr2=0x56420a4a12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:41:55.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.529+0000 7fb7437fe640 1 --2- 172.21.15.1:0/3680982009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56420a496370 0x56420a4a12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:55.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.529+0000 7fb7437fe640 1 -- 172.21.15.1:0/3680982009 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56420a4a1900 con 0x56420a4909a0 2024-09-19T09:41:55.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.529+0000 7fb74d060740 10 client.0 _ll_register_callbacks cb 0x7fb734005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:41:55.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.529+0000 7fb74d060740 1 -- 172.21.15.1:0/3680982009 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb73403d650 con 0x56420a4909a0 2024-09-19T09:41:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.533+0000 7fb7437fe640 1 --2- 172.21.15.1:0/3680982009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56420a4909a0 0x56420a49fda0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb738009780 tx=0x7fb7380097b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcbfc3f330b81448 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:41:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.533+0000 7fb7237fe640 10 client.25580 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:41:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.533+0000 7fb7237fe640 1 -- 172.21.15.1:0/3680982009 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb738028040 con 0x56420a4909a0 2024-09-19T09:41:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.534+0000 7fb7237fe640 1 -- 172.21.15.1:0/3680982009 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fb738005470 con 0x56420a4909a0 2024-09-19T09:41:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.535+0000 7fb7237fe640 1 -- 172.21.15.1:0/3680982009 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb738010530 con 0x56420a4909a0 2024-09-19T09:41:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.536+0000 7fb74d060740 10 client.25580 fetch_fsmap learned FSMap version 19 2024-09-19T09:41:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.536+0000 7fb74d060740 1 -- 172.21.15.1:0/3680982009 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({fsmap=19}) -- 0x56420a5119c0 con 0x56420a4909a0 2024-09-19T09:41:55.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.539+0000 7fb7237fe640 1 -- 172.21.15.1:0/3680982009 <== mon.2 v2:172.21.15.22:3300/0 4 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb7380106d0 con 0x56420a4909a0 2024-09-19T09:41:55.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.539+0000 7fb74d060740 10 client.25580 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:41:55.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.539+0000 7fb74d060740 10 client.25580 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:41:55.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.539+0000 7fb74d060740 20 client.25580 populate_metadata read hostname 'smithi001' 2024-09-19T09:41:55.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.539+0000 7fb74d060740 1 --2- 172.21.15.1:0/3680982009 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56420a5121c0 0x56420a512630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:41:55.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.539+0000 7fb74d060740 4 client.25580 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:41:55.541 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.539+0000 7fb74d060740 1 -- 172.21.15.1:0/3680982009 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56420a3fbd70 con 0x56420a5121c0 2024-09-19T09:41:55.542 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.541+0000 7fb743fff640 1 --2- 172.21.15.1:0/3680982009 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56420a5121c0 0x56420a512630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:41:55.554 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.552+0000 7fb743fff640 1 --2- 172.21.15.1:0/3680982009 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56420a5121c0 0x56420a512630 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=301dc3d0a3cf006c server_cookie=eb134a4152967d0d in_seq=0 out_seq=0 2024-09-19T09:41:55.554 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:55.552+0000 7fb7237fe640 10 client.25580 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:41:56.419 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:56 smithi121 ceph-mon[35577]: pgmap v453: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 91 MiB/s wr, 17.65k op/s 2024-09-19T09:41:56.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:56 smithi001 ceph-mon[31225]: pgmap v453: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 91 MiB/s wr, 17.65k op/s 2024-09-19T09:41:56.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:56 smithi022 ceph-mon[35583]: pgmap v453: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 91 MiB/s wr, 17.65k op/s 2024-09-19T09:41:58.416 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:41:58 smithi022 ceph-mon[35583]: pgmap v454: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 92 MiB/s wr, 18.20k op/s 2024-09-19T09:41:58.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:41:58 smithi001 ceph-mon[31225]: pgmap v454: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 92 MiB/s wr, 18.20k op/s 2024-09-19T09:41:58.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:41:58 smithi121 ceph-mon[35577]: pgmap v454: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 92 MiB/s wr, 18.20k op/s 2024-09-19T09:41:58.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:58.666+0000 7fb7237fe640 1 -- 172.21.15.1:0/3680982009 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56420a3fbd70 con 0x56420a5121c0 2024-09-19T09:41:58.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:58.666+0000 7fb7237fe640 10 client.25580 handle_command_reply: tid=0 2024-09-19T09:41:58.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:58.667+0000 7fb74d060740 1 client.25580 shutdown 2024-09-19T09:41:58.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:58.667+0000 7fb74d060740 1 -- 172.21.15.1:0/3680982009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56420a4909a0 msgr2=0x56420a49fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:58.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:58.667+0000 7fb74d060740 1 --2- 172.21.15.1:0/3680982009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56420a4909a0 0x56420a49fda0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb738009780 tx=0x7fb7380097b0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:58.667+0000 7fb74d060740 1 -- 172.21.15.1:0/3680982009 shutdown_connections 2024-09-19T09:41:58.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:58.667+0000 7fb74d060740 1 --2- 172.21.15.1:0/3680982009 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56420a5121c0 0x56420a512630 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:58.667+0000 7fb74d060740 1 --2- 172.21.15.1:0/3680982009 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56420a496370 0x56420a4a12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:58.667+0000 7fb74d060740 1 --2- 172.21.15.1:0/3680982009 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56420a4912e0 0x56420a4a02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:58.667+0000 7fb74d060740 1 --2- 172.21.15.1:0/3680982009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56420a4909a0 0x56420a49fda0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:58.667+0000 7fb74d060740 1 -- 172.21.15.1:0/3680982009 >> 172.21.15.1:0/3680982009 conn(0x56420a48c010 msgr2=0x56420a48d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:58.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:58.667+0000 7fb7237fe640 0 client.25580 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:41:58.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:58.668+0000 7fb74d060740 1 -- 172.21.15.1:0/3680982009 shutdown_connections 2024-09-19T09:41:58.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:58.668+0000 7fb74d060740 1 -- 172.21.15.1:0/3680982009 wait complete. 2024-09-19T09:41:58.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:58.668+0000 7fb74d060740 20 client.25580 trim_cache size 0 max 16384 2024-09-19T09:41:58.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:41:58.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:41:58.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:41:58.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:41:58.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:58.669+0000 7fb74a2c9640 1 -- 172.21.15.1:0/2492002857 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb72c0a32c0 msgr2=0x7fb72c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:58.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:58.669+0000 7fb74a2c9640 1 --2- 172.21.15.1:0/2492002857 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb72c0a32c0 0x7fb72c0a5780 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb73c0cd120 tx=0x7fb73c091120 comp rx=0 tx=0).stop 2024-09-19T09:41:58.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:58.669+0000 7fb74a2c9640 1 -- 172.21.15.1:0/2492002857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb744102620 msgr2=0x7fb74419f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:41:58.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:58.669+0000 7fb74a2c9640 1 --2- 172.21.15.1:0/2492002857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb744102620 0x7fb74419f4e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fb73c009fd0 tx=0x7fb73c00b260 comp rx=0 tx=0).stop 2024-09-19T09:41:58.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:58.669+0000 7fb74a2c9640 1 -- 172.21.15.1:0/2492002857 shutdown_connections 2024-09-19T09:41:58.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:58.669+0000 7fb74a2c9640 1 --2- 172.21.15.1:0/2492002857 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb744102620 0x7fb74419f4e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:58.669+0000 7fb74a2c9640 1 --2- 172.21.15.1:0/2492002857 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb72c0a32c0 0x7fb72c0a5780 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:58.669+0000 7fb74a2c9640 1 --2- 172.21.15.1:0/2492002857 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb744101c60 0x7fb744198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:58.669+0000 7fb74a2c9640 1 --2- 172.21.15.1:0/2492002857 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb744100a70 0x7fb744197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:41:58.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:58.669+0000 7fb74a2c9640 1 -- 172.21.15.1:0/2492002857 >> 172.21.15.1:0/2492002857 conn(0x7fb7440fc1f0 msgr2=0x7fb744105120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:41:58.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:58.669+0000 7fb74a2c9640 1 -- 172.21.15.1:0/2492002857 shutdown_connections 2024-09-19T09:41:58.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:41:58.669+0000 7fb74a2c9640 1 -- 172.21.15.1:0/2492002857 wait complete. 2024-09-19T09:42:00.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:00 smithi001 ceph-mon[31225]: pgmap v455: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 74 MiB/s wr, 15.22k op/s 2024-09-19T09:42:00.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:00 smithi022 ceph-mon[35583]: pgmap v455: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 74 MiB/s wr, 15.22k op/s 2024-09-19T09:42:00.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:00 smithi121 ceph-mon[35577]: pgmap v455: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 74 MiB/s wr, 15.22k op/s 2024-09-19T09:42:02.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:02 smithi001 ceph-mon[31225]: pgmap v456: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 69 MiB/s wr, 14.53k op/s 2024-09-19T09:42:02.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:02 smithi022 ceph-mon[35583]: pgmap v456: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 69 MiB/s wr, 14.53k op/s 2024-09-19T09:42:02.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:02 smithi121 ceph-mon[35577]: pgmap v456: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 69 MiB/s wr, 14.53k op/s 2024-09-19T09:42:03.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.984+0000 7f54752f8640 1 -- 172.21.15.1:0/4133279904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5470102570 msgr2=0x7f54701029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:03.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.984+0000 7f54752f8640 1 --2- 172.21.15.1:0/4133279904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5470102570 0x7f54701029b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5468009cd0 tx=0x7f546802ea70 comp rx=0 tx=0).stop 2024-09-19T09:42:03.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.986+0000 7f54752f8640 1 -- 172.21.15.1:0/4133279904 shutdown_connections 2024-09-19T09:42:03.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.986+0000 7f54752f8640 1 --2- 172.21.15.1:0/4133279904 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5470102ef0 0x7f547010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:03.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.986+0000 7f54752f8640 1 --2- 172.21.15.1:0/4133279904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5470102570 0x7f54701029b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:03.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.986+0000 7f54752f8640 1 --2- 172.21.15.1:0/4133279904 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5470100e20 0x7f5470101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:03.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.986+0000 7f54752f8640 1 -- 172.21.15.1:0/4133279904 >> 172.21.15.1:0/4133279904 conn(0x7f54700fc7d0 msgr2=0x7f54700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:03.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.993+0000 7f54752f8640 1 -- 172.21.15.1:0/4133279904 shutdown_connections 2024-09-19T09:42:03.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.993+0000 7f54752f8640 1 -- 172.21.15.1:0/4133279904 wait complete. 2024-09-19T09:42:03.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.994+0000 7f54752f8640 1 Processor -- start 2024-09-19T09:42:03.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.994+0000 7f54752f8640 1 -- start start 2024-09-19T09:42:03.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.994+0000 7f54752f8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5470100e20 0x7f5470116710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:03.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.994+0000 7f54752f8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5470102570 0x7f5470116c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:03.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.994+0000 7f54752f8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5470102ef0 0x7f547010f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:03.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.994+0000 7f54752f8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5470118690 con 0x7f5470100e20 2024-09-19T09:42:03.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.994+0000 7f54752f8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5470118510 con 0x7f5470102ef0 2024-09-19T09:42:03.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.994+0000 7f54752f8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5470118810 con 0x7f5470102570 2024-09-19T09:42:03.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.995+0000 7f546e7fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5470102570 0x7f5470116c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:03.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.995+0000 7f546f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5470102ef0 0x7f547010f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:03.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.995+0000 7f546f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5470102ef0 0x7f547010f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:58676/0 (socket says 172.21.15.1:58676) 2024-09-19T09:42:03.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.995+0000 7f546f7fe640 1 -- 172.21.15.1:0/2829009150 learned_addr learned my addr 172.21.15.1:0/2829009150 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:03.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.995+0000 7f546effd640 1 --2- 172.21.15.1:0/2829009150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5470100e20 0x7f5470116710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:03.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.996+0000 7f546f7fe640 1 -- 172.21.15.1:0/2829009150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5470102570 msgr2=0x7f5470116c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:03.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.996+0000 7f546f7fe640 1 --2- 172.21.15.1:0/2829009150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5470102570 0x7f5470116c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:03.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.996+0000 7f546f7fe640 1 -- 172.21.15.1:0/2829009150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5470100e20 msgr2=0x7f5470116710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:03.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.996+0000 7f546f7fe640 1 --2- 172.21.15.1:0/2829009150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5470100e20 0x7f5470116710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:03.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.996+0000 7f546f7fe640 1 -- 172.21.15.1:0/2829009150 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5470110000 con 0x7f5470102ef0 2024-09-19T09:42:03.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.996+0000 7f546f7fe640 1 --2- 172.21.15.1:0/2829009150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5470102ef0 0x7f547010f7a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f546400e970 tx=0x7f546400ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:03.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.996+0000 7f5457fff640 1 -- 172.21.15.1:0/2829009150 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546400ccc0 con 0x7f5470102ef0 2024-09-19T09:42:03.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.996+0000 7f54752f8640 1 -- 172.21.15.1:0/2829009150 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54701102f0 con 0x7f5470102ef0 2024-09-19T09:42:03.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.997+0000 7f5457fff640 1 -- 172.21.15.1:0/2829009150 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f546400ce60 con 0x7f5470102ef0 2024-09-19T09:42:03.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.997+0000 7f5457fff640 1 -- 172.21.15.1:0/2829009150 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546400ccc0 con 0x7f5470102ef0 2024-09-19T09:42:03.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:01.997+0000 7f54752f8640 1 -- 172.21.15.1:0/2829009150 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5470114410 con 0x7f5470102ef0 2024-09-19T09:42:03.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.005+0000 7f54776d1740 1 Processor -- start 2024-09-19T09:42:03.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.006+0000 7f54776d1740 1 -- start start 2024-09-19T09:42:03.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.006+0000 7f5457fff640 1 -- 172.21.15.1:0/2829009150 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f5464021440 con 0x7f5470102ef0 2024-09-19T09:42:03.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.006+0000 7f54776d1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c0cfb5760 0x555c0cfb5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:03.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.006+0000 7f54776d1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c0cfb6080 0x555c0cfc0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:03.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.006+0000 7f54776d1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555c0cfc0940 0x555c0cfc2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:03.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.007+0000 7f54776d1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x555c0cf1b2a0 con 0x555c0cfb5760 2024-09-19T09:42:03.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.007+0000 7f54776d1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555c0cec2b10 con 0x555c0cfb6080 2024-09-19T09:42:03.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.007+0000 7f54776d1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x555c0cf17260 con 0x555c0cfc0940 2024-09-19T09:42:03.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.007+0000 7f546effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c0cfb6080 0x555c0cfc0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:03.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.007+0000 7f546effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c0cfb6080 0x555c0cfc0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:58690/0 (socket says 172.21.15.1:58690) 2024-09-19T09:42:03.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.007+0000 7f546effd640 1 -- 172.21.15.1:0/3686196683 learned_addr learned my addr 172.21.15.1:0/3686196683 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:03.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.007+0000 7f546e7fc640 1 --2- 172.21.15.1:0/3686196683 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c0cfb5760 0x555c0cfb5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:03.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.008+0000 7f546e7fc640 1 -- 172.21.15.1:0/3686196683 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555c0cfc0940 msgr2=0x555c0cfc2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:03.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.008+0000 7f546e7fc640 1 --2- 172.21.15.1:0/3686196683 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555c0cfc0940 0x555c0cfc2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:03.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.008+0000 7f546e7fc640 1 -- 172.21.15.1:0/3686196683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c0cfb6080 msgr2=0x555c0cfc0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:03.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.008+0000 7f546e7fc640 1 --2- 172.21.15.1:0/3686196683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c0cfb6080 0x555c0cfc0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:03.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.008+0000 7f546e7fc640 1 -- 172.21.15.1:0/3686196683 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c0cc8cb90 con 0x555c0cfb5760 2024-09-19T09:42:03.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.008+0000 7f5457fff640 1 --2- 172.21.15.1:0/2829009150 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f54580a3700 0x7f54580a5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:03.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.008+0000 7f546e7fc640 1 --2- 172.21.15.1:0/3686196683 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c0cfb5760 0x555c0cfb5b40 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5468009ca0 tx=0x7f5468032c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=834c55ae03eb2085 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:03.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.008+0000 7f5457fff640 1 -- 172.21.15.1:0/2829009150 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f546400cac0 con 0x7f5470102ef0 2024-09-19T09:42:03.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.008+0000 7f54557fa640 1 -- 172.21.15.1:0/3686196683 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5468037070 con 0x555c0cfb5760 2024-09-19T09:42:03.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.008+0000 7f54557fa640 1 -- 172.21.15.1:0/3686196683 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5468040030 con 0x555c0cfb5760 2024-09-19T09:42:03.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.008+0000 7f54557fa640 1 -- 172.21.15.1:0/3686196683 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5468032800 con 0x555c0cfb5760 2024-09-19T09:42:03.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.010+0000 7f54776d1740 1 -- 172.21.15.1:0/3686196683 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c0cfb5760 msgr2=0x555c0cfb5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:03.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.010+0000 7f54776d1740 1 --2- 172.21.15.1:0/3686196683 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c0cfb5760 0x555c0cfb5b40 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5468009ca0 tx=0x7f5468032c00 comp rx=0 tx=0).stop 2024-09-19T09:42:03.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.010+0000 7f54776d1740 1 -- 172.21.15.1:0/3686196683 shutdown_connections 2024-09-19T09:42:03.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.010+0000 7f54776d1740 1 --2- 172.21.15.1:0/3686196683 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555c0cfc0940 0x555c0cfc2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:03.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.010+0000 7f54776d1740 1 --2- 172.21.15.1:0/3686196683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c0cfb6080 0x555c0cfc0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:03.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.010+0000 7f54776d1740 1 --2- 172.21.15.1:0/3686196683 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c0cfb5760 0x555c0cfb5b40 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:03.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.010+0000 7f54776d1740 1 -- 172.21.15.1:0/3686196683 >> 172.21.15.1:0/3686196683 conn(0x555c0cfb1cf0 msgr2=0x555c0cfb20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:03.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.012+0000 7f54776d1740 1 -- 172.21.15.1:0/3686196683 shutdown_connections 2024-09-19T09:42:03.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.012+0000 7f546effd640 1 --2- 172.21.15.1:0/2829009150 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f54580a3700 0x7f54580a5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:03.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.012+0000 7f54776d1740 1 -- 172.21.15.1:0/3686196683 wait complete. 2024-09-19T09:42:03.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.012+0000 7f54776d1740 1 -- start start 2024-09-19T09:42:03.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.012+0000 7f54776d1740 1 Processor -- start 2024-09-19T09:42:03.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.013+0000 7f54776d1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c0cfb5760 0x555c0cfbd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:03.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.013+0000 7f54776d1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c0cfc0940 0x555c0cfbde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:03.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.013+0000 7f54776d1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555c0cfbe3b0 0x555c0cfcc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:03.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.013+0000 7f54776d1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x555c0cfc3510 con 0x555c0cfc0940 2024-09-19T09:42:03.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.013+0000 7f54776d1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555c0cea36e0 con 0x555c0cfb5760 2024-09-19T09:42:03.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.013+0000 7f54776d1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x555c0cfc3690 con 0x555c0cfbe3b0 2024-09-19T09:42:03.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.013+0000 7f54776d1740 10 client.0 _ll_register_callbacks cb 0x555c0cec7a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:03.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.014+0000 7f546f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555c0cfbe3b0 0x555c0cfcc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:03.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.014+0000 7f546e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c0cfc0940 0x555c0cfbde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:03.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.014+0000 7f546e7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c0cfc0940 0x555c0cfbde70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:60548/0 (socket says 172.21.15.1:60548) 2024-09-19T09:42:03.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.014+0000 7f546e7fc640 1 -- 172.21.15.1:0/1794299655 learned_addr learned my addr 172.21.15.1:0/1794299655 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:03.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.014+0000 7f546effd640 1 --2- 172.21.15.1:0/1794299655 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c0cfb5760 0x555c0cfbd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:03.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.014+0000 7f546effd640 1 --2- 172.21.15.1:0/2829009150 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f54580a3700 0x7f54580a5bc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f54600058c0 tx=0x7f546002e340 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:03.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.015+0000 7f546e7fc640 1 -- 172.21.15.1:0/1794299655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555c0cfbe3b0 msgr2=0x555c0cfcc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:03.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.015+0000 7f546e7fc640 1 --2- 172.21.15.1:0/1794299655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555c0cfbe3b0 0x555c0cfcc9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:03.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.015+0000 7f546e7fc640 1 -- 172.21.15.1:0/1794299655 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c0cfb5760 msgr2=0x555c0cfbd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:03.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.015+0000 7f546e7fc640 1 --2- 172.21.15.1:0/1794299655 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c0cfb5760 0x555c0cfbd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:03.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.015+0000 7f546e7fc640 1 -- 172.21.15.1:0/1794299655 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c0cfccf40 con 0x555c0cfc0940 2024-09-19T09:42:03.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.016+0000 7f546e7fc640 1 --2- 172.21.15.1:0/1794299655 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c0cfc0940 0x555c0cfbde70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f546800f2f0 tx=0x7f546802ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d84d4678117c2f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:03.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.016+0000 7f5452ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:42:03.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.017+0000 7f5452ff5640 1 -- 172.21.15.1:0/1794299655 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546804c070 con 0x555c0cfc0940 2024-09-19T09:42:03.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.017+0000 7f5452ff5640 1 -- 172.21.15.1:0/1794299655 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f5468009780 con 0x555c0cfc0940 2024-09-19T09:42:03.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.018+0000 7f54776d1740 1 -- 172.21.15.1:0/1794299655 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5468040030 con 0x555c0cfc0940 2024-09-19T09:42:03.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.018+0000 7f5452ff5640 1 -- 172.21.15.1:0/1794299655 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f5468056050 con 0x555c0cfc0940 2024-09-19T09:42:03.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.018+0000 7f54776d1740 10 client.15924 fetch_fsmap learned FSMap version 19 2024-09-19T09:42:03.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.018+0000 7f54776d1740 1 -- 172.21.15.1:0/1794299655 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x555c0cfcf890 con 0x555c0cfc0940 2024-09-19T09:42:03.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.019+0000 7f5452ff5640 1 -- 172.21.15.1:0/1794299655 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5468040030 con 0x555c0cfc0940 2024-09-19T09:42:03.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.019+0000 7f5452ff5640 1 -- 172.21.15.1:0/1794299655 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f546800b040 con 0x555c0cfc0940 2024-09-19T09:42:03.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.019+0000 7f54776d1740 10 client.15924 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:42:03.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.019+0000 7f54776d1740 10 client.15924 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:42:03.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.019+0000 7f54776d1740 20 client.15924 populate_metadata read hostname 'smithi001' 2024-09-19T09:42:03.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.019+0000 7f54776d1740 1 --2- 172.21.15.1:0/1794299655 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x555c0cfd0da0 0x555c0cfd3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:03.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.019+0000 7f54776d1740 4 client.15924 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:42:03.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.019+0000 7f54776d1740 1 -- 172.21.15.1:0/1794299655 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c0cf289d0 con 0x555c0cfd0da0 2024-09-19T09:42:03.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.020+0000 7f546effd640 1 --2- 172.21.15.1:0/1794299655 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x555c0cfd0da0 0x555c0cfd3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:03.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.026+0000 7f546effd640 1 --2- 172.21.15.1:0/1794299655 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x555c0cfd0da0 0x555c0cfd3220 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b582e980f55749aa server_cookie=33469e7bf583fbbd in_seq=0 out_seq=0 2024-09-19T09:42:03.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.026+0000 7f5452ff5640 10 client.15924 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:03.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.028+0000 7f5452ff5640 1 -- 172.21.15.1:0/1794299655 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555c0cf289d0 con 0x555c0cfd0da0 2024-09-19T09:42:03.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.028+0000 7f5452ff5640 10 client.15924 handle_command_reply: tid=0 2024-09-19T09:42:03.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.028+0000 7f54776d1740 1 client.15924 shutdown 2024-09-19T09:42:03.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.028+0000 7f54776d1740 1 -- 172.21.15.1:0/1794299655 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c0cfc0940 msgr2=0x555c0cfbde70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:03.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.028+0000 7f54776d1740 1 --2- 172.21.15.1:0/1794299655 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c0cfc0940 0x555c0cfbde70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f546800f2f0 tx=0x7f546802ea70 comp rx=0 tx=0).stop 2024-09-19T09:42:03.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.028+0000 7f54776d1740 1 -- 172.21.15.1:0/1794299655 shutdown_connections 2024-09-19T09:42:03.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.028+0000 7f54776d1740 1 --2- 172.21.15.1:0/1794299655 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x555c0cfd0da0 0x555c0cfd3220 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:03.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.028+0000 7f54776d1740 1 --2- 172.21.15.1:0/1794299655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555c0cfbe3b0 0x555c0cfcc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:03.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.028+0000 7f54776d1740 1 --2- 172.21.15.1:0/1794299655 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c0cfc0940 0x555c0cfbde70 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:03.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.028+0000 7f54776d1740 1 --2- 172.21.15.1:0/1794299655 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c0cfb5760 0x555c0cfbd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:03.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.028+0000 7f54776d1740 1 -- 172.21.15.1:0/1794299655 >> 172.21.15.1:0/1794299655 conn(0x555c0cfb1cf0 msgr2=0x555c0cfb7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:03.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.029+0000 7f5452ff5640 0 client.15924 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:03.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.029+0000 7f54776d1740 1 -- 172.21.15.1:0/1794299655 shutdown_connections 2024-09-19T09:42:03.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.029+0000 7f54776d1740 1 -- 172.21.15.1:0/1794299655 wait complete. 2024-09-19T09:42:03.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.029+0000 7f54776d1740 20 client.15924 trim_cache size 0 max 16384 2024-09-19T09:42:03.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.052+0000 7f54776d1740 1 Processor -- start 2024-09-19T09:42:03.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.052+0000 7f54776d1740 1 -- start start 2024-09-19T09:42:03.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.052+0000 7f54776d1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c0cfb5760 0x555c0cfb1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:03.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.052+0000 7f54776d1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555c0cfbe3b0 0x555c0cfb81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:03.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.052+0000 7f54776d1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c0cfc0940 0x555c0cfbd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:03.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.052+0000 7f54776d1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f545c00c520 con 0x555c0cfb5760 2024-09-19T09:42:03.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.052+0000 7f54776d1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f545c00edc0 con 0x555c0cfc0940 2024-09-19T09:42:03.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.052+0000 7f54776d1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f545c00cbb0 con 0x555c0cfbe3b0 2024-09-19T09:42:03.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.052+0000 7f546effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c0cfb5760 0x555c0cfb1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:03.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.052+0000 7f546f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c0cfc0940 0x555c0cfbd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:03.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.052+0000 7f546f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c0cfc0940 0x555c0cfbd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:58702/0 (socket says 172.21.15.1:58702) 2024-09-19T09:42:03.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.052+0000 7f546f7fe640 1 -- 172.21.15.1:0/3619920019 learned_addr learned my addr 172.21.15.1:0/3619920019 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:03.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.052+0000 7f546e7fc640 1 --2- 172.21.15.1:0/3619920019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555c0cfbe3b0 0x555c0cfb81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:03.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.052+0000 7f546f7fe640 1 -- 172.21.15.1:0/3619920019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555c0cfbe3b0 msgr2=0x555c0cfb81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:03.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.052+0000 7f546f7fe640 1 --2- 172.21.15.1:0/3619920019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555c0cfbe3b0 0x555c0cfb81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:03.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.052+0000 7f546f7fe640 1 -- 172.21.15.1:0/3619920019 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c0cfb5760 msgr2=0x555c0cfb1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:03.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.052+0000 7f546f7fe640 1 --2- 172.21.15.1:0/3619920019 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c0cfb5760 0x555c0cfb1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:03.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.052+0000 7f546f7fe640 1 -- 172.21.15.1:0/3619920019 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c0cfad260 con 0x555c0cfc0940 2024-09-19T09:42:03.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.052+0000 7f546e7fc640 1 --2- 172.21.15.1:0/3619920019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555c0cfbe3b0 0x555c0cfb81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:03.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.053+0000 7f546f7fe640 1 --2- 172.21.15.1:0/3619920019 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c0cfc0940 0x555c0cfbd9a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f546409cd60 tx=0x7f546400ccc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7ce3c920a9ff81d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:03.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.053+0000 7f5454ff9640 1 -- 172.21.15.1:0/3619920019 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546409d4d0 con 0x555c0cfc0940 2024-09-19T09:42:03.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.053+0000 7f5454ff9640 1 -- 172.21.15.1:0/3619920019 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5464064030 con 0x555c0cfc0940 2024-09-19T09:42:03.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.053+0000 7f5454ff9640 1 -- 172.21.15.1:0/3619920019 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5464099440 con 0x555c0cfc0940 2024-09-19T09:42:03.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.053+0000 7f54776d1740 1 -- 172.21.15.1:0/3619920019 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c0cfc0940 msgr2=0x555c0cfbd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:03.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.053+0000 7f54776d1740 1 --2- 172.21.15.1:0/3619920019 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c0cfc0940 0x555c0cfbd9a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f546409cd60 tx=0x7f546400ccc0 comp rx=0 tx=0).stop 2024-09-19T09:42:03.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.054+0000 7f54776d1740 1 -- 172.21.15.1:0/3619920019 shutdown_connections 2024-09-19T09:42:03.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.054+0000 7f54776d1740 1 --2- 172.21.15.1:0/3619920019 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c0cfc0940 0x555c0cfbd9a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:03.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.054+0000 7f54776d1740 1 --2- 172.21.15.1:0/3619920019 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555c0cfbe3b0 0x555c0cfb81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:03.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.054+0000 7f54776d1740 1 --2- 172.21.15.1:0/3619920019 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c0cfb5760 0x555c0cfb1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:03.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.054+0000 7f54776d1740 1 -- 172.21.15.1:0/3619920019 >> 172.21.15.1:0/3619920019 conn(0x555c0cfb1cf0 msgr2=0x555c0cfbd290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:03.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.054+0000 7f54776d1740 1 -- 172.21.15.1:0/3619920019 shutdown_connections 2024-09-19T09:42:03.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.054+0000 7f54776d1740 1 -- 172.21.15.1:0/3619920019 wait complete. 2024-09-19T09:42:03.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.054+0000 7f54776d1740 1 -- start start 2024-09-19T09:42:03.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.054+0000 7f54776d1740 1 Processor -- start 2024-09-19T09:42:03.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.054+0000 7f54776d1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c0cfb5760 0x555c0cfc9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:03.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.054+0000 7f54776d1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555c0cfbe3b0 0x555c0cfba7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:03.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.054+0000 7f54776d1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c0cfc0940 0x555c0cfbad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:03.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.054+0000 7f54776d1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f545c00d280 con 0x555c0cfb5760 2024-09-19T09:42:03.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.054+0000 7f54776d1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f545c00e6f0 con 0x555c0cfc0940 2024-09-19T09:42:03.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.054+0000 7f54776d1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f545c00d950 con 0x555c0cfbe3b0 2024-09-19T09:42:03.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.055+0000 7f54776d1740 10 client.0 _ll_register_callbacks cb 0x7f5468003d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:03.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.055+0000 7f546e7fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555c0cfbe3b0 0x555c0cfba7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:03.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.055+0000 7f546e7fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555c0cfbe3b0 0x555c0cfba7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:44952/0 (socket says 172.21.15.1:44952) 2024-09-19T09:42:03.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.055+0000 7f546e7fc640 1 -- 172.21.15.1:0/498008383 learned_addr learned my addr 172.21.15.1:0/498008383 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:03.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.055+0000 7f546effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c0cfb5760 0x555c0cfc9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:03.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.055+0000 7f546f7fe640 1 --2- 172.21.15.1:0/498008383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c0cfc0940 0x555c0cfbad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:03.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.055+0000 7f546e7fc640 1 -- 172.21.15.1:0/498008383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c0cfc0940 msgr2=0x555c0cfbad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:03.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.055+0000 7f546e7fc640 1 --2- 172.21.15.1:0/498008383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c0cfc0940 0x555c0cfbad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:03.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.055+0000 7f546e7fc640 1 -- 172.21.15.1:0/498008383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c0cfb5760 msgr2=0x555c0cfc9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:03.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.055+0000 7f546e7fc640 1 --2- 172.21.15.1:0/498008383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c0cfb5760 0x555c0cfc9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:03.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.055+0000 7f546e7fc640 1 -- 172.21.15.1:0/498008383 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c0cfbb540 con 0x555c0cfbe3b0 2024-09-19T09:42:03.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.055+0000 7f546e7fc640 1 --2- 172.21.15.1:0/498008383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555c0cfbe3b0 0x555c0cfba7d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5468033040 tx=0x7f5468005ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=459ad9f35c4ba73c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:03.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.055+0000 7f5452ff5640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-19T09:42:03.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.055+0000 7f5452ff5640 1 -- 172.21.15.1:0/498008383 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5468060060 con 0x555c0cfbe3b0 2024-09-19T09:42:03.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.055+0000 7f5452ff5640 1 -- 172.21.15.1:0/498008383 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f5468003e00 con 0x555c0cfbe3b0 2024-09-19T09:42:03.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.055+0000 7f54776d1740 1 -- 172.21.15.1:0/498008383 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5464064030 con 0x555c0cfbe3b0 2024-09-19T09:42:03.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.055+0000 7f5452ff5640 1 -- 172.21.15.1:0/498008383 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f546804c050 con 0x555c0cfbe3b0 2024-09-19T09:42:03.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.055+0000 7f54776d1740 10 client.25441 fetch_fsmap learned FSMap version 19 2024-09-19T09:42:03.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.055+0000 7f54776d1740 1 -- 172.21.15.1:0/498008383 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x555c0d03bb40 con 0x555c0cfbe3b0 2024-09-19T09:42:03.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.056+0000 7f5452ff5640 1 -- 172.21.15.1:0/498008383 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5464064030 con 0x555c0cfbe3b0 2024-09-19T09:42:03.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.056+0000 7f5452ff5640 1 -- 172.21.15.1:0/498008383 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f5468065070 con 0x555c0cfbe3b0 2024-09-19T09:42:03.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.056+0000 7f54776d1740 10 client.25441 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:42:03.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.056+0000 7f54776d1740 10 client.25441 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:42:03.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.056+0000 7f54776d1740 20 client.25441 populate_metadata read hostname 'smithi001' 2024-09-19T09:42:03.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.056+0000 7f54776d1740 1 --2- 172.21.15.1:0/498008383 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x555c0d03c270 0x555c0d03e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:03.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.056+0000 7f54776d1740 4 client.25441 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}] 2024-09-19T09:42:03.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.056+0000 7f54776d1740 1 -- 172.21.15.1:0/498008383 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}) -- 0x555c0cf22d20 con 0x555c0d03c270 2024-09-19T09:42:03.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.056+0000 7f546effd640 1 --2- 172.21.15.1:0/498008383 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x555c0d03c270 0x555c0d03e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:03.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.057+0000 7f5452ff5640 10 client.25441 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:03.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:02.057+0000 7f546effd640 1 --2- 172.21.15.1:0/498008383 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x555c0d03c270 0x555c0d03e660 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a529e6f62f74492 server_cookie=7b71df03f40b4a06 in_seq=0 out_seq=0 2024-09-19T09:42:04.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:04 smithi001 ceph-mon[31225]: pgmap v457: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 73 MiB/s wr, 15.63k op/s 2024-09-19T09:42:04.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:04 smithi022 ceph-mon[35583]: pgmap v457: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 73 MiB/s wr, 15.63k op/s 2024-09-19T09:42:04.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:04 smithi121 ceph-mon[35577]: pgmap v457: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 73 MiB/s wr, 15.63k op/s 2024-09-19T09:42:04.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:04.794+0000 7f5452ff5640 1 -- 172.21.15.1:0/498008383 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x555c0cf22d20 con 0x555c0d03c270 2024-09-19T09:42:04.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:04.794+0000 7f5452ff5640 10 client.25441 handle_command_reply: tid=0 2024-09-19T09:42:04.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:04.794+0000 7f54776d1740 1 client.25441 shutdown 2024-09-19T09:42:04.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:04.794+0000 7f54776d1740 1 -- 172.21.15.1:0/498008383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555c0cfbe3b0 msgr2=0x555c0cfba7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:04.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:04.794+0000 7f54776d1740 1 --2- 172.21.15.1:0/498008383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555c0cfbe3b0 0x555c0cfba7d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5468033040 tx=0x7f5468005ef0 comp rx=0 tx=0).stop 2024-09-19T09:42:04.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:04.794+0000 7f54776d1740 1 -- 172.21.15.1:0/498008383 shutdown_connections 2024-09-19T09:42:04.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:04.794+0000 7f54776d1740 1 --2- 172.21.15.1:0/498008383 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x555c0d03c270 0x555c0d03e660 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:04.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:04.794+0000 7f54776d1740 1 --2- 172.21.15.1:0/498008383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555c0cfc0940 0x555c0cfbad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:04.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:04.794+0000 7f5452ff5640 0 client.25441 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:04.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:04.794+0000 7f54776d1740 1 --2- 172.21.15.1:0/498008383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555c0cfbe3b0 0x555c0cfba7d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:04.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:04.794+0000 7f54776d1740 1 --2- 172.21.15.1:0/498008383 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x555c0cfb5760 0x555c0cfc9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:04.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:04.794+0000 7f54776d1740 1 -- 172.21.15.1:0/498008383 >> 172.21.15.1:0/498008383 conn(0x555c0cfb1cf0 msgr2=0x555c0cfbdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:04.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:04.795+0000 7f54776d1740 1 -- 172.21.15.1:0/498008383 shutdown_connections 2024-09-19T09:42:04.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:04.795+0000 7f54776d1740 1 -- 172.21.15.1:0/498008383 wait complete. 2024-09-19T09:42:04.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:04.795+0000 7f54776d1740 20 client.25441 trim_cache size 0 max 16384 2024-09-19T09:42:04.799 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:42:04.799 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 19, 2024-09-19T09:42:04.799 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24497, 2024-09-19T09:42:04.799 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 14, 2024-09-19T09:42:04.799 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T09:42:04.799 INFO:teuthology.orchestra.run.smithi001.stdout: "f8a03d4b": { 2024-09-19T09:42:04.799 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 14, 2024-09-19T09:42:04.799 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T09:42:04.799 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:42:04.799 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T09:42:04.799 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:42:04.799 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:42:04.799 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T09:42:04.800 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 136.6, 2024-09-19T09:42:04.800 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T09:42:04.800 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T09:42:04.800 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T09:42:04.800 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:42:04.800 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T09:42:04.800 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:42:04.800 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:42:04.800 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:42:04.800 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:42:04.800 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:42:04.800 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:42:04.800 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:42:04.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:04.795+0000 7f54752f8640 1 -- 172.21.15.1:0/2829009150 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f54580a3700 msgr2=0x7f54580a5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:04.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:04.795+0000 7f54752f8640 1 --2- 172.21.15.1:0/2829009150 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f54580a3700 0x7f54580a5bc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f54600058c0 tx=0x7f546002e340 comp rx=0 tx=0).stop 2024-09-19T09:42:04.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:04.795+0000 7f54752f8640 1 -- 172.21.15.1:0/2829009150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5470102ef0 msgr2=0x7f547010f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:04.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:04.795+0000 7f54752f8640 1 --2- 172.21.15.1:0/2829009150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5470102ef0 0x7f547010f7a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f546400e970 tx=0x7f546400ed70 comp rx=0 tx=0).stop 2024-09-19T09:42:04.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:04.795+0000 7f54752f8640 1 -- 172.21.15.1:0/2829009150 shutdown_connections 2024-09-19T09:42:04.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:04.795+0000 7f54752f8640 1 --2- 172.21.15.1:0/2829009150 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f54580a3700 0x7f54580a5bc0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:04.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:04.796+0000 7f54752f8640 1 --2- 172.21.15.1:0/2829009150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5470102ef0 0x7f547010f7a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:04.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:04.796+0000 7f54752f8640 1 --2- 172.21.15.1:0/2829009150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5470102570 0x7f5470116c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:04.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:04.796+0000 7f54752f8640 1 --2- 172.21.15.1:0/2829009150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5470100e20 0x7f5470116710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:04.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:04.796+0000 7f54752f8640 1 -- 172.21.15.1:0/2829009150 >> 172.21.15.1:0/2829009150 conn(0x7f54700fc7d0 msgr2=0x7f5470104700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:04.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:04.796+0000 7f54752f8640 1 -- 172.21.15.1:0/2829009150 shutdown_connections 2024-09-19T09:42:04.802 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:04.796+0000 7f54752f8640 1 -- 172.21.15.1:0/2829009150 wait complete. 2024-09-19T09:42:05.697 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:42:05.698 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:42:06.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:06 smithi001 ceph-mon[31225]: pgmap v458: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 62 MiB/s wr, 13.46k op/s 2024-09-19T09:42:06.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:06 smithi022 ceph-mon[35583]: pgmap v458: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 62 MiB/s wr, 13.46k op/s 2024-09-19T09:42:06.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:06 smithi121 ceph-mon[35577]: pgmap v458: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 62 MiB/s wr, 13.46k op/s 2024-09-19T09:42:08.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:08 smithi001 ceph-mon[31225]: pgmap v459: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 MiB/s wr, 11.88k op/s 2024-09-19T09:42:08.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:08 smithi022 ceph-mon[35583]: pgmap v459: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 MiB/s wr, 11.88k op/s 2024-09-19T09:42:08.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:08 smithi121 ceph-mon[35577]: pgmap v459: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 MiB/s wr, 11.88k op/s 2024-09-19T09:42:10.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:10 smithi001 ceph-mon[31225]: pgmap v460: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 47 MiB/s wr, 10.46k op/s 2024-09-19T09:42:10.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:10 smithi022 ceph-mon[35583]: pgmap v460: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 47 MiB/s wr, 10.46k op/s 2024-09-19T09:42:10.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:10 smithi121 ceph-mon[35577]: pgmap v460: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 47 MiB/s wr, 10.46k op/s 2024-09-19T09:42:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.777+0000 7fe82fdc4640 1 -- 172.21.15.1:0/3051134328 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe8281016c0 msgr2=0x7fe828101b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.777+0000 7fe82fdc4640 1 --2- 172.21.15.1:0/3051134328 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe8281016c0 0x7fe828101b70 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe820009ca0 tx=0x7fe82002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.777+0000 7fe82fdc4640 1 -- 172.21.15.1:0/3051134328 shutdown_connections 2024-09-19T09:42:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.777+0000 7fe82fdc4640 1 --2- 172.21.15.1:0/3051134328 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe8281016c0 0x7fe828101b70 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.777+0000 7fe82fdc4640 1 --2- 172.21.15.1:0/3051134328 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe828100d20 0x7fe828101180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.777+0000 7fe82fdc4640 1 --2- 172.21.15.1:0/3051134328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe8281003e0 0x7fe8281007e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.777+0000 7fe82fdc4640 1 -- 172.21.15.1:0/3051134328 >> 172.21.15.1:0/3051134328 conn(0x7fe8280fc1f0 msgr2=0x7fe8280fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.777+0000 7fe82fdc4640 1 -- 172.21.15.1:0/3051134328 shutdown_connections 2024-09-19T09:42:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.777+0000 7fe82fdc4640 1 -- 172.21.15.1:0/3051134328 wait complete. 2024-09-19T09:42:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.777+0000 7fe82fdc4640 1 Processor -- start 2024-09-19T09:42:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.778+0000 7fe82fdc4640 1 -- start start 2024-09-19T09:42:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.778+0000 7fe82fdc4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8281003e0 0x7fe828199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.778+0000 7fe82fdc4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe828100d20 0x7fe82819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.778+0000 7fe82fdc4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe8281016c0 0x7fe8281a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.778+0000 7fe82fdc4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe82810f9c0 con 0x7fe828100d20 2024-09-19T09:42:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.778+0000 7fe82fdc4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe82810f840 con 0x7fe8281016c0 2024-09-19T09:42:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.778+0000 7fe82fdc4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe82810fb40 con 0x7fe8281003e0 2024-09-19T09:42:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.778+0000 7fe82d35f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe828100d20 0x7fe82819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.778+0000 7fe82d35f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe828100d20 0x7fe82819a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47706/0 (socket says 172.21.15.1:47706) 2024-09-19T09:42:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.778+0000 7fe82d35f640 1 -- 172.21.15.1:0/4083445152 learned_addr learned my addr 172.21.15.1:0/4083445152 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.778+0000 7fe82db60640 1 --2- 172.21.15.1:0/4083445152 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8281003e0 0x7fe828199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.778+0000 7fe82e361640 1 --2- 172.21.15.1:0/4083445152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe8281016c0 0x7fe8281a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.778+0000 7fe82d35f640 1 -- 172.21.15.1:0/4083445152 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8281003e0 msgr2=0x7fe828199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.778+0000 7fe82d35f640 1 --2- 172.21.15.1:0/4083445152 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8281003e0 0x7fe828199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.778+0000 7fe82d35f640 1 -- 172.21.15.1:0/4083445152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe8281016c0 msgr2=0x7fe8281a1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.778+0000 7fe82d35f640 1 --2- 172.21.15.1:0/4083445152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe8281016c0 0x7fe8281a1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.778+0000 7fe82d35f640 1 -- 172.21.15.1:0/4083445152 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8281a1bd0 con 0x7fe828100d20 2024-09-19T09:42:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.778+0000 7fe82db60640 1 --2- 172.21.15.1:0/4083445152 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8281003e0 0x7fe828199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.778+0000 7fe82e361640 1 --2- 172.21.15.1:0/4083445152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe8281016c0 0x7fe8281a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.778+0000 7fe82d35f640 1 --2- 172.21.15.1:0/4083445152 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe828100d20 0x7fe82819a4f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe81800c920 tx=0x7fe81800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.779+0000 7fe81effd640 1 -- 172.21.15.1:0/4083445152 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe818007c70 con 0x7fe828100d20 2024-09-19T09:42:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.779+0000 7fe81effd640 1 -- 172.21.15.1:0/4083445152 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe818007e10 con 0x7fe828100d20 2024-09-19T09:42:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.779+0000 7fe82fdc4640 1 -- 172.21.15.1:0/4083445152 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8281a1ec0 con 0x7fe828100d20 2024-09-19T09:42:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.779+0000 7fe81effd640 1 -- 172.21.15.1:0/4083445152 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe818018890 con 0x7fe828100d20 2024-09-19T09:42:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.779+0000 7fe82fdc4640 1 -- 172.21.15.1:0/4083445152 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8281a23d0 con 0x7fe828100d20 2024-09-19T09:42:11.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.781+0000 7fe81effd640 1 -- 172.21.15.1:0/4083445152 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fe818018a70 con 0x7fe828100d20 2024-09-19T09:42:11.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.781+0000 7fe832c38740 1 Processor -- start 2024-09-19T09:42:11.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.782+0000 7fe832c38740 1 -- start start 2024-09-19T09:42:11.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.782+0000 7fe832c38740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b044159a0 0x562b04415da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.782+0000 7fe832c38740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b044162e0 0x562b0441ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.782+0000 7fe832c38740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b0441b370 0x562b0441d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.789 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.782+0000 7fe832c38740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562b043792f0 con 0x562b044159a0 2024-09-19T09:42:11.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.782+0000 7fe832c38740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562b04321270 con 0x562b0441b370 2024-09-19T09:42:11.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.782+0000 7fe832c38740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562b043752b0 con 0x562b044162e0 2024-09-19T09:42:11.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.782+0000 7fe82e361640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b044159a0 0x562b04415da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.782+0000 7fe82e361640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b044159a0 0x562b04415da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47708/0 (socket says 172.21.15.1:47708) 2024-09-19T09:42:11.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.782+0000 7fe82e361640 1 -- 172.21.15.1:0/2934216708 learned_addr learned my addr 172.21.15.1:0/2934216708 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:11.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.782+0000 7fe82db60640 1 --2- 172.21.15.1:0/2934216708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b044162e0 0x562b0441ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.782+0000 7fe82d35f640 1 --2- 172.21.15.1:0/2934216708 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b0441b370 0x562b0441d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.782+0000 7fe81effd640 1 --2- 172.21.15.1:0/4083445152 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe8140a32c0 0x7fe8140a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.782+0000 7fe82e361640 1 -- 172.21.15.1:0/2934216708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b044162e0 msgr2=0x562b0441ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:11.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.782+0000 7fe82e361640 1 --2- 172.21.15.1:0/2934216708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b044162e0 0x562b0441ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.782+0000 7fe82e361640 1 -- 172.21.15.1:0/2934216708 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b0441b370 msgr2=0x562b0441d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:11.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.782+0000 7fe82e361640 1 --2- 172.21.15.1:0/2934216708 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b0441b370 0x562b0441d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.790 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.782+0000 7fe82e361640 1 -- 172.21.15.1:0/2934216708 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b04320340 con 0x562b044159a0 2024-09-19T09:42:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.782+0000 7fe82d35f640 1 --2- 172.21.15.1:0/2934216708 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b0441b370 0x562b0441d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.783+0000 7fe82e361640 1 --2- 172.21.15.1:0/4083445152 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe8140a32c0 0x7fe8140a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.783+0000 7fe81effd640 1 -- 172.21.15.1:0/4083445152 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fe8180cfaa0 con 0x7fe828100d20 2024-09-19T09:42:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.783+0000 7fe82e361640 1 --2- 172.21.15.1:0/2934216708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b044159a0 0x562b04415da0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe820009dc0 tx=0x7fe820009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79e2411182b488d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.783+0000 7fe813fff640 1 -- 172.21.15.1:0/2934216708 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe820004040 con 0x562b044159a0 2024-09-19T09:42:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.783+0000 7fe813fff640 1 -- 172.21.15.1:0/2934216708 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe820036070 con 0x562b044159a0 2024-09-19T09:42:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.783+0000 7fe813fff640 1 -- 172.21.15.1:0/2934216708 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe82002fa10 con 0x562b044159a0 2024-09-19T09:42:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.784+0000 7fe832c38740 1 -- 172.21.15.1:0/2934216708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b044159a0 msgr2=0x562b04415da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.784+0000 7fe82e361640 1 --2- 172.21.15.1:0/4083445152 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe8140a32c0 0x7fe8140a5780 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe820005e30 tx=0x7fe820048000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.784+0000 7fe832c38740 1 --2- 172.21.15.1:0/2934216708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b044159a0 0x562b04415da0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe820009dc0 tx=0x7fe820009800 comp rx=0 tx=0).stop 2024-09-19T09:42:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.784+0000 7fe832c38740 1 -- 172.21.15.1:0/2934216708 shutdown_connections 2024-09-19T09:42:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.784+0000 7fe832c38740 1 --2- 172.21.15.1:0/2934216708 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b0441b370 0x562b0441d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.791 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.784+0000 7fe832c38740 1 --2- 172.21.15.1:0/2934216708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b044162e0 0x562b0441ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.792 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.784+0000 7fe832c38740 1 --2- 172.21.15.1:0/2934216708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b044159a0 0x562b04415da0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.792 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.784+0000 7fe832c38740 1 -- 172.21.15.1:0/2934216708 >> 172.21.15.1:0/2934216708 conn(0x562b04411010 msgr2=0x562b04411410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:11.792 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.784+0000 7fe832c38740 1 -- 172.21.15.1:0/2934216708 shutdown_connections 2024-09-19T09:42:11.792 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.784+0000 7fe832c38740 1 -- 172.21.15.1:0/2934216708 wait complete. 2024-09-19T09:42:11.792 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.784+0000 7fe832c38740 1 -- start start 2024-09-19T09:42:11.792 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.784+0000 7fe832c38740 1 Processor -- start 2024-09-19T09:42:11.792 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.785+0000 7fe832c38740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b044159a0 0x562b0441fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.792 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.785+0000 7fe832c38740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b044162e0 0x562b0441ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.792 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.785+0000 7fe832c38740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b0441b370 0x562b04426ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.792 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.785+0000 7fe832c38740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562b0441e1c0 con 0x562b0441b370 2024-09-19T09:42:11.792 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.785+0000 7fe832c38740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562b04302290 con 0x562b044159a0 2024-09-19T09:42:11.792 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.785+0000 7fe832c38740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562b0441e340 con 0x562b044162e0 2024-09-19T09:42:11.792 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.785+0000 7fe832c38740 10 client.0 _ll_register_callbacks cb 0x562b04333140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:11.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.785+0000 7fe82e361640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b0441b370 0x562b04426ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.785+0000 7fe82e361640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b0441b370 0x562b04426ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47720/0 (socket says 172.21.15.1:47720) 2024-09-19T09:42:11.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.785+0000 7fe82e361640 1 -- 172.21.15.1:0/3007555413 learned_addr learned my addr 172.21.15.1:0/3007555413 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:11.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.785+0000 7fe82d35f640 1 --2- 172.21.15.1:0/3007555413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b044162e0 0x562b0441ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.785+0000 7fe82db60640 1 --2- 172.21.15.1:0/3007555413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b044159a0 0x562b0441fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.785+0000 7fe82e361640 1 -- 172.21.15.1:0/3007555413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b044162e0 msgr2=0x562b0441ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:11.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.785+0000 7fe82e361640 1 --2- 172.21.15.1:0/3007555413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b044162e0 0x562b0441ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.785+0000 7fe82e361640 1 -- 172.21.15.1:0/3007555413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b044159a0 msgr2=0x562b0441fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:11.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.785+0000 7fe82e361640 1 --2- 172.21.15.1:0/3007555413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b044159a0 0x562b0441fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.785+0000 7fe82e361640 1 -- 172.21.15.1:0/3007555413 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b0408c210 con 0x562b0441b370 2024-09-19T09:42:11.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.786+0000 7fe82e361640 1 --2- 172.21.15.1:0/3007555413 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b0441b370 0x562b04426ff0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe82002fa30 tx=0x7fe82002fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a46861d8f041098f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:11.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.786+0000 7fe8117fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:42:11.793 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.786+0000 7fe8117fa640 1 -- 172.21.15.1:0/3007555413 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe82002f310 con 0x562b0441b370 2024-09-19T09:42:11.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.786+0000 7fe8117fa640 1 -- 172.21.15.1:0/3007555413 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fe82004d070 con 0x562b0441b370 2024-09-19T09:42:11.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.786+0000 7fe832c38740 1 -- 172.21.15.1:0/3007555413 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe820036070 con 0x562b0441b370 2024-09-19T09:42:11.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.786+0000 7fe8117fa640 1 -- 172.21.15.1:0/3007555413 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe820004210 con 0x562b0441b370 2024-09-19T09:42:11.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.786+0000 7fe832c38740 10 client.15942 fetch_fsmap learned FSMap version 19 2024-09-19T09:42:11.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.786+0000 7fe832c38740 1 -- 172.21.15.1:0/3007555413 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x562b04158620 con 0x562b0441b370 2024-09-19T09:42:11.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.786+0000 7fe8117fa640 1 -- 172.21.15.1:0/3007555413 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe820036070 con 0x562b0441b370 2024-09-19T09:42:11.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.786+0000 7fe8117fa640 1 -- 172.21.15.1:0/3007555413 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe820030a60 con 0x562b0441b370 2024-09-19T09:42:11.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.786+0000 7fe832c38740 10 client.15942 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:42:11.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.786+0000 7fe832c38740 10 client.15942 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:11.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.786+0000 7fe832c38740 20 client.15942 populate_metadata read hostname 'smithi001' 2024-09-19T09:42:11.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.786+0000 7fe832c38740 1 --2- 172.21.15.1:0/3007555413 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x562b0442b440 0x562b0442d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.786+0000 7fe832c38740 4 client.15942 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:42:11.794 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.786+0000 7fe832c38740 1 -- 172.21.15.1:0/3007555413 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b04386a20 con 0x562b0442b440 2024-09-19T09:42:11.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.787+0000 7fe82db60640 1 --2- 172.21.15.1:0/3007555413 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x562b0442b440 0x562b0442d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.787+0000 7fe8117fa640 10 client.15942 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:11.795 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.787+0000 7fe82db60640 1 --2- 172.21.15.1:0/3007555413 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x562b0442b440 0x562b0442d830 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d88df1b5bbbb6f3b server_cookie=e04a75406f895cb3 in_seq=0 out_seq=0 2024-09-19T09:42:11.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.788+0000 7fe8117fa640 1 -- 172.21.15.1:0/3007555413 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562b04386a20 con 0x562b0442b440 2024-09-19T09:42:11.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.788+0000 7fe8117fa640 10 client.15942 handle_command_reply: tid=0 2024-09-19T09:42:11.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.788+0000 7fe832c38740 1 client.15942 shutdown 2024-09-19T09:42:11.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.788+0000 7fe832c38740 1 -- 172.21.15.1:0/3007555413 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b0441b370 msgr2=0x562b04426ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:11.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.788+0000 7fe832c38740 1 --2- 172.21.15.1:0/3007555413 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b0441b370 0x562b04426ff0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe82002fa30 tx=0x7fe82002fa60 comp rx=0 tx=0).stop 2024-09-19T09:42:11.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.788+0000 7fe832c38740 1 -- 172.21.15.1:0/3007555413 shutdown_connections 2024-09-19T09:42:11.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.788+0000 7fe832c38740 1 --2- 172.21.15.1:0/3007555413 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x562b0442b440 0x562b0442d830 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.788+0000 7fe832c38740 1 --2- 172.21.15.1:0/3007555413 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b0441b370 0x562b04426ff0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.788+0000 7fe832c38740 1 --2- 172.21.15.1:0/3007555413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b044162e0 0x562b0441ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.796 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.788+0000 7fe832c38740 1 --2- 172.21.15.1:0/3007555413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b044159a0 0x562b0441fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.788+0000 7fe8117fa640 0 client.15942 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:11.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.788+0000 7fe832c38740 1 -- 172.21.15.1:0/3007555413 >> 172.21.15.1:0/3007555413 conn(0x562b04411010 msgr2=0x562b04412820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:11.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.788+0000 7fe832c38740 1 -- 172.21.15.1:0/3007555413 shutdown_connections 2024-09-19T09:42:11.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.788+0000 7fe832c38740 1 -- 172.21.15.1:0/3007555413 wait complete. 2024-09-19T09:42:11.797 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.789+0000 7fe832c38740 20 client.15942 trim_cache size 0 max 16384 2024-09-19T09:42:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.803+0000 7fe832c38740 1 Processor -- start 2024-09-19T09:42:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.803+0000 7fe832c38740 1 -- start start 2024-09-19T09:42:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.803+0000 7fe832c38740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b044159a0 0x562b04411ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.803+0000 7fe832c38740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b044162e0 0x562b04426fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.803+0000 7fe832c38740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b0441b370 0x562b04412400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.803+0000 7fe832c38740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe8281a9140 con 0x562b044162e0 2024-09-19T09:42:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.803+0000 7fe832c38740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe8281ab9e0 con 0x562b044159a0 2024-09-19T09:42:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.803+0000 7fe832c38740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe8281a97d0 con 0x562b0441b370 2024-09-19T09:42:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.803+0000 7fe82d35f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b044162e0 0x562b04426fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.803+0000 7fe82d35f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b044162e0 0x562b04426fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47728/0 (socket says 172.21.15.1:47728) 2024-09-19T09:42:11.807 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.804+0000 7fe82d35f640 1 -- 172.21.15.1:0/1797143036 learned_addr learned my addr 172.21.15.1:0/1797143036 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.804+0000 7fe82e361640 1 --2- 172.21.15.1:0/1797143036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b0441b370 0x562b04412400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.804+0000 7fe82db60640 1 --2- 172.21.15.1:0/1797143036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b044159a0 0x562b04411ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.804+0000 7fe82d35f640 1 -- 172.21.15.1:0/1797143036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b0441b370 msgr2=0x562b04412400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.804+0000 7fe82d35f640 1 --2- 172.21.15.1:0/1797143036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b0441b370 0x562b04412400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.804+0000 7fe82d35f640 1 -- 172.21.15.1:0/1797143036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b044159a0 msgr2=0x562b04411ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.804+0000 7fe82d35f640 1 --2- 172.21.15.1:0/1797143036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b044159a0 0x562b04411ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.804+0000 7fe82d35f640 1 -- 172.21.15.1:0/1797143036 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b0440c2d0 con 0x562b044162e0 2024-09-19T09:42:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.804+0000 7fe82d35f640 1 --2- 172.21.15.1:0/1797143036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b044162e0 0x562b04426fb0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe81800cfd0 tx=0x7fe818000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f88da3ce53d111a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.804+0000 7fe8137fe640 1 -- 172.21.15.1:0/1797143036 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8180a0430 con 0x562b044162e0 2024-09-19T09:42:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.804+0000 7fe8137fe640 1 -- 172.21.15.1:0/1797143036 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8180a4cf0 con 0x562b044162e0 2024-09-19T09:42:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.804+0000 7fe8137fe640 1 -- 172.21.15.1:0/1797143036 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8180a4860 con 0x562b044162e0 2024-09-19T09:42:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.805+0000 7fe832c38740 1 -- 172.21.15.1:0/1797143036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b044162e0 msgr2=0x562b04426fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.805+0000 7fe832c38740 1 --2- 172.21.15.1:0/1797143036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b044162e0 0x562b04426fb0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe81800cfd0 tx=0x7fe818000bc0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.805+0000 7fe832c38740 1 -- 172.21.15.1:0/1797143036 shutdown_connections 2024-09-19T09:42:11.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.805+0000 7fe832c38740 1 --2- 172.21.15.1:0/1797143036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b0441b370 0x562b04412400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.805+0000 7fe832c38740 1 --2- 172.21.15.1:0/1797143036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b044162e0 0x562b04426fb0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.805+0000 7fe832c38740 1 --2- 172.21.15.1:0/1797143036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b044159a0 0x562b04411ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.805+0000 7fe832c38740 1 -- 172.21.15.1:0/1797143036 >> 172.21.15.1:0/1797143036 conn(0x562b04411010 msgr2=0x562b0441fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:11.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.805+0000 7fe832c38740 1 -- 172.21.15.1:0/1797143036 shutdown_connections 2024-09-19T09:42:11.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.805+0000 7fe832c38740 1 -- 172.21.15.1:0/1797143036 wait complete. 2024-09-19T09:42:11.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.805+0000 7fe832c38740 1 -- start start 2024-09-19T09:42:11.809 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.805+0000 7fe832c38740 1 Processor -- start 2024-09-19T09:42:11.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.805+0000 7fe832c38740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b044159a0 0x562b044242a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.806+0000 7fe832c38740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b044162e0 0x562b044247e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.806+0000 7fe832c38740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b0441b370 0x562b044257a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.806+0000 7fe832c38740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe8281a9ea0 con 0x562b044159a0 2024-09-19T09:42:11.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.806+0000 7fe832c38740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe8281ab310 con 0x562b044162e0 2024-09-19T09:42:11.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.806+0000 7fe832c38740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe8281aa570 con 0x562b0441b370 2024-09-19T09:42:11.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.806+0000 7fe832c38740 10 client.0 _ll_register_callbacks cb 0x7fe82004a020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:11.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.806+0000 7fe82db60640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b044159a0 0x562b044242a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.812 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.806+0000 7fe82db60640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b044159a0 0x562b044242a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47734/0 (socket says 172.21.15.1:47734) 2024-09-19T09:42:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.806+0000 7fe82db60640 1 -- 172.21.15.1:0/422122711 learned_addr learned my addr 172.21.15.1:0/422122711 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.806+0000 7fe82e361640 1 --2- 172.21.15.1:0/422122711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b0441b370 0x562b044257a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.806+0000 7fe82d35f640 1 --2- 172.21.15.1:0/422122711 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b044162e0 0x562b044247e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.806+0000 7fe82db60640 1 -- 172.21.15.1:0/422122711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b0441b370 msgr2=0x562b044257a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.806+0000 7fe82db60640 1 --2- 172.21.15.1:0/422122711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b0441b370 0x562b044257a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.806+0000 7fe82db60640 1 -- 172.21.15.1:0/422122711 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b044162e0 msgr2=0x562b044247e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.806+0000 7fe82db60640 1 --2- 172.21.15.1:0/422122711 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b044162e0 0x562b044247e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.806+0000 7fe82db60640 1 -- 172.21.15.1:0/422122711 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b04425db0 con 0x562b044159a0 2024-09-19T09:42:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.806+0000 7fe82e361640 1 --2- 172.21.15.1:0/422122711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b0441b370 0x562b044257a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.806+0000 7fe82d35f640 1 --2- 172.21.15.1:0/422122711 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b044162e0 0x562b044247e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.806+0000 7fe82db60640 1 --2- 172.21.15.1:0/422122711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b044159a0 0x562b044242a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x562b04411e90 tx=0x7fe824009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c8abdc1bf36859a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.806+0000 7fe8117fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:42:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.806+0000 7fe8117fa640 1 -- 172.21.15.1:0/422122711 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe82401e620 con 0x562b044159a0 2024-09-19T09:42:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.806+0000 7fe832c38740 1 -- 172.21.15.1:0/422122711 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8180a4cf0 con 0x562b044159a0 2024-09-19T09:42:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.806+0000 7fe8117fa640 1 -- 172.21.15.1:0/422122711 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fe82401e7c0 con 0x562b044159a0 2024-09-19T09:42:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.807+0000 7fe8117fa640 1 -- 172.21.15.1:0/422122711 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe824003e50 con 0x562b044159a0 2024-09-19T09:42:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.807+0000 7fe832c38740 10 client.15948 fetch_fsmap learned FSMap version 19 2024-09-19T09:42:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.807+0000 7fe832c38740 1 -- 172.21.15.1:0/422122711 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x562b04427190 con 0x562b044159a0 2024-09-19T09:42:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.807+0000 7fe8117fa640 1 -- 172.21.15.1:0/422122711 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8180a4cf0 con 0x562b044159a0 2024-09-19T09:42:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.807+0000 7fe8117fa640 1 -- 172.21.15.1:0/422122711 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe824027400 con 0x562b044159a0 2024-09-19T09:42:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.807+0000 7fe832c38740 10 client.15948 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:42:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.807+0000 7fe832c38740 10 client.15948 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.807+0000 7fe832c38740 20 client.15948 populate_metadata read hostname 'smithi001' 2024-09-19T09:42:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.807+0000 7fe832c38740 1 --2- 172.21.15.1:0/422122711 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x562b04496790 0x562b04498bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.807+0000 7fe832c38740 4 client.15948 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:42:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.807+0000 7fe832c38740 1 -- 172.21.15.1:0/422122711 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562b04380d70 con 0x562b04496790 2024-09-19T09:42:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.807+0000 7fe82d35f640 1 --2- 172.21.15.1:0/422122711 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x562b04496790 0x562b04498bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:11.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.808+0000 7fe8117fa640 10 client.15948 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:11.815 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.808+0000 7fe82d35f640 1 --2- 172.21.15.1:0/422122711 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x562b04496790 0x562b04498bb0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fff675a89b77568b server_cookie=34104b316330c983 in_seq=0 out_seq=0 2024-09-19T09:42:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.833+0000 7fe8117fa640 1 -- 172.21.15.1:0/422122711 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fe8180b4040 con 0x562b04496790 2024-09-19T09:42:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.833+0000 7fe8117fa640 10 client.15948 handle_command_reply: tid=0 2024-09-19T09:42:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.833+0000 7fe832c38740 1 client.15948 shutdown 2024-09-19T09:42:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.834+0000 7fe832c38740 1 -- 172.21.15.1:0/422122711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b044159a0 msgr2=0x562b044242a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.834+0000 7fe832c38740 1 --2- 172.21.15.1:0/422122711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b044159a0 0x562b044242a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x562b04411e90 tx=0x7fe824009e30 comp rx=0 tx=0).stop 2024-09-19T09:42:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.834+0000 7fe832c38740 1 -- 172.21.15.1:0/422122711 shutdown_connections 2024-09-19T09:42:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.834+0000 7fe832c38740 1 --2- 172.21.15.1:0/422122711 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x562b04496790 0x562b04498bb0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.834+0000 7fe832c38740 1 --2- 172.21.15.1:0/422122711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b0441b370 0x562b044257a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.834+0000 7fe832c38740 1 --2- 172.21.15.1:0/422122711 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562b044162e0 0x562b044247e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.834+0000 7fe8117fa640 0 client.15948 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:11.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.834+0000 7fe832c38740 1 --2- 172.21.15.1:0/422122711 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562b044159a0 0x562b044242a0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.834+0000 7fe832c38740 1 -- 172.21.15.1:0/422122711 >> 172.21.15.1:0/422122711 conn(0x562b04411010 msgr2=0x562b0440f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:11.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.834+0000 7fe832c38740 1 -- 172.21.15.1:0/422122711 shutdown_connections 2024-09-19T09:42:11.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.834+0000 7fe832c38740 1 -- 172.21.15.1:0/422122711 wait complete. 2024-09-19T09:42:11.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.834+0000 7fe832c38740 20 client.15948 trim_cache size 0 max 16384 2024-09-19T09:42:11.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:42:11.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:42:11.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:42:11.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:42:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.834+0000 7fe82fdc4640 1 -- 172.21.15.1:0/4083445152 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe8140a32c0 msgr2=0x7fe8140a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.835+0000 7fe82fdc4640 1 --2- 172.21.15.1:0/4083445152 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe8140a32c0 0x7fe8140a5780 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe820005e30 tx=0x7fe820048000 comp rx=0 tx=0).stop 2024-09-19T09:42:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.835+0000 7fe82fdc4640 1 -- 172.21.15.1:0/4083445152 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe828100d20 msgr2=0x7fe82819a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.835+0000 7fe82fdc4640 1 --2- 172.21.15.1:0/4083445152 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe828100d20 0x7fe82819a4f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe81800c920 tx=0x7fe81800cde0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.835+0000 7fe82fdc4640 1 -- 172.21.15.1:0/4083445152 shutdown_connections 2024-09-19T09:42:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.835+0000 7fe82fdc4640 1 --2- 172.21.15.1:0/4083445152 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe8140a32c0 0x7fe8140a5780 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.838 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.835+0000 7fe82fdc4640 1 --2- 172.21.15.1:0/4083445152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe8281016c0 0x7fe8281a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.835+0000 7fe82fdc4640 1 --2- 172.21.15.1:0/4083445152 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe828100d20 0x7fe82819a4f0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.835+0000 7fe82fdc4640 1 --2- 172.21.15.1:0/4083445152 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe8281003e0 0x7fe828199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:11.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.835+0000 7fe82fdc4640 1 -- 172.21.15.1:0/4083445152 >> 172.21.15.1:0/4083445152 conn(0x7fe8280fc1f0 msgr2=0x7fe8280fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:11.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.835+0000 7fe82fdc4640 1 -- 172.21.15.1:0/4083445152 shutdown_connections 2024-09-19T09:42:11.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:11.835+0000 7fe82fdc4640 1 -- 172.21.15.1:0/4083445152 wait complete. 2024-09-19T09:42:12.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:12 smithi001 ceph-mon[31225]: pgmap v461: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 40 MiB/s wr, 8.94k op/s 2024-09-19T09:42:12.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:12 smithi022 ceph-mon[35583]: pgmap v461: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 40 MiB/s wr, 8.94k op/s 2024-09-19T09:42:12.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:12 smithi121 ceph-mon[35577]: pgmap v461: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 40 MiB/s wr, 8.94k op/s 2024-09-19T09:42:14.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:14 smithi001 ceph-mon[31225]: pgmap v462: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 MiB/s wr, 7.39k op/s 2024-09-19T09:42:14.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:14 smithi022 ceph-mon[35583]: pgmap v462: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 MiB/s wr, 7.39k op/s 2024-09-19T09:42:14.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:14 smithi121 ceph-mon[35577]: pgmap v462: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 MiB/s wr, 7.39k op/s 2024-09-19T09:42:14.654 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f8a03d4b', quiesce took 52.7 seconds. Will release after: -36.1 2024-09-19T09:42:14.655 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:42:14.708 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:42:16.330 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:16 smithi001 ceph-mon[31225]: pgmap v463: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 17 MiB/s wr, 3.92k op/s 2024-09-19T09:42:16.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:16 smithi022 ceph-mon[35583]: pgmap v463: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 17 MiB/s wr, 3.92k op/s 2024-09-19T09:42:16.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:16 smithi121 ceph-mon[35577]: pgmap v463: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 17 MiB/s wr, 3.92k op/s 2024-09-19T09:42:18.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:18 smithi001 ceph-mon[31225]: pgmap v464: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 11 MiB/s wr, 2.51k op/s 2024-09-19T09:42:18.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:18 smithi022 ceph-mon[35583]: pgmap v464: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 11 MiB/s wr, 2.51k op/s 2024-09-19T09:42:18.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:18 smithi121 ceph-mon[35577]: pgmap v464: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 11 MiB/s wr, 2.51k op/s 2024-09-19T09:42:19.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:19 smithi001 ceph-mon[31225]: scrub queued for path: / 2024-09-19T09:42:19.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:19 smithi001 ceph-mon[31225]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:19.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:19 smithi001 ceph-mon[31225]: scrub summary: active paths [/] 2024-09-19T09:42:19.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:19 smithi001 ceph-mon[31225]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:19.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:19 smithi022 ceph-mon[35583]: scrub queued for path: / 2024-09-19T09:42:19.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:19 smithi022 ceph-mon[35583]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:19.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:19 smithi022 ceph-mon[35583]: scrub summary: active paths [/] 2024-09-19T09:42:19.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:19 smithi022 ceph-mon[35583]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:19.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:19 smithi121 ceph-mon[35577]: scrub queued for path: / 2024-09-19T09:42:19.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:19 smithi121 ceph-mon[35577]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:19.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:19 smithi121 ceph-mon[35577]: scrub summary: active paths [/] 2024-09-19T09:42:19.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:19 smithi121 ceph-mon[35577]: scrub summary: idle+waiting paths [/] 2024-09-19T09:42:20.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.906+0000 7f92f8ef3640 1 -- 172.21.15.1:0/444805437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92f4102570 msgr2=0x7f92f41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:20.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.906+0000 7f92f8ef3640 1 --2- 172.21.15.1:0/444805437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92f4102570 0x7f92f41029b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f92dc009900 tx=0x7f92dc02a480 comp rx=0 tx=0).stop 2024-09-19T09:42:20.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.906+0000 7f92f8ef3640 1 -- 172.21.15.1:0/444805437 shutdown_connections 2024-09-19T09:42:20.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.906+0000 7f92f8ef3640 1 --2- 172.21.15.1:0/444805437 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92f4102ef0 0x7f92f410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.906+0000 7f92f8ef3640 1 --2- 172.21.15.1:0/444805437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92f4102570 0x7f92f41029b0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.906+0000 7f92f8ef3640 1 --2- 172.21.15.1:0/444805437 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92f4100e20 0x7f92f4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.906+0000 7f92f8ef3640 1 -- 172.21.15.1:0/444805437 >> 172.21.15.1:0/444805437 conn(0x7f92f40fc7d0 msgr2=0x7f92f40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:20.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.907+0000 7f92f8ef3640 1 -- 172.21.15.1:0/444805437 shutdown_connections 2024-09-19T09:42:20.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.907+0000 7f92f8ef3640 1 -- 172.21.15.1:0/444805437 wait complete. 2024-09-19T09:42:20.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.907+0000 7f92f8ef3640 1 Processor -- start 2024-09-19T09:42:20.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.907+0000 7f92f8ef3640 1 -- start start 2024-09-19T09:42:20.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.908+0000 7f92f8ef3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92f4100e20 0x7f92f4199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:20.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.908+0000 7f92f8ef3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92f4102570 0x7f92f4199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:20.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.908+0000 7f92f8ef3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92f4102ef0 0x7f92f41a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:20.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.908+0000 7f92f8ef3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f92f4110f80 con 0x7f92f4100e20 2024-09-19T09:42:20.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.908+0000 7f92f8ef3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f92f4110e00 con 0x7f92f4102570 2024-09-19T09:42:20.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.908+0000 7f92f8ef3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f92f4111100 con 0x7f92f4102ef0 2024-09-19T09:42:20.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.908+0000 7f92f259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92f4100e20 0x7f92f4199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:20.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.908+0000 7f92f259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92f4100e20 0x7f92f4199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49440/0 (socket says 172.21.15.1:49440) 2024-09-19T09:42:20.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.908+0000 7f92ebfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92f4102570 0x7f92f4199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:20.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.908+0000 7f92f259c640 1 -- 172.21.15.1:0/992570762 learned_addr learned my addr 172.21.15.1:0/992570762 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:20.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.908+0000 7f92f2d9d640 1 --2- 172.21.15.1:0/992570762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92f4102ef0 0x7f92f41a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:20.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.908+0000 7f92f259c640 1 -- 172.21.15.1:0/992570762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92f4102ef0 msgr2=0x7f92f41a4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:20.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.908+0000 7f92f259c640 1 --2- 172.21.15.1:0/992570762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92f4102ef0 0x7f92f41a4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.908+0000 7f92f259c640 1 -- 172.21.15.1:0/992570762 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92f4102570 msgr2=0x7f92f4199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:20.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.908+0000 7f92f259c640 1 --2- 172.21.15.1:0/992570762 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92f4102570 0x7f92f4199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.908+0000 7f92f259c640 1 -- 172.21.15.1:0/992570762 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f41a48d0 con 0x7f92f4100e20 2024-09-19T09:42:20.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.908+0000 7f92ebfff640 1 --2- 172.21.15.1:0/992570762 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92f4102570 0x7f92f4199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:20.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.908+0000 7f92f259c640 1 --2- 172.21.15.1:0/992570762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92f4100e20 0x7f92f4199310 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f92e400e9f0 tx=0x7f92e400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:20.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.909+0000 7f92eb7fe640 1 -- 172.21.15.1:0/992570762 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e400cd80 con 0x7f92f4100e20 2024-09-19T09:42:20.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.909+0000 7f92eb7fe640 1 -- 172.21.15.1:0/992570762 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92e4010910 con 0x7f92f4100e20 2024-09-19T09:42:20.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.909+0000 7f92eb7fe640 1 -- 172.21.15.1:0/992570762 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e4018990 con 0x7f92f4100e20 2024-09-19T09:42:20.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.909+0000 7f92f8ef3640 1 -- 172.21.15.1:0/992570762 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92f41a4aa0 con 0x7f92f4100e20 2024-09-19T09:42:20.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.909+0000 7f92f8ef3640 1 -- 172.21.15.1:0/992570762 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92f41a4fb0 con 0x7f92f4100e20 2024-09-19T09:42:20.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.911+0000 7f92eb7fe640 1 -- 172.21.15.1:0/992570762 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f92e4010ac0 con 0x7f92f4100e20 2024-09-19T09:42:20.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.911+0000 7f92fb2cc740 1 Processor -- start 2024-09-19T09:42:20.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.912+0000 7f92fb2cc740 1 -- start start 2024-09-19T09:42:20.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.912+0000 7f92fb2cc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0ba678a20 0x55b0ba678e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:20.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.912+0000 7f92fb2cc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0ba679340 0x55b0ba687c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:20.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.912+0000 7f92fb2cc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0ba688150 0x55b0ba68a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:20.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.912+0000 7f92fb2cc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b0ba5de280 con 0x55b0ba678a20 2024-09-19T09:42:20.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.912+0000 7f92fb2cc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b0ba585b10 con 0x55b0ba688150 2024-09-19T09:42:20.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.912+0000 7f92fb2cc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b0ba5da240 con 0x55b0ba679340 2024-09-19T09:42:20.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.912+0000 7f92f2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0ba678a20 0x55b0ba678e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:20.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.912+0000 7f92f2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0ba678a20 0x55b0ba678e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49446/0 (socket says 172.21.15.1:49446) 2024-09-19T09:42:20.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.912+0000 7f92f2d9d640 1 -- 172.21.15.1:0/2565402319 learned_addr learned my addr 172.21.15.1:0/2565402319 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:20.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.912+0000 7f92f259c640 1 --2- 172.21.15.1:0/2565402319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0ba679340 0x55b0ba687c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:20.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.912+0000 7f92ebfff640 1 --2- 172.21.15.1:0/2565402319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0ba688150 0x55b0ba68a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:20.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.912+0000 7f92f2d9d640 1 -- 172.21.15.1:0/2565402319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0ba679340 msgr2=0x55b0ba687c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:20.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.912+0000 7f92f2d9d640 1 --2- 172.21.15.1:0/2565402319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0ba679340 0x55b0ba687c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.912+0000 7f92f2d9d640 1 -- 172.21.15.1:0/2565402319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0ba688150 msgr2=0x55b0ba68a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:20.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.912+0000 7f92f2d9d640 1 --2- 172.21.15.1:0/2565402319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0ba688150 0x55b0ba68a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.912+0000 7f92eb7fe640 1 --2- 172.21.15.1:0/992570762 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f92e00a3240 0x7f92e00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:20.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.912+0000 7f92f2d9d640 1 -- 172.21.15.1:0/2565402319 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0ba5921f0 con 0x55b0ba678a20 2024-09-19T09:42:20.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.913+0000 7f92f2d9d640 1 --2- 172.21.15.1:0/2565402319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0ba678a20 0x55b0ba678e00 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f92ec009f70 tx=0x7f92ec010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c41e5e6fbb1db463 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:20.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.913+0000 7f92eb7fe640 1 -- 172.21.15.1:0/992570762 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f92e40cfc60 con 0x7f92f4100e20 2024-09-19T09:42:20.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.913+0000 7f92f259c640 1 --2- 172.21.15.1:0/992570762 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f92e00a3240 0x7f92e00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:20.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.913+0000 7f92e8ff9640 1 -- 172.21.15.1:0/2565402319 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ec016070 con 0x55b0ba678a20 2024-09-19T09:42:20.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.913+0000 7f92e8ff9640 1 -- 172.21.15.1:0/2565402319 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92ec004d20 con 0x55b0ba678a20 2024-09-19T09:42:20.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.913+0000 7f92e8ff9640 1 -- 172.21.15.1:0/2565402319 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ec012850 con 0x55b0ba678a20 2024-09-19T09:42:20.038 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.914+0000 7f92fb2cc740 1 -- 172.21.15.1:0/2565402319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0ba678a20 msgr2=0x55b0ba678e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:20.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.914+0000 7f92f259c640 1 --2- 172.21.15.1:0/992570762 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f92e00a3240 0x7f92e00a5700 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f92e409c280 tx=0x7f92e4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:20.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.914+0000 7f92fb2cc740 1 --2- 172.21.15.1:0/2565402319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0ba678a20 0x55b0ba678e00 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f92ec009f70 tx=0x7f92ec010800 comp rx=0 tx=0).stop 2024-09-19T09:42:20.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.914+0000 7f92fb2cc740 1 -- 172.21.15.1:0/2565402319 shutdown_connections 2024-09-19T09:42:20.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.914+0000 7f92fb2cc740 1 --2- 172.21.15.1:0/2565402319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0ba688150 0x55b0ba68a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.914+0000 7f92fb2cc740 1 --2- 172.21.15.1:0/2565402319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0ba679340 0x55b0ba687c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.914+0000 7f92fb2cc740 1 --2- 172.21.15.1:0/2565402319 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0ba678a20 0x55b0ba678e00 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.914+0000 7f92fb2cc740 1 -- 172.21.15.1:0/2565402319 >> 172.21.15.1:0/2565402319 conn(0x55b0ba6750f0 msgr2=0x55b0ba6754d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:20.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.914+0000 7f92fb2cc740 1 -- 172.21.15.1:0/2565402319 shutdown_connections 2024-09-19T09:42:20.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.914+0000 7f92fb2cc740 1 -- 172.21.15.1:0/2565402319 wait complete. 2024-09-19T09:42:20.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.914+0000 7f92fb2cc740 1 -- start start 2024-09-19T09:42:20.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.914+0000 7f92fb2cc740 1 Processor -- start 2024-09-19T09:42:20.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.915+0000 7f92fb2cc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0ba678a20 0x55b0ba685070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:20.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.915+0000 7f92fb2cc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0ba679340 0x55b0ba6855b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:20.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.915+0000 7f92fb2cc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0ba688150 0x55b0ba685af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:20.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.915+0000 7f92fb2cc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b0ba68ad20 con 0x55b0ba678a20 2024-09-19T09:42:20.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.915+0000 7f92fb2cc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b0ba598f10 con 0x55b0ba679340 2024-09-19T09:42:20.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.915+0000 7f92fb2cc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b0ba68aea0 con 0x55b0ba688150 2024-09-19T09:42:20.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.915+0000 7f92fb2cc740 10 client.0 _ll_register_callbacks cb 0x55b0ba561a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:20.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.915+0000 7f92f2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0ba678a20 0x55b0ba685070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:20.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.915+0000 7f92f2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0ba678a20 0x55b0ba685070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49462/0 (socket says 172.21.15.1:49462) 2024-09-19T09:42:20.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.915+0000 7f92f2d9d640 1 -- 172.21.15.1:0/176661851 learned_addr learned my addr 172.21.15.1:0/176661851 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:20.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.915+0000 7f92ebfff640 1 --2- 172.21.15.1:0/176661851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0ba679340 0x55b0ba6855b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:20.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.915+0000 7f92f2d9d640 1 --2- 172.21.15.1:0/176661851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0ba688150 0x55b0ba685af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:20.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.915+0000 7f92f2d9d640 1 -- 172.21.15.1:0/176661851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0ba688150 msgr2=0x55b0ba685af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:20.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.915+0000 7f92f2d9d640 1 --2- 172.21.15.1:0/176661851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0ba688150 0x55b0ba685af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.915+0000 7f92f2d9d640 1 -- 172.21.15.1:0/176661851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0ba679340 msgr2=0x55b0ba6855b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:20.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.915+0000 7f92f2d9d640 1 --2- 172.21.15.1:0/176661851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0ba679340 0x55b0ba6855b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.915+0000 7f92f2d9d640 1 -- 172.21.15.1:0/176661851 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0ba34f6a0 con 0x55b0ba678a20 2024-09-19T09:42:20.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.916+0000 7f92f2d9d640 1 --2- 172.21.15.1:0/176661851 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0ba678a20 0x55b0ba685070 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f92ec011010 tx=0x7f92ec005950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdcda52c38faa64f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:20.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.916+0000 7f92d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:42:20.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.916+0000 7f92d9ffb640 1 -- 172.21.15.1:0/176661851 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ec016070 con 0x55b0ba678a20 2024-09-19T09:42:20.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.916+0000 7f92d9ffb640 1 -- 172.21.15.1:0/176661851 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f92ec004ed0 con 0x55b0ba678a20 2024-09-19T09:42:20.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.916+0000 7f92fb2cc740 1 -- 172.21.15.1:0/176661851 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92ec004d20 con 0x55b0ba678a20 2024-09-19T09:42:20.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.916+0000 7f92d9ffb640 1 -- 172.21.15.1:0/176661851 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f92ec030050 con 0x55b0ba678a20 2024-09-19T09:42:20.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.916+0000 7f92fb2cc740 10 client.15960 fetch_fsmap learned FSMap version 19 2024-09-19T09:42:20.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.916+0000 7f92fb2cc740 1 -- 172.21.15.1:0/176661851 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55b0ba6969a0 con 0x55b0ba678a20 2024-09-19T09:42:20.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.916+0000 7f92d9ffb640 1 -- 172.21.15.1:0/176661851 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92ec004d20 con 0x55b0ba678a20 2024-09-19T09:42:20.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.916+0000 7f92d9ffb640 1 -- 172.21.15.1:0/176661851 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f92ec028020 con 0x55b0ba678a20 2024-09-19T09:42:20.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.916+0000 7f92fb2cc740 10 client.15960 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:42:20.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.916+0000 7f92fb2cc740 10 client.15960 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:20.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.916+0000 7f92fb2cc740 20 client.15960 populate_metadata read hostname 'smithi001' 2024-09-19T09:42:20.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.916+0000 7f92fb2cc740 1 --2- 172.21.15.1:0/176661851 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b0ba697e00 0x55b0ba69a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:20.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.916+0000 7f92fb2cc740 4 client.15960 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:42:20.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.916+0000 7f92fb2cc740 1 -- 172.21.15.1:0/176661851 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0ba5eb7f0 con 0x55b0ba697e00 2024-09-19T09:42:20.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.917+0000 7f92ebfff640 1 --2- 172.21.15.1:0/176661851 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b0ba697e00 0x55b0ba69a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:20.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.917+0000 7f92ebfff640 1 --2- 172.21.15.1:0/176661851 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b0ba697e00 0x55b0ba69a1f0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d2953519398c0c server_cookie=6ea9f8c0f78d6d in_seq=0 out_seq=0 2024-09-19T09:42:20.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.917+0000 7f92d9ffb640 10 client.15960 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:20.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.918+0000 7f92d9ffb640 1 -- 172.21.15.1:0/176661851 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b0ba5eb7f0 con 0x55b0ba697e00 2024-09-19T09:42:20.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.918+0000 7f92d9ffb640 10 client.15960 handle_command_reply: tid=0 2024-09-19T09:42:20.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.918+0000 7f92fb2cc740 1 client.15960 shutdown 2024-09-19T09:42:20.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.918+0000 7f92fb2cc740 1 -- 172.21.15.1:0/176661851 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0ba678a20 msgr2=0x55b0ba685070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:20.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.918+0000 7f92fb2cc740 1 --2- 172.21.15.1:0/176661851 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0ba678a20 0x55b0ba685070 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f92ec011010 tx=0x7f92ec005950 comp rx=0 tx=0).stop 2024-09-19T09:42:20.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.918+0000 7f92fb2cc740 1 -- 172.21.15.1:0/176661851 shutdown_connections 2024-09-19T09:42:20.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.918+0000 7f92fb2cc740 1 --2- 172.21.15.1:0/176661851 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b0ba697e00 0x55b0ba69a1f0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.918+0000 7f92d9ffb640 0 client.15960 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:20.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.918+0000 7f92fb2cc740 1 --2- 172.21.15.1:0/176661851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0ba688150 0x55b0ba685af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.918+0000 7f92fb2cc740 1 --2- 172.21.15.1:0/176661851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0ba679340 0x55b0ba6855b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.918+0000 7f92fb2cc740 1 --2- 172.21.15.1:0/176661851 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0ba678a20 0x55b0ba685070 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.918+0000 7f92fb2cc740 1 -- 172.21.15.1:0/176661851 >> 172.21.15.1:0/176661851 conn(0x55b0ba6750f0 msgr2=0x55b0ba67ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:20.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.918+0000 7f92fb2cc740 1 -- 172.21.15.1:0/176661851 shutdown_connections 2024-09-19T09:42:20.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.918+0000 7f92fb2cc740 1 -- 172.21.15.1:0/176661851 wait complete. 2024-09-19T09:42:20.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.918+0000 7f92fb2cc740 20 client.15960 trim_cache size 0 max 16384 2024-09-19T09:42:20.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.935+0000 7f92fb2cc740 1 Processor -- start 2024-09-19T09:42:20.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.935+0000 7f92fb2cc740 1 -- start start 2024-09-19T09:42:20.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.936+0000 7f92fb2cc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0ba678a20 0x55b0ba674160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:20.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.936+0000 7f92fb2cc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0ba679340 0x55b0ba69f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:20.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.936+0000 7f92fb2cc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0ba688150 0x55b0ba69fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:20.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.936+0000 7f92fb2cc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f92f41a93f0 con 0x55b0ba678a20 2024-09-19T09:42:20.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.936+0000 7f92fb2cc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f92f41abc90 con 0x55b0ba688150 2024-09-19T09:42:20.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.936+0000 7f92fb2cc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f92f41a9a80 con 0x55b0ba679340 2024-09-19T09:42:20.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.936+0000 7f92f2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0ba678a20 0x55b0ba674160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:20.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.936+0000 7f92f2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0ba678a20 0x55b0ba674160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49476/0 (socket says 172.21.15.1:49476) 2024-09-19T09:42:20.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.936+0000 7f92f2d9d640 1 -- 172.21.15.1:0/1095959961 learned_addr learned my addr 172.21.15.1:0/1095959961 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:20.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.936+0000 7f92ebfff640 1 --2- 172.21.15.1:0/1095959961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0ba679340 0x55b0ba69f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:20.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.936+0000 7f92f2d9d640 1 -- 172.21.15.1:0/1095959961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0ba679340 msgr2=0x55b0ba69f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:20.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.936+0000 7f92f2d9d640 1 --2- 172.21.15.1:0/1095959961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0ba679340 0x55b0ba69f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.936+0000 7f92f2d9d640 1 -- 172.21.15.1:0/1095959961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0ba688150 msgr2=0x55b0ba69fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:20.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.936+0000 7f92f2d9d640 1 --2- 172.21.15.1:0/1095959961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0ba688150 0x55b0ba69fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.936+0000 7f92f2d9d640 1 -- 172.21.15.1:0/1095959961 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0ba670830 con 0x55b0ba678a20 2024-09-19T09:42:20.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.936+0000 7f92ebfff640 1 --2- 172.21.15.1:0/1095959961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0ba679340 0x55b0ba69f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:20.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.936+0000 7f92f2d9d640 1 --2- 172.21.15.1:0/1095959961 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0ba678a20 0x55b0ba674160 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f92ec006010 tx=0x7f92ec004b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8ac9d003651e50 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:20.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.936+0000 7f92dbfff640 1 -- 172.21.15.1:0/1095959961 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ec016030 con 0x55b0ba678a20 2024-09-19T09:42:20.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.936+0000 7f92dbfff640 1 -- 172.21.15.1:0/1095959961 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92ec01f020 con 0x55b0ba678a20 2024-09-19T09:42:20.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.936+0000 7f92dbfff640 1 -- 172.21.15.1:0/1095959961 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ec003970 con 0x55b0ba678a20 2024-09-19T09:42:20.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.937+0000 7f92fb2cc740 1 -- 172.21.15.1:0/1095959961 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0ba678a20 msgr2=0x55b0ba674160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:20.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.937+0000 7f92fb2cc740 1 --2- 172.21.15.1:0/1095959961 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0ba678a20 0x55b0ba674160 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f92ec006010 tx=0x7f92ec004b70 comp rx=0 tx=0).stop 2024-09-19T09:42:20.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.937+0000 7f92fb2cc740 1 -- 172.21.15.1:0/1095959961 shutdown_connections 2024-09-19T09:42:20.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.937+0000 7f92fb2cc740 1 --2- 172.21.15.1:0/1095959961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0ba688150 0x55b0ba69fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.937+0000 7f92fb2cc740 1 --2- 172.21.15.1:0/1095959961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0ba679340 0x55b0ba69f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.937+0000 7f92fb2cc740 1 --2- 172.21.15.1:0/1095959961 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0ba678a20 0x55b0ba674160 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.937+0000 7f92fb2cc740 1 -- 172.21.15.1:0/1095959961 >> 172.21.15.1:0/1095959961 conn(0x55b0ba6750f0 msgr2=0x55b0ba673a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:20.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.937+0000 7f92fb2cc740 1 -- 172.21.15.1:0/1095959961 shutdown_connections 2024-09-19T09:42:20.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.937+0000 7f92fb2cc740 1 -- 172.21.15.1:0/1095959961 wait complete. 2024-09-19T09:42:20.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.937+0000 7f92fb2cc740 1 -- start start 2024-09-19T09:42:20.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.938+0000 7f92fb2cc740 1 Processor -- start 2024-09-19T09:42:20.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.938+0000 7f92fb2cc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0ba678a20 0x55b0ba690870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:20.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.938+0000 7f92fb2cc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0ba679340 0x55b0ba68bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:20.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.938+0000 7f92fb2cc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0ba688150 0x55b0ba68c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:20.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.938+0000 7f92fb2cc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f92f41aa150 con 0x55b0ba688150 2024-09-19T09:42:20.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.938+0000 7f92fb2cc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f92f41ab5c0 con 0x55b0ba678a20 2024-09-19T09:42:20.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.938+0000 7f92fb2cc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f92f41aa820 con 0x55b0ba679340 2024-09-19T09:42:20.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.938+0000 7f92fb2cc740 10 client.0 _ll_register_callbacks cb 0x7f92ec009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:20.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.938+0000 7f92f2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0ba688150 0x55b0ba68c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:20.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.938+0000 7f92f2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0ba688150 0x55b0ba68c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49478/0 (socket says 172.21.15.1:49478) 2024-09-19T09:42:20.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.938+0000 7f92f2d9d640 1 -- 172.21.15.1:0/1859262437 learned_addr learned my addr 172.21.15.1:0/1859262437 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:20.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.938+0000 7f92ebfff640 1 --2- 172.21.15.1:0/1859262437 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0ba679340 0x55b0ba68bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:20.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.938+0000 7f92f2d9d640 1 --2- 172.21.15.1:0/1859262437 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0ba678a20 0x55b0ba690870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:20.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.938+0000 7f92f2d9d640 1 -- 172.21.15.1:0/1859262437 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0ba679340 msgr2=0x55b0ba68bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:20.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.938+0000 7f92f2d9d640 1 --2- 172.21.15.1:0/1859262437 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0ba679340 0x55b0ba68bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.938+0000 7f92f2d9d640 1 -- 172.21.15.1:0/1859262437 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0ba678a20 msgr2=0x55b0ba690870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:20.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.938+0000 7f92f2d9d640 1 --2- 172.21.15.1:0/1859262437 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0ba678a20 0x55b0ba690870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.938+0000 7f92f2d9d640 1 -- 172.21.15.1:0/1859262437 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0ba68c910 con 0x55b0ba688150 2024-09-19T09:42:20.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.938+0000 7f92f2d9d640 1 --2- 172.21.15.1:0/1859262437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0ba688150 0x55b0ba68c0e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f92ec009d00 tx=0x7f92ec009c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ac6f045ea77a021 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:20.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.938+0000 7f92d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:42:20.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.939+0000 7f92d9ffb640 1 -- 172.21.15.1:0/1859262437 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92ec016070 con 0x55b0ba688150 2024-09-19T09:42:20.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.939+0000 7f92d9ffb640 1 -- 172.21.15.1:0/1859262437 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f92ec01a3e0 con 0x55b0ba688150 2024-09-19T09:42:20.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.939+0000 7f92fb2cc740 1 -- 172.21.15.1:0/1859262437 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92ec01f020 con 0x55b0ba688150 2024-09-19T09:42:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.939+0000 7f92d9ffb640 1 -- 172.21.15.1:0/1859262437 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f92ec01a5e0 con 0x55b0ba688150 2024-09-19T09:42:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.939+0000 7f92fb2cc740 10 client.15966 fetch_fsmap learned FSMap version 19 2024-09-19T09:42:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.939+0000 7f92fb2cc740 1 -- 172.21.15.1:0/1859262437 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55b0ba7027c0 con 0x55b0ba688150 2024-09-19T09:42:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.939+0000 7f92d9ffb640 1 -- 172.21.15.1:0/1859262437 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f92ec01f020 con 0x55b0ba688150 2024-09-19T09:42:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.939+0000 7f92d9ffb640 1 -- 172.21.15.1:0/1859262437 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f92ec028070 con 0x55b0ba688150 2024-09-19T09:42:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.939+0000 7f92fb2cc740 10 client.15966 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:42:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.939+0000 7f92fb2cc740 10 client.15966 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.939+0000 7f92fb2cc740 20 client.15966 populate_metadata read hostname 'smithi001' 2024-09-19T09:42:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.939+0000 7f92fb2cc740 1 --2- 172.21.15.1:0/1859262437 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b0ba697e00 0x55b0ba704e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.939+0000 7f92fb2cc740 4 client.15966 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:42:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.939+0000 7f92fb2cc740 1 -- 172.21.15.1:0/1859262437 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b0ba5e5d00 con 0x55b0ba697e00 2024-09-19T09:42:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.940+0000 7f92ebfff640 1 --2- 172.21.15.1:0/1859262437 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b0ba697e00 0x55b0ba704e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:20.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.940+0000 7f92d9ffb640 10 client.15966 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:20.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.940+0000 7f92ebfff640 1 --2- 172.21.15.1:0/1859262437 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b0ba697e00 0x55b0ba704e70 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5afbb8159bf7dc49 server_cookie=9953fe534d6ea775 in_seq=0 out_seq=0 2024-09-19T09:42:20.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.941+0000 7f92d9ffb640 1 -- 172.21.15.1:0/1859262437 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b0ba5e5d00 con 0x55b0ba697e00 2024-09-19T09:42:20.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.941+0000 7f92d9ffb640 10 client.15966 handle_command_reply: tid=0 2024-09-19T09:42:20.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.941+0000 7f92fb2cc740 1 client.15966 shutdown 2024-09-19T09:42:20.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.941+0000 7f92fb2cc740 1 -- 172.21.15.1:0/1859262437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0ba688150 msgr2=0x55b0ba68c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:20.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.941+0000 7f92fb2cc740 1 --2- 172.21.15.1:0/1859262437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0ba688150 0x55b0ba68c0e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f92ec009d00 tx=0x7f92ec009c70 comp rx=0 tx=0).stop 2024-09-19T09:42:20.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.941+0000 7f92fb2cc740 1 -- 172.21.15.1:0/1859262437 shutdown_connections 2024-09-19T09:42:20.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.941+0000 7f92fb2cc740 1 --2- 172.21.15.1:0/1859262437 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b0ba697e00 0x55b0ba704e70 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.941+0000 7f92fb2cc740 1 --2- 172.21.15.1:0/1859262437 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b0ba688150 0x55b0ba68c0e0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.941+0000 7f92fb2cc740 1 --2- 172.21.15.1:0/1859262437 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b0ba679340 0x55b0ba68bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.941+0000 7f92fb2cc740 1 --2- 172.21.15.1:0/1859262437 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b0ba678a20 0x55b0ba690870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.941+0000 7f92fb2cc740 1 -- 172.21.15.1:0/1859262437 >> 172.21.15.1:0/1859262437 conn(0x55b0ba6750f0 msgr2=0x55b0ba674270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:20.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.941+0000 7f92d9ffb640 0 client.15966 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:20.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.941+0000 7f92fb2cc740 1 -- 172.21.15.1:0/1859262437 shutdown_connections 2024-09-19T09:42:20.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.941+0000 7f92fb2cc740 1 -- 172.21.15.1:0/1859262437 wait complete. 2024-09-19T09:42:20.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.941+0000 7f92fb2cc740 20 client.15966 trim_cache size 0 max 16384 2024-09-19T09:42:20.051 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:42:20.051 INFO:teuthology.orchestra.run.smithi001.stdout: "return_code": 0, 2024-09-19T09:42:20.052 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_tag": "76ce9226-0c74-4e0e-a28e-b93e2f547d9e", 2024-09-19T09:42:20.052 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": "asynchronous" 2024-09-19T09:42:20.052 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:42:20.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.942+0000 7f92f8ef3640 1 -- 172.21.15.1:0/992570762 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f92e00a3240 msgr2=0x7f92e00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:20.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.942+0000 7f92f8ef3640 1 --2- 172.21.15.1:0/992570762 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f92e00a3240 0x7f92e00a5700 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f92e409c280 tx=0x7f92e4000bc0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.942+0000 7f92f8ef3640 1 -- 172.21.15.1:0/992570762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92f4100e20 msgr2=0x7f92f4199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:20.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.942+0000 7f92f8ef3640 1 --2- 172.21.15.1:0/992570762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92f4100e20 0x7f92f4199310 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f92e400e9f0 tx=0x7f92e400eeb0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.942+0000 7f92f8ef3640 1 -- 172.21.15.1:0/992570762 shutdown_connections 2024-09-19T09:42:20.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.942+0000 7f92f8ef3640 1 --2- 172.21.15.1:0/992570762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92f4102ef0 0x7f92f41a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.942+0000 7f92f8ef3640 1 --2- 172.21.15.1:0/992570762 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f92e00a3240 0x7f92e00a5700 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.942+0000 7f92f8ef3640 1 --2- 172.21.15.1:0/992570762 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92f4102570 0x7f92f4199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.942+0000 7f92f8ef3640 1 --2- 172.21.15.1:0/992570762 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f92f4100e20 0x7f92f4199310 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:20.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.942+0000 7f92f8ef3640 1 -- 172.21.15.1:0/992570762 >> 172.21.15.1:0/992570762 conn(0x7f92f40fc7d0 msgr2=0x7f92f40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:20.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.942+0000 7f92f8ef3640 1 -- 172.21.15.1:0/992570762 shutdown_connections 2024-09-19T09:42:20.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:18.942+0000 7f92f8ef3640 1 -- 172.21.15.1:0/992570762 wait complete. 2024-09-19T09:42:20.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:20 smithi001 ceph-mon[31225]: pgmap v465: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 8.9 MiB/s wr, 1.95k op/s 2024-09-19T09:42:20.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:20 smithi022 ceph-mon[35583]: pgmap v465: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 8.9 MiB/s wr, 1.95k op/s 2024-09-19T09:42:20.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:20 smithi121 ceph-mon[35577]: pgmap v465: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 8.9 MiB/s wr, 1.95k op/s 2024-09-19T09:42:22.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:22 smithi001 ceph-mon[31225]: pgmap v466: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 KiB/s wr, 19 op/s 2024-09-19T09:42:22.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:22 smithi022 ceph-mon[35583]: pgmap v466: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 KiB/s wr, 19 op/s 2024-09-19T09:42:22.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:22 smithi121 ceph-mon[35577]: pgmap v466: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 KiB/s wr, 19 op/s 2024-09-19T09:42:23.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:23 smithi001 ceph-mon[31225]: scrub summary: idle 2024-09-19T09:42:23.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:23 smithi022 ceph-mon[35583]: scrub summary: idle 2024-09-19T09:42:23.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:23 smithi121 ceph-mon[35577]: scrub summary: idle 2024-09-19T09:42:24.497 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:24 smithi001 ceph-mon[31225]: pgmap v467: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 38 op/s 2024-09-19T09:42:24.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:24 smithi022 ceph-mon[35583]: pgmap v467: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 38 op/s 2024-09-19T09:42:24.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:24 smithi121 ceph-mon[35577]: pgmap v467: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 38 op/s 2024-09-19T09:42:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.926+0000 7fa1ed1f6640 1 -- 172.21.15.1:0/498012509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1e81001d0 msgr2=0x7fa1e81005d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.926+0000 7fa1ed1f6640 1 --2- 172.21.15.1:0/498012509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1e81001d0 0x7fa1e81005d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8009900 tx=0x7fa1d802a410 comp rx=0 tx=0).stop 2024-09-19T09:42:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.926+0000 7fa1ed1f6640 1 -- 172.21.15.1:0/498012509 shutdown_connections 2024-09-19T09:42:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.926+0000 7fa1ed1f6640 1 --2- 172.21.15.1:0/498012509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1e8101d80 0x7fa1e8108610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.926+0000 7fa1ed1f6640 1 --2- 172.21.15.1:0/498012509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1e81013c0 0x7fa1e8101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.926+0000 7fa1ed1f6640 1 --2- 172.21.15.1:0/498012509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1e81001d0 0x7fa1e81005d0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.926+0000 7fa1ed1f6640 1 -- 172.21.15.1:0/498012509 >> 172.21.15.1:0/498012509 conn(0x7fa1e80fb970 msgr2=0x7fa1e80fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:24.932 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.926+0000 7fa1ed1f6640 1 -- 172.21.15.1:0/498012509 shutdown_connections 2024-09-19T09:42:24.932 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.926+0000 7fa1ed1f6640 1 -- 172.21.15.1:0/498012509 wait complete. 2024-09-19T09:42:24.932 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.927+0000 7fa1ed1f6640 1 Processor -- start 2024-09-19T09:42:24.932 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.927+0000 7fa1ed1f6640 1 -- start start 2024-09-19T09:42:24.932 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.927+0000 7fa1ed1f6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1e81001d0 0x7fa1e8104160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.932 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.927+0000 7fa1ed1f6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1e81013c0 0x7fa1e81027a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.932 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.927+0000 7fa1ed1f6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1e8101d80 0x7fa1e8102ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.932 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.927+0000 7fa1ed1f6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e810b5c0 con 0x7fa1e81013c0 2024-09-19T09:42:24.932 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.927+0000 7fa1ed1f6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e810b440 con 0x7fa1e8101d80 2024-09-19T09:42:24.932 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.927+0000 7fa1ed1f6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e810b740 con 0x7fa1e81001d0 2024-09-19T09:42:24.932 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.927+0000 7fa1dffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1e81013c0 0x7fa1e81027a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.928+0000 7fa1dffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1e81013c0 0x7fa1e81027a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49494/0 (socket says 172.21.15.1:49494) 2024-09-19T09:42:24.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.928+0000 7fa1dffff640 1 -- 172.21.15.1:0/1483178867 learned_addr learned my addr 172.21.15.1:0/1483178867 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:24.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.928+0000 7fa1e6d9d640 1 --2- 172.21.15.1:0/1483178867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1e81001d0 0x7fa1e8104160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.928+0000 7fa1e759e640 1 --2- 172.21.15.1:0/1483178867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1e8101d80 0x7fa1e8102ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.928+0000 7fa1dffff640 1 -- 172.21.15.1:0/1483178867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1e81001d0 msgr2=0x7fa1e8104160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:24.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.928+0000 7fa1dffff640 1 --2- 172.21.15.1:0/1483178867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1e81001d0 0x7fa1e8104160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.928+0000 7fa1dffff640 1 -- 172.21.15.1:0/1483178867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1e8101d80 msgr2=0x7fa1e8102ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:24.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.928+0000 7fa1dffff640 1 --2- 172.21.15.1:0/1483178867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1e8101d80 0x7fa1e8102ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.928+0000 7fa1dffff640 1 -- 172.21.15.1:0/1483178867 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e8103570 con 0x7fa1e81013c0 2024-09-19T09:42:24.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.928+0000 7fa1dffff640 1 --2- 172.21.15.1:0/1483178867 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1e81013c0 0x7fa1e81027a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa1d000ea20 tx=0x7fa1d000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:24.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.928+0000 7fa1e4d99640 1 -- 172.21.15.1:0/1483178867 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d000cd40 con 0x7fa1e81013c0 2024-09-19T09:42:24.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.928+0000 7fa1e4d99640 1 -- 172.21.15.1:0/1483178867 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1d00168f0 con 0x7fa1e81013c0 2024-09-19T09:42:24.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.928+0000 7fa1ed1f6640 1 -- 172.21.15.1:0/1483178867 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1e81a1fa0 con 0x7fa1e81013c0 2024-09-19T09:42:24.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.928+0000 7fa1e4d99640 1 -- 172.21.15.1:0/1483178867 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d000b920 con 0x7fa1e81013c0 2024-09-19T09:42:24.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.928+0000 7fa1ed1f6640 1 -- 172.21.15.1:0/1483178867 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1e81a2460 con 0x7fa1e81013c0 2024-09-19T09:42:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.930+0000 7fa1e4d99640 1 -- 172.21.15.1:0/1483178867 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fa1d0016aa0 con 0x7fa1e81013c0 2024-09-19T09:42:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.931+0000 7fa1f006b740 1 Processor -- start 2024-09-19T09:42:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.931+0000 7fa1f006b740 1 -- start start 2024-09-19T09:42:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.931+0000 7fa1f006b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5564a3f6b9a0 0x5564a3f6bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.931+0000 7fa1f006b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5564a3f6c2e0 0x5564a3f70da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.931+0000 7fa1f006b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5564a3f71370 0x5564a3f73830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.931+0000 7fa1f006b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5564a3ecf2f0 con 0x5564a3f6b9a0 2024-09-19T09:42:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.931+0000 7fa1f006b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5564a3e77270 con 0x5564a3f71370 2024-09-19T09:42:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.931+0000 7fa1f006b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5564a3ecb2b0 con 0x5564a3f6c2e0 2024-09-19T09:42:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.931+0000 7fa1e759e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5564a3f6b9a0 0x5564a3f6bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.931+0000 7fa1e759e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5564a3f6b9a0 0x5564a3f6bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49504/0 (socket says 172.21.15.1:49504) 2024-09-19T09:42:24.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.931+0000 7fa1e759e640 1 -- 172.21.15.1:0/3981697902 learned_addr learned my addr 172.21.15.1:0/3981697902 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:24.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.931+0000 7fa1e6d9d640 1 --2- 172.21.15.1:0/3981697902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5564a3f6c2e0 0x5564a3f70da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.932+0000 7fa1dffff640 1 --2- 172.21.15.1:0/3981697902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5564a3f71370 0x5564a3f73830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.932+0000 7fa1e759e640 1 -- 172.21.15.1:0/3981697902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5564a3f6c2e0 msgr2=0x5564a3f70da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:24.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.932+0000 7fa1e759e640 1 --2- 172.21.15.1:0/3981697902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5564a3f6c2e0 0x5564a3f70da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.932+0000 7fa1e759e640 1 -- 172.21.15.1:0/3981697902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5564a3f71370 msgr2=0x5564a3f73830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:24.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.932+0000 7fa1e759e640 1 --2- 172.21.15.1:0/3981697902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5564a3f71370 0x5564a3f73830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.932+0000 7fa1e759e640 1 -- 172.21.15.1:0/3981697902 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564a3e76340 con 0x5564a3f6b9a0 2024-09-19T09:42:24.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.932+0000 7fa1e4d99640 1 --2- 172.21.15.1:0/1483178867 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fa1d40a3240 0x7fa1d40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.932+0000 7fa1e759e640 1 --2- 172.21.15.1:0/3981697902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5564a3f6b9a0 0x5564a3f6bda0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0009fa0 tx=0x7fa1e000f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce220d2102a9a39 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:24.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.932+0000 7fa1e6d9d640 1 --2- 172.21.15.1:0/1483178867 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fa1d40a3240 0x7fa1d40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.932+0000 7fa1e4d99640 1 -- 172.21.15.1:0/1483178867 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fa1d00cf830 con 0x7fa1e81013c0 2024-09-19T09:42:24.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.932+0000 7fa1dd7fa640 1 -- 172.21.15.1:0/3981697902 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0015070 con 0x5564a3f6b9a0 2024-09-19T09:42:24.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.932+0000 7fa1dd7fa640 1 -- 172.21.15.1:0/3981697902 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1e001ab40 con 0x5564a3f6b9a0 2024-09-19T09:42:24.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.932+0000 7fa1dd7fa640 1 -- 172.21.15.1:0/3981697902 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0011d80 con 0x5564a3f6b9a0 2024-09-19T09:42:24.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.933+0000 7fa1f006b740 1 -- 172.21.15.1:0/3981697902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5564a3f6b9a0 msgr2=0x5564a3f6bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:24.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.933+0000 7fa1f006b740 1 --2- 172.21.15.1:0/3981697902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5564a3f6b9a0 0x5564a3f6bda0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0009fa0 tx=0x7fa1e000f7f0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.933+0000 7fa1e6d9d640 1 --2- 172.21.15.1:0/1483178867 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fa1d40a3240 0x7fa1d40a5700 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8005ab0 tx=0x7fa1d8005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:24.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.933+0000 7fa1f006b740 1 -- 172.21.15.1:0/3981697902 shutdown_connections 2024-09-19T09:42:24.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.933+0000 7fa1f006b740 1 --2- 172.21.15.1:0/3981697902 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5564a3f71370 0x5564a3f73830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.933+0000 7fa1f006b740 1 --2- 172.21.15.1:0/3981697902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5564a3f6c2e0 0x5564a3f70da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.933+0000 7fa1f006b740 1 --2- 172.21.15.1:0/3981697902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5564a3f6b9a0 0x5564a3f6bda0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.933+0000 7fa1f006b740 1 -- 172.21.15.1:0/3981697902 >> 172.21.15.1:0/3981697902 conn(0x5564a3f67010 msgr2=0x5564a3f67410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:24.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.933+0000 7fa1f006b740 1 -- 172.21.15.1:0/3981697902 shutdown_connections 2024-09-19T09:42:24.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.933+0000 7fa1f006b740 1 -- 172.21.15.1:0/3981697902 wait complete. 2024-09-19T09:42:24.943 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.933+0000 7fa1f006b740 1 -- start start 2024-09-19T09:42:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.933+0000 7fa1f006b740 1 Processor -- start 2024-09-19T09:42:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.934+0000 7fa1f006b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5564a3f6b9a0 0x5564a3f75c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.934+0000 7fa1f006b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5564a3f6c2e0 0x5564a3f76160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.934+0000 7fa1f006b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5564a3f71370 0x5564a3f7d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.934+0000 7fa1f006b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5564a3f74340 con 0x5564a3f6b9a0 2024-09-19T09:42:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.934+0000 7fa1f006b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5564a3e58290 con 0x5564a3f71370 2024-09-19T09:42:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.934+0000 7fa1f006b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5564a3f744c0 con 0x5564a3f6c2e0 2024-09-19T09:42:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.934+0000 7fa1f006b740 10 client.0 _ll_register_callbacks cb 0x5564a3e89140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.934+0000 7fa1e6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5564a3f6b9a0 0x5564a3f75c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.934+0000 7fa1e6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5564a3f6b9a0 0x5564a3f75c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49506/0 (socket says 172.21.15.1:49506) 2024-09-19T09:42:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.934+0000 7fa1e6d9d640 1 -- 172.21.15.1:0/1315950473 learned_addr learned my addr 172.21.15.1:0/1315950473 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.934+0000 7fa1dffff640 1 --2- 172.21.15.1:0/1315950473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5564a3f6c2e0 0x5564a3f76160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.944 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.934+0000 7fa1e759e640 1 --2- 172.21.15.1:0/1315950473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5564a3f71370 0x5564a3f7d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.934+0000 7fa1e6d9d640 1 -- 172.21.15.1:0/1315950473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5564a3f6c2e0 msgr2=0x5564a3f76160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.934+0000 7fa1e6d9d640 1 --2- 172.21.15.1:0/1315950473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5564a3f6c2e0 0x5564a3f76160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.934+0000 7fa1e6d9d640 1 -- 172.21.15.1:0/1315950473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5564a3f71370 msgr2=0x5564a3f7d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.934+0000 7fa1e6d9d640 1 --2- 172.21.15.1:0/1315950473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5564a3f71370 0x5564a3f7d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.934+0000 7fa1e6d9d640 1 -- 172.21.15.1:0/1315950473 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564a3be2210 con 0x5564a3f6b9a0 2024-09-19T09:42:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.934+0000 7fa1e6d9d640 1 --2- 172.21.15.1:0/1315950473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5564a3f6b9a0 0x5564a3f75c20 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8000c00 tx=0x7fa1d8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbea54755af7ec1f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.934+0000 7fa1ce7fc640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:42:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.934+0000 7fa1ce7fc640 1 -- 172.21.15.1:0/1315950473 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d804d070 con 0x5564a3f6b9a0 2024-09-19T09:42:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.935+0000 7fa1ce7fc640 1 -- 172.21.15.1:0/1315950473 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fa1d8005180 con 0x5564a3f6b9a0 2024-09-19T09:42:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.935+0000 7fa1f006b740 1 -- 172.21.15.1:0/1315950473 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1e001ab40 con 0x5564a3f6b9a0 2024-09-19T09:42:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.935+0000 7fa1ce7fc640 1 -- 172.21.15.1:0/1315950473 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa1d8059050 con 0x5564a3f6b9a0 2024-09-19T09:42:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.935+0000 7fa1f006b740 10 client.15978 fetch_fsmap learned FSMap version 19 2024-09-19T09:42:24.945 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.935+0000 7fa1f006b740 1 -- 172.21.15.1:0/1315950473 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5564a3cae620 con 0x5564a3f6b9a0 2024-09-19T09:42:24.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.935+0000 7fa1ce7fc640 1 -- 172.21.15.1:0/1315950473 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1e001ab40 con 0x5564a3f6b9a0 2024-09-19T09:42:24.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.935+0000 7fa1ce7fc640 1 -- 172.21.15.1:0/1315950473 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fa1d80035f0 con 0x5564a3f6b9a0 2024-09-19T09:42:24.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.935+0000 7fa1f006b740 10 client.15978 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:42:24.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.935+0000 7fa1f006b740 10 client.15978 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:24.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.935+0000 7fa1f006b740 20 client.15978 populate_metadata read hostname 'smithi001' 2024-09-19T09:42:24.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.935+0000 7fa1f006b740 1 --2- 172.21.15.1:0/1315950473 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5564a3f81890 0x5564a3f83cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.935+0000 7fa1f006b740 4 client.15978 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:42:24.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.935+0000 7fa1f006b740 1 -- 172.21.15.1:0/1315950473 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564a3edca20 con 0x5564a3f81890 2024-09-19T09:42:24.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.935+0000 7fa1dffff640 1 --2- 172.21.15.1:0/1315950473 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5564a3f81890 0x5564a3f83cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.936+0000 7fa1dffff640 1 --2- 172.21.15.1:0/1315950473 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5564a3f81890 0x5564a3f83cc0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ad0abbd0834bf62 server_cookie=b210fa3228f3b2f in_seq=0 out_seq=0 2024-09-19T09:42:24.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.936+0000 7fa1ce7fc640 10 client.15978 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:24.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.936+0000 7fa1ce7fc640 1 -- 172.21.15.1:0/1315950473 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5564a3edca20 con 0x5564a3f81890 2024-09-19T09:42:24.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.937+0000 7fa1ce7fc640 10 client.15978 handle_command_reply: tid=0 2024-09-19T09:42:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.937+0000 7fa1f006b740 1 client.15978 shutdown 2024-09-19T09:42:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.937+0000 7fa1f006b740 1 -- 172.21.15.1:0/1315950473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5564a3f6b9a0 msgr2=0x5564a3f75c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.937+0000 7fa1f006b740 1 --2- 172.21.15.1:0/1315950473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5564a3f6b9a0 0x5564a3f75c20 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8000c00 tx=0x7fa1d8009260 comp rx=0 tx=0).stop 2024-09-19T09:42:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.937+0000 7fa1f006b740 1 -- 172.21.15.1:0/1315950473 shutdown_connections 2024-09-19T09:42:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.937+0000 7fa1f006b740 1 --2- 172.21.15.1:0/1315950473 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5564a3f81890 0x5564a3f83cc0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.937+0000 7fa1f006b740 1 --2- 172.21.15.1:0/1315950473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5564a3f71370 0x5564a3f7d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.937+0000 7fa1f006b740 1 --2- 172.21.15.1:0/1315950473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5564a3f6c2e0 0x5564a3f76160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.937+0000 7fa1ce7fc640 0 client.15978 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.937+0000 7fa1f006b740 1 --2- 172.21.15.1:0/1315950473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5564a3f6b9a0 0x5564a3f75c20 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.937+0000 7fa1f006b740 1 -- 172.21.15.1:0/1315950473 >> 172.21.15.1:0/1315950473 conn(0x5564a3f67010 msgr2=0x5564a3f68820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.937+0000 7fa1f006b740 1 -- 172.21.15.1:0/1315950473 shutdown_connections 2024-09-19T09:42:24.947 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.937+0000 7fa1f006b740 1 -- 172.21.15.1:0/1315950473 wait complete. 2024-09-19T09:42:24.948 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.937+0000 7fa1f006b740 20 client.15978 trim_cache size 0 max 16384 2024-09-19T09:42:24.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.951+0000 7fa1f006b740 1 Processor -- start 2024-09-19T09:42:24.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.951+0000 7fa1f006b740 1 -- start start 2024-09-19T09:42:24.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.952+0000 7fa1f006b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5564a3f6b9a0 0x5564a3f761f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.952+0000 7fa1f006b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5564a3f6c2e0 0x5564a3f7d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.952+0000 7fa1f006b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5564a3f71370 0x5564a3f660b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.952+0000 7fa1f006b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e81a92f0 con 0x5564a3f6b9a0 2024-09-19T09:42:24.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.952+0000 7fa1f006b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e81abb90 con 0x5564a3f71370 2024-09-19T09:42:24.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.952+0000 7fa1f006b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e81a9980 con 0x5564a3f6c2e0 2024-09-19T09:42:24.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.952+0000 7fa1e6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5564a3f6b9a0 0x5564a3f761f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.952+0000 7fa1e6d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5564a3f6b9a0 0x5564a3f761f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49520/0 (socket says 172.21.15.1:49520) 2024-09-19T09:42:24.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.952+0000 7fa1e6d9d640 1 -- 172.21.15.1:0/833795001 learned_addr learned my addr 172.21.15.1:0/833795001 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:24.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.952+0000 7fa1e759e640 1 --2- 172.21.15.1:0/833795001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5564a3f71370 0x5564a3f660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.952+0000 7fa1e6d9d640 1 -- 172.21.15.1:0/833795001 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5564a3f6c2e0 msgr2=0x5564a3f7d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:24.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.952+0000 7fa1e6d9d640 1 --2- 172.21.15.1:0/833795001 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5564a3f6c2e0 0x5564a3f7d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.952+0000 7fa1e6d9d640 1 -- 172.21.15.1:0/833795001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5564a3f71370 msgr2=0x5564a3f660b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:24.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.952+0000 7fa1e6d9d640 1 --2- 172.21.15.1:0/833795001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5564a3f71370 0x5564a3f660b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.952+0000 7fa1e6d9d640 1 -- 172.21.15.1:0/833795001 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564a3f73760 con 0x5564a3f6b9a0 2024-09-19T09:42:24.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.952+0000 7fa1e759e640 1 --2- 172.21.15.1:0/833795001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5564a3f71370 0x5564a3f660b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:24.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.952+0000 7fa1e6d9d640 1 --2- 172.21.15.1:0/833795001 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5564a3f6b9a0 0x5564a3f761f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8005c40 tx=0x7fa1d802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8877ead8d01274e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:24.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.952+0000 7fa1dcff9640 1 -- 172.21.15.1:0/833795001 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8061020 con 0x5564a3f6b9a0 2024-09-19T09:42:24.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.952+0000 7fa1dcff9640 1 -- 172.21.15.1:0/833795001 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1d8003c30 con 0x5564a3f6b9a0 2024-09-19T09:42:24.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.952+0000 7fa1dcff9640 1 -- 172.21.15.1:0/833795001 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d804d070 con 0x5564a3f6b9a0 2024-09-19T09:42:24.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.953+0000 7fa1f006b740 1 -- 172.21.15.1:0/833795001 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5564a3f6b9a0 msgr2=0x5564a3f761f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:24.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.953+0000 7fa1f006b740 1 --2- 172.21.15.1:0/833795001 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5564a3f6b9a0 0x5564a3f761f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8005c40 tx=0x7fa1d802a410 comp rx=0 tx=0).stop 2024-09-19T09:42:24.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.953+0000 7fa1f006b740 1 -- 172.21.15.1:0/833795001 shutdown_connections 2024-09-19T09:42:24.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.953+0000 7fa1f006b740 1 --2- 172.21.15.1:0/833795001 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5564a3f71370 0x5564a3f660b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.953+0000 7fa1f006b740 1 --2- 172.21.15.1:0/833795001 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5564a3f6c2e0 0x5564a3f7d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.953+0000 7fa1f006b740 1 --2- 172.21.15.1:0/833795001 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5564a3f6b9a0 0x5564a3f761f0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.953+0000 7fa1f006b740 1 -- 172.21.15.1:0/833795001 >> 172.21.15.1:0/833795001 conn(0x5564a3f67010 msgr2=0x5564a3f659a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:24.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.953+0000 7fa1f006b740 1 -- 172.21.15.1:0/833795001 shutdown_connections 2024-09-19T09:42:24.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.953+0000 7fa1f006b740 1 -- 172.21.15.1:0/833795001 wait complete. 2024-09-19T09:42:24.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.953+0000 7fa1f006b740 1 -- start start 2024-09-19T09:42:24.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.953+0000 7fa1f006b740 1 Processor -- start 2024-09-19T09:42:24.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.954+0000 7fa1f006b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5564a3f6b9a0 0x5564a3f7ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.954+0000 7fa1f006b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5564a3f6c2e0 0x5564a3f7b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.954+0000 7fa1f006b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5564a3f71370 0x5564a3f7c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.954+0000 7fa1f006b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e81aa050 con 0x5564a3f6c2e0 2024-09-19T09:42:24.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.954+0000 7fa1f006b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e81ab4c0 con 0x5564a3f6b9a0 2024-09-19T09:42:24.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.954+0000 7fa1f006b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e81aa720 con 0x5564a3f71370 2024-09-19T09:42:24.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.954+0000 7fa1f006b740 10 client.0 _ll_register_callbacks cb 0x7fa1d8005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:24.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.954+0000 7fa1dffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5564a3f6c2e0 0x5564a3f7b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.954+0000 7fa1dffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5564a3f6c2e0 0x5564a3f7b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49534/0 (socket says 172.21.15.1:49534) 2024-09-19T09:42:24.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.954+0000 7fa1dffff640 1 -- 172.21.15.1:0/1260595859 learned_addr learned my addr 172.21.15.1:0/1260595859 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:24.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.954+0000 7fa1e759e640 1 --2- 172.21.15.1:0/1260595859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5564a3f71370 0x5564a3f7c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.954+0000 7fa1e6d9d640 1 --2- 172.21.15.1:0/1260595859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5564a3f6b9a0 0x5564a3f7ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.954+0000 7fa1dffff640 1 -- 172.21.15.1:0/1260595859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5564a3f71370 msgr2=0x5564a3f7c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:24.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.954+0000 7fa1dffff640 1 --2- 172.21.15.1:0/1260595859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5564a3f71370 0x5564a3f7c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.954+0000 7fa1dffff640 1 -- 172.21.15.1:0/1260595859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5564a3f6b9a0 msgr2=0x5564a3f7ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:24.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.954+0000 7fa1dffff640 1 --2- 172.21.15.1:0/1260595859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5564a3f6b9a0 0x5564a3f7ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.961 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.954+0000 7fa1dffff640 1 -- 172.21.15.1:0/1260595859 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564a3f7c8b0 con 0x5564a3f6c2e0 2024-09-19T09:42:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.954+0000 7fa1e6d9d640 1 --2- 172.21.15.1:0/1260595859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5564a3f6b9a0 0x5564a3f7ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.954+0000 7fa1e759e640 1 --2- 172.21.15.1:0/1260595859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5564a3f71370 0x5564a3f7c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.954+0000 7fa1dffff640 1 --2- 172.21.15.1:0/1260595859 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5564a3f6c2e0 0x5564a3f7b290 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0098270 tx=0x7fa1d000a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a355c8621dd242 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.954+0000 7fa1ce7fc640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:42:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.954+0000 7fa1ce7fc640 1 -- 172.21.15.1:0/1260595859 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d009c510 con 0x5564a3f6c2e0 2024-09-19T09:42:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.954+0000 7fa1ce7fc640 1 -- 172.21.15.1:0/1260595859 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fa1d0098480 con 0x5564a3f6c2e0 2024-09-19T09:42:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.954+0000 7fa1f006b740 1 -- 172.21.15.1:0/1260595859 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1d8003c30 con 0x5564a3f6c2e0 2024-09-19T09:42:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.955+0000 7fa1ce7fc640 1 -- 172.21.15.1:0/1260595859 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa1d009be10 con 0x5564a3f6c2e0 2024-09-19T09:42:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.955+0000 7fa1f006b740 10 client.15984 fetch_fsmap learned FSMap version 19 2024-09-19T09:42:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.955+0000 7fa1f006b740 1 -- 172.21.15.1:0/1260595859 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5564a3fecb60 con 0x5564a3f6c2e0 2024-09-19T09:42:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.955+0000 7fa1ce7fc640 1 -- 172.21.15.1:0/1260595859 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1d8003c30 con 0x5564a3f6c2e0 2024-09-19T09:42:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.955+0000 7fa1ce7fc640 1 -- 172.21.15.1:0/1260595859 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fa1d000b040 con 0x5564a3f6c2e0 2024-09-19T09:42:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.955+0000 7fa1f006b740 10 client.15984 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:42:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.955+0000 7fa1f006b740 10 client.15984 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.955+0000 7fa1f006b740 20 client.15984 populate_metadata read hostname 'smithi001' 2024-09-19T09:42:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.955+0000 7fa1f006b740 1 --2- 172.21.15.1:0/1260595859 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5564a3fed510 0x5564a3fef930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.955+0000 7fa1f006b740 4 client.15984 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:42:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.955+0000 7fa1f006b740 1 -- 172.21.15.1:0/1260595859 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5564a3ed6d70 con 0x5564a3fed510 2024-09-19T09:42:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.955+0000 7fa1e6d9d640 1 --2- 172.21.15.1:0/1260595859 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5564a3fed510 0x5564a3fef930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.956+0000 7fa1ce7fc640 10 client.15984 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.956+0000 7fa1e6d9d640 1 --2- 172.21.15.1:0/1260595859 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5564a3fed510 0x5564a3fef930 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45a2f47784351f12 server_cookie=2bd15f9cce7368fb in_seq=0 out_seq=0 2024-09-19T09:42:24.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.966+0000 7fa1ce7fc640 1 -- 172.21.15.1:0/1260595859 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5564a3ed6d70 con 0x5564a3fed510 2024-09-19T09:42:24.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.966+0000 7fa1ce7fc640 10 client.15984 handle_command_reply: tid=0 2024-09-19T09:42:24.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.966+0000 7fa1f006b740 1 client.15984 shutdown 2024-09-19T09:42:24.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.967+0000 7fa1f006b740 1 -- 172.21.15.1:0/1260595859 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5564a3f6c2e0 msgr2=0x5564a3f7b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:24.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.967+0000 7fa1f006b740 1 --2- 172.21.15.1:0/1260595859 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5564a3f6c2e0 0x5564a3f7b290 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0098270 tx=0x7fa1d000a420 comp rx=0 tx=0).stop 2024-09-19T09:42:24.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.967+0000 7fa1f006b740 1 -- 172.21.15.1:0/1260595859 shutdown_connections 2024-09-19T09:42:24.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.967+0000 7fa1f006b740 1 --2- 172.21.15.1:0/1260595859 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5564a3fed510 0x5564a3fef930 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.967+0000 7fa1f006b740 1 --2- 172.21.15.1:0/1260595859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5564a3f71370 0x5564a3f7c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.967+0000 7fa1ce7fc640 0 client.15984 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.967+0000 7fa1f006b740 1 --2- 172.21.15.1:0/1260595859 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5564a3f6c2e0 0x5564a3f7b290 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.967+0000 7fa1f006b740 1 --2- 172.21.15.1:0/1260595859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5564a3f6b9a0 0x5564a3f7ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.967+0000 7fa1f006b740 1 -- 172.21.15.1:0/1260595859 >> 172.21.15.1:0/1260595859 conn(0x5564a3f67010 msgr2=0x5564a3f661c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.967+0000 7fa1f006b740 1 -- 172.21.15.1:0/1260595859 shutdown_connections 2024-09-19T09:42:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.967+0000 7fa1f006b740 1 -- 172.21.15.1:0/1260595859 wait complete. 2024-09-19T09:42:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.967+0000 7fa1f006b740 20 client.15984 trim_cache size 0 max 16384 2024-09-19T09:42:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:42:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:42:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:42:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:42:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.967+0000 7fa1ed1f6640 1 -- 172.21.15.1:0/1483178867 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fa1d40a3240 msgr2=0x7fa1d40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.967+0000 7fa1ed1f6640 1 --2- 172.21.15.1:0/1483178867 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fa1d40a3240 0x7fa1d40a5700 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8005ab0 tx=0x7fa1d8005fd0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.967+0000 7fa1ed1f6640 1 -- 172.21.15.1:0/1483178867 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1e81013c0 msgr2=0x7fa1e81027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.967+0000 7fa1ed1f6640 1 --2- 172.21.15.1:0/1483178867 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1e81013c0 0x7fa1e81027a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa1d000ea20 tx=0x7fa1d000eee0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.967+0000 7fa1ed1f6640 1 -- 172.21.15.1:0/1483178867 shutdown_connections 2024-09-19T09:42:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.967+0000 7fa1ed1f6640 1 --2- 172.21.15.1:0/1483178867 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fa1d40a3240 0x7fa1d40a5700 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.967+0000 7fa1ed1f6640 1 --2- 172.21.15.1:0/1483178867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1e8101d80 0x7fa1e8102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.967+0000 7fa1ed1f6640 1 --2- 172.21.15.1:0/1483178867 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1e81013c0 0x7fa1e81027a0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.967+0000 7fa1ed1f6640 1 --2- 172.21.15.1:0/1483178867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1e81001d0 0x7fa1e8104160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.967+0000 7fa1ed1f6640 1 -- 172.21.15.1:0/1483178867 >> 172.21.15.1:0/1483178867 conn(0x7fa1e80fb970 msgr2=0x7fa1e81069a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.967+0000 7fa1ed1f6640 1 -- 172.21.15.1:0/1483178867 shutdown_connections 2024-09-19T09:42:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:24.968+0000 7fa1ed1f6640 1 -- 172.21.15.1:0/1483178867 wait complete. 2024-09-19T09:42:25.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:25 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:42:25.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:25 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:42:25.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:25 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:42:26.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:26 smithi001 ceph-mon[31225]: pgmap v468: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.6 KiB/s wr, 40 op/s 2024-09-19T09:42:26.518 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:26 smithi121 ceph-mon[35577]: pgmap v468: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.6 KiB/s wr, 40 op/s 2024-09-19T09:42:26.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:26 smithi022 ceph-mon[35583]: pgmap v468: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.6 KiB/s wr, 40 op/s 2024-09-19T09:42:28.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:28 smithi001 ceph-mon[31225]: pgmap v469: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 7.1 KiB/s wr, 41 op/s 2024-09-19T09:42:28.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:28 smithi022 ceph-mon[35583]: pgmap v469: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 7.1 KiB/s wr, 41 op/s 2024-09-19T09:42:28.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:28 smithi121 ceph-mon[35577]: pgmap v469: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 7.1 KiB/s wr, 41 op/s 2024-09-19T09:42:28.798 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:42:28.830 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:42:29.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:29 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:42:29.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:29 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:42:29.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:29 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:42:29.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:29 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:42:29.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:29 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:42:29.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:29 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:42:29.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:29 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:42:29.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:29 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:42:29.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:29 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:42:30.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:30 smithi001 ceph-mon[31225]: pgmap v470: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 2.9 KiB/s wr, 40 op/s 2024-09-19T09:42:30.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:30 smithi022 ceph-mon[35583]: pgmap v470: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 2.9 KiB/s wr, 40 op/s 2024-09-19T09:42:30.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:30 smithi121 ceph-mon[35577]: pgmap v470: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 2.9 KiB/s wr, 40 op/s 2024-09-19T09:42:32.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:32 smithi001 ceph-mon[31225]: pgmap v471: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 2.8 KiB/s wr, 39 op/s 2024-09-19T09:42:32.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:32 smithi022 ceph-mon[35583]: pgmap v471: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 2.8 KiB/s wr, 39 op/s 2024-09-19T09:42:32.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:32 smithi121 ceph-mon[35577]: pgmap v471: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 2.8 KiB/s wr, 39 op/s 2024-09-19T09:42:33.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.380+0000 7f81a8999640 1 -- 172.21.15.1:0/2793645797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81a4101420 msgr2=0x7f81a410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:33.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.380+0000 7f81a8999640 1 --2- 172.21.15.1:0/2793645797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81a4101420 0x7f81a410d950 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f819c009cd0 tx=0x7f819c02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:42:33.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.380+0000 7f81a8999640 1 -- 172.21.15.1:0/2793645797 shutdown_connections 2024-09-19T09:42:33.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.380+0000 7f81a8999640 1 --2- 172.21.15.1:0/2793645797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81a4101420 0x7f81a410d950 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:33.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.380+0000 7f81a8999640 1 --2- 172.21.15.1:0/2793645797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81a4100a80 0x7f81a4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:33.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.380+0000 7f81a8999640 1 --2- 172.21.15.1:0/2793645797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81a4106a80 0x7f81a4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:33.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.380+0000 7f81a8999640 1 -- 172.21.15.1:0/2793645797 >> 172.21.15.1:0/2793645797 conn(0x7f81a40fc7a0 msgr2=0x7f81a40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:33.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.380+0000 7f81a8999640 1 -- 172.21.15.1:0/2793645797 shutdown_connections 2024-09-19T09:42:33.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.380+0000 7f81a8999640 1 -- 172.21.15.1:0/2793645797 wait complete. 2024-09-19T09:42:33.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.381+0000 7f81a8999640 1 Processor -- start 2024-09-19T09:42:33.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.381+0000 7f81a8999640 1 -- start start 2024-09-19T09:42:33.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.381+0000 7f81a8999640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81a4100a80 0x7f81a4198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:33.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.381+0000 7f81a8999640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81a4101420 0x7f81a41989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:33.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.381+0000 7f81a8999640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81a4106a80 0x7f81a419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:33.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.381+0000 7f81a8999640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f81a4110e80 con 0x7f81a4100a80 2024-09-19T09:42:33.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.381+0000 7f81a8999640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f81a4110d00 con 0x7f81a4101420 2024-09-19T09:42:33.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.381+0000 7f81a8999640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f81a4111000 con 0x7f81a4106a80 2024-09-19T09:42:33.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.381+0000 7f81a259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81a4100a80 0x7f81a4198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:33.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.381+0000 7f81a259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81a4100a80 0x7f81a4198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33458/0 (socket says 172.21.15.1:33458) 2024-09-19T09:42:33.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.381+0000 7f81a259c640 1 -- 172.21.15.1:0/492475653 learned_addr learned my addr 172.21.15.1:0/492475653 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:33.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.381+0000 7f81a2d9d640 1 --2- 172.21.15.1:0/492475653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81a4106a80 0x7f81a419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:33.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.381+0000 7f81a1d9b640 1 --2- 172.21.15.1:0/492475653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81a4101420 0x7f81a41989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:33.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.381+0000 7f81a259c640 1 -- 172.21.15.1:0/492475653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81a4106a80 msgr2=0x7f81a419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:33.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.381+0000 7f81a259c640 1 --2- 172.21.15.1:0/492475653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81a4106a80 0x7f81a419cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:33.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.381+0000 7f81a259c640 1 -- 172.21.15.1:0/492475653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81a4101420 msgr2=0x7f81a41989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:33.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.381+0000 7f81a259c640 1 --2- 172.21.15.1:0/492475653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81a4101420 0x7f81a41989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:33.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.381+0000 7f81a259c640 1 -- 172.21.15.1:0/492475653 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81a419d410 con 0x7f81a4100a80 2024-09-19T09:42:33.400 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:42:33.401 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":19,"btime":"2024-09-19T09:36:24:006349+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:36:23.723388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6839/3279971690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3279971690},{"type":"v1","addr":"172.21.15.121:6839","nonce":3279971690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:42:33.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.381+0000 7f81a1d9b640 1 --2- 172.21.15.1:0/492475653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81a4101420 0x7f81a41989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:33.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.382+0000 7f81a259c640 1 --2- 172.21.15.1:0/492475653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81a4100a80 0x7f81a4198460 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f819400d950 tx=0x7f819400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:33.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.382+0000 7f81937fe640 1 -- 172.21.15.1:0/492475653 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8194017030 con 0x7f81a4100a80 2024-09-19T09:42:33.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.382+0000 7f81a8999640 1 -- 172.21.15.1:0/492475653 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81a419d700 con 0x7f81a4100a80 2024-09-19T09:42:33.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.382+0000 7f81937fe640 1 -- 172.21.15.1:0/492475653 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8194004020 con 0x7f81a4100a80 2024-09-19T09:42:33.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.382+0000 7f81937fe640 1 -- 172.21.15.1:0/492475653 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81940047a0 con 0x7f81a4100a80 2024-09-19T09:42:33.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.382+0000 7f81a8999640 1 -- 172.21.15.1:0/492475653 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81a41a4fe0 con 0x7f81a4100a80 2024-09-19T09:42:33.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.383+0000 7f81a8999640 1 -- 172.21.15.1:0/492475653 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81a4100ee0 con 0x7f81a4100a80 2024-09-19T09:42:33.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.385+0000 7f81937fe640 1 -- 172.21.15.1:0/492475653 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f81940041d0 con 0x7f81a4100a80 2024-09-19T09:42:33.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.386+0000 7f81937fe640 1 --2- 172.21.15.1:0/492475653 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f818c0a32c0 0x7f818c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:33.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.386+0000 7f81a1d9b640 1 --2- 172.21.15.1:0/492475653 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f818c0a32c0 0x7f818c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:33.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.386+0000 7f81937fe640 1 -- 172.21.15.1:0/492475653 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f81940cf8b0 con 0x7f81a4100a80 2024-09-19T09:42:33.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.386+0000 7f81a1d9b640 1 --2- 172.21.15.1:0/492475653 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f818c0a32c0 0x7f818c0a5780 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f81980058c0 tx=0x7f8198005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:33.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.389+0000 7f81937fe640 1 -- 172.21.15.1:0/492475653 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f819409c610 con 0x7f81a4100a80 2024-09-19T09:42:33.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.606+0000 7f81a8999640 1 -- 172.21.15.1:0/492475653 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81a41997c0 con 0x7f81a4100a80 2024-09-19T09:42:33.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.607+0000 7f81937fe640 1 -- 172.21.15.1:0/492475653 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11837 (secure 0 0 0) 0x7f81a41997c0 con 0x7f81a4100a80 2024-09-19T09:42:33.402 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 19 2024-09-19T09:42:33.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.609+0000 7f81a8999640 1 -- 172.21.15.1:0/492475653 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f818c0a32c0 msgr2=0x7f818c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:33.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.609+0000 7f81a8999640 1 --2- 172.21.15.1:0/492475653 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f818c0a32c0 0x7f818c0a5780 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f81980058c0 tx=0x7f8198005850 comp rx=0 tx=0).stop 2024-09-19T09:42:33.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.609+0000 7f81a8999640 1 -- 172.21.15.1:0/492475653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81a4100a80 msgr2=0x7f81a4198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:33.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.609+0000 7f81a8999640 1 --2- 172.21.15.1:0/492475653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81a4100a80 0x7f81a4198460 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f819400d950 tx=0x7f819400de10 comp rx=0 tx=0).stop 2024-09-19T09:42:33.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.609+0000 7f81a8999640 1 -- 172.21.15.1:0/492475653 shutdown_connections 2024-09-19T09:42:33.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.609+0000 7f81a8999640 1 --2- 172.21.15.1:0/492475653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81a4106a80 0x7f81a419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:33.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.609+0000 7f81a8999640 1 --2- 172.21.15.1:0/492475653 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f818c0a32c0 0x7f818c0a5780 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:33.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.609+0000 7f81a8999640 1 --2- 172.21.15.1:0/492475653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81a4101420 0x7f81a41989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:33.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.609+0000 7f81a8999640 1 --2- 172.21.15.1:0/492475653 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81a4100a80 0x7f81a4198460 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:33.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.609+0000 7f81a8999640 1 -- 172.21.15.1:0/492475653 >> 172.21.15.1:0/492475653 conn(0x7f81a40fc7a0 msgr2=0x7f81a406a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:33.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.610+0000 7f81a8999640 1 -- 172.21.15.1:0/492475653 shutdown_connections 2024-09-19T09:42:33.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:32.610+0000 7f81a8999640 1 -- 172.21.15.1:0/492475653 wait complete. 2024-09-19T09:42:33.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:33 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/492475653' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:42:33.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:33 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/492475653' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:42:33.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:33 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/492475653' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:42:34.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:34 smithi001 ceph-mon[31225]: pgmap v472: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.7 KiB/s wr, 34 op/s 2024-09-19T09:42:34.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:34 smithi022 ceph-mon[35583]: pgmap v472: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.7 KiB/s wr, 34 op/s 2024-09-19T09:42:34.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:34 smithi121 ceph-mon[35577]: pgmap v472: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 1.7 KiB/s wr, 34 op/s 2024-09-19T09:42:35.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:35 smithi001 ceph-mon[31225]: pgmap v473: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-19T09:42:35.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:35 smithi022 ceph-mon[35583]: pgmap v473: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-19T09:42:35.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:35 smithi121 ceph-mon[35577]: pgmap v473: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-19T09:42:36.284 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:42:36.303 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db --set-id f8a03d4b --release --await' 2024-09-19T09:42:36.304 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db --set-id f8a03d4b --release --await 2024-09-19T09:42:36.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.799+0000 7f7f7c4bc640 1 -- 172.21.15.1:0/234701289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f74106f00 msgr2=0x7f7f7410ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:36.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.799+0000 7f7f7c4bc640 1 --2- 172.21.15.1:0/234701289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f74106f00 0x7f7f7410ea80 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009ca0 tx=0x7f7f6c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.799+0000 7f7f7c4bc640 1 -- 172.21.15.1:0/234701289 shutdown_connections 2024-09-19T09:42:36.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.799+0000 7f7f7c4bc640 1 --2- 172.21.15.1:0/234701289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f74106f00 0x7f7f7410ea80 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.799+0000 7f7f7c4bc640 1 --2- 172.21.15.1:0/234701289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f74102780 0x7f7f741067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.799+0000 7f7f7c4bc640 1 --2- 172.21.15.1:0/234701289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f74101dd0 0x7f7f741021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.799+0000 7f7f7c4bc640 1 -- 172.21.15.1:0/234701289 >> 172.21.15.1:0/234701289 conn(0x7f7f740fd8b0 msgr2=0x7f7f740ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:36.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.799+0000 7f7f7c4bc640 1 -- 172.21.15.1:0/234701289 shutdown_connections 2024-09-19T09:42:36.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.799+0000 7f7f7c4bc640 1 -- 172.21.15.1:0/234701289 wait complete. 2024-09-19T09:42:36.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.799+0000 7f7f7c4bc640 1 Processor -- start 2024-09-19T09:42:36.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.799+0000 7f7f7c4bc640 1 -- start start 2024-09-19T09:42:36.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.800+0000 7f7f7c4bc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f74101dd0 0x7f7f74198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:36.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.800+0000 7f7f7c4bc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f74102780 0x7f7f74198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:36.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.800+0000 7f7f7c4bc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f74106f00 0x7f7f7419ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:36.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.800+0000 7f7f7c4bc640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7f74111f60 con 0x7f7f74102780 2024-09-19T09:42:36.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.800+0000 7f7f7c4bc640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7f74111de0 con 0x7f7f74101dd0 2024-09-19T09:42:36.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.800+0000 7f7f7c4bc640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7f741120e0 con 0x7f7f74106f00 2024-09-19T09:42:36.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.800+0000 7f7f79a57640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f74102780 0x7f7f74198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:36.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.800+0000 7f7f79a57640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f74102780 0x7f7f74198940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34724/0 (socket says 172.21.15.1:34724) 2024-09-19T09:42:36.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.800+0000 7f7f79a57640 1 -- 172.21.15.1:0/1252463925 learned_addr learned my addr 172.21.15.1:0/1252463925 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:36.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.800+0000 7f7f7a258640 1 --2- 172.21.15.1:0/1252463925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f74101dd0 0x7f7f74198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:36.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.800+0000 7f7f7aa59640 1 --2- 172.21.15.1:0/1252463925 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f74106f00 0x7f7f7419ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:36.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.800+0000 7f7f79a57640 1 -- 172.21.15.1:0/1252463925 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f74106f00 msgr2=0x7f7f7419ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:36.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.800+0000 7f7f79a57640 1 --2- 172.21.15.1:0/1252463925 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f74106f00 0x7f7f7419ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.800+0000 7f7f79a57640 1 -- 172.21.15.1:0/1252463925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f74101dd0 msgr2=0x7f7f74198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:36.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.800+0000 7f7f79a57640 1 --2- 172.21.15.1:0/1252463925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f74101dd0 0x7f7f74198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.800+0000 7f7f79a57640 1 -- 172.21.15.1:0/1252463925 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f7419d3b0 con 0x7f7f74102780 2024-09-19T09:42:36.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.800+0000 7f7f7a258640 1 --2- 172.21.15.1:0/1252463925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f74101dd0 0x7f7f74198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:36.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.800+0000 7f7f7aa59640 1 --2- 172.21.15.1:0/1252463925 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f74106f00 0x7f7f7419ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:36.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.800+0000 7f7f79a57640 1 --2- 172.21.15.1:0/1252463925 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f74102780 0x7f7f74198940 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f7f6400d950 tx=0x7f7f6400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:36.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.800+0000 7f7f6b7fe640 1 -- 172.21.15.1:0/1252463925 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f64017030 con 0x7f7f74102780 2024-09-19T09:42:36.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.800+0000 7f7f7c4bc640 1 -- 172.21.15.1:0/1252463925 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f7419d6a0 con 0x7f7f74102780 2024-09-19T09:42:36.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.801+0000 7f7f6b7fe640 1 -- 172.21.15.1:0/1252463925 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f64004020 con 0x7f7f74102780 2024-09-19T09:42:36.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.801+0000 7f7f6b7fe640 1 -- 172.21.15.1:0/1252463925 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f640047a0 con 0x7f7f74102780 2024-09-19T09:42:36.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.801+0000 7f7f7c4bc640 1 -- 172.21.15.1:0/1252463925 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f741a4f80 con 0x7f7f74102780 2024-09-19T09:42:36.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.803+0000 7f7f6b7fe640 1 -- 172.21.15.1:0/1252463925 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f7f640041d0 con 0x7f7f74102780 2024-09-19T09:42:36.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.803+0000 7f7f7e895740 1 Processor -- start 2024-09-19T09:42:36.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.803+0000 7f7f7e895740 1 -- start start 2024-09-19T09:42:36.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.804+0000 7f7f7e895740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b2b56f1380 0x55b2b56f1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:36.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.804+0000 7f7f7e895740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2b56f1ca0 0x55b2b5700550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:36.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.804+0000 7f7f7e895740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b2b5700a90 0x55b2b5702e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:36.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.804+0000 7f7f6b7fe640 1 --2- 172.21.15.1:0/1252463925 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f7f600a3240 0x7f7f600a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:36.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.804+0000 7f7f7e895740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b2b56572e0 con 0x55b2b5700a90 2024-09-19T09:42:36.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.804+0000 7f7f7e895740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b2b55fece0 con 0x55b2b56f1ca0 2024-09-19T09:42:36.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.804+0000 7f7f7e895740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b2b56532a0 con 0x55b2b56f1380 2024-09-19T09:42:36.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.804+0000 7f7f7aa59640 1 --2- 172.21.15.1:0/1252463925 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f7f600a3240 0x7f7f600a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:36.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.804+0000 7f7f79a57640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b2b5700a90 0x55b2b5702e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:36.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.804+0000 7f7f79a57640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b2b5700a90 0x55b2b5702e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34738/0 (socket says 172.21.15.1:34738) 2024-09-19T09:42:36.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.804+0000 7f7f6b7fe640 1 -- 172.21.15.1:0/1252463925 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f7f640cf3c0 con 0x7f7f74102780 2024-09-19T09:42:36.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.804+0000 7f7f79a57640 1 -- 172.21.15.1:0/581795139 learned_addr learned my addr 172.21.15.1:0/581795139 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:36.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.804+0000 7f7f7aa59640 1 --2- 172.21.15.1:0/581795139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b2b56f1380 0x55b2b56f1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:36.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.804+0000 7f7f7a258640 1 --2- 172.21.15.1:0/581795139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2b56f1ca0 0x55b2b5700550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:36.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.804+0000 7f7f79a57640 1 -- 172.21.15.1:0/581795139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b2b56f1380 msgr2=0x55b2b56f1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:36.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.804+0000 7f7f79a57640 1 --2- 172.21.15.1:0/581795139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b2b56f1380 0x55b2b56f1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.804+0000 7f7f79a57640 1 -- 172.21.15.1:0/581795139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2b56f1ca0 msgr2=0x55b2b5700550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:36.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.804+0000 7f7f79a57640 1 --2- 172.21.15.1:0/581795139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2b56f1ca0 0x55b2b5700550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.804+0000 7f7f79a57640 1 -- 172.21.15.1:0/581795139 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2b55e3440 con 0x55b2b5700a90 2024-09-19T09:42:36.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.804+0000 7f7f7aa59640 1 --2- 172.21.15.1:0/1252463925 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f7f600a3240 0x7f7f600a5700 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c006010 tx=0x7f7f6c02f3e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:36.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.805+0000 7f7f79a57640 1 --2- 172.21.15.1:0/581795139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b2b5700a90 0x55b2b5702e80 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f7f6401b000 tx=0x7f7f64017560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a394caac6cf8db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:36.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.805+0000 7f7f68ff9640 1 -- 172.21.15.1:0/581795139 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6409b770 con 0x55b2b5700a90 2024-09-19T09:42:36.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.805+0000 7f7f68ff9640 1 -- 172.21.15.1:0/581795139 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f6409c0a0 con 0x55b2b5700a90 2024-09-19T09:42:36.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.805+0000 7f7f68ff9640 1 -- 172.21.15.1:0/581795139 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6409b300 con 0x55b2b5700a90 2024-09-19T09:42:36.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.805+0000 7f7f7e895740 1 -- 172.21.15.1:0/581795139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b2b5700a90 msgr2=0x55b2b5702e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:36.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.806+0000 7f7f7e895740 1 --2- 172.21.15.1:0/581795139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b2b5700a90 0x55b2b5702e80 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f7f6401b000 tx=0x7f7f64017560 comp rx=0 tx=0).stop 2024-09-19T09:42:36.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.806+0000 7f7f7e895740 1 -- 172.21.15.1:0/581795139 shutdown_connections 2024-09-19T09:42:36.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.806+0000 7f7f7e895740 1 --2- 172.21.15.1:0/581795139 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b2b5700a90 0x55b2b5702e80 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.806+0000 7f7f7e895740 1 --2- 172.21.15.1:0/581795139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2b56f1ca0 0x55b2b5700550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.806+0000 7f7f7e895740 1 --2- 172.21.15.1:0/581795139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b2b56f1380 0x55b2b56f1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.806+0000 7f7f7e895740 1 -- 172.21.15.1:0/581795139 >> 172.21.15.1:0/581795139 conn(0x55b2b56eda30 msgr2=0x55b2b56ede10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:36.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.806+0000 7f7f7e895740 1 -- 172.21.15.1:0/581795139 shutdown_connections 2024-09-19T09:42:36.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.806+0000 7f7f7e895740 1 -- 172.21.15.1:0/581795139 wait complete. 2024-09-19T09:42:36.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.806+0000 7f7f7e895740 1 -- start start 2024-09-19T09:42:36.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.806+0000 7f7f7e895740 1 Processor -- start 2024-09-19T09:42:36.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.807+0000 7f7f7e895740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2b56f1380 0x55b2b57003d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:36.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.807+0000 7f7f7e895740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b2b56f1ca0 0x55b2b56fd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:36.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.807+0000 7f7f7e895740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b2b5700a90 0x55b2b56fdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:36.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.807+0000 7f7f7e895740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b2b5703660 con 0x55b2b56f1ca0 2024-09-19T09:42:36.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.807+0000 7f7f7e895740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b2b5612050 con 0x55b2b56f1380 2024-09-19T09:42:36.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.807+0000 7f7f7e895740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b2b57037e0 con 0x55b2b5700a90 2024-09-19T09:42:36.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.807+0000 7f7f7e895740 10 client.0 _ll_register_callbacks cb 0x55b2b5652160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:36.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.807+0000 7f7f79a57640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b2b56f1ca0 0x55b2b56fd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:36.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.807+0000 7f7f79a57640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b2b56f1ca0 0x55b2b56fd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34740/0 (socket says 172.21.15.1:34740) 2024-09-19T09:42:36.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.807+0000 7f7f79a57640 1 -- 172.21.15.1:0/4175542505 learned_addr learned my addr 172.21.15.1:0/4175542505 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:36.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.807+0000 7f7f7a258640 1 --2- 172.21.15.1:0/4175542505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2b56f1380 0x55b2b57003d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:36.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.807+0000 7f7f7aa59640 1 --2- 172.21.15.1:0/4175542505 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b2b5700a90 0x55b2b56fdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:36.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.807+0000 7f7f79a57640 1 -- 172.21.15.1:0/4175542505 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b2b5700a90 msgr2=0x55b2b56fdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:36.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.807+0000 7f7f79a57640 1 --2- 172.21.15.1:0/4175542505 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b2b5700a90 0x55b2b56fdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.807+0000 7f7f79a57640 1 -- 172.21.15.1:0/4175542505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2b56f1380 msgr2=0x55b2b57003d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:36.816 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.807+0000 7f7f79a57640 1 --2- 172.21.15.1:0/4175542505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2b56f1380 0x55b2b57003d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.807+0000 7f7f79a57640 1 -- 172.21.15.1:0/4175542505 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2b53c83c0 con 0x55b2b56f1ca0 2024-09-19T09:42:36.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.807+0000 7f7f79a57640 1 --2- 172.21.15.1:0/4175542505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b2b56f1ca0 0x55b2b56fd6d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f7f64098370 tx=0x7f7f6409b380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c800111bdb6b0d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:36.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.807+0000 7f7f5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:42:36.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.807+0000 7f7f5dffb640 1 -- 172.21.15.1:0/4175542505 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6409b4e0 con 0x55b2b56f1ca0 2024-09-19T09:42:36.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.808+0000 7f7f5dffb640 1 -- 172.21.15.1:0/4175542505 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f7f640a4180 con 0x55b2b56f1ca0 2024-09-19T09:42:36.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.808+0000 7f7f7e895740 1 -- 172.21.15.1:0/4175542505 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f6409c0a0 con 0x55b2b56f1ca0 2024-09-19T09:42:36.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.808+0000 7f7f5dffb640 1 -- 172.21.15.1:0/4175542505 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7f6409fd50 con 0x55b2b56f1ca0 2024-09-19T09:42:36.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.808+0000 7f7f7e895740 10 client.16002 fetch_fsmap learned FSMap version 19 2024-09-19T09:42:36.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.808+0000 7f7f7e895740 1 -- 172.21.15.1:0/4175542505 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55b2b570f090 con 0x55b2b56f1ca0 2024-09-19T09:42:36.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.808+0000 7f7f5dffb640 1 -- 172.21.15.1:0/4175542505 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f6409c0a0 con 0x55b2b56f1ca0 2024-09-19T09:42:36.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.808+0000 7f7f5dffb640 1 -- 172.21.15.1:0/4175542505 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f7f64075e30 con 0x55b2b56f1ca0 2024-09-19T09:42:36.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.808+0000 7f7f7e895740 10 client.16002 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:42:36.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.808+0000 7f7f7e895740 10 client.16002 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:36.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.808+0000 7f7f7e895740 20 client.16002 populate_metadata read hostname 'smithi001' 2024-09-19T09:42:36.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.808+0000 7f7f7e895740 1 --2- 172.21.15.1:0/4175542505 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b2b57103e0 0x55b2b57127d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:36.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.808+0000 7f7f7e895740 4 client.16002 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:42:36.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.808+0000 7f7f7e895740 1 -- 172.21.15.1:0/4175542505 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2b5664850 con 0x55b2b57103e0 2024-09-19T09:42:36.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.809+0000 7f7f7a258640 1 --2- 172.21.15.1:0/4175542505 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b2b57103e0 0x55b2b57127d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:36.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.809+0000 7f7f7a258640 1 --2- 172.21.15.1:0/4175542505 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b2b57103e0 0x55b2b57127d0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a34143db96af70c server_cookie=a629e439f7e85e66 in_seq=0 out_seq=0 2024-09-19T09:42:36.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.809+0000 7f7f5dffb640 10 client.16002 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:36.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.810+0000 7f7f5dffb640 1 -- 172.21.15.1:0/4175542505 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b2b5664850 con 0x55b2b57103e0 2024-09-19T09:42:36.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.810+0000 7f7f5dffb640 10 client.16002 handle_command_reply: tid=0 2024-09-19T09:42:36.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.810+0000 7f7f7e895740 1 client.16002 shutdown 2024-09-19T09:42:36.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.810+0000 7f7f7e895740 1 -- 172.21.15.1:0/4175542505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b2b56f1ca0 msgr2=0x55b2b56fd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:36.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.810+0000 7f7f7e895740 1 --2- 172.21.15.1:0/4175542505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b2b56f1ca0 0x55b2b56fd6d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f7f64098370 tx=0x7f7f6409b380 comp rx=0 tx=0).stop 2024-09-19T09:42:36.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.810+0000 7f7f7e895740 1 -- 172.21.15.1:0/4175542505 shutdown_connections 2024-09-19T09:42:36.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.810+0000 7f7f7e895740 1 --2- 172.21.15.1:0/4175542505 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b2b57103e0 0x55b2b57127d0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.810+0000 7f7f7e895740 1 --2- 172.21.15.1:0/4175542505 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b2b5700a90 0x55b2b56fdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.810+0000 7f7f7e895740 1 --2- 172.21.15.1:0/4175542505 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b2b56f1ca0 0x55b2b56fd6d0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.810+0000 7f7f7e895740 1 --2- 172.21.15.1:0/4175542505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2b56f1380 0x55b2b57003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.810+0000 7f7f7e895740 1 -- 172.21.15.1:0/4175542505 >> 172.21.15.1:0/4175542505 conn(0x55b2b56eda30 msgr2=0x55b2b56f3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:36.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.810+0000 7f7f5dffb640 0 client.16002 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:36.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.810+0000 7f7f7e895740 1 -- 172.21.15.1:0/4175542505 shutdown_connections 2024-09-19T09:42:36.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.810+0000 7f7f7e895740 1 -- 172.21.15.1:0/4175542505 wait complete. 2024-09-19T09:42:36.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.810+0000 7f7f7e895740 20 client.16002 trim_cache size 0 max 16384 2024-09-19T09:42:36.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.828+0000 7f7f7e895740 1 Processor -- start 2024-09-19T09:42:36.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.828+0000 7f7f7e895740 1 -- start start 2024-09-19T09:42:36.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.828+0000 7f7f7e895740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2b56f1380 0x55b2b56fa930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:36.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.828+0000 7f7f7e895740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b2b56f1ca0 0x55b2b56fae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:36.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.828+0000 7f7f7e895740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b2b5700a90 0x55b2b56fbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:36.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.828+0000 7f7f7e895740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7f741a9400 con 0x55b2b5700a90 2024-09-19T09:42:36.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.828+0000 7f7f7e895740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7f741abca0 con 0x55b2b56f1380 2024-09-19T09:42:36.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.828+0000 7f7f7e895740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7f741a9a90 con 0x55b2b56f1ca0 2024-09-19T09:42:36.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.828+0000 7f7f7aa59640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b2b5700a90 0x55b2b56fbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:36.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.828+0000 7f7f7aa59640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b2b5700a90 0x55b2b56fbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34756/0 (socket says 172.21.15.1:34756) 2024-09-19T09:42:36.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.828+0000 7f7f7aa59640 1 -- 172.21.15.1:0/3880846240 learned_addr learned my addr 172.21.15.1:0/3880846240 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:36.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.828+0000 7f7f7a258640 1 --2- 172.21.15.1:0/3880846240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2b56f1380 0x55b2b56fa930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:36.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.828+0000 7f7f79a57640 1 --2- 172.21.15.1:0/3880846240 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b2b56f1ca0 0x55b2b56fae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:36.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.829+0000 7f7f7aa59640 1 -- 172.21.15.1:0/3880846240 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b2b56f1ca0 msgr2=0x55b2b56fae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:36.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.829+0000 7f7f7aa59640 1 --2- 172.21.15.1:0/3880846240 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b2b56f1ca0 0x55b2b56fae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.829+0000 7f7f7aa59640 1 -- 172.21.15.1:0/3880846240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2b56f1380 msgr2=0x55b2b56fa930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:36.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.829+0000 7f7f7aa59640 1 --2- 172.21.15.1:0/3880846240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2b56f1380 0x55b2b56fa930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.829+0000 7f7f7aa59640 1 -- 172.21.15.1:0/3880846240 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2b56fbc20 con 0x55b2b5700a90 2024-09-19T09:42:36.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.829+0000 7f7f7aa59640 1 --2- 172.21.15.1:0/3880846240 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b2b5700a90 0x55b2b56fbe70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c003bb0 tx=0x7f7f6c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255965120a9016d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:36.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.829+0000 7f7f5ffff640 1 -- 172.21.15.1:0/3880846240 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c004030 con 0x55b2b5700a90 2024-09-19T09:42:36.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.830+0000 7f7f5ffff640 1 -- 172.21.15.1:0/3880846240 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f6c036040 con 0x55b2b5700a90 2024-09-19T09:42:36.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.830+0000 7f7f5ffff640 1 -- 172.21.15.1:0/3880846240 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c02fa30 con 0x55b2b5700a90 2024-09-19T09:42:36.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.830+0000 7f7f7e895740 1 -- 172.21.15.1:0/3880846240 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b2b5700a90 msgr2=0x55b2b56fbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:36.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.830+0000 7f7f7e895740 1 --2- 172.21.15.1:0/3880846240 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b2b5700a90 0x55b2b56fbe70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c003bb0 tx=0x7f7f6c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.830+0000 7f7f7e895740 1 -- 172.21.15.1:0/3880846240 shutdown_connections 2024-09-19T09:42:36.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.830+0000 7f7f7e895740 1 --2- 172.21.15.1:0/3880846240 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b2b5700a90 0x55b2b56fbe70 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.830+0000 7f7f7e895740 1 --2- 172.21.15.1:0/3880846240 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b2b56f1ca0 0x55b2b56fae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.830+0000 7f7f7e895740 1 --2- 172.21.15.1:0/3880846240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2b56f1380 0x55b2b56fa930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.830+0000 7f7f7e895740 1 -- 172.21.15.1:0/3880846240 >> 172.21.15.1:0/3880846240 conn(0x55b2b56eda30 msgr2=0x55b2b56f8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:36.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.831+0000 7f7f7e895740 1 -- 172.21.15.1:0/3880846240 shutdown_connections 2024-09-19T09:42:36.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.831+0000 7f7f7e895740 1 -- 172.21.15.1:0/3880846240 wait complete. 2024-09-19T09:42:36.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.831+0000 7f7f7e895740 1 -- start start 2024-09-19T09:42:36.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.831+0000 7f7f7e895740 1 Processor -- start 2024-09-19T09:42:36.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.831+0000 7f7f7e895740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2b56f1380 0x55b2b5712570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:36.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.831+0000 7f7f7e895740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b2b56f1ca0 0x55b2b5712ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:36.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.831+0000 7f7f7e895740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b2b5700a90 0x55b2b5778d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:36.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.832+0000 7f7f7e895740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7f741aa160 con 0x55b2b5700a90 2024-09-19T09:42:36.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.832+0000 7f7f7aa59640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b2b5700a90 0x55b2b5778d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:36.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.832+0000 7f7f7aa59640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b2b5700a90 0x55b2b5778d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34764/0 (socket says 172.21.15.1:34764) 2024-09-19T09:42:36.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.832+0000 7f7f7aa59640 1 -- 172.21.15.1:0/611976036 learned_addr learned my addr 172.21.15.1:0/611976036 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:36.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.832+0000 7f7f7e895740 1 -- 172.21.15.1:0/611976036 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7f741ab5d0 con 0x55b2b56f1380 2024-09-19T09:42:36.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.832+0000 7f7f7e895740 1 -- 172.21.15.1:0/611976036 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7f741aa830 con 0x55b2b56f1ca0 2024-09-19T09:42:36.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.832+0000 7f7f7a258640 1 --2- 172.21.15.1:0/611976036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2b56f1380 0x55b2b5712570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:36.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.832+0000 7f7f79a57640 1 --2- 172.21.15.1:0/611976036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b2b56f1ca0 0x55b2b5712ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:36.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.832+0000 7f7f7e895740 10 client.0 _ll_register_callbacks cb 0x7f7f700095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:36.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.832+0000 7f7f7a258640 1 -- 172.21.15.1:0/611976036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b2b56f1ca0 msgr2=0x55b2b5712ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:36.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.832+0000 7f7f7a258640 1 --2- 172.21.15.1:0/611976036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b2b56f1ca0 0x55b2b5712ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.832+0000 7f7f7a258640 1 -- 172.21.15.1:0/611976036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b2b5700a90 msgr2=0x55b2b5778d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:36.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.832+0000 7f7f7a258640 1 --2- 172.21.15.1:0/611976036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b2b5700a90 0x55b2b5778d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.832+0000 7f7f7a258640 1 -- 172.21.15.1:0/611976036 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2b5779250 con 0x55b2b56f1380 2024-09-19T09:42:36.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.832+0000 7f7f7aa59640 1 --2- 172.21.15.1:0/611976036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b2b5700a90 0x55b2b5778d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:36.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.832+0000 7f7f7a258640 1 --2- 172.21.15.1:0/611976036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2b56f1380 0x55b2b5712570 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7f70009fd0 tx=0x7f7f70014840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e15f6a8179188599 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:36.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.832+0000 7f7f5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:42:36.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.833+0000 7f7f5dffb640 1 -- 172.21.15.1:0/611976036 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f70023020 con 0x55b2b56f1380 2024-09-19T09:42:36.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.833+0000 7f7f5dffb640 1 -- 172.21.15.1:0/611976036 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f7f70004250 con 0x55b2b56f1380 2024-09-19T09:42:36.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.833+0000 7f7f7e895740 1 -- 172.21.15.1:0/611976036 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f6c036040 con 0x55b2b56f1380 2024-09-19T09:42:36.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.833+0000 7f7f5dffb640 1 -- 172.21.15.1:0/611976036 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7f70004450 con 0x55b2b56f1380 2024-09-19T09:42:36.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.833+0000 7f7f7e895740 10 client.25658 fetch_fsmap learned FSMap version 19 2024-09-19T09:42:36.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.833+0000 7f7f7e895740 1 -- 172.21.15.1:0/611976036 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55b2b577a410 con 0x55b2b56f1380 2024-09-19T09:42:36.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.833+0000 7f7f5dffb640 1 -- 172.21.15.1:0/611976036 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f6c036040 con 0x55b2b56f1380 2024-09-19T09:42:36.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.833+0000 7f7f5dffb640 1 -- 172.21.15.1:0/611976036 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f7f7000f040 con 0x55b2b56f1380 2024-09-19T09:42:36.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.833+0000 7f7f7e895740 10 client.25658 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:42:36.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.833+0000 7f7f7e895740 10 client.25658 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:36.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.834+0000 7f7f7e895740 20 client.25658 populate_metadata read hostname 'smithi001' 2024-09-19T09:42:36.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.834+0000 7f7f7e895740 1 --2- 172.21.15.1:0/611976036 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b2b577ab60 0x55b2b577cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:36.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.834+0000 7f7f7e895740 4 client.25658 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:42:36.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.834+0000 7f7f7e895740 1 -- 172.21.15.1:0/611976036 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b2b565ed60 con 0x55b2b577ab60 2024-09-19T09:42:36.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.834+0000 7f7f79a57640 1 --2- 172.21.15.1:0/611976036 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b2b577ab60 0x55b2b577cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:36.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.834+0000 7f7f5dffb640 10 client.25658 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:36.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.834+0000 7f7f79a57640 1 --2- 172.21.15.1:0/611976036 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b2b577ab60 0x55b2b577cfa0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=643c5c4f5cb0cae5 server_cookie=e4bbfbfcd04cc93f in_seq=0 out_seq=0 2024-09-19T09:42:36.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.834+0000 7f7f5dffb640 1 -- 172.21.15.1:0/611976036 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b2b565ed60 con 0x55b2b577ab60 2024-09-19T09:42:36.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.834+0000 7f7f5dffb640 10 client.25658 handle_command_reply: tid=0 2024-09-19T09:42:36.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.835+0000 7f7f7e895740 1 client.25658 shutdown 2024-09-19T09:42:36.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.835+0000 7f7f7e895740 1 -- 172.21.15.1:0/611976036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2b56f1380 msgr2=0x55b2b5712570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:36.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.835+0000 7f7f7e895740 1 --2- 172.21.15.1:0/611976036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2b56f1380 0x55b2b5712570 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7f70009fd0 tx=0x7f7f70014840 comp rx=0 tx=0).stop 2024-09-19T09:42:36.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.835+0000 7f7f7e895740 1 -- 172.21.15.1:0/611976036 shutdown_connections 2024-09-19T09:42:36.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.835+0000 7f7f7e895740 1 --2- 172.21.15.1:0/611976036 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b2b577ab60 0x55b2b577cfa0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.835+0000 7f7f7e895740 1 --2- 172.21.15.1:0/611976036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b2b5700a90 0x55b2b5778d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.835+0000 7f7f7e895740 1 --2- 172.21.15.1:0/611976036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b2b56f1ca0 0x55b2b5712ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.835+0000 7f7f5dffb640 0 client.25658 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:36.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.835+0000 7f7f7e895740 1 --2- 172.21.15.1:0/611976036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b2b56f1380 0x55b2b5712570 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.835+0000 7f7f7e895740 1 -- 172.21.15.1:0/611976036 >> 172.21.15.1:0/611976036 conn(0x55b2b56eda30 msgr2=0x55b2b56fef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:36.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.835+0000 7f7f7e895740 1 -- 172.21.15.1:0/611976036 shutdown_connections 2024-09-19T09:42:36.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.835+0000 7f7f7e895740 1 -- 172.21.15.1:0/611976036 wait complete. 2024-09-19T09:42:36.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.836+0000 7f7f7e895740 20 client.25658 trim_cache size 0 max 16384 2024-09-19T09:42:36.842 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:42:36.842 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "no active scrubs running", 2024-09-19T09:42:36.842 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": {} 2024-09-19T09:42:36.843 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:42:36.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.836+0000 7f7f7c4bc640 1 -- 172.21.15.1:0/1252463925 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f7f600a3240 msgr2=0x7f7f600a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:36.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.836+0000 7f7f7c4bc640 1 --2- 172.21.15.1:0/1252463925 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f7f600a3240 0x7f7f600a5700 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c006010 tx=0x7f7f6c02f3e0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.836+0000 7f7f7c4bc640 1 -- 172.21.15.1:0/1252463925 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f74102780 msgr2=0x7f7f74198940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:36.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.836+0000 7f7f7c4bc640 1 --2- 172.21.15.1:0/1252463925 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f74102780 0x7f7f74198940 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f7f6400d950 tx=0x7f7f6400de10 comp rx=0 tx=0).stop 2024-09-19T09:42:36.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.837+0000 7f7f7c4bc640 1 -- 172.21.15.1:0/1252463925 shutdown_connections 2024-09-19T09:42:36.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.837+0000 7f7f7c4bc640 1 --2- 172.21.15.1:0/1252463925 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f74106f00 0x7f7f7419ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.837+0000 7f7f7c4bc640 1 --2- 172.21.15.1:0/1252463925 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f74102780 0x7f7f74198940 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.837+0000 7f7f7c4bc640 1 --2- 172.21.15.1:0/1252463925 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f7f600a3240 0x7f7f600a5700 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.837+0000 7f7f7c4bc640 1 --2- 172.21.15.1:0/1252463925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f74101dd0 0x7f7f74198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:36.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.837+0000 7f7f7c4bc640 1 -- 172.21.15.1:0/1252463925 >> 172.21.15.1:0/1252463925 conn(0x7f7f740fd8b0 msgr2=0x7f7f740feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:36.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.837+0000 7f7f7c4bc640 1 -- 172.21.15.1:0/1252463925 shutdown_connections 2024-09-19T09:42:36.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:36.837+0000 7f7f7c4bc640 1 -- 172.21.15.1:0/1252463925 wait complete. 2024-09-19T09:42:36.850 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:42:37.450 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:37 smithi001 ceph-mon[31225]: pgmap v474: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.9 KiB/s wr, 4 op/s 2024-09-19T09:42:37.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:37 smithi022 ceph-mon[35583]: pgmap v474: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.9 KiB/s wr, 4 op/s 2024-09-19T09:42:37.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:37 smithi121 ceph-mon[35577]: pgmap v474: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.9 KiB/s wr, 4 op/s 2024-09-19T09:42:37.636 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:42:37.636 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:42:38.060 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.057+0000 7ff76afc4640 1 -- 172.21.15.1:0/3675279205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7641025c0 msgr2=0x7ff7641049b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.057+0000 7ff76afc4640 1 --2- 172.21.15.1:0/3675279205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7641025c0 0x7ff7641049b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff754009900 tx=0x7ff75402a410 comp rx=0 tx=0).stop 2024-09-19T09:42:38.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.057+0000 7ff76afc4640 1 -- 172.21.15.1:0/3675279205 shutdown_connections 2024-09-19T09:42:38.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.057+0000 7ff76afc4640 1 --2- 172.21.15.1:0/3675279205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff764107820 0x7ff764109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.057+0000 7ff76afc4640 1 --2- 172.21.15.1:0/3675279205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff764104ef0 0x7ff7641072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.057+0000 7ff76afc4640 1 --2- 172.21.15.1:0/3675279205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff7641025c0 0x7ff7641049b0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.057+0000 7ff76afc4640 1 -- 172.21.15.1:0/3675279205 >> 172.21.15.1:0/3675279205 conn(0x7ff7640fc1c0 msgr2=0x7ff7640fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:38.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.057+0000 7ff76afc4640 1 -- 172.21.15.1:0/3675279205 shutdown_connections 2024-09-19T09:42:38.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.057+0000 7ff76afc4640 1 -- 172.21.15.1:0/3675279205 wait complete. 2024-09-19T09:42:38.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.058+0000 7ff76afc4640 1 Processor -- start 2024-09-19T09:42:38.061 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.058+0000 7ff76afc4640 1 -- start start 2024-09-19T09:42:38.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.058+0000 7ff76afc4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7641025c0 0x7ff764197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.058+0000 7ff76afc4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff764104ef0 0x7ff7641983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.058+0000 7ff76afc4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff764107820 0x7ff76419f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.058+0000 7ff76afc4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff76410d800 con 0x7ff764107820 2024-09-19T09:42:38.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.058+0000 7ff76afc4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff76410d680 con 0x7ff764104ef0 2024-09-19T09:42:38.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.058+0000 7ff76afc4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff76410d980 con 0x7ff7641025c0 2024-09-19T09:42:38.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.058+0000 7ff769561640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff764107820 0x7ff76419f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.058+0000 7ff769561640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff764107820 0x7ff76419f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34776/0 (socket says 172.21.15.1:34776) 2024-09-19T09:42:38.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.059+0000 7ff769561640 1 -- 172.21.15.1:0/1157648371 learned_addr learned my addr 172.21.15.1:0/1157648371 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:38.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.059+0000 7ff763fff640 1 --2- 172.21.15.1:0/1157648371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff764104ef0 0x7ff7641983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.059+0000 7ff768d60640 1 --2- 172.21.15.1:0/1157648371 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7641025c0 0x7ff764197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.059+0000 7ff769561640 1 -- 172.21.15.1:0/1157648371 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7641025c0 msgr2=0x7ff764197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.059+0000 7ff769561640 1 --2- 172.21.15.1:0/1157648371 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7641025c0 0x7ff764197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.059+0000 7ff769561640 1 -- 172.21.15.1:0/1157648371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff764104ef0 msgr2=0x7ff7641983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.059+0000 7ff769561640 1 --2- 172.21.15.1:0/1157648371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff764104ef0 0x7ff7641983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.059+0000 7ff769561640 1 -- 172.21.15.1:0/1157648371 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff76419fab0 con 0x7ff764107820 2024-09-19T09:42:38.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.059+0000 7ff763fff640 1 --2- 172.21.15.1:0/1157648371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff764104ef0 0x7ff7641983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:38.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.059+0000 7ff768d60640 1 --2- 172.21.15.1:0/1157648371 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7641025c0 0x7ff764197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:38.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.059+0000 7ff769561640 1 --2- 172.21.15.1:0/1157648371 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff764107820 0x7ff76419f440 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00dac0 tx=0x7ff75c00df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:38.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.059+0000 7ff761ffb640 1 -- 172.21.15.1:0/1157648371 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c017070 con 0x7ff764107820 2024-09-19T09:42:38.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.059+0000 7ff761ffb640 1 -- 172.21.15.1:0/1157648371 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff75c003e50 con 0x7ff764107820 2024-09-19T09:42:38.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.059+0000 7ff761ffb640 1 -- 172.21.15.1:0/1157648371 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c0106c0 con 0x7ff764107820 2024-09-19T09:42:38.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.059+0000 7ff76afc4640 1 -- 172.21.15.1:0/1157648371 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff76419fda0 con 0x7ff764107820 2024-09-19T09:42:38.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.059+0000 7ff76afc4640 1 -- 172.21.15.1:0/1157648371 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7641a0260 con 0x7ff764107820 2024-09-19T09:42:38.070 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.062+0000 7ff76de39740 1 Processor -- start 2024-09-19T09:42:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.063+0000 7ff761ffb640 1 -- 172.21.15.1:0/1157648371 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7ff75c003970 con 0x7ff764107820 2024-09-19T09:42:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.063+0000 7ff76de39740 1 -- start start 2024-09-19T09:42:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.063+0000 7ff76de39740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cf69c09a0 0x563cf69c0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.063+0000 7ff76de39740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cf69c12e0 0x563cf69c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.063+0000 7ff76de39740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cf69c6370 0x563cf69c8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.063+0000 7ff76de39740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563cf69242f0 con 0x563cf69c09a0 2024-09-19T09:42:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.063+0000 7ff76de39740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563cf68cc270 con 0x563cf69c12e0 2024-09-19T09:42:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.063+0000 7ff76de39740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563cf69202b0 con 0x563cf69c6370 2024-09-19T09:42:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.063+0000 7ff763fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cf69c09a0 0x563cf69c0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.063+0000 7ff763fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cf69c09a0 0x563cf69c0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34782/0 (socket says 172.21.15.1:34782) 2024-09-19T09:42:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.063+0000 7ff763fff640 1 -- 172.21.15.1:0/1698687797 learned_addr learned my addr 172.21.15.1:0/1698687797 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.063+0000 7ff768d60640 1 --2- 172.21.15.1:0/1698687797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cf69c12e0 0x563cf69c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.063+0000 7ff763fff640 1 --2- 172.21.15.1:0/1698687797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cf69c6370 0x563cf69c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.063+0000 7ff763fff640 1 -- 172.21.15.1:0/1698687797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cf69c6370 msgr2=0x563cf69c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:38.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.063+0000 7ff763fff640 1 --2- 172.21.15.1:0/1698687797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cf69c6370 0x563cf69c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.063+0000 7ff763fff640 1 -- 172.21.15.1:0/1698687797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cf69c12e0 msgr2=0x563cf69c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:38.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.063+0000 7ff763fff640 1 --2- 172.21.15.1:0/1698687797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cf69c12e0 0x563cf69c5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.063+0000 7ff763fff640 1 -- 172.21.15.1:0/1698687797 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cf68cb340 con 0x563cf69c09a0 2024-09-19T09:42:38.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.063+0000 7ff761ffb640 1 --2- 172.21.15.1:0/1157648371 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff7500a32c0 0x7ff7500a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.064+0000 7ff763fff640 1 --2- 172.21.15.1:0/1698687797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cf69c09a0 0x563cf69c0da0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff74c012490 tx=0x7ff74c008600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f907605cc4ead3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:38.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.064+0000 7ff768d60640 1 --2- 172.21.15.1:0/1157648371 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff7500a32c0 0x7ff7500a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.064+0000 7ff761ffb640 1 -- 172.21.15.1:0/1157648371 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7ff75c0cf300 con 0x7ff764107820 2024-09-19T09:42:38.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.064+0000 7ff75affd640 1 -- 172.21.15.1:0/1698687797 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74c018030 con 0x563cf69c09a0 2024-09-19T09:42:38.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.064+0000 7ff75affd640 1 -- 172.21.15.1:0/1698687797 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff74c010b20 con 0x563cf69c09a0 2024-09-19T09:42:38.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.064+0000 7ff75affd640 1 -- 172.21.15.1:0/1698687797 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74c01cb90 con 0x563cf69c09a0 2024-09-19T09:42:38.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.065+0000 7ff76de39740 1 -- 172.21.15.1:0/1698687797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cf69c09a0 msgr2=0x563cf69c0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.072 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.065+0000 7ff76de39740 1 --2- 172.21.15.1:0/1698687797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cf69c09a0 0x563cf69c0da0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ff74c012490 tx=0x7ff74c008600 comp rx=0 tx=0).stop 2024-09-19T09:42:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.065+0000 7ff768d60640 1 --2- 172.21.15.1:0/1157648371 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff7500a32c0 0x7ff7500a5780 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x563cf69c1d10 tx=0x7ff754009610 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.065+0000 7ff76de39740 1 -- 172.21.15.1:0/1698687797 shutdown_connections 2024-09-19T09:42:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.065+0000 7ff76de39740 1 --2- 172.21.15.1:0/1698687797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cf69c6370 0x563cf69c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.065+0000 7ff76de39740 1 --2- 172.21.15.1:0/1698687797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cf69c12e0 0x563cf69c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.065+0000 7ff76de39740 1 --2- 172.21.15.1:0/1698687797 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cf69c09a0 0x563cf69c0da0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.065+0000 7ff76de39740 1 -- 172.21.15.1:0/1698687797 >> 172.21.15.1:0/1698687797 conn(0x563cf69bc010 msgr2=0x563cf69bc410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.065+0000 7ff76de39740 1 -- 172.21.15.1:0/1698687797 shutdown_connections 2024-09-19T09:42:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.065+0000 7ff76de39740 1 -- 172.21.15.1:0/1698687797 wait complete. 2024-09-19T09:42:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.065+0000 7ff76de39740 1 -- start start 2024-09-19T09:42:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.065+0000 7ff76de39740 1 Processor -- start 2024-09-19T09:42:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.065+0000 7ff76de39740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cf69c09a0 0x563cf69cef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.065+0000 7ff76de39740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cf69c12e0 0x563cf69cf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.065+0000 7ff76de39740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cf69c6370 0x563cf69d6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.066+0000 7ff76de39740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563cf69cd6c0 con 0x563cf69c6370 2024-09-19T09:42:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.066+0000 7ff76de39740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563cf68ad290 con 0x563cf69c09a0 2024-09-19T09:42:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.066+0000 7ff76de39740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563cf69cd840 con 0x563cf69c12e0 2024-09-19T09:42:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.066+0000 7ff76de39740 10 client.0 _ll_register_callbacks cb 0x563cf68de140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.066+0000 7ff769561640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cf69c6370 0x563cf69d6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.066+0000 7ff769561640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cf69c6370 0x563cf69d6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34790/0 (socket says 172.21.15.1:34790) 2024-09-19T09:42:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.066+0000 7ff769561640 1 -- 172.21.15.1:0/1649094016 learned_addr learned my addr 172.21.15.1:0/1649094016 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.066+0000 7ff768d60640 1 --2- 172.21.15.1:0/1649094016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cf69c09a0 0x563cf69cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.066+0000 7ff763fff640 1 --2- 172.21.15.1:0/1649094016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cf69c12e0 0x563cf69cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.066+0000 7ff769561640 1 -- 172.21.15.1:0/1649094016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cf69c12e0 msgr2=0x563cf69cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.066+0000 7ff769561640 1 --2- 172.21.15.1:0/1649094016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cf69c12e0 0x563cf69cf450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.066+0000 7ff769561640 1 -- 172.21.15.1:0/1649094016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cf69c09a0 msgr2=0x563cf69cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.066+0000 7ff769561640 1 --2- 172.21.15.1:0/1649094016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cf69c09a0 0x563cf69cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.066+0000 7ff769561640 1 -- 172.21.15.1:0/1649094016 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cf6637210 con 0x563cf69c6370 2024-09-19T09:42:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.066+0000 7ff763fff640 1 --2- 172.21.15.1:0/1649094016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cf69c12e0 0x563cf69cf450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.066+0000 7ff769561640 1 --2- 172.21.15.1:0/1649094016 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cf69c6370 0x563cf69d6490 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff75c097d80 tx=0x7ff75c09b370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97bfde978c60457e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.066+0000 7ff743fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:42:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.066+0000 7ff743fff640 1 -- 172.21.15.1:0/1649094016 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c020070 con 0x563cf69c6370 2024-09-19T09:42:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.066+0000 7ff743fff640 1 -- 172.21.15.1:0/1649094016 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7ff75c0041b0 con 0x563cf69c6370 2024-09-19T09:42:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.066+0000 7ff76de39740 1 -- 172.21.15.1:0/1649094016 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff74c010b20 con 0x563cf69c6370 2024-09-19T09:42:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.067+0000 7ff743fff640 1 -- 172.21.15.1:0/1649094016 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff75c09fcd0 con 0x563cf69c6370 2024-09-19T09:42:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.067+0000 7ff76de39740 10 client.16020 fetch_fsmap learned FSMap version 19 2024-09-19T09:42:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.067+0000 7ff76de39740 1 -- 172.21.15.1:0/1649094016 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x563cf6703620 con 0x563cf69c6370 2024-09-19T09:42:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.067+0000 7ff743fff640 1 -- 172.21.15.1:0/1649094016 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff74c010b20 con 0x563cf69c6370 2024-09-19T09:42:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.067+0000 7ff743fff640 1 -- 172.21.15.1:0/1649094016 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff75c023060 con 0x563cf69c6370 2024-09-19T09:42:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.067+0000 7ff76de39740 10 client.16020 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:42:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.067+0000 7ff76de39740 10 client.16020 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:38.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.067+0000 7ff76de39740 20 client.16020 populate_metadata read hostname 'smithi001' 2024-09-19T09:42:38.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.067+0000 7ff76de39740 1 --2- 172.21.15.1:0/1649094016 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563cf69dabc0 0x563cf69dcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.067+0000 7ff76de39740 4 client.16020 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:42:38.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.067+0000 7ff76de39740 1 -- 172.21.15.1:0/1649094016 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563cf6931a20 con 0x563cf69dabc0 2024-09-19T09:42:38.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.067+0000 7ff768d60640 1 --2- 172.21.15.1:0/1649094016 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563cf69dabc0 0x563cf69dcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.068+0000 7ff743fff640 10 client.16020 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:38.076 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.068+0000 7ff768d60640 1 --2- 172.21.15.1:0/1649094016 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563cf69dabc0 0x563cf69dcfb0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c61da79a715a1f9 server_cookie=42ed2c55363f9ad1 in_seq=0 out_seq=0 2024-09-19T09:42:38.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.068+0000 7ff743fff640 1 -- 172.21.15.1:0/1649094016 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563cf6931a20 con 0x563cf69dabc0 2024-09-19T09:42:38.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.068+0000 7ff743fff640 10 client.16020 handle_command_reply: tid=0 2024-09-19T09:42:38.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.068+0000 7ff76de39740 1 client.16020 shutdown 2024-09-19T09:42:38.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.069+0000 7ff76de39740 1 -- 172.21.15.1:0/1649094016 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cf69c6370 msgr2=0x563cf69d6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.069+0000 7ff76de39740 1 --2- 172.21.15.1:0/1649094016 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cf69c6370 0x563cf69d6490 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff75c097d80 tx=0x7ff75c09b370 comp rx=0 tx=0).stop 2024-09-19T09:42:38.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.069+0000 7ff76de39740 1 -- 172.21.15.1:0/1649094016 shutdown_connections 2024-09-19T09:42:38.077 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.069+0000 7ff76de39740 1 --2- 172.21.15.1:0/1649094016 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563cf69dabc0 0x563cf69dcfb0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.069+0000 7ff76de39740 1 --2- 172.21.15.1:0/1649094016 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cf69c6370 0x563cf69d6490 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.069+0000 7ff743fff640 0 client.16020 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:38.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.069+0000 7ff76de39740 1 --2- 172.21.15.1:0/1649094016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cf69c12e0 0x563cf69cf450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.069+0000 7ff76de39740 1 --2- 172.21.15.1:0/1649094016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cf69c09a0 0x563cf69cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.069+0000 7ff76de39740 1 -- 172.21.15.1:0/1649094016 >> 172.21.15.1:0/1649094016 conn(0x563cf69bc010 msgr2=0x563cf69bd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:38.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.069+0000 7ff76de39740 1 -- 172.21.15.1:0/1649094016 shutdown_connections 2024-09-19T09:42:38.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.069+0000 7ff76de39740 1 -- 172.21.15.1:0/1649094016 wait complete. 2024-09-19T09:42:38.078 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.069+0000 7ff76de39740 20 client.16020 trim_cache size 0 max 16384 2024-09-19T09:42:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.083+0000 7ff76de39740 1 Processor -- start 2024-09-19T09:42:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.083+0000 7ff76de39740 1 -- start start 2024-09-19T09:42:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.084+0000 7ff76de39740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cf69c09a0 0x563cf69bb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.084+0000 7ff76de39740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cf69c12e0 0x563cf69d6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.084+0000 7ff76de39740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cf69c6370 0x563cf69bd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.084+0000 7ff76de39740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff7641a4e20 con 0x563cf69c6370 2024-09-19T09:42:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.084+0000 7ff76de39740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff7641a76c0 con 0x563cf69c12e0 2024-09-19T09:42:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.084+0000 7ff76de39740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff7641a54b0 con 0x563cf69c09a0 2024-09-19T09:42:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.084+0000 7ff769561640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cf69c6370 0x563cf69bd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.084+0000 7ff769561640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cf69c6370 0x563cf69bd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34800/0 (socket says 172.21.15.1:34800) 2024-09-19T09:42:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.084+0000 7ff769561640 1 -- 172.21.15.1:0/738801 learned_addr learned my addr 172.21.15.1:0/738801 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.084+0000 7ff763fff640 1 --2- 172.21.15.1:0/738801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cf69c12e0 0x563cf69d6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.084+0000 7ff768d60640 1 --2- 172.21.15.1:0/738801 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cf69c09a0 0x563cf69bb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.084+0000 7ff769561640 1 -- 172.21.15.1:0/738801 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cf69c09a0 msgr2=0x563cf69bb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.084+0000 7ff769561640 1 --2- 172.21.15.1:0/738801 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cf69c09a0 0x563cf69bb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.084+0000 7ff769561640 1 -- 172.21.15.1:0/738801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cf69c12e0 msgr2=0x563cf69d6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.084+0000 7ff769561640 1 --2- 172.21.15.1:0/738801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cf69c12e0 0x563cf69d6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.084+0000 7ff769561640 1 -- 172.21.15.1:0/738801 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cf69cdfa0 con 0x563cf69c6370 2024-09-19T09:42:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.084+0000 7ff769561640 1 --2- 172.21.15.1:0/738801 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cf69c6370 0x563cf69bd400 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff75c004160 tx=0x7ff75c09b020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e520024f9c8c383 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.084+0000 7ff75a7fc640 1 -- 172.21.15.1:0/738801 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c020030 con 0x563cf69c6370 2024-09-19T09:42:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.085+0000 7ff75a7fc640 1 -- 172.21.15.1:0/738801 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff75c0ba2a0 con 0x563cf69c6370 2024-09-19T09:42:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.085+0000 7ff75a7fc640 1 -- 172.21.15.1:0/738801 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c09a8b0 con 0x563cf69c6370 2024-09-19T09:42:38.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.085+0000 7ff76de39740 1 -- 172.21.15.1:0/738801 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cf69c6370 msgr2=0x563cf69bd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.085+0000 7ff76de39740 1 --2- 172.21.15.1:0/738801 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cf69c6370 0x563cf69bd400 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff75c004160 tx=0x7ff75c09b020 comp rx=0 tx=0).stop 2024-09-19T09:42:38.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.085+0000 7ff76de39740 1 -- 172.21.15.1:0/738801 shutdown_connections 2024-09-19T09:42:38.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.085+0000 7ff76de39740 1 --2- 172.21.15.1:0/738801 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cf69c6370 0x563cf69bd400 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.085+0000 7ff76de39740 1 --2- 172.21.15.1:0/738801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cf69c12e0 0x563cf69d6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.085+0000 7ff76de39740 1 --2- 172.21.15.1:0/738801 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cf69c09a0 0x563cf69bb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.085+0000 7ff76de39740 1 -- 172.21.15.1:0/738801 >> 172.21.15.1:0/738801 conn(0x563cf69bc010 msgr2=0x563cf69ba9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:38.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.085+0000 7ff76de39740 1 -- 172.21.15.1:0/738801 shutdown_connections 2024-09-19T09:42:38.092 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.085+0000 7ff76de39740 1 -- 172.21.15.1:0/738801 wait complete. 2024-09-19T09:42:38.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.086+0000 7ff76de39740 1 -- start start 2024-09-19T09:42:38.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.086+0000 7ff76de39740 1 Processor -- start 2024-09-19T09:42:38.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.086+0000 7ff76de39740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cf69c09a0 0x563cf69d3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.086+0000 7ff76de39740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cf69c12e0 0x563cf69d4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.086+0000 7ff76de39740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cf69c6370 0x563cf69d5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.086+0000 7ff76de39740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff7641a5b80 con 0x563cf69c12e0 2024-09-19T09:42:38.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.086+0000 7ff76de39740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff7641a6ff0 con 0x563cf69c09a0 2024-09-19T09:42:38.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.086+0000 7ff76de39740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff7641a6250 con 0x563cf69c6370 2024-09-19T09:42:38.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.086+0000 7ff76de39740 10 client.0 _ll_register_callbacks cb 0x7ff75c0048c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:38.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.086+0000 7ff763fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cf69c12e0 0x563cf69d4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.086+0000 7ff763fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cf69c12e0 0x563cf69d4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34810/0 (socket says 172.21.15.1:34810) 2024-09-19T09:42:38.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.086+0000 7ff763fff640 1 -- 172.21.15.1:0/2983216651 learned_addr learned my addr 172.21.15.1:0/2983216651 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:38.093 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.086+0000 7ff768d60640 1 --2- 172.21.15.1:0/2983216651 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cf69c09a0 0x563cf69d3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.087+0000 7ff769561640 1 --2- 172.21.15.1:0/2983216651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cf69c6370 0x563cf69d5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.087+0000 7ff763fff640 1 -- 172.21.15.1:0/2983216651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cf69c6370 msgr2=0x563cf69d5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.087+0000 7ff763fff640 1 --2- 172.21.15.1:0/2983216651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cf69c6370 0x563cf69d5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.087+0000 7ff763fff640 1 -- 172.21.15.1:0/2983216651 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cf69c09a0 msgr2=0x563cf69d3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.087+0000 7ff763fff640 1 --2- 172.21.15.1:0/2983216651 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cf69c09a0 0x563cf69d3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.087+0000 7ff763fff640 1 -- 172.21.15.1:0/2983216651 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cf69d5a60 con 0x563cf69c12e0 2024-09-19T09:42:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.087+0000 7ff769561640 1 --2- 172.21.15.1:0/2983216651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cf69c6370 0x563cf69d5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:42:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.087+0000 7ff763fff640 1 --2- 172.21.15.1:0/2983216651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cf69c12e0 0x563cf69d4490 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff74c012460 tx=0x7ff74c008310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=991fec299915e91b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.087+0000 7ff743fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:42:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.087+0000 7ff743fff640 1 -- 172.21.15.1:0/2983216651 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74c018040 con 0x563cf69c12e0 2024-09-19T09:42:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.087+0000 7ff743fff640 1 -- 172.21.15.1:0/2983216651 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7ff74c01cc50 con 0x563cf69c12e0 2024-09-19T09:42:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.087+0000 7ff76de39740 1 -- 172.21.15.1:0/2983216651 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff75c0ba2a0 con 0x563cf69c12e0 2024-09-19T09:42:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.087+0000 7ff743fff640 1 -- 172.21.15.1:0/2983216651 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff74c01ce50 con 0x563cf69c12e0 2024-09-19T09:42:38.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.087+0000 7ff76de39740 10 client.16026 fetch_fsmap learned FSMap version 19 2024-09-19T09:42:38.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.087+0000 7ff76de39740 1 -- 172.21.15.1:0/2983216651 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x563cf6a45c10 con 0x563cf69c12e0 2024-09-19T09:42:38.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.087+0000 7ff743fff640 1 -- 172.21.15.1:0/2983216651 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff75c0ba2a0 con 0x563cf69c12e0 2024-09-19T09:42:38.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.088+0000 7ff743fff640 1 -- 172.21.15.1:0/2983216651 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff74c004c00 con 0x563cf69c12e0 2024-09-19T09:42:38.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.088+0000 7ff76de39740 10 client.16026 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:42:38.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.088+0000 7ff76de39740 10 client.16026 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:38.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.088+0000 7ff76de39740 20 client.16026 populate_metadata read hostname 'smithi001' 2024-09-19T09:42:38.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.088+0000 7ff76de39740 1 --2- 172.21.15.1:0/2983216651 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563cf69dabc0 0x563cf6a482c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.088+0000 7ff76de39740 4 client.16026 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:42:38.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.088+0000 7ff76de39740 1 -- 172.21.15.1:0/2983216651 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563cf692bd70 con 0x563cf69dabc0 2024-09-19T09:42:38.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.088+0000 7ff768d60640 1 --2- 172.21.15.1:0/2983216651 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563cf69dabc0 0x563cf6a482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.088+0000 7ff768d60640 1 --2- 172.21.15.1:0/2983216651 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563cf69dabc0 0x563cf6a482c0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad4ef5d900a3dab0 server_cookie=1997f4752805265f in_seq=0 out_seq=0 2024-09-19T09:42:38.095 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.088+0000 7ff743fff640 10 client.16026 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.096+0000 7ff743fff640 1 -- 172.21.15.1:0/2983216651 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563cf692bd70 con 0x563cf69dabc0 2024-09-19T09:42:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.096+0000 7ff743fff640 10 client.16026 handle_command_reply: tid=0 2024-09-19T09:42:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.096+0000 7ff76de39740 1 client.16026 shutdown 2024-09-19T09:42:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.096+0000 7ff76de39740 1 -- 172.21.15.1:0/2983216651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cf69c12e0 msgr2=0x563cf69d4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.096+0000 7ff76de39740 1 --2- 172.21.15.1:0/2983216651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cf69c12e0 0x563cf69d4490 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff74c012460 tx=0x7ff74c008310 comp rx=0 tx=0).stop 2024-09-19T09:42:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.096+0000 7ff76de39740 1 -- 172.21.15.1:0/2983216651 shutdown_connections 2024-09-19T09:42:38.099 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.096+0000 7ff76de39740 1 --2- 172.21.15.1:0/2983216651 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563cf69dabc0 0x563cf6a482c0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.096+0000 7ff76de39740 1 --2- 172.21.15.1:0/2983216651 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cf69c6370 0x563cf69d5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.096+0000 7ff76de39740 1 --2- 172.21.15.1:0/2983216651 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563cf69c12e0 0x563cf69d4490 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.096+0000 7ff743fff640 0 client.16026 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.096+0000 7ff76de39740 1 --2- 172.21.15.1:0/2983216651 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563cf69c09a0 0x563cf69d3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.096+0000 7ff76de39740 1 -- 172.21.15.1:0/2983216651 >> 172.21.15.1:0/2983216651 conn(0x563cf69bc010 msgr2=0x563cf69bb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.096+0000 7ff76de39740 1 -- 172.21.15.1:0/2983216651 shutdown_connections 2024-09-19T09:42:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.096+0000 7ff76de39740 1 -- 172.21.15.1:0/2983216651 wait complete. 2024-09-19T09:42:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.096+0000 7ff76de39740 20 client.16026 trim_cache size 0 max 16384 2024-09-19T09:42:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:42:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:42:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:42:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:42:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.097+0000 7ff76afc4640 1 -- 172.21.15.1:0/1157648371 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff7500a32c0 msgr2=0x7ff7500a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.097+0000 7ff76afc4640 1 --2- 172.21.15.1:0/1157648371 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff7500a32c0 0x7ff7500a5780 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x563cf69c1d10 tx=0x7ff754009610 comp rx=0 tx=0).stop 2024-09-19T09:42:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.097+0000 7ff76afc4640 1 -- 172.21.15.1:0/1157648371 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff764107820 msgr2=0x7ff76419f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.097+0000 7ff76afc4640 1 --2- 172.21.15.1:0/1157648371 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff764107820 0x7ff76419f440 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff75c00dac0 tx=0x7ff75c00df80 comp rx=0 tx=0).stop 2024-09-19T09:42:38.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.097+0000 7ff76afc4640 1 -- 172.21.15.1:0/1157648371 shutdown_connections 2024-09-19T09:42:38.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.097+0000 7ff76afc4640 1 --2- 172.21.15.1:0/1157648371 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff764107820 0x7ff76419f440 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.097+0000 7ff76afc4640 1 --2- 172.21.15.1:0/1157648371 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff7500a32c0 0x7ff7500a5780 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.097+0000 7ff76afc4640 1 --2- 172.21.15.1:0/1157648371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff764104ef0 0x7ff7641983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.097+0000 7ff76afc4640 1 --2- 172.21.15.1:0/1157648371 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7641025c0 0x7ff764197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.097+0000 7ff76afc4640 1 -- 172.21.15.1:0/1157648371 >> 172.21.15.1:0/1157648371 conn(0x7ff7640fc1c0 msgr2=0x7ff764102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:38.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.097+0000 7ff76afc4640 1 -- 172.21.15.1:0/1157648371 shutdown_connections 2024-09-19T09:42:38.102 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:38.097+0000 7ff76afc4640 1 -- 172.21.15.1:0/1157648371 wait complete. 2024-09-19T09:42:38.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.115+0000 7efc8e7e0640 1 -- 172.21.15.1:0/1540821781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc88102570 msgr2=0x7efc881029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.115+0000 7efc8e7e0640 1 --2- 172.21.15.1:0/1540821781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc88102570 0x7efc881029b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7efc7c009900 tx=0x7efc7c02a480 comp rx=0 tx=0).stop 2024-09-19T09:42:38.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.115+0000 7efc8e7e0640 1 -- 172.21.15.1:0/1540821781 shutdown_connections 2024-09-19T09:42:38.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.115+0000 7efc8e7e0640 1 --2- 172.21.15.1:0/1540821781 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc88102ef0 0x7efc8810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.115+0000 7efc8e7e0640 1 --2- 172.21.15.1:0/1540821781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc88102570 0x7efc881029b0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.115+0000 7efc8e7e0640 1 --2- 172.21.15.1:0/1540821781 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc88100e20 0x7efc88101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.115+0000 7efc8e7e0640 1 -- 172.21.15.1:0/1540821781 >> 172.21.15.1:0/1540821781 conn(0x7efc880fc7d0 msgr2=0x7efc880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:38.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.115+0000 7efc8e7e0640 1 -- 172.21.15.1:0/1540821781 shutdown_connections 2024-09-19T09:42:38.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.115+0000 7efc8e7e0640 1 -- 172.21.15.1:0/1540821781 wait complete. 2024-09-19T09:42:38.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.116+0000 7efc8e7e0640 1 Processor -- start 2024-09-19T09:42:38.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.116+0000 7efc8e7e0640 1 -- start start 2024-09-19T09:42:38.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.116+0000 7efc8e7e0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc88100e20 0x7efc880fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.116+0000 7efc8e7e0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc88102570 0x7efc880fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.116+0000 7efc8e7e0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc88102ef0 0x7efc880fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.116+0000 7efc8e7e0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efc88110f50 con 0x7efc88102570 2024-09-19T09:42:38.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.116+0000 7efc8e7e0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efc88110dd0 con 0x7efc88100e20 2024-09-19T09:42:38.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.116+0000 7efc8e7e0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efc881110d0 con 0x7efc88102ef0 2024-09-19T09:42:38.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.117+0000 7efc877fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc88102570 0x7efc880fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.117+0000 7efc877fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc88102570 0x7efc880fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34830/0 (socket says 172.21.15.1:34830) 2024-09-19T09:42:38.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.117+0000 7efc877fe640 1 -- 172.21.15.1:0/4270040760 learned_addr learned my addr 172.21.15.1:0/4270040760 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:38.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.117+0000 7efc87fff640 1 --2- 172.21.15.1:0/4270040760 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc88100e20 0x7efc880fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.117+0000 7efc8cd7d640 1 --2- 172.21.15.1:0/4270040760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc88102ef0 0x7efc880fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.117+0000 7efc87fff640 1 -- 172.21.15.1:0/4270040760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc88102ef0 msgr2=0x7efc880fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.117+0000 7efc87fff640 1 --2- 172.21.15.1:0/4270040760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc88102ef0 0x7efc880fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.117+0000 7efc87fff640 1 -- 172.21.15.1:0/4270040760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc88102570 msgr2=0x7efc880fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.117+0000 7efc87fff640 1 --2- 172.21.15.1:0/4270040760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc88102570 0x7efc880fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.117+0000 7efc87fff640 1 -- 172.21.15.1:0/4270040760 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc881a69b0 con 0x7efc88100e20 2024-09-19T09:42:38.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.117+0000 7efc877fe640 1 --2- 172.21.15.1:0/4270040760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc88102570 0x7efc880fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:38.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.117+0000 7efc87fff640 1 --2- 172.21.15.1:0/4270040760 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc88100e20 0x7efc880fcc80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efc7800e9f0 tx=0x7efc7800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:38.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.117+0000 7efc857fa640 1 -- 172.21.15.1:0/4270040760 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc7800ccc0 con 0x7efc88100e20 2024-09-19T09:42:38.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.117+0000 7efc857fa640 1 -- 172.21.15.1:0/4270040760 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc78010910 con 0x7efc88100e20 2024-09-19T09:42:38.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.117+0000 7efc8e7e0640 1 -- 172.21.15.1:0/4270040760 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc881a6ca0 con 0x7efc88100e20 2024-09-19T09:42:38.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.118+0000 7efc857fa640 1 -- 172.21.15.1:0/4270040760 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc78018960 con 0x7efc88100e20 2024-09-19T09:42:38.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.118+0000 7efc8e7e0640 1 -- 172.21.15.1:0/4270040760 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc881a7190 con 0x7efc88100e20 2024-09-19T09:42:38.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.120+0000 7efc90bb9740 1 Processor -- start 2024-09-19T09:42:38.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.120+0000 7efc857fa640 1 -- 172.21.15.1:0/4270040760 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7efc78018b00 con 0x7efc88100e20 2024-09-19T09:42:38.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.120+0000 7efc90bb9740 1 -- start start 2024-09-19T09:42:38.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.121+0000 7efc90bb9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614e8a14060 0x5614e8a14440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.121+0000 7efc90bb9740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5614e8a14980 0x5614e8a1ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.121+0000 7efc90bb9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5614e8a1f240 0x5614e8a21630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.121+0000 7efc90bb9740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5614e8979620 con 0x5614e8a14980 2024-09-19T09:42:38.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.121+0000 7efc90bb9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5614e8920e50 con 0x5614e8a1f240 2024-09-19T09:42:38.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.121+0000 7efc90bb9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5614e89755e0 con 0x5614e8a14060 2024-09-19T09:42:38.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.121+0000 7efc87fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5614e8a14980 0x5614e8a1ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.121+0000 7efc87fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5614e8a14980 0x5614e8a1ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34842/0 (socket says 172.21.15.1:34842) 2024-09-19T09:42:38.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.121+0000 7efc8cd7d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614e8a14060 0x5614e8a14440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.121+0000 7efc87fff640 1 -- 172.21.15.1:0/1979208591 learned_addr learned my addr 172.21.15.1:0/1979208591 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:38.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.121+0000 7efc877fe640 1 --2- 172.21.15.1:0/1979208591 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5614e8a1f240 0x5614e8a21630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.121+0000 7efc857fa640 1 --2- 172.21.15.1:0/4270040760 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7efc700a3240 0x7efc700a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.122+0000 7efc8cd7d640 1 -- 172.21.15.1:0/1979208591 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5614e8a1f240 msgr2=0x5614e8a21630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:38.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.122+0000 7efc8cd7d640 1 --2- 172.21.15.1:0/1979208591 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5614e8a1f240 0x5614e8a21630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.122+0000 7efc8cd7d640 1 -- 172.21.15.1:0/1979208591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5614e8a14980 msgr2=0x5614e8a1ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:38.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.122+0000 7efc857fa640 1 -- 172.21.15.1:0/4270040760 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7efc780cfcc0 con 0x7efc88100e20 2024-09-19T09:42:38.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.122+0000 7efc8cd7d640 1 --2- 172.21.15.1:0/1979208591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5614e8a14980 0x5614e8a1ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.122+0000 7efc8cd7d640 1 -- 172.21.15.1:0/1979208591 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614e8911d40 con 0x5614e8a14060 2024-09-19T09:42:38.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.122+0000 7efc877fe640 1 --2- 172.21.15.1:0/1979208591 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5614e8a1f240 0x5614e8a21630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:38.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.122+0000 7efc87fff640 1 --2- 172.21.15.1:0/1979208591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5614e8a14980 0x5614e8a1ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:38.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.122+0000 7efc8cd7d640 1 --2- 172.21.15.1:0/4270040760 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7efc700a3240 0x7efc700a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.122+0000 7efc8cd7d640 1 --2- 172.21.15.1:0/1979208591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614e8a14060 0x5614e8a14440 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efc80009f00 tx=0x7efc80011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1435120cff943523 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:38.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.122+0000 7efc6e7fc640 1 -- 172.21.15.1:0/1979208591 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc80003cb0 con 0x5614e8a14060 2024-09-19T09:42:38.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.123+0000 7efc6e7fc640 1 -- 172.21.15.1:0/1979208591 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc8001bb10 con 0x5614e8a14060 2024-09-19T09:42:38.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.123+0000 7efc6e7fc640 1 -- 172.21.15.1:0/1979208591 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc80019ae0 con 0x5614e8a14060 2024-09-19T09:42:38.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.123+0000 7efc8cd7d640 1 --2- 172.21.15.1:0/4270040760 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7efc700a3240 0x7efc700a5700 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efc80020000 tx=0x7efc80021000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:38.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.123+0000 7efc90bb9740 1 -- 172.21.15.1:0/1979208591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614e8a14060 msgr2=0x5614e8a14440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.123+0000 7efc90bb9740 1 --2- 172.21.15.1:0/1979208591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614e8a14060 0x5614e8a14440 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efc80009f00 tx=0x7efc80011810 comp rx=0 tx=0).stop 2024-09-19T09:42:38.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.123+0000 7efc90bb9740 1 -- 172.21.15.1:0/1979208591 shutdown_connections 2024-09-19T09:42:38.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.123+0000 7efc90bb9740 1 --2- 172.21.15.1:0/1979208591 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5614e8a1f240 0x5614e8a21630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.123+0000 7efc90bb9740 1 --2- 172.21.15.1:0/1979208591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5614e8a14980 0x5614e8a1ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.123+0000 7efc90bb9740 1 --2- 172.21.15.1:0/1979208591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614e8a14060 0x5614e8a14440 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.123+0000 7efc90bb9740 1 -- 172.21.15.1:0/1979208591 >> 172.21.15.1:0/1979208591 conn(0x5614e8a105f0 msgr2=0x5614e8a109d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:38.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.123+0000 7efc90bb9740 1 -- 172.21.15.1:0/1979208591 shutdown_connections 2024-09-19T09:42:38.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.123+0000 7efc90bb9740 1 -- 172.21.15.1:0/1979208591 wait complete. 2024-09-19T09:42:38.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.124+0000 7efc90bb9740 1 -- start start 2024-09-19T09:42:38.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.124+0000 7efc90bb9740 1 Processor -- start 2024-09-19T09:42:38.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.124+0000 7efc90bb9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5614e8a14060 0x5614e8a1c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.124+0000 7efc90bb9740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5614e8a14980 0x5614e8a1c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.124+0000 7efc90bb9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614e8a1f240 0x5614e8a1cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.124+0000 7efc90bb9740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5614e8a21e10 con 0x5614e8a14980 2024-09-19T09:42:38.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.124+0000 7efc90bb9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5614e8901f10 con 0x5614e8a14060 2024-09-19T09:42:38.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.124+0000 7efc90bb9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5614e8a21f90 con 0x5614e8a1f240 2024-09-19T09:42:38.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.124+0000 7efc90bb9740 10 client.0 _ll_register_callbacks cb 0x5614e8925db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:38.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.125+0000 7efc8cd7d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614e8a1f240 0x5614e8a1cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.125+0000 7efc8cd7d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614e8a1f240 0x5614e8a1cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:52024/0 (socket says 172.21.15.1:52024) 2024-09-19T09:42:38.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.125+0000 7efc8cd7d640 1 -- 172.21.15.1:0/1202872743 learned_addr learned my addr 172.21.15.1:0/1202872743 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:38.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.125+0000 7efc87fff640 1 --2- 172.21.15.1:0/1202872743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5614e8a14060 0x5614e8a1c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.125+0000 7efc8cd7d640 1 -- 172.21.15.1:0/1202872743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5614e8a14060 msgr2=0x5614e8a1c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:38.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.125+0000 7efc8cd7d640 1 --2- 172.21.15.1:0/1202872743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5614e8a14060 0x5614e8a1c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.125+0000 7efc8cd7d640 1 -- 172.21.15.1:0/1202872743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5614e8a14980 msgr2=0x5614e8a1c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:38.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.125+0000 7efc8cd7d640 1 --2- 172.21.15.1:0/1202872743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5614e8a14980 0x5614e8a1c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.125+0000 7efc8cd7d640 1 -- 172.21.15.1:0/1202872743 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614e8688580 con 0x5614e8a1f240 2024-09-19T09:42:38.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.125+0000 7efc87fff640 1 --2- 172.21.15.1:0/1202872743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5614e8a14060 0x5614e8a1c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:42:38.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.126+0000 7efc8cd7d640 1 --2- 172.21.15.1:0/1202872743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614e8a1f240 0x5614e8a1cc20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efc80011d10 tx=0x7efc80004a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e715b384e726b29e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:38.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.126+0000 7efc677fe640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-19T09:42:38.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.126+0000 7efc677fe640 1 -- 172.21.15.1:0/1202872743 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc80034020 con 0x5614e8a1f240 2024-09-19T09:42:38.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.126+0000 7efc90bb9740 1 -- 172.21.15.1:0/1202872743 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc8001bb10 con 0x5614e8a1f240 2024-09-19T09:42:38.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.126+0000 7efc677fe640 1 -- 172.21.15.1:0/1202872743 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7efc8001b430 con 0x5614e8a1f240 2024-09-19T09:42:38.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.126+0000 7efc677fe640 1 -- 172.21.15.1:0/1202872743 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7efc80029040 con 0x5614e8a1f240 2024-09-19T09:42:38.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.126+0000 7efc90bb9740 10 client.25531 fetch_fsmap learned FSMap version 19 2024-09-19T09:42:38.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.126+0000 7efc90bb9740 1 -- 172.21.15.1:0/1202872743 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5614e8752960 con 0x5614e8a1f240 2024-09-19T09:42:38.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.126+0000 7efc677fe640 1 -- 172.21.15.1:0/1202872743 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc8001bb10 con 0x5614e8a1f240 2024-09-19T09:42:38.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.126+0000 7efc677fe640 1 -- 172.21.15.1:0/1202872743 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7efc8002f9a0 con 0x5614e8a1f240 2024-09-19T09:42:38.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.127+0000 7efc90bb9740 10 client.25531 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:42:38.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.127+0000 7efc90bb9740 10 client.25531 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:42:38.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.127+0000 7efc90bb9740 20 client.25531 populate_metadata read hostname 'smithi001' 2024-09-19T09:42:38.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.127+0000 7efc90bb9740 1 --2- 172.21.15.1:0/1202872743 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5614e8a2ed80 0x5614e8a31170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.127+0000 7efc90bb9740 4 client.25531 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:42:38.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.127+0000 7efc90bb9740 1 -- 172.21.15.1:0/1202872743 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5614e8986b90 con 0x5614e8a2ed80 2024-09-19T09:42:38.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.127+0000 7efc87fff640 1 --2- 172.21.15.1:0/1202872743 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5614e8a2ed80 0x5614e8a31170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.127+0000 7efc87fff640 1 --2- 172.21.15.1:0/1202872743 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5614e8a2ed80 0x5614e8a31170 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65f29cb89e57f83 server_cookie=1dbe312cec249e2b in_seq=0 out_seq=0 2024-09-19T09:42:38.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.127+0000 7efc677fe640 10 client.25531 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:38.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.128+0000 7efc677fe640 1 -- 172.21.15.1:0/1202872743 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5614e8986b90 con 0x5614e8a2ed80 2024-09-19T09:42:38.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.128+0000 7efc677fe640 10 client.25531 handle_command_reply: tid=0 2024-09-19T09:42:38.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.128+0000 7efc90bb9740 1 client.25531 shutdown 2024-09-19T09:42:38.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.128+0000 7efc90bb9740 1 -- 172.21.15.1:0/1202872743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614e8a1f240 msgr2=0x5614e8a1cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.128+0000 7efc90bb9740 1 --2- 172.21.15.1:0/1202872743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614e8a1f240 0x5614e8a1cc20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efc80011d10 tx=0x7efc80004a00 comp rx=0 tx=0).stop 2024-09-19T09:42:38.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.128+0000 7efc90bb9740 1 -- 172.21.15.1:0/1202872743 shutdown_connections 2024-09-19T09:42:38.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.128+0000 7efc90bb9740 1 --2- 172.21.15.1:0/1202872743 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5614e8a2ed80 0x5614e8a31170 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.128+0000 7efc90bb9740 1 --2- 172.21.15.1:0/1202872743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614e8a1f240 0x5614e8a1cc20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.128+0000 7efc90bb9740 1 --2- 172.21.15.1:0/1202872743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5614e8a14980 0x5614e8a1c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.128+0000 7efc677fe640 0 client.25531 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:38.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.128+0000 7efc90bb9740 1 --2- 172.21.15.1:0/1202872743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5614e8a14060 0x5614e8a1c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.128+0000 7efc90bb9740 1 -- 172.21.15.1:0/1202872743 >> 172.21.15.1:0/1202872743 conn(0x5614e8a105f0 msgr2=0x5614e8a162d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:38.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.128+0000 7efc90bb9740 1 -- 172.21.15.1:0/1202872743 shutdown_connections 2024-09-19T09:42:38.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.128+0000 7efc90bb9740 1 -- 172.21.15.1:0/1202872743 wait complete. 2024-09-19T09:42:38.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.128+0000 7efc90bb9740 20 client.25531 trim_cache size 0 max 16384 2024-09-19T09:42:38.143 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:42:38.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.146+0000 7efc90bb9740 1 Processor -- start 2024-09-19T09:42:38.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.146+0000 7efc90bb9740 1 -- start start 2024-09-19T09:42:38.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.146+0000 7efc90bb9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5614e8a14060 0x5614e8a16ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.146+0000 7efc90bb9740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5614e8a14980 0x5614e8a0f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.147+0000 7efc90bb9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614e8a1f240 0x5614e8a36960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.147+0000 7efc90bb9740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efc881ad8d0 con 0x5614e8a14980 2024-09-19T09:42:38.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.147+0000 7efc90bb9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efc881b0170 con 0x5614e8a14060 2024-09-19T09:42:38.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.147+0000 7efc90bb9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efc881adf60 con 0x5614e8a1f240 2024-09-19T09:42:38.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.147+0000 7efc877fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5614e8a14980 0x5614e8a0f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.147+0000 7efc877fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5614e8a14980 0x5614e8a0f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34862/0 (socket says 172.21.15.1:34862) 2024-09-19T09:42:38.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.147+0000 7efc877fe640 1 -- 172.21.15.1:0/2148571289 learned_addr learned my addr 172.21.15.1:0/2148571289 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:38.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.147+0000 7efc87fff640 1 --2- 172.21.15.1:0/2148571289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5614e8a14060 0x5614e8a16ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.147+0000 7efc8cd7d640 1 --2- 172.21.15.1:0/2148571289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614e8a1f240 0x5614e8a36960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.147+0000 7efc877fe640 1 -- 172.21.15.1:0/2148571289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614e8a1f240 msgr2=0x5614e8a36960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:38.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.147+0000 7efc877fe640 1 --2- 172.21.15.1:0/2148571289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614e8a1f240 0x5614e8a36960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.147+0000 7efc877fe640 1 -- 172.21.15.1:0/2148571289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5614e8a14060 msgr2=0x5614e8a16ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:38.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.147+0000 7efc877fe640 1 --2- 172.21.15.1:0/2148571289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5614e8a14060 0x5614e8a16ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.147+0000 7efc877fe640 1 -- 172.21.15.1:0/2148571289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614e8a31730 con 0x5614e8a14980 2024-09-19T09:42:38.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.147+0000 7efc877fe640 1 --2- 172.21.15.1:0/2148571289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5614e8a14980 0x5614e8a0f640 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7efc7c006010 tx=0x7efc7c0044a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419c1b6c59297b1d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:38.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.148+0000 7efc6dffb640 1 -- 172.21.15.1:0/2148571289 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc7c035040 con 0x5614e8a14980 2024-09-19T09:42:38.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.148+0000 7efc6dffb640 1 -- 172.21.15.1:0/2148571289 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc7c003cd0 con 0x5614e8a14980 2024-09-19T09:42:38.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.148+0000 7efc6dffb640 1 -- 172.21.15.1:0/2148571289 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc7c03c440 con 0x5614e8a14980 2024-09-19T09:42:38.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.148+0000 7efc90bb9740 1 -- 172.21.15.1:0/2148571289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5614e8a14980 msgr2=0x5614e8a0f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.148+0000 7efc90bb9740 1 --2- 172.21.15.1:0/2148571289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5614e8a14980 0x5614e8a0f640 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7efc7c006010 tx=0x7efc7c0044a0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.148+0000 7efc90bb9740 1 -- 172.21.15.1:0/2148571289 shutdown_connections 2024-09-19T09:42:38.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.148+0000 7efc90bb9740 1 --2- 172.21.15.1:0/2148571289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614e8a1f240 0x5614e8a36960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.148+0000 7efc90bb9740 1 --2- 172.21.15.1:0/2148571289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5614e8a14980 0x5614e8a0f640 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.148+0000 7efc90bb9740 1 --2- 172.21.15.1:0/2148571289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5614e8a14060 0x5614e8a16ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.148+0000 7efc90bb9740 1 -- 172.21.15.1:0/2148571289 >> 172.21.15.1:0/2148571289 conn(0x5614e8a105f0 msgr2=0x5614e8a0ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:38.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.149+0000 7efc90bb9740 1 -- 172.21.15.1:0/2148571289 shutdown_connections 2024-09-19T09:42:38.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.149+0000 7efc90bb9740 1 -- 172.21.15.1:0/2148571289 wait complete. 2024-09-19T09:42:38.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.149+0000 7efc90bb9740 1 -- start start 2024-09-19T09:42:38.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.149+0000 7efc90bb9740 1 Processor -- start 2024-09-19T09:42:38.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.149+0000 7efc90bb9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614e8a14060 0x5614e8a23250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.149+0000 7efc90bb9740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5614e8a14980 0x5614e8a23790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.150+0000 7efc90bb9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5614e8a1f240 0x5614e8a23d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.150+0000 7efc90bb9740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efc881ae630 con 0x5614e8a14980 2024-09-19T09:42:38.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.150+0000 7efc90bb9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efc881afaa0 con 0x5614e8a1f240 2024-09-19T09:42:38.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.150+0000 7efc90bb9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7efc881aed00 con 0x5614e8a14060 2024-09-19T09:42:38.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.150+0000 7efc90bb9740 10 client.0 _ll_register_callbacks cb 0x7efc80009e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:38.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.150+0000 7efc877fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5614e8a14980 0x5614e8a23790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.150+0000 7efc877fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5614e8a14980 0x5614e8a23790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34864/0 (socket says 172.21.15.1:34864) 2024-09-19T09:42:38.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.150+0000 7efc877fe640 1 -- 172.21.15.1:0/2216471321 learned_addr learned my addr 172.21.15.1:0/2216471321 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:38.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.150+0000 7efc8cd7d640 1 --2- 172.21.15.1:0/2216471321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5614e8a1f240 0x5614e8a23d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.150+0000 7efc87fff640 1 --2- 172.21.15.1:0/2216471321 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614e8a14060 0x5614e8a23250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.150+0000 7efc877fe640 1 -- 172.21.15.1:0/2216471321 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614e8a14060 msgr2=0x5614e8a23250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:38.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.150+0000 7efc877fe640 1 --2- 172.21.15.1:0/2216471321 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614e8a14060 0x5614e8a23250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.150+0000 7efc877fe640 1 -- 172.21.15.1:0/2216471321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5614e8a1f240 msgr2=0x5614e8a23d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:38.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.150+0000 7efc877fe640 1 --2- 172.21.15.1:0/2216471321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5614e8a1f240 0x5614e8a23d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.150+0000 7efc877fe640 1 -- 172.21.15.1:0/2216471321 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614e8a11280 con 0x5614e8a14980 2024-09-19T09:42:38.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.150+0000 7efc877fe640 1 --2- 172.21.15.1:0/2216471321 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5614e8a14980 0x5614e8a23790 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7efc7c005770 tx=0x7efc7c005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fca5df6fe9659b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:38.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.150+0000 7efc677fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:42:38.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.151+0000 7efc677fe640 1 -- 172.21.15.1:0/2216471321 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc7c035040 con 0x5614e8a14980 2024-09-19T09:42:38.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.151+0000 7efc677fe640 1 -- 172.21.15.1:0/2216471321 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7efc7c031750 con 0x5614e8a14980 2024-09-19T09:42:38.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.151+0000 7efc90bb9740 1 -- 172.21.15.1:0/2216471321 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc7c003cd0 con 0x5614e8a14980 2024-09-19T09:42:38.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.151+0000 7efc677fe640 1 -- 172.21.15.1:0/2216471321 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7efc7c003e80 con 0x5614e8a14980 2024-09-19T09:42:38.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.151+0000 7efc90bb9740 10 client.16041 fetch_fsmap learned FSMap version 19 2024-09-19T09:42:38.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.151+0000 7efc90bb9740 1 -- 172.21.15.1:0/2216471321 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5614e8a99d90 con 0x5614e8a14980 2024-09-19T09:42:38.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.151+0000 7efc677fe640 1 -- 172.21.15.1:0/2216471321 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc7c003cd0 con 0x5614e8a14980 2024-09-19T09:42:38.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.151+0000 7efc677fe640 1 -- 172.21.15.1:0/2216471321 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7efc7c044070 con 0x5614e8a14980 2024-09-19T09:42:38.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.151+0000 7efc90bb9740 10 client.16041 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:42:38.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.151+0000 7efc90bb9740 10 client.16041 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:42:38.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.151+0000 7efc90bb9740 20 client.16041 populate_metadata read hostname 'smithi001' 2024-09-19T09:42:38.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.152+0000 7efc90bb9740 1 --2- 172.21.15.1:0/2216471321 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5614e8a9a450 0x5614e8a9c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:38.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.152+0000 7efc90bb9740 4 client.16041 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f8a03d4b", "release": true, "await": true}] 2024-09-19T09:42:38.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.152+0000 7efc90bb9740 1 -- 172.21.15.1:0/2216471321 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f8a03d4b", "release": true, "await": true}) -- 0x5614e89810a0 con 0x5614e8a9a450 2024-09-19T09:42:38.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.152+0000 7efc87fff640 1 --2- 172.21.15.1:0/2216471321 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5614e8a9a450 0x5614e8a9c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:38.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.152+0000 7efc87fff640 1 --2- 172.21.15.1:0/2216471321 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5614e8a9a450 0x5614e8a9c870 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f4b7f124dd9e6a9 server_cookie=4d421485a59b94ef in_seq=0 out_seq=0 2024-09-19T09:42:38.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.152+0000 7efc677fe640 10 client.16041 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:38.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.177+0000 7efc677fe640 1 -- 172.21.15.1:0/2216471321 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5614e89810a0 con 0x5614e8a9a450 2024-09-19T09:42:38.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.177+0000 7efc677fe640 10 client.16041 handle_command_reply: tid=0 2024-09-19T09:42:38.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.177+0000 7efc90bb9740 1 client.16041 shutdown 2024-09-19T09:42:38.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.181+0000 7efc90bb9740 1 -- 172.21.15.1:0/2216471321 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5614e8a14980 msgr2=0x5614e8a23790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.181+0000 7efc90bb9740 1 --2- 172.21.15.1:0/2216471321 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5614e8a14980 0x5614e8a23790 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7efc7c005770 tx=0x7efc7c005a20 comp rx=0 tx=0).stop 2024-09-19T09:42:38.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.181+0000 7efc90bb9740 1 -- 172.21.15.1:0/2216471321 shutdown_connections 2024-09-19T09:42:38.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.181+0000 7efc90bb9740 1 --2- 172.21.15.1:0/2216471321 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5614e8a9a450 0x5614e8a9c870 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.181+0000 7efc90bb9740 1 --2- 172.21.15.1:0/2216471321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5614e8a1f240 0x5614e8a23d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.181+0000 7efc90bb9740 1 --2- 172.21.15.1:0/2216471321 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5614e8a14980 0x5614e8a23790 secure :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7efc7c005770 tx=0x7efc7c005a20 comp rx=0 tx=0).stop 2024-09-19T09:42:38.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.181+0000 7efc90bb9740 1 --2- 172.21.15.1:0/2216471321 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614e8a14060 0x5614e8a23250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.181+0000 7efc90bb9740 1 -- 172.21.15.1:0/2216471321 >> 172.21.15.1:0/2216471321 conn(0x5614e8a105f0 msgr2=0x5614e8a1e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:38.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.181+0000 7efc677fe640 0 client.16041 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:38.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.183+0000 7efc90bb9740 1 -- 172.21.15.1:0/2216471321 shutdown_connections 2024-09-19T09:42:38.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.184+0000 7efc90bb9740 1 -- 172.21.15.1:0/2216471321 wait complete. 2024-09-19T09:42:38.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.184+0000 7efc90bb9740 20 client.16041 trim_cache size 0 max 16384 2024-09-19T09:42:38.189 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:42:38.189 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 19, 2024-09-19T09:42:38.189 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24497, 2024-09-19T09:42:38.189 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 16, 2024-09-19T09:42:38.189 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T09:42:38.189 INFO:teuthology.orchestra.run.smithi001.stdout: "f8a03d4b": { 2024-09-19T09:42:38.189 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 16, 2024-09-19T09:42:38.189 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T09:42:38.189 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:42:38.189 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T09:42:38.189 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:42:38.190 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:42:38.190 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T09:42:38.190 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 136.6, 2024-09-19T09:42:38.190 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T09:42:38.190 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T09:42:38.190 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T09:42:38.190 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:42:38.190 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T09:42:38.190 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:42:38.190 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:42:38.190 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:42:38.190 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:42:38.190 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:42:38.190 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:42:38.190 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:42:38.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.187+0000 7efc8e7e0640 1 -- 172.21.15.1:0/4270040760 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7efc700a3240 msgr2=0x7efc700a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.187+0000 7efc8e7e0640 1 --2- 172.21.15.1:0/4270040760 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7efc700a3240 0x7efc700a5700 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efc80020000 tx=0x7efc80021000 comp rx=0 tx=0).stop 2024-09-19T09:42:38.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.187+0000 7efc8e7e0640 1 -- 172.21.15.1:0/4270040760 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc88100e20 msgr2=0x7efc880fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:38.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.187+0000 7efc8e7e0640 1 --2- 172.21.15.1:0/4270040760 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc88100e20 0x7efc880fcc80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efc7800e9f0 tx=0x7efc7800eeb0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.188+0000 7efc8e7e0640 1 -- 172.21.15.1:0/4270040760 shutdown_connections 2024-09-19T09:42:38.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.188+0000 7efc8e7e0640 1 --2- 172.21.15.1:0/4270040760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7efc88102ef0 0x7efc880fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.188+0000 7efc8e7e0640 1 --2- 172.21.15.1:0/4270040760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc88102570 0x7efc880fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.188+0000 7efc8e7e0640 1 --2- 172.21.15.1:0/4270040760 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7efc700a3240 0x7efc700a5700 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.188+0000 7efc8e7e0640 1 --2- 172.21.15.1:0/4270040760 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc88100e20 0x7efc880fcc80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:38.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.188+0000 7efc8e7e0640 1 -- 172.21.15.1:0/4270040760 >> 172.21.15.1:0/4270040760 conn(0x7efc880fc7d0 msgr2=0x7efc8806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:38.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.192+0000 7efc8e7e0640 1 -- 172.21.15.1:0/4270040760 shutdown_connections 2024-09-19T09:42:38.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:38.193+0000 7efc8e7e0640 1 -- 172.21.15.1:0/4270040760 wait complete. 2024-09-19T09:42:39.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:39 smithi022 ceph-mon[35583]: pgmap v475: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-19T09:42:39.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:39 smithi121 ceph-mon[35577]: pgmap v475: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-19T09:42:39.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:39 smithi001 ceph-mon[31225]: pgmap v475: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 767 B/s wr, 3 op/s 2024-09-19T09:42:41.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:41 smithi022 ceph-mon[35583]: pgmap v476: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 1.9 MiB/s wr, 359 op/s 2024-09-19T09:42:41.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:41 smithi121 ceph-mon[35577]: pgmap v476: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 1.9 MiB/s wr, 359 op/s 2024-09-19T09:42:41.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:41 smithi001 ceph-mon[31225]: pgmap v476: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 1.9 MiB/s wr, 359 op/s 2024-09-19T09:42:43.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:43 smithi022 ceph-mon[35583]: pgmap v477: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 2.23k op/s 2024-09-19T09:42:43.616 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:43 smithi121 ceph-mon[35577]: pgmap v477: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 2.23k op/s 2024-09-19T09:42:43.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:43 smithi001 ceph-mon[31225]: pgmap v477: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 12 MiB/s wr, 2.23k op/s 2024-09-19T09:42:45.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:45 smithi022 ceph-mon[35583]: pgmap v478: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 MiB/s wr, 3.32k op/s 2024-09-19T09:42:45.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:45 smithi121 ceph-mon[35577]: pgmap v478: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 MiB/s wr, 3.32k op/s 2024-09-19T09:42:45.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:45 smithi001 ceph-mon[31225]: pgmap v478: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 19 MiB/s wr, 3.32k op/s 2024-09-19T09:42:46.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.465+0000 7f5a6bd5f640 1 -- 172.21.15.1:0/3440002074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a64109450 msgr2=0x7f5a64109830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.465+0000 7f5a6bd5f640 1 --2- 172.21.15.1:0/3440002074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a64109450 0x7f5a64109830 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f5a60009ca0 tx=0x7f5a6002e9b0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.467+0000 7f5a6bd5f640 1 -- 172.21.15.1:0/3440002074 shutdown_connections 2024-09-19T09:42:46.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.467+0000 7f5a6bd5f640 1 --2- 172.21.15.1:0/3440002074 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a6410ea80 0x7f5a641154f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.467+0000 7f5a6bd5f640 1 --2- 172.21.15.1:0/3440002074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a64109e00 0x7f5a6410e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.467+0000 7f5a6bd5f640 1 --2- 172.21.15.1:0/3440002074 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a64109450 0x7f5a64109830 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.467+0000 7f5a6bd5f640 1 -- 172.21.15.1:0/3440002074 >> 172.21.15.1:0/3440002074 conn(0x7f5a6406e2d0 msgr2=0x7f5a6406e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:46.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.469+0000 7f5a6bd5f640 1 -- 172.21.15.1:0/3440002074 shutdown_connections 2024-09-19T09:42:46.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.471+0000 7f5a6bd5f640 1 -- 172.21.15.1:0/3440002074 wait complete. 2024-09-19T09:42:46.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.472+0000 7f5a6bd5f640 1 Processor -- start 2024-09-19T09:42:46.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.473+0000 7f5a6bd5f640 1 -- start start 2024-09-19T09:42:46.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.473+0000 7f5a6bd5f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a64109450 0x7f5a641188e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.473+0000 7f5a6bd5f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a64109e00 0x7f5a64118e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.473+0000 7f5a6bd5f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a6410ea80 0x7f5a6411d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.473+0000 7f5a6bd5f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5a641171c0 con 0x7f5a64109e00 2024-09-19T09:42:46.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.473+0000 7f5a6bd5f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5a64117040 con 0x7f5a64109450 2024-09-19T09:42:46.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.473+0000 7f5a6bd5f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5a64117340 con 0x7f5a6410ea80 2024-09-19T09:42:46.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.474+0000 7f5a69afb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a64109450 0x7f5a641188e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.474+0000 7f5a69afb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a64109450 0x7f5a641188e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:36218/0 (socket says 172.21.15.1:36218) 2024-09-19T09:42:46.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.474+0000 7f5a69afb640 1 -- 172.21.15.1:0/401827014 learned_addr learned my addr 172.21.15.1:0/401827014 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:46.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.476+0000 7f5a692fa640 1 --2- 172.21.15.1:0/401827014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a64109e00 0x7f5a64118e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.476+0000 7f5a69afb640 1 -- 172.21.15.1:0/401827014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a6410ea80 msgr2=0x7f5a6411d1b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:42:46.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.476+0000 7f5a69afb640 1 --2- 172.21.15.1:0/401827014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a6410ea80 0x7f5a6411d1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.476+0000 7f5a69afb640 1 -- 172.21.15.1:0/401827014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a64109e00 msgr2=0x7f5a64118e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.476+0000 7f5a69afb640 1 --2- 172.21.15.1:0/401827014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a64109e00 0x7f5a64118e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.476+0000 7f5a69afb640 1 -- 172.21.15.1:0/401827014 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a6411d720 con 0x7f5a64109450 2024-09-19T09:42:46.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.477+0000 7f5a69afb640 1 --2- 172.21.15.1:0/401827014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a64109450 0x7f5a641188e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5a6002ef20 tx=0x7f5a6003a600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:46.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.477+0000 7f5a5affd640 1 -- 172.21.15.1:0/401827014 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a60041070 con 0x7f5a64109450 2024-09-19T09:42:46.437 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:42:46.437 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":19,"btime":"2024-09-19T09:36:24:006349+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:36:23.723388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6839/3279971690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3279971690},{"type":"v1","addr":"172.21.15.121:6839","nonce":3279971690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:42:46.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.478+0000 7f5a6bd5f640 1 -- 172.21.15.1:0/401827014 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a6411d9b0 con 0x7f5a64109450 2024-09-19T09:42:46.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.478+0000 7f5a6bd5f640 1 -- 172.21.15.1:0/401827014 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a6411dee0 con 0x7f5a64109450 2024-09-19T09:42:46.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.478+0000 7f5a5affd640 1 -- 172.21.15.1:0/401827014 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a60003b70 con 0x7f5a64109450 2024-09-19T09:42:46.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.478+0000 7f5a5affd640 1 -- 172.21.15.1:0/401827014 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a60037040 con 0x7f5a64109450 2024-09-19T09:42:46.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.484+0000 7f5a5affd640 1 -- 172.21.15.1:0/401827014 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f5a60044070 con 0x7f5a64109450 2024-09-19T09:42:46.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.485+0000 7f5a5affd640 1 --2- 172.21.15.1:0/401827014 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f5a500a3380 0x7f5a500a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:46.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.486+0000 7f5a5affd640 1 -- 172.21.15.1:0/401827014 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f5a600efbe0 con 0x7f5a64109450 2024-09-19T09:42:46.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.486+0000 7f5a6bd5f640 1 -- 172.21.15.1:0/401827014 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a48005290 con 0x7f5a64109450 2024-09-19T09:42:46.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.493+0000 7f5a692fa640 1 --2- 172.21.15.1:0/401827014 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f5a500a3380 0x7f5a500a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:46.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.496+0000 7f5a692fa640 1 --2- 172.21.15.1:0/401827014 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f5a500a3380 0x7f5a500a5840 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5a64119ed0 tx=0x7f5a54008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:46.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.496+0000 7f5a5affd640 1 -- 172.21.15.1:0/401827014 <== mon.2 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5a60030030 con 0x7f5a64109450 2024-09-19T09:42:46.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.949+0000 7f5a6bd5f640 1 -- 172.21.15.1:0/401827014 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a48005580 con 0x7f5a64109450 2024-09-19T09:42:46.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.949+0000 7f5a5affd640 1 -- 172.21.15.1:0/401827014 <== mon.2 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11837 (secure 0 0 0) 0x7f5a6004b030 con 0x7f5a64109450 2024-09-19T09:42:46.439 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 19 2024-09-19T09:42:46.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.954+0000 7f5a6bd5f640 1 -- 172.21.15.1:0/401827014 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f5a500a3380 msgr2=0x7f5a500a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.954+0000 7f5a6bd5f640 1 --2- 172.21.15.1:0/401827014 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f5a500a3380 0x7f5a500a5840 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5a64119ed0 tx=0x7f5a54008040 comp rx=0 tx=0).stop 2024-09-19T09:42:46.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.954+0000 7f5a6bd5f640 1 -- 172.21.15.1:0/401827014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a64109450 msgr2=0x7f5a641188e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:46.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.954+0000 7f5a6bd5f640 1 --2- 172.21.15.1:0/401827014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a64109450 0x7f5a641188e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5a6002ef20 tx=0x7f5a6003a600 comp rx=0 tx=0).stop 2024-09-19T09:42:46.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.959+0000 7f5a6bd5f640 1 -- 172.21.15.1:0/401827014 shutdown_connections 2024-09-19T09:42:46.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.959+0000 7f5a6bd5f640 1 --2- 172.21.15.1:0/401827014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a6410ea80 0x7f5a6411d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.959+0000 7f5a6bd5f640 1 --2- 172.21.15.1:0/401827014 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5a64109e00 0x7f5a64118e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.959+0000 7f5a6bd5f640 1 --2- 172.21.15.1:0/401827014 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f5a500a3380 0x7f5a500a5840 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.959+0000 7f5a6bd5f640 1 --2- 172.21.15.1:0/401827014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a64109450 0x7f5a641188e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:46.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.959+0000 7f5a6bd5f640 1 -- 172.21.15.1:0/401827014 >> 172.21.15.1:0/401827014 conn(0x7f5a6406e2d0 msgr2=0x7f5a64072930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:46.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.961+0000 7f5a6bd5f640 1 -- 172.21.15.1:0/401827014 shutdown_connections 2024-09-19T09:42:46.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:42:45.961+0000 7f5a6bd5f640 1 -- 172.21.15.1:0/401827014 wait complete. 2024-09-19T09:42:46.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:46 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/401827014' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:42:46.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:46 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/401827014' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:42:46.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:46 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/401827014' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:42:47.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:47 smithi022 ceph-mon[35583]: pgmap v479: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 43 MiB/s wr, 7.08k op/s 2024-09-19T09:42:47.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:47 smithi121 ceph-mon[35577]: pgmap v479: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 43 MiB/s wr, 7.08k op/s 2024-09-19T09:42:47.747 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:47 smithi001 ceph-mon[31225]: pgmap v479: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 43 MiB/s wr, 7.08k op/s 2024-09-19T09:42:49.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:49 smithi022 ceph-mon[35583]: pgmap v480: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 66 MiB/s wr, 10.65k op/s 2024-09-19T09:42:49.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:49 smithi121 ceph-mon[35577]: pgmap v480: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 66 MiB/s wr, 10.65k op/s 2024-09-19T09:42:49.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:49 smithi001 ceph-mon[31225]: pgmap v480: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 66 MiB/s wr, 10.65k op/s 2024-09-19T09:42:51.046 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f8a03d4b', total seconds elapsed: 89.1 2024-09-19T09:42:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.216+0000 7f1613fc4640 1 -- 172.21.15.1:0/1736020097 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f160c103720 msgr2=0x7f160c109fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.216+0000 7f1613fc4640 1 --2- 172.21.15.1:0/1736020097 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f160c103720 0x7f160c109fb0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f1604009ca0 tx=0x7f160402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.216+0000 7f1613fc4640 1 -- 172.21.15.1:0/1736020097 shutdown_connections 2024-09-19T09:42:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.216+0000 7f1613fc4640 1 --2- 172.21.15.1:0/1736020097 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f160c103720 0x7f160c109fb0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.216+0000 7f1613fc4640 1 --2- 172.21.15.1:0/1736020097 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f160c102d60 0x7f160c1031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.216+0000 7f1613fc4640 1 --2- 172.21.15.1:0/1736020097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f160c101b70 0x7f160c101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.216+0000 7f1613fc4640 1 -- 172.21.15.1:0/1736020097 >> 172.21.15.1:0/1736020097 conn(0x7f160c0fd2f0 msgr2=0x7f160c0ff710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.216+0000 7f1613fc4640 1 -- 172.21.15.1:0/1736020097 shutdown_connections 2024-09-19T09:42:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.216+0000 7f1613fc4640 1 -- 172.21.15.1:0/1736020097 wait complete. 2024-09-19T09:42:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.217+0000 7f1613fc4640 1 Processor -- start 2024-09-19T09:42:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.217+0000 7f1613fc4640 1 -- start start 2024-09-19T09:42:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.217+0000 7f1613fc4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f160c101b70 0x7f160c197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.217+0000 7f1613fc4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f160c102d60 0x7f160c1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.217+0000 7f1613fc4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f160c103720 0x7f160c19f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.217+0000 7f1613fc4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f160c10d850 con 0x7f160c101b70 2024-09-19T09:42:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.217+0000 7f1613fc4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f160c10d6d0 con 0x7f160c103720 2024-09-19T09:42:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.217+0000 7f1613fc4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f160c10d9d0 con 0x7f160c102d60 2024-09-19T09:42:51.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.217+0000 7f1611d60640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f160c101b70 0x7f160c197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.217+0000 7f1611d60640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f160c101b70 0x7f160c197eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45842/0 (socket says 172.21.15.1:45842) 2024-09-19T09:42:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.217+0000 7f1611d60640 1 -- 172.21.15.1:0/4241564790 learned_addr learned my addr 172.21.15.1:0/4241564790 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.217+0000 7f1612561640 1 --2- 172.21.15.1:0/4241564790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f160c103720 0x7f160c19f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.217+0000 7f161155f640 1 --2- 172.21.15.1:0/4241564790 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f160c102d60 0x7f160c1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.217+0000 7f1611d60640 1 -- 172.21.15.1:0/4241564790 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f160c102d60 msgr2=0x7f160c1983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.217+0000 7f1611d60640 1 --2- 172.21.15.1:0/4241564790 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f160c102d60 0x7f160c1983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.217+0000 7f1611d60640 1 -- 172.21.15.1:0/4241564790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f160c103720 msgr2=0x7f160c19f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.217+0000 7f1611d60640 1 --2- 172.21.15.1:0/4241564790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f160c103720 0x7f160c19f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.217+0000 7f1611d60640 1 -- 172.21.15.1:0/4241564790 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f160c19fad0 con 0x7f160c101b70 2024-09-19T09:42:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.217+0000 7f1612561640 1 --2- 172.21.15.1:0/4241564790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f160c103720 0x7f160c19f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.218+0000 7f1611d60640 1 --2- 172.21.15.1:0/4241564790 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f160c101b70 0x7f160c197eb0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f160800e9c0 tx=0x7f160800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.218+0000 7f1602ffd640 1 -- 172.21.15.1:0/4241564790 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160800cd80 con 0x7f160c101b70 2024-09-19T09:42:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.218+0000 7f1602ffd640 1 -- 172.21.15.1:0/4241564790 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16080035f0 con 0x7f160c101b70 2024-09-19T09:42:51.222 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.218+0000 7f1613fc4640 1 -- 172.21.15.1:0/4241564790 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f160c19fdc0 con 0x7f160c101b70 2024-09-19T09:42:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.218+0000 7f1602ffd640 1 -- 172.21.15.1:0/4241564790 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1608010690 con 0x7f160c101b70 2024-09-19T09:42:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.218+0000 7f1613fc4640 1 -- 172.21.15.1:0/4241564790 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f160c1a02a0 con 0x7f160c101b70 2024-09-19T09:42:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.221+0000 7f1616e39740 1 Processor -- start 2024-09-19T09:42:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.221+0000 7f1602ffd640 1 -- 172.21.15.1:0/4241564790 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f16080037a0 con 0x7f160c101b70 2024-09-19T09:42:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.221+0000 7f1616e39740 1 -- start start 2024-09-19T09:42:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.221+0000 7f1616e39740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dd76d7b9a0 0x55dd76d7bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.221+0000 7f1616e39740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd76d7c2e0 0x55dd76d80da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.221+0000 7f1616e39740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd76d81370 0x55dd76d83830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.221+0000 7f1616e39740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dd76cdf2f0 con 0x55dd76d81370 2024-09-19T09:42:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.221+0000 7f1616e39740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55dd76c87270 con 0x55dd76d7c2e0 2024-09-19T09:42:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.221+0000 7f1616e39740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55dd76cdb2b0 con 0x55dd76d7b9a0 2024-09-19T09:42:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.222+0000 7f161155f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd76d81370 0x55dd76d83830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.222+0000 7f161155f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd76d81370 0x55dd76d83830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45846/0 (socket says 172.21.15.1:45846) 2024-09-19T09:42:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.222+0000 7f161155f640 1 -- 172.21.15.1:0/1131584121 learned_addr learned my addr 172.21.15.1:0/1131584121 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.222+0000 7f1611d60640 1 --2- 172.21.15.1:0/1131584121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd76d7c2e0 0x55dd76d80da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.222+0000 7f1612561640 1 --2- 172.21.15.1:0/1131584121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dd76d7b9a0 0x55dd76d7bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.222+0000 7f161155f640 1 -- 172.21.15.1:0/1131584121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dd76d7b9a0 msgr2=0x55dd76d7bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.222+0000 7f161155f640 1 --2- 172.21.15.1:0/1131584121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dd76d7b9a0 0x55dd76d7bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.222+0000 7f161155f640 1 -- 172.21.15.1:0/1131584121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd76d7c2e0 msgr2=0x55dd76d80da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.222+0000 7f161155f640 1 --2- 172.21.15.1:0/1131584121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd76d7c2e0 0x55dd76d80da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.222+0000 7f161155f640 1 -- 172.21.15.1:0/1131584121 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd76c86340 con 0x55dd76d81370 2024-09-19T09:42:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.222+0000 7f1602ffd640 1 --2- 172.21.15.1:0/4241564790 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f15f80a3240 0x7f15f80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.222+0000 7f161155f640 1 --2- 172.21.15.1:0/1131584121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd76d81370 0x55dd76d83830 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f15fc00b7f0 tx=0x7f15fc00bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9461091c8d4cc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.222+0000 7f1612561640 1 --2- 172.21.15.1:0/4241564790 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f15f80a3240 0x7f15f80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.222+0000 7f1602ffd640 1 -- 172.21.15.1:0/4241564790 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f16080cfe50 con 0x7f160c101b70 2024-09-19T09:42:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.222+0000 7f15f7fff640 1 -- 172.21.15.1:0/1131584121 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15fc00d950 con 0x55dd76d81370 2024-09-19T09:42:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.223+0000 7f15f7fff640 1 -- 172.21.15.1:0/1131584121 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15fc018070 con 0x55dd76d81370 2024-09-19T09:42:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.223+0000 7f15f7fff640 1 -- 172.21.15.1:0/1131584121 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15fc0123e0 con 0x55dd76d81370 2024-09-19T09:42:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.223+0000 7f1616e39740 1 -- 172.21.15.1:0/1131584121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd76d81370 msgr2=0x55dd76d83830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.223+0000 7f1612561640 1 --2- 172.21.15.1:0/4241564790 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f15f80a3240 0x7f15f80a5700 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1604006010 tx=0x7f1604005fa0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.223+0000 7f1616e39740 1 --2- 172.21.15.1:0/1131584121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd76d81370 0x55dd76d83830 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f15fc00b7f0 tx=0x7f15fc00bcb0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.223+0000 7f1616e39740 1 -- 172.21.15.1:0/1131584121 shutdown_connections 2024-09-19T09:42:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.223+0000 7f1616e39740 1 --2- 172.21.15.1:0/1131584121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd76d81370 0x55dd76d83830 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.223+0000 7f1616e39740 1 --2- 172.21.15.1:0/1131584121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd76d7c2e0 0x55dd76d80da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.223+0000 7f1616e39740 1 --2- 172.21.15.1:0/1131584121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dd76d7b9a0 0x55dd76d7bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.223+0000 7f1616e39740 1 -- 172.21.15.1:0/1131584121 >> 172.21.15.1:0/1131584121 conn(0x55dd76d77010 msgr2=0x55dd76d77410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.223+0000 7f1616e39740 1 -- 172.21.15.1:0/1131584121 shutdown_connections 2024-09-19T09:42:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.223+0000 7f1616e39740 1 -- 172.21.15.1:0/1131584121 wait complete. 2024-09-19T09:42:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.224+0000 7f1616e39740 1 -- start start 2024-09-19T09:42:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.224+0000 7f1616e39740 1 Processor -- start 2024-09-19T09:42:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.224+0000 7f1616e39740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dd76d7b9a0 0x55dd76d85b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.224+0000 7f1616e39740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd76d7c2e0 0x55dd76d860d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.224+0000 7f1616e39740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd76d81370 0x55dd76d8d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.224+0000 7f1616e39740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55dd76d84340 con 0x55dd76d7c2e0 2024-09-19T09:42:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.224+0000 7f1616e39740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55dd76c68290 con 0x55dd76d81370 2024-09-19T09:42:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.224+0000 7f1616e39740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55dd76d844c0 con 0x55dd76d7b9a0 2024-09-19T09:42:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.224+0000 7f1616e39740 10 client.0 _ll_register_callbacks cb 0x55dd76c99140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.224+0000 7f161155f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd76d7c2e0 0x55dd76d860d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.224+0000 7f161155f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd76d7c2e0 0x55dd76d860d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45862/0 (socket says 172.21.15.1:45862) 2024-09-19T09:42:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.224+0000 7f161155f640 1 -- 172.21.15.1:0/3925122996 learned_addr learned my addr 172.21.15.1:0/3925122996 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.224+0000 7f1612561640 1 --2- 172.21.15.1:0/3925122996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd76d81370 0x55dd76d8d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.225+0000 7f1611d60640 1 --2- 172.21.15.1:0/3925122996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dd76d7b9a0 0x55dd76d85b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.225+0000 7f161155f640 1 -- 172.21.15.1:0/3925122996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dd76d7b9a0 msgr2=0x55dd76d85b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.225+0000 7f161155f640 1 --2- 172.21.15.1:0/3925122996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dd76d7b9a0 0x55dd76d85b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.225+0000 7f161155f640 1 -- 172.21.15.1:0/3925122996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd76d81370 msgr2=0x55dd76d8d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.225+0000 7f161155f640 1 --2- 172.21.15.1:0/3925122996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd76d81370 0x55dd76d8d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.225+0000 7f161155f640 1 -- 172.21.15.1:0/3925122996 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd769f2210 con 0x55dd76d7c2e0 2024-09-19T09:42:51.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.225+0000 7f161155f640 1 --2- 172.21.15.1:0/3925122996 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd76d7c2e0 0x55dd76d860d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f15fc008010 tx=0x7f15fc0136b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa9eaf7e85da059 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:51.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.225+0000 7f15f57fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:42:51.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.225+0000 7f15f57fa640 1 -- 172.21.15.1:0/3925122996 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15fc022070 con 0x55dd76d7c2e0 2024-09-19T09:42:51.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.225+0000 7f15f57fa640 1 -- 172.21.15.1:0/3925122996 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f15fc00dd60 con 0x55dd76d7c2e0 2024-09-19T09:42:51.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.225+0000 7f1616e39740 1 -- 172.21.15.1:0/3925122996 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15fc018070 con 0x55dd76d7c2e0 2024-09-19T09:42:51.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.225+0000 7f15f57fa640 1 -- 172.21.15.1:0/3925122996 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f15fc02e050 con 0x55dd76d7c2e0 2024-09-19T09:42:51.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.225+0000 7f1616e39740 10 client.16059 fetch_fsmap learned FSMap version 19 2024-09-19T09:42:51.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.225+0000 7f1616e39740 1 -- 172.21.15.1:0/3925122996 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55dd76abe620 con 0x55dd76d7c2e0 2024-09-19T09:42:51.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.226+0000 7f15f57fa640 1 -- 172.21.15.1:0/3925122996 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15fc018070 con 0x55dd76d7c2e0 2024-09-19T09:42:51.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.226+0000 7f15f57fa640 1 -- 172.21.15.1:0/3925122996 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f15fc01b410 con 0x55dd76d7c2e0 2024-09-19T09:42:51.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.226+0000 7f1616e39740 10 client.16059 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:42:51.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.226+0000 7f1616e39740 10 client.16059 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:51.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.226+0000 7f1616e39740 20 client.16059 populate_metadata read hostname 'smithi001' 2024-09-19T09:42:51.233 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.226+0000 7f1616e39740 1 --2- 172.21.15.1:0/3925122996 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55dd76d914d0 0x55dd76d938c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.226+0000 7f1616e39740 4 client.16059 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:42:51.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.226+0000 7f1616e39740 1 -- 172.21.15.1:0/3925122996 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd76ceca20 con 0x55dd76d914d0 2024-09-19T09:42:51.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.226+0000 7f1611d60640 1 --2- 172.21.15.1:0/3925122996 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55dd76d914d0 0x55dd76d938c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.227+0000 7f15f57fa640 10 client.16059 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:51.234 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.227+0000 7f1611d60640 1 --2- 172.21.15.1:0/3925122996 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55dd76d914d0 0x55dd76d938c0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=385c545f89ddff37 server_cookie=9a0b5d09d7e76c72 in_seq=0 out_seq=0 2024-09-19T09:42:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.228+0000 7f15f57fa640 1 -- 172.21.15.1:0/3925122996 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dd76ceca20 con 0x55dd76d914d0 2024-09-19T09:42:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.228+0000 7f15f57fa640 10 client.16059 handle_command_reply: tid=0 2024-09-19T09:42:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.228+0000 7f1616e39740 1 client.16059 shutdown 2024-09-19T09:42:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.228+0000 7f1616e39740 1 -- 172.21.15.1:0/3925122996 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd76d7c2e0 msgr2=0x55dd76d860d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.228+0000 7f1616e39740 1 --2- 172.21.15.1:0/3925122996 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd76d7c2e0 0x55dd76d860d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f15fc008010 tx=0x7f15fc0136b0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.228+0000 7f1616e39740 1 -- 172.21.15.1:0/3925122996 shutdown_connections 2024-09-19T09:42:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.228+0000 7f1616e39740 1 --2- 172.21.15.1:0/3925122996 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55dd76d914d0 0x55dd76d938c0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.228+0000 7f1616e39740 1 --2- 172.21.15.1:0/3925122996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd76d81370 0x55dd76d8d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.228+0000 7f1616e39740 1 --2- 172.21.15.1:0/3925122996 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd76d7c2e0 0x55dd76d860d0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.228+0000 7f15f57fa640 0 client.16059 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.228+0000 7f1616e39740 1 --2- 172.21.15.1:0/3925122996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dd76d7b9a0 0x55dd76d85b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.228+0000 7f1616e39740 1 -- 172.21.15.1:0/3925122996 >> 172.21.15.1:0/3925122996 conn(0x55dd76d77010 msgr2=0x55dd76d78820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.228+0000 7f1616e39740 1 -- 172.21.15.1:0/3925122996 shutdown_connections 2024-09-19T09:42:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.228+0000 7f1616e39740 1 -- 172.21.15.1:0/3925122996 wait complete. 2024-09-19T09:42:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.228+0000 7f1616e39740 20 client.16059 trim_cache size 0 max 16384 2024-09-19T09:42:51.245 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.242+0000 7f1616e39740 1 Processor -- start 2024-09-19T09:42:51.245 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.242+0000 7f1616e39740 1 -- start start 2024-09-19T09:42:51.245 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.243+0000 7f1616e39740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd76d7b9a0 0x55dd76d78400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.245 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.243+0000 7f1616e39740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dd76d7c2e0 0x55dd76d8d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.245 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.243+0000 7f1616e39740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd76d81370 0x55dd76d78940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.243+0000 7f1616e39740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f160c1a4f90 con 0x55dd76d81370 2024-09-19T09:42:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.243+0000 7f1616e39740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f160c1a7830 con 0x55dd76d7b9a0 2024-09-19T09:42:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.243+0000 7f1616e39740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f160c1a5620 con 0x55dd76d7c2e0 2024-09-19T09:42:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.243+0000 7f1612561640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd76d81370 0x55dd76d78940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.243+0000 7f1612561640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd76d81370 0x55dd76d78940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45878/0 (socket says 172.21.15.1:45878) 2024-09-19T09:42:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.243+0000 7f1612561640 1 -- 172.21.15.1:0/1197482283 learned_addr learned my addr 172.21.15.1:0/1197482283 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.243+0000 7f1611d60640 1 --2- 172.21.15.1:0/1197482283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd76d7b9a0 0x55dd76d78400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.243+0000 7f161155f640 1 --2- 172.21.15.1:0/1197482283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dd76d7c2e0 0x55dd76d8d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.243+0000 7f1612561640 1 -- 172.21.15.1:0/1197482283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dd76d7c2e0 msgr2=0x55dd76d8d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.243+0000 7f1612561640 1 --2- 172.21.15.1:0/1197482283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dd76d7c2e0 0x55dd76d8d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.243+0000 7f1612561640 1 -- 172.21.15.1:0/1197482283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd76d7b9a0 msgr2=0x55dd76d78400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.243+0000 7f1612561640 1 --2- 172.21.15.1:0/1197482283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd76d7b9a0 0x55dd76d78400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.243+0000 7f1612561640 1 -- 172.21.15.1:0/1197482283 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd76d93c30 con 0x55dd76d81370 2024-09-19T09:42:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.243+0000 7f1611d60640 1 --2- 172.21.15.1:0/1197482283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd76d7b9a0 0x55dd76d78400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.243+0000 7f1612561640 1 --2- 172.21.15.1:0/1197482283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd76d81370 0x55dd76d78940 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1604009ca0 tx=0x7f1604047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa52721eec3d95dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.243+0000 7f15f77fe640 1 -- 172.21.15.1:0/1197482283 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160403d990 con 0x55dd76d81370 2024-09-19T09:42:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.243+0000 7f15f77fe640 1 -- 172.21.15.1:0/1197482283 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1604036040 con 0x55dd76d81370 2024-09-19T09:42:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.243+0000 7f15f77fe640 1 -- 172.21.15.1:0/1197482283 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1604004860 con 0x55dd76d81370 2024-09-19T09:42:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.244+0000 7f1616e39740 1 -- 172.21.15.1:0/1197482283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd76d81370 msgr2=0x55dd76d78940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.244+0000 7f1616e39740 1 --2- 172.21.15.1:0/1197482283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd76d81370 0x55dd76d78940 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1604009ca0 tx=0x7f1604047000 comp rx=0 tx=0).stop 2024-09-19T09:42:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.244+0000 7f1616e39740 1 -- 172.21.15.1:0/1197482283 shutdown_connections 2024-09-19T09:42:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.244+0000 7f1616e39740 1 --2- 172.21.15.1:0/1197482283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd76d81370 0x55dd76d78940 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.244+0000 7f1616e39740 1 --2- 172.21.15.1:0/1197482283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dd76d7c2e0 0x55dd76d8d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.244+0000 7f1616e39740 1 --2- 172.21.15.1:0/1197482283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd76d7b9a0 0x55dd76d78400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.244+0000 7f1616e39740 1 -- 172.21.15.1:0/1197482283 >> 172.21.15.1:0/1197482283 conn(0x55dd76d77010 msgr2=0x55dd76d761c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.244+0000 7f1616e39740 1 -- 172.21.15.1:0/1197482283 shutdown_connections 2024-09-19T09:42:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.244+0000 7f1616e39740 1 -- 172.21.15.1:0/1197482283 wait complete. 2024-09-19T09:42:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.244+0000 7f1616e39740 1 -- start start 2024-09-19T09:42:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.244+0000 7f1616e39740 1 Processor -- start 2024-09-19T09:42:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.245+0000 7f1616e39740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd76d7b9a0 0x55dd76d8aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.245+0000 7f1616e39740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd76d7c2e0 0x55dd76d8af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.245+0000 7f1616e39740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dd76d81370 0x55dd76d8bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.245+0000 7f1616e39740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f160c1a5cf0 con 0x55dd76d7b9a0 2024-09-19T09:42:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.245+0000 7f1616e39740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f160c1a7160 con 0x55dd76d7c2e0 2024-09-19T09:42:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.245+0000 7f1616e39740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f160c1a63c0 con 0x55dd76d81370 2024-09-19T09:42:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.245+0000 7f1616e39740 10 client.0 _ll_register_callbacks cb 0x7f16080d37a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:42:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.245+0000 7f1611d60640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd76d7b9a0 0x55dd76d8aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.245+0000 7f1611d60640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd76d7b9a0 0x55dd76d8aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45890/0 (socket says 172.21.15.1:45890) 2024-09-19T09:42:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.245+0000 7f1611d60640 1 -- 172.21.15.1:0/3201967602 learned_addr learned my addr 172.21.15.1:0/3201967602 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:42:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.245+0000 7f161155f640 1 --2- 172.21.15.1:0/3201967602 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd76d7c2e0 0x55dd76d8af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.245+0000 7f1612561640 1 --2- 172.21.15.1:0/3201967602 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dd76d81370 0x55dd76d8bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.245+0000 7f1611d60640 1 -- 172.21.15.1:0/3201967602 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dd76d81370 msgr2=0x55dd76d8bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.245+0000 7f1611d60640 1 --2- 172.21.15.1:0/3201967602 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dd76d81370 0x55dd76d8bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.245+0000 7f1611d60640 1 -- 172.21.15.1:0/3201967602 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd76d7c2e0 msgr2=0x55dd76d8af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:42:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.245+0000 7f1611d60640 1 --2- 172.21.15.1:0/3201967602 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd76d7c2e0 0x55dd76d8af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.245+0000 7f1611d60640 1 -- 172.21.15.1:0/3201967602 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd76d8c590 con 0x55dd76d7b9a0 2024-09-19T09:42:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.245+0000 7f161155f640 1 --2- 172.21.15.1:0/3201967602 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd76d7c2e0 0x55dd76d8af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:42:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.245+0000 7f1611d60640 1 --2- 172.21.15.1:0/3201967602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd76d7b9a0 0x55dd76d8aa30 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f16080058c0 tx=0x7f16080987d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c964f80ee22bfbc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:42:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.245+0000 7f15f57fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:42:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.245+0000 7f15f57fa640 1 -- 172.21.15.1:0/3201967602 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1608085030 con 0x55dd76d7b9a0 2024-09-19T09:42:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.246+0000 7f15f57fa640 1 -- 172.21.15.1:0/3201967602 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f16080cda60 con 0x55dd76d7b9a0 2024-09-19T09:42:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.246+0000 7f1616e39740 1 -- 172.21.15.1:0/3201967602 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1604036040 con 0x55dd76d7b9a0 2024-09-19T09:42:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.246+0000 7f15f57fa640 1 -- 172.21.15.1:0/3201967602 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f160809cb70 con 0x55dd76d7b9a0 2024-09-19T09:42:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.246+0000 7f1616e39740 10 client.16065 fetch_fsmap learned FSMap version 19 2024-09-19T09:42:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.246+0000 7f1616e39740 1 -- 172.21.15.1:0/3201967602 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55dd76dfc3e0 con 0x55dd76d7b9a0 2024-09-19T09:42:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.246+0000 7f15f57fa640 1 -- 172.21.15.1:0/3201967602 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1604036040 con 0x55dd76d7b9a0 2024-09-19T09:42:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.246+0000 7f15f57fa640 1 -- 172.21.15.1:0/3201967602 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1608098ae0 con 0x55dd76d7b9a0 2024-09-19T09:42:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.246+0000 7f1616e39740 10 client.16065 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:42:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.246+0000 7f1616e39740 10 client.16065 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:42:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.246+0000 7f1616e39740 20 client.16065 populate_metadata read hostname 'smithi001' 2024-09-19T09:42:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.246+0000 7f1616e39740 1 --2- 172.21.15.1:0/3201967602 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55dd76dfcce0 0x55dd76dff0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:42:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.246+0000 7f1616e39740 4 client.16065 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:42:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.246+0000 7f1616e39740 1 -- 172.21.15.1:0/3201967602 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dd76ce6d70 con 0x55dd76dfcce0 2024-09-19T09:42:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.246+0000 7f161155f640 1 --2- 172.21.15.1:0/3201967602 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55dd76dfcce0 0x55dd76dff0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:42:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.247+0000 7f161155f640 1 --2- 172.21.15.1:0/3201967602 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55dd76dfcce0 0x55dd76dff0d0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41a15749084ee005 server_cookie=7f33047c600ccc35 in_seq=0 out_seq=0 2024-09-19T09:42:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.247+0000 7f15f57fa640 10 client.16065 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:51.579 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.577+0000 7f15f57fa640 1 -- 172.21.15.1:0/3201967602 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dd76ce6d70 con 0x55dd76dfcce0 2024-09-19T09:42:51.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.577+0000 7f15f57fa640 10 client.16065 handle_command_reply: tid=0 2024-09-19T09:42:51.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.577+0000 7f1616e39740 1 client.16065 shutdown 2024-09-19T09:42:51.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.577+0000 7f1616e39740 1 -- 172.21.15.1:0/3201967602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd76d7b9a0 msgr2=0x55dd76d8aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:51.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.577+0000 7f1616e39740 1 --2- 172.21.15.1:0/3201967602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd76d7b9a0 0x55dd76d8aa30 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f16080058c0 tx=0x7f16080987d0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.578+0000 7f1616e39740 1 -- 172.21.15.1:0/3201967602 shutdown_connections 2024-09-19T09:42:51.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.578+0000 7f1616e39740 1 --2- 172.21.15.1:0/3201967602 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55dd76dfcce0 0x55dd76dff0d0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.578+0000 7f15f57fa640 0 client.16065 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:42:51.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.578+0000 7f1616e39740 1 --2- 172.21.15.1:0/3201967602 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dd76d81370 0x55dd76d8bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.578+0000 7f1616e39740 1 --2- 172.21.15.1:0/3201967602 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55dd76d7c2e0 0x55dd76d8af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.578+0000 7f1616e39740 1 --2- 172.21.15.1:0/3201967602 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55dd76d7b9a0 0x55dd76d8aa30 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.578+0000 7f1616e39740 1 -- 172.21.15.1:0/3201967602 >> 172.21.15.1:0/3201967602 conn(0x55dd76d77010 msgr2=0x55dd76d761c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:51.580 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.578+0000 7f1616e39740 1 -- 172.21.15.1:0/3201967602 shutdown_connections 2024-09-19T09:42:51.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.578+0000 7f1616e39740 1 -- 172.21.15.1:0/3201967602 wait complete. 2024-09-19T09:42:51.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.578+0000 7f1616e39740 20 client.16065 trim_cache size 0 max 16384 2024-09-19T09:42:51.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:42:51.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:42:51.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:42:51.581 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:42:51.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.579+0000 7f1613fc4640 1 -- 172.21.15.1:0/4241564790 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f15f80a3240 msgr2=0x7f15f80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:51.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.579+0000 7f1613fc4640 1 --2- 172.21.15.1:0/4241564790 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f15f80a3240 0x7f15f80a5700 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1604006010 tx=0x7f1604005fa0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.579+0000 7f1613fc4640 1 -- 172.21.15.1:0/4241564790 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f160c101b70 msgr2=0x7f160c197eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:42:51.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.579+0000 7f1613fc4640 1 --2- 172.21.15.1:0/4241564790 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f160c101b70 0x7f160c197eb0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f160800e9c0 tx=0x7f160800ee80 comp rx=0 tx=0).stop 2024-09-19T09:42:51.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.579+0000 7f1613fc4640 1 -- 172.21.15.1:0/4241564790 shutdown_connections 2024-09-19T09:42:51.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.579+0000 7f1613fc4640 1 --2- 172.21.15.1:0/4241564790 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f15f80a3240 0x7f15f80a5700 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.582 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.579+0000 7f1613fc4640 1 --2- 172.21.15.1:0/4241564790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f160c103720 0x7f160c19f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.579+0000 7f1613fc4640 1 --2- 172.21.15.1:0/4241564790 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f160c102d60 0x7f160c1983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.579+0000 7f1613fc4640 1 --2- 172.21.15.1:0/4241564790 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f160c101b70 0x7f160c197eb0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:42:51.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.579+0000 7f1613fc4640 1 -- 172.21.15.1:0/4241564790 >> 172.21.15.1:0/4241564790 conn(0x7f160c0fd2f0 msgr2=0x7f160c106130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:42:51.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.579+0000 7f1613fc4640 1 -- 172.21.15.1:0/4241564790 shutdown_connections 2024-09-19T09:42:51.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:42:51.579+0000 7f1613fc4640 1 -- 172.21.15.1:0/4241564790 wait complete. 2024-09-19T09:42:51.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:51 smithi022 ceph-mon[35583]: pgmap v481: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 72 MiB/s wr, 11.43k op/s 2024-09-19T09:42:51.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:51 smithi121 ceph-mon[35577]: pgmap v481: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 72 MiB/s wr, 11.43k op/s 2024-09-19T09:42:51.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:51 smithi001 ceph-mon[31225]: pgmap v481: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 72 MiB/s wr, 11.43k op/s 2024-09-19T09:42:53.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:53 smithi022 ceph-mon[35583]: pgmap v482: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 93 MiB/s wr, 14.35k op/s 2024-09-19T09:42:53.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:53 smithi121 ceph-mon[35577]: pgmap v482: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 93 MiB/s wr, 14.35k op/s 2024-09-19T09:42:53.662 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:53 smithi001 ceph-mon[31225]: pgmap v482: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 93 MiB/s wr, 14.35k op/s 2024-09-19T09:42:55.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:55 smithi022 ceph-mon[35583]: pgmap v483: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 94 MiB/s wr, 14.03k op/s 2024-09-19T09:42:55.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:55 smithi121 ceph-mon[35577]: pgmap v483: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 94 MiB/s wr, 14.03k op/s 2024-09-19T09:42:55.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:55 smithi001 ceph-mon[31225]: pgmap v483: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 94 MiB/s wr, 14.03k op/s 2024-09-19T09:42:57.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:57 smithi022 ceph-mon[35583]: pgmap v484: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 115 MiB/s wr, 16.88k op/s 2024-09-19T09:42:57.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:57 smithi121 ceph-mon[35577]: pgmap v484: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 115 MiB/s wr, 16.88k op/s 2024-09-19T09:42:57.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:57 smithi001 ceph-mon[31225]: pgmap v484: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 115 MiB/s wr, 16.88k op/s 2024-09-19T09:42:58.659 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:42:59.210 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:42:59.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:42:59 smithi121 ceph-mon[35577]: pgmap v485: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 110 MiB/s wr, 15.79k op/s 2024-09-19T09:42:59.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:42:59 smithi001 ceph-mon[31225]: pgmap v485: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 110 MiB/s wr, 15.79k op/s 2024-09-19T09:42:59.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:42:59 smithi022 ceph-mon[35583]: pgmap v485: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 110 MiB/s wr, 15.79k op/s 2024-09-19T09:43:01.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:01 smithi001 ceph-mon[31225]: pgmap v486: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 94 MiB/s wr, 13.34k op/s 2024-09-19T09:43:01.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:01 smithi022 ceph-mon[35583]: pgmap v486: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 94 MiB/s wr, 13.34k op/s 2024-09-19T09:43:01.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:01 smithi121 ceph-mon[35577]: pgmap v486: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 94 MiB/s wr, 13.34k op/s 2024-09-19T09:43:03.677 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:03 smithi001 ceph-mon[31225]: pgmap v487: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 116 MiB/s wr, 16.59k op/s 2024-09-19T09:43:03.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:03 smithi022 ceph-mon[35583]: pgmap v487: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 116 MiB/s wr, 16.59k op/s 2024-09-19T09:43:03.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:03 smithi121 ceph-mon[35577]: pgmap v487: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 116 MiB/s wr, 16.59k op/s 2024-09-19T09:43:04.670 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-19T09:43:04.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.769+0000 7fb390fcd640 1 -- 172.21.15.1:0/3153923566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb38c109830 msgr2=0x7fb38c109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:04.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.769+0000 7fb390fcd640 1 --2- 172.21.15.1:0/3153923566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb38c109830 0x7fb38c109c90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb384009be0 tx=0x7fb38402a710 comp rx=0 tx=0).stop 2024-09-19T09:43:04.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.773+0000 7fb390fcd640 1 -- 172.21.15.1:0/3153923566 shutdown_connections 2024-09-19T09:43:04.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.773+0000 7fb390fcd640 1 --2- 172.21.15.1:0/3153923566 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb38c11b140 0x7fb38c11d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.773+0000 7fb390fcd640 1 --2- 172.21.15.1:0/3153923566 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb38c109830 0x7fb38c109c90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.773+0000 7fb390fcd640 1 --2- 172.21.15.1:0/3153923566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb38c109450 0x7fb38c110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.773+0000 7fb390fcd640 1 -- 172.21.15.1:0/3153923566 >> 172.21.15.1:0/3153923566 conn(0x7fb38c06e140 msgr2=0x7fb38c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:04.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.773+0000 7fb390fcd640 1 -- 172.21.15.1:0/3153923566 shutdown_connections 2024-09-19T09:43:04.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.773+0000 7fb390fcd640 1 -- 172.21.15.1:0/3153923566 wait complete. 2024-09-19T09:43:04.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.774+0000 7fb390fcd640 1 Processor -- start 2024-09-19T09:43:04.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.774+0000 7fb390fcd640 1 -- start start 2024-09-19T09:43:04.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.774+0000 7fb390fcd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb38c109450 0x7fb38c118700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.774+0000 7fb390fcd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb38c109830 0x7fb38c111790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.774+0000 7fb390fcd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb38c11b140 0x7fb38c111cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.774+0000 7fb390fcd640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb38c120dc0 con 0x7fb38c11b140 2024-09-19T09:43:04.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.774+0000 7fb390fcd640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb38c120c40 con 0x7fb38c109450 2024-09-19T09:43:04.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.774+0000 7fb390fcd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb38c120f40 con 0x7fb38c109830 2024-09-19T09:43:04.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.775+0000 7fb38ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb38c11b140 0x7fb38c111cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:04.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.775+0000 7fb38ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb38c11b140 0x7fb38c111cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47388/0 (socket says 172.21.15.1:47388) 2024-09-19T09:43:04.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.775+0000 7fb38ad9d640 1 -- 172.21.15.1:0/2097449187 learned_addr learned my addr 172.21.15.1:0/2097449187 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:04.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.775+0000 7fb38a59c640 1 --2- 172.21.15.1:0/2097449187 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb38c109450 0x7fb38c118700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:04.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.776+0000 7fb38a59c640 1 -- 172.21.15.1:0/2097449187 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb38c109830 msgr2=0x7fb38c111790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:04.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.776+0000 7fb38a59c640 1 --2- 172.21.15.1:0/2097449187 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb38c109830 0x7fb38c111790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.776+0000 7fb38a59c640 1 -- 172.21.15.1:0/2097449187 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb38c11b140 msgr2=0x7fb38c111cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:04.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.776+0000 7fb38a59c640 1 --2- 172.21.15.1:0/2097449187 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb38c11b140 0x7fb38c111cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.776+0000 7fb38a59c640 1 -- 172.21.15.1:0/2097449187 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb38c112290 con 0x7fb38c109450 2024-09-19T09:43:04.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.777+0000 7fb38a59c640 1 --2- 172.21.15.1:0/2097449187 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb38c109450 0x7fb38c118700 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb37c00b3f0 tx=0x7fb37c00b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:04.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.777+0000 7fb37b7fe640 1 -- 172.21.15.1:0/2097449187 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb37c015020 con 0x7fb38c109450 2024-09-19T09:43:04.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.777+0000 7fb37b7fe640 1 -- 172.21.15.1:0/2097449187 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb37c011d10 con 0x7fb38c109450 2024-09-19T09:43:04.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.777+0000 7fb37b7fe640 1 -- 172.21.15.1:0/2097449187 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb37c00f2e0 con 0x7fb38c109450 2024-09-19T09:43:04.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.777+0000 7fb390fcd640 1 -- 172.21.15.1:0/2097449187 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb38c112580 con 0x7fb38c109450 2024-09-19T09:43:04.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.778+0000 7fb390fcd640 1 -- 172.21.15.1:0/2097449187 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb38c116550 con 0x7fb38c109450 2024-09-19T09:43:04.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.782+0000 7fb3933a6740 1 Processor -- start 2024-09-19T09:43:04.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.782+0000 7fb3933a6740 1 -- start start 2024-09-19T09:43:04.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.782+0000 7fb3933a6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38d3e8b40 0x55b38d3e7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.782+0000 7fb3933a6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b38d3e75d0 0x55b38d3e7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.782+0000 7fb3933a6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b38d3f2370 0x55b38d3f4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.782+0000 7fb3933a6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b38d34d2f0 con 0x55b38d3f2370 2024-09-19T09:43:04.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.782+0000 7fb3933a6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b38d2f4cf0 con 0x55b38d3e75d0 2024-09-19T09:43:04.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.782+0000 7fb3933a6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b38d3492b0 con 0x55b38d3e8b40 2024-09-19T09:43:04.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.783+0000 7fb38ad9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38d3e8b40 0x55b38d3e7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:04.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.783+0000 7fb38ad9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38d3e8b40 0x55b38d3e7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:60832/0 (socket says 172.21.15.1:60832) 2024-09-19T09:43:04.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.783+0000 7fb38ad9d640 1 -- 172.21.15.1:0/86906851 learned_addr learned my addr 172.21.15.1:0/86906851 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:04.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.784+0000 7fb37b7fe640 1 -- 172.21.15.1:0/2097449187 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fb37c018020 con 0x7fb38c109450 2024-09-19T09:43:04.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.785+0000 7fb38a59c640 1 --2- 172.21.15.1:0/86906851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b38d3e75d0 0x55b38d3e7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:04.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.786+0000 7fb389d9b640 1 --2- 172.21.15.1:0/86906851 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b38d3f2370 0x55b38d3f4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:04.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.786+0000 7fb38ad9d640 1 -- 172.21.15.1:0/86906851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b38d3e75d0 msgr2=0x55b38d3e7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:04.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.786+0000 7fb38ad9d640 1 --2- 172.21.15.1:0/86906851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b38d3e75d0 0x55b38d3e7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.786+0000 7fb38ad9d640 1 -- 172.21.15.1:0/86906851 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b38d3f2370 msgr2=0x55b38d3f4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:04.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.786+0000 7fb38ad9d640 1 --2- 172.21.15.1:0/86906851 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b38d3f2370 0x55b38d3f4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.786+0000 7fb38ad9d640 1 -- 172.21.15.1:0/86906851 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b38d2d93a0 con 0x55b38d3e8b40 2024-09-19T09:43:04.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.787+0000 7fb37b7fe640 1 --2- 172.21.15.1:0/2097449187 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb3740a3410 0x7fb3740a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.787+0000 7fb37b7fe640 1 -- 172.21.15.1:0/2097449187 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fb37c0cef60 con 0x7fb38c109450 2024-09-19T09:43:04.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.788+0000 7fb38ad9d640 1 --2- 172.21.15.1:0/86906851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38d3e8b40 0x55b38d3e7090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb38000bd70 tx=0x7fb3800107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d1e7de8054089c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:04.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.788+0000 7fb38a59c640 1 --2- 172.21.15.1:0/2097449187 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb3740a3410 0x7fb3740a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:04.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.789+0000 7fb389d9b640 1 --2- 172.21.15.1:0/86906851 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b38d3f2370 0x55b38d3f4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:43:04.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.789+0000 7fb38a59c640 1 --2- 172.21.15.1:0/2097449187 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb3740a3410 0x7fb3740a58d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb37c09b240 tx=0x7fb37c0046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:04.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.792+0000 7fb378ff9640 1 -- 172.21.15.1:0/86906851 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb38000be60 con 0x55b38d3e8b40 2024-09-19T09:43:04.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.792+0000 7fb378ff9640 1 -- 172.21.15.1:0/86906851 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb380011b20 con 0x55b38d3e8b40 2024-09-19T09:43:04.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.792+0000 7fb378ff9640 1 -- 172.21.15.1:0/86906851 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb380019ca0 con 0x55b38d3e8b40 2024-09-19T09:43:04.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.793+0000 7fb3933a6740 1 -- 172.21.15.1:0/86906851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38d3e8b40 msgr2=0x55b38d3e7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:04.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.793+0000 7fb3933a6740 1 --2- 172.21.15.1:0/86906851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38d3e8b40 0x55b38d3e7090 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb38000bd70 tx=0x7fb3800107a0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.794+0000 7fb3933a6740 1 -- 172.21.15.1:0/86906851 shutdown_connections 2024-09-19T09:43:04.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.794+0000 7fb3933a6740 1 --2- 172.21.15.1:0/86906851 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b38d3f2370 0x55b38d3f4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.794+0000 7fb3933a6740 1 --2- 172.21.15.1:0/86906851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b38d3e75d0 0x55b38d3e7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.794+0000 7fb3933a6740 1 --2- 172.21.15.1:0/86906851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38d3e8b40 0x55b38d3e7090 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.794+0000 7fb3933a6740 1 -- 172.21.15.1:0/86906851 >> 172.21.15.1:0/86906851 conn(0x55b38d3b0310 msgr2=0x55b38d3e3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:04.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.794+0000 7fb3933a6740 1 -- 172.21.15.1:0/86906851 shutdown_connections 2024-09-19T09:43:04.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.794+0000 7fb3933a6740 1 -- 172.21.15.1:0/86906851 wait complete. 2024-09-19T09:43:04.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.795+0000 7fb3933a6740 1 -- start start 2024-09-19T09:43:04.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.795+0000 7fb3933a6740 1 Processor -- start 2024-09-19T09:43:04.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.795+0000 7fb3933a6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b38d3e75d0 0x55b38d3f1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.795+0000 7fb3933a6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b38d3e8b40 0x55b38d3eef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.795+0000 7fb3933a6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38d3f2370 0x55b38d3ef4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.795+0000 7fb3933a6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55b38d3f50c0 con 0x55b38d3e8b40 2024-09-19T09:43:04.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.795+0000 7fb3933a6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b38d308060 con 0x55b38d3e75d0 2024-09-19T09:43:04.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.795+0000 7fb3933a6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b38d3f5240 con 0x55b38d3f2370 2024-09-19T09:43:04.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.796+0000 7fb3933a6740 10 client.0 _ll_register_callbacks cb 0x55b38d05b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:43:04.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.798+0000 7fb389d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b38d3e8b40 0x55b38d3eef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:04.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.798+0000 7fb389d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b38d3e8b40 0x55b38d3eef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47412/0 (socket says 172.21.15.1:47412) 2024-09-19T09:43:04.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.798+0000 7fb389d9b640 1 -- 172.21.15.1:0/704249145 learned_addr learned my addr 172.21.15.1:0/704249145 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:04.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.798+0000 7fb38ad9d640 1 --2- 172.21.15.1:0/704249145 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b38d3e75d0 0x55b38d3f1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:04.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.798+0000 7fb38ad9d640 1 --2- 172.21.15.1:0/704249145 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38d3f2370 0x55b38d3ef4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:04.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.798+0000 7fb38ad9d640 1 -- 172.21.15.1:0/704249145 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38d3f2370 msgr2=0x55b38d3ef4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:04.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.798+0000 7fb38ad9d640 1 --2- 172.21.15.1:0/704249145 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38d3f2370 0x55b38d3ef4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.798+0000 7fb38ad9d640 1 -- 172.21.15.1:0/704249145 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b38d3e8b40 msgr2=0x55b38d3eef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:04.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.798+0000 7fb38ad9d640 1 --2- 172.21.15.1:0/704249145 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b38d3e8b40 0x55b38d3eef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.798+0000 7fb38ad9d640 1 -- 172.21.15.1:0/704249145 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b38d0be3c0 con 0x55b38d3e75d0 2024-09-19T09:43:04.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.799+0000 7fb38ad9d640 1 --2- 172.21.15.1:0/704249145 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b38d3e75d0 0x55b38d3f1cd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb380000c00 tx=0x7fb380013040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=865eaf9fcb3fb7fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:04.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.799+0000 7fb371ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:43:04.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.799+0000 7fb371ffb640 1 -- 172.21.15.1:0/704249145 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb38002e060 con 0x55b38d3e75d0 2024-09-19T09:43:04.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.799+0000 7fb3933a6740 1 -- 172.21.15.1:0/704249145 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb380011b20 con 0x55b38d3e75d0 2024-09-19T09:43:04.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.800+0000 7fb371ffb640 1 -- 172.21.15.1:0/704249145 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fb380019c50 con 0x55b38d3e75d0 2024-09-19T09:43:04.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.800+0000 7fb371ffb640 1 -- 172.21.15.1:0/704249145 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb380019e50 con 0x55b38d3e75d0 2024-09-19T09:43:04.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.801+0000 7fb3933a6740 10 client.25727 fetch_fsmap learned FSMap version 19 2024-09-19T09:43:04.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.801+0000 7fb3933a6740 1 -- 172.21.15.1:0/704249145 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55b38d400ad0 con 0x55b38d3e75d0 2024-09-19T09:43:04.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.801+0000 7fb371ffb640 1 -- 172.21.15.1:0/704249145 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb380011b20 con 0x55b38d3e75d0 2024-09-19T09:43:04.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.803+0000 7fb371ffb640 1 -- 172.21.15.1:0/704249145 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb38001aa20 con 0x55b38d3e75d0 2024-09-19T09:43:04.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.803+0000 7fb3933a6740 10 client.25727 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:43:04.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.803+0000 7fb3933a6740 10 client.25727 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:43:04.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.803+0000 7fb3933a6740 20 client.25727 populate_metadata read hostname 'smithi001' 2024-09-19T09:43:04.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.803+0000 7fb3933a6740 1 --2- 172.21.15.1:0/704249145 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b38d402360 0x55b38d4047a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.803+0000 7fb3933a6740 4 client.25727 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:43:04.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.803+0000 7fb3933a6740 1 -- 172.21.15.1:0/704249145 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b38d35a860 con 0x55b38d402360 2024-09-19T09:43:04.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.805+0000 7fb389d9b640 1 --2- 172.21.15.1:0/704249145 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b38d402360 0x55b38d4047a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:04.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.805+0000 7fb389d9b640 1 --2- 172.21.15.1:0/704249145 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b38d402360 0x55b38d4047a0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=600da187bd9ab270 server_cookie=5029edb920c5bb4d in_seq=0 out_seq=0 2024-09-19T09:43:04.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.806+0000 7fb371ffb640 10 client.25727 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:43:04.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.806+0000 7fb371ffb640 1 -- 172.21.15.1:0/704249145 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b38d35a860 con 0x55b38d402360 2024-09-19T09:43:04.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.807+0000 7fb371ffb640 10 client.25727 handle_command_reply: tid=0 2024-09-19T09:43:04.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.807+0000 7fb3933a6740 1 client.25727 shutdown 2024-09-19T09:43:04.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.811+0000 7fb3933a6740 1 -- 172.21.15.1:0/704249145 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b38d3e75d0 msgr2=0x55b38d3f1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:04.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.811+0000 7fb3933a6740 1 --2- 172.21.15.1:0/704249145 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b38d3e75d0 0x55b38d3f1cd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb380000c00 tx=0x7fb380013040 comp rx=0 tx=0).stop 2024-09-19T09:43:04.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.812+0000 7fb3933a6740 1 -- 172.21.15.1:0/704249145 shutdown_connections 2024-09-19T09:43:04.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.812+0000 7fb3933a6740 1 --2- 172.21.15.1:0/704249145 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b38d402360 0x55b38d4047a0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.812+0000 7fb3933a6740 1 --2- 172.21.15.1:0/704249145 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38d3f2370 0x55b38d3ef4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.812+0000 7fb3933a6740 1 --2- 172.21.15.1:0/704249145 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b38d3e8b40 0x55b38d3eef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.812+0000 7fb3933a6740 1 --2- 172.21.15.1:0/704249145 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b38d3e75d0 0x55b38d3f1cd0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.812+0000 7fb3933a6740 1 -- 172.21.15.1:0/704249145 >> 172.21.15.1:0/704249145 conn(0x55b38d3b0310 msgr2=0x55b38d3e9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:04.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.812+0000 7fb371ffb640 0 client.25727 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:43:04.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.813+0000 7fb3933a6740 1 -- 172.21.15.1:0/704249145 shutdown_connections 2024-09-19T09:43:04.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.813+0000 7fb3933a6740 1 -- 172.21.15.1:0/704249145 wait complete. 2024-09-19T09:43:04.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.813+0000 7fb3933a6740 20 client.25727 trim_cache size 0 max 16384 2024-09-19T09:43:04.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.842+0000 7fb3933a6740 1 Processor -- start 2024-09-19T09:43:04.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.842+0000 7fb3933a6740 1 -- start start 2024-09-19T09:43:04.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.843+0000 7fb3933a6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38d3e75d0 0x55b38d3e3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.843+0000 7fb3933a6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b38d3e8b40 0x55b38d3fe3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.843+0000 7fb38ad9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38d3e75d0 0x55b38d3e3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:04.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.843+0000 7fb38ad9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38d3e75d0 0x55b38d3e3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:60856/0 (socket says 172.21.15.1:60856) 2024-09-19T09:43:04.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.844+0000 7fb38ad9d640 1 -- 172.21.15.1:0/3296016235 learned_addr learned my addr 172.21.15.1:0/3296016235 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:04.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.844+0000 7fb3933a6740 1 --2- 172.21.15.1:0/3296016235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b38d3f2370 0x55b38d3ee840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.844+0000 7fb3933a6740 1 -- 172.21.15.1:0/3296016235 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb36c00c3d0 con 0x55b38d3e8b40 2024-09-19T09:43:04.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.844+0000 7fb3933a6740 1 -- 172.21.15.1:0/3296016235 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb36c00eba0 con 0x55b38d3f2370 2024-09-19T09:43:04.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.844+0000 7fb3933a6740 1 -- 172.21.15.1:0/3296016235 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb36c00c990 con 0x55b38d3e75d0 2024-09-19T09:43:04.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.844+0000 7fb389d9b640 1 --2- 172.21.15.1:0/3296016235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b38d3e8b40 0x55b38d3fe3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:04.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.845+0000 7fb389d9b640 1 -- 172.21.15.1:0/3296016235 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38d3e75d0 msgr2=0x55b38d3e3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:04.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.845+0000 7fb389d9b640 1 --2- 172.21.15.1:0/3296016235 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38d3e75d0 0x55b38d3e3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.845+0000 7fb389d9b640 1 -- 172.21.15.1:0/3296016235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b38d3f2370 msgr2=0x55b38d3ee840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:04.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.845+0000 7fb389d9b640 1 --2- 172.21.15.1:0/3296016235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b38d3f2370 0x55b38d3ee840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.686 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.845+0000 7fb389d9b640 1 -- 172.21.15.1:0/3296016235 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b38d3f2000 con 0x55b38d3e8b40 2024-09-19T09:43:04.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.846+0000 7fb389d9b640 1 --2- 172.21.15.1:0/3296016235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b38d3e8b40 0x55b38d3fe3f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fb38402ac30 tx=0x7fb384030ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25db29569781e0a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:04.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.846+0000 7fb373fff640 1 -- 172.21.15.1:0/3296016235 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb38404b070 con 0x55b38d3e8b40 2024-09-19T09:43:04.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.846+0000 7fb373fff640 1 -- 172.21.15.1:0/3296016235 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb384037040 con 0x55b38d3e8b40 2024-09-19T09:43:04.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.846+0000 7fb373fff640 1 -- 172.21.15.1:0/3296016235 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb384036040 con 0x55b38d3e8b40 2024-09-19T09:43:04.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.848+0000 7fb3933a6740 1 -- 172.21.15.1:0/3296016235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b38d3e8b40 msgr2=0x55b38d3fe3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:04.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.848+0000 7fb3933a6740 1 --2- 172.21.15.1:0/3296016235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b38d3e8b40 0x55b38d3fe3f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fb38402ac30 tx=0x7fb384030ca0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.850+0000 7fb3933a6740 1 -- 172.21.15.1:0/3296016235 shutdown_connections 2024-09-19T09:43:04.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.850+0000 7fb3933a6740 1 --2- 172.21.15.1:0/3296016235 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b38d3f2370 0x55b38d3ee840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.850+0000 7fb3933a6740 1 --2- 172.21.15.1:0/3296016235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b38d3e8b40 0x55b38d3fe3f0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.850+0000 7fb3933a6740 1 --2- 172.21.15.1:0/3296016235 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38d3e75d0 0x55b38d3e3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.850+0000 7fb3933a6740 1 -- 172.21.15.1:0/3296016235 >> 172.21.15.1:0/3296016235 conn(0x55b38d3b0310 msgr2=0x55b38d3e3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:04.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.851+0000 7fb3933a6740 1 -- 172.21.15.1:0/3296016235 shutdown_connections 2024-09-19T09:43:04.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.852+0000 7fb3933a6740 1 -- 172.21.15.1:0/3296016235 wait complete. 2024-09-19T09:43:04.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.852+0000 7fb3933a6740 1 -- start start 2024-09-19T09:43:04.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.852+0000 7fb3933a6740 1 Processor -- start 2024-09-19T09:43:04.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.853+0000 7fb3933a6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b38d3e75d0 0x55b38d3fae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.853+0000 7fb3933a6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38d3e8b40 0x55b38d3f5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.853+0000 7fb3933a6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b38d3f2370 0x55b38d3f5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.853+0000 7fb38ad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b38d3e75d0 0x55b38d3fae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:04.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.853+0000 7fb38ad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b38d3e75d0 0x55b38d3fae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:51622/0 (socket says 172.21.15.1:51622) 2024-09-19T09:43:04.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.853+0000 7fb38ad9d640 1 -- 172.21.15.1:0/3642185342 learned_addr learned my addr 172.21.15.1:0/3642185342 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:04.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.853+0000 7fb3933a6740 1 -- 172.21.15.1:0/3642185342 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb36c00d060 con 0x55b38d3f2370 2024-09-19T09:43:04.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.854+0000 7fb3933a6740 1 -- 172.21.15.1:0/3642185342 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb36c00e4d0 con 0x55b38d3e75d0 2024-09-19T09:43:04.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.854+0000 7fb3933a6740 1 -- 172.21.15.1:0/3642185342 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb36c00d730 con 0x55b38d3e8b40 2024-09-19T09:43:04.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.854+0000 7fb3933a6740 10 client.0 _ll_register_callbacks cb 0x7fb38000bbc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:43:04.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.854+0000 7fb389d9b640 1 --2- 172.21.15.1:0/3642185342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38d3e8b40 0x55b38d3f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:04.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.855+0000 7fb389d9b640 1 -- 172.21.15.1:0/3642185342 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b38d3e75d0 msgr2=0x55b38d3fae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:04.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.855+0000 7fb389d9b640 1 --2- 172.21.15.1:0/3642185342 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b38d3e75d0 0x55b38d3fae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.855+0000 7fb389d9b640 1 -- 172.21.15.1:0/3642185342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b38d3f2370 msgr2=0x55b38d3f5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:04.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.855+0000 7fb389d9b640 1 --2- 172.21.15.1:0/3642185342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b38d3f2370 0x55b38d3f5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.855+0000 7fb389d9b640 1 -- 172.21.15.1:0/3642185342 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b38d46b070 con 0x55b38d3e8b40 2024-09-19T09:43:04.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.856+0000 7fb389d9b640 1 --2- 172.21.15.1:0/3642185342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38d3e8b40 0x55b38d3f5520 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x55b38d3e2420 tx=0x7fb384003db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86c3c75d239e8da9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:04.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.856+0000 7fb371ffb640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-19T09:43:04.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.856+0000 7fb371ffb640 1 -- 172.21.15.1:0/3642185342 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb384054060 con 0x55b38d3e8b40 2024-09-19T09:43:04.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.856+0000 7fb3933a6740 1 -- 172.21.15.1:0/3642185342 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb384037040 con 0x55b38d3e8b40 2024-09-19T09:43:04.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.856+0000 7fb371ffb640 1 -- 172.21.15.1:0/3642185342 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fb384003970 con 0x55b38d3e8b40 2024-09-19T09:43:04.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.857+0000 7fb371ffb640 1 -- 172.21.15.1:0/3642185342 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb38404b040 con 0x55b38d3e8b40 2024-09-19T09:43:04.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.857+0000 7fb3933a6740 10 client.25564 fetch_fsmap learned FSMap version 19 2024-09-19T09:43:04.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.857+0000 7fb3933a6740 1 -- 172.21.15.1:0/3642185342 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55b38d46c1e0 con 0x55b38d3e8b40 2024-09-19T09:43:04.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.858+0000 7fb371ffb640 1 -- 172.21.15.1:0/3642185342 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb384037040 con 0x55b38d3e8b40 2024-09-19T09:43:04.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.860+0000 7fb371ffb640 1 -- 172.21.15.1:0/3642185342 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fb384059070 con 0x55b38d3e8b40 2024-09-19T09:43:04.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.860+0000 7fb3933a6740 10 client.25564 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:43:04.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.860+0000 7fb3933a6740 10 client.25564 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:43:04.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.860+0000 7fb3933a6740 20 client.25564 populate_metadata read hostname 'smithi001' 2024-09-19T09:43:04.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.860+0000 7fb3933a6740 1 --2- 172.21.15.1:0/3642185342 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b38d46c800 0x55b38d46ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.861+0000 7fb3933a6740 4 client.25564 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:43:04.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.861+0000 7fb3933a6740 1 -- 172.21.15.1:0/3642185342 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b38d354d70 con 0x55b38d46c800 2024-09-19T09:43:04.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.861+0000 7fb38ad9d640 1 --2- 172.21.15.1:0/3642185342 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b38d46c800 0x55b38d46ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:04.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.864+0000 7fb38ad9d640 1 --2- 172.21.15.1:0/3642185342 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b38d46c800 0x55b38d46ebf0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aac7edda2c840b62 server_cookie=ec83a1fab9f3c6a6 in_seq=0 out_seq=0 2024-09-19T09:43:04.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.864+0000 7fb371ffb640 10 client.25564 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:43:04.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.865+0000 7fb371ffb640 1 -- 172.21.15.1:0/3642185342 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b38d354d70 con 0x55b38d46c800 2024-09-19T09:43:04.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.865+0000 7fb371ffb640 10 client.25564 handle_command_reply: tid=0 2024-09-19T09:43:04.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.865+0000 7fb3933a6740 1 client.25564 shutdown 2024-09-19T09:43:04.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.865+0000 7fb3933a6740 1 -- 172.21.15.1:0/3642185342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38d3e8b40 msgr2=0x55b38d3f5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:04.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.866+0000 7fb3933a6740 1 --2- 172.21.15.1:0/3642185342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38d3e8b40 0x55b38d3f5520 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x55b38d3e2420 tx=0x7fb384003db0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.866+0000 7fb3933a6740 1 -- 172.21.15.1:0/3642185342 shutdown_connections 2024-09-19T09:43:04.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.866+0000 7fb3933a6740 1 --2- 172.21.15.1:0/3642185342 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55b38d46c800 0x55b38d46ebf0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.866+0000 7fb3933a6740 1 --2- 172.21.15.1:0/3642185342 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55b38d3f2370 0x55b38d3f5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.866+0000 7fb3933a6740 1 --2- 172.21.15.1:0/3642185342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b38d3e8b40 0x55b38d3f5520 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.866+0000 7fb3933a6740 1 --2- 172.21.15.1:0/3642185342 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b38d3e75d0 0x55b38d3fae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.866+0000 7fb3933a6740 1 -- 172.21.15.1:0/3642185342 >> 172.21.15.1:0/3642185342 conn(0x55b38d3b0310 msgr2=0x55b38d3e24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:04.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.867+0000 7fb371ffb640 0 client.25564 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:43:04.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.870+0000 7fb3933a6740 1 -- 172.21.15.1:0/3642185342 shutdown_connections 2024-09-19T09:43:04.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.871+0000 7fb3933a6740 1 -- 172.21.15.1:0/3642185342 wait complete. 2024-09-19T09:43:04.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.872+0000 7fb3933a6740 20 client.25564 trim_cache size 0 max 16384 2024-09-19T09:43:04.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.875+0000 7fb390fcd640 1 -- 172.21.15.1:0/2097449187 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb3740a3410 msgr2=0x7fb3740a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:04.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.875+0000 7fb390fcd640 1 --2- 172.21.15.1:0/2097449187 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb3740a3410 0x7fb3740a58d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb37c09b240 tx=0x7fb37c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.875+0000 7fb390fcd640 1 -- 172.21.15.1:0/2097449187 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb38c109450 msgr2=0x7fb38c118700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:04.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.875+0000 7fb390fcd640 1 --2- 172.21.15.1:0/2097449187 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb38c109450 0x7fb38c118700 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb37c00b3f0 tx=0x7fb37c00b8b0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.875+0000 7fb390fcd640 1 -- 172.21.15.1:0/2097449187 shutdown_connections 2024-09-19T09:43:04.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.875+0000 7fb390fcd640 1 --2- 172.21.15.1:0/2097449187 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb38c11b140 0x7fb38c111cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.875+0000 7fb390fcd640 1 --2- 172.21.15.1:0/2097449187 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb38c109830 0x7fb38c111790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.875+0000 7fb390fcd640 1 --2- 172.21.15.1:0/2097449187 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb3740a3410 0x7fb3740a58d0 secure :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb37c09b240 tx=0x7fb37c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.875+0000 7fb390fcd640 1 --2- 172.21.15.1:0/2097449187 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb38c109450 0x7fb38c118700 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb37c00b3f0 tx=0x7fb37c00b8b0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.875+0000 7fb390fcd640 1 -- 172.21.15.1:0/2097449187 >> 172.21.15.1:0/2097449187 conn(0x7fb38c06e140 msgr2=0x7fb38c11c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:04.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.877+0000 7fb390fcd640 1 -- 172.21.15.1:0/2097449187 shutdown_connections 2024-09-19T09:43:04.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:03.877+0000 7fb390fcd640 1 -- 172.21.15.1:0/2097449187 wait complete. 2024-09-19T09:43:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.743+0000 7f1594401640 1 -- 172.21.15.1:0/81006265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f158c100a60 msgr2=0x7f158c100e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:04.745 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.743+0000 7f1594401640 1 --2- 172.21.15.1:0/81006265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f158c100a60 0x7f158c100e60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f158400d910 tx=0x7f158402c390 comp rx=0 tx=0).stop 2024-09-19T09:43:04.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.745+0000 7f1594401640 1 -- 172.21.15.1:0/81006265 shutdown_connections 2024-09-19T09:43:04.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.745+0000 7f1594401640 1 --2- 172.21.15.1:0/81006265 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f158c102610 0x7f158c108ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.745+0000 7f1594401640 1 --2- 172.21.15.1:0/81006265 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f158c101c50 0x7f158c1020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.745+0000 7f1594401640 1 --2- 172.21.15.1:0/81006265 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f158c100a60 0x7f158c100e60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.747 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.745+0000 7f1594401640 1 -- 172.21.15.1:0/81006265 >> 172.21.15.1:0/81006265 conn(0x7f158c0fc1c0 msgr2=0x7f158c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:04.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.748+0000 7f1594401640 1 -- 172.21.15.1:0/81006265 shutdown_connections 2024-09-19T09:43:04.749 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.748+0000 7f1594401640 1 -- 172.21.15.1:0/81006265 wait complete. 2024-09-19T09:43:04.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.748+0000 7f1594401640 1 Processor -- start 2024-09-19T09:43:04.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.749+0000 7f1594401640 1 -- start start 2024-09-19T09:43:04.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.749+0000 7f1594401640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f158c100a60 0x7f158c111010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.749+0000 7f1594401640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f158c101c50 0x7f158c111550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.751 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.749+0000 7f1594401640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f158c102610 0x7f158c1ae560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.749+0000 7f1594401640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f158c10b600 con 0x7f158c101c50 2024-09-19T09:43:04.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.749+0000 7f1594401640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f158c10b480 con 0x7f158c102610 2024-09-19T09:43:04.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.749+0000 7f1594401640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f158c10b780 con 0x7f158c100a60 2024-09-19T09:43:04.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.749+0000 7f159199c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f158c101c50 0x7f158c111550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:04.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.749+0000 7f159199c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f158c101c50 0x7f158c111550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47434/0 (socket says 172.21.15.1:47434) 2024-09-19T09:43:04.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.749+0000 7f159199c640 1 -- 172.21.15.1:0/3628078547 learned_addr learned my addr 172.21.15.1:0/3628078547 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:04.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.749+0000 7f159219d640 1 --2- 172.21.15.1:0/3628078547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f158c100a60 0x7f158c111010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:04.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.749+0000 7f159299e640 1 --2- 172.21.15.1:0/3628078547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f158c102610 0x7f158c1ae560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:04.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.749+0000 7f159199c640 1 -- 172.21.15.1:0/3628078547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f158c100a60 msgr2=0x7f158c111010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:04.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.749+0000 7f159199c640 1 --2- 172.21.15.1:0/3628078547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f158c100a60 0x7f158c111010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.749+0000 7f159199c640 1 -- 172.21.15.1:0/3628078547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f158c102610 msgr2=0x7f158c1ae560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:04.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.749+0000 7f159199c640 1 --2- 172.21.15.1:0/3628078547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f158c102610 0x7f158c1ae560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.752 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.749+0000 7f159199c640 1 -- 172.21.15.1:0/3628078547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f158c1aeaa0 con 0x7f158c101c50 2024-09-19T09:43:04.753 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.751+0000 7f159199c640 1 --2- 172.21.15.1:0/3628078547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f158c101c50 0x7f158c111550 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f158800ba50 tx=0x7f158800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:04.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.752+0000 7f15837fe640 1 -- 172.21.15.1:0/3628078547 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1588019070 con 0x7f158c101c50 2024-09-19T09:43:04.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.752+0000 7f1594401640 1 -- 172.21.15.1:0/3628078547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f158c1aec70 con 0x7f158c101c50 2024-09-19T09:43:04.756 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.752+0000 7f1594401640 1 -- 172.21.15.1:0/3628078547 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f158c1af240 con 0x7f158c101c50 2024-09-19T09:43:04.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.756+0000 7f1597272740 1 Processor -- start 2024-09-19T09:43:04.757 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.756+0000 7f15837fe640 1 -- 172.21.15.1:0/3628078547 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f158800cbe0 con 0x7f158c101c50 2024-09-19T09:43:04.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.756+0000 7f15837fe640 1 -- 172.21.15.1:0/3628078547 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1588019070 con 0x7f158c101c50 2024-09-19T09:43:04.758 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.757+0000 7f1597272740 1 -- start start 2024-09-19T09:43:04.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.757+0000 7f1597272740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618e262f9a0 0x5618e262fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.757+0000 7f1597272740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618e26302e0 0x5618e2634da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.757+0000 7f1597272740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618e2635370 0x5618e2637830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.757+0000 7f1597272740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5618e25932f0 con 0x5618e2635370 2024-09-19T09:43:04.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.757+0000 7f1597272740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5618e253b270 con 0x5618e262f9a0 2024-09-19T09:43:04.759 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.757+0000 7f1597272740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5618e258f2b0 con 0x5618e26302e0 2024-09-19T09:43:04.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.760+0000 7f159299e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618e262f9a0 0x5618e262fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:04.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.760+0000 7f159299e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618e262f9a0 0x5618e262fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:51646/0 (socket says 172.21.15.1:51646) 2024-09-19T09:43:04.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.760+0000 7f159299e640 1 -- 172.21.15.1:0/2845567672 learned_addr learned my addr 172.21.15.1:0/2845567672 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:04.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.760+0000 7f159219d640 1 --2- 172.21.15.1:0/2845567672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618e26302e0 0x5618e2634da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:04.763 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.760+0000 7f15837fe640 1 -- 172.21.15.1:0/3628078547 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f158801c070 con 0x7f158c101c50 2024-09-19T09:43:04.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.761+0000 7f15837fe640 1 --2- 172.21.15.1:0/3628078547 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f15780a3590 0x7f15780a5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.761+0000 7f15837fe640 1 -- 172.21.15.1:0/3628078547 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f15880cfc60 con 0x7f158c101c50 2024-09-19T09:43:04.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.762+0000 7f159219d640 1 -- 172.21.15.1:0/2845567672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618e262f9a0 msgr2=0x5618e262fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:04.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.762+0000 7f159219d640 1 --2- 172.21.15.1:0/2845567672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618e262f9a0 0x5618e262fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.762+0000 7f159219d640 1 -- 172.21.15.1:0/2845567672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618e2635370 msgr2=0x5618e2637830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:04.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.762+0000 7f159219d640 1 --2- 172.21.15.1:0/2845567672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618e2635370 0x5618e2637830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.762+0000 7f159299e640 1 --2- 172.21.15.1:0/3628078547 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f15780a3590 0x7f15780a5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:04.764 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.762+0000 7f159219d640 1 -- 172.21.15.1:0/2845567672 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618e253a340 con 0x5618e26302e0 2024-09-19T09:43:04.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.762+0000 7f159219d640 1 --2- 172.21.15.1:0/2845567672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618e26302e0 0x5618e2634da0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f15840048b0 tx=0x7f1584004b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e28794895c36c519 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:04.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.763+0000 7f1580bfe640 1 -- 172.21.15.1:0/2845567672 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1584004050 con 0x5618e26302e0 2024-09-19T09:43:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.763+0000 7f1580bfe640 1 -- 172.21.15.1:0/2845567672 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1584042070 con 0x5618e26302e0 2024-09-19T09:43:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.763+0000 7f1580bfe640 1 -- 172.21.15.1:0/2845567672 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15840054a0 con 0x5618e26302e0 2024-09-19T09:43:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.764+0000 7f1597272740 1 -- 172.21.15.1:0/2845567672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618e26302e0 msgr2=0x5618e2634da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:04.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.764+0000 7f1597272740 1 --2- 172.21.15.1:0/2845567672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618e26302e0 0x5618e2634da0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f15840048b0 tx=0x7f1584004b50 comp rx=0 tx=0).stop 2024-09-19T09:43:04.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.767+0000 7f159299e640 1 --2- 172.21.15.1:0/3628078547 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f15780a3590 0x7f15780a5a50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f157c006fd0 tx=0x7f157c0046e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:04.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.767+0000 7f1597272740 1 -- 172.21.15.1:0/2845567672 shutdown_connections 2024-09-19T09:43:04.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.767+0000 7f1597272740 1 --2- 172.21.15.1:0/2845567672 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618e2635370 0x5618e2637830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.767+0000 7f1597272740 1 --2- 172.21.15.1:0/2845567672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618e26302e0 0x5618e2634da0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.767+0000 7f1597272740 1 --2- 172.21.15.1:0/2845567672 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618e262f9a0 0x5618e262fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.767+0000 7f1597272740 1 -- 172.21.15.1:0/2845567672 >> 172.21.15.1:0/2845567672 conn(0x5618e262b010 msgr2=0x5618e262b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.768+0000 7f1597272740 1 -- 172.21.15.1:0/2845567672 shutdown_connections 2024-09-19T09:43:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.769+0000 7f1597272740 1 -- 172.21.15.1:0/2845567672 wait complete. 2024-09-19T09:43:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.769+0000 7f1597272740 1 -- start start 2024-09-19T09:43:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.769+0000 7f1597272740 1 Processor -- start 2024-09-19T09:43:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.770+0000 7f1597272740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618e262f9a0 0x5618e264ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.770+0000 7f1597272740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618e26302e0 0x5618e264b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.770+0000 7f1597272740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618e2635370 0x5618e26521e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.770+0000 7f1597272740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5618e26492f0 con 0x5618e262f9a0 2024-09-19T09:43:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.770+0000 7f1597272740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5618e251c290 con 0x5618e26302e0 2024-09-19T09:43:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.770+0000 7f1597272740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5618e2649470 con 0x5618e2635370 2024-09-19T09:43:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.770+0000 7f1597272740 10 client.0 _ll_register_callbacks cb 0x5618e254d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:43:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.770+0000 7f159299e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618e2635370 0x5618e26521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.771+0000 7f159299e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618e2635370 0x5618e26521e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:60920/0 (socket says 172.21.15.1:60920) 2024-09-19T09:43:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.771+0000 7f159299e640 1 -- 172.21.15.1:0/2781529910 learned_addr learned my addr 172.21.15.1:0/2781529910 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.771+0000 7f159299e640 1 -- 172.21.15.1:0/2781529910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618e26302e0 msgr2=0x5618e264b1a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:43:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.771+0000 7f159299e640 1 --2- 172.21.15.1:0/2781529910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618e26302e0 0x5618e264b1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.771+0000 7f159299e640 1 -- 172.21.15.1:0/2781529910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618e262f9a0 msgr2=0x5618e264ac60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:43:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.771+0000 7f159299e640 1 --2- 172.21.15.1:0/2781529910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618e262f9a0 0x5618e264ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.771+0000 7f159299e640 1 -- 172.21.15.1:0/2781529910 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618e22a6210 con 0x5618e2635370 2024-09-19T09:43:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.772+0000 7f159299e640 1 --2- 172.21.15.1:0/2781529910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618e2635370 0x5618e26521e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f157c017ba0 tx=0x7f157c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b6bb4900a883f67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.772+0000 7f1575ffb640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-19T09:43:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.772+0000 7f1575ffb640 1 -- 172.21.15.1:0/2781529910 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157c027060 con 0x5618e2635370 2024-09-19T09:43:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.773+0000 7f1575ffb640 1 -- 172.21.15.1:0/2781529910 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f157c0168a0 con 0x5618e2635370 2024-09-19T09:43:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.773+0000 7f1597272740 1 -- 172.21.15.1:0/2781529910 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1584042070 con 0x5618e2635370 2024-09-19T09:43:04.777 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.775+0000 7f1575ffb640 1 -- 172.21.15.1:0/2781529910 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f157c014e80 con 0x5618e2635370 2024-09-19T09:43:04.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.777+0000 7f1597272740 10 client.25573 fetch_fsmap learned FSMap version 19 2024-09-19T09:43:04.778 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.777+0000 7f1597272740 1 -- 172.21.15.1:0/2781529910 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5618e2372620 con 0x5618e2635370 2024-09-19T09:43:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.782+0000 7f1575ffb640 1 -- 172.21.15.1:0/2781529910 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1584042070 con 0x5618e2635370 2024-09-19T09:43:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.782+0000 7f1575ffb640 1 -- 172.21.15.1:0/2781529910 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f157c02bb30 con 0x5618e2635370 2024-09-19T09:43:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.782+0000 7f1597272740 10 client.25573 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:43:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.782+0000 7f1597272740 10 client.25573 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:43:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.782+0000 7f1597272740 20 client.25573 populate_metadata read hostname 'smithi001' 2024-09-19T09:43:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.782+0000 7f1597272740 1 --2- 172.21.15.1:0/2781529910 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5618e26569d0 0x5618e2658e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.782+0000 7f1597272740 4 client.25573 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:43:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.782+0000 7f1597272740 1 -- 172.21.15.1:0/2781529910 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618e25a0a20 con 0x5618e26569d0 2024-09-19T09:43:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.796+0000 7f159219d640 1 --2- 172.21.15.1:0/2781529910 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5618e26569d0 0x5618e2658e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:04.817 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.811+0000 7f159219d640 1 --2- 172.21.15.1:0/2781529910 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5618e26569d0 0x5618e2658e60 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9c4e9ec56a32424 server_cookie=2d226f13aacbc7bb in_seq=0 out_seq=0 2024-09-19T09:43:04.817 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.812+0000 7f1575ffb640 10 client.25573 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:43:04.818 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.816+0000 7f1575ffb640 1 -- 172.21.15.1:0/2781529910 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5618e25a0a20 con 0x5618e26569d0 2024-09-19T09:43:04.818 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.816+0000 7f1575ffb640 10 client.25573 handle_command_reply: tid=0 2024-09-19T09:43:04.818 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.817+0000 7f1597272740 1 client.25573 shutdown 2024-09-19T09:43:04.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.819+0000 7f1597272740 1 -- 172.21.15.1:0/2781529910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618e2635370 msgr2=0x5618e26521e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:04.820 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.819+0000 7f1597272740 1 --2- 172.21.15.1:0/2781529910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618e2635370 0x5618e26521e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f157c017ba0 tx=0x7f157c004750 comp rx=0 tx=0).stop 2024-09-19T09:43:04.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.821+0000 7f1597272740 1 -- 172.21.15.1:0/2781529910 shutdown_connections 2024-09-19T09:43:04.822 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.821+0000 7f1597272740 1 --2- 172.21.15.1:0/2781529910 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5618e26569d0 0x5618e2658e60 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.821+0000 7f1597272740 1 --2- 172.21.15.1:0/2781529910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618e2635370 0x5618e26521e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.821+0000 7f1597272740 1 --2- 172.21.15.1:0/2781529910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618e26302e0 0x5618e264b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.821+0000 7f1597272740 1 --2- 172.21.15.1:0/2781529910 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618e262f9a0 0x5618e264ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.821+0000 7f1597272740 1 -- 172.21.15.1:0/2781529910 >> 172.21.15.1:0/2781529910 conn(0x5618e262b010 msgr2=0x5618e262c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:04.823 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.821+0000 7f1575ffb640 0 client.25573 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:43:04.829 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.826+0000 7f1597272740 1 -- 172.21.15.1:0/2781529910 shutdown_connections 2024-09-19T09:43:04.830 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.828+0000 7f1597272740 1 -- 172.21.15.1:0/2781529910 wait complete. 2024-09-19T09:43:04.831 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.830+0000 7f1597272740 20 client.25573 trim_cache size 0 max 16384 2024-09-19T09:43:04.866 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.864+0000 7f1597272740 1 Processor -- start 2024-09-19T09:43:04.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.866+0000 7f1597272740 1 -- start start 2024-09-19T09:43:04.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.867+0000 7f1597272740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618e262f9a0 0x5618e262a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.867+0000 7f1597272740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618e26302e0 0x5618e26521a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.867+0000 7f1597272740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618e2635370 0x5618e265d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.867+0000 7f1597272740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f157000c5b0 con 0x5618e2635370 2024-09-19T09:43:04.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.867+0000 7f1597272740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f157000ee50 con 0x5618e262f9a0 2024-09-19T09:43:04.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.867+0000 7f1597272740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f157000cc40 con 0x5618e26302e0 2024-09-19T09:43:04.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.868+0000 7f159299e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618e2635370 0x5618e265d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:04.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.868+0000 7f159299e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618e2635370 0x5618e265d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47448/0 (socket says 172.21.15.1:47448) 2024-09-19T09:43:04.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.868+0000 7f159299e640 1 -- 172.21.15.1:0/1757179544 learned_addr learned my addr 172.21.15.1:0/1757179544 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:04.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.868+0000 7f159299e640 1 -- 172.21.15.1:0/1757179544 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618e26302e0 msgr2=0x5618e26521a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:04.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.868+0000 7f159299e640 1 --2- 172.21.15.1:0/1757179544 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618e26302e0 0x5618e26521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.868+0000 7f159299e640 1 -- 172.21.15.1:0/1757179544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618e262f9a0 msgr2=0x5618e262a0b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:43:04.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.868+0000 7f159299e640 1 --2- 172.21.15.1:0/1757179544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618e262f9a0 0x5618e262a0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.868+0000 7f159299e640 1 -- 172.21.15.1:0/1757179544 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618e262ae30 con 0x5618e2635370 2024-09-19T09:43:04.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.869+0000 7f159299e640 1 --2- 172.21.15.1:0/1757179544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618e2635370 0x5618e265d760 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f157c008010 tx=0x7f157c006f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de50f851b27d323c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:04.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.871+0000 7f1577fff640 1 -- 172.21.15.1:0/1757179544 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157c031080 con 0x5618e2635370 2024-09-19T09:43:04.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.871+0000 7f1577fff640 1 -- 172.21.15.1:0/1757179544 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f157c004500 con 0x5618e2635370 2024-09-19T09:43:04.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.871+0000 7f1577fff640 1 -- 172.21.15.1:0/1757179544 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157c016820 con 0x5618e2635370 2024-09-19T09:43:04.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.872+0000 7f1597272740 1 -- 172.21.15.1:0/1757179544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618e2635370 msgr2=0x5618e265d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:04.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.872+0000 7f1597272740 1 --2- 172.21.15.1:0/1757179544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618e2635370 0x5618e265d760 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f157c008010 tx=0x7f157c006f10 comp rx=0 tx=0).stop 2024-09-19T09:43:04.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.872+0000 7f1597272740 1 -- 172.21.15.1:0/1757179544 shutdown_connections 2024-09-19T09:43:04.874 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.872+0000 7f1597272740 1 --2- 172.21.15.1:0/1757179544 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618e2635370 0x5618e265d760 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.874 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.872+0000 7f1597272740 1 --2- 172.21.15.1:0/1757179544 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618e26302e0 0x5618e26521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.874 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.872+0000 7f1597272740 1 --2- 172.21.15.1:0/1757179544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618e262f9a0 0x5618e262a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.874 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.872+0000 7f1597272740 1 -- 172.21.15.1:0/1757179544 >> 172.21.15.1:0/1757179544 conn(0x5618e262b010 msgr2=0x5618e26299a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:04.876 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.874+0000 7f1597272740 1 -- 172.21.15.1:0/1757179544 shutdown_connections 2024-09-19T09:43:04.876 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.874+0000 7f1597272740 1 -- 172.21.15.1:0/1757179544 wait complete. 2024-09-19T09:43:04.876 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.875+0000 7f1597272740 1 -- start start 2024-09-19T09:43:04.876 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.875+0000 7f1597272740 1 Processor -- start 2024-09-19T09:43:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.875+0000 7f1597272740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618e262f9a0 0x5618e264fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.875+0000 7f1597272740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618e26302e0 0x5618e2650400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.875+0000 7f1597272740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618e2635370 0x5618e2651410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.875+0000 7f1597272740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f157000d310 con 0x5618e2635370 2024-09-19T09:43:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.875+0000 7f1597272740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f157000e780 con 0x5618e26302e0 2024-09-19T09:43:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.875+0000 7f1597272740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f157000d9e0 con 0x5618e262f9a0 2024-09-19T09:43:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.875+0000 7f1597272740 10 client.0 _ll_register_callbacks cb 0x7f157c017820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:43:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.876+0000 7f159219d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618e262f9a0 0x5618e264fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.876+0000 7f159219d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618e262f9a0 0x5618e264fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:60940/0 (socket says 172.21.15.1:60940) 2024-09-19T09:43:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.876+0000 7f159219d640 1 -- 172.21.15.1:0/2072342407 learned_addr learned my addr 172.21.15.1:0/2072342407 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.876+0000 7f159299e640 1 --2- 172.21.15.1:0/2072342407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618e2635370 0x5618e2651410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.876+0000 7f159199c640 1 --2- 172.21.15.1:0/2072342407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618e26302e0 0x5618e2650400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.876+0000 7f159219d640 1 -- 172.21.15.1:0/2072342407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618e26302e0 msgr2=0x5618e2650400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.876+0000 7f159219d640 1 --2- 172.21.15.1:0/2072342407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618e26302e0 0x5618e2650400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.876+0000 7f159219d640 1 -- 172.21.15.1:0/2072342407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618e2635370 msgr2=0x5618e2651410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:04.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.876+0000 7f159219d640 1 --2- 172.21.15.1:0/2072342407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618e2635370 0x5618e2651410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:04.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.876+0000 7f159219d640 1 -- 172.21.15.1:0/2072342407 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618e2651a20 con 0x5618e262f9a0 2024-09-19T09:43:04.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.877+0000 7f159219d640 1 --2- 172.21.15.1:0/2072342407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618e262f9a0 0x5618e264fec0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1584004650 tx=0x7f1584005970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f98c1454d10ddd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:04.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.877+0000 7f1575ffb640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-19T09:43:04.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.877+0000 7f1575ffb640 1 -- 172.21.15.1:0/2072342407 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1584004260 con 0x5618e262f9a0 2024-09-19T09:43:04.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.877+0000 7f1597272740 1 -- 172.21.15.1:0/2072342407 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f157c004500 con 0x5618e262f9a0 2024-09-19T09:43:04.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.878+0000 7f1575ffb640 1 -- 172.21.15.1:0/2072342407 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f1584004400 con 0x5618e262f9a0 2024-09-19T09:43:04.886 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.880+0000 7f1575ffb640 1 -- 172.21.15.1:0/2072342407 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1584004fe0 con 0x5618e262f9a0 2024-09-19T09:43:04.886 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.884+0000 7f1597272740 10 client.25576 fetch_fsmap learned FSMap version 19 2024-09-19T09:43:04.886 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.884+0000 7f1597272740 1 -- 172.21.15.1:0/2072342407 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5618e26c1e80 con 0x5618e262f9a0 2024-09-19T09:43:04.888 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.887+0000 7f1575ffb640 1 -- 172.21.15.1:0/2072342407 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f157c004500 con 0x5618e262f9a0 2024-09-19T09:43:04.888 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.887+0000 7f1575ffb640 1 -- 172.21.15.1:0/2072342407 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f1584052490 con 0x5618e262f9a0 2024-09-19T09:43:04.889 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.887+0000 7f1597272740 10 client.25576 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:43:04.890 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.887+0000 7f1597272740 10 client.25576 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:43:04.890 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.887+0000 7f1597272740 20 client.25576 populate_metadata read hostname 'smithi001' 2024-09-19T09:43:04.890 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.887+0000 7f1597272740 1 --2- 172.21.15.1:0/2072342407 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5618e26c2860 0x5618e26c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:04.890 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.887+0000 7f1597272740 4 client.25576 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:43:04.890 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.887+0000 7f1597272740 1 -- 172.21.15.1:0/2072342407 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5618e259ad70 con 0x5618e26c2860 2024-09-19T09:43:04.893 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.891+0000 7f159199c640 1 --2- 172.21.15.1:0/2072342407 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5618e26c2860 0x5618e26c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:04.894 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.893+0000 7f159199c640 1 --2- 172.21.15.1:0/2072342407 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5618e26c2860 0x5618e26c4c80 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5cfa3906ebb94aa server_cookie=15dc62cf1844d4e9 in_seq=0 out_seq=0 2024-09-19T09:43:04.896 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:04.895+0000 7f1575ffb640 10 client.25576 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:43:05.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:05 smithi001 ceph-mon[31225]: pgmap v488: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 106 MiB/s wr, 15.36k op/s 2024-09-19T09:43:05.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:05 smithi022 ceph-mon[35583]: pgmap v488: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 106 MiB/s wr, 15.36k op/s 2024-09-19T09:43:05.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:05 smithi121 ceph-mon[35577]: pgmap v488: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 106 MiB/s wr, 15.36k op/s 2024-09-19T09:43:07.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:07 smithi001 ceph-mon[31225]: pgmap v489: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 116 MiB/s wr, 17.02k op/s 2024-09-19T09:43:07.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:07 smithi022 ceph-mon[35583]: pgmap v489: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 116 MiB/s wr, 17.02k op/s 2024-09-19T09:43:07.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:07 smithi121 ceph-mon[35577]: pgmap v489: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 116 MiB/s wr, 17.02k op/s 2024-09-19T09:43:09.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:09.060+0000 7f1575ffb640 1 -- 172.21.15.1:0/2072342407 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5618e259ad70 con 0x5618e26c2860 2024-09-19T09:43:09.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:09.060+0000 7f1575ffb640 10 client.25576 handle_command_reply: tid=0 2024-09-19T09:43:09.062 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:09.060+0000 7f1597272740 1 client.25576 shutdown 2024-09-19T09:43:09.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:09.060+0000 7f1597272740 1 -- 172.21.15.1:0/2072342407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618e262f9a0 msgr2=0x5618e264fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:09.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:09.060+0000 7f1597272740 1 --2- 172.21.15.1:0/2072342407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618e262f9a0 0x5618e264fec0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1584004650 tx=0x7f1584005970 comp rx=0 tx=0).stop 2024-09-19T09:43:09.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:09.061+0000 7f1597272740 1 -- 172.21.15.1:0/2072342407 shutdown_connections 2024-09-19T09:43:09.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:09.061+0000 7f1597272740 1 --2- 172.21.15.1:0/2072342407 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5618e26c2860 0x5618e26c4c80 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:09.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:09.061+0000 7f1597272740 1 --2- 172.21.15.1:0/2072342407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5618e2635370 0x5618e2651410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:09.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:09.061+0000 7f1597272740 1 --2- 172.21.15.1:0/2072342407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5618e26302e0 0x5618e2650400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:09.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:09.061+0000 7f1597272740 1 --2- 172.21.15.1:0/2072342407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618e262f9a0 0x5618e264fec0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:09.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:09.061+0000 7f1597272740 1 -- 172.21.15.1:0/2072342407 >> 172.21.15.1:0/2072342407 conn(0x5618e262b010 msgr2=0x5618e262a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:09.063 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:09.061+0000 7f1575ffb640 0 client.25576 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:43:09.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:09.061+0000 7f1597272740 1 -- 172.21.15.1:0/2072342407 shutdown_connections 2024-09-19T09:43:09.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:09.061+0000 7f1597272740 1 -- 172.21.15.1:0/2072342407 wait complete. 2024-09-19T09:43:09.064 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:09.061+0000 7f1597272740 20 client.25576 trim_cache size 0 max 16384 2024-09-19T09:43:09.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:43:09.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:43:09.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:43:09.065 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:43:09.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:09.063+0000 7f1594401640 1 -- 172.21.15.1:0/3628078547 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f15780a3590 msgr2=0x7f15780a5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:09.066 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:09.063+0000 7f1594401640 1 --2- 172.21.15.1:0/3628078547 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f15780a3590 0x7f15780a5a50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f157c006fd0 tx=0x7f157c0046e0 comp rx=0 tx=0).stop 2024-09-19T09:43:09.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:09.063+0000 7f1594401640 1 -- 172.21.15.1:0/3628078547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f158c101c50 msgr2=0x7f158c111550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:09.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:09.063+0000 7f1594401640 1 --2- 172.21.15.1:0/3628078547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f158c101c50 0x7f158c111550 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f158800ba50 tx=0x7f158800bf10 comp rx=0 tx=0).stop 2024-09-19T09:43:09.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:09.063+0000 7f1594401640 1 -- 172.21.15.1:0/3628078547 shutdown_connections 2024-09-19T09:43:09.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:09.063+0000 7f1594401640 1 --2- 172.21.15.1:0/3628078547 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f15780a3590 0x7f15780a5a50 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:09.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:09.063+0000 7f1594401640 1 --2- 172.21.15.1:0/3628078547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f158c102610 0x7f158c1ae560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:09.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:09.063+0000 7f1594401640 1 --2- 172.21.15.1:0/3628078547 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f158c101c50 0x7f158c111550 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:09.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:09.063+0000 7f1594401640 1 --2- 172.21.15.1:0/3628078547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f158c100a60 0x7f158c111010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:09.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:09.063+0000 7f1594401640 1 -- 172.21.15.1:0/3628078547 >> 172.21.15.1:0/3628078547 conn(0x7f158c0fc1c0 msgr2=0x7f158c0fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:09.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:09.064+0000 7f1594401640 1 -- 172.21.15.1:0/3628078547 shutdown_connections 2024-09-19T09:43:09.067 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:09.064+0000 7f1594401640 1 -- 172.21.15.1:0/3628078547 wait complete. 2024-09-19T09:43:09.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:09 smithi001 ceph-mon[31225]: pgmap v490: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 110 MiB/s wr, 16.48k op/s 2024-09-19T09:43:09.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:09 smithi022 ceph-mon[35583]: pgmap v490: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 110 MiB/s wr, 16.48k op/s 2024-09-19T09:43:09.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:09 smithi121 ceph-mon[35577]: pgmap v490: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 110 MiB/s wr, 16.48k op/s 2024-09-19T09:43:11.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:11 smithi001 ceph-mon[31225]: pgmap v491: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 104 MiB/s wr, 15.82k op/s 2024-09-19T09:43:11.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:11 smithi022 ceph-mon[35583]: pgmap v491: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 104 MiB/s wr, 15.82k op/s 2024-09-19T09:43:11.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:11 smithi121 ceph-mon[35577]: pgmap v491: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 104 MiB/s wr, 15.82k op/s 2024-09-19T09:43:13.734 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:13 smithi001 ceph-mon[31225]: pgmap v492: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 121 MiB/s wr, 18.41k op/s 2024-09-19T09:43:13.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:13 smithi022 ceph-mon[35583]: pgmap v492: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 121 MiB/s wr, 18.41k op/s 2024-09-19T09:43:13.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:13 smithi121 ceph-mon[35577]: pgmap v492: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 121 MiB/s wr, 18.41k op/s 2024-09-19T09:43:15.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:15 smithi001 ceph-mon[31225]: pgmap v493: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 111 MiB/s wr, 16.96k op/s 2024-09-19T09:43:15.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:15 smithi022 ceph-mon[35583]: pgmap v493: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 111 MiB/s wr, 16.96k op/s 2024-09-19T09:43:15.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:15 smithi121 ceph-mon[35577]: pgmap v493: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 111 MiB/s wr, 16.96k op/s 2024-09-19T09:43:16.486 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:43:16.486 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:43:17.067 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:43:17.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:17 smithi001 ceph-mon[31225]: pgmap v494: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 113 MiB/s wr, 17.21k op/s 2024-09-19T09:43:17.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:17 smithi022 ceph-mon[35583]: pgmap v494: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 113 MiB/s wr, 17.21k op/s 2024-09-19T09:43:17.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:17 smithi121 ceph-mon[35577]: pgmap v494: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 113 MiB/s wr, 17.21k op/s 2024-09-19T09:43:19.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:19 smithi001 ceph-mon[31225]: pgmap v495: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 118 MiB/s wr, 17.67k op/s 2024-09-19T09:43:19.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:19 smithi022 ceph-mon[35583]: pgmap v495: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 118 MiB/s wr, 17.67k op/s 2024-09-19T09:43:19.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:19 smithi121 ceph-mon[35577]: pgmap v495: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 118 MiB/s wr, 17.67k op/s 2024-09-19T09:43:21.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:21 smithi001 ceph-mon[31225]: pgmap v496: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 106 MiB/s wr, 15.78k op/s 2024-09-19T09:43:21.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:21 smithi022 ceph-mon[35583]: pgmap v496: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 106 MiB/s wr, 15.78k op/s 2024-09-19T09:43:21.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:21 smithi121 ceph-mon[35577]: pgmap v496: 97 pgs: 97 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 106 MiB/s wr, 15.78k op/s 2024-09-19T09:43:21.876 INFO:tasks.quiescer.fs.[cephfs]:Total duration (59.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T09:43:21.876 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.8 2024-09-19T09:43:21.877 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:43:22.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.164+0000 7f8364b68640 1 -- 172.21.15.1:0/3570309587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8360101c30 msgr2=0x7f83601020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:22.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.164+0000 7f8364b68640 1 --2- 172.21.15.1:0/3570309587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8360101c30 0x7f83601020b0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8348009900 tx=0x7f834802a410 comp rx=0 tx=0).stop 2024-09-19T09:43:22.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.164+0000 7f8364b68640 1 -- 172.21.15.1:0/3570309587 shutdown_connections 2024-09-19T09:43:22.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.164+0000 7f8364b68640 1 --2- 172.21.15.1:0/3570309587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f83601025f0 0x7f8360108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:22.166 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.164+0000 7f8364b68640 1 --2- 172.21.15.1:0/3570309587 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8360101c30 0x7f83601020b0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:22.167 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.164+0000 7f8364b68640 1 --2- 172.21.15.1:0/3570309587 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8360100a40 0x7f8360100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:22.167 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.164+0000 7f8364b68640 1 -- 172.21.15.1:0/3570309587 >> 172.21.15.1:0/3570309587 conn(0x7f83600fc1c0 msgr2=0x7f83600fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:22.167 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.164+0000 7f8364b68640 1 -- 172.21.15.1:0/3570309587 shutdown_connections 2024-09-19T09:43:22.167 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.164+0000 7f8364b68640 1 -- 172.21.15.1:0/3570309587 wait complete. 2024-09-19T09:43:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.165+0000 7f8364b68640 1 Processor -- start 2024-09-19T09:43:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.165+0000 7f8364b68640 1 -- start start 2024-09-19T09:43:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.165+0000 7f8364b68640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8360100a40 0x7f836010b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.165+0000 7f8364b68640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8360101c30 0x7f8360109a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.165+0000 7f8364b68640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83601025f0 0x7f8360109f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:22.169 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.165+0000 7f8364b68640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f836010d810 con 0x7f83601025f0 2024-09-19T09:43:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.165+0000 7f8364b68640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f836010d690 con 0x7f8360100a40 2024-09-19T09:43:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.165+0000 7f8364b68640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f836010d990 con 0x7f8360101c30 2024-09-19T09:43:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.165+0000 7f835ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83601025f0 0x7f8360109f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.165+0000 7f835ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83601025f0 0x7f8360109f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45120/0 (socket says 172.21.15.1:45120) 2024-09-19T09:43:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.165+0000 7f835ed9d640 1 -- 172.21.15.1:0/1715259036 learned_addr learned my addr 172.21.15.1:0/1715259036 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.165+0000 7f835dd9b640 1 --2- 172.21.15.1:0/1715259036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8360101c30 0x7f8360109a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.165+0000 7f835e59c640 1 --2- 172.21.15.1:0/1715259036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8360100a40 0x7f836010b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.166+0000 7f835ed9d640 1 -- 172.21.15.1:0/1715259036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8360101c30 msgr2=0x7f8360109a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.166+0000 7f835ed9d640 1 --2- 172.21.15.1:0/1715259036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8360101c30 0x7f8360109a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.166+0000 7f835ed9d640 1 -- 172.21.15.1:0/1715259036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8360100a40 msgr2=0x7f836010b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.166+0000 7f835ed9d640 1 --2- 172.21.15.1:0/1715259036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8360100a40 0x7f836010b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.166+0000 7f835ed9d640 1 -- 172.21.15.1:0/1715259036 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f836010a7d0 con 0x7f83601025f0 2024-09-19T09:43:22.170 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.166+0000 7f835ed9d640 1 --2- 172.21.15.1:0/1715259036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83601025f0 0x7f8360109f40 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f835800d750 tx=0x7f835800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:22.171 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.166+0000 7f83577fe640 1 -- 172.21.15.1:0/1715259036 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8358017070 con 0x7f83601025f0 2024-09-19T09:43:22.171 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.166+0000 7f83577fe640 1 -- 172.21.15.1:0/1715259036 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8358005500 con 0x7f83601025f0 2024-09-19T09:43:22.171 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.166+0000 7f8364b68640 1 -- 172.21.15.1:0/1715259036 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83601a1fc0 con 0x7f83601025f0 2024-09-19T09:43:22.171 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.166+0000 7f83577fe640 1 -- 172.21.15.1:0/1715259036 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8358004d90 con 0x7f83601025f0 2024-09-19T09:43:22.171 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.166+0000 7f8364b68640 1 -- 172.21.15.1:0/1715259036 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83601a2420 con 0x7f83601025f0 2024-09-19T09:43:22.173 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.169+0000 7f83679d9740 1 Processor -- start 2024-09-19T09:43:22.173 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.169+0000 7f83577fe640 1 -- 172.21.15.1:0/1715259036 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f8358004f30 con 0x7f83601025f0 2024-09-19T09:43:22.173 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.170+0000 7f83679d9740 1 -- start start 2024-09-19T09:43:22.173 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.170+0000 7f83679d9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562502c719a0 0x562502c71da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:22.173 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.170+0000 7f83679d9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562502c722e0 0x562502c76da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:22.173 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.170+0000 7f83679d9740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562502c77370 0x562502c79830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:22.173 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.170+0000 7f83679d9740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562502bd52f0 con 0x562502c77370 2024-09-19T09:43:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.170+0000 7f83679d9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562502b7d270 con 0x562502c722e0 2024-09-19T09:43:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.170+0000 7f83679d9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562502bd12b0 con 0x562502c719a0 2024-09-19T09:43:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.170+0000 7f835dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562502c77370 0x562502c79830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.170+0000 7f835dd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562502c77370 0x562502c79830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45124/0 (socket says 172.21.15.1:45124) 2024-09-19T09:43:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.170+0000 7f835dd9b640 1 -- 172.21.15.1:0/1929969357 learned_addr learned my addr 172.21.15.1:0/1929969357 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.170+0000 7f835e59c640 1 --2- 172.21.15.1:0/1929969357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562502c722e0 0x562502c76da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.170+0000 7f835dd9b640 1 --2- 172.21.15.1:0/1929969357 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562502c719a0 0x562502c71da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.170+0000 7f83577fe640 1 --2- 172.21.15.1:0/1715259036 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f834c0a32c0 0x7f834c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.171+0000 7f835e59c640 1 -- 172.21.15.1:0/1929969357 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562502c719a0 msgr2=0x562502c71da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.171+0000 7f835e59c640 1 --2- 172.21.15.1:0/1929969357 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562502c719a0 0x562502c71da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.171+0000 7f835ed9d640 1 --2- 172.21.15.1:0/1715259036 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f834c0a32c0 0x7f834c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.171+0000 7f835e59c640 1 -- 172.21.15.1:0/1929969357 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562502c77370 msgr2=0x562502c79830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:22.174 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.171+0000 7f835e59c640 1 --2- 172.21.15.1:0/1929969357 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562502c77370 0x562502c79830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:22.175 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.171+0000 7f835e59c640 1 -- 172.21.15.1:0/1929969357 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562502b7c340 con 0x562502c722e0 2024-09-19T09:43:22.175 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.171+0000 7f835dd9b640 1 --2- 172.21.15.1:0/1929969357 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562502c77370 0x562502c79830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:43:22.175 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.171+0000 7f83577fe640 1 -- 172.21.15.1:0/1715259036 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f83580cf160 con 0x7f83601025f0 2024-09-19T09:43:22.175 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.171+0000 7f835e59c640 1 --2- 172.21.15.1:0/1929969357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562502c722e0 0x562502c76da0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8350005fd0 tx=0x7f8350010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f79d4abe10baa50c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:22.175 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.171+0000 7f835ed9d640 1 --2- 172.21.15.1:0/1715259036 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f834c0a32c0 0x7f834c0a5780 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f835800d720 tx=0x7f8358016500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:22.175 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.171+0000 7f8354ff9640 1 -- 172.21.15.1:0/1929969357 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8350016070 con 0x562502c722e0 2024-09-19T09:43:22.175 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.172+0000 7f8354ff9640 1 -- 172.21.15.1:0/1929969357 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8350012bf0 con 0x562502c722e0 2024-09-19T09:43:22.175 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.172+0000 7f8354ff9640 1 -- 172.21.15.1:0/1929969357 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8350011cc0 con 0x562502c722e0 2024-09-19T09:43:22.179 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.172+0000 7f83679d9740 1 -- 172.21.15.1:0/1929969357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562502c722e0 msgr2=0x562502c76da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:22.179 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.172+0000 7f83679d9740 1 --2- 172.21.15.1:0/1929969357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562502c722e0 0x562502c76da0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8350005fd0 tx=0x7f8350010800 comp rx=0 tx=0).stop 2024-09-19T09:43:22.179 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.172+0000 7f83679d9740 1 -- 172.21.15.1:0/1929969357 shutdown_connections 2024-09-19T09:43:22.179 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.172+0000 7f83679d9740 1 --2- 172.21.15.1:0/1929969357 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562502c77370 0x562502c79830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:22.180 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.172+0000 7f83679d9740 1 --2- 172.21.15.1:0/1929969357 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562502c722e0 0x562502c76da0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:22.180 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.172+0000 7f83679d9740 1 --2- 172.21.15.1:0/1929969357 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562502c719a0 0x562502c71da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:22.180 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.172+0000 7f83679d9740 1 -- 172.21.15.1:0/1929969357 >> 172.21.15.1:0/1929969357 conn(0x562502c6d010 msgr2=0x562502c6d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:22.180 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.173+0000 7f83679d9740 1 -- 172.21.15.1:0/1929969357 shutdown_connections 2024-09-19T09:43:22.180 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.173+0000 7f83679d9740 1 -- 172.21.15.1:0/1929969357 wait complete. 2024-09-19T09:43:22.180 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.173+0000 7f83679d9740 1 -- start start 2024-09-19T09:43:22.180 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.173+0000 7f83679d9740 1 Processor -- start 2024-09-19T09:43:22.180 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.173+0000 7f83679d9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562502c719a0 0x562502c7bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:22.180 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.173+0000 7f83679d9740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562502c722e0 0x562502c7c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:22.180 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.173+0000 7f83679d9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562502c77370 0x562502c831b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:22.180 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.173+0000 7f83679d9740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562502c7a390 con 0x562502c722e0 2024-09-19T09:43:22.180 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.173+0000 7f83679d9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562502b5e290 con 0x562502c77370 2024-09-19T09:43:22.181 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.173+0000 7f83679d9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562502c7a510 con 0x562502c719a0 2024-09-19T09:43:22.181 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.173+0000 7f835e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562502c722e0 0x562502c7c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:22.181 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.173+0000 7f83679d9740 10 client.0 _ll_register_callbacks cb 0x562502b8f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:43:22.181 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.173+0000 7f835e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562502c722e0 0x562502c7c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45134/0 (socket says 172.21.15.1:45134) 2024-09-19T09:43:22.181 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.173+0000 7f835e59c640 1 -- 172.21.15.1:0/2194896244 learned_addr learned my addr 172.21.15.1:0/2194896244 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:22.181 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.173+0000 7f835dd9b640 1 --2- 172.21.15.1:0/2194896244 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562502c77370 0x562502c831b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:22.181 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.173+0000 7f835dd9b640 1 --2- 172.21.15.1:0/2194896244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562502c719a0 0x562502c7bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:22.181 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.174+0000 7f835e59c640 1 -- 172.21.15.1:0/2194896244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562502c719a0 msgr2=0x562502c7bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:22.181 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.174+0000 7f835e59c640 1 --2- 172.21.15.1:0/2194896244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562502c719a0 0x562502c7bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:22.181 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.174+0000 7f835e59c640 1 -- 172.21.15.1:0/2194896244 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562502c77370 msgr2=0x562502c831b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:22.181 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.174+0000 7f835e59c640 1 --2- 172.21.15.1:0/2194896244 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562502c77370 0x562502c831b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:22.181 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.174+0000 7f835e59c640 1 -- 172.21.15.1:0/2194896244 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625028e8210 con 0x562502c722e0 2024-09-19T09:43:22.181 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.174+0000 7f835e59c640 1 --2- 172.21.15.1:0/2194896244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562502c722e0 0x562502c7c1e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f8350005c10 tx=0x7f8350009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd598ea98fe81127 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:22.182 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.174+0000 7f8345ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:43:22.182 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.174+0000 7f8345ffb640 1 -- 172.21.15.1:0/2194896244 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835002a060 con 0x562502c722e0 2024-09-19T09:43:22.182 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.174+0000 7f8345ffb640 1 -- 172.21.15.1:0/2194896244 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f8350004a40 con 0x562502c722e0 2024-09-19T09:43:22.182 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.174+0000 7f83679d9740 1 -- 172.21.15.1:0/2194896244 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8350012bf0 con 0x562502c722e0 2024-09-19T09:43:22.182 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.174+0000 7f8345ffb640 1 -- 172.21.15.1:0/2194896244 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8350016050 con 0x562502c722e0 2024-09-19T09:43:22.182 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.174+0000 7f83679d9740 10 client.16104 fetch_fsmap learned FSMap version 19 2024-09-19T09:43:22.182 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.174+0000 7f83679d9740 1 -- 172.21.15.1:0/2194896244 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5625029b4620 con 0x562502c722e0 2024-09-19T09:43:22.182 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.174+0000 7f8345ffb640 1 -- 172.21.15.1:0/2194896244 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8350012bf0 con 0x562502c722e0 2024-09-19T09:43:22.182 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.175+0000 7f8345ffb640 1 -- 172.21.15.1:0/2194896244 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f835002f070 con 0x562502c722e0 2024-09-19T09:43:22.182 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.175+0000 7f83679d9740 10 client.16104 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:43:22.182 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.175+0000 7f83679d9740 10 client.16104 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:43:22.182 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.175+0000 7f83679d9740 20 client.16104 populate_metadata read hostname 'smithi001' 2024-09-19T09:43:22.182 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.175+0000 7f83679d9740 1 --2- 172.21.15.1:0/2194896244 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x562502c875a0 0x562502c89990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:22.183 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.175+0000 7f83679d9740 4 client.16104 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:43:22.183 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.175+0000 7f83679d9740 1 -- 172.21.15.1:0/2194896244 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562502be2a20 con 0x562502c875a0 2024-09-19T09:43:22.183 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.175+0000 7f835dd9b640 1 --2- 172.21.15.1:0/2194896244 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x562502c875a0 0x562502c89990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:22.183 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.175+0000 7f8345ffb640 10 client.16104 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:43:22.183 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.175+0000 7f835dd9b640 1 --2- 172.21.15.1:0/2194896244 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x562502c875a0 0x562502c89990 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ad9632fa099b013 server_cookie=255c9e38b1bd4f74 in_seq=0 out_seq=0 2024-09-19T09:43:22.183 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.177+0000 7f8345ffb640 1 -- 172.21.15.1:0/2194896244 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562502be2a20 con 0x562502c875a0 2024-09-19T09:43:22.183 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.177+0000 7f8345ffb640 10 client.16104 handle_command_reply: tid=0 2024-09-19T09:43:22.183 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.177+0000 7f83679d9740 1 client.16104 shutdown 2024-09-19T09:43:22.183 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.177+0000 7f83679d9740 1 -- 172.21.15.1:0/2194896244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562502c722e0 msgr2=0x562502c7c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:22.183 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.177+0000 7f83679d9740 1 --2- 172.21.15.1:0/2194896244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562502c722e0 0x562502c7c1e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f8350005c10 tx=0x7f8350009d20 comp rx=0 tx=0).stop 2024-09-19T09:43:22.184 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.177+0000 7f83679d9740 1 -- 172.21.15.1:0/2194896244 shutdown_connections 2024-09-19T09:43:22.184 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.177+0000 7f83679d9740 1 --2- 172.21.15.1:0/2194896244 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x562502c875a0 0x562502c89990 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:22.184 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.177+0000 7f83679d9740 1 --2- 172.21.15.1:0/2194896244 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562502c77370 0x562502c831b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:22.184 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.177+0000 7f8345ffb640 0 client.16104 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:43:22.184 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.177+0000 7f83679d9740 1 --2- 172.21.15.1:0/2194896244 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562502c722e0 0x562502c7c1e0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:22.184 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.177+0000 7f83679d9740 1 --2- 172.21.15.1:0/2194896244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562502c719a0 0x562502c7bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:22.184 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.177+0000 7f83679d9740 1 -- 172.21.15.1:0/2194896244 >> 172.21.15.1:0/2194896244 conn(0x562502c6d010 msgr2=0x562502c6e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:22.184 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.177+0000 7f83679d9740 1 -- 172.21.15.1:0/2194896244 shutdown_connections 2024-09-19T09:43:22.184 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.177+0000 7f83679d9740 1 -- 172.21.15.1:0/2194896244 wait complete. 2024-09-19T09:43:22.184 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.177+0000 7f83679d9740 20 client.16104 trim_cache size 0 max 16384 2024-09-19T09:43:22.206 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.203+0000 7f83679d9740 1 Processor -- start 2024-09-19T09:43:22.206 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.203+0000 7f83679d9740 1 -- start start 2024-09-19T09:43:22.206 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.204+0000 7f83679d9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562502c6d010 0x562502c6c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:22.208 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.205+0000 7f83679d9740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562502c719a0 0x562502c83170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:22.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.212+0000 7f835dd9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562502c6d010 0x562502c6c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:22.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.212+0000 7f835dd9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562502c6d010 0x562502c6c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:45212/0 (socket says 172.21.15.1:45212) 2024-09-19T09:43:22.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.212+0000 7f835e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562502c719a0 0x562502c83170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:22.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.212+0000 7f835dd9b640 1 -- 172.21.15.1:0/163713523 learned_addr learned my addr 172.21.15.1:0/163713523 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:22.216 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.212+0000 7f83679d9740 1 --2- 172.21.15.1:0/163713523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562502c722e0 0x562502c6e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:22.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.212+0000 7f83679d9740 1 -- 172.21.15.1:0/163713523 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f83601a9200 con 0x562502c719a0 2024-09-19T09:43:22.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.212+0000 7f83679d9740 1 -- 172.21.15.1:0/163713523 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f83601abaa0 con 0x562502c722e0 2024-09-19T09:43:22.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.212+0000 7f83679d9740 1 -- 172.21.15.1:0/163713523 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f83601a9890 con 0x562502c6d010 2024-09-19T09:43:22.217 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.214+0000 7f835dd9b640 1 --2- 172.21.15.1:0/163713523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562502c722e0 0x562502c6e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:22.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.217+0000 7f835dd9b640 1 -- 172.21.15.1:0/163713523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562502c722e0 msgr2=0x562502c6e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:22.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.217+0000 7f835dd9b640 1 --2- 172.21.15.1:0/163713523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562502c722e0 0x562502c6e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:22.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.217+0000 7f835dd9b640 1 -- 172.21.15.1:0/163713523 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562502c719a0 msgr2=0x562502c83170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:22.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.217+0000 7f835dd9b640 1 --2- 172.21.15.1:0/163713523 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562502c719a0 0x562502c83170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:22.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.217+0000 7f835dd9b640 1 -- 172.21.15.1:0/163713523 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562502c89f20 con 0x562502c6d010 2024-09-19T09:43:22.225 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.222+0000 7f835dd9b640 1 --2- 172.21.15.1:0/163713523 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562502c6d010 0x562502c6c0b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8348005ab0 tx=0x7f834802a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=badf598f4f671edb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:22.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.224+0000 7f8347fff640 1 -- 172.21.15.1:0/163713523 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8348052040 con 0x562502c6d010 2024-09-19T09:43:22.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.224+0000 7f8347fff640 1 -- 172.21.15.1:0/163713523 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8348004780 con 0x562502c6d010 2024-09-19T09:43:22.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.224+0000 7f8347fff640 1 -- 172.21.15.1:0/163713523 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8348035040 con 0x562502c6d010 2024-09-19T09:43:22.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.225+0000 7f83679d9740 1 -- 172.21.15.1:0/163713523 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562502c6d010 msgr2=0x562502c6c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:22.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.225+0000 7f83679d9740 1 --2- 172.21.15.1:0/163713523 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562502c6d010 0x562502c6c0b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8348005ab0 tx=0x7f834802a410 comp rx=0 tx=0).stop 2024-09-19T09:43:22.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.226+0000 7f83679d9740 1 -- 172.21.15.1:0/163713523 shutdown_connections 2024-09-19T09:43:22.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.226+0000 7f83679d9740 1 --2- 172.21.15.1:0/163713523 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562502c722e0 0x562502c6e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:22.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.226+0000 7f83679d9740 1 --2- 172.21.15.1:0/163713523 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562502c719a0 0x562502c83170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:22.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.226+0000 7f83679d9740 1 --2- 172.21.15.1:0/163713523 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562502c6d010 0x562502c6c0b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:22.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.226+0000 7f83679d9740 1 -- 172.21.15.1:0/163713523 >> 172.21.15.1:0/163713523 conn(0x562502c76ec0 msgr2=0x562502c6b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:22.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.231+0000 7f83679d9740 1 -- 172.21.15.1:0/163713523 shutdown_connections 2024-09-19T09:43:22.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.233+0000 7f83679d9740 1 -- 172.21.15.1:0/163713523 wait complete. 2024-09-19T09:43:22.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.233+0000 7f83679d9740 1 -- start start 2024-09-19T09:43:22.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.233+0000 7f83679d9740 1 Processor -- start 2024-09-19T09:43:22.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.234+0000 7f83679d9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562502c6d010 0x562502c80da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:22.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.234+0000 7f83679d9740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562502c719a0 0x562502c812e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:22.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.234+0000 7f83679d9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562502c722e0 0x562502c82280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:22.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.234+0000 7f83679d9740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f83601a9f60 con 0x562502c719a0 2024-09-19T09:43:22.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.234+0000 7f83679d9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f83601ab3d0 con 0x562502c6d010 2024-09-19T09:43:22.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.234+0000 7f83679d9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f83601aa630 con 0x562502c722e0 2024-09-19T09:43:22.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.234+0000 7f83679d9740 10 client.0 _ll_register_callbacks cb 0x7f8348005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:43:22.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.235+0000 7f835e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562502c719a0 0x562502c812e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:22.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.235+0000 7f835e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562502c719a0 0x562502c812e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45144/0 (socket says 172.21.15.1:45144) 2024-09-19T09:43:22.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.235+0000 7f835e59c640 1 -- 172.21.15.1:0/3159441931 learned_addr learned my addr 172.21.15.1:0/3159441931 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:22.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.236+0000 7f835dd9b640 1 --2- 172.21.15.1:0/3159441931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562502c722e0 0x562502c82280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:22.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.236+0000 7f835dd9b640 1 --2- 172.21.15.1:0/3159441931 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562502c6d010 0x562502c80da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:22.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.237+0000 7f835dd9b640 1 -- 172.21.15.1:0/3159441931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562502c722e0 msgr2=0x562502c82280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:22.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.237+0000 7f835dd9b640 1 --2- 172.21.15.1:0/3159441931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562502c722e0 0x562502c82280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:22.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.238+0000 7f835dd9b640 1 -- 172.21.15.1:0/3159441931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562502c719a0 msgr2=0x562502c812e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:22.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.238+0000 7f835dd9b640 1 --2- 172.21.15.1:0/3159441931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562502c719a0 0x562502c812e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:22.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.238+0000 7f835dd9b640 1 -- 172.21.15.1:0/3159441931 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562502c82890 con 0x562502c6d010 2024-09-19T09:43:22.244 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.240+0000 7f835dd9b640 1 --2- 172.21.15.1:0/3159441931 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562502c6d010 0x562502c80da0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8348031b70 tx=0x7f8348005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da37d9fe28b5af65 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:22.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.245+0000 7f8345ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:43:22.246 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.245+0000 7f8345ffb640 1 -- 172.21.15.1:0/3159441931 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834805b070 con 0x562502c6d010 2024-09-19T09:43:22.247 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.245+0000 7f8345ffb640 1 -- 172.21.15.1:0/3159441931 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f8348004930 con 0x562502c6d010 2024-09-19T09:43:22.251 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.248+0000 7f83679d9740 1 -- 172.21.15.1:0/3159441931 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8348004780 con 0x562502c6d010 2024-09-19T09:43:22.252 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.250+0000 7f8345ffb640 1 -- 172.21.15.1:0/3159441931 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8348035040 con 0x562502c6d010 2024-09-19T09:43:22.252 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.250+0000 7f83679d9740 10 client.25769 fetch_fsmap learned FSMap version 19 2024-09-19T09:43:22.252 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.250+0000 7f83679d9740 1 -- 172.21.15.1:0/3159441931 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x562502cf2630 con 0x562502c6d010 2024-09-19T09:43:22.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.251+0000 7f8345ffb640 1 -- 172.21.15.1:0/3159441931 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f834804f430 con 0x562502c6d010 2024-09-19T09:43:22.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.251+0000 7f8345ffb640 1 -- 172.21.15.1:0/3159441931 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f834803d450 con 0x562502c6d010 2024-09-19T09:43:22.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.251+0000 7f83679d9740 10 client.25769 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:43:22.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.251+0000 7f83679d9740 10 client.25769 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:43:22.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.251+0000 7f83679d9740 20 client.25769 populate_metadata read hostname 'smithi001' 2024-09-19T09:43:22.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.251+0000 7f83679d9740 1 --2- 172.21.15.1:0/3159441931 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x562502c77370 0x562502cf2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:22.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.251+0000 7f83679d9740 4 client.25769 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:43:22.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.251+0000 7f83679d9740 1 -- 172.21.15.1:0/3159441931 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f8348004780 con 0x562502c77370 2024-09-19T09:43:22.254 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.253+0000 7f835e59c640 1 --2- 172.21.15.1:0/3159441931 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x562502c77370 0x562502cf2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:22.260 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.258+0000 7f835e59c640 1 --2- 172.21.15.1:0/3159441931 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x562502c77370 0x562502cf2f20 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b30f148879e08dd1 server_cookie=2d265445aa349e33 in_seq=0 out_seq=0 2024-09-19T09:43:22.260 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:22.258+0000 7f8345ffb640 10 client.25769 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:43:22.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:22 smithi001 ceph-mon[31225]: scrub queued for path: / 2024-09-19T09:43:22.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:22 smithi001 ceph-mon[31225]: scrub summary: idle+waiting paths [/] 2024-09-19T09:43:22.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:22 smithi001 ceph-mon[31225]: scrub summary: active paths [/] 2024-09-19T09:43:22.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:22 smithi022 ceph-mon[35583]: scrub queued for path: / 2024-09-19T09:43:22.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:22 smithi022 ceph-mon[35583]: scrub summary: idle+waiting paths [/] 2024-09-19T09:43:22.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:22 smithi022 ceph-mon[35583]: scrub summary: active paths [/] 2024-09-19T09:43:22.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:22 smithi121 ceph-mon[35577]: scrub queued for path: / 2024-09-19T09:43:22.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:22 smithi121 ceph-mon[35577]: scrub summary: idle+waiting paths [/] 2024-09-19T09:43:22.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:22 smithi121 ceph-mon[35577]: scrub summary: active paths [/] 2024-09-19T09:43:23.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.947+0000 7fae331c5640 1 -- 172.21.15.1:0/3122412221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae2c11b140 msgr2=0x7fae2c11d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:23.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.947+0000 7fae331c5640 1 --2- 172.21.15.1:0/3122412221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae2c11b140 0x7fae2c11d530 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fae24009ca0 tx=0x7fae2402a8f0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.948+0000 7fae331c5640 1 -- 172.21.15.1:0/3122412221 shutdown_connections 2024-09-19T09:43:23.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.948+0000 7fae331c5640 1 --2- 172.21.15.1:0/3122412221 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae2c11b140 0x7fae2c11d530 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.948+0000 7fae331c5640 1 --2- 172.21.15.1:0/3122412221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae2c109830 0x7fae2c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.948+0000 7fae331c5640 1 --2- 172.21.15.1:0/3122412221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae2c109450 0x7fae2c110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.948+0000 7fae331c5640 1 -- 172.21.15.1:0/3122412221 >> 172.21.15.1:0/3122412221 conn(0x7fae2c06e140 msgr2=0x7fae2c06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:23.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.948+0000 7fae331c5640 1 -- 172.21.15.1:0/3122412221 shutdown_connections 2024-09-19T09:43:23.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.950+0000 7fae331c5640 1 -- 172.21.15.1:0/3122412221 wait complete. 2024-09-19T09:43:23.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.950+0000 7fae331c5640 1 Processor -- start 2024-09-19T09:43:23.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.951+0000 7fae331c5640 1 -- start start 2024-09-19T09:43:23.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.951+0000 7fae331c5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae2c109450 0x7fae2c118690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:23.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.951+0000 7fae331c5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae2c109830 0x7fae2c118bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:23.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.951+0000 7fae331c5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae2c11b140 0x7fae2c1118e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:23.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.951+0000 7fae331c5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c120da0 con 0x7fae2c11b140 2024-09-19T09:43:23.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.951+0000 7fae331c5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c120c20 con 0x7fae2c109830 2024-09-19T09:43:23.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.951+0000 7fae331c5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c120f20 con 0x7fae2c109450 2024-09-19T09:43:23.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.951+0000 7fae2bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae2c109830 0x7fae2c118bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:23.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.951+0000 7fae2bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae2c109830 0x7fae2c118bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:53832/0 (socket says 172.21.15.1:53832) 2024-09-19T09:43:23.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.951+0000 7fae2bfff640 1 -- 172.21.15.1:0/3738301659 learned_addr learned my addr 172.21.15.1:0/3738301659 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:23.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.951+0000 7fae30f61640 1 --2- 172.21.15.1:0/3738301659 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae2c109450 0x7fae2c118690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:23.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.953+0000 7fae2bfff640 1 -- 172.21.15.1:0/3738301659 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae2c109450 msgr2=0x7fae2c118690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:23.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.953+0000 7fae2bfff640 1 --2- 172.21.15.1:0/3738301659 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae2c109450 0x7fae2c118690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.953+0000 7fae2bfff640 1 -- 172.21.15.1:0/3738301659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae2c11b140 msgr2=0x7fae2c1118e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:23.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.953+0000 7fae2bfff640 1 --2- 172.21.15.1:0/3738301659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae2c11b140 0x7fae2c1118e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.953+0000 7fae2bfff640 1 -- 172.21.15.1:0/3738301659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae2c1121a0 con 0x7fae2c109830 2024-09-19T09:43:23.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.954+0000 7fae2bfff640 1 --2- 172.21.15.1:0/3738301659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae2c109830 0x7fae2c118bd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fae2000e9f0 tx=0x7fae2000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:23.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.954+0000 7fae29ffb640 1 -- 172.21.15.1:0/3738301659 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae2000cd80 con 0x7fae2c109830 2024-09-19T09:43:23.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.954+0000 7fae29ffb640 1 -- 172.21.15.1:0/3738301659 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae20010910 con 0x7fae2c109830 2024-09-19T09:43:23.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.954+0000 7fae29ffb640 1 -- 172.21.15.1:0/3738301659 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae200188f0 con 0x7fae2c109830 2024-09-19T09:43:23.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.956+0000 7fae331c5640 1 -- 172.21.15.1:0/3738301659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae2c112490 con 0x7fae2c109830 2024-09-19T09:43:23.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.956+0000 7fae331c5640 1 -- 172.21.15.1:0/3738301659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae2c1163f0 con 0x7fae2c109830 2024-09-19T09:43:23.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.959+0000 7fae29ffb640 1 -- 172.21.15.1:0/3738301659 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fae20010ac0 con 0x7fae2c109830 2024-09-19T09:43:23.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.961+0000 7fae29ffb640 1 --2- 172.21.15.1:0/3738301659 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fae140a3450 0x7fae140a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:23.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.961+0000 7fae29ffb640 1 -- 172.21.15.1:0/3738301659 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fae200cfcd0 con 0x7fae2c109830 2024-09-19T09:43:23.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.962+0000 7fae30f61640 1 --2- 172.21.15.1:0/3738301659 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fae140a3450 0x7fae140a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:23.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.963+0000 7fae3559e740 1 Processor -- start 2024-09-19T09:43:23.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.964+0000 7fae30f61640 1 --2- 172.21.15.1:0/3738301659 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fae140a3450 0x7fae140a5910 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0058c0 tx=0x7fae1c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:23.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.966+0000 7fae3559e740 1 -- start start 2024-09-19T09:43:23.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.966+0000 7fae3559e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5615c16cab60 0x5615c16caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:23.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.966+0000 7fae3559e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615c16cb480 0x5615c16d5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:23.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.966+0000 7fae3559e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615c16d5d40 0x5615c16d8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:23.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.966+0000 7fae2bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615c16cb480 0x5615c16d5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:23.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.966+0000 7fae2bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615c16cb480 0x5615c16d5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:53842/0 (socket says 172.21.15.1:53842) 2024-09-19T09:43:23.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.966+0000 7fae2bfff640 1 -- 172.21.15.1:0/2849996769 learned_addr learned my addr 172.21.15.1:0/2849996769 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:23.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.966+0000 7fae3559e740 1 -- 172.21.15.1:0/2849996769 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5615c1630280 con 0x5615c16cab60 2024-09-19T09:43:23.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.966+0000 7fae3559e740 1 -- 172.21.15.1:0/2849996769 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5615c15d7b10 con 0x5615c16cb480 2024-09-19T09:43:23.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.966+0000 7fae3559e740 1 -- 172.21.15.1:0/2849996769 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5615c162c240 con 0x5615c16d5d40 2024-09-19T09:43:23.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.967+0000 7fae31762640 1 --2- 172.21.15.1:0/2849996769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615c16d5d40 0x5615c16d8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:23.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.967+0000 7fae31762640 1 -- 172.21.15.1:0/2849996769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615c16cb480 msgr2=0x5615c16d5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:23.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.967+0000 7fae31762640 1 --2- 172.21.15.1:0/2849996769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615c16cb480 0x5615c16d5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.967+0000 7fae31762640 1 -- 172.21.15.1:0/2849996769 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5615c16cab60 msgr2=0x5615c16caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:23.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.967+0000 7fae31762640 1 --2- 172.21.15.1:0/2849996769 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5615c16cab60 0x5615c16caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.967+0000 7fae31762640 1 -- 172.21.15.1:0/2849996769 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615c15e41f0 con 0x5615c16d5d40 2024-09-19T09:43:23.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.971+0000 7fae31762640 1 --2- 172.21.15.1:0/2849996769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615c16d5d40 0x5615c16d8130 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fae24009bf0 tx=0x7fae24005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=427afc32269bc73e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:23.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.971+0000 7fae12ffd640 1 -- 172.21.15.1:0/2849996769 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae240305f0 con 0x5615c16d5d40 2024-09-19T09:43:23.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.971+0000 7fae12ffd640 1 -- 172.21.15.1:0/2849996769 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae2403f070 con 0x5615c16d5d40 2024-09-19T09:43:23.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.973+0000 7fae3559e740 1 -- 172.21.15.1:0/2849996769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615c16d5d40 msgr2=0x5615c16d8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:23.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.973+0000 7fae3559e740 1 --2- 172.21.15.1:0/2849996769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615c16d5d40 0x5615c16d8130 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fae24009bf0 tx=0x7fae24005f90 comp rx=0 tx=0).stop 2024-09-19T09:43:23.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.973+0000 7fae3559e740 1 -- 172.21.15.1:0/2849996769 shutdown_connections 2024-09-19T09:43:23.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.973+0000 7fae3559e740 1 --2- 172.21.15.1:0/2849996769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615c16d5d40 0x5615c16d8130 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.973+0000 7fae3559e740 1 --2- 172.21.15.1:0/2849996769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615c16cb480 0x5615c16d5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.973+0000 7fae3559e740 1 --2- 172.21.15.1:0/2849996769 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5615c16cab60 0x5615c16caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.973+0000 7fae3559e740 1 -- 172.21.15.1:0/2849996769 >> 172.21.15.1:0/2849996769 conn(0x5615c16c70f0 msgr2=0x5615c16c74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:23.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.973+0000 7fae3559e740 1 -- 172.21.15.1:0/2849996769 shutdown_connections 2024-09-19T09:43:23.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.973+0000 7fae3559e740 1 -- 172.21.15.1:0/2849996769 wait complete. 2024-09-19T09:43:23.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.974+0000 7fae3559e740 1 -- start start 2024-09-19T09:43:23.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.974+0000 7fae3559e740 1 Processor -- start 2024-09-19T09:43:23.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.974+0000 7fae3559e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615c16cab60 0x5615c16d7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:23.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.974+0000 7fae3559e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615c16cb480 0x5615c16d5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:23.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.975+0000 7fae30f61640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615c16cab60 0x5615c16d7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:23.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.975+0000 7fae30f61640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615c16cab60 0x5615c16d7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:45146/0 (socket says 172.21.15.1:45146) 2024-09-19T09:43:23.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.975+0000 7fae30f61640 1 -- 172.21.15.1:0/3854726454 learned_addr learned my addr 172.21.15.1:0/3854726454 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:23.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.975+0000 7fae2bfff640 1 --2- 172.21.15.1:0/3854726454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615c16cb480 0x5615c16d5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:23.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.975+0000 7fae3559e740 1 --2- 172.21.15.1:0/3854726454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5615c16d57c0 0x5615c16d5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:23.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.975+0000 7fae3559e740 1 -- 172.21.15.1:0/3854726454 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5615c16d8960 con 0x5615c16d57c0 2024-09-19T09:43:23.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.975+0000 7fae3559e740 1 -- 172.21.15.1:0/3854726454 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5615c15eaf10 con 0x5615c16cb480 2024-09-19T09:43:23.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.975+0000 7fae3559e740 1 -- 172.21.15.1:0/3854726454 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5615c16d8ae0 con 0x5615c16cab60 2024-09-19T09:43:23.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.975+0000 7fae3559e740 10 client.0 _ll_register_callbacks cb 0x5615c15b3a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:43:23.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.975+0000 7fae30f61640 1 -- 172.21.15.1:0/3854726454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615c16cb480 msgr2=0x5615c16d5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:23.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.975+0000 7fae30f61640 1 --2- 172.21.15.1:0/3854726454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615c16cb480 0x5615c16d5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.975+0000 7fae30f61640 1 -- 172.21.15.1:0/3854726454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5615c16d57c0 msgr2=0x5615c16d5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:23.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.975+0000 7fae30f61640 1 --2- 172.21.15.1:0/3854726454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5615c16d57c0 0x5615c16d5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.975+0000 7fae30f61640 1 -- 172.21.15.1:0/3854726454 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615c13a16a0 con 0x5615c16cab60 2024-09-19T09:43:23.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.976+0000 7fae30f61640 1 --2- 172.21.15.1:0/3854726454 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615c16cab60 0x5615c16d7f80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fae1c010a90 tx=0x7fae1c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9573e9ca0426573c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:23.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.977+0000 7fae0bfff640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-19T09:43:23.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.977+0000 7fae0bfff640 1 -- 172.21.15.1:0/3854726454 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1c016070 con 0x5615c16cab60 2024-09-19T09:43:23.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.977+0000 7fae3559e740 1 -- 172.21.15.1:0/3854726454 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5615c163d7f0 con 0x5615c16cab60 2024-09-19T09:43:23.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.977+0000 7fae0bfff640 1 -- 172.21.15.1:0/3854726454 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fae1c01bcc0 con 0x5615c16cab60 2024-09-19T09:43:23.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.977+0000 7fae0bfff640 1 -- 172.21.15.1:0/3854726454 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fae1c005020 con 0x5615c16cab60 2024-09-19T09:43:23.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.977+0000 7fae3559e740 10 client.25588 fetch_fsmap learned FSMap version 19 2024-09-19T09:43:23.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.977+0000 7fae3559e740 1 -- 172.21.15.1:0/3854726454 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5615c16e4890 con 0x5615c16cab60 2024-09-19T09:43:23.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.978+0000 7fae0bfff640 1 -- 172.21.15.1:0/3854726454 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5615c163d7f0 con 0x5615c16cab60 2024-09-19T09:43:23.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.979+0000 7fae0bfff640 1 -- 172.21.15.1:0/3854726454 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fae1c026430 con 0x5615c16cab60 2024-09-19T09:43:23.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.979+0000 7fae3559e740 10 client.25588 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:43:23.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.979+0000 7fae3559e740 10 client.25588 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:43:23.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.979+0000 7fae3559e740 20 client.25588 populate_metadata read hostname 'smithi001' 2024-09-19T09:43:23.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.979+0000 7fae3559e740 1 --2- 172.21.15.1:0/3854726454 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5615c16e5d50 0x5615c16e8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:23.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.979+0000 7fae3559e740 4 client.25588 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:43:23.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.979+0000 7fae3559e740 1 -- 172.21.15.1:0/3854726454 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5615c1637d00 con 0x5615c16e5d50 2024-09-19T09:43:23.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.979+0000 7fae2bfff640 1 --2- 172.21.15.1:0/3854726454 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5615c16e5d50 0x5615c16e8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:23.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.980+0000 7fae2bfff640 1 --2- 172.21.15.1:0/3854726454 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5615c16e5d50 0x5615c16e8160 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5bbe14dac9cd227 server_cookie=5d0c5496b4db1eb1 in_seq=0 out_seq=0 2024-09-19T09:43:23.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.980+0000 7fae0bfff640 10 client.25588 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:43:23.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.981+0000 7fae0bfff640 1 -- 172.21.15.1:0/3854726454 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5615c1637d00 con 0x5615c16e5d50 2024-09-19T09:43:23.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.981+0000 7fae0bfff640 10 client.25588 handle_command_reply: tid=0 2024-09-19T09:43:23.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.981+0000 7fae3559e740 1 client.25588 shutdown 2024-09-19T09:43:23.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.983+0000 7fae3559e740 1 -- 172.21.15.1:0/3854726454 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615c16cab60 msgr2=0x5615c16d7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:23.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.983+0000 7fae3559e740 1 --2- 172.21.15.1:0/3854726454 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615c16cab60 0x5615c16d7f80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fae1c010a90 tx=0x7fae1c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.983+0000 7fae3559e740 1 -- 172.21.15.1:0/3854726454 shutdown_connections 2024-09-19T09:43:23.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.983+0000 7fae3559e740 1 --2- 172.21.15.1:0/3854726454 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5615c16e5d50 0x5615c16e8160 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.983+0000 7fae3559e740 1 --2- 172.21.15.1:0/3854726454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5615c16d57c0 0x5615c16d5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.983+0000 7fae3559e740 1 --2- 172.21.15.1:0/3854726454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615c16cb480 0x5615c16d5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.983+0000 7fae3559e740 1 --2- 172.21.15.1:0/3854726454 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615c16cab60 0x5615c16d7f80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.983+0000 7fae0bfff640 0 client.25588 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:43:23.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.983+0000 7fae3559e740 1 -- 172.21.15.1:0/3854726454 >> 172.21.15.1:0/3854726454 conn(0x5615c16c70f0 msgr2=0x5615c16cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:23.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.983+0000 7fae3559e740 1 -- 172.21.15.1:0/3854726454 shutdown_connections 2024-09-19T09:43:23.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.983+0000 7fae3559e740 1 -- 172.21.15.1:0/3854726454 wait complete. 2024-09-19T09:43:23.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:21.984+0000 7fae3559e740 20 client.25588 trim_cache size 0 max 16384 2024-09-19T09:43:23.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.021+0000 7fae3559e740 1 Processor -- start 2024-09-19T09:43:23.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.022+0000 7fae3559e740 1 -- start start 2024-09-19T09:43:23.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.023+0000 7fae3559e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615c16cab60 0x5615c16d3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:23.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.023+0000 7fae3559e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615c16cb480 0x5615c16d4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:23.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.023+0000 7fae3559e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5615c16d57c0 0x5615c16ed9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:23.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.023+0000 7fae3559e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c1b1a80 con 0x5615c16d57c0 2024-09-19T09:43:23.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.023+0000 7fae3559e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c1b4320 con 0x5615c16cab60 2024-09-19T09:43:23.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.023+0000 7fae3559e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c1b2110 con 0x5615c16cb480 2024-09-19T09:43:23.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.025+0000 7fae2bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615c16cb480 0x5615c16d4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:23.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.025+0000 7fae30f61640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615c16cab60 0x5615c16d3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:23.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.025+0000 7fae2bfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615c16cb480 0x5615c16d4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:45156/0 (socket says 172.21.15.1:45156) 2024-09-19T09:43:23.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.025+0000 7fae2bfff640 1 -- 172.21.15.1:0/2488295260 learned_addr learned my addr 172.21.15.1:0/2488295260 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:23.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.026+0000 7fae2bfff640 1 -- 172.21.15.1:0/2488295260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615c16cab60 msgr2=0x5615c16d3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:23.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.026+0000 7fae2bfff640 1 --2- 172.21.15.1:0/2488295260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615c16cab60 0x5615c16d3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.026+0000 7fae2bfff640 1 -- 172.21.15.1:0/2488295260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5615c16d57c0 msgr2=0x5615c16ed9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:23.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.026+0000 7fae2bfff640 1 --2- 172.21.15.1:0/2488295260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5615c16d57c0 0x5615c16ed9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.026+0000 7fae2bfff640 1 -- 172.21.15.1:0/2488295260 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615c16d82f0 con 0x5615c16cb480 2024-09-19T09:43:23.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.027+0000 7fae2bfff640 1 --2- 172.21.15.1:0/2488295260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615c16cb480 0x5615c16d4090 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fae2009c240 tx=0x7fae2001a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c10edd0ae96b9b0d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:23.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.027+0000 7fae127fc640 1 -- 172.21.15.1:0/2488295260 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae200b4020 con 0x5615c16cb480 2024-09-19T09:43:23.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.027+0000 7fae127fc640 1 -- 172.21.15.1:0/2488295260 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae200b5260 con 0x5615c16cb480 2024-09-19T09:43:23.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.027+0000 7fae127fc640 1 -- 172.21.15.1:0/2488295260 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae200abe80 con 0x5615c16cb480 2024-09-19T09:43:23.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.029+0000 7fae3559e740 1 -- 172.21.15.1:0/2488295260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615c16cb480 msgr2=0x5615c16d4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:23.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.029+0000 7fae3559e740 1 --2- 172.21.15.1:0/2488295260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615c16cb480 0x5615c16d4090 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fae2009c240 tx=0x7fae2001a040 comp rx=0 tx=0).stop 2024-09-19T09:43:23.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.029+0000 7fae3559e740 1 -- 172.21.15.1:0/2488295260 shutdown_connections 2024-09-19T09:43:23.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.029+0000 7fae3559e740 1 --2- 172.21.15.1:0/2488295260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5615c16d57c0 0x5615c16ed9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.029+0000 7fae3559e740 1 --2- 172.21.15.1:0/2488295260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615c16cb480 0x5615c16d4090 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fae2009c240 tx=0x7fae2001a040 comp rx=0 tx=0).stop 2024-09-19T09:43:23.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.029+0000 7fae3559e740 1 --2- 172.21.15.1:0/2488295260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615c16cab60 0x5615c16d3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.029+0000 7fae3559e740 1 -- 172.21.15.1:0/2488295260 >> 172.21.15.1:0/2488295260 conn(0x5615c16c70f0 msgr2=0x5615c16d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:23.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.031+0000 7fae3559e740 1 -- 172.21.15.1:0/2488295260 shutdown_connections 2024-09-19T09:43:23.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.031+0000 7fae3559e740 1 -- 172.21.15.1:0/2488295260 wait complete. 2024-09-19T09:43:23.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.031+0000 7fae3559e740 1 -- start start 2024-09-19T09:43:23.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.031+0000 7fae3559e740 1 Processor -- start 2024-09-19T09:43:23.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.032+0000 7fae3559e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5615c16cab60 0x5615c16d9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:23.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.032+0000 7fae3559e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615c16d57c0 0x5615c16da030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:23.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.032+0000 7fae3559e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615c16da570 0x5615c174f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:23.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.032+0000 7fae3559e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c1b27e0 con 0x5615c16cab60 2024-09-19T09:43:23.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.032+0000 7fae3559e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c1b3c50 con 0x5615c16d57c0 2024-09-19T09:43:23.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.032+0000 7fae3559e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fae2c1b2eb0 con 0x5615c16da570 2024-09-19T09:43:23.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.032+0000 7fae3559e740 10 client.0 _ll_register_callbacks cb 0x7fae1c00a7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:43:23.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.033+0000 7fae2bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615c16d57c0 0x5615c16da030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:23.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.034+0000 7fae31762640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615c16da570 0x5615c174f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:23.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.034+0000 7fae30f61640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5615c16cab60 0x5615c16d9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:23.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.034+0000 7fae30f61640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5615c16cab60 0x5615c16d9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:45098/0 (socket says 172.21.15.1:45098) 2024-09-19T09:43:23.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.034+0000 7fae30f61640 1 -- 172.21.15.1:0/2013681730 learned_addr learned my addr 172.21.15.1:0/2013681730 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:23.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.037+0000 7fae30f61640 1 -- 172.21.15.1:0/2013681730 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615c16da570 msgr2=0x5615c174f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:23.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.037+0000 7fae30f61640 1 --2- 172.21.15.1:0/2013681730 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615c16da570 0x5615c174f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.037+0000 7fae30f61640 1 -- 172.21.15.1:0/2013681730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615c16d57c0 msgr2=0x5615c16da030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:23.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.037+0000 7fae30f61640 1 --2- 172.21.15.1:0/2013681730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615c16d57c0 0x5615c16da030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.037+0000 7fae30f61640 1 -- 172.21.15.1:0/2013681730 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615c16cb2b0 con 0x5615c16cab60 2024-09-19T09:43:23.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.037+0000 7fae30f61640 1 --2- 172.21.15.1:0/2013681730 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5615c16cab60 0x5615c16d9af0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fae1c004690 tx=0x7fae1c01bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd32038c68494f15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:23.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.038+0000 7fae0bfff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:43:23.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.038+0000 7fae0bfff640 1 -- 172.21.15.1:0/2013681730 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1c03e060 con 0x5615c16cab60 2024-09-19T09:43:23.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.038+0000 7fae0bfff640 1 -- 172.21.15.1:0/2013681730 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fae1c0053d0 con 0x5615c16cab60 2024-09-19T09:43:23.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.038+0000 7fae3559e740 1 -- 172.21.15.1:0/2013681730 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae200b5260 con 0x5615c16cab60 2024-09-19T09:43:23.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.040+0000 7fae0bfff640 1 -- 172.21.15.1:0/2013681730 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fae1c016040 con 0x5615c16cab60 2024-09-19T09:43:23.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.041+0000 7fae3559e740 10 client.16092 fetch_fsmap learned FSMap version 19 2024-09-19T09:43:23.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.041+0000 7fae3559e740 1 -- 172.21.15.1:0/2013681730 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5615c1750f50 con 0x5615c16cab60 2024-09-19T09:43:23.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.042+0000 7fae0bfff640 1 -- 172.21.15.1:0/2013681730 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae200b5260 con 0x5615c16cab60 2024-09-19T09:43:23.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.042+0000 7fae0bfff640 1 -- 172.21.15.1:0/2013681730 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fae1c01c420 con 0x5615c16cab60 2024-09-19T09:43:23.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.042+0000 7fae3559e740 10 client.16092 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:43:23.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.042+0000 7fae3559e740 10 client.16092 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:43:23.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.042+0000 7fae3559e740 20 client.16092 populate_metadata read hostname 'smithi001' 2024-09-19T09:43:23.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.042+0000 7fae3559e740 1 --2- 172.21.15.1:0/2013681730 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5615c1751670 0x5615c1753a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:23.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.042+0000 7fae3559e740 4 client.16092 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:43:23.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.042+0000 7fae3559e740 1 -- 172.21.15.1:0/2013681730 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5615c15b4110 con 0x5615c1751670 2024-09-19T09:43:23.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.047+0000 7fae2bfff640 1 --2- 172.21.15.1:0/2013681730 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5615c1751670 0x5615c1753a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:23.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.049+0000 7fae2bfff640 1 --2- 172.21.15.1:0/2013681730 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5615c1751670 0x5615c1753a90 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8971d10d78e2aeee server_cookie=50324ba36b3fe09f in_seq=0 out_seq=0 2024-09-19T09:43:23.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.049+0000 7fae0bfff640 10 client.16092 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:43:23.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.052+0000 7fae0bfff640 1 -- 172.21.15.1:0/2013681730 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5615c15b4110 con 0x5615c1751670 2024-09-19T09:43:23.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.052+0000 7fae0bfff640 10 client.16092 handle_command_reply: tid=0 2024-09-19T09:43:23.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.053+0000 7fae3559e740 1 client.16092 shutdown 2024-09-19T09:43:23.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.055+0000 7fae3559e740 1 -- 172.21.15.1:0/2013681730 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5615c16cab60 msgr2=0x5615c16d9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:23.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.055+0000 7fae3559e740 1 --2- 172.21.15.1:0/2013681730 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5615c16cab60 0x5615c16d9af0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fae1c004690 tx=0x7fae1c01bd70 comp rx=0 tx=0).stop 2024-09-19T09:43:23.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.055+0000 7fae3559e740 1 -- 172.21.15.1:0/2013681730 shutdown_connections 2024-09-19T09:43:23.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.055+0000 7fae3559e740 1 --2- 172.21.15.1:0/2013681730 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5615c1751670 0x5615c1753a90 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.055+0000 7fae3559e740 1 --2- 172.21.15.1:0/2013681730 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615c16da570 0x5615c174f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.055+0000 7fae3559e740 1 --2- 172.21.15.1:0/2013681730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5615c16d57c0 0x5615c16da030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.055+0000 7fae3559e740 1 --2- 172.21.15.1:0/2013681730 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5615c16cab60 0x5615c16d9af0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.055+0000 7fae3559e740 1 -- 172.21.15.1:0/2013681730 >> 172.21.15.1:0/2013681730 conn(0x5615c16c70f0 msgr2=0x5615c16d39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:23.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.055+0000 7fae0bfff640 0 client.16092 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:43:23.145 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:43:23.145 INFO:teuthology.orchestra.run.smithi001.stdout: "return_code": 0, 2024-09-19T09:43:23.146 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_tag": "e3364ece-6012-4b22-8215-21b8e7bcae0b", 2024-09-19T09:43:23.146 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": "asynchronous" 2024-09-19T09:43:23.146 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:43:23.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.056+0000 7fae3559e740 1 -- 172.21.15.1:0/2013681730 shutdown_connections 2024-09-19T09:43:23.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.056+0000 7fae3559e740 1 -- 172.21.15.1:0/2013681730 wait complete. 2024-09-19T09:43:23.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.056+0000 7fae3559e740 20 client.16092 trim_cache size 0 max 16384 2024-09-19T09:43:23.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.062+0000 7fae331c5640 1 -- 172.21.15.1:0/3738301659 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fae140a3450 msgr2=0x7fae140a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:23.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.062+0000 7fae331c5640 1 --2- 172.21.15.1:0/3738301659 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fae140a3450 0x7fae140a5910 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0058c0 tx=0x7fae1c00a2d0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.062+0000 7fae331c5640 1 -- 172.21.15.1:0/3738301659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae2c109830 msgr2=0x7fae2c118bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:23.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.062+0000 7fae331c5640 1 --2- 172.21.15.1:0/3738301659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae2c109830 0x7fae2c118bd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fae2000e9f0 tx=0x7fae2000eeb0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.062+0000 7fae331c5640 1 -- 172.21.15.1:0/3738301659 shutdown_connections 2024-09-19T09:43:23.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.062+0000 7fae331c5640 1 --2- 172.21.15.1:0/3738301659 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fae2c11b140 0x7fae2c1118e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.062+0000 7fae331c5640 1 --2- 172.21.15.1:0/3738301659 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fae140a3450 0x7fae140a5910 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.062+0000 7fae331c5640 1 --2- 172.21.15.1:0/3738301659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae2c109830 0x7fae2c118bd0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.062+0000 7fae331c5640 1 --2- 172.21.15.1:0/3738301659 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae2c109450 0x7fae2c118690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.062+0000 7fae331c5640 1 -- 172.21.15.1:0/3738301659 >> 172.21.15.1:0/3738301659 conn(0x7fae2c06e140 msgr2=0x7fae2c11be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:23.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.065+0000 7fae331c5640 1 -- 172.21.15.1:0/3738301659 shutdown_connections 2024-09-19T09:43:23.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:22.066+0000 7fae331c5640 1 -- 172.21.15.1:0/3738301659 wait complete. 2024-09-19T09:43:23.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:23.528+0000 7f8345ffb640 1 -- 172.21.15.1:0/3159441931 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f8348004780 con 0x562502c77370 2024-09-19T09:43:23.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:23.529+0000 7f8345ffb640 10 client.25769 handle_command_reply: tid=0 2024-09-19T09:43:23.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:23.529+0000 7f83679d9740 1 client.25769 shutdown 2024-09-19T09:43:23.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:23.529+0000 7f83679d9740 1 -- 172.21.15.1:0/3159441931 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562502c6d010 msgr2=0x562502c80da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:23.531 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:23.529+0000 7f83679d9740 1 --2- 172.21.15.1:0/3159441931 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562502c6d010 0x562502c80da0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8348031b70 tx=0x7f8348005fd0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:23.529+0000 7f83679d9740 1 -- 172.21.15.1:0/3159441931 shutdown_connections 2024-09-19T09:43:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:23.529+0000 7f83679d9740 1 --2- 172.21.15.1:0/3159441931 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x562502c77370 0x562502cf2f20 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:23.529+0000 7f83679d9740 1 --2- 172.21.15.1:0/3159441931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562502c722e0 0x562502c82280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:23.529+0000 7f83679d9740 1 --2- 172.21.15.1:0/3159441931 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x562502c719a0 0x562502c812e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:23.529+0000 7f83679d9740 1 --2- 172.21.15.1:0/3159441931 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562502c6d010 0x562502c80da0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:23.529+0000 7f8345ffb640 0 client.25769 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:43:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:23.529+0000 7f83679d9740 1 -- 172.21.15.1:0/3159441931 >> 172.21.15.1:0/3159441931 conn(0x562502c76ec0 msgr2=0x562502c6c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:23.529+0000 7f83679d9740 1 -- 172.21.15.1:0/3159441931 shutdown_connections 2024-09-19T09:43:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:23.529+0000 7f83679d9740 1 -- 172.21.15.1:0/3159441931 wait complete. 2024-09-19T09:43:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:23.529+0000 7f83679d9740 20 client.25769 trim_cache size 0 max 16384 2024-09-19T09:43:23.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:43:23.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:43:23.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:43:23.533 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:43:23.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:23.529+0000 7f8364b68640 1 -- 172.21.15.1:0/1715259036 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f834c0a32c0 msgr2=0x7f834c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:23.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:23.529+0000 7f8364b68640 1 --2- 172.21.15.1:0/1715259036 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f834c0a32c0 0x7f834c0a5780 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f835800d720 tx=0x7f8358016500 comp rx=0 tx=0).stop 2024-09-19T09:43:23.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:23.529+0000 7f8364b68640 1 -- 172.21.15.1:0/1715259036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83601025f0 msgr2=0x7f8360109f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:23.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:23.529+0000 7f8364b68640 1 --2- 172.21.15.1:0/1715259036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83601025f0 0x7f8360109f40 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f835800d750 tx=0x7f835800dc10 comp rx=0 tx=0).stop 2024-09-19T09:43:23.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:23.529+0000 7f8364b68640 1 -- 172.21.15.1:0/1715259036 shutdown_connections 2024-09-19T09:43:23.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:23.529+0000 7f8364b68640 1 --2- 172.21.15.1:0/1715259036 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f83601025f0 0x7f8360109f40 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:23.529+0000 7f8364b68640 1 --2- 172.21.15.1:0/1715259036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8360101c30 0x7f8360109a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:23.530+0000 7f8364b68640 1 --2- 172.21.15.1:0/1715259036 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f834c0a32c0 0x7f834c0a5780 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:23.530+0000 7f8364b68640 1 --2- 172.21.15.1:0/1715259036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8360100a40 0x7f836010b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:23.534 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:23.530+0000 7f8364b68640 1 -- 172.21.15.1:0/1715259036 >> 172.21.15.1:0/1715259036 conn(0x7f83600fc1c0 msgr2=0x7f8360105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:23.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:23.530+0000 7f8364b68640 1 -- 172.21.15.1:0/1715259036 shutdown_connections 2024-09-19T09:43:23.535 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:23.530+0000 7f8364b68640 1 -- 172.21.15.1:0/1715259036 wait complete. 2024-09-19T09:43:23.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:23 smithi001 ceph-mon[31225]: pgmap v497: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 108 MiB/s wr, 15.95k op/s 2024-09-19T09:43:23.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:23 smithi022 ceph-mon[35583]: pgmap v497: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 108 MiB/s wr, 15.95k op/s 2024-09-19T09:43:23.866 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:23 smithi121 ceph-mon[35577]: pgmap v497: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 108 MiB/s wr, 15.95k op/s 2024-09-19T09:43:25.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:25 smithi001 ceph-mon[31225]: pgmap v498: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 103 MiB/s wr, 14.99k op/s 2024-09-19T09:43:25.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:25 smithi022 ceph-mon[35583]: pgmap v498: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 103 MiB/s wr, 14.99k op/s 2024-09-19T09:43:25.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:25 smithi121 ceph-mon[35577]: pgmap v498: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 103 MiB/s wr, 14.99k op/s 2024-09-19T09:43:27.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:27 smithi001 ceph-mon[31225]: pgmap v499: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 96 MiB/s wr, 13.88k op/s 2024-09-19T09:43:27.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:27 smithi022 ceph-mon[35583]: pgmap v499: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 96 MiB/s wr, 13.88k op/s 2024-09-19T09:43:27.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:27 smithi121 ceph-mon[35577]: pgmap v499: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 96 MiB/s wr, 13.88k op/s 2024-09-19T09:43:28.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:28 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:28.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:28 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:28.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:28 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:43:29.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:29 smithi022 ceph-mon[35583]: pgmap v500: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 104 MiB/s wr, 14.71k op/s 2024-09-19T09:43:29.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:29 smithi121 ceph-mon[35577]: pgmap v500: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 104 MiB/s wr, 14.71k op/s 2024-09-19T09:43:29.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:29 smithi001 ceph-mon[31225]: pgmap v500: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 104 MiB/s wr, 14.71k op/s 2024-09-19T09:43:31.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:31 smithi022 ceph-mon[35583]: pgmap v501: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 83 MiB/s wr, 11.87k op/s 2024-09-19T09:43:31.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:31 smithi121 ceph-mon[35577]: pgmap v501: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 83 MiB/s wr, 11.87k op/s 2024-09-19T09:43:31.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:31 smithi001 ceph-mon[31225]: pgmap v501: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 83 MiB/s wr, 11.87k op/s 2024-09-19T09:43:33.126 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:43:33.169 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:43:33.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:33 smithi001 ceph-mon[31225]: pgmap v502: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 83 MiB/s wr, 11.87k op/s 2024-09-19T09:43:33.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:33 smithi022 ceph-mon[35583]: pgmap v502: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 83 MiB/s wr, 11.87k op/s 2024-09-19T09:43:33.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:33 smithi121 ceph-mon[35577]: pgmap v502: 97 pgs: 97 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 83 MiB/s wr, 11.87k op/s 2024-09-19T09:43:35.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:35 smithi022 ceph-mon[35583]: pgmap v503: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 82 MiB/s wr, 11.97k op/s 2024-09-19T09:43:35.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:35 smithi121 ceph-mon[35577]: pgmap v503: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 82 MiB/s wr, 11.97k op/s 2024-09-19T09:43:35.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:35 smithi001 ceph-mon[31225]: pgmap v503: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 82 MiB/s wr, 11.97k op/s 2024-09-19T09:43:36.653 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.651+0000 7fe5075c4640 1 -- 172.21.15.1:0/426413065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe500102610 msgr2=0x7fe500108ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.651+0000 7fe5075c4640 1 --2- 172.21.15.1:0/426413065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe500102610 0x7fe500108ea0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8009900 tx=0x7fe4f802a410 comp rx=0 tx=0).stop 2024-09-19T09:43:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.651+0000 7fe5075c4640 1 -- 172.21.15.1:0/426413065 shutdown_connections 2024-09-19T09:43:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.651+0000 7fe5075c4640 1 --2- 172.21.15.1:0/426413065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe500102610 0x7fe500108ea0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.651+0000 7fe5075c4640 1 --2- 172.21.15.1:0/426413065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe500101c50 0x7fe5001020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.651+0000 7fe5075c4640 1 --2- 172.21.15.1:0/426413065 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe500100a60 0x7fe500100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.651+0000 7fe5075c4640 1 -- 172.21.15.1:0/426413065 >> 172.21.15.1:0/426413065 conn(0x7fe5000fc1c0 msgr2=0x7fe5000fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.651+0000 7fe5075c4640 1 -- 172.21.15.1:0/426413065 shutdown_connections 2024-09-19T09:43:36.654 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.651+0000 7fe5075c4640 1 -- 172.21.15.1:0/426413065 wait complete. 2024-09-19T09:43:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.652+0000 7fe5075c4640 1 Processor -- start 2024-09-19T09:43:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.652+0000 7fe5075c4640 1 -- start start 2024-09-19T09:43:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.653+0000 7fe5075c4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe500100a60 0x7fe500197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.653+0000 7fe5075c4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe500101c50 0x7fe500198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.653+0000 7fe5075c4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe500102610 0x7fe50019f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.653+0000 7fe5075c4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe50010c6c0 con 0x7fe500102610 2024-09-19T09:43:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.653+0000 7fe5075c4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe50010c540 con 0x7fe500100a60 2024-09-19T09:43:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.653+0000 7fe5075c4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe50010c840 con 0x7fe500101c50 2024-09-19T09:43:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.653+0000 7fe505b61640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe500102610 0x7fe50019f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.653+0000 7fe505b61640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe500102610 0x7fe50019f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50490/0 (socket says 172.21.15.1:50490) 2024-09-19T09:43:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.653+0000 7fe505b61640 1 -- 172.21.15.1:0/3954807200 learned_addr learned my addr 172.21.15.1:0/3954807200 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.653+0000 7fe504b5f640 1 --2- 172.21.15.1:0/3954807200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe500101c50 0x7fe500198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.653+0000 7fe505360640 1 --2- 172.21.15.1:0/3954807200 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe500100a60 0x7fe500197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.653+0000 7fe504b5f640 1 -- 172.21.15.1:0/3954807200 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe500100a60 msgr2=0x7fe500197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.653+0000 7fe504b5f640 1 --2- 172.21.15.1:0/3954807200 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe500100a60 0x7fe500197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.653+0000 7fe504b5f640 1 -- 172.21.15.1:0/3954807200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe500102610 msgr2=0x7fe50019f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.653+0000 7fe504b5f640 1 --2- 172.21.15.1:0/3954807200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe500102610 0x7fe50019f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.653+0000 7fe504b5f640 1 -- 172.21.15.1:0/3954807200 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe50019fa60 con 0x7fe500101c50 2024-09-19T09:43:36.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.654+0000 7fe504b5f640 1 --2- 172.21.15.1:0/3954807200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe500101c50 0x7fe500198380 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe4f000d6d0 tx=0x7fe4f000db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:36.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.654+0000 7fe4f67fc640 1 -- 172.21.15.1:0/3954807200 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0017070 con 0x7fe500101c50 2024-09-19T09:43:36.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.654+0000 7fe5075c4640 1 -- 172.21.15.1:0/3954807200 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe50019fd50 con 0x7fe500101c50 2024-09-19T09:43:36.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.654+0000 7fe5075c4640 1 -- 172.21.15.1:0/3954807200 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5001a0260 con 0x7fe500101c50 2024-09-19T09:43:36.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.654+0000 7fe4f67fc640 1 -- 172.21.15.1:0/3954807200 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4f0009d00 con 0x7fe500101c50 2024-09-19T09:43:36.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.654+0000 7fe4f67fc640 1 -- 172.21.15.1:0/3954807200 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0020060 con 0x7fe500101c50 2024-09-19T09:43:36.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.657+0000 7fe50a43d740 1 Processor -- start 2024-09-19T09:43:36.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.657+0000 7fe50a43d740 1 -- start start 2024-09-19T09:43:36.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.657+0000 7fe50a43d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e1694e9db0 0x55e1694ea1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.657+0000 7fe50a43d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e1694ea6f0 0x55e1694ef1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.657+0000 7fe50a43d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e1694ef780 0x55e1694f1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.657+0000 7fe50a43d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e1694492f0 con 0x55e1694ea6f0 2024-09-19T09:43:36.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.657+0000 7fe50a43d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e1693f1270 con 0x55e1694e9db0 2024-09-19T09:43:36.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.657+0000 7fe50a43d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55e1694452b0 con 0x55e1694ef780 2024-09-19T09:43:36.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.657+0000 7fe505360640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e1694ea6f0 0x55e1694ef1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.657+0000 7fe4f67fc640 1 -- 172.21.15.1:0/3954807200 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fe4f0009820 con 0x7fe500101c50 2024-09-19T09:43:36.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.657+0000 7fe505360640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e1694ea6f0 0x55e1694ef1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50500/0 (socket says 172.21.15.1:50500) 2024-09-19T09:43:36.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.657+0000 7fe505360640 1 -- 172.21.15.1:0/3615946324 learned_addr learned my addr 172.21.15.1:0/3615946324 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:36.664 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.657+0000 7fe505b61640 1 --2- 172.21.15.1:0/3615946324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e1694e9db0 0x55e1694ea1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.657+0000 7fe504b5f640 1 --2- 172.21.15.1:0/3615946324 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e1694ef780 0x55e1694f1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.658+0000 7fe505360640 1 -- 172.21.15.1:0/3615946324 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e1694ef780 msgr2=0x55e1694f1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:36.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.658+0000 7fe505360640 1 --2- 172.21.15.1:0/3615946324 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e1694ef780 0x55e1694f1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.658+0000 7fe505360640 1 -- 172.21.15.1:0/3615946324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e1694e9db0 msgr2=0x55e1694ea1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:36.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.658+0000 7fe505360640 1 --2- 172.21.15.1:0/3615946324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e1694e9db0 0x55e1694ea1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.658+0000 7fe505360640 1 -- 172.21.15.1:0/3615946324 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1693f0340 con 0x55e1694ea6f0 2024-09-19T09:43:36.665 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.658+0000 7fe505360640 1 --2- 172.21.15.1:0/3615946324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e1694ea6f0 0x55e1694ef1b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc003a70 tx=0x7fe4fc003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f18b03fff58e30 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:36.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.658+0000 7fe4f67fc640 1 --2- 172.21.15.1:0/3954807200 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe4ec0a3240 0x7fe4ec0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.658+0000 7fe4eb7fe640 1 -- 172.21.15.1:0/3615946324 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc012450 con 0x55e1694ea6f0 2024-09-19T09:43:36.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.658+0000 7fe4eb7fe640 1 -- 172.21.15.1:0/3615946324 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4fc012ad0 con 0x55e1694ea6f0 2024-09-19T09:43:36.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.658+0000 7fe4eb7fe640 1 -- 172.21.15.1:0/3615946324 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc011c80 con 0x55e1694ea6f0 2024-09-19T09:43:36.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.658+0000 7fe505b61640 1 --2- 172.21.15.1:0/3954807200 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe4ec0a3240 0x7fe4ec0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.658+0000 7fe4f67fc640 1 -- 172.21.15.1:0/3954807200 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fe4f00cf340 con 0x7fe500101c50 2024-09-19T09:43:36.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.659+0000 7fe50a43d740 1 -- 172.21.15.1:0/3615946324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e1694ea6f0 msgr2=0x55e1694ef1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:36.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.659+0000 7fe505b61640 1 --2- 172.21.15.1:0/3954807200 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe4ec0a3240 0x7fe4ec0a5700 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8005c40 tx=0x7fe4f80315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:36.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.659+0000 7fe50a43d740 1 --2- 172.21.15.1:0/3615946324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e1694ea6f0 0x55e1694ef1b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc003a70 tx=0x7fe4fc003f30 comp rx=0 tx=0).stop 2024-09-19T09:43:36.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.659+0000 7fe50a43d740 1 -- 172.21.15.1:0/3615946324 shutdown_connections 2024-09-19T09:43:36.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.659+0000 7fe50a43d740 1 --2- 172.21.15.1:0/3615946324 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e1694ef780 0x55e1694f1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.659+0000 7fe50a43d740 1 --2- 172.21.15.1:0/3615946324 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e1694ea6f0 0x55e1694ef1b0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.659+0000 7fe50a43d740 1 --2- 172.21.15.1:0/3615946324 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e1694e9db0 0x55e1694ea1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.666 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.659+0000 7fe50a43d740 1 -- 172.21.15.1:0/3615946324 >> 172.21.15.1:0/3615946324 conn(0x55e1694e1010 msgr2=0x55e1694e1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:36.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.659+0000 7fe50a43d740 1 -- 172.21.15.1:0/3615946324 shutdown_connections 2024-09-19T09:43:36.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.659+0000 7fe50a43d740 1 -- 172.21.15.1:0/3615946324 wait complete. 2024-09-19T09:43:36.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.659+0000 7fe50a43d740 1 -- start start 2024-09-19T09:43:36.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.659+0000 7fe50a43d740 1 Processor -- start 2024-09-19T09:43:36.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.659+0000 7fe50a43d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e1694e9db0 0x55e1694f3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.659+0000 7fe50a43d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e1694ea6f0 0x55e1694f4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.659+0000 7fe50a43d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e1694ef780 0x55e1694fb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.659+0000 7fe50a43d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55e1694f2750 con 0x55e1694e9db0 2024-09-19T09:43:36.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.659+0000 7fe50a43d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e1693d2290 con 0x55e1694ef780 2024-09-19T09:43:36.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.659+0000 7fe50a43d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55e1694f28d0 con 0x55e1694ea6f0 2024-09-19T09:43:36.667 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.660+0000 7fe50a43d740 10 client.0 _ll_register_callbacks cb 0x55e169403140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:43:36.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.660+0000 7fe505360640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e1694e9db0 0x55e1694f3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.668 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.660+0000 7fe505360640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e1694e9db0 0x55e1694f3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50506/0 (socket says 172.21.15.1:50506) 2024-09-19T09:43:36.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.660+0000 7fe505360640 1 -- 172.21.15.1:0/2450543923 learned_addr learned my addr 172.21.15.1:0/2450543923 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:36.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.660+0000 7fe504b5f640 1 --2- 172.21.15.1:0/2450543923 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e1694ea6f0 0x55e1694f4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.660+0000 7fe505b61640 1 --2- 172.21.15.1:0/2450543923 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e1694ef780 0x55e1694fb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.660+0000 7fe505360640 1 -- 172.21.15.1:0/2450543923 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e1694ea6f0 msgr2=0x55e1694f4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:36.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.660+0000 7fe505360640 1 --2- 172.21.15.1:0/2450543923 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e1694ea6f0 0x55e1694f4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.660+0000 7fe505360640 1 -- 172.21.15.1:0/2450543923 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e1694ef780 msgr2=0x55e1694fb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:36.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.660+0000 7fe505360640 1 --2- 172.21.15.1:0/2450543923 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e1694ef780 0x55e1694fb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.660+0000 7fe505360640 1 -- 172.21.15.1:0/2450543923 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e16915c210 con 0x55e1694e9db0 2024-09-19T09:43:36.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.660+0000 7fe505360640 1 --2- 172.21.15.1:0/2450543923 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e1694e9db0 0x55e1694f3fe0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc011610 tx=0x7fe4fc011640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e72f2feffbf686 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:36.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.660+0000 7fe4e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:43:36.669 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.660+0000 7fe4e8ff9640 1 -- 172.21.15.1:0/2450543923 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc004a40 con 0x55e1694e9db0 2024-09-19T09:43:36.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.660+0000 7fe4e8ff9640 1 -- 172.21.15.1:0/2450543923 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fe4fc004be0 con 0x55e1694e9db0 2024-09-19T09:43:36.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.660+0000 7fe50a43d740 1 -- 172.21.15.1:0/2450543923 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4fc012ad0 con 0x55e1694e9db0 2024-09-19T09:43:36.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.661+0000 7fe4e8ff9640 1 -- 172.21.15.1:0/2450543923 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe4fc004de0 con 0x55e1694e9db0 2024-09-19T09:43:36.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.661+0000 7fe50a43d740 10 client.16122 fetch_fsmap learned FSMap version 19 2024-09-19T09:43:36.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.661+0000 7fe50a43d740 1 -- 172.21.15.1:0/2450543923 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e169228620 con 0x55e1694e9db0 2024-09-19T09:43:36.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.661+0000 7fe4e8ff9640 1 -- 172.21.15.1:0/2450543923 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4fc012ad0 con 0x55e1694e9db0 2024-09-19T09:43:36.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.661+0000 7fe4e8ff9640 1 -- 172.21.15.1:0/2450543923 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe4fc00f040 con 0x55e1694e9db0 2024-09-19T09:43:36.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.661+0000 7fe50a43d740 10 client.16122 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:43:36.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.661+0000 7fe50a43d740 10 client.16122 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:43:36.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.661+0000 7fe50a43d740 20 client.16122 populate_metadata read hostname 'smithi001' 2024-09-19T09:43:36.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.661+0000 7fe50a43d740 1 --2- 172.21.15.1:0/2450543923 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55e1694ff9c0 0x55e169501e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.661+0000 7fe50a43d740 4 client.16122 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:43:36.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.661+0000 7fe50a43d740 1 -- 172.21.15.1:0/2450543923 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e169456a20 con 0x55e1694ff9c0 2024-09-19T09:43:36.670 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.661+0000 7fe504b5f640 1 --2- 172.21.15.1:0/2450543923 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55e1694ff9c0 0x55e169501e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.662+0000 7fe4e8ff9640 10 client.16122 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:43:36.671 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.662+0000 7fe504b5f640 1 --2- 172.21.15.1:0/2450543923 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55e1694ff9c0 0x55e169501e30 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da2e0de5a27026c6 server_cookie=569fd6b955165d93 in_seq=0 out_seq=0 2024-09-19T09:43:36.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.663+0000 7fe4e8ff9640 1 -- 172.21.15.1:0/2450543923 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e169456a20 con 0x55e1694ff9c0 2024-09-19T09:43:36.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.663+0000 7fe4e8ff9640 10 client.16122 handle_command_reply: tid=0 2024-09-19T09:43:36.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.663+0000 7fe50a43d740 1 client.16122 shutdown 2024-09-19T09:43:36.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.663+0000 7fe50a43d740 1 -- 172.21.15.1:0/2450543923 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e1694e9db0 msgr2=0x55e1694f3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:36.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.663+0000 7fe50a43d740 1 --2- 172.21.15.1:0/2450543923 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e1694e9db0 0x55e1694f3fe0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc011610 tx=0x7fe4fc011640 comp rx=0 tx=0).stop 2024-09-19T09:43:36.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.663+0000 7fe50a43d740 1 -- 172.21.15.1:0/2450543923 shutdown_connections 2024-09-19T09:43:36.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.663+0000 7fe50a43d740 1 --2- 172.21.15.1:0/2450543923 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55e1694ff9c0 0x55e169501e30 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.672 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.663+0000 7fe50a43d740 1 --2- 172.21.15.1:0/2450543923 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e1694ef780 0x55e1694fb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.663+0000 7fe50a43d740 1 --2- 172.21.15.1:0/2450543923 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e1694ea6f0 0x55e1694f4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.663+0000 7fe50a43d740 1 --2- 172.21.15.1:0/2450543923 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e1694e9db0 0x55e1694f3fe0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.663+0000 7fe4e8ff9640 0 client.16122 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:43:36.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.663+0000 7fe50a43d740 1 -- 172.21.15.1:0/2450543923 >> 172.21.15.1:0/2450543923 conn(0x55e1694e1010 msgr2=0x55e1694e2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:36.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.663+0000 7fe50a43d740 1 -- 172.21.15.1:0/2450543923 shutdown_connections 2024-09-19T09:43:36.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.663+0000 7fe50a43d740 1 -- 172.21.15.1:0/2450543923 wait complete. 2024-09-19T09:43:36.673 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.663+0000 7fe50a43d740 20 client.16122 trim_cache size 0 max 16384 2024-09-19T09:43:36.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.678+0000 7fe50a43d740 1 Processor -- start 2024-09-19T09:43:36.681 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.678+0000 7fe50a43d740 1 -- start start 2024-09-19T09:43:36.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.678+0000 7fe50a43d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e1694e9db0 0x55e1694e13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.678+0000 7fe50a43d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e1694ea6f0 0x55e1694fb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.678+0000 7fe50a43d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e1694ef780 0x55e1694e1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.678+0000 7fe50a43d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e400c460 con 0x55e1694ea6f0 2024-09-19T09:43:36.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.678+0000 7fe50a43d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e400ed00 con 0x55e1694e9db0 2024-09-19T09:43:36.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.678+0000 7fe50a43d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e400caf0 con 0x55e1694ef780 2024-09-19T09:43:36.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.679+0000 7fe504b5f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e1694ea6f0 0x55e1694fb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.679+0000 7fe505360640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e1694e9db0 0x55e1694e13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.679+0000 7fe505360640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e1694e9db0 0x55e1694e13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:36224/0 (socket says 172.21.15.1:36224) 2024-09-19T09:43:36.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.679+0000 7fe504b5f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e1694ea6f0 0x55e1694fb480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50520/0 (socket says 172.21.15.1:50520) 2024-09-19T09:43:36.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.679+0000 7fe505360640 1 -- 172.21.15.1:0/338048005 learned_addr learned my addr 172.21.15.1:0/338048005 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:36.682 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.679+0000 7fe505b61640 1 --2- 172.21.15.1:0/338048005 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e1694ef780 0x55e1694e1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.679+0000 7fe504b5f640 1 -- 172.21.15.1:0/338048005 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e1694ef780 msgr2=0x55e1694e1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:36.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.679+0000 7fe504b5f640 1 --2- 172.21.15.1:0/338048005 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e1694ef780 0x55e1694e1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.679+0000 7fe504b5f640 1 -- 172.21.15.1:0/338048005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e1694e9db0 msgr2=0x55e1694e13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:36.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.679+0000 7fe504b5f640 1 --2- 172.21.15.1:0/338048005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e1694e9db0 0x55e1694e13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.679+0000 7fe504b5f640 1 -- 172.21.15.1:0/338048005 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1694eabd0 con 0x55e1694ea6f0 2024-09-19T09:43:36.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.679+0000 7fe505360640 1 --2- 172.21.15.1:0/338048005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e1694e9db0 0x55e1694e13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:43:36.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.679+0000 7fe504b5f640 1 --2- 172.21.15.1:0/338048005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e1694ea6f0 0x55e1694fb480 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fe4f009b960 tx=0x7fe4f0086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231cbfb6dc6a7591 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:36.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.679+0000 7fe4eaffd640 1 -- 172.21.15.1:0/338048005 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f00a4590 con 0x55e1694ea6f0 2024-09-19T09:43:36.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.679+0000 7fe4eaffd640 1 -- 172.21.15.1:0/338048005 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4f0009b10 con 0x55e1694ea6f0 2024-09-19T09:43:36.683 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.679+0000 7fe4eaffd640 1 -- 172.21.15.1:0/338048005 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0098040 con 0x55e1694ea6f0 2024-09-19T09:43:36.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.680+0000 7fe50a43d740 1 -- 172.21.15.1:0/338048005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e1694ea6f0 msgr2=0x55e1694fb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:36.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.680+0000 7fe50a43d740 1 --2- 172.21.15.1:0/338048005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e1694ea6f0 0x55e1694fb480 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fe4f009b960 tx=0x7fe4f0086040 comp rx=0 tx=0).stop 2024-09-19T09:43:36.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.680+0000 7fe50a43d740 1 -- 172.21.15.1:0/338048005 shutdown_connections 2024-09-19T09:43:36.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.680+0000 7fe50a43d740 1 --2- 172.21.15.1:0/338048005 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e1694ef780 0x55e1694e1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.680+0000 7fe50a43d740 1 --2- 172.21.15.1:0/338048005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e1694ea6f0 0x55e1694fb480 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.685 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.680+0000 7fe50a43d740 1 --2- 172.21.15.1:0/338048005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e1694e9db0 0x55e1694e13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.680+0000 7fe50a43d740 1 -- 172.21.15.1:0/338048005 >> 172.21.15.1:0/338048005 conn(0x55e1694e1010 msgr2=0x55e1694f3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.680+0000 7fe50a43d740 1 -- 172.21.15.1:0/338048005 shutdown_connections 2024-09-19T09:43:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.680+0000 7fe50a43d740 1 -- 172.21.15.1:0/338048005 wait complete. 2024-09-19T09:43:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.681+0000 7fe50a43d740 1 -- start start 2024-09-19T09:43:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.681+0000 7fe50a43d740 1 Processor -- start 2024-09-19T09:43:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.681+0000 7fe50a43d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e1694e9db0 0x55e1694f8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.681+0000 7fe50a43d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e1694ea6f0 0x55e1694f8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.681+0000 7fe50a43d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e1694ef780 0x55e1694f9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.681+0000 7fe50a43d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e400d1c0 con 0x55e1694ef780 2024-09-19T09:43:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.681+0000 7fe50a43d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e400e630 con 0x55e1694ea6f0 2024-09-19T09:43:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.681+0000 7fe50a43d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e400d890 con 0x55e1694e9db0 2024-09-19T09:43:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.681+0000 7fe50a43d740 10 client.0 _ll_register_callbacks cb 0x7fe4f8005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:43:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.681+0000 7fe505b61640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e1694ef780 0x55e1694f9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.681+0000 7fe505b61640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e1694ef780 0x55e1694f9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50522/0 (socket says 172.21.15.1:50522) 2024-09-19T09:43:36.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.681+0000 7fe505b61640 1 -- 172.21.15.1:0/337023282 learned_addr learned my addr 172.21.15.1:0/337023282 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:36.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.681+0000 7fe504b5f640 1 --2- 172.21.15.1:0/337023282 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e1694ea6f0 0x55e1694f8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.681+0000 7fe505360640 1 --2- 172.21.15.1:0/337023282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e1694e9db0 0x55e1694f8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.681+0000 7fe505b61640 1 -- 172.21.15.1:0/337023282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e1694e9db0 msgr2=0x55e1694f8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:36.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.681+0000 7fe505b61640 1 --2- 172.21.15.1:0/337023282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e1694e9db0 0x55e1694f8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.681+0000 7fe505b61640 1 -- 172.21.15.1:0/337023282 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e1694ea6f0 msgr2=0x55e1694f8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:36.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.681+0000 7fe505b61640 1 --2- 172.21.15.1:0/337023282 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e1694ea6f0 0x55e1694f8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:36.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.682+0000 7fe505b61640 1 -- 172.21.15.1:0/337023282 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1694fa490 con 0x55e1694ef780 2024-09-19T09:43:36.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.682+0000 7fe505b61640 1 --2- 172.21.15.1:0/337023282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e1694ef780 0x55e1694f9e80 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe4f80042c0 tx=0x7fe4f8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=756677bb5ee54f5e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:36.687 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.682+0000 7fe4e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:43:36.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.684+0000 7fe4e8ff9640 1 -- 172.21.15.1:0/337023282 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f8035040 con 0x55e1694ef780 2024-09-19T09:43:36.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.684+0000 7fe50a43d740 1 -- 172.21.15.1:0/337023282 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4f0009b10 con 0x55e1694ef780 2024-09-19T09:43:36.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.684+0000 7fe4e8ff9640 1 -- 172.21.15.1:0/337023282 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fe4f8005250 con 0x55e1694ef780 2024-09-19T09:43:36.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.684+0000 7fe4e8ff9640 1 -- 172.21.15.1:0/337023282 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe4f8005450 con 0x55e1694ef780 2024-09-19T09:43:36.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.684+0000 7fe50a43d740 10 client.16128 fetch_fsmap learned FSMap version 19 2024-09-19T09:43:36.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.684+0000 7fe50a43d740 1 -- 172.21.15.1:0/337023282 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55e16956a710 con 0x55e1694ef780 2024-09-19T09:43:36.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.684+0000 7fe4e8ff9640 1 -- 172.21.15.1:0/337023282 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4f0009b10 con 0x55e1694ef780 2024-09-19T09:43:36.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.684+0000 7fe4e8ff9640 1 -- 172.21.15.1:0/337023282 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe4f8003850 con 0x55e1694ef780 2024-09-19T09:43:36.689 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.684+0000 7fe50a43d740 10 client.16128 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:43:36.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.684+0000 7fe50a43d740 10 client.16128 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:43:36.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.684+0000 7fe50a43d740 20 client.16128 populate_metadata read hostname 'smithi001' 2024-09-19T09:43:36.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.684+0000 7fe50a43d740 1 --2- 172.21.15.1:0/337023282 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55e1694ff9c0 0x55e16956cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:36.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.684+0000 7fe50a43d740 4 client.16128 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:43:36.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.684+0000 7fe50a43d740 1 -- 172.21.15.1:0/337023282 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e169450d70 con 0x55e1694ff9c0 2024-09-19T09:43:36.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.685+0000 7fe505360640 1 --2- 172.21.15.1:0/337023282 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55e1694ff9c0 0x55e16956cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:36.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.685+0000 7fe505360640 1 --2- 172.21.15.1:0/337023282 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55e1694ff9c0 0x55e16956cff0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=939aa18e4b6101a4 server_cookie=233fad7a462e3ab8 in_seq=0 out_seq=0 2024-09-19T09:43:36.690 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:36.685+0000 7fe4e8ff9640 10 client.16128 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:43:37.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:37 smithi022 ceph-mon[35583]: pgmap v504: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 72 MiB/s wr, 10.54k op/s 2024-09-19T09:43:37.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:37 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:43:37.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:37 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:43:37.865 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:37 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:43:37.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:37 smithi121 ceph-mon[35577]: pgmap v504: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 72 MiB/s wr, 10.54k op/s 2024-09-19T09:43:37.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:37 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:43:37.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:37 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:43:37.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:37 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:43:37.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:37 smithi001 ceph-mon[31225]: pgmap v504: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 72 MiB/s wr, 10.54k op/s 2024-09-19T09:43:37.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:37 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:43:37.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:37 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:43:37.999 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:37 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:43:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:39.052+0000 7fe4e8ff9640 1 -- 172.21.15.1:0/337023282 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e169450d70 con 0x55e1694ff9c0 2024-09-19T09:43:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:39.052+0000 7fe4e8ff9640 10 client.16128 handle_command_reply: tid=0 2024-09-19T09:43:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:39.053+0000 7fe50a43d740 1 client.16128 shutdown 2024-09-19T09:43:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:39.053+0000 7fe50a43d740 1 -- 172.21.15.1:0/337023282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e1694ef780 msgr2=0x55e1694f9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:39.053+0000 7fe50a43d740 1 --2- 172.21.15.1:0/337023282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e1694ef780 0x55e1694f9e80 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe4f80042c0 tx=0x7fe4f8009260 comp rx=0 tx=0).stop 2024-09-19T09:43:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:39.053+0000 7fe50a43d740 1 -- 172.21.15.1:0/337023282 shutdown_connections 2024-09-19T09:43:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:39.053+0000 7fe50a43d740 1 --2- 172.21.15.1:0/337023282 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55e1694ff9c0 0x55e16956cff0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:39.053+0000 7fe50a43d740 1 --2- 172.21.15.1:0/337023282 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55e1694ef780 0x55e1694f9e80 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:39.053+0000 7fe50a43d740 1 --2- 172.21.15.1:0/337023282 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e1694ea6f0 0x55e1694f8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:39.053+0000 7fe4e8ff9640 0 client.16128 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:43:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:39.053+0000 7fe50a43d740 1 --2- 172.21.15.1:0/337023282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e1694e9db0 0x55e1694f8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:39.053+0000 7fe50a43d740 1 -- 172.21.15.1:0/337023282 >> 172.21.15.1:0/337023282 conn(0x55e1694e1010 msgr2=0x55e1694df9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:39.053+0000 7fe50a43d740 1 -- 172.21.15.1:0/337023282 shutdown_connections 2024-09-19T09:43:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:39.053+0000 7fe50a43d740 1 -- 172.21.15.1:0/337023282 wait complete. 2024-09-19T09:43:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:39.054+0000 7fe50a43d740 20 client.16128 trim_cache size 0 max 16384 2024-09-19T09:43:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:43:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:43:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:43:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:43:39.058 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:39.054+0000 7fe5075c4640 1 -- 172.21.15.1:0/3954807200 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe4ec0a3240 msgr2=0x7fe4ec0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:39.058 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:39.055+0000 7fe5075c4640 1 --2- 172.21.15.1:0/3954807200 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe4ec0a3240 0x7fe4ec0a5700 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8005c40 tx=0x7fe4f80315b0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.058 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:39.055+0000 7fe5075c4640 1 -- 172.21.15.1:0/3954807200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe500101c50 msgr2=0x7fe500198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:39.058 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:39.055+0000 7fe5075c4640 1 --2- 172.21.15.1:0/3954807200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe500101c50 0x7fe500198380 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe4f000d6d0 tx=0x7fe4f000db90 comp rx=0 tx=0).stop 2024-09-19T09:43:39.058 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:39.055+0000 7fe5075c4640 1 -- 172.21.15.1:0/3954807200 shutdown_connections 2024-09-19T09:43:39.058 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:39.055+0000 7fe5075c4640 1 --2- 172.21.15.1:0/3954807200 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe500102610 0x7fe50019f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.058 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:39.055+0000 7fe5075c4640 1 --2- 172.21.15.1:0/3954807200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe500101c50 0x7fe500198380 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.058 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:39.055+0000 7fe5075c4640 1 --2- 172.21.15.1:0/3954807200 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe4ec0a3240 0x7fe4ec0a5700 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.058 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:39.055+0000 7fe5075c4640 1 --2- 172.21.15.1:0/3954807200 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe500100a60 0x7fe500197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.058 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:39.055+0000 7fe5075c4640 1 -- 172.21.15.1:0/3954807200 >> 172.21.15.1:0/3954807200 conn(0x7fe5000fc1c0 msgr2=0x7fe5000fdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:39.058 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:39.055+0000 7fe5075c4640 1 -- 172.21.15.1:0/3954807200 shutdown_connections 2024-09-19T09:43:39.058 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:39.056+0000 7fe5075c4640 1 -- 172.21.15.1:0/3954807200 wait complete. 2024-09-19T09:43:39.513 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:43:39.513 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":19,"btime":"2024-09-19T09:36:24:006349+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:36:23.723388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6839/3279971690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3279971690},{"type":"v1","addr":"172.21.15.121:6839","nonce":3279971690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:43:39.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.273+0000 7f404f235640 1 -- 172.21.15.1:0/1586773318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4048103660 msgr2=0x7f404810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:39.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.273+0000 7f404f235640 1 --2- 172.21.15.1:0/1586773318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4048103660 0x7f404810bb50 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f4034009900 tx=0x7f403402a480 comp rx=0 tx=0).stop 2024-09-19T09:43:39.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.273+0000 7f404f235640 1 -- 172.21.15.1:0/1586773318 shutdown_connections 2024-09-19T09:43:39.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.273+0000 7f404f235640 1 --2- 172.21.15.1:0/1586773318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f404810c170 0x7f404810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.273+0000 7f404f235640 1 --2- 172.21.15.1:0/1586773318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4048103660 0x7f404810bb50 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.273+0000 7f404f235640 1 --2- 172.21.15.1:0/1586773318 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4048102d40 0x7f4048103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.273+0000 7f404f235640 1 -- 172.21.15.1:0/1586773318 >> 172.21.15.1:0/1586773318 conn(0x7f40480fc7a0 msgr2=0x7f40480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:39.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.273+0000 7f404f235640 1 -- 172.21.15.1:0/1586773318 shutdown_connections 2024-09-19T09:43:39.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.273+0000 7f404f235640 1 -- 172.21.15.1:0/1586773318 wait complete. 2024-09-19T09:43:39.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.273+0000 7f404f235640 1 Processor -- start 2024-09-19T09:43:39.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.273+0000 7f404f235640 1 -- start start 2024-09-19T09:43:39.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.273+0000 7f404f235640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4048102d40 0x7f4048198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:39.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.273+0000 7f404f235640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4048103660 0x7f40481989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:39.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.273+0000 7f404f235640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f404810c170 0x7f404819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:39.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.273+0000 7f404f235640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4048111f70 con 0x7f4048103660 2024-09-19T09:43:39.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.273+0000 7f404f235640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4048111df0 con 0x7f4048102d40 2024-09-19T09:43:39.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.273+0000 7f404f235640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f40481120f0 con 0x7f404810c170 2024-09-19T09:43:39.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.274+0000 7f4047fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4048103660 0x7f40481989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:39.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.274+0000 7f4047fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4048103660 0x7f40481989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50536/0 (socket says 172.21.15.1:50536) 2024-09-19T09:43:39.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.274+0000 7f4047fff640 1 -- 172.21.15.1:0/1426444509 learned_addr learned my addr 172.21.15.1:0/1426444509 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:39.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.274+0000 7f404cfd1640 1 --2- 172.21.15.1:0/1426444509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4048102d40 0x7f4048198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:39.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.274+0000 7f4047fff640 1 -- 172.21.15.1:0/1426444509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f404810c170 msgr2=0x7f404819cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:39.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.274+0000 7f4047fff640 1 --2- 172.21.15.1:0/1426444509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f404810c170 0x7f404819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.274+0000 7f4047fff640 1 -- 172.21.15.1:0/1426444509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4048102d40 msgr2=0x7f4048198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:39.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.274+0000 7f4047fff640 1 --2- 172.21.15.1:0/1426444509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4048102d40 0x7f4048198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.274+0000 7f4047fff640 1 -- 172.21.15.1:0/1426444509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f404819d420 con 0x7f4048103660 2024-09-19T09:43:39.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.274+0000 7f4047fff640 1 --2- 172.21.15.1:0/1426444509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4048103660 0x7f40481989b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4034006010 tx=0x7f40340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:39.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.274+0000 7f4045ffb640 1 -- 172.21.15.1:0/1426444509 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f403403f030 con 0x7f4048103660 2024-09-19T09:43:39.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.274+0000 7f4045ffb640 1 -- 172.21.15.1:0/1426444509 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4034003ce0 con 0x7f4048103660 2024-09-19T09:43:39.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.274+0000 7f404f235640 1 -- 172.21.15.1:0/1426444509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f404819d6b0 con 0x7f4048103660 2024-09-19T09:43:39.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.274+0000 7f4045ffb640 1 -- 172.21.15.1:0/1426444509 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4034035070 con 0x7f4048103660 2024-09-19T09:43:39.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.274+0000 7f404f235640 1 -- 172.21.15.1:0/1426444509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40481a4ff0 con 0x7f4048103660 2024-09-19T09:43:39.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.275+0000 7f404f235640 1 -- 172.21.15.1:0/1426444509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4048103120 con 0x7f4048103660 2024-09-19T09:43:39.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.276+0000 7f4045ffb640 1 -- 172.21.15.1:0/1426444509 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f4034042030 con 0x7f4048103660 2024-09-19T09:43:39.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.277+0000 7f4045ffb640 1 --2- 172.21.15.1:0/1426444509 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f40380a32c0 0x7f40380a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:39.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.277+0000 7f4045ffb640 1 -- 172.21.15.1:0/1426444509 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f40340efe70 con 0x7f4048103660 2024-09-19T09:43:39.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.277+0000 7f404cfd1640 1 --2- 172.21.15.1:0/1426444509 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f40380a32c0 0x7f40380a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:39.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.278+0000 7f404cfd1640 1 --2- 172.21.15.1:0/1426444509 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f40380a32c0 0x7f40380a5780 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f403c005fd0 tx=0x7f403c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:39.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.282+0000 7f4045ffb640 1 -- 172.21.15.1:0/1426444509 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f40340bcc50 con 0x7f4048103660 2024-09-19T09:43:39.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.615+0000 7f404f235640 1 -- 172.21.15.1:0/1426444509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4048106c50 con 0x7f4048103660 2024-09-19T09:43:39.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.615+0000 7f4045ffb640 1 -- 172.21.15.1:0/1426444509 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11837 (secure 0 0 0) 0x7f40340bc550 con 0x7f4048103660 2024-09-19T09:43:39.517 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 19 2024-09-19T09:43:39.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.617+0000 7f404f235640 1 -- 172.21.15.1:0/1426444509 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f40380a32c0 msgr2=0x7f40380a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:39.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.617+0000 7f404f235640 1 --2- 172.21.15.1:0/1426444509 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f40380a32c0 0x7f40380a5780 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f403c005fd0 tx=0x7f403c00b390 comp rx=0 tx=0).stop 2024-09-19T09:43:39.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.617+0000 7f404f235640 1 -- 172.21.15.1:0/1426444509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4048103660 msgr2=0x7f40481989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:39.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.617+0000 7f404f235640 1 --2- 172.21.15.1:0/1426444509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4048103660 0x7f40481989b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4034006010 tx=0x7f40340042f0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.617+0000 7f404f235640 1 -- 172.21.15.1:0/1426444509 shutdown_connections 2024-09-19T09:43:39.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.617+0000 7f404f235640 1 --2- 172.21.15.1:0/1426444509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f404810c170 0x7f404819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.617+0000 7f404f235640 1 --2- 172.21.15.1:0/1426444509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4048103660 0x7f40481989b0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.617+0000 7f404f235640 1 --2- 172.21.15.1:0/1426444509 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f40380a32c0 0x7f40380a5780 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.617+0000 7f404f235640 1 --2- 172.21.15.1:0/1426444509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4048102d40 0x7f4048198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:39.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.617+0000 7f404f235640 1 -- 172.21.15.1:0/1426444509 >> 172.21.15.1:0/1426444509 conn(0x7f40480fc7a0 msgr2=0x7f40480fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:39.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.617+0000 7f404f235640 1 -- 172.21.15.1:0/1426444509 shutdown_connections 2024-09-19T09:43:39.518 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:38.617+0000 7f404f235640 1 -- 172.21.15.1:0/1426444509 wait complete. 2024-09-19T09:43:39.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:39 smithi022 ceph-mon[35583]: pgmap v505: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 81 MiB/s wr, 12.39k op/s 2024-09-19T09:43:39.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:39 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1426444509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:43:39.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:39 smithi121 ceph-mon[35577]: pgmap v505: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 81 MiB/s wr, 12.39k op/s 2024-09-19T09:43:39.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:39 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1426444509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:43:39.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:39 smithi001 ceph-mon[31225]: pgmap v505: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 81 MiB/s wr, 12.39k op/s 2024-09-19T09:43:39.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:39 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1426444509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:43:41.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:41 smithi022 ceph-mon[35583]: pgmap v506: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 65 MiB/s wr, 10.21k op/s 2024-09-19T09:43:41.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:41 smithi121 ceph-mon[35577]: pgmap v506: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 65 MiB/s wr, 10.21k op/s 2024-09-19T09:43:41.997 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:41 smithi001 ceph-mon[31225]: pgmap v506: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 65 MiB/s wr, 10.21k op/s 2024-09-19T09:43:43.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:43 smithi022 ceph-mon[35583]: pgmap v507: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 73 MiB/s wr, 11.57k op/s 2024-09-19T09:43:43.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:43 smithi121 ceph-mon[35577]: pgmap v507: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 73 MiB/s wr, 11.57k op/s 2024-09-19T09:43:43.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:43 smithi001 ceph-mon[31225]: pgmap v507: 97 pgs: 97 active+clean; 13 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 73 MiB/s wr, 11.57k op/s 2024-09-19T09:43:45.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:45 smithi022 ceph-mon[35583]: pgmap v508: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 71 MiB/s wr, 11.53k op/s 2024-09-19T09:43:45.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:45 smithi121 ceph-mon[35577]: pgmap v508: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 71 MiB/s wr, 11.53k op/s 2024-09-19T09:43:45.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:45 smithi001 ceph-mon[31225]: pgmap v508: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 71 MiB/s wr, 11.53k op/s 2024-09-19T09:43:47.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:47 smithi022 ceph-mon[35583]: pgmap v509: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 67 MiB/s wr, 10.99k op/s 2024-09-19T09:43:47.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:47 smithi121 ceph-mon[35577]: pgmap v509: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 67 MiB/s wr, 10.99k op/s 2024-09-19T09:43:47.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:47 smithi001 ceph-mon[31225]: pgmap v509: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 67 MiB/s wr, 10.99k op/s 2024-09-19T09:43:49.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:49 smithi022 ceph-mon[35583]: pgmap v510: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 72 MiB/s wr, 12.32k op/s 2024-09-19T09:43:49.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:49 smithi121 ceph-mon[35577]: pgmap v510: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 72 MiB/s wr, 12.32k op/s 2024-09-19T09:43:49.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:49 smithi001 ceph-mon[31225]: pgmap v510: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 72 MiB/s wr, 12.32k op/s 2024-09-19T09:43:50.674 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0' 2024-09-19T09:43:50.674 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0 2024-09-19T09:43:50.735 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:43:51.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:51 smithi022 ceph-mon[35583]: pgmap v511: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 57 MiB/s wr, 10.01k op/s 2024-09-19T09:43:51.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:51 smithi121 ceph-mon[35577]: pgmap v511: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 57 MiB/s wr, 10.01k op/s 2024-09-19T09:43:51.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:51 smithi001 ceph-mon[31225]: pgmap v511: 97 pgs: 97 active+clean; 13 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 57 MiB/s wr, 10.01k op/s 2024-09-19T09:43:52.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.216+0000 7f42ca053640 1 -- 172.21.15.1:0/1450679144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42c41025f0 msgr2=0x7f42c4108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:52.219 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.216+0000 7f42ca053640 1 --2- 172.21.15.1:0/1450679144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42c41025f0 0x7f42c4108e80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f42bc009be0 tx=0x7f42bc02a6c0 comp rx=0 tx=0).stop 2024-09-19T09:43:52.220 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.216+0000 7f42c27fc640 1 -- 172.21.15.1:0/1450679144 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42bc030e30 con 0x7f42c41025f0 2024-09-19T09:43:52.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.218+0000 7f42ca053640 1 -- 172.21.15.1:0/1450679144 shutdown_connections 2024-09-19T09:43:52.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.218+0000 7f42ca053640 1 --2- 172.21.15.1:0/1450679144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42c41025f0 0x7f42c4108e80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:52.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.218+0000 7f42ca053640 1 --2- 172.21.15.1:0/1450679144 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42c4101c30 0x7f42c41020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:52.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.218+0000 7f42ca053640 1 --2- 172.21.15.1:0/1450679144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42c4100a40 0x7f42c4100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:52.221 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.218+0000 7f42ca053640 1 -- 172.21.15.1:0/1450679144 >> 172.21.15.1:0/1450679144 conn(0x7f42c40fc1c0 msgr2=0x7f42c40fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:52.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.221+0000 7f42ca053640 1 -- 172.21.15.1:0/1450679144 shutdown_connections 2024-09-19T09:43:52.224 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.222+0000 7f42ca053640 1 -- 172.21.15.1:0/1450679144 wait complete. 2024-09-19T09:43:52.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.222+0000 7f42ca053640 1 Processor -- start 2024-09-19T09:43:52.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.222+0000 7f42ca053640 1 -- start start 2024-09-19T09:43:52.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.222+0000 7f42ca053640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42c4100a40 0x7f42c4070a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:52.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.223+0000 7f42ca053640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42c4101c30 0x7f42c4070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:52.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.223+0000 7f42ca053640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42c41025f0 0x7f42c41a5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:52.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.223+0000 7f42ca053640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f42c406c200 con 0x7f42c41025f0 2024-09-19T09:43:52.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.223+0000 7f42ca053640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f42c406c080 con 0x7f42c4101c30 2024-09-19T09:43:52.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.223+0000 7f42ca053640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f42c406c380 con 0x7f42c4100a40 2024-09-19T09:43:52.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.223+0000 7f42c37fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42c4100a40 0x7f42c4070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:52.226 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.223+0000 7f42c3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42c41025f0 0x7f42c41a5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:52.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.223+0000 7f42c37fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42c4100a40 0x7f42c4070a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:49346/0 (socket says 172.21.15.1:49346) 2024-09-19T09:43:52.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.223+0000 7f42c2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42c4101c30 0x7f42c4070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:52.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.223+0000 7f42c37fe640 1 -- 172.21.15.1:0/1582521595 learned_addr learned my addr 172.21.15.1:0/1582521595 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:52.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.223+0000 7f42c37fe640 1 -- 172.21.15.1:0/1582521595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42c4101c30 msgr2=0x7f42c4070fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:52.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.223+0000 7f42c37fe640 1 --2- 172.21.15.1:0/1582521595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42c4101c30 0x7f42c4070fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:52.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.223+0000 7f42c37fe640 1 -- 172.21.15.1:0/1582521595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42c41025f0 msgr2=0x7f42c41a5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:52.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.223+0000 7f42c37fe640 1 --2- 172.21.15.1:0/1582521595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42c41025f0 0x7f42c41a5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:52.227 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.223+0000 7f42c37fe640 1 -- 172.21.15.1:0/1582521595 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c4074130 con 0x7f42c4100a40 2024-09-19T09:43:52.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.223+0000 7f42c37fe640 1 --2- 172.21.15.1:0/1582521595 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42c4100a40 0x7f42c4070a70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f42b400e9f0 tx=0x7f42b400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:52.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.224+0000 7f42c0ff9640 1 -- 172.21.15.1:0/1582521595 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b400cc40 con 0x7f42c4100a40 2024-09-19T09:43:52.228 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.224+0000 7f42ca053640 1 -- 172.21.15.1:0/1582521595 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42c41aa810 con 0x7f42c4100a40 2024-09-19T09:43:52.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.224+0000 7f42c0ff9640 1 -- 172.21.15.1:0/1582521595 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42b400cde0 con 0x7f42c4100a40 2024-09-19T09:43:52.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.224+0000 7f42c0ff9640 1 -- 172.21.15.1:0/1582521595 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b4010430 con 0x7f42c4100a40 2024-09-19T09:43:52.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.224+0000 7f42ca053640 1 -- 172.21.15.1:0/1582521595 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42c41aade0 con 0x7f42c4100a40 2024-09-19T09:43:52.229 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.226+0000 7f42c0ff9640 1 -- 172.21.15.1:0/1582521595 <== mon.1 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f42b4003f20 con 0x7f42c4100a40 2024-09-19T09:43:52.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.226+0000 7f42ccdec740 1 Processor -- start 2024-09-19T09:43:52.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.226+0000 7f42ccdec740 1 -- start start 2024-09-19T09:43:52.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.226+0000 7f42ccdec740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625a4f6a9a0 0x5625a4f6ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:52.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.226+0000 7f42ccdec740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5625a4f6b2e0 0x5625a4f6fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:52.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.226+0000 7f42ccdec740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625a4f70370 0x5625a4f72830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:52.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.226+0000 7f42ccdec740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5625a4ece2f0 con 0x5625a4f6a9a0 2024-09-19T09:43:52.235 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.226+0000 7f42ccdec740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5625a4e76270 con 0x5625a4f6b2e0 2024-09-19T09:43:52.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.226+0000 7f42ccdec740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5625a4eca2b0 con 0x5625a4f70370 2024-09-19T09:43:52.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.227+0000 7f42c3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625a4f6a9a0 0x5625a4f6ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:52.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.227+0000 7f42c2ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625a4f70370 0x5625a4f72830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:52.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.227+0000 7f42c2ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625a4f70370 0x5625a4f72830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:49358/0 (socket says 172.21.15.1:49358) 2024-09-19T09:43:52.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.227+0000 7f42c2ffd640 1 -- 172.21.15.1:0/4113918087 learned_addr learned my addr 172.21.15.1:0/4113918087 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:52.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.227+0000 7f42c37fe640 1 --2- 172.21.15.1:0/4113918087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5625a4f6b2e0 0x5625a4f6fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:52.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.227+0000 7f42c0ff9640 1 --2- 172.21.15.1:0/1582521595 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f42ac0a3300 0x7f42ac0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:52.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.227+0000 7f42c2ffd640 1 -- 172.21.15.1:0/4113918087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5625a4f6b2e0 msgr2=0x5625a4f6fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:52.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.227+0000 7f42c2ffd640 1 --2- 172.21.15.1:0/4113918087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5625a4f6b2e0 0x5625a4f6fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:52.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.227+0000 7f42c2ffd640 1 -- 172.21.15.1:0/4113918087 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625a4f6a9a0 msgr2=0x5625a4f6ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:52.236 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.227+0000 7f42c2ffd640 1 --2- 172.21.15.1:0/4113918087 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625a4f6a9a0 0x5625a4f6ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:52.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.227+0000 7f42c2ffd640 1 -- 172.21.15.1:0/4113918087 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625a4e75340 con 0x5625a4f70370 2024-09-19T09:43:52.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.227+0000 7f42c0ff9640 1 -- 172.21.15.1:0/1582521595 <== mon.1 v2:172.21.15.121:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f42b40cfb00 con 0x7f42c4100a40 2024-09-19T09:43:52.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.227+0000 7f42c3fff640 1 --2- 172.21.15.1:0/1582521595 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f42ac0a3300 0x7f42ac0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:52.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.227+0000 7f42c2ffd640 1 --2- 172.21.15.1:0/4113918087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625a4f70370 0x5625a4f72830 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f42b8009a40 tx=0x7f42b8009f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f05f204f290b8c88 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:52.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.227+0000 7f42a9ffb640 1 -- 172.21.15.1:0/4113918087 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b8017070 con 0x5625a4f70370 2024-09-19T09:43:52.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.227+0000 7f42a9ffb640 1 -- 172.21.15.1:0/4113918087 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42b8013470 con 0x5625a4f70370 2024-09-19T09:43:52.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.227+0000 7f42a9ffb640 1 -- 172.21.15.1:0/4113918087 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b8012630 con 0x5625a4f70370 2024-09-19T09:43:52.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.228+0000 7f42ccdec740 1 -- 172.21.15.1:0/4113918087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625a4f70370 msgr2=0x5625a4f72830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:52.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.228+0000 7f42ccdec740 1 --2- 172.21.15.1:0/4113918087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625a4f70370 0x5625a4f72830 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f42b8009a40 tx=0x7f42b8009f00 comp rx=0 tx=0).stop 2024-09-19T09:43:52.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.228+0000 7f42c3fff640 1 --2- 172.21.15.1:0/1582521595 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f42ac0a3300 0x7f42ac0a57c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f42bc006010 tx=0x7f42bc009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:52.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.228+0000 7f42ccdec740 1 -- 172.21.15.1:0/4113918087 shutdown_connections 2024-09-19T09:43:52.237 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.228+0000 7f42ccdec740 1 --2- 172.21.15.1:0/4113918087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625a4f70370 0x5625a4f72830 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.228+0000 7f42ccdec740 1 --2- 172.21.15.1:0/4113918087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5625a4f6b2e0 0x5625a4f6fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.228+0000 7f42ccdec740 1 --2- 172.21.15.1:0/4113918087 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625a4f6a9a0 0x5625a4f6ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.228+0000 7f42ccdec740 1 -- 172.21.15.1:0/4113918087 >> 172.21.15.1:0/4113918087 conn(0x5625a4f66010 msgr2=0x5625a4f66410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.228+0000 7f42ccdec740 1 -- 172.21.15.1:0/4113918087 shutdown_connections 2024-09-19T09:43:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.228+0000 7f42ccdec740 1 -- 172.21.15.1:0/4113918087 wait complete. 2024-09-19T09:43:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.228+0000 7f42ccdec740 1 -- start start 2024-09-19T09:43:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.228+0000 7f42ccdec740 1 Processor -- start 2024-09-19T09:43:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.229+0000 7f42ccdec740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5625a4f6a9a0 0x5625a4f74b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.229+0000 7f42ccdec740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625a4f6b2e0 0x5625a4f75070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.229+0000 7f42ccdec740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625a4f70370 0x5625a4f7c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.229+0000 7f42ccdec740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5625a4f73340 con 0x5625a4f6b2e0 2024-09-19T09:43:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.229+0000 7f42ccdec740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5625a4e57290 con 0x5625a4f6a9a0 2024-09-19T09:43:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.229+0000 7f42ccdec740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5625a4f734c0 con 0x5625a4f70370 2024-09-19T09:43:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.229+0000 7f42ccdec740 10 client.0 _ll_register_callbacks cb 0x5625a4e88140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:43:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.229+0000 7f42c2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625a4f6b2e0 0x5625a4f75070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.229+0000 7f42c2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625a4f6b2e0 0x5625a4f75070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52522/0 (socket says 172.21.15.1:52522) 2024-09-19T09:43:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.229+0000 7f42c2ffd640 1 -- 172.21.15.1:0/3412756208 learned_addr learned my addr 172.21.15.1:0/3412756208 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.229+0000 7f42c37fe640 1 --2- 172.21.15.1:0/3412756208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5625a4f6a9a0 0x5625a4f74b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.229+0000 7f42c3fff640 1 --2- 172.21.15.1:0/3412756208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625a4f70370 0x5625a4f7c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.229+0000 7f42c2ffd640 1 -- 172.21.15.1:0/3412756208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625a4f70370 msgr2=0x5625a4f7c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.229+0000 7f42c2ffd640 1 --2- 172.21.15.1:0/3412756208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625a4f70370 0x5625a4f7c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.229+0000 7f42c2ffd640 1 -- 172.21.15.1:0/3412756208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5625a4f6a9a0 msgr2=0x5625a4f74b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.229+0000 7f42c2ffd640 1 --2- 172.21.15.1:0/3412756208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5625a4f6a9a0 0x5625a4f74b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.229+0000 7f42c2ffd640 1 -- 172.21.15.1:0/3412756208 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625a4be1210 con 0x5625a4f6b2e0 2024-09-19T09:43:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.229+0000 7f42c37fe640 1 --2- 172.21.15.1:0/3412756208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5625a4f6a9a0 0x5625a4f74b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:43:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.229+0000 7f42c3fff640 1 --2- 172.21.15.1:0/3412756208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625a4f70370 0x5625a4f7c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:43:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.229+0000 7f42c2ffd640 1 --2- 172.21.15.1:0/3412756208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625a4f6b2e0 0x5625a4f75070 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f42b8004700 tx=0x7f42b8013cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c075e55ff6778202 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.229+0000 7f42a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:43:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.229+0000 7f42a2ffd640 1 -- 172.21.15.1:0/3412756208 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b8017050 con 0x5625a4f6b2e0 2024-09-19T09:43:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.230+0000 7f42a2ffd640 1 -- 172.21.15.1:0/3412756208 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f42b801c450 con 0x5625a4f6b2e0 2024-09-19T09:43:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.230+0000 7f42ccdec740 1 -- 172.21.15.1:0/3412756208 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42b8013470 con 0x5625a4f6b2e0 2024-09-19T09:43:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.230+0000 7f42a2ffd640 1 -- 172.21.15.1:0/3412756208 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f42b801c670 con 0x5625a4f6b2e0 2024-09-19T09:43:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.230+0000 7f42ccdec740 10 client.16143 fetch_fsmap learned FSMap version 19 2024-09-19T09:43:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.230+0000 7f42ccdec740 1 -- 172.21.15.1:0/3412756208 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5625a4cad620 con 0x5625a4f6b2e0 2024-09-19T09:43:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.230+0000 7f42a2ffd640 1 -- 172.21.15.1:0/3412756208 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42b8013470 con 0x5625a4f6b2e0 2024-09-19T09:43:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.230+0000 7f42a2ffd640 1 -- 172.21.15.1:0/3412756208 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f42b8030980 con 0x5625a4f6b2e0 2024-09-19T09:43:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.230+0000 7f42ccdec740 10 client.16143 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:43:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.230+0000 7f42ccdec740 10 client.16143 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:43:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.230+0000 7f42ccdec740 20 client.16143 populate_metadata read hostname 'smithi001' 2024-09-19T09:43:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.230+0000 7f42ccdec740 1 --2- 172.21.15.1:0/3412756208 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5625a4f80470 0x5625a4f82860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.230+0000 7f42ccdec740 4 client.16143 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:43:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.230+0000 7f42ccdec740 1 -- 172.21.15.1:0/3412756208 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625a4edba20 con 0x5625a4f80470 2024-09-19T09:43:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.230+0000 7f42c37fe640 1 --2- 172.21.15.1:0/3412756208 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5625a4f80470 0x5625a4f82860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.231+0000 7f42a2ffd640 10 client.16143 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:43:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.231+0000 7f42c37fe640 1 --2- 172.21.15.1:0/3412756208 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5625a4f80470 0x5625a4f82860 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5dde2957d18b70b server_cookie=671807ff990bc059 in_seq=0 out_seq=0 2024-09-19T09:43:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.231+0000 7f42a2ffd640 1 -- 172.21.15.1:0/3412756208 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5625a4edba20 con 0x5625a4f80470 2024-09-19T09:43:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.231+0000 7f42a2ffd640 10 client.16143 handle_command_reply: tid=0 2024-09-19T09:43:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.231+0000 7f42ccdec740 1 client.16143 shutdown 2024-09-19T09:43:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.231+0000 7f42ccdec740 1 -- 172.21.15.1:0/3412756208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625a4f6b2e0 msgr2=0x5625a4f75070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.231+0000 7f42ccdec740 1 --2- 172.21.15.1:0/3412756208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625a4f6b2e0 0x5625a4f75070 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f42b8004700 tx=0x7f42b8013cc0 comp rx=0 tx=0).stop 2024-09-19T09:43:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.231+0000 7f42ccdec740 1 -- 172.21.15.1:0/3412756208 shutdown_connections 2024-09-19T09:43:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.231+0000 7f42ccdec740 1 --2- 172.21.15.1:0/3412756208 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5625a4f80470 0x5625a4f82860 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.231+0000 7f42ccdec740 1 --2- 172.21.15.1:0/3412756208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625a4f70370 0x5625a4f7c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.231+0000 7f42ccdec740 1 --2- 172.21.15.1:0/3412756208 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625a4f6b2e0 0x5625a4f75070 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.231+0000 7f42ccdec740 1 --2- 172.21.15.1:0/3412756208 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5625a4f6a9a0 0x5625a4f74b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.231+0000 7f42ccdec740 1 -- 172.21.15.1:0/3412756208 >> 172.21.15.1:0/3412756208 conn(0x5625a4f66010 msgr2=0x5625a4f67820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.231+0000 7f42a2ffd640 0 client.16143 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:43:52.242 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.232+0000 7f42ccdec740 1 -- 172.21.15.1:0/3412756208 shutdown_connections 2024-09-19T09:43:52.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.232+0000 7f42ccdec740 1 -- 172.21.15.1:0/3412756208 wait complete. 2024-09-19T09:43:52.243 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.232+0000 7f42ccdec740 20 client.16143 trim_cache size 0 max 16384 2024-09-19T09:43:52.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.246+0000 7f42ccdec740 1 Processor -- start 2024-09-19T09:43:52.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.246+0000 7f42ccdec740 1 -- start start 2024-09-19T09:43:52.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.246+0000 7f42ccdec740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625a4f6a9a0 0x5625a4f650b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:52.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.246+0000 7f42ccdec740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5625a4f6b2e0 0x5625a4f7c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:52.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.246+0000 7f42ccdec740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625a4f70370 0x5625a4f67400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:52.253 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.246+0000 7f42ccdec740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f42c41b1be0 con 0x5625a4f70370 2024-09-19T09:43:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.246+0000 7f42ccdec740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f42c41b4480 con 0x5625a4f6b2e0 2024-09-19T09:43:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.246+0000 7f42ccdec740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f42c41b2270 con 0x5625a4f6a9a0 2024-09-19T09:43:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.246+0000 7f42c3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625a4f70370 0x5625a4f67400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.246+0000 7f42c3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625a4f70370 0x5625a4f67400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52530/0 (socket says 172.21.15.1:52530) 2024-09-19T09:43:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.246+0000 7f42c3fff640 1 -- 172.21.15.1:0/159122650 learned_addr learned my addr 172.21.15.1:0/159122650 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.246+0000 7f42c37fe640 1 --2- 172.21.15.1:0/159122650 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625a4f6a9a0 0x5625a4f650b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.246+0000 7f42c2ffd640 1 --2- 172.21.15.1:0/159122650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5625a4f6b2e0 0x5625a4f7c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.246+0000 7f42c3fff640 1 -- 172.21.15.1:0/159122650 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625a4f6a9a0 msgr2=0x5625a4f650b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.246+0000 7f42c3fff640 1 --2- 172.21.15.1:0/159122650 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625a4f6a9a0 0x5625a4f650b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.247+0000 7f42c3fff640 1 -- 172.21.15.1:0/159122650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5625a4f6b2e0 msgr2=0x5625a4f7c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:52.254 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.247+0000 7f42c3fff640 1 --2- 172.21.15.1:0/159122650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5625a4f6b2e0 0x5625a4f7c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:52.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.247+0000 7f42c3fff640 1 -- 172.21.15.1:0/159122650 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625a4f72ba0 con 0x5625a4f70370 2024-09-19T09:43:52.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.247+0000 7f42c2ffd640 1 --2- 172.21.15.1:0/159122650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5625a4f6b2e0 0x5625a4f7c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:43:52.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.247+0000 7f42c3fff640 1 --2- 172.21.15.1:0/159122650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625a4f70370 0x5625a4f67400 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f42bc033000 tx=0x7f42bc03f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f8e2fc0218b1a3b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:52.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.247+0000 7f42a97fa640 1 -- 172.21.15.1:0/159122650 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42bc036040 con 0x5625a4f70370 2024-09-19T09:43:52.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.247+0000 7f42a97fa640 1 -- 172.21.15.1:0/159122650 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42bc04f030 con 0x5625a4f70370 2024-09-19T09:43:52.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.247+0000 7f42a97fa640 1 -- 172.21.15.1:0/159122650 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42bc03e680 con 0x5625a4f70370 2024-09-19T09:43:52.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.247+0000 7f42ccdec740 1 -- 172.21.15.1:0/159122650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625a4f70370 msgr2=0x5625a4f67400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:52.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.247+0000 7f42ccdec740 1 --2- 172.21.15.1:0/159122650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625a4f70370 0x5625a4f67400 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f42bc033000 tx=0x7f42bc03f000 comp rx=0 tx=0).stop 2024-09-19T09:43:52.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.247+0000 7f42ccdec740 1 -- 172.21.15.1:0/159122650 shutdown_connections 2024-09-19T09:43:52.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.247+0000 7f42ccdec740 1 --2- 172.21.15.1:0/159122650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625a4f70370 0x5625a4f67400 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:52.255 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.247+0000 7f42ccdec740 1 --2- 172.21.15.1:0/159122650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5625a4f6b2e0 0x5625a4f7c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:52.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.247+0000 7f42ccdec740 1 --2- 172.21.15.1:0/159122650 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625a4f6a9a0 0x5625a4f650b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:52.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.247+0000 7f42ccdec740 1 -- 172.21.15.1:0/159122650 >> 172.21.15.1:0/159122650 conn(0x5625a4f66010 msgr2=0x5625a4f649a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:52.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.248+0000 7f42ccdec740 1 -- 172.21.15.1:0/159122650 shutdown_connections 2024-09-19T09:43:52.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.248+0000 7f42ccdec740 1 -- 172.21.15.1:0/159122650 wait complete. 2024-09-19T09:43:52.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.248+0000 7f42ccdec740 1 -- start start 2024-09-19T09:43:52.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.248+0000 7f42ccdec740 1 Processor -- start 2024-09-19T09:43:52.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.248+0000 7f42ccdec740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5625a4f6a9a0 0x5625a4f79690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:52.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.248+0000 7f42ccdec740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625a4f6b2e0 0x5625a4f79bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:52.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.248+0000 7f42ccdec740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625a4f70370 0x5625a4f7ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:52.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.248+0000 7f42ccdec740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f42c41b2940 con 0x5625a4f70370 2024-09-19T09:43:52.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.248+0000 7f42ccdec740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f42c41b3db0 con 0x5625a4f6a9a0 2024-09-19T09:43:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.248+0000 7f42ccdec740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f42c41b3010 con 0x5625a4f6b2e0 2024-09-19T09:43:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.248+0000 7f42ccdec740 10 client.0 _ll_register_callbacks cb 0x7f42b40d7040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:43:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.248+0000 7f42c3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625a4f70370 0x5625a4f7ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.248+0000 7f42c2ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625a4f6b2e0 0x5625a4f79bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.248+0000 7f42c37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5625a4f6a9a0 0x5625a4f79690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.248+0000 7f42c3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625a4f70370 0x5625a4f7ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52544/0 (socket says 172.21.15.1:52544) 2024-09-19T09:43:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.248+0000 7f42c37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5625a4f6a9a0 0x5625a4f79690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:60552/0 (socket says 172.21.15.1:60552) 2024-09-19T09:43:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.248+0000 7f42c2ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625a4f6b2e0 0x5625a4f79bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:49392/0 (socket says 172.21.15.1:49392) 2024-09-19T09:43:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.248+0000 7f42c3fff640 1 -- 172.21.15.1:0/1477781365 learned_addr learned my addr 172.21.15.1:0/1477781365 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.249+0000 7f42c2ffd640 1 -- 172.21.15.1:0/1477781365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5625a4f6a9a0 msgr2=0x5625a4f79690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:52.257 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.249+0000 7f42c2ffd640 1 --2- 172.21.15.1:0/1477781365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5625a4f6a9a0 0x5625a4f79690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.249+0000 7f42c2ffd640 1 -- 172.21.15.1:0/1477781365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625a4f70370 msgr2=0x5625a4f7ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.249+0000 7f42c2ffd640 1 --2- 172.21.15.1:0/1477781365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625a4f70370 0x5625a4f7ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.249+0000 7f42c2ffd640 1 -- 172.21.15.1:0/1477781365 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625a4f7b1a0 con 0x5625a4f6b2e0 2024-09-19T09:43:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.249+0000 7f42c37fe640 1 --2- 172.21.15.1:0/1477781365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5625a4f6a9a0 0x5625a4f79690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:43:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.249+0000 7f42c3fff640 1 --2- 172.21.15.1:0/1477781365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625a4f70370 0x5625a4f7ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:43:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.249+0000 7f42c2ffd640 1 --2- 172.21.15.1:0/1477781365 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625a4f6b2e0 0x5625a4f79bd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f42b8030d50 tx=0x7f42b800e710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f1e42e27afcb26 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.249+0000 7f42a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-19T09:43:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.249+0000 7f42a2ffd640 1 -- 172.21.15.1:0/1477781365 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b8017050 con 0x5625a4f6b2e0 2024-09-19T09:43:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.249+0000 7f42ccdec740 1 -- 172.21.15.1:0/1477781365 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42bc04f030 con 0x5625a4f6b2e0 2024-09-19T09:43:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.249+0000 7f42a2ffd640 1 -- 172.21.15.1:0/1477781365 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f42b801c810 con 0x5625a4f6b2e0 2024-09-19T09:43:52.258 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.249+0000 7f42a2ffd640 1 -- 172.21.15.1:0/1477781365 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f42b801ca30 con 0x5625a4f6b2e0 2024-09-19T09:43:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.249+0000 7f42ccdec740 10 client.25651 fetch_fsmap learned FSMap version 19 2024-09-19T09:43:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.249+0000 7f42ccdec740 1 -- 172.21.15.1:0/1477781365 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5625a4f7c4b0 con 0x5625a4f6b2e0 2024-09-19T09:43:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.249+0000 7f42a2ffd640 1 -- 172.21.15.1:0/1477781365 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42bc04f030 con 0x5625a4f6b2e0 2024-09-19T09:43:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.249+0000 7f42a2ffd640 1 -- 172.21.15.1:0/1477781365 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f42b80267b0 con 0x5625a4f6b2e0 2024-09-19T09:43:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.249+0000 7f42ccdec740 10 client.25651 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:43:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.249+0000 7f42ccdec740 10 client.25651 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:43:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.249+0000 7f42ccdec740 20 client.25651 populate_metadata read hostname 'smithi001' 2024-09-19T09:43:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.249+0000 7f42ccdec740 1 --2- 172.21.15.1:0/1477781365 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5625a4feb880 0x5625a4fedca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.249+0000 7f42ccdec740 4 client.25651 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:43:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.249+0000 7f42ccdec740 1 -- 172.21.15.1:0/1477781365 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5625a4ed5d70 con 0x5625a4feb880 2024-09-19T09:43:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.250+0000 7f42c37fe640 1 --2- 172.21.15.1:0/1477781365 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5625a4feb880 0x5625a4fedca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:52.259 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.250+0000 7f42a2ffd640 10 client.25651 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:43:52.260 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:52.250+0000 7f42c37fe640 1 --2- 172.21.15.1:0/1477781365 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5625a4feb880 0x5625a4fedca0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f0d31637a17fbd4 server_cookie=90141741edb7de69 in_seq=0 out_seq=0 2024-09-19T09:43:53.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:53 smithi022 ceph-mon[35583]: pgmap v512: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 69 MiB/s wr, 12.25k op/s 2024-09-19T09:43:53.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:53 smithi121 ceph-mon[35577]: pgmap v512: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 69 MiB/s wr, 12.25k op/s 2024-09-19T09:43:53.928 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:53 smithi001 ceph-mon[31225]: pgmap v512: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 69 MiB/s wr, 12.25k op/s 2024-09-19T09:43:54.186 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:54.182+0000 7f42a2ffd640 1 -- 172.21.15.1:0/1477781365 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5625a4ed5d70 con 0x5625a4feb880 2024-09-19T09:43:54.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:54.182+0000 7f42a2ffd640 10 client.25651 handle_command_reply: tid=0 2024-09-19T09:43:54.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:54.182+0000 7f42ccdec740 1 client.25651 shutdown 2024-09-19T09:43:54.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:54.183+0000 7f42ccdec740 1 -- 172.21.15.1:0/1477781365 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625a4f6b2e0 msgr2=0x5625a4f79bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:54.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:54.183+0000 7f42ccdec740 1 --2- 172.21.15.1:0/1477781365 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625a4f6b2e0 0x5625a4f79bd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f42b8030d50 tx=0x7f42b800e710 comp rx=0 tx=0).stop 2024-09-19T09:43:54.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:54.183+0000 7f42ccdec740 1 -- 172.21.15.1:0/1477781365 shutdown_connections 2024-09-19T09:43:54.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:54.183+0000 7f42ccdec740 1 --2- 172.21.15.1:0/1477781365 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5625a4feb880 0x5625a4fedca0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:54.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:54.183+0000 7f42a2ffd640 0 client.25651 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:43:54.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:54.183+0000 7f42ccdec740 1 --2- 172.21.15.1:0/1477781365 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5625a4f70370 0x5625a4f7ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:54.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:54.183+0000 7f42ccdec740 1 --2- 172.21.15.1:0/1477781365 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625a4f6b2e0 0x5625a4f79bd0 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f42b8030d50 tx=0x7f42b800e710 comp rx=0 tx=0).stop 2024-09-19T09:43:54.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:54.183+0000 7f42ccdec740 1 --2- 172.21.15.1:0/1477781365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5625a4f6a9a0 0x5625a4f79690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:54.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:54.183+0000 7f42ccdec740 1 -- 172.21.15.1:0/1477781365 >> 172.21.15.1:0/1477781365 conn(0x5625a4f66010 msgr2=0x5625a4f651c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:54.187 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:54.183+0000 7f42ccdec740 1 -- 172.21.15.1:0/1477781365 shutdown_connections 2024-09-19T09:43:54.188 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:54.183+0000 7f42ccdec740 1 -- 172.21.15.1:0/1477781365 wait complete. 2024-09-19T09:43:54.188 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:54.183+0000 7f42ccdec740 20 client.25651 trim_cache size 0 max 16384 2024-09-19T09:43:54.188 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:43:54.188 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:43:54.188 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:43:54.188 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:43:54.189 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:54.185+0000 7f42ca053640 1 -- 172.21.15.1:0/1582521595 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f42ac0a3300 msgr2=0x7f42ac0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:54.189 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:54.185+0000 7f42ca053640 1 --2- 172.21.15.1:0/1582521595 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f42ac0a3300 0x7f42ac0a57c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f42bc006010 tx=0x7f42bc009500 comp rx=0 tx=0).stop 2024-09-19T09:43:54.189 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:54.185+0000 7f42ca053640 1 -- 172.21.15.1:0/1582521595 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42c4100a40 msgr2=0x7f42c4070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:54.189 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:54.185+0000 7f42ca053640 1 --2- 172.21.15.1:0/1582521595 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42c4100a40 0x7f42c4070a70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f42b400e9f0 tx=0x7f42b400edf0 comp rx=0 tx=0).stop 2024-09-19T09:43:54.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:54.187+0000 7f42ca053640 1 -- 172.21.15.1:0/1582521595 shutdown_connections 2024-09-19T09:43:54.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:54.187+0000 7f42ca053640 1 --2- 172.21.15.1:0/1582521595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f42c41025f0 0x7f42c41a5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:54.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:54.187+0000 7f42ca053640 1 --2- 172.21.15.1:0/1582521595 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f42ac0a3300 0x7f42ac0a57c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:54.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:54.187+0000 7f42ca053640 1 --2- 172.21.15.1:0/1582521595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42c4101c30 0x7f42c4070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:54.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:54.187+0000 7f42ca053640 1 --2- 172.21.15.1:0/1582521595 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42c4100a40 0x7f42c4070a70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:54.190 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:54.187+0000 7f42ca053640 1 -- 172.21.15.1:0/1582521595 >> 172.21.15.1:0/1582521595 conn(0x7f42c40fc1c0 msgr2=0x7f42c40fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:54.192 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:54.189+0000 7f42ca053640 1 -- 172.21.15.1:0/1582521595 shutdown_connections 2024-09-19T09:43:54.192 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:43:54.189+0000 7f42ca053640 1 -- 172.21.15.1:0/1582521595 wait complete. 2024-09-19T09:43:55.818 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:55 smithi001 ceph-mon[31225]: pgmap v513: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 65 MiB/s wr, 11.91k op/s 2024-09-19T09:43:55.864 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:55 smithi022 ceph-mon[35583]: pgmap v513: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 65 MiB/s wr, 11.91k op/s 2024-09-19T09:43:55.867 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:55 smithi121 ceph-mon[35577]: pgmap v513: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 65 MiB/s wr, 11.91k op/s 2024-09-19T09:43:56.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.778+0000 7f8923bc8640 1 -- 172.21.15.1:0/3805258205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f891c106f20 msgr2=0x7f891c10eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:56.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.778+0000 7f8923bc8640 1 --2- 172.21.15.1:0/3805258205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f891c106f20 0x7f891c10eaa0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f8914009ca0 tx=0x7f891402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.778+0000 7f8923bc8640 1 -- 172.21.15.1:0/3805258205 shutdown_connections 2024-09-19T09:43:56.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.778+0000 7f8923bc8640 1 --2- 172.21.15.1:0/3805258205 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f891c106f20 0x7f891c10eaa0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.778+0000 7f8923bc8640 1 --2- 172.21.15.1:0/3805258205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f891c1027a0 0x7f891c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.778+0000 7f8923bc8640 1 --2- 172.21.15.1:0/3805258205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f891c101df0 0x7f891c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.778+0000 7f8923bc8640 1 -- 172.21.15.1:0/3805258205 >> 172.21.15.1:0/3805258205 conn(0x7f891c0fd8b0 msgr2=0x7f891c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:56.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.779+0000 7f8923bc8640 1 -- 172.21.15.1:0/3805258205 shutdown_connections 2024-09-19T09:43:56.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.779+0000 7f8923bc8640 1 -- 172.21.15.1:0/3805258205 wait complete. 2024-09-19T09:43:56.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.780+0000 7f8923bc8640 1 Processor -- start 2024-09-19T09:43:56.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.780+0000 7f8923bc8640 1 -- start start 2024-09-19T09:43:56.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.780+0000 7f8923bc8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f891c101df0 0x7f891c19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:56.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.780+0000 7f8923bc8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f891c1027a0 0x7f891c19aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:56.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.780+0000 7f8923bc8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f891c106f20 0x7f891c19ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:56.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.780+0000 7f8923bc8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f891c111fd0 con 0x7f891c106f20 2024-09-19T09:43:56.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.780+0000 7f8923bc8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f891c111e50 con 0x7f891c1027a0 2024-09-19T09:43:56.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.780+0000 7f8922165640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f891c106f20 0x7f891c19ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:56.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.780+0000 7f8923bc8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f891c112150 con 0x7f891c101df0 2024-09-19T09:43:56.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.780+0000 7f8922165640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f891c106f20 0x7f891c19ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34964/0 (socket says 172.21.15.1:34964) 2024-09-19T09:43:56.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.780+0000 7f8922165640 1 -- 172.21.15.1:0/1101891371 learned_addr learned my addr 172.21.15.1:0/1101891371 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:56.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.781+0000 7f8921163640 1 --2- 172.21.15.1:0/1101891371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f891c1027a0 0x7f891c19aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:56.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.781+0000 7f8922165640 1 -- 172.21.15.1:0/1101891371 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f891c101df0 msgr2=0x7f891c19a5a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:43:56.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.781+0000 7f8922165640 1 --2- 172.21.15.1:0/1101891371 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f891c101df0 0x7f891c19a5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.781+0000 7f8922165640 1 -- 172.21.15.1:0/1101891371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f891c1027a0 msgr2=0x7f891c19aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:56.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.781+0000 7f8922165640 1 --2- 172.21.15.1:0/1101891371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f891c1027a0 0x7f891c19aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.781+0000 7f8922165640 1 -- 172.21.15.1:0/1101891371 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f891c19f550 con 0x7f891c106f20 2024-09-19T09:43:56.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.781+0000 7f8922165640 1 --2- 172.21.15.1:0/1101891371 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f891c106f20 0x7f891c19ee70 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8914033040 tx=0x7f8914003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:56.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.782+0000 7f8912ffd640 1 -- 172.21.15.1:0/1101891371 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8914031650 con 0x7f891c106f20 2024-09-19T09:43:56.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.782+0000 7f8912ffd640 1 -- 172.21.15.1:0/1101891371 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f89140317f0 con 0x7f891c106f20 2024-09-19T09:43:56.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.782+0000 7f8912ffd640 1 -- 172.21.15.1:0/1101891371 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891402fa40 con 0x7f891c106f20 2024-09-19T09:43:56.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.784+0000 7f8923bc8640 1 -- 172.21.15.1:0/1101891371 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f891c19f7e0 con 0x7f891c106f20 2024-09-19T09:43:56.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.785+0000 7f8923bc8640 1 -- 172.21.15.1:0/1101891371 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f891c19fca0 con 0x7f891c106f20 2024-09-19T09:43:56.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.788+0000 7f8925fa1740 1 Processor -- start 2024-09-19T09:43:56.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.790+0000 7f8912ffd640 1 -- 172.21.15.1:0/1101891371 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f891402fbe0 con 0x7f891c106f20 2024-09-19T09:43:56.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.791+0000 7f8925fa1740 1 -- start start 2024-09-19T09:43:56.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.792+0000 7f8925fa1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637409f83c0 0x5637409f87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:56.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.792+0000 7f8925fa1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637409f8ce0 0x563740a0b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:56.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.792+0000 7f8925fa1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563740a0be90 0x563740a0e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:56.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.792+0000 7f8925fa1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56374095e2e0 con 0x5637409f8ce0 2024-09-19T09:43:56.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.792+0000 7f8925fa1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563740905ce0 con 0x5637409f83c0 2024-09-19T09:43:56.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.792+0000 7f8925fa1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56374095a2a0 con 0x563740a0be90 2024-09-19T09:43:56.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.792+0000 7f8912ffd640 1 --2- 172.21.15.1:0/1101891371 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f89080a32c0 0x7f89080a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:56.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.792+0000 7f8921163640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563740a0be90 0x563740a0e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:56.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.792+0000 7f8921163640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563740a0be90 0x563740a0e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:35632/0 (socket says 172.21.15.1:35632) 2024-09-19T09:43:56.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.792+0000 7f8921163640 1 -- 172.21.15.1:0/3898907777 learned_addr learned my addr 172.21.15.1:0/3898907777 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:56.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.792+0000 7f8921163640 1 --2- 172.21.15.1:0/3898907777 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637409f83c0 0x5637409f87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:56.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.793+0000 7f8922165640 1 --2- 172.21.15.1:0/1101891371 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f89080a32c0 0x7f89080a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:56.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.793+0000 7f8912ffd640 1 -- 172.21.15.1:0/1101891371 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f89140f0fa0 con 0x7f891c106f20 2024-09-19T09:43:56.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.793+0000 7f8922165640 1 --2- 172.21.15.1:0/1101891371 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f89080a32c0 0x7f89080a5780 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f89140c5d00 tx=0x7f8914009a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:56.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.793+0000 7f8921163640 1 -- 172.21.15.1:0/3898907777 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637409f83c0 msgr2=0x5637409f87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:56.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.793+0000 7f8921163640 1 --2- 172.21.15.1:0/3898907777 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637409f83c0 0x5637409f87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.793+0000 7f8921163640 1 -- 172.21.15.1:0/3898907777 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637409f8ce0 msgr2=0x563740a0b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:56.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.793+0000 7f8921163640 1 --2- 172.21.15.1:0/3898907777 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637409f8ce0 0x563740a0b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.793+0000 7f8921163640 1 -- 172.21.15.1:0/3898907777 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637408ea440 con 0x563740a0be90 2024-09-19T09:43:56.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.797+0000 7f8921163640 1 --2- 172.21.15.1:0/3898907777 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563740a0be90 0x563740a0e280 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f890c014950 tx=0x7f890c00c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72d464aee0ec659e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:56.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.797+0000 7f8907fff640 1 -- 172.21.15.1:0/3898907777 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890c00f760 con 0x563740a0be90 2024-09-19T09:43:56.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.798+0000 7f8907fff640 1 -- 172.21.15.1:0/3898907777 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f890c00fde0 con 0x563740a0be90 2024-09-19T09:43:56.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.798+0000 7f8907fff640 1 -- 172.21.15.1:0/3898907777 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890c012b50 con 0x563740a0be90 2024-09-19T09:43:56.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.799+0000 7f8925fa1740 1 -- 172.21.15.1:0/3898907777 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563740a0be90 msgr2=0x563740a0e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:56.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.799+0000 7f8925fa1740 1 --2- 172.21.15.1:0/3898907777 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563740a0be90 0x563740a0e280 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f890c014950 tx=0x7f890c00c450 comp rx=0 tx=0).stop 2024-09-19T09:43:56.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.799+0000 7f8925fa1740 1 -- 172.21.15.1:0/3898907777 shutdown_connections 2024-09-19T09:43:56.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.799+0000 7f8925fa1740 1 --2- 172.21.15.1:0/3898907777 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563740a0be90 0x563740a0e280 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.799+0000 7f8925fa1740 1 --2- 172.21.15.1:0/3898907777 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637409f8ce0 0x563740a0b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.799+0000 7f8925fa1740 1 --2- 172.21.15.1:0/3898907777 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637409f83c0 0x5637409f87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.799+0000 7f8925fa1740 1 -- 172.21.15.1:0/3898907777 >> 172.21.15.1:0/3898907777 conn(0x5637409f4a30 msgr2=0x5637409f4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:56.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.800+0000 7f8925fa1740 1 -- 172.21.15.1:0/3898907777 shutdown_connections 2024-09-19T09:43:56.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.805+0000 7f8925fa1740 1 -- 172.21.15.1:0/3898907777 wait complete. 2024-09-19T09:43:56.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.805+0000 7f8925fa1740 1 -- start start 2024-09-19T09:43:56.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.805+0000 7f8925fa1740 1 Processor -- start 2024-09-19T09:43:56.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.806+0000 7f8925fa1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637409f83c0 0x563740a057f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:56.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.806+0000 7f8925fa1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563740a0be90 0x563740a05d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:56.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.806+0000 7f8925fa1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563740a0b500 0x563740a00b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:56.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.806+0000 7f8921163640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637409f83c0 0x563740a057f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:56.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.806+0000 7f8921163640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637409f83c0 0x563740a057f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:59348/0 (socket says 172.21.15.1:59348) 2024-09-19T09:43:56.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.806+0000 7f8921163640 1 -- 172.21.15.1:0/4207179470 learned_addr learned my addr 172.21.15.1:0/4207179470 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:56.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.806+0000 7f8925fa1740 1 -- 172.21.15.1:0/4207179470 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5637409fb370 con 0x563740a0be90 2024-09-19T09:43:56.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.807+0000 7f8925fa1740 1 -- 172.21.15.1:0/4207179470 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563740919050 con 0x5637409f83c0 2024-09-19T09:43:56.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.807+0000 7f8925fa1740 1 -- 172.21.15.1:0/4207179470 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5637409fb4f0 con 0x563740a0b500 2024-09-19T09:43:56.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.807+0000 7f8925fa1740 10 client.0 _ll_register_callbacks cb 0x563740959160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:43:56.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.808+0000 7f8921964640 1 --2- 172.21.15.1:0/4207179470 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563740a0be90 0x563740a05d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:56.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.808+0000 7f8921163640 1 --2- 172.21.15.1:0/4207179470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563740a0b500 0x563740a00b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:56.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.808+0000 7f8921163640 1 -- 172.21.15.1:0/4207179470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563740a0b500 msgr2=0x563740a00b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:56.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.808+0000 7f8921163640 1 --2- 172.21.15.1:0/4207179470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563740a0b500 0x563740a00b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.808+0000 7f8921163640 1 -- 172.21.15.1:0/4207179470 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563740a0be90 msgr2=0x563740a05d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:56.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.808+0000 7f8921163640 1 --2- 172.21.15.1:0/4207179470 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563740a0be90 0x563740a05d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.808+0000 7f8921163640 1 -- 172.21.15.1:0/4207179470 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637406cf3c0 con 0x5637409f83c0 2024-09-19T09:43:56.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.809+0000 7f8921163640 1 --2- 172.21.15.1:0/4207179470 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637409f83c0 0x563740a057f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f890c0126d0 tx=0x7f890c00ff90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72fb6de965ee002f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:56.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.809+0000 7f89057fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:43:56.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.811+0000 7f89057fa640 1 -- 172.21.15.1:0/4207179470 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890c028030 con 0x5637409f83c0 2024-09-19T09:43:56.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.811+0000 7f89057fa640 1 -- 172.21.15.1:0/4207179470 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f890c00f7f0 con 0x5637409f83c0 2024-09-19T09:43:56.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.811+0000 7f8925fa1740 1 -- 172.21.15.1:0/4207179470 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f890c00fde0 con 0x5637409f83c0 2024-09-19T09:43:56.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.811+0000 7f89057fa640 1 -- 172.21.15.1:0/4207179470 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f890c00f9f0 con 0x5637409f83c0 2024-09-19T09:43:56.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.813+0000 7f8925fa1740 10 client.25823 fetch_fsmap learned FSMap version 19 2024-09-19T09:43:56.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.813+0000 7f8925fa1740 1 -- 172.21.15.1:0/4207179470 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x563740a231d0 con 0x5637409f83c0 2024-09-19T09:43:56.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.814+0000 7f89057fa640 1 -- 172.21.15.1:0/4207179470 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f890c00fde0 con 0x5637409f83c0 2024-09-19T09:43:56.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.814+0000 7f89057fa640 1 -- 172.21.15.1:0/4207179470 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f890c011750 con 0x5637409f83c0 2024-09-19T09:43:56.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.814+0000 7f8925fa1740 10 client.25823 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:43:56.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.814+0000 7f8925fa1740 10 client.25823 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:43:56.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.814+0000 7f8925fa1740 20 client.25823 populate_metadata read hostname 'smithi001' 2024-09-19T09:43:56.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.814+0000 7f8925fa1740 1 --2- 172.21.15.1:0/4207179470 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563740a248a0 0x563740a26ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:56.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.814+0000 7f8925fa1740 4 client.25823 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:43:56.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.814+0000 7f8925fa1740 1 -- 172.21.15.1:0/4207179470 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56374096b850 con 0x563740a248a0 2024-09-19T09:43:56.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.815+0000 7f8921964640 1 --2- 172.21.15.1:0/4207179470 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563740a248a0 0x563740a26ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:56.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.817+0000 7f8921964640 1 --2- 172.21.15.1:0/4207179470 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563740a248a0 0x563740a26ce0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18ef000c821cc457 server_cookie=4036bca4925bfd84 in_seq=0 out_seq=0 2024-09-19T09:43:56.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.817+0000 7f89057fa640 10 client.25823 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:43:56.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.819+0000 7f89057fa640 1 -- 172.21.15.1:0/4207179470 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56374096b850 con 0x563740a248a0 2024-09-19T09:43:56.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.819+0000 7f89057fa640 10 client.25823 handle_command_reply: tid=0 2024-09-19T09:43:56.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.820+0000 7f8925fa1740 1 client.25823 shutdown 2024-09-19T09:43:56.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.821+0000 7f8925fa1740 1 -- 172.21.15.1:0/4207179470 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637409f83c0 msgr2=0x563740a057f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:56.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.821+0000 7f8925fa1740 1 --2- 172.21.15.1:0/4207179470 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637409f83c0 0x563740a057f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f890c0126d0 tx=0x7f890c00ff90 comp rx=0 tx=0).stop 2024-09-19T09:43:56.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.822+0000 7f8925fa1740 1 -- 172.21.15.1:0/4207179470 shutdown_connections 2024-09-19T09:43:56.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.822+0000 7f8925fa1740 1 --2- 172.21.15.1:0/4207179470 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563740a248a0 0x563740a26ce0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.822+0000 7f8925fa1740 1 --2- 172.21.15.1:0/4207179470 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563740a0b500 0x563740a00b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.822+0000 7f8925fa1740 1 --2- 172.21.15.1:0/4207179470 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563740a0be90 0x563740a05d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.822+0000 7f8925fa1740 1 --2- 172.21.15.1:0/4207179470 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637409f83c0 0x563740a057f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.822+0000 7f89057fa640 0 client.25823 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:43:56.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.822+0000 7f8925fa1740 1 -- 172.21.15.1:0/4207179470 >> 172.21.15.1:0/4207179470 conn(0x5637409f4a30 msgr2=0x5637409fa6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:56.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.824+0000 7f8925fa1740 1 -- 172.21.15.1:0/4207179470 shutdown_connections 2024-09-19T09:43:56.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.824+0000 7f8925fa1740 1 -- 172.21.15.1:0/4207179470 wait complete. 2024-09-19T09:43:56.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.824+0000 7f8925fa1740 20 client.25823 trim_cache size 0 max 16384 2024-09-19T09:43:56.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.861+0000 7f8925fa1740 1 Processor -- start 2024-09-19T09:43:56.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.862+0000 7f8925fa1740 1 -- start start 2024-09-19T09:43:56.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.863+0000 7f8925fa1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637409f83c0 0x563740a0ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:56.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.863+0000 7f8925fa1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563740a0b500 0x563740a2c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:56.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.863+0000 7f8925fa1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563740a0be90 0x563740a2cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:56.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.863+0000 7f8925fa1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f891c1a94a0 con 0x5637409f83c0 2024-09-19T09:43:56.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.863+0000 7f8921964640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563740a0b500 0x563740a2c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:56.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.864+0000 7f8921964640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563740a0b500 0x563740a2c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:35636/0 (socket says 172.21.15.1:35636) 2024-09-19T09:43:56.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.864+0000 7f8921964640 1 -- 172.21.15.1:0/1968891516 learned_addr learned my addr 172.21.15.1:0/1968891516 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:56.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.864+0000 7f8921163640 1 --2- 172.21.15.1:0/1968891516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563740a0be90 0x563740a2cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:56.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.864+0000 7f8925fa1740 1 -- 172.21.15.1:0/1968891516 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f891c1abd00 con 0x563740a0be90 2024-09-19T09:43:56.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.864+0000 7f8925fa1740 1 -- 172.21.15.1:0/1968891516 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f891c1a9af0 con 0x563740a0b500 2024-09-19T09:43:56.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.865+0000 7f8921163640 1 --2- 172.21.15.1:0/1968891516 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637409f83c0 0x563740a0ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:56.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.865+0000 7f8921964640 1 -- 172.21.15.1:0/1968891516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563740a0be90 msgr2=0x563740a2cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:56.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.865+0000 7f8921964640 1 --2- 172.21.15.1:0/1968891516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563740a0be90 0x563740a2cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.865+0000 7f8921964640 1 -- 172.21.15.1:0/1968891516 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637409f83c0 msgr2=0x563740a0ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:56.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.865+0000 7f8921964640 1 --2- 172.21.15.1:0/1968891516 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637409f83c0 0x563740a0ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.865+0000 7f8921964640 1 -- 172.21.15.1:0/1968891516 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563740a27360 con 0x563740a0b500 2024-09-19T09:43:56.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.866+0000 7f8921964640 1 --2- 172.21.15.1:0/1968891516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563740a0b500 0x563740a2c5f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x563740a003a0 tx=0x7f8918005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=deb0b3704ae9e4ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:56.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.867+0000 7f89077fe640 1 -- 172.21.15.1:0/1968891516 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8918003d20 con 0x563740a0b500 2024-09-19T09:43:56.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.867+0000 7f89077fe640 1 -- 172.21.15.1:0/1968891516 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8918020070 con 0x563740a0b500 2024-09-19T09:43:56.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.867+0000 7f89077fe640 1 -- 172.21.15.1:0/1968891516 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89180126b0 con 0x563740a0b500 2024-09-19T09:43:56.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.868+0000 7f8925fa1740 1 -- 172.21.15.1:0/1968891516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563740a0b500 msgr2=0x563740a2c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:56.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.868+0000 7f8925fa1740 1 --2- 172.21.15.1:0/1968891516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563740a0b500 0x563740a2c5f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x563740a003a0 tx=0x7f8918005f90 comp rx=0 tx=0).stop 2024-09-19T09:43:56.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.870+0000 7f8925fa1740 1 -- 172.21.15.1:0/1968891516 shutdown_connections 2024-09-19T09:43:56.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.870+0000 7f8925fa1740 1 --2- 172.21.15.1:0/1968891516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563740a0be90 0x563740a2cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.870+0000 7f8925fa1740 1 --2- 172.21.15.1:0/1968891516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563740a0b500 0x563740a2c5f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.870+0000 7f8925fa1740 1 --2- 172.21.15.1:0/1968891516 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5637409f83c0 0x563740a0ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.870+0000 7f8925fa1740 1 -- 172.21.15.1:0/1968891516 >> 172.21.15.1:0/1968891516 conn(0x5637409f4a30 msgr2=0x563740a00ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:56.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.872+0000 7f8925fa1740 1 -- 172.21.15.1:0/1968891516 shutdown_connections 2024-09-19T09:43:56.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.872+0000 7f8925fa1740 1 -- 172.21.15.1:0/1968891516 wait complete. 2024-09-19T09:43:56.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.873+0000 7f8925fa1740 1 -- start start 2024-09-19T09:43:56.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.873+0000 7f8925fa1740 1 Processor -- start 2024-09-19T09:43:56.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.874+0000 7f8925fa1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637409f83c0 0x563740a38860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:56.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.874+0000 7f8925fa1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563740a0b500 0x563740a33b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:56.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.874+0000 7f8925fa1740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563740a0be90 0x563740a340d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:56.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.874+0000 7f8925fa1740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f891c1aa1c0 con 0x563740a0be90 2024-09-19T09:43:56.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.875+0000 7f8925fa1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f891c1ab630 con 0x5637409f83c0 2024-09-19T09:43:56.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.875+0000 7f8925fa1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f891c1aa890 con 0x563740a0b500 2024-09-19T09:43:56.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.875+0000 7f8925fa1740 10 client.0 _ll_register_callbacks cb 0x7f890c00ce90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:43:56.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.879+0000 7f8921964640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563740a0b500 0x563740a33b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:56.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.879+0000 7f8921163640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637409f83c0 0x563740a38860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:56.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.879+0000 7f8921163640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637409f83c0 0x563740a38860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:59376/0 (socket says 172.21.15.1:59376) 2024-09-19T09:43:56.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.879+0000 7f8921163640 1 -- 172.21.15.1:0/611681632 learned_addr learned my addr 172.21.15.1:0/611681632 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:43:56.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.882+0000 7f8921964640 1 -- 172.21.15.1:0/611681632 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637409f83c0 msgr2=0x563740a38860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:56.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.882+0000 7f8921964640 1 --2- 172.21.15.1:0/611681632 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637409f83c0 0x563740a38860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.882+0000 7f8921964640 1 -- 172.21.15.1:0/611681632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563740a0be90 msgr2=0x563740a340d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:43:56.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.882+0000 7f8921964640 1 --2- 172.21.15.1:0/611681632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563740a0be90 0x563740a340d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.882+0000 7f8921964640 1 -- 172.21.15.1:0/611681632 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563740a060a0 con 0x563740a0b500 2024-09-19T09:43:56.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.883+0000 7f8921964640 1 --2- 172.21.15.1:0/611681632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563740a0b500 0x563740a33b90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x563740a01370 tx=0x7f8918009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f261d6f02148bc22 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:43:56.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.883+0000 7f89057fa640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-19T09:43:56.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.886+0000 7f89057fa640 1 -- 172.21.15.1:0/611681632 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8918003d20 con 0x563740a0b500 2024-09-19T09:43:56.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.886+0000 7f89057fa640 1 -- 172.21.15.1:0/611681632 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f891801b3a0 con 0x563740a0b500 2024-09-19T09:43:56.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.887+0000 7f8925fa1740 1 -- 172.21.15.1:0/611681632 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8918020070 con 0x563740a0b500 2024-09-19T09:43:56.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.889+0000 7f89057fa640 1 -- 172.21.15.1:0/611681632 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f891801b5e0 con 0x563740a0b500 2024-09-19T09:43:56.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.891+0000 7f8925fa1740 10 client.25666 fetch_fsmap learned FSMap version 19 2024-09-19T09:43:56.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.892+0000 7f8925fa1740 1 -- 172.21.15.1:0/611681632 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x563740a01d60 con 0x563740a0b500 2024-09-19T09:43:56.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.894+0000 7f89057fa640 1 -- 172.21.15.1:0/611681632 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8918012450 con 0x563740a0b500 2024-09-19T09:43:56.945 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:43:56.945 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "scrub active (136 inodes in the stack)", 2024-09-19T09:43:56.945 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": { 2024-09-19T09:43:56.946 INFO:teuthology.orchestra.run.smithi001.stdout: "e3364ece-6012-4b22-8215-21b8e7bcae0b": { 2024-09-19T09:43:56.946 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-19T09:43:56.946 INFO:teuthology.orchestra.run.smithi001.stdout: "tag": "e3364ece-6012-4b22-8215-21b8e7bcae0b", 2024-09-19T09:43:56.946 INFO:teuthology.orchestra.run.smithi001.stdout: "options": "recursive,force" 2024-09-19T09:43:56.946 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:43:56.946 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:43:56.946 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:43:56.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.894+0000 7f89057fa640 1 -- 172.21.15.1:0/611681632 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f891802e430 con 0x563740a0b500 2024-09-19T09:43:56.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.896+0000 7f8925fa1740 10 client.25666 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:43:56.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.896+0000 7f8925fa1740 10 client.25666 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:43:56.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.896+0000 7f8925fa1740 20 client.25666 populate_metadata read hostname 'smithi001' 2024-09-19T09:43:56.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.896+0000 7f8925fa1740 1 --2- 172.21.15.1:0/611681632 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563740a8f3f0 0x563740a91810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:43:56.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.896+0000 7f8925fa1740 4 client.25666 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:43:56.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.896+0000 7f8925fa1740 1 -- 172.21.15.1:0/611681632 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f8918020070 con 0x563740a8f3f0 2024-09-19T09:43:56.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.902+0000 7f8921163640 1 --2- 172.21.15.1:0/611681632 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563740a8f3f0 0x563740a91810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:43:56.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.904+0000 7f8921163640 1 --2- 172.21.15.1:0/611681632 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563740a8f3f0 0x563740a91810 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e1b7a62e393c2ce server_cookie=74bb57461bd1cc37 in_seq=0 out_seq=0 2024-09-19T09:43:56.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.904+0000 7f89057fa640 10 client.25666 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:43:56.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.905+0000 7f89057fa640 1 -- 172.21.15.1:0/611681632 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x7f8918020070 con 0x563740a8f3f0 2024-09-19T09:43:56.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.905+0000 7f89057fa640 10 client.25666 handle_command_reply: tid=0 2024-09-19T09:43:56.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.905+0000 7f8925fa1740 1 client.25666 shutdown 2024-09-19T09:43:56.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.909+0000 7f8925fa1740 1 -- 172.21.15.1:0/611681632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563740a0b500 msgr2=0x563740a33b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:56.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.909+0000 7f8925fa1740 1 --2- 172.21.15.1:0/611681632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563740a0b500 0x563740a33b90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x563740a01370 tx=0x7f8918009b30 comp rx=0 tx=0).stop 2024-09-19T09:43:56.947 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.909+0000 7f8925fa1740 1 -- 172.21.15.1:0/611681632 shutdown_connections 2024-09-19T09:43:56.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.909+0000 7f8925fa1740 1 --2- 172.21.15.1:0/611681632 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563740a8f3f0 0x563740a91810 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.909+0000 7f8925fa1740 1 --2- 172.21.15.1:0/611681632 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563740a0be90 0x563740a340d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.909+0000 7f8925fa1740 1 --2- 172.21.15.1:0/611681632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563740a0b500 0x563740a33b90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.909+0000 7f89057fa640 0 client.25666 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:43:56.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.909+0000 7f8925fa1740 1 --2- 172.21.15.1:0/611681632 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637409f83c0 0x563740a38860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.909+0000 7f8925fa1740 1 -- 172.21.15.1:0/611681632 >> 172.21.15.1:0/611681632 conn(0x5637409f4a30 msgr2=0x5637409fbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:56.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.909+0000 7f8925fa1740 1 -- 172.21.15.1:0/611681632 shutdown_connections 2024-09-19T09:43:56.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.909+0000 7f8925fa1740 1 -- 172.21.15.1:0/611681632 wait complete. 2024-09-19T09:43:56.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.909+0000 7f8925fa1740 20 client.25666 trim_cache size 0 max 16384 2024-09-19T09:43:56.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.912+0000 7f8923bc8640 1 -- 172.21.15.1:0/1101891371 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f89080a32c0 msgr2=0x7f89080a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:56.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.912+0000 7f8923bc8640 1 --2- 172.21.15.1:0/1101891371 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f89080a32c0 0x7f89080a5780 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f89140c5d00 tx=0x7f8914009a20 comp rx=0 tx=0).stop 2024-09-19T09:43:56.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.912+0000 7f8923bc8640 1 -- 172.21.15.1:0/1101891371 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f891c106f20 msgr2=0x7f891c19ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:43:56.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.912+0000 7f8923bc8640 1 --2- 172.21.15.1:0/1101891371 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f891c106f20 0x7f891c19ee70 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8914033040 tx=0x7f8914003f10 comp rx=0 tx=0).stop 2024-09-19T09:43:56.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.912+0000 7f8923bc8640 1 -- 172.21.15.1:0/1101891371 shutdown_connections 2024-09-19T09:43:56.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.912+0000 7f8923bc8640 1 --2- 172.21.15.1:0/1101891371 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f891c106f20 0x7f891c19ee70 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.912+0000 7f8923bc8640 1 --2- 172.21.15.1:0/1101891371 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f89080a32c0 0x7f89080a5780 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.912+0000 7f8923bc8640 1 --2- 172.21.15.1:0/1101891371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f891c1027a0 0x7f891c19aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.912+0000 7f8923bc8640 1 --2- 172.21.15.1:0/1101891371 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f891c101df0 0x7f891c19a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:43:56.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.912+0000 7f8923bc8640 1 -- 172.21.15.1:0/1101891371 >> 172.21.15.1:0/1101891371 conn(0x7f891c0fd8b0 msgr2=0x7f891c0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:43:56.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.912+0000 7f8923bc8640 1 -- 172.21.15.1:0/1101891371 shutdown_connections 2024-09-19T09:43:56.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:43:55.912+0000 7f8923bc8640 1 -- 172.21.15.1:0/1101891371 wait complete. 2024-09-19T09:43:57.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:57 smithi001 ceph-mon[31225]: pgmap v514: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 64 MiB/s wr, 11.89k op/s 2024-09-19T09:43:58.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:57 smithi022 ceph-mon[35583]: pgmap v514: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 64 MiB/s wr, 11.89k op/s 2024-09-19T09:43:58.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:57 smithi121 ceph-mon[35577]: pgmap v514: 97 pgs: 97 active+clean; 13 GiB data, 36 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 64 MiB/s wr, 11.89k op/s 2024-09-19T09:43:59.916 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:43:59 smithi022 ceph-mon[35583]: pgmap v515: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 76 MiB/s wr, 14.32k op/s 2024-09-19T09:43:59.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:43:59 smithi001 ceph-mon[31225]: pgmap v515: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 76 MiB/s wr, 14.32k op/s 2024-09-19T09:44:00.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:43:59 smithi121 ceph-mon[35577]: pgmap v515: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 76 MiB/s wr, 14.32k op/s 2024-09-19T09:44:01.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:01 smithi001 ceph-mon[31225]: pgmap v516: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 66 MiB/s wr, 12.44k op/s 2024-09-19T09:44:02.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:01 smithi022 ceph-mon[35583]: pgmap v516: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 66 MiB/s wr, 12.44k op/s 2024-09-19T09:44:02.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:01 smithi121 ceph-mon[35577]: pgmap v516: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 66 MiB/s wr, 12.44k op/s 2024-09-19T09:44:03.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:03 smithi001 ceph-mon[31225]: pgmap v517: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 68 MiB/s wr, 12.78k op/s 2024-09-19T09:44:04.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:03 smithi022 ceph-mon[35583]: pgmap v517: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 68 MiB/s wr, 12.78k op/s 2024-09-19T09:44:04.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:03 smithi121 ceph-mon[35577]: pgmap v517: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 68 MiB/s wr, 12.78k op/s 2024-09-19T09:44:05.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:05 smithi001 ceph-mon[31225]: pgmap v518: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 65 MiB/s wr, 12.52k op/s 2024-09-19T09:44:06.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:05 smithi022 ceph-mon[35583]: pgmap v518: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 65 MiB/s wr, 12.52k op/s 2024-09-19T09:44:06.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:05 smithi121 ceph-mon[35577]: pgmap v518: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 65 MiB/s wr, 12.52k op/s 2024-09-19T09:44:06.615 INFO:tasks.cephfs.filesystem:scrub status for tag:e3364ece-6012-4b22-8215-21b8e7bcae0b - {'path': '/', 'tag': 'e3364ece-6012-4b22-8215-21b8e7bcae0b', 'options': 'recursive,force'} 2024-09-19T09:44:06.669 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:44:07.319 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.318+0000 7fba3232b640 1 -- 172.21.15.1:0/650472901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba24095100 msgr2=0x7fba2409c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:07.320 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.318+0000 7fba3232b640 1 --2- 172.21.15.1:0/650472901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba24095100 0x7fba2409c9c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fba2c067960 tx=0x7fba2c096c10 comp rx=0 tx=0).stop 2024-09-19T09:44:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.320+0000 7fba3232b640 1 -- 172.21.15.1:0/650472901 shutdown_connections 2024-09-19T09:44:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.320+0000 7fba3232b640 1 --2- 172.21.15.1:0/650472901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba24095100 0x7fba2409c9c0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.320+0000 7fba3232b640 1 --2- 172.21.15.1:0/650472901 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba24094760 0x7fba24094bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.320+0000 7fba3232b640 1 --2- 172.21.15.1:0/650472901 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba24095b10 0x7fba24095f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:07.322 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.320+0000 7fba3232b640 1 -- 172.21.15.1:0/650472901 >> 172.21.15.1:0/650472901 conn(0x7fba2408f420 msgr2=0x7fba24091880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:07.329 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.327+0000 7fba3232b640 1 -- 172.21.15.1:0/650472901 shutdown_connections 2024-09-19T09:44:07.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.328+0000 7fba3232b640 1 -- 172.21.15.1:0/650472901 wait complete. 2024-09-19T09:44:07.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.329+0000 7fba3232b640 1 Processor -- start 2024-09-19T09:44:07.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.329+0000 7fba3232b640 1 -- start start 2024-09-19T09:44:07.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.329+0000 7fba3232b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba24094760 0x7fba241297a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:07.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.329+0000 7fba3232b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba24095100 0x7fba24129ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:07.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.329+0000 7fba3232b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba24095b10 0x7fba24130d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:07.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.329+0000 7fba31329640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba24094760 0x7fba241297a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:07.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.330+0000 7fba31329640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba24094760 0x7fba241297a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:46658/0 (socket says 172.21.15.1:46658) 2024-09-19T09:44:07.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.330+0000 7fba31329640 1 -- 172.21.15.1:0/4175743760 learned_addr learned my addr 172.21.15.1:0/4175743760 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:07.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.330+0000 7fba3232b640 1 -- 172.21.15.1:0/4175743760 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fba240a0180 con 0x7fba24095b10 2024-09-19T09:44:07.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.330+0000 7fba3232b640 1 -- 172.21.15.1:0/4175743760 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fba240a0000 con 0x7fba24094760 2024-09-19T09:44:07.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.330+0000 7fba3232b640 1 -- 172.21.15.1:0/4175743760 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fba240a0300 con 0x7fba24095100 2024-09-19T09:44:07.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.330+0000 7fba30b28640 1 --2- 172.21.15.1:0/4175743760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba24095100 0x7fba24129ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:07.333 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.330+0000 7fba31329640 1 -- 172.21.15.1:0/4175743760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba24095100 msgr2=0x7fba24129ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.330+0000 7fba31329640 1 --2- 172.21.15.1:0/4175743760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba24095100 0x7fba24129ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.330+0000 7fba31329640 1 -- 172.21.15.1:0/4175743760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba24095b10 msgr2=0x7fba24130d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:44:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.330+0000 7fba31329640 1 --2- 172.21.15.1:0/4175743760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba24095b10 0x7fba24130d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.330+0000 7fba31329640 1 -- 172.21.15.1:0/4175743760 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba241313c0 con 0x7fba24094760 2024-09-19T09:44:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.330+0000 7fba30b28640 1 --2- 172.21.15.1:0/4175743760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba24095100 0x7fba24129ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:44:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.331+0000 7fba31329640 1 --2- 172.21.15.1:0/4175743760 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba24094760 0x7fba241297a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fba1c00b450 tx=0x7fba1c00b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.331+0000 7fba227fc640 1 -- 172.21.15.1:0/4175743760 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1c015020 con 0x7fba24094760 2024-09-19T09:44:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.332+0000 7fba227fc640 1 -- 172.21.15.1:0/4175743760 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba1c011d70 con 0x7fba24094760 2024-09-19T09:44:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.332+0000 7fba227fc640 1 -- 172.21.15.1:0/4175743760 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1c015020 con 0x7fba24094760 2024-09-19T09:44:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.332+0000 7fba3232b640 1 -- 172.21.15.1:0/4175743760 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba241316b0 con 0x7fba24094760 2024-09-19T09:44:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.332+0000 7fba3232b640 1 -- 172.21.15.1:0/4175743760 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba24131c30 con 0x7fba24094760 2024-09-19T09:44:07.340 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.338+0000 7fba227fc640 1 -- 172.21.15.1:0/4175743760 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fba1c018020 con 0x7fba24094760 2024-09-19T09:44:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.339+0000 7fba227fc640 1 --2- 172.21.15.1:0/4175743760 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fba180a3710 0x7fba180a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.340+0000 7fba227fc640 1 -- 172.21.15.1:0/4175743760 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fba1c011690 con 0x7fba24094760 2024-09-19T09:44:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.342+0000 7fba36400740 1 Processor -- start 2024-09-19T09:44:07.344 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.342+0000 7fba36400740 1 -- start start 2024-09-19T09:44:07.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.343+0000 7fba36400740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55996d7e6b70 0x55996d7e6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:07.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.343+0000 7fba36400740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55996d7e74b0 0x55996d7ebf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:07.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.343+0000 7fba36400740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55996d7ec540 0x55996d7eea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:07.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.343+0000 7fba36400740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55996d74a2f0 con 0x55996d7e6b70 2024-09-19T09:44:07.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.343+0000 7fba36400740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55996d6f2270 con 0x55996d7e74b0 2024-09-19T09:44:07.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.343+0000 7fba36400740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55996d7462b0 con 0x55996d7ec540 2024-09-19T09:44:07.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.344+0000 7fba30b28640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55996d7e74b0 0x55996d7ebf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:07.345 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.344+0000 7fba30b28640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55996d7e74b0 0x55996d7ebf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:46668/0 (socket says 172.21.15.1:46668) 2024-09-19T09:44:07.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.344+0000 7fba30b28640 1 -- 172.21.15.1:0/3595907794 learned_addr learned my addr 172.21.15.1:0/3595907794 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:07.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.344+0000 7fba30b28640 1 -- 172.21.15.1:0/3595907794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55996d7ec540 msgr2=0x55996d7eea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:07.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.344+0000 7fba30b28640 1 --2- 172.21.15.1:0/3595907794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55996d7ec540 0x55996d7eea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:07.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.344+0000 7fba30b28640 1 -- 172.21.15.1:0/3595907794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55996d7e6b70 msgr2=0x55996d7e6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:07.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.344+0000 7fba30b28640 1 --2- 172.21.15.1:0/3595907794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55996d7e6b70 0x55996d7e6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:07.346 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.344+0000 7fba30b28640 1 -- 172.21.15.1:0/3595907794 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55996d6f1340 con 0x55996d7e74b0 2024-09-19T09:44:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.344+0000 7fba30b28640 1 --2- 172.21.15.1:0/4175743760 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fba180a3710 0x7fba180a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.345+0000 7fba30b28640 1 --2- 172.21.15.1:0/3595907794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55996d7e74b0 0x55996d7ebf70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fba28011510 tx=0x7fba280119d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c7072cc63418c17 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:07.347 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.346+0000 7fba30b28640 1 --2- 172.21.15.1:0/4175743760 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fba180a3710 0x7fba180a5bd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fba2801f000 tx=0x7fba28019ac0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.348+0000 7fba177fe640 1 -- 172.21.15.1:0/3595907794 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2800fb90 con 0x55996d7e74b0 2024-09-19T09:44:07.349 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.348+0000 7fba177fe640 1 -- 172.21.15.1:0/3595907794 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba2800fd30 con 0x55996d7e74b0 2024-09-19T09:44:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.349+0000 7fba36400740 1 -- 172.21.15.1:0/3595907794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55996d7e74b0 msgr2=0x55996d7ebf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:07.350 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.349+0000 7fba36400740 1 --2- 172.21.15.1:0/3595907794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55996d7e74b0 0x55996d7ebf70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fba28011510 tx=0x7fba280119d0 comp rx=0 tx=0).stop 2024-09-19T09:44:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.350+0000 7fba36400740 1 -- 172.21.15.1:0/3595907794 shutdown_connections 2024-09-19T09:44:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.350+0000 7fba36400740 1 --2- 172.21.15.1:0/3595907794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55996d7ec540 0x55996d7eea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.351+0000 7fba36400740 1 --2- 172.21.15.1:0/3595907794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55996d7e74b0 0x55996d7ebf70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.351+0000 7fba36400740 1 --2- 172.21.15.1:0/3595907794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55996d7e6b70 0x55996d7e6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.351+0000 7fba36400740 1 -- 172.21.15.1:0/3595907794 >> 172.21.15.1:0/3595907794 conn(0x55996d7e21e0 msgr2=0x55996d7e25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.353+0000 7fba36400740 1 -- 172.21.15.1:0/3595907794 shutdown_connections 2024-09-19T09:44:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.353+0000 7fba36400740 1 -- 172.21.15.1:0/3595907794 wait complete. 2024-09-19T09:44:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.354+0000 7fba36400740 1 -- start start 2024-09-19T09:44:07.355 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.354+0000 7fba36400740 1 Processor -- start 2024-09-19T09:44:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.354+0000 7fba36400740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55996d7e6b70 0x55996d7f0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.354+0000 7fba36400740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55996d7e74b0 0x55996d7f12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.354+0000 7fba36400740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55996d7ec540 0x55996d7f8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.354+0000 7fba36400740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55996d7ef500 con 0x55996d7e74b0 2024-09-19T09:44:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.354+0000 7fba36400740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55996d6d3290 con 0x55996d7ec540 2024-09-19T09:44:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.354+0000 7fba36400740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55996d7ef680 con 0x55996d7e6b70 2024-09-19T09:44:07.356 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.354+0000 7fba36400740 10 client.0 _ll_register_callbacks cb 0x55996d704140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:44:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.355+0000 7fba31b2a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55996d7ec540 0x55996d7f8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.355+0000 7fba31b2a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55996d7ec540 0x55996d7f8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:46680/0 (socket says 172.21.15.1:46680) 2024-09-19T09:44:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.355+0000 7fba31b2a640 1 -- 172.21.15.1:0/2055877643 learned_addr learned my addr 172.21.15.1:0/2055877643 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:07.357 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.355+0000 7fba30b28640 1 --2- 172.21.15.1:0/2055877643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55996d7e74b0 0x55996d7f12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.355+0000 7fba31b2a640 1 -- 172.21.15.1:0/2055877643 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55996d7e6b70 msgr2=0x55996d7f0db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:44:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.355+0000 7fba31b2a640 1 --2- 172.21.15.1:0/2055877643 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55996d7e6b70 0x55996d7f0db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.355+0000 7fba31b2a640 1 -- 172.21.15.1:0/2055877643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55996d7e74b0 msgr2=0x55996d7f12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.355+0000 7fba31b2a640 1 --2- 172.21.15.1:0/2055877643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55996d7e74b0 0x55996d7f12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.355+0000 7fba31b2a640 1 -- 172.21.15.1:0/2055877643 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55996d45d210 con 0x55996d7ec540 2024-09-19T09:44:07.358 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.356+0000 7fba31b2a640 1 --2- 172.21.15.1:0/2055877643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55996d7ec540 0x55996d7f8330 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fba2c065a40 tx=0x7fba2c09f670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5189c74392cc7e3f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:07.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.356+0000 7fba14ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:44:07.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.356+0000 7fba14ff9640 1 -- 172.21.15.1:0/2055877643 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2c097720 con 0x55996d7ec540 2024-09-19T09:44:07.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.356+0000 7fba14ff9640 1 -- 172.21.15.1:0/2055877643 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fba2c0978c0 con 0x55996d7ec540 2024-09-19T09:44:07.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.358+0000 7fba36400740 1 -- 172.21.15.1:0/2055877643 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba2800fd30 con 0x55996d7ec540 2024-09-19T09:44:07.360 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.359+0000 7fba14ff9640 1 -- 172.21.15.1:0/2055877643 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fba2c097ac0 con 0x55996d7ec540 2024-09-19T09:44:07.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.361+0000 7fba36400740 10 client.25838 fetch_fsmap learned FSMap version 19 2024-09-19T09:44:07.362 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.361+0000 7fba36400740 1 -- 172.21.15.1:0/2055877643 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55996d529620 con 0x55996d7ec540 2024-09-19T09:44:07.363 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.362+0000 7fba14ff9640 1 -- 172.21.15.1:0/2055877643 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba2800fd30 con 0x55996d7ec540 2024-09-19T09:44:07.364 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.363+0000 7fba14ff9640 1 -- 172.21.15.1:0/2055877643 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fba2c0b3420 con 0x55996d7ec540 2024-09-19T09:44:07.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.363+0000 7fba36400740 10 client.25838 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:44:07.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.363+0000 7fba36400740 10 client.25838 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:44:07.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.363+0000 7fba36400740 20 client.25838 populate_metadata read hostname 'smithi001' 2024-09-19T09:44:07.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.363+0000 7fba36400740 1 --2- 172.21.15.1:0/2055877643 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55996d7fce60 0x55996d7ff2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:07.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.363+0000 7fba36400740 4 client.25838 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:44:07.365 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.363+0000 7fba36400740 1 -- 172.21.15.1:0/2055877643 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55996d757a20 con 0x55996d7fce60 2024-09-19T09:44:07.372 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.370+0000 7fba31329640 1 --2- 172.21.15.1:0/2055877643 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55996d7fce60 0x55996d7ff2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:07.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.376+0000 7fba31329640 1 --2- 172.21.15.1:0/2055877643 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55996d7fce60 0x55996d7ff2c0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10c79c0bfe8d9255 server_cookie=be79355e155b9963 in_seq=0 out_seq=0 2024-09-19T09:44:07.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.377+0000 7fba14ff9640 10 client.25838 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:44:07.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.378+0000 7fba14ff9640 1 -- 172.21.15.1:0/2055877643 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55996d757a20 con 0x55996d7fce60 2024-09-19T09:44:07.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.378+0000 7fba14ff9640 10 client.25838 handle_command_reply: tid=0 2024-09-19T09:44:07.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.378+0000 7fba36400740 1 client.25838 shutdown 2024-09-19T09:44:07.382 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.380+0000 7fba36400740 1 -- 172.21.15.1:0/2055877643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55996d7ec540 msgr2=0x55996d7f8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:07.382 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.380+0000 7fba36400740 1 --2- 172.21.15.1:0/2055877643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55996d7ec540 0x55996d7f8330 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fba2c065a40 tx=0x7fba2c09f670 comp rx=0 tx=0).stop 2024-09-19T09:44:07.389 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.385+0000 7fba36400740 1 -- 172.21.15.1:0/2055877643 shutdown_connections 2024-09-19T09:44:07.390 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.385+0000 7fba36400740 1 --2- 172.21.15.1:0/2055877643 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55996d7fce60 0x55996d7ff2c0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:07.390 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.385+0000 7fba36400740 1 --2- 172.21.15.1:0/2055877643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55996d7ec540 0x55996d7f8330 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:07.391 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.385+0000 7fba36400740 1 --2- 172.21.15.1:0/2055877643 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55996d7e74b0 0x55996d7f12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:07.391 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.385+0000 7fba36400740 1 --2- 172.21.15.1:0/2055877643 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55996d7e6b70 0x55996d7f0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:07.391 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.385+0000 7fba36400740 1 -- 172.21.15.1:0/2055877643 >> 172.21.15.1:0/2055877643 conn(0x55996d7e21e0 msgr2=0x55996d7e39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:07.391 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.387+0000 7fba14ff9640 0 client.25838 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:44:07.393 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.392+0000 7fba36400740 1 -- 172.21.15.1:0/2055877643 shutdown_connections 2024-09-19T09:44:07.398 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.395+0000 7fba36400740 1 -- 172.21.15.1:0/2055877643 wait complete. 2024-09-19T09:44:07.399 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.397+0000 7fba36400740 20 client.25838 trim_cache size 0 max 16384 2024-09-19T09:44:07.429 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.427+0000 7fba36400740 1 Processor -- start 2024-09-19T09:44:07.430 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.427+0000 7fba36400740 1 -- start start 2024-09-19T09:44:07.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.428+0000 7fba36400740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55996d7e6b70 0x55996d7f0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:07.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.428+0000 7fba36400740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55996d7e74b0 0x55996d7f82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:07.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.428+0000 7fba31329640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55996d7e6b70 0x55996d7f0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:07.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.428+0000 7fba31329640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55996d7e6b70 0x55996d7f0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:46682/0 (socket says 172.21.15.1:46682) 2024-09-19T09:44:07.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.429+0000 7fba31329640 1 -- 172.21.15.1:0/2741321455 learned_addr learned my addr 172.21.15.1:0/2741321455 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:07.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.429+0000 7fba36400740 1 --2- 172.21.15.1:0/2741321455 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55996d7ec540 0x55996d7e85f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:07.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.429+0000 7fba36400740 1 -- 172.21.15.1:0/2741321455 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fba1000c510 con 0x55996d7e74b0 2024-09-19T09:44:07.434 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.429+0000 7fba31b2a640 1 --2- 172.21.15.1:0/2741321455 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55996d7ec540 0x55996d7e85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:07.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.429+0000 7fba36400740 1 -- 172.21.15.1:0/2741321455 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fba1000ece0 con 0x55996d7e6b70 2024-09-19T09:44:07.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.429+0000 7fba36400740 1 -- 172.21.15.1:0/2741321455 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fba1000cad0 con 0x55996d7ec540 2024-09-19T09:44:07.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.431+0000 7fba30b28640 1 --2- 172.21.15.1:0/2741321455 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55996d7e74b0 0x55996d7f82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:07.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.431+0000 7fba31329640 1 -- 172.21.15.1:0/2741321455 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55996d7ec540 msgr2=0x55996d7e85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:07.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.431+0000 7fba31329640 1 --2- 172.21.15.1:0/2741321455 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55996d7ec540 0x55996d7e85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:07.435 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.431+0000 7fba31329640 1 -- 172.21.15.1:0/2741321455 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55996d7e74b0 msgr2=0x55996d7f82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:07.436 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.431+0000 7fba31329640 1 --2- 172.21.15.1:0/2741321455 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55996d7e74b0 0x55996d7f82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:07.436 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.431+0000 7fba31329640 1 -- 172.21.15.1:0/2741321455 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55996d7e2000 con 0x55996d7e6b70 2024-09-19T09:44:07.436 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.432+0000 7fba31329640 1 --2- 172.21.15.1:0/2741321455 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55996d7e6b70 0x55996d7f0db0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fba1c0978a0 tx=0x7fba1c0ce040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0cc1ee96ed5e312 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:07.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.437+0000 7fba16ffd640 1 -- 172.21.15.1:0/2741321455 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1c0b9070 con 0x55996d7e6b70 2024-09-19T09:44:07.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.437+0000 7fba16ffd640 1 -- 172.21.15.1:0/2741321455 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba1c09f7f0 con 0x55996d7e6b70 2024-09-19T09:44:07.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.439+0000 7fba36400740 1 -- 172.21.15.1:0/2741321455 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55996d7e6b70 msgr2=0x55996d7f0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:07.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.439+0000 7fba36400740 1 --2- 172.21.15.1:0/2741321455 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55996d7e6b70 0x55996d7f0db0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fba1c0978a0 tx=0x7fba1c0ce040 comp rx=0 tx=0).stop 2024-09-19T09:44:07.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.441+0000 7fba36400740 1 -- 172.21.15.1:0/2741321455 shutdown_connections 2024-09-19T09:44:07.443 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.441+0000 7fba36400740 1 --2- 172.21.15.1:0/2741321455 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55996d7ec540 0x55996d7e85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:07.443 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.441+0000 7fba36400740 1 --2- 172.21.15.1:0/2741321455 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55996d7e74b0 0x55996d7f82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:07.443 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.441+0000 7fba36400740 1 --2- 172.21.15.1:0/2741321455 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55996d7e6b70 0x55996d7f0db0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:07.443 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.441+0000 7fba36400740 1 -- 172.21.15.1:0/2741321455 >> 172.21.15.1:0/2741321455 conn(0x55996d7e21e0 msgr2=0x55996d7dced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:07.445 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.444+0000 7fba36400740 1 -- 172.21.15.1:0/2741321455 shutdown_connections 2024-09-19T09:44:07.445 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.444+0000 7fba36400740 1 -- 172.21.15.1:0/2741321455 wait complete. 2024-09-19T09:44:07.446 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.445+0000 7fba36400740 1 -- start start 2024-09-19T09:44:07.446 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.445+0000 7fba36400740 1 Processor -- start 2024-09-19T09:44:07.447 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.446+0000 7fba36400740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55996d7e6b70 0x55996d7f7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:07.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.446+0000 7fba36400740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55996d7e74b0 0x55996d7f49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:07.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.446+0000 7fba31329640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55996d7e6b70 0x55996d7f7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:07.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.446+0000 7fba31329640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55996d7e6b70 0x55996d7f7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:41834/0 (socket says 172.21.15.1:41834) 2024-09-19T09:44:07.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.446+0000 7fba31329640 1 -- 172.21.15.1:0/1528579612 learned_addr learned my addr 172.21.15.1:0/1528579612 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:07.448 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.446+0000 7fba36400740 1 --2- 172.21.15.1:0/1528579612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55996d7ec540 0x55996d7f4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:07.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.446+0000 7fba30b28640 1 --2- 172.21.15.1:0/1528579612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55996d7e74b0 0x55996d7f49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:07.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.447+0000 7fba36400740 1 -- 172.21.15.1:0/1528579612 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fba1000d1a0 con 0x55996d7ec540 2024-09-19T09:44:07.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.447+0000 7fba31b2a640 1 --2- 172.21.15.1:0/1528579612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55996d7ec540 0x55996d7f4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:07.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.447+0000 7fba36400740 1 -- 172.21.15.1:0/1528579612 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fba1000e610 con 0x55996d7e74b0 2024-09-19T09:44:07.449 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.447+0000 7fba36400740 1 -- 172.21.15.1:0/1528579612 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fba1000d870 con 0x55996d7e6b70 2024-09-19T09:44:07.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.447+0000 7fba36400740 10 client.0 _ll_register_callbacks cb 0x7fba2c068a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:44:07.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.448+0000 7fba31329640 1 -- 172.21.15.1:0/1528579612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55996d7e74b0 msgr2=0x55996d7f49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:07.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.448+0000 7fba31329640 1 --2- 172.21.15.1:0/1528579612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55996d7e74b0 0x55996d7f49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:07.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.448+0000 7fba31329640 1 -- 172.21.15.1:0/1528579612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55996d7ec540 msgr2=0x55996d7f4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:07.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.448+0000 7fba31329640 1 --2- 172.21.15.1:0/1528579612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55996d7ec540 0x55996d7f4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:07.450 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.448+0000 7fba31329640 1 -- 172.21.15.1:0/1528579612 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55996d7f5460 con 0x55996d7e6b70 2024-09-19T09:44:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.449+0000 7fba31329640 1 --2- 172.21.15.1:0/1528579612 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55996d7e6b70 0x55996d7f7f10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fba1c00be10 tx=0x7fba1c010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=729ef3e178c0a180 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.449+0000 7fba14ff9640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-19T09:44:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.449+0000 7fba14ff9640 1 -- 172.21.15.1:0/1528579612 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1c0b9070 con 0x55996d7e6b70 2024-09-19T09:44:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.449+0000 7fba36400740 1 -- 172.21.15.1:0/1528579612 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55996d751d70 con 0x55996d7e6b70 2024-09-19T09:44:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.449+0000 7fba14ff9640 1 -- 172.21.15.1:0/1528579612 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fba1c0103e0 con 0x55996d7e6b70 2024-09-19T09:44:07.452 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.449+0000 7fba14ff9640 1 -- 172.21.15.1:0/1528579612 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fba1c015040 con 0x55996d7e6b70 2024-09-19T09:44:07.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.454+0000 7fba36400740 10 client.25675 fetch_fsmap learned FSMap version 19 2024-09-19T09:44:07.455 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.454+0000 7fba36400740 1 -- 172.21.15.1:0/1528579612 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55996d866c10 con 0x55996d7e6b70 2024-09-19T09:44:07.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.455+0000 7fba14ff9640 1 -- 172.21.15.1:0/1528579612 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55996d751d70 con 0x55996d7e6b70 2024-09-19T09:44:07.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.455+0000 7fba14ff9640 1 -- 172.21.15.1:0/1528579612 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fba1c09a920 con 0x55996d7e6b70 2024-09-19T09:44:07.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.455+0000 7fba36400740 10 client.25675 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:44:07.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.455+0000 7fba36400740 10 client.25675 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:44:07.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.455+0000 7fba36400740 20 client.25675 populate_metadata read hostname 'smithi001' 2024-09-19T09:44:07.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.455+0000 7fba36400740 1 --2- 172.21.15.1:0/1528579612 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55996d867590 0x55996d8699b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:07.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.455+0000 7fba36400740 4 client.25675 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:44:07.457 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.455+0000 7fba36400740 1 -- 172.21.15.1:0/1528579612 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55996d6ce900 con 0x55996d867590 2024-09-19T09:44:07.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.456+0000 7fba30b28640 1 --2- 172.21.15.1:0/1528579612 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55996d867590 0x55996d8699b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:07.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.456+0000 7fba14ff9640 10 client.25675 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:44:07.458 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:07.457+0000 7fba30b28640 1 --2- 172.21.15.1:0/1528579612 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55996d867590 0x55996d8699b0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54a89fd1c2880624 server_cookie=cdf22902f2ffc79b in_seq=0 out_seq=0 2024-09-19T09:44:07.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:07 smithi001 ceph-mon[31225]: pgmap v519: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 62 MiB/s wr, 12.06k op/s 2024-09-19T09:44:08.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:07 smithi022 ceph-mon[35583]: pgmap v519: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 62 MiB/s wr, 12.06k op/s 2024-09-19T09:44:08.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:07 smithi121 ceph-mon[35577]: pgmap v519: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 62 MiB/s wr, 12.06k op/s 2024-09-19T09:44:08.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:08.436+0000 7fba14ff9640 1 -- 172.21.15.1:0/1528579612 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55996d6ce900 con 0x55996d867590 2024-09-19T09:44:08.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:08.436+0000 7fba14ff9640 10 client.25675 handle_command_reply: tid=0 2024-09-19T09:44:08.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:08.436+0000 7fba36400740 1 client.25675 shutdown 2024-09-19T09:44:08.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:08.437+0000 7fba36400740 1 -- 172.21.15.1:0/1528579612 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55996d7e6b70 msgr2=0x55996d7f7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:08.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:08.437+0000 7fba36400740 1 --2- 172.21.15.1:0/1528579612 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55996d7e6b70 0x55996d7f7f10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fba1c00be10 tx=0x7fba1c010740 comp rx=0 tx=0).stop 2024-09-19T09:44:08.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:08.437+0000 7fba36400740 1 -- 172.21.15.1:0/1528579612 shutdown_connections 2024-09-19T09:44:08.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:08.437+0000 7fba36400740 1 --2- 172.21.15.1:0/1528579612 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55996d867590 0x55996d8699b0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:08.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:08.437+0000 7fba36400740 1 --2- 172.21.15.1:0/1528579612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55996d7ec540 0x55996d7f4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:08.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:08.437+0000 7fba36400740 1 --2- 172.21.15.1:0/1528579612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55996d7e74b0 0x55996d7f49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:08.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:08.437+0000 7fba36400740 1 --2- 172.21.15.1:0/1528579612 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55996d7e6b70 0x55996d7f7f10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:08.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:08.437+0000 7fba36400740 1 -- 172.21.15.1:0/1528579612 >> 172.21.15.1:0/1528579612 conn(0x55996d7e21e0 msgr2=0x55996d7e85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:08.439 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:08.437+0000 7fba14ff9640 0 client.25675 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:44:08.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:08.437+0000 7fba36400740 1 -- 172.21.15.1:0/1528579612 shutdown_connections 2024-09-19T09:44:08.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:08.437+0000 7fba36400740 1 -- 172.21.15.1:0/1528579612 wait complete. 2024-09-19T09:44:08.440 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:08.438+0000 7fba36400740 20 client.25675 trim_cache size 0 max 16384 2024-09-19T09:44:08.441 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:44:08.441 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:44:08.441 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:44:08.441 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:44:08.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:08.439+0000 7fba3232b640 1 -- 172.21.15.1:0/4175743760 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fba180a3710 msgr2=0x7fba180a5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:08.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:08.439+0000 7fba3232b640 1 --2- 172.21.15.1:0/4175743760 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fba180a3710 0x7fba180a5bd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fba2801f000 tx=0x7fba28019ac0 comp rx=0 tx=0).stop 2024-09-19T09:44:08.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:08.439+0000 7fba3232b640 1 -- 172.21.15.1:0/4175743760 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba24094760 msgr2=0x7fba241297a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:08.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:08.439+0000 7fba3232b640 1 --2- 172.21.15.1:0/4175743760 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba24094760 0x7fba241297a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fba1c00b450 tx=0x7fba1c00b910 comp rx=0 tx=0).stop 2024-09-19T09:44:08.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:08.439+0000 7fba3232b640 1 -- 172.21.15.1:0/4175743760 shutdown_connections 2024-09-19T09:44:08.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:08.439+0000 7fba3232b640 1 --2- 172.21.15.1:0/4175743760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fba24095b10 0x7fba24130d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:08.442 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:08.439+0000 7fba3232b640 1 --2- 172.21.15.1:0/4175743760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba24095100 0x7fba24129ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:08.443 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:08.439+0000 7fba3232b640 1 --2- 172.21.15.1:0/4175743760 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fba180a3710 0x7fba180a5bd0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:08.443 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:08.439+0000 7fba3232b640 1 --2- 172.21.15.1:0/4175743760 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba24094760 0x7fba241297a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:08.443 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:08.439+0000 7fba3232b640 1 -- 172.21.15.1:0/4175743760 >> 172.21.15.1:0/4175743760 conn(0x7fba2408f420 msgr2=0x7fba24090b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:08.443 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:08.439+0000 7fba3232b640 1 -- 172.21.15.1:0/4175743760 shutdown_connections 2024-09-19T09:44:08.443 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:08.440+0000 7fba3232b640 1 -- 172.21.15.1:0/4175743760 wait complete. 2024-09-19T09:44:09.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:09 smithi001 ceph-mon[31225]: pgmap v520: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 72 MiB/s wr, 14.22k op/s 2024-09-19T09:44:10.117 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:09 smithi022 ceph-mon[35583]: pgmap v520: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 72 MiB/s wr, 14.22k op/s 2024-09-19T09:44:10.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:09 smithi121 ceph-mon[35577]: pgmap v520: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 72 MiB/s wr, 14.22k op/s 2024-09-19T09:44:11.980 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:11 smithi001 ceph-mon[31225]: pgmap v521: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 52 MiB/s wr, 10.40k op/s 2024-09-19T09:44:12.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:11 smithi022 ceph-mon[35583]: pgmap v521: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 52 MiB/s wr, 10.40k op/s 2024-09-19T09:44:12.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:11 smithi121 ceph-mon[35577]: pgmap v521: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 52 MiB/s wr, 10.40k op/s 2024-09-19T09:44:13.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.978+0000 7fe778c9a640 1 -- 172.21.15.1:0/3682479942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe774102570 msgr2=0x7fe7741029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:13.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.978+0000 7fe778c9a640 1 --2- 172.21.15.1:0/3682479942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe774102570 0x7fe7741029b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fe768009900 tx=0x7fe76802a480 comp rx=0 tx=0).stop 2024-09-19T09:44:13.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.979+0000 7fe778c9a640 1 -- 172.21.15.1:0/3682479942 shutdown_connections 2024-09-19T09:44:13.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.979+0000 7fe778c9a640 1 --2- 172.21.15.1:0/3682479942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe774102ef0 0x7fe77410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.979+0000 7fe778c9a640 1 --2- 172.21.15.1:0/3682479942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe774102570 0x7fe7741029b0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.979+0000 7fe778c9a640 1 --2- 172.21.15.1:0/3682479942 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe774100e20 0x7fe774101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.979+0000 7fe778c9a640 1 -- 172.21.15.1:0/3682479942 >> 172.21.15.1:0/3682479942 conn(0x7fe7740fc7d0 msgr2=0x7fe7740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:13.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.979+0000 7fe778c9a640 1 -- 172.21.15.1:0/3682479942 shutdown_connections 2024-09-19T09:44:13.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.979+0000 7fe778c9a640 1 -- 172.21.15.1:0/3682479942 wait complete. 2024-09-19T09:44:13.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.980+0000 7fe778c9a640 1 Processor -- start 2024-09-19T09:44:13.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.980+0000 7fe778c9a640 1 -- start start 2024-09-19T09:44:13.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.980+0000 7fe778c9a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe774100e20 0x7fe77419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:13.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.980+0000 7fe778c9a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe774102570 0x7fe77419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:13.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.980+0000 7fe778c9a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe774102ef0 0x7fe77419ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:13.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.980+0000 7fe778c9a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe774110f80 con 0x7fe774100e20 2024-09-19T09:44:13.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.980+0000 7fe778c9a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe774110e00 con 0x7fe774102ef0 2024-09-19T09:44:13.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.980+0000 7fe778c9a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe774111100 con 0x7fe774102570 2024-09-19T09:44:13.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.980+0000 7fe77259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe774100e20 0x7fe77419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:13.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.980+0000 7fe77259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe774100e20 0x7fe77419a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46236/0 (socket says 172.21.15.1:46236) 2024-09-19T09:44:13.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.980+0000 7fe77259c640 1 -- 172.21.15.1:0/3736618824 learned_addr learned my addr 172.21.15.1:0/3736618824 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:13.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.980+0000 7fe771d9b640 1 --2- 172.21.15.1:0/3736618824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe774102570 0x7fe77419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:13.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.980+0000 7fe772d9d640 1 --2- 172.21.15.1:0/3736618824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe774102ef0 0x7fe77419ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:13.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.980+0000 7fe77259c640 1 -- 172.21.15.1:0/3736618824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe774102570 msgr2=0x7fe77419abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:13.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.980+0000 7fe77259c640 1 --2- 172.21.15.1:0/3736618824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe774102570 0x7fe77419abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.980+0000 7fe77259c640 1 -- 172.21.15.1:0/3736618824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe774102ef0 msgr2=0x7fe77419ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:13.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.980+0000 7fe77259c640 1 --2- 172.21.15.1:0/3736618824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe774102ef0 0x7fe77419ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.980+0000 7fe77259c640 1 -- 172.21.15.1:0/3736618824 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe77419f640 con 0x7fe774100e20 2024-09-19T09:44:13.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.981+0000 7fe77259c640 1 --2- 172.21.15.1:0/3736618824 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe774100e20 0x7fe77419a690 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe76400d950 tx=0x7fe76400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:13.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.981+0000 7fe7637fe640 1 -- 172.21.15.1:0/3736618824 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe764017070 con 0x7fe774100e20 2024-09-19T09:44:13.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.981+0000 7fe7637fe640 1 -- 172.21.15.1:0/3736618824 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe764009c30 con 0x7fe774100e20 2024-09-19T09:44:13.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.981+0000 7fe778c9a640 1 -- 172.21.15.1:0/3736618824 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe77419f930 con 0x7fe774100e20 2024-09-19T09:44:13.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.981+0000 7fe7637fe640 1 -- 172.21.15.1:0/3736618824 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76400f6b0 con 0x7fe774100e20 2024-09-19T09:44:13.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.981+0000 7fe778c9a640 1 -- 172.21.15.1:0/3736618824 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7741a7210 con 0x7fe774100e20 2024-09-19T09:44:13.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.983+0000 7fe7637fe640 1 -- 172.21.15.1:0/3736618824 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fe7640109d0 con 0x7fe774100e20 2024-09-19T09:44:13.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.984+0000 7fe7637fe640 1 --2- 172.21.15.1:0/3736618824 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe75c0a3240 0x7fe75c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:13.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.984+0000 7fe771d9b640 1 --2- 172.21.15.1:0/3736618824 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe75c0a3240 0x7fe75c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:13.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.984+0000 7fe7637fe640 1 -- 172.21.15.1:0/3736618824 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fe7640cf560 con 0x7fe774100e20 2024-09-19T09:44:13.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.984+0000 7fe771d9b640 1 --2- 172.21.15.1:0/3736618824 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe75c0a3240 0x7fe75c0a5700 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe768009230 tx=0x7fe7680058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:13.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.985+0000 7fe77b073740 1 Processor -- start 2024-09-19T09:44:13.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.985+0000 7fe77b073740 1 -- start start 2024-09-19T09:44:13.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.985+0000 7fe77b073740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a459a7d760 0x55a459a7db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:13.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.985+0000 7fe77b073740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a459a7e080 0x55a459a88400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:13.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.985+0000 7fe77b073740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a459a88940 0x55a459a8ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:13.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.985+0000 7fe77b073740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a4599e32a0 con 0x55a459a88940 2024-09-19T09:44:13.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.985+0000 7fe77b073740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a45998ab10 con 0x55a459a7d760 2024-09-19T09:44:13.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.985+0000 7fe77b073740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a4599df260 con 0x55a459a7e080 2024-09-19T09:44:13.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.985+0000 7fe772d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a459a88940 0x55a459a8ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:13.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.985+0000 7fe772d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a459a88940 0x55a459a8ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46238/0 (socket says 172.21.15.1:46238) 2024-09-19T09:44:13.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.985+0000 7fe772d9d640 1 -- 172.21.15.1:0/3126963027 learned_addr learned my addr 172.21.15.1:0/3126963027 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:13.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.985+0000 7fe77259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a459a7d760 0x55a459a7db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:13.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.985+0000 7fe771d9b640 1 --2- 172.21.15.1:0/3126963027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a459a7e080 0x55a459a88400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:13.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.986+0000 7fe772d9d640 1 -- 172.21.15.1:0/3126963027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a459a7e080 msgr2=0x55a459a88400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:13.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.986+0000 7fe772d9d640 1 --2- 172.21.15.1:0/3126963027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a459a7e080 0x55a459a88400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.986+0000 7fe772d9d640 1 -- 172.21.15.1:0/3126963027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a459a7d760 msgr2=0x55a459a7db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:13.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.986+0000 7fe772d9d640 1 --2- 172.21.15.1:0/3126963027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a459a7d760 0x55a459a7db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.986+0000 7fe772d9d640 1 -- 172.21.15.1:0/3126963027 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a459754b90 con 0x55a459a88940 2024-09-19T09:44:13.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.986+0000 7fe772d9d640 1 --2- 172.21.15.1:0/3126963027 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a459a88940 0x55a459a8ad30 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe76c009ee0 tx=0x7fe76c010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f06e83ae0d6a9b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:13.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.986+0000 7fe760ff9640 1 -- 172.21.15.1:0/3126963027 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76c016070 con 0x55a459a88940 2024-09-19T09:44:13.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.986+0000 7fe760ff9640 1 -- 172.21.15.1:0/3126963027 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe76c004d20 con 0x55a459a88940 2024-09-19T09:44:13.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.986+0000 7fe760ff9640 1 -- 172.21.15.1:0/3126963027 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76c012790 con 0x55a459a88940 2024-09-19T09:44:13.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.987+0000 7fe77b073740 1 -- 172.21.15.1:0/3126963027 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a459a88940 msgr2=0x55a459a8ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:13.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.987+0000 7fe77b073740 1 --2- 172.21.15.1:0/3126963027 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a459a88940 0x55a459a8ad30 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe76c009ee0 tx=0x7fe76c010740 comp rx=0 tx=0).stop 2024-09-19T09:44:13.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.987+0000 7fe77b073740 1 -- 172.21.15.1:0/3126963027 shutdown_connections 2024-09-19T09:44:13.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.987+0000 7fe77b073740 1 --2- 172.21.15.1:0/3126963027 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a459a88940 0x55a459a8ad30 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.987+0000 7fe77b073740 1 --2- 172.21.15.1:0/3126963027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a459a7e080 0x55a459a88400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.987+0000 7fe77b073740 1 --2- 172.21.15.1:0/3126963027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a459a7d760 0x55a459a7db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.987+0000 7fe77b073740 1 -- 172.21.15.1:0/3126963027 >> 172.21.15.1:0/3126963027 conn(0x55a459a79cf0 msgr2=0x55a459a7a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:13.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.987+0000 7fe77b073740 1 -- 172.21.15.1:0/3126963027 shutdown_connections 2024-09-19T09:44:13.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.987+0000 7fe77b073740 1 -- 172.21.15.1:0/3126963027 wait complete. 2024-09-19T09:44:13.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.987+0000 7fe77b073740 1 -- start start 2024-09-19T09:44:13.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.987+0000 7fe77b073740 1 Processor -- start 2024-09-19T09:44:13.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.987+0000 7fe77b073740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a459a7d760 0x55a459a85870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:13.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.987+0000 7fe77b073740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a459a7e080 0x55a459a85db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:13.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.987+0000 7fe77b073740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a459a88940 0x55a459a862f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:13.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.987+0000 7fe77b073740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55a459a8b510 con 0x55a459a88940 2024-09-19T09:44:13.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.988+0000 7fe77b073740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55a45996b6e0 con 0x55a459a7d760 2024-09-19T09:44:13.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.988+0000 7fe77b073740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a459a8b690 con 0x55a459a7e080 2024-09-19T09:44:13.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.988+0000 7fe772d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a459a88940 0x55a459a862f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:13.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.988+0000 7fe77b073740 10 client.0 _ll_register_callbacks cb 0x55a45998fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:44:13.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.988+0000 7fe772d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a459a88940 0x55a459a862f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46254/0 (socket says 172.21.15.1:46254) 2024-09-19T09:44:13.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.988+0000 7fe772d9d640 1 -- 172.21.15.1:0/2521600107 learned_addr learned my addr 172.21.15.1:0/2521600107 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:13.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.988+0000 7fe77259c640 1 --2- 172.21.15.1:0/2521600107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a459a7d760 0x55a459a85870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:13.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.988+0000 7fe771d9b640 1 --2- 172.21.15.1:0/2521600107 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a459a7e080 0x55a459a85db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:13.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.988+0000 7fe772d9d640 1 -- 172.21.15.1:0/2521600107 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a459a7e080 msgr2=0x55a459a85db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:13.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.988+0000 7fe772d9d640 1 --2- 172.21.15.1:0/2521600107 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a459a7e080 0x55a459a85db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.988+0000 7fe772d9d640 1 -- 172.21.15.1:0/2521600107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a459a7d760 msgr2=0x55a459a85870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:13.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.988+0000 7fe772d9d640 1 --2- 172.21.15.1:0/2521600107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a459a7d760 0x55a459a85870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.988+0000 7fe772d9d640 1 -- 172.21.15.1:0/2521600107 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a459a94a50 con 0x55a459a88940 2024-09-19T09:44:13.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.988+0000 7fe772d9d640 1 --2- 172.21.15.1:0/2521600107 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a459a88940 0x55a459a862f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe76c006010 tx=0x7fe76c009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca67dc0da7b7203 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:13.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.988+0000 7fe759ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:44:13.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.988+0000 7fe759ffb640 1 -- 172.21.15.1:0/2521600107 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76c028060 con 0x55a459a88940 2024-09-19T09:44:13.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.988+0000 7fe759ffb640 1 -- 172.21.15.1:0/2521600107 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fe76c004fe0 con 0x55a459a88940 2024-09-19T09:44:13.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.988+0000 7fe77b073740 1 -- 172.21.15.1:0/2521600107 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe76c004d20 con 0x55a459a88940 2024-09-19T09:44:13.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.989+0000 7fe759ffb640 1 -- 172.21.15.1:0/2521600107 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe76c016070 con 0x55a459a88940 2024-09-19T09:44:13.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.989+0000 7fe77b073740 10 client.16185 fetch_fsmap learned FSMap version 19 2024-09-19T09:44:13.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.989+0000 7fe77b073740 1 -- 172.21.15.1:0/2521600107 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55a459a973e0 con 0x55a459a88940 2024-09-19T09:44:13.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.989+0000 7fe759ffb640 1 -- 172.21.15.1:0/2521600107 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe76c004d20 con 0x55a459a88940 2024-09-19T09:44:13.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.989+0000 7fe759ffb640 1 -- 172.21.15.1:0/2521600107 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe76c02d070 con 0x55a459a88940 2024-09-19T09:44:13.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.989+0000 7fe77b073740 10 client.16185 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:44:13.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.989+0000 7fe77b073740 10 client.16185 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:44:13.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.989+0000 7fe77b073740 20 client.16185 populate_metadata read hostname 'smithi001' 2024-09-19T09:44:13.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.989+0000 7fe77b073740 1 --2- 172.21.15.1:0/2521600107 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55a459a988a0 0x55a459a9ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:13.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.989+0000 7fe77b073740 4 client.16185 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:44:13.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.989+0000 7fe77b073740 1 -- 172.21.15.1:0/2521600107 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a4599f09d0 con 0x55a459a988a0 2024-09-19T09:44:13.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.989+0000 7fe77259c640 1 --2- 172.21.15.1:0/2521600107 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55a459a988a0 0x55a459a9ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:13.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.990+0000 7fe77259c640 1 --2- 172.21.15.1:0/2521600107 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55a459a988a0 0x55a459a9ac90 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=215e8e5e88302858 server_cookie=b62b4cdad0db105b in_seq=0 out_seq=0 2024-09-19T09:44:13.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.990+0000 7fe759ffb640 10 client.16185 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:44:13.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.991+0000 7fe759ffb640 1 -- 172.21.15.1:0/2521600107 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a4599f09d0 con 0x55a459a988a0 2024-09-19T09:44:13.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.991+0000 7fe759ffb640 10 client.16185 handle_command_reply: tid=0 2024-09-19T09:44:13.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.991+0000 7fe77b073740 1 client.16185 shutdown 2024-09-19T09:44:13.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.991+0000 7fe77b073740 1 -- 172.21.15.1:0/2521600107 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a459a88940 msgr2=0x55a459a862f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:13.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.991+0000 7fe77b073740 1 --2- 172.21.15.1:0/2521600107 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a459a88940 0x55a459a862f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe76c006010 tx=0x7fe76c009c50 comp rx=0 tx=0).stop 2024-09-19T09:44:13.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.991+0000 7fe77b073740 1 -- 172.21.15.1:0/2521600107 shutdown_connections 2024-09-19T09:44:13.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.991+0000 7fe77b073740 1 --2- 172.21.15.1:0/2521600107 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55a459a988a0 0x55a459a9ac90 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.991+0000 7fe77b073740 1 --2- 172.21.15.1:0/2521600107 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a459a88940 0x55a459a862f0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.991+0000 7fe77b073740 1 --2- 172.21.15.1:0/2521600107 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a459a7e080 0x55a459a85db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.991+0000 7fe759ffb640 0 client.16185 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:44:13.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.991+0000 7fe77b073740 1 --2- 172.21.15.1:0/2521600107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a459a7d760 0x55a459a85870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.991+0000 7fe77b073740 1 -- 172.21.15.1:0/2521600107 >> 172.21.15.1:0/2521600107 conn(0x55a459a79cf0 msgr2=0x55a459a78e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:13.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.991+0000 7fe77b073740 1 -- 172.21.15.1:0/2521600107 shutdown_connections 2024-09-19T09:44:13.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.991+0000 7fe77b073740 1 -- 172.21.15.1:0/2521600107 wait complete. 2024-09-19T09:44:13.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:11.991+0000 7fe77b073740 20 client.16185 trim_cache size 0 max 16384 2024-09-19T09:44:13.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.025+0000 7fe77b073740 1 Processor -- start 2024-09-19T09:44:13.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.027+0000 7fe77b073740 1 -- start start 2024-09-19T09:44:13.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.027+0000 7fe77b073740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a459a7d760 0x55a459a78d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:13.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.027+0000 7fe77b073740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a459a7e080 0x55a459aa0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:13.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.027+0000 7fe77b073740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a459a88940 0x55a459aa0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:13.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.027+0000 7fe77b073740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe7741ad830 con 0x55a459a7d760 2024-09-19T09:44:13.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.027+0000 7fe77b073740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe7741b00d0 con 0x55a459a88940 2024-09-19T09:44:13.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.027+0000 7fe77b073740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe7741adec0 con 0x55a459a7e080 2024-09-19T09:44:13.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.029+0000 7fe77259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a459a7d760 0x55a459a78d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:13.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.029+0000 7fe77259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a459a7d760 0x55a459a78d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46256/0 (socket says 172.21.15.1:46256) 2024-09-19T09:44:13.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.029+0000 7fe77259c640 1 -- 172.21.15.1:0/1686965702 learned_addr learned my addr 172.21.15.1:0/1686965702 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:13.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.029+0000 7fe772d9d640 1 --2- 172.21.15.1:0/1686965702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a459a88940 0x55a459aa0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:13.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.030+0000 7fe77259c640 1 -- 172.21.15.1:0/1686965702 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a459a7e080 msgr2=0x55a459aa0230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:44:13.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.030+0000 7fe77259c640 1 --2- 172.21.15.1:0/1686965702 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a459a7e080 0x55a459aa0230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.030+0000 7fe77259c640 1 -- 172.21.15.1:0/1686965702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a459a88940 msgr2=0x55a459aa0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:13.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.030+0000 7fe77259c640 1 --2- 172.21.15.1:0/1686965702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a459a88940 0x55a459aa0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.030+0000 7fe77259c640 1 -- 172.21.15.1:0/1686965702 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a459a75260 con 0x55a459a7d760 2024-09-19T09:44:13.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.030+0000 7fe77259c640 1 --2- 172.21.15.1:0/1686965702 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a459a7d760 0x55a459a78d60 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe76409bb10 tx=0x7fe764086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e75ba978cb0346 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:13.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.031+0000 7fe75bfff640 1 -- 172.21.15.1:0/1686965702 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe764020040 con 0x55a459a7d760 2024-09-19T09:44:13.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.031+0000 7fe75bfff640 1 -- 172.21.15.1:0/1686965702 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7640a47f0 con 0x55a459a7d760 2024-09-19T09:44:13.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.032+0000 7fe77b073740 1 -- 172.21.15.1:0/1686965702 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a459a7d760 msgr2=0x55a459a78d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:13.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.032+0000 7fe77b073740 1 --2- 172.21.15.1:0/1686965702 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a459a7d760 0x55a459a78d60 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe76409bb10 tx=0x7fe764086040 comp rx=0 tx=0).stop 2024-09-19T09:44:13.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.038+0000 7fe77b073740 1 -- 172.21.15.1:0/1686965702 shutdown_connections 2024-09-19T09:44:13.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.038+0000 7fe77b073740 1 --2- 172.21.15.1:0/1686965702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a459a88940 0x55a459aa0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.038+0000 7fe77b073740 1 --2- 172.21.15.1:0/1686965702 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a459a7e080 0x55a459aa0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.038+0000 7fe77b073740 1 --2- 172.21.15.1:0/1686965702 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a459a7d760 0x55a459a78d60 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.038+0000 7fe77b073740 1 -- 172.21.15.1:0/1686965702 >> 172.21.15.1:0/1686965702 conn(0x55a459a79cf0 msgr2=0x55a459a78650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:13.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.043+0000 7fe77b073740 1 -- 172.21.15.1:0/1686965702 shutdown_connections 2024-09-19T09:44:13.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.045+0000 7fe77b073740 1 -- 172.21.15.1:0/1686965702 wait complete. 2024-09-19T09:44:13.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.045+0000 7fe77b073740 1 -- start start 2024-09-19T09:44:13.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.045+0000 7fe77b073740 1 Processor -- start 2024-09-19T09:44:13.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.046+0000 7fe77b073740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a459a7d760 0x55a459a8f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:13.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.046+0000 7fe77b073740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a459a7e080 0x55a459a8fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:13.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.046+0000 7fe77b073740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a459a88940 0x55a459a90360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:13.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.046+0000 7fe77b073740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe7741ae590 con 0x55a459a7e080 2024-09-19T09:44:13.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.046+0000 7fe77b073740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe7741afa00 con 0x55a459a88940 2024-09-19T09:44:13.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.046+0000 7fe77b073740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe7741aec60 con 0x55a459a7d760 2024-09-19T09:44:13.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.046+0000 7fe77b073740 10 client.0 _ll_register_callbacks cb 0x7fe76c009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:44:13.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.046+0000 7fe772d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a459a88940 0x55a459a90360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:13.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.046+0000 7fe772d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a459a88940 0x55a459a90360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:46754/0 (socket says 172.21.15.1:46754) 2024-09-19T09:44:13.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.047+0000 7fe772d9d640 1 -- 172.21.15.1:0/2653489180 learned_addr learned my addr 172.21.15.1:0/2653489180 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:13.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.047+0000 7fe772d9d640 1 -- 172.21.15.1:0/2653489180 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a459a7d760 msgr2=0x55a459a8f8e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:44:13.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.047+0000 7fe772d9d640 1 --2- 172.21.15.1:0/2653489180 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a459a7d760 0x55a459a8f8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.047+0000 7fe772d9d640 1 -- 172.21.15.1:0/2653489180 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a459a7e080 msgr2=0x55a459a8fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:13.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.047+0000 7fe772d9d640 1 --2- 172.21.15.1:0/2653489180 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a459a7e080 0x55a459a8fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:13.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.047+0000 7fe772d9d640 1 -- 172.21.15.1:0/2653489180 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a459a90b90 con 0x55a459a88940 2024-09-19T09:44:13.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.047+0000 7fe772d9d640 1 --2- 172.21.15.1:0/2653489180 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a459a88940 0x55a459a90360 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe76c012a40 tx=0x7fe76c012a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d14a6cf7955cc8e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:13.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.047+0000 7fe759ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:44:13.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.048+0000 7fe759ffb640 1 -- 172.21.15.1:0/2653489180 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe76c033070 con 0x55a459a88940 2024-09-19T09:44:13.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.048+0000 7fe77b073740 1 -- 172.21.15.1:0/2653489180 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7640a47f0 con 0x55a459a88940 2024-09-19T09:44:13.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.048+0000 7fe759ffb640 1 -- 172.21.15.1:0/2653489180 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fe76c020040 con 0x55a459a88940 2024-09-19T09:44:13.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.048+0000 7fe759ffb640 1 -- 172.21.15.1:0/2653489180 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe76c03f050 con 0x55a459a88940 2024-09-19T09:44:13.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.050+0000 7fe77b073740 10 client.25862 fetch_fsmap learned FSMap version 19 2024-09-19T09:44:13.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.050+0000 7fe77b073740 1 -- 172.21.15.1:0/2653489180 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55a459b1d140 con 0x55a459a88940 2024-09-19T09:44:13.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.053+0000 7fe759ffb640 1 -- 172.21.15.1:0/2653489180 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe7640a47f0 con 0x55a459a88940 2024-09-19T09:44:13.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.053+0000 7fe759ffb640 1 -- 172.21.15.1:0/2653489180 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fe76c02d070 con 0x55a459a88940 2024-09-19T09:44:13.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.053+0000 7fe77b073740 10 client.25862 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:44:13.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.053+0000 7fe77b073740 10 client.25862 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:44:13.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.053+0000 7fe77b073740 20 client.25862 populate_metadata read hostname 'smithi001' 2024-09-19T09:44:13.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.053+0000 7fe77b073740 1 --2- 172.21.15.1:0/2653489180 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55a459b1d8d0 0x55a459b1fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:13.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.053+0000 7fe77b073740 4 client.25862 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}] 2024-09-19T09:44:13.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.053+0000 7fe77b073740 1 -- 172.21.15.1:0/2653489180 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}) -- 0x55a4599ead20 con 0x55a459b1d8d0 2024-09-19T09:44:13.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.055+0000 7fe77259c640 1 --2- 172.21.15.1:0/2653489180 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55a459b1d8d0 0x55a459b1fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:13.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.062+0000 7fe77259c640 1 --2- 172.21.15.1:0/2653489180 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55a459b1d8d0 0x55a459b1fd10 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8524a4a63cdade19 server_cookie=5f68de933e37399a in_seq=0 out_seq=0 2024-09-19T09:44:13.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:12.062+0000 7fe759ffb640 10 client.25862 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:44:13.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:13 smithi001 ceph-mon[31225]: pgmap v522: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 60 MiB/s wr, 12.05k op/s 2024-09-19T09:44:14.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:13 smithi022 ceph-mon[35583]: pgmap v522: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 60 MiB/s wr, 12.05k op/s 2024-09-19T09:44:14.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:13 smithi121 ceph-mon[35577]: pgmap v522: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 60 MiB/s wr, 12.05k op/s 2024-09-19T09:44:15.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:15 smithi001 ceph-mon[31225]: pgmap v523: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 67 MiB/s wr, 13.80k op/s 2024-09-19T09:44:16.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:15 smithi022 ceph-mon[35583]: pgmap v523: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 67 MiB/s wr, 13.80k op/s 2024-09-19T09:44:16.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:15 smithi121 ceph-mon[35577]: pgmap v523: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 67 MiB/s wr, 13.80k op/s 2024-09-19T09:44:17.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:17.499+0000 7fe759ffb640 1 -- 172.21.15.1:0/2653489180 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55a4599ead20 con 0x55a459b1d8d0 2024-09-19T09:44:17.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:17.499+0000 7fe759ffb640 10 client.25862 handle_command_reply: tid=0 2024-09-19T09:44:17.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:17.499+0000 7fe77b073740 1 client.25862 shutdown 2024-09-19T09:44:17.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:17.499+0000 7fe77b073740 1 -- 172.21.15.1:0/2653489180 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a459a88940 msgr2=0x55a459a90360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:17.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:17.499+0000 7fe77b073740 1 --2- 172.21.15.1:0/2653489180 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a459a88940 0x55a459a90360 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe76c012a40 tx=0x7fe76c012a70 comp rx=0 tx=0).stop 2024-09-19T09:44:17.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:17.499+0000 7fe77b073740 1 -- 172.21.15.1:0/2653489180 shutdown_connections 2024-09-19T09:44:17.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:17.499+0000 7fe77b073740 1 --2- 172.21.15.1:0/2653489180 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55a459b1d8d0 0x55a459b1fd10 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:17.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:17.499+0000 7fe77b073740 1 --2- 172.21.15.1:0/2653489180 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a459a88940 0x55a459a90360 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:17.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:17.499+0000 7fe77b073740 1 --2- 172.21.15.1:0/2653489180 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55a459a7e080 0x55a459a8fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:17.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:17.499+0000 7fe77b073740 1 --2- 172.21.15.1:0/2653489180 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a459a7d760 0x55a459a8f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:17.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:17.499+0000 7fe759ffb640 0 client.25862 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:44:17.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:17.499+0000 7fe77b073740 1 -- 172.21.15.1:0/2653489180 >> 172.21.15.1:0/2653489180 conn(0x55a459a79cf0 msgr2=0x55a459a7f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:17.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:17.500+0000 7fe77b073740 1 -- 172.21.15.1:0/2653489180 shutdown_connections 2024-09-19T09:44:17.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:17.500+0000 7fe77b073740 1 -- 172.21.15.1:0/2653489180 wait complete. 2024-09-19T09:44:17.503 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:17.500+0000 7fe77b073740 20 client.25862 trim_cache size 0 max 16384 2024-09-19T09:44:17.504 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:44:17.504 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 19, 2024-09-19T09:44:17.504 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24497, 2024-09-19T09:44:17.504 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 18, 2024-09-19T09:44:17.504 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T09:44:17.504 INFO:teuthology.orchestra.run.smithi001.stdout: "978f3b4d": { 2024-09-19T09:44:17.504 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 18, 2024-09-19T09:44:17.504 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T09:44:17.504 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:44:17.504 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T09:44:17.504 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:44:17.505 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:44:17.505 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T09:44:17.505 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 149.8, 2024-09-19T09:44:17.505 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T09:44:17.505 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T09:44:17.505 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T09:44:17.505 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:44:17.505 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T09:44:17.505 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:44:17.505 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:44:17.505 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:44:17.505 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:44:17.505 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:44:17.505 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:44:17.506 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:44:17.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:17.500+0000 7fe778c9a640 1 -- 172.21.15.1:0/3736618824 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe75c0a3240 msgr2=0x7fe75c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:17.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:17.500+0000 7fe778c9a640 1 --2- 172.21.15.1:0/3736618824 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe75c0a3240 0x7fe75c0a5700 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe768009230 tx=0x7fe7680058d0 comp rx=0 tx=0).stop 2024-09-19T09:44:17.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:17.501+0000 7fe778c9a640 1 -- 172.21.15.1:0/3736618824 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe774100e20 msgr2=0x7fe77419a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:17.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:17.501+0000 7fe778c9a640 1 --2- 172.21.15.1:0/3736618824 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe774100e20 0x7fe77419a690 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe76400d950 tx=0x7fe76400de10 comp rx=0 tx=0).stop 2024-09-19T09:44:17.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:17.501+0000 7fe778c9a640 1 -- 172.21.15.1:0/3736618824 shutdown_connections 2024-09-19T09:44:17.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:17.501+0000 7fe778c9a640 1 --2- 172.21.15.1:0/3736618824 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe75c0a3240 0x7fe75c0a5700 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:17.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:17.501+0000 7fe778c9a640 1 --2- 172.21.15.1:0/3736618824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe774102ef0 0x7fe77419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:17.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:17.501+0000 7fe778c9a640 1 --2- 172.21.15.1:0/3736618824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe774102570 0x7fe77419abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:17.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:17.501+0000 7fe778c9a640 1 --2- 172.21.15.1:0/3736618824 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe774100e20 0x7fe77419a690 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:17.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:17.501+0000 7fe778c9a640 1 -- 172.21.15.1:0/3736618824 >> 172.21.15.1:0/3736618824 conn(0x7fe7740fc7d0 msgr2=0x7fe77406a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:17.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:17.501+0000 7fe778c9a640 1 -- 172.21.15.1:0/3736618824 shutdown_connections 2024-09-19T09:44:17.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:17.501+0000 7fe778c9a640 1 -- 172.21.15.1:0/3736618824 wait complete. 2024-09-19T09:44:17.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:17 smithi001 ceph-mon[31225]: pgmap v524: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 61 MiB/s wr, 12.75k op/s 2024-09-19T09:44:18.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:17 smithi022 ceph-mon[35583]: pgmap v524: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 61 MiB/s wr, 12.75k op/s 2024-09-19T09:44:18.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:17 smithi121 ceph-mon[35577]: pgmap v524: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 61 MiB/s wr, 12.75k op/s 2024-09-19T09:44:18.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:18 smithi001 ceph-mon[31225]: scrub summary: idle+waiting paths [/] 2024-09-19T09:44:18.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:18 smithi001 ceph-mon[31225]: scrub summary: idle 2024-09-19T09:44:19.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:18 smithi022 ceph-mon[35583]: scrub summary: idle+waiting paths [/] 2024-09-19T09:44:19.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:18 smithi022 ceph-mon[35583]: scrub summary: idle 2024-09-19T09:44:19.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:18 smithi121 ceph-mon[35577]: scrub summary: idle+waiting paths [/] 2024-09-19T09:44:19.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:18 smithi121 ceph-mon[35577]: scrub summary: idle 2024-09-19T09:44:19.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:19 smithi001 ceph-mon[31225]: pgmap v525: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 66 MiB/s wr, 13.98k op/s 2024-09-19T09:44:20.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:19 smithi022 ceph-mon[35583]: pgmap v525: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 66 MiB/s wr, 13.98k op/s 2024-09-19T09:44:20.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:19 smithi121 ceph-mon[35577]: pgmap v525: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 66 MiB/s wr, 13.98k op/s 2024-09-19T09:44:21.550 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.548+0000 7ff2a7e1e640 1 -- 172.21.15.1:0/3202089039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2a0101c60 msgr2=0x7ff2a01020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:21.551 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.548+0000 7ff2a7e1e640 1 --2- 172.21.15.1:0/3202089039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2a0101c60 0x7ff2a01020e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff290009900 tx=0x7ff29002a410 comp rx=0 tx=0).stop 2024-09-19T09:44:21.551 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.549+0000 7ff2a7e1e640 1 -- 172.21.15.1:0/3202089039 shutdown_connections 2024-09-19T09:44:21.551 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.549+0000 7ff2a7e1e640 1 --2- 172.21.15.1:0/3202089039 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2a0102620 0x7ff2a0108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.551 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.549+0000 7ff2a7e1e640 1 --2- 172.21.15.1:0/3202089039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2a0101c60 0x7ff2a01020e0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.551 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.549+0000 7ff2a7e1e640 1 --2- 172.21.15.1:0/3202089039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2a0100a70 0x7ff2a0100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.551 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.549+0000 7ff2a7e1e640 1 -- 172.21.15.1:0/3202089039 >> 172.21.15.1:0/3202089039 conn(0x7ff2a00fc1f0 msgr2=0x7ff2a00fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:21.551 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.549+0000 7ff2a7e1e640 1 -- 172.21.15.1:0/3202089039 shutdown_connections 2024-09-19T09:44:21.551 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.549+0000 7ff2a7e1e640 1 -- 172.21.15.1:0/3202089039 wait complete. 2024-09-19T09:44:21.564 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.549+0000 7ff2a7e1e640 1 Processor -- start 2024-09-19T09:44:21.564 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.550+0000 7ff2a7e1e640 1 -- start start 2024-09-19T09:44:21.564 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.550+0000 7ff2a7e1e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2a0100a70 0x7ff2a0197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:21.564 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.550+0000 7ff2a7e1e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2a0101c60 0x7ff2a0198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:21.564 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.550+0000 7ff2a7e1e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2a0102620 0x7ff2a019f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:21.564 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.550+0000 7ff2a7e1e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a010c740 con 0x7ff2a0101c60 2024-09-19T09:44:21.564 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.550+0000 7ff2a7e1e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a010c5c0 con 0x7ff2a0100a70 2024-09-19T09:44:21.564 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.550+0000 7ff2a7e1e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a010c8c0 con 0x7ff2a0102620 2024-09-19T09:44:21.564 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.550+0000 7ff2a53b9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2a0101c60 0x7ff2a0198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:21.565 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.550+0000 7ff2a53b9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2a0101c60 0x7ff2a0198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50526/0 (socket says 172.21.15.1:50526) 2024-09-19T09:44:21.565 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.550+0000 7ff2a53b9640 1 -- 172.21.15.1:0/4125518304 learned_addr learned my addr 172.21.15.1:0/4125518304 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:21.565 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.550+0000 7ff2a63bb640 1 --2- 172.21.15.1:0/4125518304 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2a0102620 0x7ff2a019f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:21.565 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.550+0000 7ff2a5bba640 1 --2- 172.21.15.1:0/4125518304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2a0100a70 0x7ff2a0197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:21.565 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.550+0000 7ff2a53b9640 1 -- 172.21.15.1:0/4125518304 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2a0102620 msgr2=0x7ff2a019f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:21.565 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.550+0000 7ff2a53b9640 1 --2- 172.21.15.1:0/4125518304 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2a0102620 0x7ff2a019f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.565 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.550+0000 7ff2a53b9640 1 -- 172.21.15.1:0/4125518304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2a0100a70 msgr2=0x7ff2a0197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:21.565 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.550+0000 7ff2a53b9640 1 --2- 172.21.15.1:0/4125518304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2a0100a70 0x7ff2a0197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.565 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.550+0000 7ff2a53b9640 1 -- 172.21.15.1:0/4125518304 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a019fae0 con 0x7ff2a0101c60 2024-09-19T09:44:21.565 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.551+0000 7ff2a53b9640 1 --2- 172.21.15.1:0/4125518304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2a0101c60 0x7ff2a0198400 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff2900314e0 tx=0x7ff290032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:21.565 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.551+0000 7ff296ffd640 1 -- 172.21.15.1:0/4125518304 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29003f030 con 0x7ff2a0101c60 2024-09-19T09:44:21.565 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.551+0000 7ff296ffd640 1 -- 172.21.15.1:0/4125518304 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff290032e50 con 0x7ff2a0101c60 2024-09-19T09:44:21.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.551+0000 7ff2a7e1e640 1 -- 172.21.15.1:0/4125518304 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2a019fd70 con 0x7ff2a0101c60 2024-09-19T09:44:21.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.551+0000 7ff296ffd640 1 -- 172.21.15.1:0/4125518304 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff290035070 con 0x7ff2a0101c60 2024-09-19T09:44:21.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.551+0000 7ff2a7e1e640 1 -- 172.21.15.1:0/4125518304 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2a01a0200 con 0x7ff2a0101c60 2024-09-19T09:44:21.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.553+0000 7ff296ffd640 1 -- 172.21.15.1:0/4125518304 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7ff290042030 con 0x7ff2a0101c60 2024-09-19T09:44:21.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.554+0000 7ff2aac8d740 1 Processor -- start 2024-09-19T09:44:21.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.554+0000 7ff2aac8d740 1 -- start start 2024-09-19T09:44:21.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.554+0000 7ff2aac8d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de082e6db0 0x55de082e71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:21.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.554+0000 7ff2aac8d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55de082e76f0 0x55de082ec1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:21.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.554+0000 7ff2aac8d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55de082ec780 0x55de082eec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:21.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.554+0000 7ff2aac8d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55de082462f0 con 0x55de082e6db0 2024-09-19T09:44:21.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.554+0000 7ff2aac8d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55de081ee270 con 0x55de082e76f0 2024-09-19T09:44:21.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.554+0000 7ff2aac8d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55de082422b0 con 0x55de082ec780 2024-09-19T09:44:21.566 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.554+0000 7ff296ffd640 1 --2- 172.21.15.1:0/4125518304 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff28c0a3240 0x7ff28c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:21.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.555+0000 7ff2a5bba640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55de082e76f0 0x55de082ec1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:21.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.555+0000 7ff2a63bb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de082e6db0 0x55de082e71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:21.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.555+0000 7ff2a5bba640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55de082e76f0 0x55de082ec1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:55538/0 (socket says 172.21.15.1:55538) 2024-09-19T09:44:21.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.555+0000 7ff2a5bba640 1 -- 172.21.15.1:0/3480713468 learned_addr learned my addr 172.21.15.1:0/3480713468 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:21.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.555+0000 7ff2a53b9640 1 --2- 172.21.15.1:0/3480713468 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55de082ec780 0x55de082eec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:21.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.555+0000 7ff2a63bb640 1 --2- 172.21.15.1:0/4125518304 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff28c0a3240 0x7ff28c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:21.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.555+0000 7ff296ffd640 1 -- 172.21.15.1:0/4125518304 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7ff2900efe20 con 0x7ff2a0101c60 2024-09-19T09:44:21.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.555+0000 7ff2a5bba640 1 -- 172.21.15.1:0/3480713468 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55de082ec780 msgr2=0x55de082eec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:21.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.555+0000 7ff2a5bba640 1 --2- 172.21.15.1:0/3480713468 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55de082ec780 0x55de082eec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.555+0000 7ff2a5bba640 1 -- 172.21.15.1:0/3480713468 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de082e6db0 msgr2=0x55de082e71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:21.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.555+0000 7ff2a5bba640 1 --2- 172.21.15.1:0/3480713468 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de082e6db0 0x55de082e71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.567 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.555+0000 7ff2a5bba640 1 -- 172.21.15.1:0/3480713468 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de081ed340 con 0x55de082e76f0 2024-09-19T09:44:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.555+0000 7ff2a53b9640 1 --2- 172.21.15.1:0/3480713468 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55de082ec780 0x55de082eec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:44:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.555+0000 7ff2a5bba640 1 --2- 172.21.15.1:0/3480713468 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55de082e76f0 0x55de082ec1b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00bcb0 tx=0x7ff29c0107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f297587b920a912c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.555+0000 7ff2a63bb640 1 --2- 172.21.15.1:0/4125518304 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff28c0a3240 0x7ff28c0a5700 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff298009fd0 tx=0x7ff298009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.555+0000 7ff28bfff640 1 -- 172.21.15.1:0/3480713468 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c004020 con 0x55de082e76f0 2024-09-19T09:44:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.555+0000 7ff28bfff640 1 -- 172.21.15.1:0/3480713468 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff29c005500 con 0x55de082e76f0 2024-09-19T09:44:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.555+0000 7ff28bfff640 1 -- 172.21.15.1:0/3480713468 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c004d60 con 0x55de082e76f0 2024-09-19T09:44:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.556+0000 7ff2aac8d740 1 -- 172.21.15.1:0/3480713468 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55de082e76f0 msgr2=0x55de082ec1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.556+0000 7ff2aac8d740 1 --2- 172.21.15.1:0/3480713468 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55de082e76f0 0x55de082ec1b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00bcb0 tx=0x7ff29c0107a0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.556+0000 7ff2aac8d740 1 -- 172.21.15.1:0/3480713468 shutdown_connections 2024-09-19T09:44:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.556+0000 7ff2aac8d740 1 --2- 172.21.15.1:0/3480713468 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55de082ec780 0x55de082eec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.556+0000 7ff2aac8d740 1 --2- 172.21.15.1:0/3480713468 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55de082e76f0 0x55de082ec1b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.556+0000 7ff2aac8d740 1 --2- 172.21.15.1:0/3480713468 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de082e6db0 0x55de082e71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.568 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.556+0000 7ff2aac8d740 1 -- 172.21.15.1:0/3480713468 >> 172.21.15.1:0/3480713468 conn(0x55de082de010 msgr2=0x55de082de410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:21.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.556+0000 7ff2aac8d740 1 -- 172.21.15.1:0/3480713468 shutdown_connections 2024-09-19T09:44:21.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.556+0000 7ff2aac8d740 1 -- 172.21.15.1:0/3480713468 wait complete. 2024-09-19T09:44:21.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.557+0000 7ff2aac8d740 1 -- start start 2024-09-19T09:44:21.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.557+0000 7ff2aac8d740 1 Processor -- start 2024-09-19T09:44:21.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.557+0000 7ff2aac8d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55de082e6db0 0x55de082f0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:21.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.557+0000 7ff2aac8d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55de082e76f0 0x55de082f14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:21.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.557+0000 7ff2aac8d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de082ec780 0x55de082f84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:21.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.557+0000 7ff2aac8d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55de082ef750 con 0x55de082ec780 2024-09-19T09:44:21.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.557+0000 7ff2aac8d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55de081cf290 con 0x55de082e76f0 2024-09-19T09:44:21.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.557+0000 7ff2aac8d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55de082ef8d0 con 0x55de082e6db0 2024-09-19T09:44:21.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.557+0000 7ff2aac8d740 10 client.0 _ll_register_callbacks cb 0x55de08200140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:44:21.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.557+0000 7ff2a63bb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de082ec780 0x55de082f84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:21.569 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.557+0000 7ff2a63bb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de082ec780 0x55de082f84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50546/0 (socket says 172.21.15.1:50546) 2024-09-19T09:44:21.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.558+0000 7ff2a63bb640 1 -- 172.21.15.1:0/2459025412 learned_addr learned my addr 172.21.15.1:0/2459025412 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:21.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.558+0000 7ff2a5bba640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55de082e6db0 0x55de082f0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:21.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.558+0000 7ff2a53b9640 1 --2- 172.21.15.1:0/2459025412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55de082e76f0 0x55de082f14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:21.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.558+0000 7ff2a63bb640 1 -- 172.21.15.1:0/2459025412 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55de082e6db0 msgr2=0x55de082f0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:21.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.558+0000 7ff2a63bb640 1 --2- 172.21.15.1:0/2459025412 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55de082e6db0 0x55de082f0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.558+0000 7ff2a63bb640 1 -- 172.21.15.1:0/2459025412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55de082e76f0 msgr2=0x55de082f14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:21.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.558+0000 7ff2a63bb640 1 --2- 172.21.15.1:0/2459025412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55de082e76f0 0x55de082f14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.558+0000 7ff2a63bb640 1 -- 172.21.15.1:0/2459025412 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de07f59210 con 0x55de082ec780 2024-09-19T09:44:21.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.558+0000 7ff2a5bba640 1 --2- 172.21.15.1:0/2459025412 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55de082e6db0 0x55de082f0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:44:21.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.558+0000 7ff2a53b9640 1 --2- 172.21.15.1:0/2459025412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55de082e76f0 0x55de082f14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:44:21.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.558+0000 7ff2a63bb640 1 --2- 172.21.15.1:0/2459025412 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de082ec780 0x55de082f84f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff298009e20 tx=0x7ff298004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23ef7e68f0eaed83 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:21.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.558+0000 7ff2897fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:44:21.570 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.558+0000 7ff2897fa640 1 -- 172.21.15.1:0/2459025412 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff298011cf0 con 0x55de082ec780 2024-09-19T09:44:21.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.558+0000 7ff2897fa640 1 -- 172.21.15.1:0/2459025412 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7ff298004b20 con 0x55de082ec780 2024-09-19T09:44:21.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.558+0000 7ff2aac8d740 1 -- 172.21.15.1:0/2459025412 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff29c005500 con 0x55de082ec780 2024-09-19T09:44:21.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.558+0000 7ff2897fa640 1 -- 172.21.15.1:0/2459025412 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff298004d20 con 0x55de082ec780 2024-09-19T09:44:21.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.558+0000 7ff2aac8d740 10 client.16200 fetch_fsmap learned FSMap version 19 2024-09-19T09:44:21.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.558+0000 7ff2aac8d740 1 -- 172.21.15.1:0/2459025412 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55de08025620 con 0x55de082ec780 2024-09-19T09:44:21.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.559+0000 7ff2897fa640 1 -- 172.21.15.1:0/2459025412 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff29c005500 con 0x55de082ec780 2024-09-19T09:44:21.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.559+0000 7ff2897fa640 1 -- 172.21.15.1:0/2459025412 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff29800f040 con 0x55de082ec780 2024-09-19T09:44:21.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.559+0000 7ff2aac8d740 10 client.16200 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:44:21.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.559+0000 7ff2aac8d740 10 client.16200 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:44:21.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.559+0000 7ff2aac8d740 20 client.16200 populate_metadata read hostname 'smithi001' 2024-09-19T09:44:21.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.559+0000 7ff2aac8d740 1 --2- 172.21.15.1:0/2459025412 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55de082fcc60 0x55de082ff090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:21.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.559+0000 7ff2aac8d740 4 client.16200 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:44:21.571 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.559+0000 7ff2aac8d740 1 -- 172.21.15.1:0/2459025412 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de08253a20 con 0x55de082fcc60 2024-09-19T09:44:21.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.559+0000 7ff2a5bba640 1 --2- 172.21.15.1:0/2459025412 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55de082fcc60 0x55de082ff090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:21.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.560+0000 7ff2897fa640 10 client.16200 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:44:21.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.560+0000 7ff2a5bba640 1 --2- 172.21.15.1:0/2459025412 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55de082fcc60 0x55de082ff090 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bbf17df2e7557c1 server_cookie=a672e6ece9643c3 in_seq=0 out_seq=0 2024-09-19T09:44:21.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.560+0000 7ff2897fa640 1 -- 172.21.15.1:0/2459025412 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55de08253a20 con 0x55de082fcc60 2024-09-19T09:44:21.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.560+0000 7ff2897fa640 10 client.16200 handle_command_reply: tid=0 2024-09-19T09:44:21.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.561+0000 7ff2aac8d740 1 client.16200 shutdown 2024-09-19T09:44:21.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.561+0000 7ff2aac8d740 1 -- 172.21.15.1:0/2459025412 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de082ec780 msgr2=0x55de082f84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:21.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.561+0000 7ff2aac8d740 1 --2- 172.21.15.1:0/2459025412 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de082ec780 0x55de082f84f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff298009e20 tx=0x7ff298004a40 comp rx=0 tx=0).stop 2024-09-19T09:44:21.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.561+0000 7ff2aac8d740 1 -- 172.21.15.1:0/2459025412 shutdown_connections 2024-09-19T09:44:21.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.561+0000 7ff2aac8d740 1 --2- 172.21.15.1:0/2459025412 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55de082fcc60 0x55de082ff090 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.561+0000 7ff2aac8d740 1 --2- 172.21.15.1:0/2459025412 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de082ec780 0x55de082f84f0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.572 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.561+0000 7ff2aac8d740 1 --2- 172.21.15.1:0/2459025412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55de082e76f0 0x55de082f14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.561+0000 7ff2aac8d740 1 --2- 172.21.15.1:0/2459025412 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55de082e6db0 0x55de082f0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.561+0000 7ff2897fa640 0 client.16200 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:44:21.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.561+0000 7ff2aac8d740 1 -- 172.21.15.1:0/2459025412 >> 172.21.15.1:0/2459025412 conn(0x55de082de010 msgr2=0x55de082df820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:21.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.561+0000 7ff2aac8d740 1 -- 172.21.15.1:0/2459025412 shutdown_connections 2024-09-19T09:44:21.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.561+0000 7ff2aac8d740 1 -- 172.21.15.1:0/2459025412 wait complete. 2024-09-19T09:44:21.573 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.561+0000 7ff2aac8d740 20 client.16200 trim_cache size 0 max 16384 2024-09-19T09:44:21.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.576+0000 7ff2aac8d740 1 Processor -- start 2024-09-19T09:44:21.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.576+0000 7ff2aac8d740 1 -- start start 2024-09-19T09:44:21.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.576+0000 7ff2aac8d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de082e6db0 0x55de082e7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:21.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.576+0000 7ff2aac8d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55de082e76f0 0x55de082f84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:21.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.576+0000 7ff2aac8d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55de082ec780 0x55de082deec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:21.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.576+0000 7ff2aac8d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a01a4f00 con 0x55de082e6db0 2024-09-19T09:44:21.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.576+0000 7ff2aac8d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a01a77a0 con 0x55de082ec780 2024-09-19T09:44:21.583 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.576+0000 7ff2aac8d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a01a5590 con 0x55de082e76f0 2024-09-19T09:44:21.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.576+0000 7ff2a5bba640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de082e6db0 0x55de082e7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:21.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.576+0000 7ff2a5bba640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de082e6db0 0x55de082e7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50552/0 (socket says 172.21.15.1:50552) 2024-09-19T09:44:21.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.576+0000 7ff2a5bba640 1 -- 172.21.15.1:0/828830964 learned_addr learned my addr 172.21.15.1:0/828830964 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:21.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.576+0000 7ff2a53b9640 1 --2- 172.21.15.1:0/828830964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55de082e76f0 0x55de082f84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:21.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.576+0000 7ff2a63bb640 1 --2- 172.21.15.1:0/828830964 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55de082ec780 0x55de082deec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:21.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.576+0000 7ff2a5bba640 1 -- 172.21.15.1:0/828830964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55de082e76f0 msgr2=0x55de082f84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:21.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.576+0000 7ff2a5bba640 1 --2- 172.21.15.1:0/828830964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55de082e76f0 0x55de082f84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.576+0000 7ff2a5bba640 1 -- 172.21.15.1:0/828830964 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55de082ec780 msgr2=0x55de082deec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:21.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.576+0000 7ff2a5bba640 1 --2- 172.21.15.1:0/828830964 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55de082ec780 0x55de082deec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.576+0000 7ff2a5bba640 1 -- 172.21.15.1:0/828830964 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de082dde30 con 0x55de082e6db0 2024-09-19T09:44:21.584 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.576+0000 7ff2a53b9640 1 --2- 172.21.15.1:0/828830964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55de082e76f0 0x55de082f84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:44:21.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.577+0000 7ff2a5bba640 1 --2- 172.21.15.1:0/828830964 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de082e6db0 0x55de082e7190 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00bcb0 tx=0x7ff29c013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=637c1d6b44eff038 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:21.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.577+0000 7ff28b7fe640 1 -- 172.21.15.1:0/828830964 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c011640 con 0x55de082e6db0 2024-09-19T09:44:21.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.577+0000 7ff28b7fe640 1 -- 172.21.15.1:0/828830964 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff29c011cc0 con 0x55de082e6db0 2024-09-19T09:44:21.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.577+0000 7ff28b7fe640 1 -- 172.21.15.1:0/828830964 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c01b8d0 con 0x55de082e6db0 2024-09-19T09:44:21.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.577+0000 7ff2aac8d740 1 -- 172.21.15.1:0/828830964 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de082e6db0 msgr2=0x55de082e7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:21.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.577+0000 7ff2aac8d740 1 --2- 172.21.15.1:0/828830964 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de082e6db0 0x55de082e7190 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00bcb0 tx=0x7ff29c013040 comp rx=0 tx=0).stop 2024-09-19T09:44:21.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.578+0000 7ff2aac8d740 1 -- 172.21.15.1:0/828830964 shutdown_connections 2024-09-19T09:44:21.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.578+0000 7ff2aac8d740 1 --2- 172.21.15.1:0/828830964 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55de082ec780 0x55de082deec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.585 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.578+0000 7ff2aac8d740 1 --2- 172.21.15.1:0/828830964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55de082e76f0 0x55de082f84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.578+0000 7ff2aac8d740 1 --2- 172.21.15.1:0/828830964 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de082e6db0 0x55de082e7190 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.578+0000 7ff2aac8d740 1 -- 172.21.15.1:0/828830964 >> 172.21.15.1:0/828830964 conn(0x55de082de010 msgr2=0x55de082f0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.578+0000 7ff2aac8d740 1 -- 172.21.15.1:0/828830964 shutdown_connections 2024-09-19T09:44:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.578+0000 7ff2aac8d740 1 -- 172.21.15.1:0/828830964 wait complete. 2024-09-19T09:44:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.578+0000 7ff2aac8d740 1 -- start start 2024-09-19T09:44:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.578+0000 7ff2aac8d740 1 Processor -- start 2024-09-19T09:44:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.578+0000 7ff2aac8d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55de082e6db0 0x55de082f8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.578+0000 7ff2aac8d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55de082e76f0 0x55de082f8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.578+0000 7ff2aac8d740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de082ec780 0x55de082f4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.578+0000 7ff2aac8d740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a01a5c60 con 0x55de082ec780 2024-09-19T09:44:21.586 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.578+0000 7ff2aac8d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a01a70d0 con 0x55de082e76f0 2024-09-19T09:44:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.578+0000 7ff2aac8d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a01a6330 con 0x55de082e6db0 2024-09-19T09:44:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.578+0000 7ff2aac8d740 10 client.0 _ll_register_callbacks cb 0x7ff2980127e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:44:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.579+0000 7ff2a63bb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de082ec780 0x55de082f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.579+0000 7ff2a63bb640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de082ec780 0x55de082f4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50566/0 (socket says 172.21.15.1:50566) 2024-09-19T09:44:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.579+0000 7ff2a63bb640 1 -- 172.21.15.1:0/187323598 learned_addr learned my addr 172.21.15.1:0/187323598 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.579+0000 7ff2a5bba640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55de082e6db0 0x55de082f8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.579+0000 7ff2a53b9640 1 --2- 172.21.15.1:0/187323598 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55de082e76f0 0x55de082f8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:21.587 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.579+0000 7ff2a63bb640 1 -- 172.21.15.1:0/187323598 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55de082e6db0 msgr2=0x55de082f8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:21.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.579+0000 7ff2a63bb640 1 --2- 172.21.15.1:0/187323598 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55de082e6db0 0x55de082f8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.579+0000 7ff2a63bb640 1 -- 172.21.15.1:0/187323598 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55de082e76f0 msgr2=0x55de082f8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:21.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.579+0000 7ff2a63bb640 1 --2- 172.21.15.1:0/187323598 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55de082e76f0 0x55de082f8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.579+0000 7ff2a63bb640 1 -- 172.21.15.1:0/187323598 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de082f5480 con 0x55de082ec780 2024-09-19T09:44:21.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.579+0000 7ff2a63bb640 1 --2- 172.21.15.1:0/187323598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de082ec780 0x55de082f4c50 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff298009e20 tx=0x7ff2980213f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1b5718537b213a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:21.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.579+0000 7ff2897fa640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:44:21.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.579+0000 7ff2897fa640 1 -- 172.21.15.1:0/187323598 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2980117b0 con 0x55de082ec780 2024-09-19T09:44:21.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.579+0000 7ff2897fa640 1 -- 172.21.15.1:0/187323598 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7ff298004ab0 con 0x55de082ec780 2024-09-19T09:44:21.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.579+0000 7ff2aac8d740 1 -- 172.21.15.1:0/187323598 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff29c011cc0 con 0x55de082ec780 2024-09-19T09:44:21.588 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.579+0000 7ff2897fa640 1 -- 172.21.15.1:0/187323598 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff298021b80 con 0x55de082ec780 2024-09-19T09:44:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.579+0000 7ff2aac8d740 10 client.16206 fetch_fsmap learned FSMap version 19 2024-09-19T09:44:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.579+0000 7ff2aac8d740 1 -- 172.21.15.1:0/187323598 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55de083667a0 con 0x55de082ec780 2024-09-19T09:44:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.580+0000 7ff2897fa640 1 -- 172.21.15.1:0/187323598 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff29c011cc0 con 0x55de082ec780 2024-09-19T09:44:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.580+0000 7ff2897fa640 1 -- 172.21.15.1:0/187323598 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7ff298034ae0 con 0x55de082ec780 2024-09-19T09:44:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.580+0000 7ff2aac8d740 10 client.16206 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:44:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.580+0000 7ff2aac8d740 10 client.16206 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:44:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.580+0000 7ff2aac8d740 20 client.16206 populate_metadata read hostname 'smithi001' 2024-09-19T09:44:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.580+0000 7ff2aac8d740 1 --2- 172.21.15.1:0/187323598 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55de08367180 0x55de083695a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.580+0000 7ff2aac8d740 4 client.16206 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:44:21.589 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.580+0000 7ff2aac8d740 1 -- 172.21.15.1:0/187323598 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55de0824dd70 con 0x55de08367180 2024-09-19T09:44:21.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.580+0000 7ff2a5bba640 1 --2- 172.21.15.1:0/187323598 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55de08367180 0x55de083695a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:21.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.581+0000 7ff2a5bba640 1 --2- 172.21.15.1:0/187323598 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55de08367180 0x55de083695a0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea5fb6d13a3b8df5 server_cookie=fdde40731d3d926e in_seq=0 out_seq=0 2024-09-19T09:44:21.590 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.581+0000 7ff2897fa640 10 client.16206 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:44:21.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.728+0000 7ff2897fa640 1 -- 172.21.15.1:0/187323598 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55de0824dd70 con 0x55de08367180 2024-09-19T09:44:21.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.728+0000 7ff2897fa640 10 client.16206 handle_command_reply: tid=0 2024-09-19T09:44:21.731 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.729+0000 7ff2aac8d740 1 client.16206 shutdown 2024-09-19T09:44:21.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.729+0000 7ff2aac8d740 1 -- 172.21.15.1:0/187323598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de082ec780 msgr2=0x55de082f4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:21.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.729+0000 7ff2aac8d740 1 --2- 172.21.15.1:0/187323598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de082ec780 0x55de082f4c50 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff298009e20 tx=0x7ff2980213f0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.729+0000 7ff2aac8d740 1 -- 172.21.15.1:0/187323598 shutdown_connections 2024-09-19T09:44:21.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.729+0000 7ff2aac8d740 1 --2- 172.21.15.1:0/187323598 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55de08367180 0x55de083695a0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.729+0000 7ff2aac8d740 1 --2- 172.21.15.1:0/187323598 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55de082ec780 0x55de082f4c50 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.729+0000 7ff2aac8d740 1 --2- 172.21.15.1:0/187323598 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55de082e76f0 0x55de082f8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.729+0000 7ff2897fa640 0 client.16206 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:44:21.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.729+0000 7ff2aac8d740 1 --2- 172.21.15.1:0/187323598 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55de082e6db0 0x55de082f8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.729+0000 7ff2aac8d740 1 -- 172.21.15.1:0/187323598 >> 172.21.15.1:0/187323598 conn(0x55de082de010 msgr2=0x55de082dc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:21.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.729+0000 7ff2aac8d740 1 -- 172.21.15.1:0/187323598 shutdown_connections 2024-09-19T09:44:21.732 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.729+0000 7ff2aac8d740 1 -- 172.21.15.1:0/187323598 wait complete. 2024-09-19T09:44:21.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.729+0000 7ff2aac8d740 20 client.16206 trim_cache size 0 max 16384 2024-09-19T09:44:21.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:44:21.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:44:21.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:44:21.733 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:44:21.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.730+0000 7ff2a7e1e640 1 -- 172.21.15.1:0/4125518304 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff28c0a3240 msgr2=0x7ff28c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:21.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.730+0000 7ff2a7e1e640 1 --2- 172.21.15.1:0/4125518304 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff28c0a3240 0x7ff28c0a5700 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff298009fd0 tx=0x7ff298009600 comp rx=0 tx=0).stop 2024-09-19T09:44:21.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.730+0000 7ff2a7e1e640 1 -- 172.21.15.1:0/4125518304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2a0101c60 msgr2=0x7ff2a0198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:21.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.730+0000 7ff2a7e1e640 1 --2- 172.21.15.1:0/4125518304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2a0101c60 0x7ff2a0198400 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff2900314e0 tx=0x7ff290032c60 comp rx=0 tx=0).stop 2024-09-19T09:44:21.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.730+0000 7ff2a7e1e640 1 -- 172.21.15.1:0/4125518304 shutdown_connections 2024-09-19T09:44:21.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.730+0000 7ff2a7e1e640 1 --2- 172.21.15.1:0/4125518304 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2a0102620 0x7ff2a019f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.734 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.730+0000 7ff2a7e1e640 1 --2- 172.21.15.1:0/4125518304 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2a0101c60 0x7ff2a0198400 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.730+0000 7ff2a7e1e640 1 --2- 172.21.15.1:0/4125518304 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff28c0a3240 0x7ff28c0a5700 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.730+0000 7ff2a7e1e640 1 --2- 172.21.15.1:0/4125518304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2a0100a70 0x7ff2a0197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:21.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.730+0000 7ff2a7e1e640 1 -- 172.21.15.1:0/4125518304 >> 172.21.15.1:0/4125518304 conn(0x7ff2a00fc1f0 msgr2=0x7ff2a006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:21.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.730+0000 7ff2a7e1e640 1 -- 172.21.15.1:0/4125518304 shutdown_connections 2024-09-19T09:44:21.735 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:21.730+0000 7ff2a7e1e640 1 -- 172.21.15.1:0/4125518304 wait complete. 2024-09-19T09:44:21.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:21 smithi001 ceph-mon[31225]: pgmap v526: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 49 MiB/s wr, 10.70k op/s 2024-09-19T09:44:22.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:21 smithi022 ceph-mon[35583]: pgmap v526: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 49 MiB/s wr, 10.70k op/s 2024-09-19T09:44:22.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:21 smithi121 ceph-mon[35577]: pgmap v526: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 49 MiB/s wr, 10.70k op/s 2024-09-19T09:44:23.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:23 smithi001 ceph-mon[31225]: pgmap v527: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 50 MiB/s wr, 10.82k op/s 2024-09-19T09:44:24.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:23 smithi022 ceph-mon[35583]: pgmap v527: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 50 MiB/s wr, 10.82k op/s 2024-09-19T09:44:24.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:23 smithi121 ceph-mon[35577]: pgmap v527: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 50 MiB/s wr, 10.82k op/s 2024-09-19T09:44:25.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:25 smithi001 ceph-mon[31225]: pgmap v528: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 38 MiB/s wr, 8.41k op/s 2024-09-19T09:44:26.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:25 smithi022 ceph-mon[35583]: pgmap v528: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 38 MiB/s wr, 8.41k op/s 2024-09-19T09:44:26.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:25 smithi121 ceph-mon[35577]: pgmap v528: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 38 MiB/s wr, 8.41k op/s 2024-09-19T09:44:26.976 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '978f3b4d', quiesce took 65.1 seconds. Will release after: -35.3 2024-09-19T09:44:26.976 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:44:27.280 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:44:27.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:27 smithi001 ceph-mon[31225]: pgmap v529: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 24 MiB/s wr, 5.31k op/s 2024-09-19T09:44:28.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:27 smithi022 ceph-mon[35583]: pgmap v529: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 24 MiB/s wr, 5.31k op/s 2024-09-19T09:44:28.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:27 smithi121 ceph-mon[35577]: pgmap v529: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 24 MiB/s wr, 5.31k op/s 2024-09-19T09:44:29.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:29 smithi001 ceph-mon[31225]: pgmap v530: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 16 MiB/s wr, 3.44k op/s 2024-09-19T09:44:30.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:29 smithi022 ceph-mon[35583]: pgmap v530: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 16 MiB/s wr, 3.44k op/s 2024-09-19T09:44:30.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:29 smithi121 ceph-mon[35577]: pgmap v530: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 16 MiB/s wr, 3.44k op/s 2024-09-19T09:44:31.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.789+0000 7fe4e3c77640 1 -- 172.21.15.1:0/2504121556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4dc102790 msgr2=0x7fe4dc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:31.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.789+0000 7fe4e3c77640 1 --2- 172.21.15.1:0/2504121556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4dc102790 0x7fe4dc1067e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc009900 tx=0x7fe4cc02a410 comp rx=0 tx=0).stop 2024-09-19T09:44:31.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.789+0000 7fe4e3c77640 1 -- 172.21.15.1:0/2504121556 shutdown_connections 2024-09-19T09:44:31.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.789+0000 7fe4e3c77640 1 --2- 172.21.15.1:0/2504121556 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe4dc106f10 0x7fe4dc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:31.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.789+0000 7fe4e3c77640 1 --2- 172.21.15.1:0/2504121556 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4dc102790 0x7fe4dc1067e0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:31.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.789+0000 7fe4e3c77640 1 --2- 172.21.15.1:0/2504121556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4dc101de0 0x7fe4dc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:31.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.789+0000 7fe4e3c77640 1 -- 172.21.15.1:0/2504121556 >> 172.21.15.1:0/2504121556 conn(0x7fe4dc0fd8c0 msgr2=0x7fe4dc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:31.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.789+0000 7fe4e3c77640 1 -- 172.21.15.1:0/2504121556 shutdown_connections 2024-09-19T09:44:31.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.790+0000 7fe4e3c77640 1 -- 172.21.15.1:0/2504121556 wait complete. 2024-09-19T09:44:31.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.790+0000 7fe4e3c77640 1 Processor -- start 2024-09-19T09:44:31.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.790+0000 7fe4e3c77640 1 -- start start 2024-09-19T09:44:31.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.790+0000 7fe4e3c77640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe4dc101de0 0x7fe4dc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:31.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.790+0000 7fe4e3c77640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4dc102790 0x7fe4dc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:31.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.790+0000 7fe4e3c77640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4dc106f10 0x7fe4dc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:31.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.790+0000 7fe4e3c77640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe4dc111f70 con 0x7fe4dc106f10 2024-09-19T09:44:31.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.791+0000 7fe4e3c77640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe4dc111df0 con 0x7fe4dc101de0 2024-09-19T09:44:31.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.791+0000 7fe4e3c77640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe4dc1120f0 con 0x7fe4dc102790 2024-09-19T09:44:31.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.791+0000 7fe4e2214640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4dc106f10 0x7fe4dc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:31.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.791+0000 7fe4e1a13640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe4dc101de0 0x7fe4dc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:31.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.791+0000 7fe4e1a13640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe4dc101de0 0x7fe4dc0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:49640/0 (socket says 172.21.15.1:49640) 2024-09-19T09:44:31.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.791+0000 7fe4e2214640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4dc106f10 0x7fe4dc074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52620/0 (socket says 172.21.15.1:52620) 2024-09-19T09:44:31.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.791+0000 7fe4e1a13640 1 -- 172.21.15.1:0/1295525366 learned_addr learned my addr 172.21.15.1:0/1295525366 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:31.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.791+0000 7fe4e1212640 1 --2- 172.21.15.1:0/1295525366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4dc102790 0x7fe4dc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:31.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.791+0000 7fe4e2214640 1 -- 172.21.15.1:0/1295525366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4dc102790 msgr2=0x7fe4dc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:31.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.791+0000 7fe4e2214640 1 --2- 172.21.15.1:0/1295525366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4dc102790 0x7fe4dc074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:31.820 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:44:31.820 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":19,"btime":"2024-09-19T09:36:24:006349+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:36:23.723388+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24490":{"gid":24490,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6839/3279971690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3279971690},{"type":"v1","addr":"172.21.15.121:6839","nonce":3279971690}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:44:31.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.791+0000 7fe4e2214640 1 -- 172.21.15.1:0/1295525366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe4dc101de0 msgr2=0x7fe4dc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:31.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.791+0000 7fe4e2214640 1 --2- 172.21.15.1:0/1295525366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe4dc101de0 0x7fe4dc0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:31.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.791+0000 7fe4e2214640 1 -- 172.21.15.1:0/1295525366 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4dc1a6970 con 0x7fe4dc106f10 2024-09-19T09:44:31.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.791+0000 7fe4e1a13640 1 --2- 172.21.15.1:0/1295525366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe4dc101de0 0x7fe4dc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:44:31.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.791+0000 7fe4e2214640 1 --2- 172.21.15.1:0/1295525366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4dc106f10 0x7fe4dc074f70 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009fd0 tx=0x7fe4d400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:31.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.791+0000 7fe4d2ffd640 1 -- 172.21.15.1:0/1295525366 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d400ce20 con 0x7fe4dc106f10 2024-09-19T09:44:31.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.791+0000 7fe4d2ffd640 1 -- 172.21.15.1:0/1295525366 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4d4005020 con 0x7fe4dc106f10 2024-09-19T09:44:31.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.791+0000 7fe4d2ffd640 1 -- 172.21.15.1:0/1295525366 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4010720 con 0x7fe4dc106f10 2024-09-19T09:44:31.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.791+0000 7fe4e3c77640 1 -- 172.21.15.1:0/1295525366 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4dc1a6c60 con 0x7fe4dc106f10 2024-09-19T09:44:31.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.792+0000 7fe4e3c77640 1 -- 172.21.15.1:0/1295525366 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4dc1a7120 con 0x7fe4dc106f10 2024-09-19T09:44:31.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.793+0000 7fe4e3c77640 1 -- 172.21.15.1:0/1295525366 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4dc1021c0 con 0x7fe4dc106f10 2024-09-19T09:44:31.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.794+0000 7fe4d2ffd640 1 -- 172.21.15.1:0/1295525366 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fe4d4005540 con 0x7fe4dc106f10 2024-09-19T09:44:31.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.795+0000 7fe4d2ffd640 1 --2- 172.21.15.1:0/1295525366 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe4c80a3240 0x7fe4c80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:31.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.795+0000 7fe4d2ffd640 1 -- 172.21.15.1:0/1295525366 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fe4d40cff30 con 0x7fe4dc106f10 2024-09-19T09:44:31.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.795+0000 7fe4e1a13640 1 --2- 172.21.15.1:0/1295525366 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe4c80a3240 0x7fe4c80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:31.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.795+0000 7fe4e1a13640 1 --2- 172.21.15.1:0/1295525366 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe4c80a3240 0x7fe4c80a5700 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe4d80104e0 tx=0x7fe4d800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:31.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:30.798+0000 7fe4d2ffd640 1 -- 172.21.15.1:0/1295525366 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe4d409cc50 con 0x7fe4dc106f10 2024-09-19T09:44:31.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:31.070+0000 7fe4e3c77640 1 -- 172.21.15.1:0/1295525366 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4dc10a150 con 0x7fe4dc106f10 2024-09-19T09:44:31.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:31.071+0000 7fe4d2ffd640 1 -- 172.21.15.1:0/1295525366 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+11837 (secure 0 0 0) 0x7fe4d409c550 con 0x7fe4dc106f10 2024-09-19T09:44:31.822 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 19 2024-09-19T09:44:31.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:31.073+0000 7fe4e3c77640 1 -- 172.21.15.1:0/1295525366 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe4c80a3240 msgr2=0x7fe4c80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:31.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:31.073+0000 7fe4e3c77640 1 --2- 172.21.15.1:0/1295525366 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe4c80a3240 0x7fe4c80a5700 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe4d80104e0 tx=0x7fe4d800b410 comp rx=0 tx=0).stop 2024-09-19T09:44:31.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:31.073+0000 7fe4e3c77640 1 -- 172.21.15.1:0/1295525366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4dc106f10 msgr2=0x7fe4dc074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:31.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:31.073+0000 7fe4e3c77640 1 --2- 172.21.15.1:0/1295525366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4dc106f10 0x7fe4dc074f70 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009fd0 tx=0x7fe4d400ef10 comp rx=0 tx=0).stop 2024-09-19T09:44:31.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:31.073+0000 7fe4e3c77640 1 -- 172.21.15.1:0/1295525366 shutdown_connections 2024-09-19T09:44:31.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:31.073+0000 7fe4e3c77640 1 --2- 172.21.15.1:0/1295525366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe4dc106f10 0x7fe4dc074f70 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:31.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:31.073+0000 7fe4e3c77640 1 --2- 172.21.15.1:0/1295525366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4dc102790 0x7fe4dc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:31.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:31.073+0000 7fe4e3c77640 1 --2- 172.21.15.1:0/1295525366 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe4c80a3240 0x7fe4c80a5700 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:31.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:31.073+0000 7fe4e3c77640 1 --2- 172.21.15.1:0/1295525366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe4dc101de0 0x7fe4dc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:31.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:31.073+0000 7fe4e3c77640 1 -- 172.21.15.1:0/1295525366 >> 172.21.15.1:0/1295525366 conn(0x7fe4dc0fd8c0 msgr2=0x7fe4dc0fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:31.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:31.073+0000 7fe4e3c77640 1 -- 172.21.15.1:0/1295525366 shutdown_connections 2024-09-19T09:44:31.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:31.073+0000 7fe4e3c77640 1 -- 172.21.15.1:0/1295525366 wait complete. 2024-09-19T09:44:31.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:31 smithi001 ceph-mon[31225]: pgmap v531: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.6 MiB/s wr, 809 op/s 2024-09-19T09:44:31.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:31 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1295525366' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:44:32.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:31 smithi022 ceph-mon[35583]: pgmap v531: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.6 MiB/s wr, 809 op/s 2024-09-19T09:44:32.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:31 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1295525366' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:44:32.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:31 smithi121 ceph-mon[35577]: pgmap v531: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.6 MiB/s wr, 809 op/s 2024-09-19T09:44:32.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:31 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1295525366' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:44:33.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:33 smithi001 ceph-mon[31225]: pgmap v532: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.3 MiB/s wr, 925 op/s 2024-09-19T09:44:34.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:33 smithi022 ceph-mon[35583]: pgmap v532: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.3 MiB/s wr, 925 op/s 2024-09-19T09:44:34.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:33 smithi121 ceph-mon[35577]: pgmap v532: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 4.3 MiB/s wr, 925 op/s 2024-09-19T09:44:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.834+0000 7fc4e4a0e640 1 -- 172.21.15.1:0/951670323 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4e0102d60 msgr2=0x7fc4e01031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.834+0000 7fc4e4a0e640 1 --2- 172.21.15.1:0/951670323 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4e0102d60 0x7fc4e01031e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4009900 tx=0x7fc4d402a3f0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.834+0000 7fc4e4a0e640 1 -- 172.21.15.1:0/951670323 shutdown_connections 2024-09-19T09:44:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.834+0000 7fc4e4a0e640 1 --2- 172.21.15.1:0/951670323 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4e0103720 0x7fc4e0109fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.834+0000 7fc4e4a0e640 1 --2- 172.21.15.1:0/951670323 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4e0102d60 0x7fc4e01031e0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.834+0000 7fc4e4a0e640 1 --2- 172.21.15.1:0/951670323 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4e0101b70 0x7fc4e0101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.834+0000 7fc4e4a0e640 1 -- 172.21.15.1:0/951670323 >> 172.21.15.1:0/951670323 conn(0x7fc4e00fd2f0 msgr2=0x7fc4e00ff710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.834+0000 7fc4e4a0e640 1 -- 172.21.15.1:0/951670323 shutdown_connections 2024-09-19T09:44:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.834+0000 7fc4e4a0e640 1 -- 172.21.15.1:0/951670323 wait complete. 2024-09-19T09:44:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.835+0000 7fc4e4a0e640 1 Processor -- start 2024-09-19T09:44:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.835+0000 7fc4e4a0e640 1 -- start start 2024-09-19T09:44:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.835+0000 7fc4e4a0e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4e0101b70 0x7fc4e0197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.835+0000 7fc4e4a0e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4e0102d60 0x7fc4e0198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.835+0000 7fc4e4a0e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4e0103720 0x7fc4e019f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.835+0000 7fc4e4a0e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e010d7d0 con 0x7fc4e0102d60 2024-09-19T09:44:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.835+0000 7fc4e4a0e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e010d650 con 0x7fc4e0103720 2024-09-19T09:44:34.839 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.835+0000 7fc4e4a0e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e010d950 con 0x7fc4e0101b70 2024-09-19T09:44:34.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.835+0000 7fc4ddd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4e0102d60 0x7fc4e0198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:34.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.835+0000 7fc4ddd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4e0102d60 0x7fc4e0198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52632/0 (socket says 172.21.15.1:52632) 2024-09-19T09:44:34.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.835+0000 7fc4ddd9b640 1 -- 172.21.15.1:0/3173579512 learned_addr learned my addr 172.21.15.1:0/3173579512 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:34.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.836+0000 7fc4ded9d640 1 --2- 172.21.15.1:0/3173579512 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4e0103720 0x7fc4e019f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:34.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.836+0000 7fc4de59c640 1 --2- 172.21.15.1:0/3173579512 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4e0101b70 0x7fc4e0197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:34.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.836+0000 7fc4ddd9b640 1 -- 172.21.15.1:0/3173579512 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4e0101b70 msgr2=0x7fc4e0197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:34.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.836+0000 7fc4ddd9b640 1 --2- 172.21.15.1:0/3173579512 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4e0101b70 0x7fc4e0197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.836+0000 7fc4ddd9b640 1 -- 172.21.15.1:0/3173579512 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4e0103720 msgr2=0x7fc4e019f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:34.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.836+0000 7fc4ddd9b640 1 --2- 172.21.15.1:0/3173579512 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4e0103720 0x7fc4e019f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.836+0000 7fc4ddd9b640 1 -- 172.21.15.1:0/3173579512 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e019fa40 con 0x7fc4e0102d60 2024-09-19T09:44:34.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.836+0000 7fc4ddd9b640 1 --2- 172.21.15.1:0/3173579512 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4e0102d60 0x7fc4e0198360 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4009230 tx=0x7fc4d4004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:34.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.836+0000 7fc4cf7fe640 1 -- 172.21.15.1:0/3173579512 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d403f030 con 0x7fc4e0102d60 2024-09-19T09:44:34.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.836+0000 7fc4cf7fe640 1 -- 172.21.15.1:0/3173579512 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4d4003ce0 con 0x7fc4e0102d60 2024-09-19T09:44:34.840 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.836+0000 7fc4cf7fe640 1 -- 172.21.15.1:0/3173579512 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d4035070 con 0x7fc4e0102d60 2024-09-19T09:44:34.841 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.836+0000 7fc4e4a0e640 1 -- 172.21.15.1:0/3173579512 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4e019fcd0 con 0x7fc4e0102d60 2024-09-19T09:44:34.841 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.836+0000 7fc4e4a0e640 1 -- 172.21.15.1:0/3173579512 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4e01a0170 con 0x7fc4e0102d60 2024-09-19T09:44:34.846 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.839+0000 7fc4cf7fe640 1 -- 172.21.15.1:0/3173579512 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fc4d4042030 con 0x7fc4e0102d60 2024-09-19T09:44:34.846 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.839+0000 7fc4e7883740 1 Processor -- start 2024-09-19T09:44:34.846 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.839+0000 7fc4e7883740 1 -- start start 2024-09-19T09:44:34.846 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.840+0000 7fc4e7883740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5623056579a0 0x562305657da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:34.847 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.840+0000 7fc4e7883740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5623056582e0 0x56230565cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:34.847 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.840+0000 7fc4e7883740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56230565d370 0x56230565f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:34.847 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.840+0000 7fc4e7883740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5623055bb2f0 con 0x56230565d370 2024-09-19T09:44:34.847 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.840+0000 7fc4e7883740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562305563270 con 0x5623056582e0 2024-09-19T09:44:34.847 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.840+0000 7fc4e7883740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5623055b72b0 con 0x5623056579a0 2024-09-19T09:44:34.847 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.840+0000 7fc4ddd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56230565d370 0x56230565f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:34.847 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.840+0000 7fc4ddd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56230565d370 0x56230565f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52642/0 (socket says 172.21.15.1:52642) 2024-09-19T09:44:34.847 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.840+0000 7fc4ddd9b640 1 -- 172.21.15.1:0/3661739951 learned_addr learned my addr 172.21.15.1:0/3661739951 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:34.847 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.840+0000 7fc4ded9d640 1 --2- 172.21.15.1:0/3661739951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5623056579a0 0x562305657da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:34.847 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.840+0000 7fc4de59c640 1 --2- 172.21.15.1:0/3661739951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5623056582e0 0x56230565cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:34.847 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.840+0000 7fc4cf7fe640 1 --2- 172.21.15.1:0/3173579512 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc4c80a32c0 0x7fc4c80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:34.847 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.840+0000 7fc4ded9d640 1 -- 172.21.15.1:0/3661739951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5623056582e0 msgr2=0x56230565cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:34.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.840+0000 7fc4ded9d640 1 --2- 172.21.15.1:0/3661739951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5623056582e0 0x56230565cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.840+0000 7fc4ded9d640 1 -- 172.21.15.1:0/3661739951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56230565d370 msgr2=0x56230565f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:34.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.840+0000 7fc4ded9d640 1 --2- 172.21.15.1:0/3661739951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56230565d370 0x56230565f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.840+0000 7fc4ded9d640 1 -- 172.21.15.1:0/3661739951 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562305562340 con 0x5623056579a0 2024-09-19T09:44:34.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.840+0000 7fc4de59c640 1 --2- 172.21.15.1:0/3661739951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5623056582e0 0x56230565cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:44:34.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.840+0000 7fc4ddd9b640 1 --2- 172.21.15.1:0/3661739951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56230565d370 0x56230565f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:44:34.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.840+0000 7fc4cf7fe640 1 -- 172.21.15.1:0/3173579512 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fc4d40f0280 con 0x7fc4e0102d60 2024-09-19T09:44:34.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.840+0000 7fc4ded9d640 1 --2- 172.21.15.1:0/3173579512 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc4c80a32c0 0x7fc4c80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:34.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.841+0000 7fc4ded9d640 1 --2- 172.21.15.1:0/3661739951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5623056579a0 0x562305657da0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8003a40 tx=0x7fc4d8003f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d54bb795e6d83ea3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:34.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.841+0000 7fc4ccff9640 1 -- 172.21.15.1:0/3661739951 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8024070 con 0x5623056579a0 2024-09-19T09:44:34.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.841+0000 7fc4ded9d640 1 --2- 172.21.15.1:0/3173579512 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc4c80a32c0 0x7fc4c80a5780 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8021000 tx=0x7fc4d801e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:34.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.841+0000 7fc4ccff9640 1 -- 172.21.15.1:0/3661739951 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4d80132d0 con 0x5623056579a0 2024-09-19T09:44:34.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.841+0000 7fc4ccff9640 1 -- 172.21.15.1:0/3661739951 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d801e480 con 0x5623056579a0 2024-09-19T09:44:34.848 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.842+0000 7fc4e7883740 1 -- 172.21.15.1:0/3661739951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5623056579a0 msgr2=0x562305657da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:34.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.842+0000 7fc4e7883740 1 --2- 172.21.15.1:0/3661739951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5623056579a0 0x562305657da0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8003a40 tx=0x7fc4d8003f00 comp rx=0 tx=0).stop 2024-09-19T09:44:34.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.842+0000 7fc4e7883740 1 -- 172.21.15.1:0/3661739951 shutdown_connections 2024-09-19T09:44:34.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.842+0000 7fc4e7883740 1 --2- 172.21.15.1:0/3661739951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56230565d370 0x56230565f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.842+0000 7fc4e7883740 1 --2- 172.21.15.1:0/3661739951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5623056582e0 0x56230565cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.842+0000 7fc4e7883740 1 --2- 172.21.15.1:0/3661739951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5623056579a0 0x562305657da0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.842+0000 7fc4e7883740 1 -- 172.21.15.1:0/3661739951 >> 172.21.15.1:0/3661739951 conn(0x562305653010 msgr2=0x562305653410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:34.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.842+0000 7fc4e7883740 1 -- 172.21.15.1:0/3661739951 shutdown_connections 2024-09-19T09:44:34.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.842+0000 7fc4e7883740 1 -- 172.21.15.1:0/3661739951 wait complete. 2024-09-19T09:44:34.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.842+0000 7fc4e7883740 1 -- start start 2024-09-19T09:44:34.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.842+0000 7fc4e7883740 1 Processor -- start 2024-09-19T09:44:34.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.842+0000 7fc4e7883740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5623056579a0 0x562305661c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:34.849 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.842+0000 7fc4e7883740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5623056582e0 0x562305662160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:34.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.842+0000 7fc4e7883740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56230565d370 0x5623056691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:34.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.842+0000 7fc4e7883740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x562305660340 con 0x56230565d370 2024-09-19T09:44:34.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.842+0000 7fc4e7883740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562305544290 con 0x5623056582e0 2024-09-19T09:44:34.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.842+0000 7fc4e7883740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5623056604c0 con 0x5623056579a0 2024-09-19T09:44:34.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.843+0000 7fc4e7883740 10 client.0 _ll_register_callbacks cb 0x562305575140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:44:34.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.843+0000 7fc4ded9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56230565d370 0x5623056691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:34.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.843+0000 7fc4de59c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5623056579a0 0x562305661c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:34.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.843+0000 7fc4ded9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56230565d370 0x5623056691a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52644/0 (socket says 172.21.15.1:52644) 2024-09-19T09:44:34.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.843+0000 7fc4ded9d640 1 -- 172.21.15.1:0/2052140277 learned_addr learned my addr 172.21.15.1:0/2052140277 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:34.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.843+0000 7fc4ddd9b640 1 --2- 172.21.15.1:0/2052140277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5623056582e0 0x562305662160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:34.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.843+0000 7fc4ded9d640 1 -- 172.21.15.1:0/2052140277 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5623056579a0 msgr2=0x562305661c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:34.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.843+0000 7fc4ded9d640 1 --2- 172.21.15.1:0/2052140277 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5623056579a0 0x562305661c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.850 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.843+0000 7fc4ded9d640 1 -- 172.21.15.1:0/2052140277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5623056582e0 msgr2=0x562305662160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.843+0000 7fc4ded9d640 1 --2- 172.21.15.1:0/2052140277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5623056582e0 0x562305662160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.843+0000 7fc4ded9d640 1 -- 172.21.15.1:0/2052140277 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623052ce210 con 0x56230565d370 2024-09-19T09:44:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.843+0000 7fc4ded9d640 1 --2- 172.21.15.1:0/2052140277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56230565d370 0x5623056691a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8009950 tx=0x7fc4d8009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4e5a7c12f5f541 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.843+0000 7fc4c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:44:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.843+0000 7fc4c5ffb640 1 -- 172.21.15.1:0/2052140277 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d802c070 con 0x56230565d370 2024-09-19T09:44:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.843+0000 7fc4c5ffb640 1 -- 172.21.15.1:0/2052140277 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fc4d8010580 con 0x56230565d370 2024-09-19T09:44:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.843+0000 7fc4e7883740 1 -- 172.21.15.1:0/2052140277 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4d80132d0 con 0x56230565d370 2024-09-19T09:44:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.844+0000 7fc4c5ffb640 1 -- 172.21.15.1:0/2052140277 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc4d8038050 con 0x56230565d370 2024-09-19T09:44:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.844+0000 7fc4e7883740 10 client.16224 fetch_fsmap learned FSMap version 19 2024-09-19T09:44:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.844+0000 7fc4e7883740 1 -- 172.21.15.1:0/2052140277 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56230539a620 con 0x56230565d370 2024-09-19T09:44:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.844+0000 7fc4c5ffb640 1 -- 172.21.15.1:0/2052140277 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4d80132d0 con 0x56230565d370 2024-09-19T09:44:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.844+0000 7fc4c5ffb640 1 -- 172.21.15.1:0/2052140277 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fc4d8011440 con 0x56230565d370 2024-09-19T09:44:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.844+0000 7fc4e7883740 10 client.16224 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:44:34.851 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.844+0000 7fc4e7883740 10 client.16224 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:44:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.844+0000 7fc4e7883740 20 client.16224 populate_metadata read hostname 'smithi001' 2024-09-19T09:44:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.844+0000 7fc4e7883740 1 --2- 172.21.15.1:0/2052140277 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56230566d5c0 0x56230566f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.844+0000 7fc4e7883740 4 client.16224 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:44:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.844+0000 7fc4e7883740 1 -- 172.21.15.1:0/2052140277 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623055c8a20 con 0x56230566d5c0 2024-09-19T09:44:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.844+0000 7fc4de59c640 1 --2- 172.21.15.1:0/2052140277 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56230566d5c0 0x56230566f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.845+0000 7fc4c5ffb640 10 client.16224 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:44:34.852 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.845+0000 7fc4de59c640 1 --2- 172.21.15.1:0/2052140277 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56230566d5c0 0x56230566f9b0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60d50f6f047deea8 server_cookie=fb07ed769ed25d08 in_seq=0 out_seq=0 2024-09-19T09:44:34.853 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.845+0000 7fc4c5ffb640 1 -- 172.21.15.1:0/2052140277 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5623055c8a20 con 0x56230566d5c0 2024-09-19T09:44:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.845+0000 7fc4c5ffb640 10 client.16224 handle_command_reply: tid=0 2024-09-19T09:44:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.846+0000 7fc4e7883740 1 client.16224 shutdown 2024-09-19T09:44:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.846+0000 7fc4e7883740 1 -- 172.21.15.1:0/2052140277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56230565d370 msgr2=0x5623056691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.846+0000 7fc4e7883740 1 --2- 172.21.15.1:0/2052140277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56230565d370 0x5623056691a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8009950 tx=0x7fc4d8009ca0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.846+0000 7fc4e7883740 1 -- 172.21.15.1:0/2052140277 shutdown_connections 2024-09-19T09:44:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.846+0000 7fc4e7883740 1 --2- 172.21.15.1:0/2052140277 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56230566d5c0 0x56230566f9b0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.846+0000 7fc4c5ffb640 0 client.16224 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:44:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.846+0000 7fc4e7883740 1 --2- 172.21.15.1:0/2052140277 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56230565d370 0x5623056691a0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.846+0000 7fc4e7883740 1 --2- 172.21.15.1:0/2052140277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5623056582e0 0x562305662160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.846+0000 7fc4e7883740 1 --2- 172.21.15.1:0/2052140277 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5623056579a0 0x562305661c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.846+0000 7fc4e7883740 1 -- 172.21.15.1:0/2052140277 >> 172.21.15.1:0/2052140277 conn(0x562305653010 msgr2=0x562305654820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.846+0000 7fc4e7883740 1 -- 172.21.15.1:0/2052140277 shutdown_connections 2024-09-19T09:44:34.854 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.846+0000 7fc4e7883740 1 -- 172.21.15.1:0/2052140277 wait complete. 2024-09-19T09:44:34.855 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.846+0000 7fc4e7883740 20 client.16224 trim_cache size 0 max 16384 2024-09-19T09:44:34.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.861+0000 7fc4e7883740 1 Processor -- start 2024-09-19T09:44:34.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.861+0000 7fc4e7883740 1 -- start start 2024-09-19T09:44:34.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.861+0000 7fc4e7883740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5623056579a0 0x562305653ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:34.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.861+0000 7fc4e7883740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5623056582e0 0x5623056690c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:34.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.861+0000 7fc4e7883740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56230565d370 0x562305654400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:34.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.861+0000 7fc4e7883740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e01a7010 con 0x56230565d370 2024-09-19T09:44:34.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.861+0000 7fc4e7883740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e01a98b0 con 0x5623056579a0 2024-09-19T09:44:34.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.861+0000 7fc4e7883740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e01a76a0 con 0x5623056582e0 2024-09-19T09:44:34.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.861+0000 7fc4ded9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56230565d370 0x562305654400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:34.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.861+0000 7fc4ded9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56230565d370 0x562305654400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52654/0 (socket says 172.21.15.1:52654) 2024-09-19T09:44:34.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.861+0000 7fc4ded9d640 1 -- 172.21.15.1:0/3652423846 learned_addr learned my addr 172.21.15.1:0/3652423846 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:34.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.861+0000 7fc4de59c640 1 --2- 172.21.15.1:0/3652423846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5623056579a0 0x562305653ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:34.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.861+0000 7fc4ddd9b640 1 --2- 172.21.15.1:0/3652423846 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5623056582e0 0x5623056690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:34.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.861+0000 7fc4ded9d640 1 -- 172.21.15.1:0/3652423846 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5623056582e0 msgr2=0x5623056690c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.861+0000 7fc4ded9d640 1 --2- 172.21.15.1:0/3652423846 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5623056582e0 0x5623056690c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.861+0000 7fc4ded9d640 1 -- 172.21.15.1:0/3652423846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5623056579a0 msgr2=0x562305653ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.861+0000 7fc4ded9d640 1 --2- 172.21.15.1:0/3652423846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5623056579a0 0x562305653ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.861+0000 7fc4ded9d640 1 -- 172.21.15.1:0/3652423846 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56230566ff90 con 0x56230565d370 2024-09-19T09:44:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.862+0000 7fc4ded9d640 1 --2- 172.21.15.1:0/3652423846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56230565d370 0x562305654400 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8003990 tx=0x7fc4d8005cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1dde5c256ba69e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.862+0000 7fc4c7fff640 1 -- 172.21.15.1:0/3652423846 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d802c040 con 0x56230565d370 2024-09-19T09:44:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.862+0000 7fc4c7fff640 1 -- 172.21.15.1:0/3652423846 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4d8011e50 con 0x56230565d370 2024-09-19T09:44:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.862+0000 7fc4c7fff640 1 -- 172.21.15.1:0/3652423846 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8024040 con 0x56230565d370 2024-09-19T09:44:34.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.862+0000 7fc4e7883740 1 -- 172.21.15.1:0/3652423846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56230565d370 msgr2=0x562305654400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:34.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.862+0000 7fc4e7883740 1 --2- 172.21.15.1:0/3652423846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56230565d370 0x562305654400 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8003990 tx=0x7fc4d8005cf0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.862+0000 7fc4e7883740 1 -- 172.21.15.1:0/3652423846 shutdown_connections 2024-09-19T09:44:34.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.862+0000 7fc4e7883740 1 --2- 172.21.15.1:0/3652423846 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56230565d370 0x562305654400 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.862+0000 7fc4e7883740 1 --2- 172.21.15.1:0/3652423846 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5623056582e0 0x5623056690c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.862+0000 7fc4e7883740 1 --2- 172.21.15.1:0/3652423846 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5623056579a0 0x562305653ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.862+0000 7fc4e7883740 1 -- 172.21.15.1:0/3652423846 >> 172.21.15.1:0/3652423846 conn(0x562305653010 msgr2=0x562305661c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:34.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.862+0000 7fc4e7883740 1 -- 172.21.15.1:0/3652423846 shutdown_connections 2024-09-19T09:44:34.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.862+0000 7fc4e7883740 1 -- 172.21.15.1:0/3652423846 wait complete. 2024-09-19T09:44:34.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.863+0000 7fc4e7883740 1 -- start start 2024-09-19T09:44:34.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.863+0000 7fc4e7883740 1 Processor -- start 2024-09-19T09:44:34.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.863+0000 7fc4e7883740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5623056579a0 0x562305666790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:34.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.863+0000 7fc4e7883740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623056582e0 0x562305666cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:34.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.863+0000 7fc4e7883740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56230565d370 0x562305667c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:34.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.863+0000 7fc4e7883740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e01a7d70 con 0x5623056582e0 2024-09-19T09:44:34.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.863+0000 7fc4e7883740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e01a91e0 con 0x5623056579a0 2024-09-19T09:44:34.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.863+0000 7fc4e7883740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e01a8440 con 0x56230565d370 2024-09-19T09:44:34.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.863+0000 7fc4e7883740 10 client.0 _ll_register_callbacks cb 0x7fc4d8022070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:44:34.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.863+0000 7fc4ddd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623056582e0 0x562305666cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:34.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.863+0000 7fc4ddd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623056582e0 0x562305666cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:52656/0 (socket says 172.21.15.1:52656) 2024-09-19T09:44:34.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.863+0000 7fc4ddd9b640 1 -- 172.21.15.1:0/644764005 learned_addr learned my addr 172.21.15.1:0/644764005 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:34.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.863+0000 7fc4de59c640 1 --2- 172.21.15.1:0/644764005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5623056579a0 0x562305666790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:34.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.863+0000 7fc4ddd9b640 1 -- 172.21.15.1:0/644764005 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56230565d370 msgr2=0x562305667c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:34.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.863+0000 7fc4ddd9b640 1 --2- 172.21.15.1:0/644764005 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56230565d370 0x562305667c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.863+0000 7fc4ddd9b640 1 -- 172.21.15.1:0/644764005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5623056579a0 msgr2=0x562305666790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:34.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.863+0000 7fc4ddd9b640 1 --2- 172.21.15.1:0/644764005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5623056579a0 0x562305666790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.864+0000 7fc4ddd9b640 1 -- 172.21.15.1:0/644764005 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562305668250 con 0x5623056582e0 2024-09-19T09:44:34.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.864+0000 7fc4ddd9b640 1 --2- 172.21.15.1:0/644764005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623056582e0 0x562305666cd0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc4d40b9270 tx=0x7fc4d40f3c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf797c5803c20cae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:34.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.864+0000 7fc4c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:44:34.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.864+0000 7fc4c5ffb640 1 -- 172.21.15.1:0/644764005 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d4049040 con 0x5623056582e0 2024-09-19T09:44:34.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.864+0000 7fc4c5ffb640 1 -- 172.21.15.1:0/644764005 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fc4d40b8f10 con 0x5623056582e0 2024-09-19T09:44:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.864+0000 7fc4e7883740 1 -- 172.21.15.1:0/644764005 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4d8011e50 con 0x5623056582e0 2024-09-19T09:44:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.864+0000 7fc4c5ffb640 1 -- 172.21.15.1:0/644764005 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc4d40bc670 con 0x5623056582e0 2024-09-19T09:44:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.864+0000 7fc4e7883740 10 client.16230 fetch_fsmap learned FSMap version 19 2024-09-19T09:44:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.864+0000 7fc4e7883740 1 -- 172.21.15.1:0/644764005 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x5623056d8200 con 0x5623056582e0 2024-09-19T09:44:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.864+0000 7fc4c5ffb640 1 -- 172.21.15.1:0/644764005 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4d8011e50 con 0x5623056582e0 2024-09-19T09:44:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.864+0000 7fc4c5ffb640 1 -- 172.21.15.1:0/644764005 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fc4d40bcb00 con 0x5623056582e0 2024-09-19T09:44:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.864+0000 7fc4e7883740 10 client.16230 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:44:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.864+0000 7fc4e7883740 10 client.16230 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:44:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.864+0000 7fc4e7883740 20 client.16230 populate_metadata read hostname 'smithi001' 2024-09-19T09:44:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.864+0000 7fc4e7883740 1 --2- 172.21.15.1:0/644764005 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56230566d5c0 0x5623056dab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.864+0000 7fc4e7883740 4 client.16230 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:44:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.864+0000 7fc4e7883740 1 -- 172.21.15.1:0/644764005 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5623055c2d70 con 0x56230566d5c0 2024-09-19T09:44:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.865+0000 7fc4de59c640 1 --2- 172.21.15.1:0/644764005 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56230566d5c0 0x5623056dab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.865+0000 7fc4de59c640 1 --2- 172.21.15.1:0/644764005 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56230566d5c0 0x5623056dab40 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b4cc6b0adde5fd2 server_cookie=4ef59ef683596e58 in_seq=0 out_seq=0 2024-09-19T09:44:34.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.865+0000 7fc4c5ffb640 10 client.16230 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:44:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.878+0000 7fc4c5ffb640 1 -- 172.21.15.1:0/644764005 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5623055c2d70 con 0x56230566d5c0 2024-09-19T09:44:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.878+0000 7fc4c5ffb640 10 client.16230 handle_command_reply: tid=0 2024-09-19T09:44:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.878+0000 7fc4e7883740 1 client.16230 shutdown 2024-09-19T09:44:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.879+0000 7fc4e7883740 1 -- 172.21.15.1:0/644764005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623056582e0 msgr2=0x562305666cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.879+0000 7fc4e7883740 1 --2- 172.21.15.1:0/644764005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623056582e0 0x562305666cd0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc4d40b9270 tx=0x7fc4d40f3c90 comp rx=0 tx=0).stop 2024-09-19T09:44:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.879+0000 7fc4e7883740 1 -- 172.21.15.1:0/644764005 shutdown_connections 2024-09-19T09:44:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.879+0000 7fc4e7883740 1 --2- 172.21.15.1:0/644764005 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56230566d5c0 0x5623056dab40 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.879+0000 7fc4e7883740 1 --2- 172.21.15.1:0/644764005 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56230565d370 0x562305667c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.879+0000 7fc4e7883740 1 --2- 172.21.15.1:0/644764005 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5623056582e0 0x562305666cd0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.879+0000 7fc4c5ffb640 0 client.16230 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:44:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.879+0000 7fc4e7883740 1 --2- 172.21.15.1:0/644764005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5623056579a0 0x562305666790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.879+0000 7fc4e7883740 1 -- 172.21.15.1:0/644764005 >> 172.21.15.1:0/644764005 conn(0x562305653010 msgr2=0x5623056519a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.879+0000 7fc4e7883740 1 -- 172.21.15.1:0/644764005 shutdown_connections 2024-09-19T09:44:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.879+0000 7fc4e7883740 1 -- 172.21.15.1:0/644764005 wait complete. 2024-09-19T09:44:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.879+0000 7fc4e7883740 20 client.16230 trim_cache size 0 max 16384 2024-09-19T09:44:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:44:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:44:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:44:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:44:34.883 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.879+0000 7fc4e4a0e640 1 -- 172.21.15.1:0/3173579512 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc4c80a32c0 msgr2=0x7fc4c80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:34.883 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.879+0000 7fc4e4a0e640 1 --2- 172.21.15.1:0/3173579512 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc4c80a32c0 0x7fc4c80a5780 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8021000 tx=0x7fc4d801e000 comp rx=0 tx=0).stop 2024-09-19T09:44:34.883 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.879+0000 7fc4e4a0e640 1 -- 172.21.15.1:0/3173579512 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4e0102d60 msgr2=0x7fc4e0198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:34.883 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.879+0000 7fc4e4a0e640 1 --2- 172.21.15.1:0/3173579512 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4e0102d60 0x7fc4e0198360 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4009230 tx=0x7fc4d4004360 comp rx=0 tx=0).stop 2024-09-19T09:44:34.883 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.879+0000 7fc4e4a0e640 1 -- 172.21.15.1:0/3173579512 shutdown_connections 2024-09-19T09:44:34.883 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.879+0000 7fc4e4a0e640 1 --2- 172.21.15.1:0/3173579512 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc4c80a32c0 0x7fc4c80a5780 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.883 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.879+0000 7fc4e4a0e640 1 --2- 172.21.15.1:0/3173579512 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4e0103720 0x7fc4e019f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.884 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.879+0000 7fc4e4a0e640 1 --2- 172.21.15.1:0/3173579512 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc4e0102d60 0x7fc4e0198360 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.884 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.879+0000 7fc4e4a0e640 1 --2- 172.21.15.1:0/3173579512 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc4e0101b70 0x7fc4e0197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:34.884 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.880+0000 7fc4e4a0e640 1 -- 172.21.15.1:0/3173579512 >> 172.21.15.1:0/3173579512 conn(0x7fc4e00fd2f0 msgr2=0x7fc4e01060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:34.884 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.880+0000 7fc4e4a0e640 1 -- 172.21.15.1:0/3173579512 shutdown_connections 2024-09-19T09:44:34.884 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:34.880+0000 7fc4e4a0e640 1 -- 172.21.15.1:0/3173579512 wait complete. 2024-09-19T09:44:35.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:35 smithi001 ceph-mon[31225]: pgmap v533: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 5.1 MiB/s wr, 1.08k op/s 2024-09-19T09:44:36.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:35 smithi022 ceph-mon[35583]: pgmap v533: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 5.1 MiB/s wr, 1.08k op/s 2024-09-19T09:44:36.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:35 smithi121 ceph-mon[35577]: pgmap v533: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 5.1 MiB/s wr, 1.08k op/s 2024-09-19T09:44:36.617 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:44:37.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:37 smithi001 ceph-mon[31225]: pgmap v534: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.6 MiB/s wr, 1.20k op/s 2024-09-19T09:44:37.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:37 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:38.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:37 smithi022 ceph-mon[35583]: pgmap v534: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.6 MiB/s wr, 1.20k op/s 2024-09-19T09:44:38.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:37 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:38.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:37 smithi121 ceph-mon[35577]: pgmap v534: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.6 MiB/s wr, 1.20k op/s 2024-09-19T09:44:38.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:37 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:44:39.139 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db --set-id 978f3b4d --release --await' 2024-09-19T09:44:39.139 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db --set-id 978f3b4d --release --await 2024-09-19T09:44:39.228 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:44:39.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:39 smithi001 ceph-mon[31225]: pgmap v535: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8.1 MiB/s wr, 1.81k op/s 2024-09-19T09:44:39.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:39 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:44:39.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:39 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:44:39.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:39 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:44:39.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:39 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:44:39.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:39 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:39.999 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:39 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:39.999 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:39 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:44:40.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:39 smithi022 ceph-mon[35583]: pgmap v535: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8.1 MiB/s wr, 1.81k op/s 2024-09-19T09:44:40.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:39 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:44:40.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:39 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:44:40.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:39 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:44:40.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:39 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:44:40.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:39 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:40.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:39 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:40.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:39 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:44:40.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:39 smithi121 ceph-mon[35577]: pgmap v535: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8.1 MiB/s wr, 1.81k op/s 2024-09-19T09:44:40.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:39 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:44:40.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:39 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:44:40.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:39 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:44:40.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:39 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:44:40.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:39 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:44:40.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:39 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:44:40.118 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:39 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:44:40.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:40 smithi001 ceph-mon[31225]: Adjusting osd_memory_target on smithi001 to 177.0M 2024-09-19T09:44:40.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:40 smithi001 ceph-mon[31225]: Unable to set osd_memory_target on smithi001 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-19T09:44:41.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:40 smithi022 ceph-mon[35583]: Adjusting osd_memory_target on smithi001 to 177.0M 2024-09-19T09:44:41.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:40 smithi022 ceph-mon[35583]: Unable to set osd_memory_target on smithi001 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-19T09:44:41.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:40 smithi121 ceph-mon[35577]: Adjusting osd_memory_target on smithi001 to 177.0M 2024-09-19T09:44:41.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:40 smithi121 ceph-mon[35577]: Unable to set osd_memory_target on smithi001 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-19T09:44:41.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.684+0000 7f3b9ad68640 1 -- 172.21.15.1:0/3310770698 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b94100e20 msgr2=0x7f3b94101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:41.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.684+0000 7f3b9ad68640 1 --2- 172.21.15.1:0/3310770698 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b94100e20 0x7f3b94101200 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f3b88009900 tx=0x7f3b8802a480 comp rx=0 tx=0).stop 2024-09-19T09:44:41.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.684+0000 7f3b9ad68640 1 -- 172.21.15.1:0/3310770698 shutdown_connections 2024-09-19T09:44:41.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.684+0000 7f3b9ad68640 1 --2- 172.21.15.1:0/3310770698 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b94102ef0 0x7f3b9410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.684+0000 7f3b9ad68640 1 --2- 172.21.15.1:0/3310770698 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b94102570 0x7f3b941029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.684+0000 7f3b9ad68640 1 --2- 172.21.15.1:0/3310770698 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b94100e20 0x7f3b94101200 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.684+0000 7f3b9ad68640 1 -- 172.21.15.1:0/3310770698 >> 172.21.15.1:0/3310770698 conn(0x7f3b940fc7d0 msgr2=0x7f3b940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:41.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.684+0000 7f3b9ad68640 1 -- 172.21.15.1:0/3310770698 shutdown_connections 2024-09-19T09:44:41.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.684+0000 7f3b9ad68640 1 -- 172.21.15.1:0/3310770698 wait complete. 2024-09-19T09:44:41.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.685+0000 7f3b9ad68640 1 Processor -- start 2024-09-19T09:44:41.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.685+0000 7f3b9ad68640 1 -- start start 2024-09-19T09:44:41.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.685+0000 7f3b9ad68640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b94100e20 0x7f3b94198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:41.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.685+0000 7f3b9ad68640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b94102570 0x7f3b941989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:41.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.685+0000 7f3b9ad68640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b94102ef0 0x7f3b9419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:41.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.685+0000 7f3b9ad68640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3b94110f80 con 0x7f3b94102570 2024-09-19T09:44:41.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.685+0000 7f3b9ad68640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3b94110e00 con 0x7f3b94100e20 2024-09-19T09:44:41.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.685+0000 7f3b9ad68640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3b94111100 con 0x7f3b94102ef0 2024-09-19T09:44:41.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.685+0000 7f3b93fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b94102570 0x7f3b941989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:41.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.685+0000 7f3b93fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b94102570 0x7f3b941989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59234/0 (socket says 172.21.15.1:59234) 2024-09-19T09:44:41.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.685+0000 7f3b93fff640 1 -- 172.21.15.1:0/1378867509 learned_addr learned my addr 172.21.15.1:0/1378867509 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:41.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.685+0000 7f3b98b04640 1 --2- 172.21.15.1:0/1378867509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b94100e20 0x7f3b94198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:41.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.686+0000 7f3b99305640 1 --2- 172.21.15.1:0/1378867509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b94102ef0 0x7f3b9419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:41.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.686+0000 7f3b93fff640 1 -- 172.21.15.1:0/1378867509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b94102ef0 msgr2=0x7f3b9419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:41.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.686+0000 7f3b93fff640 1 --2- 172.21.15.1:0/1378867509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b94102ef0 0x7f3b9419cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.686+0000 7f3b93fff640 1 -- 172.21.15.1:0/1378867509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b94100e20 msgr2=0x7f3b94198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:41.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.686+0000 7f3b93fff640 1 --2- 172.21.15.1:0/1378867509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b94100e20 0x7f3b94198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.686+0000 7f3b93fff640 1 -- 172.21.15.1:0/1378867509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b9419d410 con 0x7f3b94102570 2024-09-19T09:44:41.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.686+0000 7f3b93fff640 1 --2- 172.21.15.1:0/1378867509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b94102570 0x7f3b941989a0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3b8000c890 tx=0x7f3b8000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:41.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.687+0000 7f3b91ffb640 1 -- 172.21.15.1:0/1378867509 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b80004220 con 0x7f3b94102570 2024-09-19T09:44:41.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.687+0000 7f3b9ad68640 1 -- 172.21.15.1:0/1378867509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b9419d700 con 0x7f3b94102570 2024-09-19T09:44:41.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.687+0000 7f3b91ffb640 1 -- 172.21.15.1:0/1378867509 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b800043c0 con 0x7f3b94102570 2024-09-19T09:44:41.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.687+0000 7f3b91ffb640 1 -- 172.21.15.1:0/1378867509 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b800049e0 con 0x7f3b94102570 2024-09-19T09:44:41.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.687+0000 7f3b9ad68640 1 -- 172.21.15.1:0/1378867509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b941a4fe0 con 0x7f3b94102570 2024-09-19T09:44:41.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.689+0000 7f3b91ffb640 1 -- 172.21.15.1:0/1378867509 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f3b800079b0 con 0x7f3b94102570 2024-09-19T09:44:41.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.690+0000 7f3b9d141740 1 Processor -- start 2024-09-19T09:44:41.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.690+0000 7f3b9d141740 1 -- start start 2024-09-19T09:44:41.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.690+0000 7f3b9d141740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557922bc74a0 0x557922bc7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:41.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.690+0000 7f3b9d141740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557922bc7dc0 0x557922bd2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:41.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.690+0000 7f3b9d141740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557922bd2680 0x557922bd4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:41.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.690+0000 7f3b9d141740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557922b2d2e0 con 0x557922bc74a0 2024-09-19T09:44:41.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.690+0000 7f3b9d141740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557922ad4ce0 con 0x557922bc7dc0 2024-09-19T09:44:41.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.690+0000 7f3b9d141740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x557922b292a0 con 0x557922bd2680 2024-09-19T09:44:41.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.690+0000 7f3b91ffb640 1 --2- 172.21.15.1:0/1378867509 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3b840a3240 0x7f3b840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:41.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.690+0000 7f3b98b04640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557922bc7dc0 0x557922bd2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:41.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.690+0000 7f3b98b04640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557922bc7dc0 0x557922bd2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:44722/0 (socket says 172.21.15.1:44722) 2024-09-19T09:44:41.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.691+0000 7f3b98b04640 1 -- 172.21.15.1:0/104066393 learned_addr learned my addr 172.21.15.1:0/104066393 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:41.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.691+0000 7f3b99305640 1 --2- 172.21.15.1:0/104066393 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557922bc74a0 0x557922bc7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:41.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.691+0000 7f3b93fff640 1 --2- 172.21.15.1:0/104066393 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557922bd2680 0x557922bd4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:41.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.691+0000 7f3b99305640 1 --2- 172.21.15.1:0/1378867509 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3b840a3240 0x7f3b840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:41.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.691+0000 7f3b91ffb640 1 -- 172.21.15.1:0/1378867509 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f3b800cf970 con 0x7f3b94102570 2024-09-19T09:44:41.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.691+0000 7f3b98b04640 1 -- 172.21.15.1:0/104066393 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557922bd2680 msgr2=0x557922bd4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:41.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.691+0000 7f3b98b04640 1 --2- 172.21.15.1:0/104066393 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557922bd2680 0x557922bd4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.691+0000 7f3b98b04640 1 -- 172.21.15.1:0/104066393 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557922bc74a0 msgr2=0x557922bc7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:41.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.691+0000 7f3b98b04640 1 --2- 172.21.15.1:0/104066393 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557922bc74a0 0x557922bc7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.691+0000 7f3b98b04640 1 -- 172.21.15.1:0/104066393 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557922ab9440 con 0x557922bc7dc0 2024-09-19T09:44:41.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.691+0000 7f3b99305640 1 --2- 172.21.15.1:0/104066393 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557922bc74a0 0x557922bc7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:44:41.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.691+0000 7f3b98b04640 1 --2- 172.21.15.1:0/104066393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557922bc7dc0 0x557922bd2140 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3b88009900 tx=0x7f3b88004200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3de92b65369c3ea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:41.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.691+0000 7f3b99305640 1 --2- 172.21.15.1:0/1378867509 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3b840a3240 0x7f3b840a5700 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c013600 tx=0x7f3b8c004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:41.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.691+0000 7f3b7effd640 1 -- 172.21.15.1:0/104066393 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b88035030 con 0x557922bc7dc0 2024-09-19T09:44:41.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.692+0000 7f3b7effd640 1 -- 172.21.15.1:0/104066393 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b88040070 con 0x557922bc7dc0 2024-09-19T09:44:41.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.692+0000 7f3b7effd640 1 -- 172.21.15.1:0/104066393 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b88031cb0 con 0x557922bc7dc0 2024-09-19T09:44:41.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.692+0000 7f3b9d141740 1 -- 172.21.15.1:0/104066393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557922bc7dc0 msgr2=0x557922bd2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:41.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.692+0000 7f3b9d141740 1 --2- 172.21.15.1:0/104066393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557922bc7dc0 0x557922bd2140 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3b88009900 tx=0x7f3b88004200 comp rx=0 tx=0).stop 2024-09-19T09:44:41.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.692+0000 7f3b9d141740 1 -- 172.21.15.1:0/104066393 shutdown_connections 2024-09-19T09:44:41.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.692+0000 7f3b9d141740 1 --2- 172.21.15.1:0/104066393 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557922bd2680 0x557922bd4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.692+0000 7f3b9d141740 1 --2- 172.21.15.1:0/104066393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557922bc7dc0 0x557922bd2140 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.692+0000 7f3b9d141740 1 --2- 172.21.15.1:0/104066393 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557922bc74a0 0x557922bc7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.692+0000 7f3b9d141740 1 -- 172.21.15.1:0/104066393 >> 172.21.15.1:0/104066393 conn(0x557922bc3a30 msgr2=0x557922bc3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:41.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.692+0000 7f3b9d141740 1 -- 172.21.15.1:0/104066393 shutdown_connections 2024-09-19T09:44:41.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.692+0000 7f3b9d141740 1 -- 172.21.15.1:0/104066393 wait complete. 2024-09-19T09:44:41.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.693+0000 7f3b9d141740 1 -- start start 2024-09-19T09:44:41.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.693+0000 7f3b9d141740 1 Processor -- start 2024-09-19T09:44:41.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.693+0000 7f3b9d141740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557922bc74a0 0x557922bd1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:41.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.693+0000 7f3b9d141740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557922bc7dc0 0x557922bcf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:41.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.693+0000 7f3b9d141740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557922bd2680 0x557922bcf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:41.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.693+0000 7f3b9d141740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557922bd5250 con 0x557922bd2680 2024-09-19T09:44:41.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.693+0000 7f3b9d141740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557922ae8050 con 0x557922bc74a0 2024-09-19T09:44:41.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.693+0000 7f3b9d141740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x557922bd53d0 con 0x557922bc7dc0 2024-09-19T09:44:41.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.693+0000 7f3b9d141740 10 client.0 _ll_register_callbacks cb 0x557922b28160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:44:41.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.693+0000 7f3b98b04640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557922bc74a0 0x557922bd1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:41.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.693+0000 7f3b99305640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557922bd2680 0x557922bcf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:41.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.694+0000 7f3b98b04640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557922bc74a0 0x557922bd1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:44732/0 (socket says 172.21.15.1:44732) 2024-09-19T09:44:41.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.694+0000 7f3b99305640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557922bd2680 0x557922bcf780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59250/0 (socket says 172.21.15.1:59250) 2024-09-19T09:44:41.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.694+0000 7f3b98b04640 1 -- 172.21.15.1:0/3558025273 learned_addr learned my addr 172.21.15.1:0/3558025273 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:41.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.694+0000 7f3b93fff640 1 --2- 172.21.15.1:0/3558025273 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557922bc7dc0 0x557922bcf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:41.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.694+0000 7f3b98b04640 1 -- 172.21.15.1:0/3558025273 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557922bc7dc0 msgr2=0x557922bcf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:41.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.694+0000 7f3b98b04640 1 --2- 172.21.15.1:0/3558025273 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557922bc7dc0 0x557922bcf240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.694+0000 7f3b98b04640 1 -- 172.21.15.1:0/3558025273 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557922bd2680 msgr2=0x557922bcf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:41.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.694+0000 7f3b98b04640 1 --2- 172.21.15.1:0/3558025273 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557922bd2680 0x557922bcf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.694+0000 7f3b98b04640 1 -- 172.21.15.1:0/3558025273 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55792289e3c0 con 0x557922bc74a0 2024-09-19T09:44:41.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.694+0000 7f3b98b04640 1 --2- 172.21.15.1:0/3558025273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557922bc74a0 0x557922bd1f90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3b88031990 tx=0x7f3b88005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35148350d7212229 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:41.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.694+0000 7f3b73fff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:44:41.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.694+0000 7f3b73fff640 1 -- 172.21.15.1:0/3558025273 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b88035070 con 0x557922bc74a0 2024-09-19T09:44:41.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.694+0000 7f3b73fff640 1 -- 172.21.15.1:0/3558025273 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f3b880037f0 con 0x557922bc74a0 2024-09-19T09:44:41.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.694+0000 7f3b9d141740 1 -- 172.21.15.1:0/3558025273 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b88040070 con 0x557922bc74a0 2024-09-19T09:44:41.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.694+0000 7f3b73fff640 1 -- 172.21.15.1:0/3558025273 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3b88009520 con 0x557922bc74a0 2024-09-19T09:44:41.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.694+0000 7f3b9d141740 10 client.25913 fetch_fsmap learned FSMap version 19 2024-09-19T09:44:41.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.695+0000 7f3b9d141740 1 -- 172.21.15.1:0/3558025273 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x557922be0bd0 con 0x557922bc74a0 2024-09-19T09:44:41.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.695+0000 7f3b73fff640 1 -- 172.21.15.1:0/3558025273 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b88040070 con 0x557922bc74a0 2024-09-19T09:44:41.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.695+0000 7f3b73fff640 1 -- 172.21.15.1:0/3558025273 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3b88045c90 con 0x557922bc74a0 2024-09-19T09:44:41.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.695+0000 7f3b9d141740 10 client.25913 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:44:41.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.695+0000 7f3b9d141740 10 client.25913 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:44:41.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.695+0000 7f3b9d141740 20 client.25913 populate_metadata read hostname 'smithi001' 2024-09-19T09:44:41.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.695+0000 7f3b9d141740 1 --2- 172.21.15.1:0/3558025273 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x557922be1f20 0x557922be4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:41.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.695+0000 7f3b9d141740 4 client.25913 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:44:41.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.695+0000 7f3b9d141740 1 -- 172.21.15.1:0/3558025273 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557922b3a850 con 0x557922be1f20 2024-09-19T09:44:41.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.695+0000 7f3b93fff640 1 --2- 172.21.15.1:0/3558025273 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x557922be1f20 0x557922be4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:41.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.696+0000 7f3b73fff640 10 client.25913 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:44:41.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.696+0000 7f3b93fff640 1 --2- 172.21.15.1:0/3558025273 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x557922be1f20 0x557922be4310 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=661a91da9c52a9a3 server_cookie=c44fbba20c137caf in_seq=0 out_seq=0 2024-09-19T09:44:41.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.696+0000 7f3b73fff640 1 -- 172.21.15.1:0/3558025273 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557922b3a850 con 0x557922be1f20 2024-09-19T09:44:41.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.696+0000 7f3b73fff640 10 client.25913 handle_command_reply: tid=0 2024-09-19T09:44:41.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.696+0000 7f3b9d141740 1 client.25913 shutdown 2024-09-19T09:44:41.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.697+0000 7f3b9d141740 1 -- 172.21.15.1:0/3558025273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557922bc74a0 msgr2=0x557922bd1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:41.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.697+0000 7f3b9d141740 1 --2- 172.21.15.1:0/3558025273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557922bc74a0 0x557922bd1f90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3b88031990 tx=0x7f3b88005c00 comp rx=0 tx=0).stop 2024-09-19T09:44:41.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.697+0000 7f3b9d141740 1 -- 172.21.15.1:0/3558025273 shutdown_connections 2024-09-19T09:44:41.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.697+0000 7f3b9d141740 1 --2- 172.21.15.1:0/3558025273 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x557922be1f20 0x557922be4310 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.697+0000 7f3b9d141740 1 --2- 172.21.15.1:0/3558025273 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557922bd2680 0x557922bcf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.697+0000 7f3b9d141740 1 --2- 172.21.15.1:0/3558025273 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557922bc7dc0 0x557922bcf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.697+0000 7f3b9d141740 1 --2- 172.21.15.1:0/3558025273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557922bc74a0 0x557922bd1f90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.697+0000 7f3b9d141740 1 -- 172.21.15.1:0/3558025273 >> 172.21.15.1:0/3558025273 conn(0x557922bc3a30 msgr2=0x557922bc9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:41.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.697+0000 7f3b73fff640 0 client.25913 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:44:41.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.697+0000 7f3b9d141740 1 -- 172.21.15.1:0/3558025273 shutdown_connections 2024-09-19T09:44:41.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.697+0000 7f3b9d141740 1 -- 172.21.15.1:0/3558025273 wait complete. 2024-09-19T09:44:41.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.697+0000 7f3b9d141740 20 client.25913 trim_cache size 0 max 16384 2024-09-19T09:44:41.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.714+0000 7f3b9d141740 1 Processor -- start 2024-09-19T09:44:41.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.714+0000 7f3b9d141740 1 -- start start 2024-09-19T09:44:41.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.715+0000 7f3b9d141740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557922bc74a0 0x557922bce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:41.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.715+0000 7f3b9d141740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557922bc7dc0 0x557922bcf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:41.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.715+0000 7f3b9d141740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557922bd2680 0x557922be7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:41.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.715+0000 7f3b9d141740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3b941ab460 con 0x557922bd2680 2024-09-19T09:44:41.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.715+0000 7f3b9d141740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3b941add00 con 0x557922bc7dc0 2024-09-19T09:44:41.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.715+0000 7f3b9d141740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3b941abaf0 con 0x557922bc74a0 2024-09-19T09:44:41.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.715+0000 7f3b99305640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557922bd2680 0x557922be7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:41.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.715+0000 7f3b99305640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557922bd2680 0x557922be7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59252/0 (socket says 172.21.15.1:59252) 2024-09-19T09:44:41.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.715+0000 7f3b99305640 1 -- 172.21.15.1:0/1109003702 learned_addr learned my addr 172.21.15.1:0/1109003702 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:41.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.715+0000 7f3b93fff640 1 --2- 172.21.15.1:0/1109003702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557922bc7dc0 0x557922bcf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:41.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.715+0000 7f3b98b04640 1 --2- 172.21.15.1:0/1109003702 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557922bc74a0 0x557922bce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:41.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.715+0000 7f3b93fff640 1 -- 172.21.15.1:0/1109003702 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557922bc74a0 msgr2=0x557922bce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:41.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.715+0000 7f3b93fff640 1 --2- 172.21.15.1:0/1109003702 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557922bc74a0 0x557922bce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.715+0000 7f3b93fff640 1 -- 172.21.15.1:0/1109003702 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557922bd2680 msgr2=0x557922be7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:41.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.715+0000 7f3b93fff640 1 --2- 172.21.15.1:0/1109003702 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557922bd2680 0x557922be7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.715+0000 7f3b93fff640 1 -- 172.21.15.1:0/1109003702 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557922bc3860 con 0x557922bc7dc0 2024-09-19T09:44:41.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.716+0000 7f3b93fff640 1 --2- 172.21.15.1:0/1109003702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557922bc7dc0 0x557922bcf660 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3b8009bc90 tx=0x7f3b80066e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2816e4d94def351 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:41.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.716+0000 7f3b7e7fc640 1 -- 172.21.15.1:0/1109003702 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8001d070 con 0x557922bc7dc0 2024-09-19T09:44:41.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.716+0000 7f3b7e7fc640 1 -- 172.21.15.1:0/1109003702 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b8009bf90 con 0x557922bc7dc0 2024-09-19T09:44:41.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.716+0000 7f3b7e7fc640 1 -- 172.21.15.1:0/1109003702 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b80098600 con 0x557922bc7dc0 2024-09-19T09:44:41.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.717+0000 7f3b9d141740 1 -- 172.21.15.1:0/1109003702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557922bc7dc0 msgr2=0x557922bcf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:41.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.717+0000 7f3b9d141740 1 --2- 172.21.15.1:0/1109003702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557922bc7dc0 0x557922bcf660 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3b8009bc90 tx=0x7f3b80066e70 comp rx=0 tx=0).stop 2024-09-19T09:44:41.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.717+0000 7f3b9d141740 1 -- 172.21.15.1:0/1109003702 shutdown_connections 2024-09-19T09:44:41.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.717+0000 7f3b9d141740 1 --2- 172.21.15.1:0/1109003702 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557922bd2680 0x557922be7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.717+0000 7f3b9d141740 1 --2- 172.21.15.1:0/1109003702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557922bc7dc0 0x557922bcf660 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.717+0000 7f3b9d141740 1 --2- 172.21.15.1:0/1109003702 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557922bc74a0 0x557922bce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.717+0000 7f3b9d141740 1 -- 172.21.15.1:0/1109003702 >> 172.21.15.1:0/1109003702 conn(0x557922bc3a30 msgr2=0x557922bca8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:41.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.717+0000 7f3b9d141740 1 -- 172.21.15.1:0/1109003702 shutdown_connections 2024-09-19T09:44:41.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.717+0000 7f3b9d141740 1 -- 172.21.15.1:0/1109003702 wait complete. 2024-09-19T09:44:41.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.718+0000 7f3b9d141740 1 -- start start 2024-09-19T09:44:41.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.718+0000 7f3b9d141740 1 Processor -- start 2024-09-19T09:44:41.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.718+0000 7f3b9d141740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557922bc74a0 0x557922be7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:41.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.718+0000 7f3b9d141740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557922bc7dc0 0x557922c451b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:41.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.718+0000 7f3b9d141740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557922bd2680 0x557922c456f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:41.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.718+0000 7f3b9d141740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3b941ac1c0 con 0x557922bc74a0 2024-09-19T09:44:41.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.718+0000 7f3b9d141740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3b941ad630 con 0x557922bd2680 2024-09-19T09:44:41.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.718+0000 7f3b9d141740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3b941ac890 con 0x557922bc7dc0 2024-09-19T09:44:41.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.719+0000 7f3b98b04640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557922bc74a0 0x557922be7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:41.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.719+0000 7f3b9d141740 10 client.0 _ll_register_callbacks cb 0x7f3b880040d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:44:41.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.719+0000 7f3b93fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557922bc7dc0 0x557922c451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:41.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.719+0000 7f3b98b04640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557922bc74a0 0x557922be7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59264/0 (socket says 172.21.15.1:59264) 2024-09-19T09:44:41.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.719+0000 7f3b98b04640 1 -- 172.21.15.1:0/115929704 learned_addr learned my addr 172.21.15.1:0/115929704 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:41.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.719+0000 7f3b99305640 1 --2- 172.21.15.1:0/115929704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557922bd2680 0x557922c456f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:41.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.719+0000 7f3b93fff640 1 -- 172.21.15.1:0/115929704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557922bd2680 msgr2=0x557922c456f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:41.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.719+0000 7f3b93fff640 1 --2- 172.21.15.1:0/115929704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557922bd2680 0x557922c456f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.719+0000 7f3b93fff640 1 -- 172.21.15.1:0/115929704 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557922bc74a0 msgr2=0x557922be7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:41.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.719+0000 7f3b93fff640 1 --2- 172.21.15.1:0/115929704 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557922bc74a0 0x557922be7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.719+0000 7f3b93fff640 1 -- 172.21.15.1:0/115929704 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557922c45f20 con 0x557922bc7dc0 2024-09-19T09:44:41.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.719+0000 7f3b93fff640 1 --2- 172.21.15.1:0/115929704 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557922bc7dc0 0x557922c451b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3b800bc200 tx=0x7f3b800053a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f007e78b6dcdb6e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:41.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.719+0000 7f3b73fff640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-19T09:44:41.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.720+0000 7f3b73fff640 1 -- 172.21.15.1:0/115929704 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b800b4030 con 0x557922bc7dc0 2024-09-19T09:44:41.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.720+0000 7f3b73fff640 1 -- 172.21.15.1:0/115929704 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f3b80007ca0 con 0x557922bc7dc0 2024-09-19T09:44:41.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.720+0000 7f3b9d141740 1 -- 172.21.15.1:0/115929704 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b8009bf90 con 0x557922bc7dc0 2024-09-19T09:44:41.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.725+0000 7f3b73fff640 1 -- 172.21.15.1:0/115929704 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f3b8001d040 con 0x557922bc7dc0 2024-09-19T09:44:41.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.725+0000 7f3b9d141740 10 client.25738 fetch_fsmap learned FSMap version 19 2024-09-19T09:44:41.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.725+0000 7f3b9d141740 1 -- 172.21.15.1:0/115929704 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x557922c46820 con 0x557922bc7dc0 2024-09-19T09:44:41.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.725+0000 7f3b73fff640 1 -- 172.21.15.1:0/115929704 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b8009bf90 con 0x557922bc7dc0 2024-09-19T09:44:41.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.725+0000 7f3b73fff640 1 -- 172.21.15.1:0/115929704 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f3b800babd0 con 0x557922bc7dc0 2024-09-19T09:44:41.727 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.725+0000 7f3b9d141740 10 client.25738 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:44:41.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.725+0000 7f3b9d141740 10 client.25738 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:44:41.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.725+0000 7f3b9d141740 20 client.25738 populate_metadata read hostname 'smithi001' 2024-09-19T09:44:41.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.725+0000 7f3b9d141740 1 --2- 172.21.15.1:0/115929704 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x557922c46f90 0x557922c493b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:41.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.725+0000 7f3b9d141740 4 client.25738 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:44:41.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.725+0000 7f3b9d141740 1 -- 172.21.15.1:0/115929704 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557922b34d60 con 0x557922c46f90 2024-09-19T09:44:41.728 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.726+0000 7f3b98b04640 1 --2- 172.21.15.1:0/115929704 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x557922c46f90 0x557922c493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:41.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.726+0000 7f3b98b04640 1 --2- 172.21.15.1:0/115929704 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x557922c46f90 0x557922c493b0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f5f0d3a753f86b6 server_cookie=1260c462d477c21f in_seq=0 out_seq=0 2024-09-19T09:44:41.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.726+0000 7f3b73fff640 10 client.25738 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:44:41.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.726+0000 7f3b73fff640 1 -- 172.21.15.1:0/115929704 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x557922b34d60 con 0x557922c46f90 2024-09-19T09:44:41.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.726+0000 7f3b73fff640 10 client.25738 handle_command_reply: tid=0 2024-09-19T09:44:41.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.726+0000 7f3b9d141740 1 client.25738 shutdown 2024-09-19T09:44:41.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.727+0000 7f3b9d141740 1 -- 172.21.15.1:0/115929704 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557922bc7dc0 msgr2=0x557922c451b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:41.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.727+0000 7f3b9d141740 1 --2- 172.21.15.1:0/115929704 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557922bc7dc0 0x557922c451b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3b800bc200 tx=0x7f3b800053a0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.729 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.727+0000 7f3b9d141740 1 -- 172.21.15.1:0/115929704 shutdown_connections 2024-09-19T09:44:41.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.727+0000 7f3b9d141740 1 --2- 172.21.15.1:0/115929704 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x557922c46f90 0x557922c493b0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.727+0000 7f3b73fff640 0 client.25738 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:44:41.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.727+0000 7f3b9d141740 1 --2- 172.21.15.1:0/115929704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557922bd2680 0x557922c456f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.727+0000 7f3b9d141740 1 --2- 172.21.15.1:0/115929704 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557922bc7dc0 0x557922c451b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.727+0000 7f3b9d141740 1 --2- 172.21.15.1:0/115929704 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557922bc74a0 0x557922be7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.727+0000 7f3b9d141740 1 -- 172.21.15.1:0/115929704 >> 172.21.15.1:0/115929704 conn(0x557922bc3a30 msgr2=0x557922bc2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:41.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.727+0000 7f3b9d141740 1 -- 172.21.15.1:0/115929704 shutdown_connections 2024-09-19T09:44:41.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.727+0000 7f3b9d141740 1 -- 172.21.15.1:0/115929704 wait complete. 2024-09-19T09:44:41.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.727+0000 7f3b9d141740 20 client.25738 trim_cache size 0 max 16384 2024-09-19T09:44:41.731 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:44:41.731 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "no active scrubs running", 2024-09-19T09:44:41.731 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": {} 2024-09-19T09:44:41.731 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:44:41.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.728+0000 7f3b9ad68640 1 -- 172.21.15.1:0/1378867509 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3b840a3240 msgr2=0x7f3b840a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:41.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.728+0000 7f3b9ad68640 1 --2- 172.21.15.1:0/1378867509 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3b840a3240 0x7f3b840a5700 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c013600 tx=0x7f3b8c004a40 comp rx=0 tx=0).stop 2024-09-19T09:44:41.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.728+0000 7f3b9ad68640 1 -- 172.21.15.1:0/1378867509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b94102570 msgr2=0x7f3b941989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:41.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.728+0000 7f3b9ad68640 1 --2- 172.21.15.1:0/1378867509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b94102570 0x7f3b941989a0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3b8000c890 tx=0x7f3b8000cd50 comp rx=0 tx=0).stop 2024-09-19T09:44:41.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.728+0000 7f3b9ad68640 1 -- 172.21.15.1:0/1378867509 shutdown_connections 2024-09-19T09:44:41.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.728+0000 7f3b9ad68640 1 --2- 172.21.15.1:0/1378867509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b94102ef0 0x7f3b9419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.728+0000 7f3b9ad68640 1 --2- 172.21.15.1:0/1378867509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3b94102570 0x7f3b941989a0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.728+0000 7f3b9ad68640 1 --2- 172.21.15.1:0/1378867509 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3b840a3240 0x7f3b840a5700 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.728+0000 7f3b9ad68640 1 --2- 172.21.15.1:0/1378867509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3b94100e20 0x7f3b94198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:41.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.728+0000 7f3b9ad68640 1 -- 172.21.15.1:0/1378867509 >> 172.21.15.1:0/1378867509 conn(0x7f3b940fc7d0 msgr2=0x7f3b9406a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:41.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.729+0000 7f3b9ad68640 1 -- 172.21.15.1:0/1378867509 shutdown_connections 2024-09-19T09:44:41.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:41.729+0000 7f3b9ad68640 1 -- 172.21.15.1:0/1378867509 wait complete. 2024-09-19T09:44:41.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:41 smithi001 ceph-mon[31225]: pgmap v536: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8.6 MiB/s wr, 1.91k op/s 2024-09-19T09:44:42.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:41 smithi022 ceph-mon[35583]: pgmap v536: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8.6 MiB/s wr, 1.91k op/s 2024-09-19T09:44:42.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:41 smithi121 ceph-mon[35577]: pgmap v536: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 8.6 MiB/s wr, 1.91k op/s 2024-09-19T09:44:42.653 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:44:42.659 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:44:42.660 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:44:43.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.158+0000 7f7640a4f640 1 -- 172.21.15.1:0/829368043 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f763c103660 msgr2=0x7f763c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:43.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.158+0000 7f7640a4f640 1 --2- 172.21.15.1:0/829368043 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f763c103660 0x7f763c10bb50 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7630009900 tx=0x7f763002a480 comp rx=0 tx=0).stop 2024-09-19T09:44:43.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.158+0000 7f7640a4f640 1 -- 172.21.15.1:0/829368043 shutdown_connections 2024-09-19T09:44:43.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.158+0000 7f7640a4f640 1 --2- 172.21.15.1:0/829368043 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f763c10c170 0x7f763c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.158+0000 7f7640a4f640 1 --2- 172.21.15.1:0/829368043 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f763c103660 0x7f763c10bb50 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.158+0000 7f7640a4f640 1 --2- 172.21.15.1:0/829368043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f763c102d40 0x7f763c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.158+0000 7f7640a4f640 1 -- 172.21.15.1:0/829368043 >> 172.21.15.1:0/829368043 conn(0x7f763c0fc7a0 msgr2=0x7f763c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:43.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.158+0000 7f7640a4f640 1 -- 172.21.15.1:0/829368043 shutdown_connections 2024-09-19T09:44:43.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.158+0000 7f7640a4f640 1 -- 172.21.15.1:0/829368043 wait complete. 2024-09-19T09:44:43.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.159+0000 7f7640a4f640 1 Processor -- start 2024-09-19T09:44:43.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.159+0000 7f7640a4f640 1 -- start start 2024-09-19T09:44:43.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.159+0000 7f7640a4f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f763c102d40 0x7f763c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:43.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.159+0000 7f7640a4f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f763c103660 0x7f763c198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:43.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.159+0000 7f7640a4f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f763c10c170 0x7f763c19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:43.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.159+0000 7f7640a4f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f763c111f70 con 0x7f763c102d40 2024-09-19T09:44:43.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.159+0000 7f7640a4f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f763c111df0 con 0x7f763c10c170 2024-09-19T09:44:43.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.159+0000 7f7640a4f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f763c1120f0 con 0x7f763c103660 2024-09-19T09:44:43.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.159+0000 7f763a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f763c102d40 0x7f763c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:43.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.159+0000 7f763a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f763c102d40 0x7f763c198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59290/0 (socket says 172.21.15.1:59290) 2024-09-19T09:44:43.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.159+0000 7f763a59c640 1 -- 172.21.15.1:0/1751589122 learned_addr learned my addr 172.21.15.1:0/1751589122 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:43.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.159+0000 7f763ad9d640 1 --2- 172.21.15.1:0/1751589122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f763c10c170 0x7f763c19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:43.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.159+0000 7f7639d9b640 1 --2- 172.21.15.1:0/1751589122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f763c103660 0x7f763c198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:43.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.160+0000 7f763a59c640 1 -- 172.21.15.1:0/1751589122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f763c103660 msgr2=0x7f763c198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:43.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.160+0000 7f763a59c640 1 --2- 172.21.15.1:0/1751589122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f763c103660 0x7f763c198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.160+0000 7f763a59c640 1 -- 172.21.15.1:0/1751589122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f763c10c170 msgr2=0x7f763c19cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:43.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.160+0000 7f763a59c640 1 --2- 172.21.15.1:0/1751589122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f763c10c170 0x7f763c19cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.160+0000 7f763a59c640 1 -- 172.21.15.1:0/1751589122 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f763c19d3c0 con 0x7f763c102d40 2024-09-19T09:44:43.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.160+0000 7f7639d9b640 1 --2- 172.21.15.1:0/1751589122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f763c103660 0x7f763c198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:44:43.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.160+0000 7f763a59c640 1 --2- 172.21.15.1:0/1751589122 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f763c102d40 0x7f763c198410 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f762c00c920 tx=0x7f762c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:43.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.160+0000 7f762b7fe640 1 -- 172.21.15.1:0/1751589122 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f762c007c70 con 0x7f763c102d40 2024-09-19T09:44:43.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.160+0000 7f762b7fe640 1 -- 172.21.15.1:0/1751589122 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f762c007e10 con 0x7f763c102d40 2024-09-19T09:44:43.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.160+0000 7f7640a4f640 1 -- 172.21.15.1:0/1751589122 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f763c19d6b0 con 0x7f763c102d40 2024-09-19T09:44:43.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.160+0000 7f762b7fe640 1 -- 172.21.15.1:0/1751589122 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f762c018890 con 0x7f763c102d40 2024-09-19T09:44:43.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.160+0000 7f7640a4f640 1 -- 172.21.15.1:0/1751589122 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f763c1a4f90 con 0x7f763c102d40 2024-09-19T09:44:43.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.162+0000 7f762b7fe640 1 -- 172.21.15.1:0/1751589122 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f762c018a70 con 0x7f763c102d40 2024-09-19T09:44:43.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.163+0000 7f7642e28740 1 Processor -- start 2024-09-19T09:44:43.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.163+0000 7f7642e28740 1 -- start start 2024-09-19T09:44:43.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.163+0000 7f7642e28740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361e1a3060 0x56361e1a3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:43.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.163+0000 7f7642e28740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56361e1a3980 0x56361e1add00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:43.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.163+0000 7f762b7fe640 1 --2- 172.21.15.1:0/1751589122 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f76240a32c0 0x7f76240a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:43.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.163+0000 7f7642e28740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56361e1ae240 0x56361e1b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:43.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.163+0000 7f7642e28740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56361e108620 con 0x56361e1a3060 2024-09-19T09:44:43.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.163+0000 7f7642e28740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56361e0afe50 con 0x56361e1ae240 2024-09-19T09:44:43.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.163+0000 7f7642e28740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56361e1045e0 con 0x56361e1a3980 2024-09-19T09:44:43.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.163+0000 7f762b7fe640 1 -- 172.21.15.1:0/1751589122 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f762c0cfa40 con 0x7f763c102d40 2024-09-19T09:44:43.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.164+0000 7f763ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361e1a3060 0x56361e1a3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:43.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.164+0000 7f763ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361e1a3060 0x56361e1a3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59304/0 (socket says 172.21.15.1:59304) 2024-09-19T09:44:43.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.164+0000 7f763ad9d640 1 -- 172.21.15.1:0/410036524 learned_addr learned my addr 172.21.15.1:0/410036524 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:43.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.164+0000 7f763a59c640 1 --2- 172.21.15.1:0/1751589122 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f76240a32c0 0x7f76240a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:43.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.164+0000 7f7639d9b640 1 --2- 172.21.15.1:0/410036524 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56361e1a3980 0x56361e1add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:43.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.164+0000 7f763ad9d640 1 --2- 172.21.15.1:0/410036524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56361e1ae240 0x56361e1b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:43.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.164+0000 7f763ad9d640 1 -- 172.21.15.1:0/410036524 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56361e1a3980 msgr2=0x56361e1add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:43.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.164+0000 7f763ad9d640 1 --2- 172.21.15.1:0/410036524 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56361e1a3980 0x56361e1add00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.164+0000 7f763ad9d640 1 -- 172.21.15.1:0/410036524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56361e1ae240 msgr2=0x56361e1b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:43.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.164+0000 7f763ad9d640 1 --2- 172.21.15.1:0/410036524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56361e1ae240 0x56361e1b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.164+0000 7f763ad9d640 1 -- 172.21.15.1:0/410036524 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56361e0a0d40 con 0x56361e1a3060 2024-09-19T09:44:43.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.164+0000 7f763a59c640 1 --2- 172.21.15.1:0/1751589122 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f76240a32c0 0x7f76240a5780 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f762c09aee0 tx=0x7f762c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:43.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.164+0000 7f763ad9d640 1 --2- 172.21.15.1:0/410036524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361e1a3060 0x56361e1a3440 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x56361e1a0970 tx=0x7f7634009b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94169b53e00745ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:43.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.164+0000 7f7628ff9640 1 -- 172.21.15.1:0/410036524 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763401a030 con 0x56361e1a3060 2024-09-19T09:44:43.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.165+0000 7f7628ff9640 1 -- 172.21.15.1:0/410036524 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76340120d0 con 0x56361e1a3060 2024-09-19T09:44:43.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.165+0000 7f7628ff9640 1 -- 172.21.15.1:0/410036524 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7634012d60 con 0x56361e1a3060 2024-09-19T09:44:43.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.165+0000 7f7642e28740 1 -- 172.21.15.1:0/410036524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361e1a3060 msgr2=0x56361e1a3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:43.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.165+0000 7f7642e28740 1 --2- 172.21.15.1:0/410036524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361e1a3060 0x56361e1a3440 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x56361e1a0970 tx=0x7f7634009b10 comp rx=0 tx=0).stop 2024-09-19T09:44:43.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.165+0000 7f7642e28740 1 -- 172.21.15.1:0/410036524 shutdown_connections 2024-09-19T09:44:43.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.165+0000 7f7642e28740 1 --2- 172.21.15.1:0/410036524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56361e1ae240 0x56361e1b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.165+0000 7f7642e28740 1 --2- 172.21.15.1:0/410036524 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56361e1a3980 0x56361e1add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.165+0000 7f7642e28740 1 --2- 172.21.15.1:0/410036524 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361e1a3060 0x56361e1a3440 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.165+0000 7f7642e28740 1 -- 172.21.15.1:0/410036524 >> 172.21.15.1:0/410036524 conn(0x56361e19f5f0 msgr2=0x56361e19f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:43.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.166+0000 7f7642e28740 1 -- 172.21.15.1:0/410036524 shutdown_connections 2024-09-19T09:44:43.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.166+0000 7f7642e28740 1 -- 172.21.15.1:0/410036524 wait complete. 2024-09-19T09:44:43.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.166+0000 7f7642e28740 1 -- start start 2024-09-19T09:44:43.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.166+0000 7f7642e28740 1 Processor -- start 2024-09-19T09:44:43.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.166+0000 7f7642e28740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56361e1a3060 0x56361e1ab0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:43.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.166+0000 7f7642e28740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361e1a3980 0x56361e1ab610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:43.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.166+0000 7f7642e28740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56361e1ae240 0x56361e1abb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:43.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.166+0000 7f7642e28740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x56361e1b0e10 con 0x56361e1a3980 2024-09-19T09:44:43.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.166+0000 7f7642e28740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56361e090f10 con 0x56361e1a3060 2024-09-19T09:44:43.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.166+0000 7f7642e28740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56361e1b0f90 con 0x56361e1ae240 2024-09-19T09:44:43.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.166+0000 7f7642e28740 10 client.0 _ll_register_callbacks cb 0x56361e0b4db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:44:43.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.167+0000 7f7639d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361e1a3980 0x56361e1ab610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:43.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.167+0000 7f7639d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361e1a3980 0x56361e1ab610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59314/0 (socket says 172.21.15.1:59314) 2024-09-19T09:44:43.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.167+0000 7f7639d9b640 1 -- 172.21.15.1:0/633764404 learned_addr learned my addr 172.21.15.1:0/633764404 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:43.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.167+0000 7f763ad9d640 1 --2- 172.21.15.1:0/633764404 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56361e1a3060 0x56361e1ab0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:43.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.167+0000 7f763ad9d640 1 --2- 172.21.15.1:0/633764404 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56361e1ae240 0x56361e1abb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:43.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.167+0000 7f7639d9b640 1 -- 172.21.15.1:0/633764404 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56361e1ae240 msgr2=0x56361e1abb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:43.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.167+0000 7f7639d9b640 1 --2- 172.21.15.1:0/633764404 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56361e1ae240 0x56361e1abb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.167+0000 7f7639d9b640 1 -- 172.21.15.1:0/633764404 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56361e1a3060 msgr2=0x56361e1ab0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:43.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.167+0000 7f7639d9b640 1 --2- 172.21.15.1:0/633764404 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56361e1a3060 0x56361e1ab0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.167+0000 7f7639d9b640 1 -- 172.21.15.1:0/633764404 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56361de17580 con 0x56361e1a3980 2024-09-19T09:44:43.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.167+0000 7f763ad9d640 1 --2- 172.21.15.1:0/633764404 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56361e1ae240 0x56361e1abb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:44:43.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.167+0000 7f7639d9b640 1 --2- 172.21.15.1:0/633764404 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361e1a3980 0x56361e1ab610 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f7630009900 tx=0x7f7630031920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d94fe7fab6912a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:43.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.167+0000 7f7621ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:44:43.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.167+0000 7f7621ffb640 1 -- 172.21.15.1:0/633764404 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7630035040 con 0x56361e1a3980 2024-09-19T09:44:43.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.168+0000 7f7621ffb640 1 -- 172.21.15.1:0/633764404 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f7630004240 con 0x56361e1a3980 2024-09-19T09:44:43.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.168+0000 7f7642e28740 1 -- 172.21.15.1:0/633764404 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76340120d0 con 0x56361e1a3980 2024-09-19T09:44:43.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.168+0000 7f7621ffb640 1 -- 172.21.15.1:0/633764404 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7630004440 con 0x56361e1a3980 2024-09-19T09:44:43.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.168+0000 7f7642e28740 10 client.16260 fetch_fsmap learned FSMap version 19 2024-09-19T09:44:43.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.168+0000 7f7642e28740 1 -- 172.21.15.1:0/633764404 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56361dee1960 con 0x56361e1a3980 2024-09-19T09:44:43.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.168+0000 7f7621ffb640 1 -- 172.21.15.1:0/633764404 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76340120d0 con 0x56361e1a3980 2024-09-19T09:44:43.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.168+0000 7f7621ffb640 1 -- 172.21.15.1:0/633764404 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f7630004bc0 con 0x56361e1a3980 2024-09-19T09:44:43.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.168+0000 7f7642e28740 10 client.16260 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:44:43.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.168+0000 7f7642e28740 10 client.16260 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:44:43.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.168+0000 7f7642e28740 20 client.16260 populate_metadata read hostname 'smithi001' 2024-09-19T09:44:43.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.168+0000 7f7642e28740 1 --2- 172.21.15.1:0/633764404 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56361e1bdd40 0x56361e1c0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:43.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.169+0000 7f7642e28740 4 client.16260 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:44:43.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.169+0000 7f7642e28740 1 -- 172.21.15.1:0/633764404 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56361e115b90 con 0x56361e1bdd40 2024-09-19T09:44:43.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.169+0000 7f763ad9d640 1 --2- 172.21.15.1:0/633764404 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56361e1bdd40 0x56361e1c0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:43.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.169+0000 7f7621ffb640 10 client.16260 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:44:43.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.169+0000 7f763ad9d640 1 --2- 172.21.15.1:0/633764404 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56361e1bdd40 0x56361e1c0150 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=886bbf801226327a server_cookie=98fcc4c791c560a3 in_seq=0 out_seq=0 2024-09-19T09:44:43.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.170+0000 7f7621ffb640 1 -- 172.21.15.1:0/633764404 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56361e115b90 con 0x56361e1bdd40 2024-09-19T09:44:43.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.170+0000 7f7621ffb640 10 client.16260 handle_command_reply: tid=0 2024-09-19T09:44:43.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.170+0000 7f7642e28740 1 client.16260 shutdown 2024-09-19T09:44:43.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.170+0000 7f7642e28740 1 -- 172.21.15.1:0/633764404 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361e1a3980 msgr2=0x56361e1ab610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:43.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.170+0000 7f7642e28740 1 --2- 172.21.15.1:0/633764404 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361e1a3980 0x56361e1ab610 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f7630009900 tx=0x7f7630031920 comp rx=0 tx=0).stop 2024-09-19T09:44:43.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.170+0000 7f7642e28740 1 -- 172.21.15.1:0/633764404 shutdown_connections 2024-09-19T09:44:43.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.170+0000 7f7642e28740 1 --2- 172.21.15.1:0/633764404 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56361e1bdd40 0x56361e1c0150 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.170+0000 7f7642e28740 1 --2- 172.21.15.1:0/633764404 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56361e1ae240 0x56361e1abb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.170+0000 7f7642e28740 1 --2- 172.21.15.1:0/633764404 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361e1a3980 0x56361e1ab610 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.170+0000 7f7642e28740 1 --2- 172.21.15.1:0/633764404 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56361e1a3060 0x56361e1ab0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.170+0000 7f7642e28740 1 -- 172.21.15.1:0/633764404 >> 172.21.15.1:0/633764404 conn(0x56361e19f5f0 msgr2=0x56361e1a52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:43.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.171+0000 7f7621ffb640 0 client.16260 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:44:43.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.171+0000 7f7642e28740 1 -- 172.21.15.1:0/633764404 shutdown_connections 2024-09-19T09:44:43.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.171+0000 7f7642e28740 1 -- 172.21.15.1:0/633764404 wait complete. 2024-09-19T09:44:43.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.171+0000 7f7642e28740 20 client.16260 trim_cache size 0 max 16384 2024-09-19T09:44:43.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.189+0000 7f7642e28740 1 Processor -- start 2024-09-19T09:44:43.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.189+0000 7f7642e28740 1 -- start start 2024-09-19T09:44:43.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.189+0000 7f7642e28740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361e1a3060 0x56361e1ad040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:43.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.189+0000 7f7642e28740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56361e1a3980 0x56361e1c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:43.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.189+0000 7f7642e28740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56361e1ae240 0x56361e1c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:43.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.189+0000 7f7642e28740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f763c1ab570 con 0x56361e1a3060 2024-09-19T09:44:43.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.189+0000 7f7642e28740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f763c1ade10 con 0x56361e1ae240 2024-09-19T09:44:43.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.189+0000 7f7642e28740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f763c1abc00 con 0x56361e1a3980 2024-09-19T09:44:43.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.190+0000 7f763ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361e1a3060 0x56361e1ad040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:43.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.190+0000 7f763ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361e1a3060 0x56361e1ad040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59326/0 (socket says 172.21.15.1:59326) 2024-09-19T09:44:43.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.190+0000 7f763ad9d640 1 -- 172.21.15.1:0/743208393 learned_addr learned my addr 172.21.15.1:0/743208393 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:43.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.190+0000 7f763ad9d640 1 --2- 172.21.15.1:0/743208393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56361e1ae240 0x56361e1c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:43.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.190+0000 7f763ad9d640 1 -- 172.21.15.1:0/743208393 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56361e1a3980 msgr2=0x56361e1c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:43.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.190+0000 7f763ad9d640 1 --2- 172.21.15.1:0/743208393 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56361e1a3980 0x56361e1c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.190+0000 7f763ad9d640 1 -- 172.21.15.1:0/743208393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56361e1ae240 msgr2=0x56361e1c5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:43.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.190+0000 7f763ad9d640 1 --2- 172.21.15.1:0/743208393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56361e1ae240 0x56361e1c5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.190+0000 7f763ad9d640 1 -- 172.21.15.1:0/743208393 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56361e1aa080 con 0x56361e1a3060 2024-09-19T09:44:43.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.190+0000 7f763ad9d640 1 --2- 172.21.15.1:0/743208393 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361e1a3060 0x56361e1ad040 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f7634012a10 tx=0x7f7634016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47a7a33afefdb027 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:43.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.190+0000 7f7623fff640 1 -- 172.21.15.1:0/743208393 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76340120d0 con 0x56361e1a3060 2024-09-19T09:44:43.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.190+0000 7f7623fff640 1 -- 172.21.15.1:0/743208393 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7634004a00 con 0x56361e1a3060 2024-09-19T09:44:43.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.190+0000 7f7623fff640 1 -- 172.21.15.1:0/743208393 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76340056b0 con 0x56361e1a3060 2024-09-19T09:44:43.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.191+0000 7f7642e28740 1 -- 172.21.15.1:0/743208393 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361e1a3060 msgr2=0x56361e1ad040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:43.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.191+0000 7f7642e28740 1 --2- 172.21.15.1:0/743208393 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361e1a3060 0x56361e1ad040 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f7634012a10 tx=0x7f7634016040 comp rx=0 tx=0).stop 2024-09-19T09:44:43.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.191+0000 7f7642e28740 1 -- 172.21.15.1:0/743208393 shutdown_connections 2024-09-19T09:44:43.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.191+0000 7f7642e28740 1 --2- 172.21.15.1:0/743208393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56361e1ae240 0x56361e1c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.191+0000 7f7642e28740 1 --2- 172.21.15.1:0/743208393 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56361e1a3980 0x56361e1c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.191+0000 7f7642e28740 1 --2- 172.21.15.1:0/743208393 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361e1a3060 0x56361e1ad040 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.191+0000 7f7642e28740 1 -- 172.21.15.1:0/743208393 >> 172.21.15.1:0/743208393 conn(0x56361e19f5f0 msgr2=0x56361e1ac930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:43.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.191+0000 7f7642e28740 1 -- 172.21.15.1:0/743208393 shutdown_connections 2024-09-19T09:44:43.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.191+0000 7f7642e28740 1 -- 172.21.15.1:0/743208393 wait complete. 2024-09-19T09:44:43.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.192+0000 7f7642e28740 1 -- start start 2024-09-19T09:44:43.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.192+0000 7f7642e28740 1 Processor -- start 2024-09-19T09:44:43.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.192+0000 7f7642e28740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56361e1a3060 0x56361e1b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:43.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.192+0000 7f7642e28740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361e1a3980 0x56361e1b6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:43.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.192+0000 7f7642e28740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56361e1ae240 0x56361e1b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:43.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.192+0000 7f7642e28740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f763c1ac2d0 con 0x56361e1a3980 2024-09-19T09:44:43.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.192+0000 7f7642e28740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f763c1ad740 con 0x56361e1a3060 2024-09-19T09:44:43.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.192+0000 7f7642e28740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f763c1ac9a0 con 0x56361e1ae240 2024-09-19T09:44:43.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.193+0000 7f7639d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361e1a3980 0x56361e1b6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:43.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.193+0000 7f763ad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56361e1a3060 0x56361e1b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:43.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.193+0000 7f7639d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361e1a3980 0x56361e1b6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59340/0 (socket says 172.21.15.1:59340) 2024-09-19T09:44:43.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.193+0000 7f7639d9b640 1 -- 172.21.15.1:0/3220598743 learned_addr learned my addr 172.21.15.1:0/3220598743 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:43.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.193+0000 7f7642e28740 10 client.0 _ll_register_callbacks cb 0x7f76300315b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:44:43.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.193+0000 7f763ad9d640 1 --2- 172.21.15.1:0/3220598743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56361e1ae240 0x56361e1b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:43.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.193+0000 7f763ad9d640 1 -- 172.21.15.1:0/3220598743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56361e1ae240 msgr2=0x56361e1b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:43.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.193+0000 7f763ad9d640 1 --2- 172.21.15.1:0/3220598743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56361e1ae240 0x56361e1b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.193+0000 7f763ad9d640 1 -- 172.21.15.1:0/3220598743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361e1a3980 msgr2=0x56361e1b6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:43.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.193+0000 7f763ad9d640 1 --2- 172.21.15.1:0/3220598743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361e1a3980 0x56361e1b6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.193+0000 7f763ad9d640 1 -- 172.21.15.1:0/3220598743 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56361e1b36f0 con 0x56361e1a3060 2024-09-19T09:44:43.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.193+0000 7f763ad9d640 1 --2- 172.21.15.1:0/3220598743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56361e1a3060 0x56361e1b61e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7634005cc0 tx=0x7f7634022040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3db7cb96e44fe15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.193+0000 7f7621ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:44:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.194+0000 7f7621ffb640 1 -- 172.21.15.1:0/3220598743 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7634012c40 con 0x56361e1a3060 2024-09-19T09:44:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.194+0000 7f7642e28740 1 -- 172.21.15.1:0/3220598743 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7634004a00 con 0x56361e1a3060 2024-09-19T09:44:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.194+0000 7f7621ffb640 1 -- 172.21.15.1:0/3220598743 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f7634012de0 con 0x56361e1a3060 2024-09-19T09:44:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.194+0000 7f7621ffb640 1 -- 172.21.15.1:0/3220598743 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7634003970 con 0x56361e1a3060 2024-09-19T09:44:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.194+0000 7f7642e28740 10 client.25934 fetch_fsmap learned FSMap version 19 2024-09-19T09:44:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.194+0000 7f7642e28740 1 -- 172.21.15.1:0/3220598743 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x56361e229090 con 0x56361e1a3060 2024-09-19T09:44:43.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.194+0000 7f7621ffb640 1 -- 172.21.15.1:0/3220598743 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7634004a00 con 0x56361e1a3060 2024-09-19T09:44:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.194+0000 7f7621ffb640 1 -- 172.21.15.1:0/3220598743 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7f763403c070 con 0x56361e1a3060 2024-09-19T09:44:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.194+0000 7f7642e28740 10 client.25934 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:44:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.194+0000 7f7642e28740 10 client.25934 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:44:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.194+0000 7f7642e28740 20 client.25934 populate_metadata read hostname 'smithi001' 2024-09-19T09:44:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.194+0000 7f7642e28740 1 --2- 172.21.15.1:0/3220598743 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56361e229520 0x56361e22b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.194+0000 7f7642e28740 4 client.25934 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "978f3b4d", "release": true, "await": true}] 2024-09-19T09:44:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.194+0000 7f7642e28740 1 -- 172.21.15.1:0/3220598743 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "quiesce db", "set_id": "978f3b4d", "release": true, "await": true}) -- 0x56361e1100a0 con 0x56361e229520 2024-09-19T09:44:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.195+0000 7f7639d9b640 1 --2- 172.21.15.1:0/3220598743 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56361e229520 0x56361e22b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.195+0000 7f7639d9b640 1 --2- 172.21.15.1:0/3220598743 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56361e229520 0x56361e22b940 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36e8eb968fe2d8a0 server_cookie=43314fa228023659 in_seq=0 out_seq=0 2024-09-19T09:44:43.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.195+0000 7f7621ffb640 10 client.25934 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:44:43.207 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:44:43.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.216+0000 7f7621ffb640 1 -- 172.21.15.1:0/3220598743 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56361e1100a0 con 0x56361e229520 2024-09-19T09:44:43.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.216+0000 7f7621ffb640 10 client.25934 handle_command_reply: tid=0 2024-09-19T09:44:43.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.216+0000 7f7642e28740 1 client.25934 shutdown 2024-09-19T09:44:43.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.221+0000 7f7642e28740 1 -- 172.21.15.1:0/3220598743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56361e1a3060 msgr2=0x56361e1b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:43.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.221+0000 7f7642e28740 1 --2- 172.21.15.1:0/3220598743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56361e1a3060 0x56361e1b61e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7634005cc0 tx=0x7f7634022040 comp rx=0 tx=0).stop 2024-09-19T09:44:43.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.222+0000 7f7642e28740 1 -- 172.21.15.1:0/3220598743 shutdown_connections 2024-09-19T09:44:43.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.222+0000 7f7642e28740 1 --2- 172.21.15.1:0/3220598743 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x56361e229520 0x56361e22b940 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.222+0000 7f7642e28740 1 --2- 172.21.15.1:0/3220598743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56361e1ae240 0x56361e1b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.222+0000 7f7642e28740 1 --2- 172.21.15.1:0/3220598743 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x56361e1a3980 0x56361e1b6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.222+0000 7f7642e28740 1 --2- 172.21.15.1:0/3220598743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56361e1a3060 0x56361e1b61e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.222+0000 7f7621ffb640 0 client.25934 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:44:43.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.222+0000 7f7642e28740 1 -- 172.21.15.1:0/3220598743 >> 172.21.15.1:0/3220598743 conn(0x56361e19f5f0 msgr2=0x56361e19e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:43.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.224+0000 7f7642e28740 1 -- 172.21.15.1:0/3220598743 shutdown_connections 2024-09-19T09:44:43.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.224+0000 7f7642e28740 1 -- 172.21.15.1:0/3220598743 wait complete. 2024-09-19T09:44:43.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.224+0000 7f7642e28740 20 client.25934 trim_cache size 0 max 16384 2024-09-19T09:44:43.232 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:44:43.232 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 19, 2024-09-19T09:44:43.232 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24497, 2024-09-19T09:44:43.233 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 20, 2024-09-19T09:44:43.233 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T09:44:43.233 INFO:teuthology.orchestra.run.smithi001.stdout: "978f3b4d": { 2024-09-19T09:44:43.233 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 20, 2024-09-19T09:44:43.233 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T09:44:43.233 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:44:43.233 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T09:44:43.233 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:44:43.233 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:44:43.233 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T09:44:43.233 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 149.8, 2024-09-19T09:44:43.234 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T09:44:43.234 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T09:44:43.234 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T09:44:43.234 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:44:43.234 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T09:44:43.234 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:44:43.234 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:44:43.234 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:44:43.234 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:44:43.234 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:44:43.234 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:44:43.234 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:44:43.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.232+0000 7f7640a4f640 1 -- 172.21.15.1:0/1751589122 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f76240a32c0 msgr2=0x7f76240a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:43.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.232+0000 7f7640a4f640 1 --2- 172.21.15.1:0/1751589122 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f76240a32c0 0x7f76240a5780 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f762c09aee0 tx=0x7f762c000bc0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.232+0000 7f7640a4f640 1 -- 172.21.15.1:0/1751589122 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f763c102d40 msgr2=0x7f763c198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:43.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.232+0000 7f7640a4f640 1 --2- 172.21.15.1:0/1751589122 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f763c102d40 0x7f763c198410 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f762c00c920 tx=0x7f762c00cde0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.232+0000 7f7640a4f640 1 -- 172.21.15.1:0/1751589122 shutdown_connections 2024-09-19T09:44:43.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.232+0000 7f7640a4f640 1 --2- 172.21.15.1:0/1751589122 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f76240a32c0 0x7f76240a5780 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.232+0000 7f7640a4f640 1 --2- 172.21.15.1:0/1751589122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f763c10c170 0x7f763c19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.232+0000 7f7640a4f640 1 --2- 172.21.15.1:0/1751589122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f763c103660 0x7f763c198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.232+0000 7f7640a4f640 1 --2- 172.21.15.1:0/1751589122 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f763c102d40 0x7f763c198410 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:43.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.232+0000 7f7640a4f640 1 -- 172.21.15.1:0/1751589122 >> 172.21.15.1:0/1751589122 conn(0x7f763c0fc7a0 msgr2=0x7f763c0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:43.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.237+0000 7f7640a4f640 1 -- 172.21.15.1:0/1751589122 shutdown_connections 2024-09-19T09:44:43.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:43.238+0000 7f7640a4f640 1 -- 172.21.15.1:0/1751589122 wait complete. 2024-09-19T09:44:43.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:43 smithi001 ceph-mon[31225]: pgmap v537: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 9.0 MiB/s wr, 2.01k op/s 2024-09-19T09:44:44.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:43 smithi022 ceph-mon[35583]: pgmap v537: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 9.0 MiB/s wr, 2.01k op/s 2024-09-19T09:44:44.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:43 smithi121 ceph-mon[35577]: pgmap v537: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 9.0 MiB/s wr, 2.01k op/s 2024-09-19T09:44:45.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:45 smithi001 ceph-mon[31225]: pgmap v538: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.8 MiB/s wr, 1.56k op/s 2024-09-19T09:44:46.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:45 smithi022 ceph-mon[35583]: pgmap v538: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.8 MiB/s wr, 1.56k op/s 2024-09-19T09:44:46.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:45 smithi121 ceph-mon[35577]: pgmap v538: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 6.8 MiB/s wr, 1.56k op/s 2024-09-19T09:44:47.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.970+0000 7fac55e5e640 1 -- 172.21.15.1:0/2123885402 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac50101c60 msgr2=0x7fac501020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:47.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.970+0000 7fac55e5e640 1 --2- 172.21.15.1:0/2123885402 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac50101c60 0x7fac501020e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fac44009900 tx=0x7fac4402a410 comp rx=0 tx=0).stop 2024-09-19T09:44:47.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.970+0000 7fac55e5e640 1 -- 172.21.15.1:0/2123885402 shutdown_connections 2024-09-19T09:44:47.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.970+0000 7fac55e5e640 1 --2- 172.21.15.1:0/2123885402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac50102620 0x7fac50108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:47.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.970+0000 7fac55e5e640 1 --2- 172.21.15.1:0/2123885402 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac50101c60 0x7fac501020e0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:47.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.970+0000 7fac55e5e640 1 --2- 172.21.15.1:0/2123885402 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac50100a70 0x7fac50100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:47.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.970+0000 7fac55e5e640 1 -- 172.21.15.1:0/2123885402 >> 172.21.15.1:0/2123885402 conn(0x7fac500fc1f0 msgr2=0x7fac500fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:47.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.970+0000 7fac55e5e640 1 -- 172.21.15.1:0/2123885402 shutdown_connections 2024-09-19T09:44:47.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.970+0000 7fac55e5e640 1 -- 172.21.15.1:0/2123885402 wait complete. 2024-09-19T09:44:47.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.970+0000 7fac55e5e640 1 Processor -- start 2024-09-19T09:44:47.973 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.971+0000 7fac55e5e640 1 -- start start 2024-09-19T09:44:47.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.971+0000 7fac55e5e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac50100a70 0x7fac5010b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:47.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.971+0000 7fac55e5e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac50101c60 0x7fac50109a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:47.975 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.971+0000 7fac55e5e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac50102620 0x7fac50109f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:47.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.971+0000 7fac55e5e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fac5010d8a0 con 0x7fac50101c60 2024-09-19T09:44:47.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.971+0000 7fac55e5e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fac5010d720 con 0x7fac50100a70 2024-09-19T09:44:47.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.971+0000 7fac55e5e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fac5010da20 con 0x7fac50102620 2024-09-19T09:44:47.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.971+0000 7fac4effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac50101c60 0x7fac50109a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:47.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.971+0000 7fac4f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac50100a70 0x7fac5010b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:47.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.971+0000 7fac4f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac50100a70 0x7fac5010b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:48956/0 (socket says 172.21.15.1:48956) 2024-09-19T09:44:47.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.971+0000 7fac4effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac50101c60 0x7fac50109a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48932/0 (socket says 172.21.15.1:48932) 2024-09-19T09:44:47.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.971+0000 7fac4f7fe640 1 -- 172.21.15.1:0/2516591258 learned_addr learned my addr 172.21.15.1:0/2516591258 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:47.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.971+0000 7fac4ffff640 1 --2- 172.21.15.1:0/2516591258 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac50102620 0x7fac50109f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:47.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.971+0000 7fac4f7fe640 1 -- 172.21.15.1:0/2516591258 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac50102620 msgr2=0x7fac50109f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:47.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.971+0000 7fac4f7fe640 1 --2- 172.21.15.1:0/2516591258 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac50102620 0x7fac50109f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:47.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.971+0000 7fac4f7fe640 1 -- 172.21.15.1:0/2516591258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac50101c60 msgr2=0x7fac50109a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:47.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.971+0000 7fac4f7fe640 1 --2- 172.21.15.1:0/2516591258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac50101c60 0x7fac50109a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:47.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.971+0000 7fac4f7fe640 1 -- 172.21.15.1:0/2516591258 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5010a800 con 0x7fac50100a70 2024-09-19T09:44:47.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.971+0000 7fac4ffff640 1 --2- 172.21.15.1:0/2516591258 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac50102620 0x7fac50109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:44:47.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.971+0000 7fac4effd640 1 --2- 172.21.15.1:0/2516591258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac50101c60 0x7fac50109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:44:47.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.971+0000 7fac4f7fe640 1 --2- 172.21.15.1:0/2516591258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac50100a70 0x7fac5010b3f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fac4000e9c0 tx=0x7fac4000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:47.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.972+0000 7fac4cff9640 1 -- 172.21.15.1:0/2516591258 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4000cd80 con 0x7fac50100a70 2024-09-19T09:44:47.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.972+0000 7fac4cff9640 1 -- 172.21.15.1:0/2516591258 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac400035f0 con 0x7fac50100a70 2024-09-19T09:44:47.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.972+0000 7fac55e5e640 1 -- 172.21.15.1:0/2516591258 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac501a1fb0 con 0x7fac50100a70 2024-09-19T09:44:47.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.972+0000 7fac4cff9640 1 -- 172.21.15.1:0/2516591258 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac40010690 con 0x7fac50100a70 2024-09-19T09:44:47.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.972+0000 7fac55e5e640 1 -- 172.21.15.1:0/2516591258 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac501a2410 con 0x7fac50100a70 2024-09-19T09:44:47.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.975+0000 7fac58bf6740 1 Processor -- start 2024-09-19T09:44:47.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.975+0000 7fac58bf6740 1 -- start start 2024-09-19T09:44:47.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.975+0000 7fac4cff9640 1 -- 172.21.15.1:0/2516591258 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fac400037a0 con 0x7fac50100a70 2024-09-19T09:44:47.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.975+0000 7fac58bf6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdd6b969a0 0x55fdd6b96da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:47.984 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.975+0000 7fac58bf6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdd6b972e0 0x55fdd6b9bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:47.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.975+0000 7fac58bf6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdd6b9c370 0x55fdd6b9e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:47.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.975+0000 7fac58bf6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fdd6afa2f0 con 0x55fdd6b9c370 2024-09-19T09:44:47.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.975+0000 7fac58bf6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55fdd6aa2270 con 0x55fdd6b972e0 2024-09-19T09:44:47.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.975+0000 7fac58bf6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55fdd6af62b0 con 0x55fdd6b969a0 2024-09-19T09:44:47.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.975+0000 7fac4effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdd6b9c370 0x55fdd6b9e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:47.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.975+0000 7fac4effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdd6b9c370 0x55fdd6b9e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48942/0 (socket says 172.21.15.1:48942) 2024-09-19T09:44:47.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.975+0000 7fac4effd640 1 -- 172.21.15.1:0/3639987974 learned_addr learned my addr 172.21.15.1:0/3639987974 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:47.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.975+0000 7fac4f7fe640 1 --2- 172.21.15.1:0/3639987974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdd6b972e0 0x55fdd6b9bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:47.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.975+0000 7fac4ffff640 1 --2- 172.21.15.1:0/3639987974 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdd6b969a0 0x55fdd6b96da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:47.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.975+0000 7fac4effd640 1 -- 172.21.15.1:0/3639987974 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdd6b969a0 msgr2=0x55fdd6b96da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:47.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.975+0000 7fac4effd640 1 --2- 172.21.15.1:0/3639987974 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdd6b969a0 0x55fdd6b96da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:47.985 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.975+0000 7fac4effd640 1 -- 172.21.15.1:0/3639987974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdd6b972e0 msgr2=0x55fdd6b9bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.975+0000 7fac4effd640 1 --2- 172.21.15.1:0/3639987974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdd6b972e0 0x55fdd6b9bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.975+0000 7fac4effd640 1 -- 172.21.15.1:0/3639987974 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdd6aa1340 con 0x55fdd6b9c370 2024-09-19T09:44:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.976+0000 7fac4effd640 1 --2- 172.21.15.1:0/3639987974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdd6b9c370 0x55fdd6b9e830 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fac44006010 tx=0x7fac44005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92fbb0b8c83222ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.976+0000 7fac4cff9640 1 --2- 172.21.15.1:0/2516591258 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fac380a32c0 0x7fac380a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.976+0000 7fac35ffb640 1 -- 172.21.15.1:0/3639987974 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac44035040 con 0x55fdd6b9c370 2024-09-19T09:44:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.976+0000 7fac35ffb640 1 -- 172.21.15.1:0/3639987974 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac44004750 con 0x55fdd6b9c370 2024-09-19T09:44:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.976+0000 7fac35ffb640 1 -- 172.21.15.1:0/3639987974 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac44031a30 con 0x55fdd6b9c370 2024-09-19T09:44:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.976+0000 7fac4ffff640 1 --2- 172.21.15.1:0/2516591258 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fac380a32c0 0x7fac380a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.976+0000 7fac4cff9640 1 -- 172.21.15.1:0/2516591258 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fac400cfc20 con 0x7fac50100a70 2024-09-19T09:44:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.977+0000 7fac4ffff640 1 --2- 172.21.15.1:0/2516591258 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fac380a32c0 0x7fac380a5780 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fac48009fd0 tx=0x7fac48009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.977+0000 7fac58bf6740 1 -- 172.21.15.1:0/3639987974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdd6b9c370 msgr2=0x55fdd6b9e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.977+0000 7fac58bf6740 1 --2- 172.21.15.1:0/3639987974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdd6b9c370 0x55fdd6b9e830 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fac44006010 tx=0x7fac44005e60 comp rx=0 tx=0).stop 2024-09-19T09:44:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.977+0000 7fac58bf6740 1 -- 172.21.15.1:0/3639987974 shutdown_connections 2024-09-19T09:44:47.986 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.977+0000 7fac58bf6740 1 --2- 172.21.15.1:0/3639987974 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdd6b9c370 0x55fdd6b9e830 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.977+0000 7fac58bf6740 1 --2- 172.21.15.1:0/3639987974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdd6b972e0 0x55fdd6b9bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.977+0000 7fac58bf6740 1 --2- 172.21.15.1:0/3639987974 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdd6b969a0 0x55fdd6b96da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.977+0000 7fac58bf6740 1 -- 172.21.15.1:0/3639987974 >> 172.21.15.1:0/3639987974 conn(0x55fdd6b92010 msgr2=0x55fdd6b92410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.977+0000 7fac58bf6740 1 -- 172.21.15.1:0/3639987974 shutdown_connections 2024-09-19T09:44:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.977+0000 7fac58bf6740 1 -- 172.21.15.1:0/3639987974 wait complete. 2024-09-19T09:44:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.977+0000 7fac58bf6740 1 -- start start 2024-09-19T09:44:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.977+0000 7fac58bf6740 1 Processor -- start 2024-09-19T09:44:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.977+0000 7fac58bf6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdd6b969a0 0x55fdd6ba0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.977+0000 7fac58bf6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdd6b972e0 0x55fdd6ba1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.977+0000 7fac58bf6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdd6b9c370 0x55fdd6ba80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:47.987 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.977+0000 7fac58bf6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55fdd6b9f2e0 con 0x55fdd6b9c370 2024-09-19T09:44:47.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.977+0000 7fac58bf6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55fdd6a83290 con 0x55fdd6b969a0 2024-09-19T09:44:47.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.977+0000 7fac58bf6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55fdd6b9f460 con 0x55fdd6b972e0 2024-09-19T09:44:47.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.978+0000 7fac58bf6740 10 client.0 _ll_register_callbacks cb 0x55fdd6ab4140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:44:47.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.978+0000 7fac4ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdd6b9c370 0x55fdd6ba80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:47.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.978+0000 7fac4ffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdd6b9c370 0x55fdd6ba80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48958/0 (socket says 172.21.15.1:48958) 2024-09-19T09:44:47.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.978+0000 7fac4f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdd6b969a0 0x55fdd6ba0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:47.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.978+0000 7fac4ffff640 1 -- 172.21.15.1:0/1746016664 learned_addr learned my addr 172.21.15.1:0/1746016664 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:47.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.978+0000 7fac4effd640 1 --2- 172.21.15.1:0/1746016664 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdd6b972e0 0x55fdd6ba1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:47.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.978+0000 7fac4ffff640 1 -- 172.21.15.1:0/1746016664 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdd6b972e0 msgr2=0x55fdd6ba1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:47.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.978+0000 7fac4ffff640 1 --2- 172.21.15.1:0/1746016664 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdd6b972e0 0x55fdd6ba1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:47.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.978+0000 7fac4ffff640 1 -- 172.21.15.1:0/1746016664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdd6b969a0 msgr2=0x55fdd6ba0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:47.988 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.978+0000 7fac4ffff640 1 --2- 172.21.15.1:0/1746016664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdd6b969a0 0x55fdd6ba0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.978+0000 7fac4ffff640 1 -- 172.21.15.1:0/1746016664 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdd680d210 con 0x55fdd6b9c370 2024-09-19T09:44:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.978+0000 7fac4f7fe640 1 --2- 172.21.15.1:0/1746016664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdd6b969a0 0x55fdd6ba0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:44:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.978+0000 7fac4effd640 1 --2- 172.21.15.1:0/1746016664 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdd6b972e0 0x55fdd6ba1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:44:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.978+0000 7fac4ffff640 1 --2- 172.21.15.1:0/1746016664 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdd6b9c370 0x55fdd6ba80b0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fac48003e20 tx=0x7fac48004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1847e94751295fba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.978+0000 7fac2effd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:44:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.978+0000 7fac2effd640 1 -- 172.21.15.1:0/1746016664 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac48004550 con 0x55fdd6b9c370 2024-09-19T09:44:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.978+0000 7fac2effd640 1 -- 172.21.15.1:0/1746016664 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fac48018030 con 0x55fdd6b9c370 2024-09-19T09:44:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.978+0000 7fac58bf6740 1 -- 172.21.15.1:0/1746016664 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac44004750 con 0x55fdd6b9c370 2024-09-19T09:44:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.978+0000 7fac2effd640 1 -- 172.21.15.1:0/1746016664 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fac480046f0 con 0x55fdd6b9c370 2024-09-19T09:44:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.978+0000 7fac58bf6740 10 client.16278 fetch_fsmap learned FSMap version 19 2024-09-19T09:44:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.979+0000 7fac58bf6740 1 -- 172.21.15.1:0/1746016664 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55fdd68d9620 con 0x55fdd6b9c370 2024-09-19T09:44:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.979+0000 7fac2effd640 1 -- 172.21.15.1:0/1746016664 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac44004750 con 0x55fdd6b9c370 2024-09-19T09:44:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.979+0000 7fac2effd640 1 -- 172.21.15.1:0/1746016664 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fac48028420 con 0x55fdd6b9c370 2024-09-19T09:44:47.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.979+0000 7fac58bf6740 10 client.16278 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:44:47.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.979+0000 7fac58bf6740 10 client.16278 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:44:47.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.979+0000 7fac58bf6740 20 client.16278 populate_metadata read hostname 'smithi001' 2024-09-19T09:44:47.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.979+0000 7fac58bf6740 1 --2- 172.21.15.1:0/1746016664 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55fdd6bac820 0x55fdd6baec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:47.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.979+0000 7fac58bf6740 4 client.16278 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:44:47.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.979+0000 7fac58bf6740 1 -- 172.21.15.1:0/1746016664 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fdd6b07a20 con 0x55fdd6bac820 2024-09-19T09:44:47.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.979+0000 7fac4f7fe640 1 --2- 172.21.15.1:0/1746016664 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55fdd6bac820 0x55fdd6baec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:47.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.980+0000 7fac2effd640 10 client.16278 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:44:47.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.980+0000 7fac4f7fe640 1 --2- 172.21.15.1:0/1746016664 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55fdd6bac820 0x55fdd6baec30 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=300d9d4ddb6f1723 server_cookie=375018f9f9efe24d in_seq=0 out_seq=0 2024-09-19T09:44:47.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.980+0000 7fac2effd640 1 -- 172.21.15.1:0/1746016664 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fdd6b07a20 con 0x55fdd6bac820 2024-09-19T09:44:47.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.980+0000 7fac2effd640 10 client.16278 handle_command_reply: tid=0 2024-09-19T09:44:47.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.980+0000 7fac58bf6740 1 client.16278 shutdown 2024-09-19T09:44:47.990 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.980+0000 7fac58bf6740 1 -- 172.21.15.1:0/1746016664 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdd6b9c370 msgr2=0x55fdd6ba80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:47.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.980+0000 7fac58bf6740 1 --2- 172.21.15.1:0/1746016664 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdd6b9c370 0x55fdd6ba80b0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fac48003e20 tx=0x7fac48004ab0 comp rx=0 tx=0).stop 2024-09-19T09:44:47.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.980+0000 7fac58bf6740 1 -- 172.21.15.1:0/1746016664 shutdown_connections 2024-09-19T09:44:47.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.980+0000 7fac58bf6740 1 --2- 172.21.15.1:0/1746016664 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55fdd6bac820 0x55fdd6baec30 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:47.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.980+0000 7fac58bf6740 1 --2- 172.21.15.1:0/1746016664 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdd6b9c370 0x55fdd6ba80b0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:47.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.980+0000 7fac58bf6740 1 --2- 172.21.15.1:0/1746016664 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdd6b972e0 0x55fdd6ba1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:47.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.980+0000 7fac2effd640 0 client.16278 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:44:47.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.980+0000 7fac58bf6740 1 --2- 172.21.15.1:0/1746016664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdd6b969a0 0x55fdd6ba0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:47.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.980+0000 7fac58bf6740 1 -- 172.21.15.1:0/1746016664 >> 172.21.15.1:0/1746016664 conn(0x55fdd6b92010 msgr2=0x55fdd6b93820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:47.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.981+0000 7fac58bf6740 1 -- 172.21.15.1:0/1746016664 shutdown_connections 2024-09-19T09:44:47.991 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.981+0000 7fac58bf6740 1 -- 172.21.15.1:0/1746016664 wait complete. 2024-09-19T09:44:47.992 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.981+0000 7fac58bf6740 20 client.16278 trim_cache size 0 max 16384 2024-09-19T09:44:47.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.995+0000 7fac58bf6740 1 Processor -- start 2024-09-19T09:44:47.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.995+0000 7fac58bf6740 1 -- start start 2024-09-19T09:44:47.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.995+0000 7fac58bf6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdd6b969a0 0x55fdd6baec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:47.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.995+0000 7fac58bf6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdd6b972e0 0x55fdd6ba8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:47.998 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.995+0000 7fac58bf6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdd6b9c370 0x55fdd6b92ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:47.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.995+0000 7fac58bf6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fac501a92b0 con 0x55fdd6b972e0 2024-09-19T09:44:47.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.995+0000 7fac58bf6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fac501abb50 con 0x55fdd6b969a0 2024-09-19T09:44:47.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.995+0000 7fac58bf6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fac501a9940 con 0x55fdd6b9c370 2024-09-19T09:44:47.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.995+0000 7fac4effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdd6b972e0 0x55fdd6ba8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:47.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.995+0000 7fac4effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdd6b972e0 0x55fdd6ba8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48962/0 (socket says 172.21.15.1:48962) 2024-09-19T09:44:47.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.995+0000 7fac4effd640 1 -- 172.21.15.1:0/3014130428 learned_addr learned my addr 172.21.15.1:0/3014130428 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:47.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.995+0000 7fac4f7fe640 1 --2- 172.21.15.1:0/3014130428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdd6b969a0 0x55fdd6baec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:47.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.995+0000 7fac4ffff640 1 --2- 172.21.15.1:0/3014130428 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdd6b9c370 0x55fdd6b92ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:47.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.995+0000 7fac4effd640 1 -- 172.21.15.1:0/3014130428 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdd6b9c370 msgr2=0x55fdd6b92ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:47.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.995+0000 7fac4effd640 1 --2- 172.21.15.1:0/3014130428 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdd6b9c370 0x55fdd6b92ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:47.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.995+0000 7fac4effd640 1 -- 172.21.15.1:0/3014130428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdd6b969a0 msgr2=0x55fdd6baec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:47.999 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.995+0000 7fac4effd640 1 --2- 172.21.15.1:0/3014130428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdd6b969a0 0x55fdd6baec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.995+0000 7fac4effd640 1 -- 172.21.15.1:0/3014130428 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdd6b977c0 con 0x55fdd6b972e0 2024-09-19T09:44:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.995+0000 7fac4ffff640 1 --2- 172.21.15.1:0/3014130428 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdd6b9c370 0x55fdd6b92ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:44:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.996+0000 7fac4effd640 1 --2- 172.21.15.1:0/3014130428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdd6b972e0 0x55fdd6ba8070 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fac44009900 tx=0x7fac4402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e56980854d50f33 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.996+0000 7fac357fa640 1 -- 172.21.15.1:0/3014130428 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac44035070 con 0x55fdd6b972e0 2024-09-19T09:44:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.996+0000 7fac357fa640 1 -- 172.21.15.1:0/3014130428 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac44004c30 con 0x55fdd6b972e0 2024-09-19T09:44:48.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.996+0000 7fac357fa640 1 -- 172.21.15.1:0/3014130428 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac44031ad0 con 0x55fdd6b972e0 2024-09-19T09:44:48.000 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:47 smithi001 ceph-mon[31225]: pgmap v539: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.3 MiB/s wr, 1.27k op/s 2024-09-19T09:44:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.996+0000 7fac58bf6740 1 -- 172.21.15.1:0/3014130428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdd6b972e0 msgr2=0x55fdd6ba8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.996+0000 7fac58bf6740 1 --2- 172.21.15.1:0/3014130428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdd6b972e0 0x55fdd6ba8070 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fac44009900 tx=0x7fac4402a410 comp rx=0 tx=0).stop 2024-09-19T09:44:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.996+0000 7fac58bf6740 1 -- 172.21.15.1:0/3014130428 shutdown_connections 2024-09-19T09:44:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.996+0000 7fac58bf6740 1 --2- 172.21.15.1:0/3014130428 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdd6b9c370 0x55fdd6b92ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.996+0000 7fac58bf6740 1 --2- 172.21.15.1:0/3014130428 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdd6b972e0 0x55fdd6ba8070 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.996+0000 7fac58bf6740 1 --2- 172.21.15.1:0/3014130428 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdd6b969a0 0x55fdd6baec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.996+0000 7fac58bf6740 1 -- 172.21.15.1:0/3014130428 >> 172.21.15.1:0/3014130428 conn(0x55fdd6b92010 msgr2=0x55fdd6ba0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.996+0000 7fac58bf6740 1 -- 172.21.15.1:0/3014130428 shutdown_connections 2024-09-19T09:44:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.996+0000 7fac58bf6740 1 -- 172.21.15.1:0/3014130428 wait complete. 2024-09-19T09:44:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.997+0000 7fac58bf6740 1 -- start start 2024-09-19T09:44:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.997+0000 7fac58bf6740 1 Processor -- start 2024-09-19T09:44:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.997+0000 7fac58bf6740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdd6b969a0 0x55fdd6ba5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.997+0000 7fac58bf6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdd6b972e0 0x55fdd6ba5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.997+0000 7fac58bf6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdd6b9c370 0x55fdd6ba6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.997+0000 7fac58bf6740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fac501aa010 con 0x55fdd6b969a0 2024-09-19T09:44:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.997+0000 7fac58bf6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fac501ab480 con 0x55fdd6b9c370 2024-09-19T09:44:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.997+0000 7fac58bf6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fac501aa6e0 con 0x55fdd6b972e0 2024-09-19T09:44:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.997+0000 7fac58bf6740 10 client.0 _ll_register_callbacks cb 0x7fac48012070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:44:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.997+0000 7fac4f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdd6b969a0 0x55fdd6ba5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.997+0000 7fac4f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdd6b969a0 0x55fdd6ba5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48978/0 (socket says 172.21.15.1:48978) 2024-09-19T09:44:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.997+0000 7fac4f7fe640 1 -- 172.21.15.1:0/4026821443 learned_addr learned my addr 172.21.15.1:0/4026821443 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.997+0000 7fac4effd640 1 --2- 172.21.15.1:0/4026821443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdd6b972e0 0x55fdd6ba5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.997+0000 7fac4ffff640 1 --2- 172.21.15.1:0/4026821443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdd6b9c370 0x55fdd6ba6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.997+0000 7fac4f7fe640 1 -- 172.21.15.1:0/4026821443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdd6b972e0 msgr2=0x55fdd6ba5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.997+0000 7fac4f7fe640 1 --2- 172.21.15.1:0/4026821443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdd6b972e0 0x55fdd6ba5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.997+0000 7fac4f7fe640 1 -- 172.21.15.1:0/4026821443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdd6b9c370 msgr2=0x55fdd6ba6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:44:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.997+0000 7fac4f7fe640 1 --2- 172.21.15.1:0/4026821443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdd6b9c370 0x55fdd6ba6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.997+0000 7fac4f7fe640 1 -- 172.21.15.1:0/4026821443 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdd6ba6d60 con 0x55fdd6b969a0 2024-09-19T09:44:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.998+0000 7fac4f7fe640 1 --2- 172.21.15.1:0/4026821443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdd6b969a0 0x55fdd6ba5200 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fac400986a0 tx=0x7fac400045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10131df46ddb1851 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.998+0000 7fac2effd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:44:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.998+0000 7fac2effd640 1 -- 172.21.15.1:0/4026821443 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4009c940 con 0x55fdd6b969a0 2024-09-19T09:44:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.998+0000 7fac2effd640 1 -- 172.21.15.1:0/4026821443 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fac400cd830 con 0x55fdd6b969a0 2024-09-19T09:44:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.998+0000 7fac58bf6740 1 -- 172.21.15.1:0/4026821443 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac44004c30 con 0x55fdd6b969a0 2024-09-19T09:44:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.998+0000 7fac2effd640 1 -- 172.21.15.1:0/4026821443 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fac4009c240 con 0x55fdd6b969a0 2024-09-19T09:44:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.998+0000 7fac58bf6740 10 client.16284 fetch_fsmap learned FSMap version 19 2024-09-19T09:44:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.998+0000 7fac58bf6740 1 -- 172.21.15.1:0/4026821443 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=4+}) -- 0x55fdd6ba80e0 con 0x55fdd6b969a0 2024-09-19T09:44:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.998+0000 7fac2effd640 1 -- 172.21.15.1:0/4026821443 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac44004c30 con 0x55fdd6b969a0 2024-09-19T09:44:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.998+0000 7fac2effd640 1 -- 172.21.15.1:0/4026821443 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 19) ==== 8330+0+0 (secure 0 0 0) 0x7fac400988b0 con 0x55fdd6b969a0 2024-09-19T09:44:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.998+0000 7fac58bf6740 10 client.16284 fetch_fsmap finished waiting for FSMap version 19 2024-09-19T09:44:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.998+0000 7fac58bf6740 10 client.16284 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:44:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.998+0000 7fac58bf6740 20 client.16284 populate_metadata read hostname 'smithi001' 2024-09-19T09:44:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.998+0000 7fac58bf6740 1 --2- 172.21.15.1:0/4026821443 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55fdd6c178f0 0x55fdd6c19ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:48.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.998+0000 7fac58bf6740 4 client.16284 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:44:48.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.998+0000 7fac58bf6740 1 -- 172.21.15.1:0/4026821443 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fdd6b01d70 con 0x55fdd6c178f0 2024-09-19T09:44:48.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.998+0000 7fac4effd640 1 --2- 172.21.15.1:0/4026821443 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55fdd6c178f0 0x55fdd6c19ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:48.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.999+0000 7fac4effd640 1 --2- 172.21.15.1:0/4026821443 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55fdd6c178f0 0x55fdd6c19ce0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58fe2647470f090d server_cookie=58e642b206b1bf3d in_seq=0 out_seq=0 2024-09-19T09:44:48.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:47.999+0000 7fac2effd640 10 client.16284 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:44:48.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:47 smithi022 ceph-mon[35583]: pgmap v539: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.3 MiB/s wr, 1.27k op/s 2024-09-19T09:44:48.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:47 smithi121 ceph-mon[35577]: pgmap v539: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.3 MiB/s wr, 1.27k op/s 2024-09-19T09:44:48.210 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:48.207+0000 7fac2effd640 1 -- 172.21.15.1:0/4026821443 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fdd6b01d70 con 0x55fdd6c178f0 2024-09-19T09:44:48.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:48.207+0000 7fac2effd640 10 client.16284 handle_command_reply: tid=0 2024-09-19T09:44:48.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:48.207+0000 7fac58bf6740 1 client.16284 shutdown 2024-09-19T09:44:48.211 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:48.208+0000 7fac58bf6740 1 -- 172.21.15.1:0/4026821443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdd6b969a0 msgr2=0x55fdd6ba5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:48.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:48.208+0000 7fac58bf6740 1 --2- 172.21.15.1:0/4026821443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdd6b969a0 0x55fdd6ba5200 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fac400986a0 tx=0x7fac400045f0 comp rx=0 tx=0).stop 2024-09-19T09:44:48.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:48.208+0000 7fac58bf6740 1 -- 172.21.15.1:0/4026821443 shutdown_connections 2024-09-19T09:44:48.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:48.208+0000 7fac58bf6740 1 --2- 172.21.15.1:0/4026821443 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55fdd6c178f0 0x55fdd6c19ce0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:48.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:48.208+0000 7fac2effd640 0 client.16284 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:44:48.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:48.208+0000 7fac58bf6740 1 --2- 172.21.15.1:0/4026821443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55fdd6b9c370 0x55fdd6ba6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:48.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:48.208+0000 7fac58bf6740 1 --2- 172.21.15.1:0/4026821443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fdd6b972e0 0x55fdd6ba5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:48.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:48.208+0000 7fac58bf6740 1 --2- 172.21.15.1:0/4026821443 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55fdd6b969a0 0x55fdd6ba5200 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:48.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:48.208+0000 7fac58bf6740 1 -- 172.21.15.1:0/4026821443 >> 172.21.15.1:0/4026821443 conn(0x55fdd6b92010 msgr2=0x55fdd6b909a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:48.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:48.208+0000 7fac58bf6740 1 -- 172.21.15.1:0/4026821443 shutdown_connections 2024-09-19T09:44:48.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:48.209+0000 7fac58bf6740 1 -- 172.21.15.1:0/4026821443 wait complete. 2024-09-19T09:44:48.212 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:48.209+0000 7fac58bf6740 20 client.16284 trim_cache size 0 max 16384 2024-09-19T09:44:48.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:44:48.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:44:48.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:44:48.213 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:44:48.214 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:48.210+0000 7fac55e5e640 1 -- 172.21.15.1:0/2516591258 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fac380a32c0 msgr2=0x7fac380a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:48.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:48.210+0000 7fac55e5e640 1 --2- 172.21.15.1:0/2516591258 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fac380a32c0 0x7fac380a5780 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fac48009fd0 tx=0x7fac48009500 comp rx=0 tx=0).stop 2024-09-19T09:44:48.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:48.210+0000 7fac55e5e640 1 -- 172.21.15.1:0/2516591258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac50100a70 msgr2=0x7fac5010b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:48.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:48.210+0000 7fac55e5e640 1 --2- 172.21.15.1:0/2516591258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac50100a70 0x7fac5010b3f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fac4000e9c0 tx=0x7fac4000ee80 comp rx=0 tx=0).stop 2024-09-19T09:44:48.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:48.210+0000 7fac55e5e640 1 -- 172.21.15.1:0/2516591258 shutdown_connections 2024-09-19T09:44:48.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:48.210+0000 7fac55e5e640 1 --2- 172.21.15.1:0/2516591258 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac50102620 0x7fac50109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:48.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:48.210+0000 7fac55e5e640 1 --2- 172.21.15.1:0/2516591258 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fac50101c60 0x7fac50109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:48.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:48.210+0000 7fac55e5e640 1 --2- 172.21.15.1:0/2516591258 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fac380a32c0 0x7fac380a5780 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:48.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:48.210+0000 7fac55e5e640 1 --2- 172.21.15.1:0/2516591258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac50100a70 0x7fac5010b3f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:48.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:48.210+0000 7fac55e5e640 1 -- 172.21.15.1:0/2516591258 >> 172.21.15.1:0/2516591258 conn(0x7fac500fc1f0 msgr2=0x7fac50105080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:48.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:48.211+0000 7fac55e5e640 1 -- 172.21.15.1:0/2516591258 shutdown_connections 2024-09-19T09:44:48.215 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:44:48.211+0000 7fac55e5e640 1 -- 172.21.15.1:0/2516591258 wait complete. 2024-09-19T09:44:49.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:49 smithi001 ceph-mon[31225]: pgmap v540: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 MiB/s wr, 4.41k op/s 2024-09-19T09:44:50.085 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:49 smithi121 ceph-mon[35577]: pgmap v540: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 MiB/s wr, 4.41k op/s 2024-09-19T09:44:50.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:49 smithi022 ceph-mon[35583]: pgmap v540: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 MiB/s wr, 4.41k op/s 2024-09-19T09:44:50.367 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 19 09:44:50 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-i[65189]: ignoring --setuser ceph since I am not root 2024-09-19T09:44:50.367 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 19 09:44:50 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-i[65189]: ignoring --setgroup ceph since I am not root 2024-09-19T09:44:50.367 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 19 09:44:50 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-i[65189]: starting mds.i at 2024-09-19T09:44:50.741 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '978f3b4d', total seconds elapsed: 88.9 2024-09-19T09:44:50.741 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.8 2024-09-19T09:44:50.741 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:44:50.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:50 smithi001 ceph-mon[31225]: daemon mds.i restarted 2024-09-19T09:44:51.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:50 smithi022 ceph-mon[35583]: daemon mds.i restarted 2024-09-19T09:44:51.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:50 smithi121 ceph-mon[35577]: daemon mds.i restarted 2024-09-19T09:44:51.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:51 smithi001 ceph-mon[31225]: pgmap v541: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 MiB/s wr, 4.32k op/s 2024-09-19T09:44:51.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:51 smithi001 ceph-mon[31225]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T09:44:51.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:51 smithi001 ceph-mon[31225]: mds.? [v2:172.21.15.121:6838/1975960689,v1:172.21.15.121:6839/1975960689] up:boot 2024-09-19T09:44:51.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:51 smithi001 ceph-mon[31225]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:44:51.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:51 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:44:51.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:51 smithi001 ceph-mon[31225]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T09:44:52.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:51 smithi022 ceph-mon[35583]: pgmap v541: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 MiB/s wr, 4.32k op/s 2024-09-19T09:44:52.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:51 smithi022 ceph-mon[35583]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T09:44:52.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:51 smithi022 ceph-mon[35583]: mds.? [v2:172.21.15.121:6838/1975960689,v1:172.21.15.121:6839/1975960689] up:boot 2024-09-19T09:44:52.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:51 smithi022 ceph-mon[35583]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:44:52.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:51 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:44:52.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:51 smithi022 ceph-mon[35583]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T09:44:52.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:51 smithi121 ceph-mon[35577]: pgmap v541: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 MiB/s wr, 4.32k op/s 2024-09-19T09:44:52.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:51 smithi121 ceph-mon[35577]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T09:44:52.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:51 smithi121 ceph-mon[35577]: mds.? [v2:172.21.15.121:6838/1975960689,v1:172.21.15.121:6839/1975960689] up:boot 2024-09-19T09:44:52.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:51 smithi121 ceph-mon[35577]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T09:44:52.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:51 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:44:52.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:51 smithi121 ceph-mon[35577]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-19T09:44:53.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:52 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/3904973867' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:44:53.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:52 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/3904973867' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:44:53.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:52 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/3904973867' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:44:53.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.333+0000 7f07562b5640 1 -- 172.21.15.1:0/528996778 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0750106f30 msgr2=0x7f075010eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:53.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.333+0000 7f07562b5640 1 --2- 172.21.15.1:0/528996778 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0750106f30 0x7f075010eab0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f0748009ca0 tx=0x7f074802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:44:53.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.334+0000 7f07562b5640 1 -- 172.21.15.1:0/528996778 shutdown_connections 2024-09-19T09:44:53.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.334+0000 7f07562b5640 1 --2- 172.21.15.1:0/528996778 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0750106f30 0x7f075010eab0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:53.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.334+0000 7f07562b5640 1 --2- 172.21.15.1:0/528996778 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0750100cc0 0x7f0750106800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:53.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.334+0000 7f07562b5640 1 --2- 172.21.15.1:0/528996778 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0750100310 0x7f07501006f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:53.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.334+0000 7f07562b5640 1 -- 172.21.15.1:0/528996778 >> 172.21.15.1:0/528996778 conn(0x7f0750077210 msgr2=0x7f07500fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:53.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.334+0000 7f07562b5640 1 -- 172.21.15.1:0/528996778 shutdown_connections 2024-09-19T09:44:53.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.334+0000 7f07562b5640 1 -- 172.21.15.1:0/528996778 wait complete. 2024-09-19T09:44:53.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.334+0000 7f07562b5640 1 Processor -- start 2024-09-19T09:44:53.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.334+0000 7f07562b5640 1 -- start start 2024-09-19T09:44:53.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.335+0000 7f07562b5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0750100310 0x7f0750101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:53.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.335+0000 7f07562b5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0750100cc0 0x7f07501017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:53.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.335+0000 7f07562b5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0750106f30 0x7f0750101d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:53.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.335+0000 7f07562b5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0750111f90 con 0x7f0750106f30 2024-09-19T09:44:53.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.335+0000 7f07562b5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0750111e10 con 0x7f0750100cc0 2024-09-19T09:44:53.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.335+0000 7f07562b5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0750112110 con 0x7f0750100310 2024-09-19T09:44:53.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.335+0000 7f0754852640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0750106f30 0x7f0750101d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:53.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.335+0000 7f074ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0750100310 0x7f0750101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:53.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.335+0000 7f0754852640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0750106f30 0x7f0750101d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48998/0 (socket says 172.21.15.1:48998) 2024-09-19T09:44:53.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.335+0000 7f0754852640 1 -- 172.21.15.1:0/3904973867 learned_addr learned my addr 172.21.15.1:0/3904973867 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:44:53.713 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:44:53.713 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T09:44:50:770090+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":16287,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6839/1975960689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":1975960689},{"type":"v1","addr":"172.21.15.121:6839","nonce":1975960689}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:44:50.770010+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24479":{"gid":24479,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:44:53.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.335+0000 7f074f7fe640 1 --2- 172.21.15.1:0/3904973867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0750100cc0 0x7f07501017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:53.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.335+0000 7f0754852640 1 -- 172.21.15.1:0/3904973867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0750100310 msgr2=0x7f0750101290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:53.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.335+0000 7f0754852640 1 --2- 172.21.15.1:0/3904973867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0750100310 0x7f0750101290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:53.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.335+0000 7f0754852640 1 -- 172.21.15.1:0/3904973867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0750100cc0 msgr2=0x7f07501017d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:53.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.335+0000 7f0754852640 1 --2- 172.21.15.1:0/3904973867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0750100cc0 0x7f07501017d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:53.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.335+0000 7f0754852640 1 -- 172.21.15.1:0/3904973867 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07501a6870 con 0x7f0750106f30 2024-09-19T09:44:53.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.335+0000 7f0754852640 1 --2- 172.21.15.1:0/3904973867 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0750106f30 0x7f0750101d10 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0748031a20 tx=0x7f0748031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:53.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.335+0000 7f074d7fa640 1 -- 172.21.15.1:0/3904973867 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0748003c30 con 0x7f0750106f30 2024-09-19T09:44:53.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.335+0000 7f074d7fa640 1 -- 172.21.15.1:0/3904973867 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0748003dd0 con 0x7f0750106f30 2024-09-19T09:44:53.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.335+0000 7f07562b5640 1 -- 172.21.15.1:0/3904973867 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07501a6b00 con 0x7f0750106f30 2024-09-19T09:44:53.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.335+0000 7f074d7fa640 1 -- 172.21.15.1:0/3904973867 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074802fc40 con 0x7f0750106f30 2024-09-19T09:44:53.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.336+0000 7f07562b5640 1 -- 172.21.15.1:0/3904973867 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07501a7090 con 0x7f0750106f30 2024-09-19T09:44:53.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.336+0000 7f07562b5640 1 -- 172.21.15.1:0/3904973867 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07501006f0 con 0x7f0750106f30 2024-09-19T09:44:53.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.338+0000 7f074d7fa640 1 -- 172.21.15.1:0/3904973867 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f0748004b40 con 0x7f0750106f30 2024-09-19T09:44:53.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.338+0000 7f074d7fa640 1 --2- 172.21.15.1:0/3904973867 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f073c0a32c0 0x7f073c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:44:53.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.338+0000 7f074ffff640 1 --2- 172.21.15.1:0/3904973867 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f073c0a32c0 0x7f073c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:44:53.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.339+0000 7f074d7fa640 1 -- 172.21.15.1:0/3904973867 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f07480f0b70 con 0x7f0750106f30 2024-09-19T09:44:53.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.339+0000 7f074ffff640 1 --2- 172.21.15.1:0/3904973867 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f073c0a32c0 0x7f073c0a5780 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0738009bd0 tx=0x7f0738005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:44:53.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.342+0000 7f074d7fa640 1 -- 172.21.15.1:0/3904973867 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f07480bd920 con 0x7f0750106f30 2024-09-19T09:44:53.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.674+0000 7f07562b5640 1 -- 172.21.15.1:0/3904973867 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07501027c0 con 0x7f0750106f30 2024-09-19T09:44:53.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.695+0000 7f074d7fa640 1 -- 172.21.15.1:0/3904973867 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11838 (secure 0 0 0) 0x7f07501027c0 con 0x7f0750106f30 2024-09-19T09:44:53.715 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T09:44:53.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.699+0000 7f07562b5640 1 -- 172.21.15.1:0/3904973867 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f073c0a32c0 msgr2=0x7f073c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:53.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.700+0000 7f07562b5640 1 --2- 172.21.15.1:0/3904973867 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f073c0a32c0 0x7f073c0a5780 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0738009bd0 tx=0x7f0738005f90 comp rx=0 tx=0).stop 2024-09-19T09:44:53.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.700+0000 7f07562b5640 1 -- 172.21.15.1:0/3904973867 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0750106f30 msgr2=0x7f0750101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:44:53.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.700+0000 7f07562b5640 1 --2- 172.21.15.1:0/3904973867 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0750106f30 0x7f0750101d10 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0748031a20 tx=0x7f0748031a50 comp rx=0 tx=0).stop 2024-09-19T09:44:53.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.700+0000 7f07562b5640 1 -- 172.21.15.1:0/3904973867 shutdown_connections 2024-09-19T09:44:53.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.700+0000 7f07562b5640 1 --2- 172.21.15.1:0/3904973867 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0750106f30 0x7f0750101d10 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:53.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.700+0000 7f07562b5640 1 --2- 172.21.15.1:0/3904973867 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f073c0a32c0 0x7f073c0a5780 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:53.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.700+0000 7f07562b5640 1 --2- 172.21.15.1:0/3904973867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0750100cc0 0x7f07501017d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:53.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.700+0000 7f07562b5640 1 --2- 172.21.15.1:0/3904973867 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0750100310 0x7f0750101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:44:53.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.700+0000 7f07562b5640 1 -- 172.21.15.1:0/3904973867 >> 172.21.15.1:0/3904973867 conn(0x7f0750077210 msgr2=0x7f0750105740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:44:53.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.700+0000 7f07562b5640 1 -- 172.21.15.1:0/3904973867 shutdown_connections 2024-09-19T09:44:53.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:44:52.700+0000 7f07562b5640 1 -- 172.21.15.1:0/3904973867 wait complete. 2024-09-19T09:44:53.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:53 smithi001 ceph-mon[31225]: pgmap v543: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 51 MiB/s wr, 7.87k op/s 2024-09-19T09:44:54.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:53 smithi022 ceph-mon[35583]: pgmap v543: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 51 MiB/s wr, 7.87k op/s 2024-09-19T09:44:54.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:53 smithi121 ceph-mon[35577]: pgmap v543: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 51 MiB/s wr, 7.87k op/s 2024-09-19T09:44:56.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:55 smithi022 ceph-mon[35583]: pgmap v544: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 71 MiB/s wr, 10.88k op/s 2024-09-19T09:44:56.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:55 smithi121 ceph-mon[35577]: pgmap v544: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 71 MiB/s wr, 10.88k op/s 2024-09-19T09:44:56.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:55 smithi001 ceph-mon[31225]: pgmap v544: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 71 MiB/s wr, 10.88k op/s 2024-09-19T09:44:57.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:57 smithi001 ceph-mon[31225]: pgmap v545: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 69 MiB/s wr, 10.65k op/s 2024-09-19T09:44:58.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:57 smithi022 ceph-mon[35583]: pgmap v545: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 69 MiB/s wr, 10.65k op/s 2024-09-19T09:44:58.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:57 smithi121 ceph-mon[35577]: pgmap v545: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 69 MiB/s wr, 10.65k op/s 2024-09-19T09:45:00.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:44:59 smithi022 ceph-mon[35583]: pgmap v546: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 73 MiB/s wr, 11.22k op/s 2024-09-19T09:45:00.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:44:59 smithi121 ceph-mon[35577]: pgmap v546: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 73 MiB/s wr, 11.22k op/s 2024-09-19T09:45:00.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:44:59 smithi001 ceph-mon[31225]: pgmap v546: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 73 MiB/s wr, 11.22k op/s 2024-09-19T09:45:01.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.385+0000 7fbb652d7640 1 -- 172.21.15.1:0/2589461317 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb60109700 msgr2=0x7fbb60109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:01.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.385+0000 7fbb652d7640 1 --2- 172.21.15.1:0/2589461317 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb60109700 0x7fbb60109b00 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fbb50009900 tx=0x7fbb5002a440 comp rx=0 tx=0).stop 2024-09-19T09:45:01.390 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.387+0000 7fbb652d7640 1 -- 172.21.15.1:0/2589461317 shutdown_connections 2024-09-19T09:45:01.390 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.387+0000 7fbb652d7640 1 --2- 172.21.15.1:0/2589461317 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb600736b0 0x7fbb60119130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.391 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.387+0000 7fbb652d7640 1 --2- 172.21.15.1:0/2589461317 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb60072d10 0x7fbb60073170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.391 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.387+0000 7fbb652d7640 1 --2- 172.21.15.1:0/2589461317 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb60109700 0x7fbb60109b00 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.391 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.387+0000 7fbb652d7640 1 -- 172.21.15.1:0/2589461317 >> 172.21.15.1:0/2589461317 conn(0x7fbb6006ecd0 msgr2=0x7fbb60071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:01.391 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.390+0000 7fbb652d7640 1 -- 172.21.15.1:0/2589461317 shutdown_connections 2024-09-19T09:45:01.393 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.391+0000 7fbb652d7640 1 -- 172.21.15.1:0/2589461317 wait complete. 2024-09-19T09:45:01.394 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.392+0000 7fbb652d7640 1 Processor -- start 2024-09-19T09:45:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.392+0000 7fbb652d7640 1 -- start start 2024-09-19T09:45:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.393+0000 7fbb652d7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb60072d10 0x7fbb60116de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.393+0000 7fbb652d7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb600736b0 0x7fbb60117320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.393+0000 7fbb652d7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb60109700 0x7fbb60118360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.393+0000 7fbb652d7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbb60110f30 con 0x7fbb60072d10 2024-09-19T09:45:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.393+0000 7fbb652d7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbb60110db0 con 0x7fbb600736b0 2024-09-19T09:45:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.393+0000 7fbb652d7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbb601110b0 con 0x7fbb60109700 2024-09-19T09:45:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.393+0000 7fbb57fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb600736b0 0x7fbb60117320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.397 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.393+0000 7fbb57fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb600736b0 0x7fbb60117320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:48034/0 (socket says 172.21.15.1:48034) 2024-09-19T09:45:01.398 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.393+0000 7fbb57fff640 1 -- 172.21.15.1:0/1023370678 learned_addr learned my addr 172.21.15.1:0/1023370678 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:01.398 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.394+0000 7fbb5effd640 1 --2- 172.21.15.1:0/1023370678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb60072d10 0x7fbb60116de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.398 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.394+0000 7fbb5effd640 1 -- 172.21.15.1:0/1023370678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb60109700 msgr2=0x7fbb60118360 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:45:01.398 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.394+0000 7fbb5effd640 1 --2- 172.21.15.1:0/1023370678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb60109700 0x7fbb60118360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.398 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.394+0000 7fbb5effd640 1 -- 172.21.15.1:0/1023370678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb600736b0 msgr2=0x7fbb60117320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:01.398 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.394+0000 7fbb5effd640 1 --2- 172.21.15.1:0/1023370678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb600736b0 0x7fbb60117320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.398 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.394+0000 7fbb5effd640 1 -- 172.21.15.1:0/1023370678 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb601189d0 con 0x7fbb60072d10 2024-09-19T09:45:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.395+0000 7fbb5effd640 1 --2- 172.21.15.1:0/1023370678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb60072d10 0x7fbb60116de0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fbb50009850 tx=0x7fbb50032bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.396+0000 7fbb5cff9640 1 -- 172.21.15.1:0/1023370678 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5003f030 con 0x7fbb60072d10 2024-09-19T09:45:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.396+0000 7fbb652d7640 1 -- 172.21.15.1:0/1023370678 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb60118c60 con 0x7fbb60072d10 2024-09-19T09:45:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.396+0000 7fbb652d7640 1 -- 172.21.15.1:0/1023370678 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb60119120 con 0x7fbb60072d10 2024-09-19T09:45:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.396+0000 7fbb5cff9640 1 -- 172.21.15.1:0/1023370678 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb50003ad0 con 0x7fbb60072d10 2024-09-19T09:45:01.399 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.396+0000 7fbb5cff9640 1 -- 172.21.15.1:0/1023370678 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb50035070 con 0x7fbb60072d10 2024-09-19T09:45:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.400+0000 7fbb68070740 1 Processor -- start 2024-09-19T09:45:01.403 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.401+0000 7fbb5cff9640 1 -- 172.21.15.1:0/1023370678 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fbb50042030 con 0x7fbb60072d10 2024-09-19T09:45:01.405 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.403+0000 7fbb5cff9640 1 --2- 172.21.15.1:0/1023370678 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbb400a3450 0x7fbb400a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.405 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.403+0000 7fbb5cff9640 1 -- 172.21.15.1:0/1023370678 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fbb500f0e60 con 0x7fbb60072d10 2024-09-19T09:45:01.405 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.404+0000 7fbb68070740 1 -- start start 2024-09-19T09:45:01.407 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.404+0000 7fbb68070740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56169483f9a0 0x56169483fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.404+0000 7fbb68070740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5616948402e0 0x561694844da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.404+0000 7fbb68070740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561694845370 0x561694847830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.404+0000 7fbb68070740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5616947a32f0 con 0x5616948402e0 2024-09-19T09:45:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.404+0000 7fbb68070740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56169474b270 con 0x561694845370 2024-09-19T09:45:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.404+0000 7fbb68070740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56169479f2b0 con 0x56169483f9a0 2024-09-19T09:45:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.404+0000 7fbb5effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56169483f9a0 0x56169483fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.404+0000 7fbb5effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56169483f9a0 0x56169483fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:49098/0 (socket says 172.21.15.1:49098) 2024-09-19T09:45:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.404+0000 7fbb5effd640 1 -- 172.21.15.1:0/3125829329 learned_addr learned my addr 172.21.15.1:0/3125829329 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.405+0000 7fbb5effd640 1 -- 172.21.15.1:0/3125829329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561694845370 msgr2=0x561694847830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:45:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.405+0000 7fbb5effd640 1 --2- 172.21.15.1:0/3125829329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561694845370 0x561694847830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.405+0000 7fbb5effd640 1 -- 172.21.15.1:0/3125829329 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5616948402e0 msgr2=0x561694844da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:01.408 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.405+0000 7fbb5effd640 1 --2- 172.21.15.1:0/3125829329 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5616948402e0 0x561694844da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.405+0000 7fbb5effd640 1 -- 172.21.15.1:0/3125829329 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56169474a340 con 0x56169483f9a0 2024-09-19T09:45:01.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.405+0000 7fbb5effd640 1 --2- 172.21.15.1:0/3125829329 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56169483f9a0 0x56169483fda0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbb50033000 tx=0x7fbb500095f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ada7c5510c7a3bbb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:01.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.406+0000 7fbb557fa640 1 -- 172.21.15.1:0/3125829329 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb500d6070 con 0x56169483f9a0 2024-09-19T09:45:01.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.406+0000 7fbb557fa640 1 -- 172.21.15.1:0/3125829329 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb500c17f0 con 0x56169483f9a0 2024-09-19T09:45:01.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.406+0000 7fbb557fa640 1 -- 172.21.15.1:0/3125829329 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb50049050 con 0x56169483f9a0 2024-09-19T09:45:01.409 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.406+0000 7fbb5f7fe640 1 --2- 172.21.15.1:0/1023370678 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbb400a3450 0x7fbb400a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.407+0000 7fbb68070740 1 -- 172.21.15.1:0/3125829329 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56169483f9a0 msgr2=0x56169483fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:01.410 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.407+0000 7fbb68070740 1 --2- 172.21.15.1:0/3125829329 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56169483f9a0 0x56169483fda0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbb50033000 tx=0x7fbb500095f0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.407+0000 7fbb5f7fe640 1 --2- 172.21.15.1:0/1023370678 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbb400a3450 0x7fbb400a5910 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800ab50 tx=0x7fbb58009250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:01.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.407+0000 7fbb68070740 1 -- 172.21.15.1:0/3125829329 shutdown_connections 2024-09-19T09:45:01.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.407+0000 7fbb68070740 1 --2- 172.21.15.1:0/3125829329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561694845370 0x561694847830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.407+0000 7fbb68070740 1 --2- 172.21.15.1:0/3125829329 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5616948402e0 0x561694844da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.407+0000 7fbb68070740 1 --2- 172.21.15.1:0/3125829329 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56169483f9a0 0x56169483fda0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.407+0000 7fbb68070740 1 -- 172.21.15.1:0/3125829329 >> 172.21.15.1:0/3125829329 conn(0x56169483b010 msgr2=0x56169483b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:01.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.408+0000 7fbb68070740 1 -- 172.21.15.1:0/3125829329 shutdown_connections 2024-09-19T09:45:01.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.408+0000 7fbb68070740 1 -- 172.21.15.1:0/3125829329 wait complete. 2024-09-19T09:45:01.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.408+0000 7fbb68070740 1 -- start start 2024-09-19T09:45:01.411 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.408+0000 7fbb68070740 1 Processor -- start 2024-09-19T09:45:01.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.409+0000 7fbb68070740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169483f9a0 0x561694849a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.409+0000 7fbb68070740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5616948402e0 0x561694849f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.409+0000 7fbb68070740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561694845370 0x561694850f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.409+0000 7fbb68070740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x561694848100 con 0x561694845370 2024-09-19T09:45:01.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.409+0000 7fbb68070740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56169472c290 con 0x56169483f9a0 2024-09-19T09:45:01.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.409+0000 7fbb68070740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561694848280 con 0x5616948402e0 2024-09-19T09:45:01.415 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.409+0000 7fbb68070740 10 client.0 _ll_register_callbacks cb 0x56169475d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:45:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.409+0000 7fbb5effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169483f9a0 0x561694849a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.409+0000 7fbb5effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169483f9a0 0x561694849a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:48046/0 (socket says 172.21.15.1:48046) 2024-09-19T09:45:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.409+0000 7fbb5effd640 1 -- 172.21.15.1:0/1475868900 learned_addr learned my addr 172.21.15.1:0/1475868900 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.409+0000 7fbb57fff640 1 --2- 172.21.15.1:0/1475868900 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5616948402e0 0x561694849f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.410+0000 7fbb5effd640 1 -- 172.21.15.1:0/1475868900 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5616948402e0 msgr2=0x561694849f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.410+0000 7fbb5effd640 1 --2- 172.21.15.1:0/1475868900 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5616948402e0 0x561694849f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.410+0000 7fbb5effd640 1 -- 172.21.15.1:0/1475868900 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561694845370 msgr2=0x561694850f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:45:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.410+0000 7fbb5effd640 1 --2- 172.21.15.1:0/1475868900 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561694845370 0x561694850f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.410+0000 7fbb5effd640 1 -- 172.21.15.1:0/1475868900 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616944b6210 con 0x56169483f9a0 2024-09-19T09:45:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.410+0000 7fbb5effd640 1 --2- 172.21.15.1:0/1475868900 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169483f9a0 0x561694849a40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbb500bd380 tx=0x7fbb500bd5c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b208c3e7f2de9a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.411+0000 7fbb4e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:45:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.411+0000 7fbb4e7fc640 1 -- 172.21.15.1:0/1475868900 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb500d6040 con 0x56169483f9a0 2024-09-19T09:45:01.416 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.411+0000 7fbb68070740 1 -- 172.21.15.1:0/1475868900 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb500c17f0 con 0x56169483f9a0 2024-09-19T09:45:01.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.411+0000 7fbb4e7fc640 1 -- 172.21.15.1:0/1475868900 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fbb500d63e0 con 0x56169483f9a0 2024-09-19T09:45:01.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.412+0000 7fbb4e7fc640 1 -- 172.21.15.1:0/1475868900 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbb500cf050 con 0x56169483f9a0 2024-09-19T09:45:01.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.412+0000 7fbb68070740 10 client.25970 fetch_fsmap learned FSMap version 21 2024-09-19T09:45:01.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.412+0000 7fbb68070740 1 -- 172.21.15.1:0/1475868900 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561694582620 con 0x56169483f9a0 2024-09-19T09:45:01.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.412+0000 7fbb4e7fc640 1 -- 172.21.15.1:0/1475868900 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb500c17f0 con 0x56169483f9a0 2024-09-19T09:45:01.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.413+0000 7fbb4e7fc640 1 -- 172.21.15.1:0/1475868900 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 21) ==== 8330+0+0 (secure 0 0 0) 0x7fbb500bc890 con 0x56169483f9a0 2024-09-19T09:45:01.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.413+0000 7fbb68070740 10 client.25970 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T09:45:01.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.413+0000 7fbb68070740 10 client.25970 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:45:01.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.413+0000 7fbb68070740 20 client.25970 populate_metadata read hostname 'smithi001' 2024-09-19T09:45:01.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.413+0000 7fbb68070740 1 --2- 172.21.15.1:0/1475868900 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x561694855690 0x561694857ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.413+0000 7fbb68070740 4 client.25970 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:45:01.417 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.413+0000 7fbb68070740 1 -- 172.21.15.1:0/1475868900 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616947b0a20 con 0x561694855690 2024-09-19T09:45:01.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.414+0000 7fbb57fff640 1 --2- 172.21.15.1:0/1475868900 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x561694855690 0x561694857ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.416+0000 7fbb57fff640 1 --2- 172.21.15.1:0/1475868900 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x561694855690 0x561694857ab0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac3931370cba1cbf server_cookie=c1d7bdd4ee83f43f in_seq=0 out_seq=0 2024-09-19T09:45:01.418 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.416+0000 7fbb4e7fc640 10 client.25970 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:45:01.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.417+0000 7fbb4e7fc640 1 -- 172.21.15.1:0/1475868900 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5616947b0a20 con 0x561694855690 2024-09-19T09:45:01.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.417+0000 7fbb4e7fc640 10 client.25970 handle_command_reply: tid=0 2024-09-19T09:45:01.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.417+0000 7fbb68070740 1 client.25970 shutdown 2024-09-19T09:45:01.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.417+0000 7fbb68070740 1 -- 172.21.15.1:0/1475868900 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169483f9a0 msgr2=0x561694849a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:01.419 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.417+0000 7fbb68070740 1 --2- 172.21.15.1:0/1475868900 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169483f9a0 0x561694849a40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbb500bd380 tx=0x7fbb500bd5c0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.418+0000 7fbb68070740 1 -- 172.21.15.1:0/1475868900 shutdown_connections 2024-09-19T09:45:01.420 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.418+0000 7fbb68070740 1 --2- 172.21.15.1:0/1475868900 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x561694855690 0x561694857ab0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.418+0000 7fbb68070740 1 --2- 172.21.15.1:0/1475868900 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x561694845370 0x561694850f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.418+0000 7fbb68070740 1 --2- 172.21.15.1:0/1475868900 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5616948402e0 0x561694849f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.418+0000 7fbb68070740 1 --2- 172.21.15.1:0/1475868900 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169483f9a0 0x561694849a40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.418+0000 7fbb68070740 1 -- 172.21.15.1:0/1475868900 >> 172.21.15.1:0/1475868900 conn(0x56169483b010 msgr2=0x56169483c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:01.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.418+0000 7fbb4e7fc640 0 client.25970 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:45:01.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.418+0000 7fbb68070740 1 -- 172.21.15.1:0/1475868900 shutdown_connections 2024-09-19T09:45:01.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.418+0000 7fbb68070740 1 -- 172.21.15.1:0/1475868900 wait complete. 2024-09-19T09:45:01.421 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.418+0000 7fbb68070740 20 client.25970 trim_cache size 0 max 16384 2024-09-19T09:45:01.471 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.469+0000 7fbb68070740 1 Processor -- start 2024-09-19T09:45:01.472 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.470+0000 7fbb68070740 1 -- start start 2024-09-19T09:45:01.472 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.470+0000 7fbb68070740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5616948402e0 0x56169483a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.473 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.470+0000 7fbb68070740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561694845370 0x56169485c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.474 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.470+0000 7fbb68070740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56169483ba60 0x56169485c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.474 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.470+0000 7fbb68070740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4400c5b0 con 0x5616948402e0 2024-09-19T09:45:01.474 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.470+0000 7fbb68070740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4400ee50 con 0x561694845370 2024-09-19T09:45:01.474 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.470+0000 7fbb68070740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4400cc40 con 0x56169483ba60 2024-09-19T09:45:01.474 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.470+0000 7fbb5effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5616948402e0 0x56169483a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.474 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.470+0000 7fbb5effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5616948402e0 0x56169483a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59272/0 (socket says 172.21.15.1:59272) 2024-09-19T09:45:01.474 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.470+0000 7fbb5effd640 1 -- 172.21.15.1:0/4093461121 learned_addr learned my addr 172.21.15.1:0/4093461121 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:01.474 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.470+0000 7fbb57fff640 1 --2- 172.21.15.1:0/4093461121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561694845370 0x56169485c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.474 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.471+0000 7fbb5effd640 1 -- 172.21.15.1:0/4093461121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56169483ba60 msgr2=0x56169485c8f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:45:01.474 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.471+0000 7fbb5f7fe640 1 --2- 172.21.15.1:0/4093461121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56169483ba60 0x56169485c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.474 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.471+0000 7fbb5effd640 1 --2- 172.21.15.1:0/4093461121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56169483ba60 0x56169485c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.471+0000 7fbb5effd640 1 -- 172.21.15.1:0/4093461121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561694845370 msgr2=0x56169485c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:01.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.471+0000 7fbb5effd640 1 --2- 172.21.15.1:0/4093461121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561694845370 0x56169485c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.471+0000 7fbb5effd640 1 -- 172.21.15.1:0/4093461121 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561694849580 con 0x5616948402e0 2024-09-19T09:45:01.475 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.472+0000 7fbb57fff640 1 --2- 172.21.15.1:0/4093461121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561694845370 0x56169485c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:45:01.480 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.476+0000 7fbb5effd640 1 --2- 172.21.15.1:0/4093461121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5616948402e0 0x56169483a0b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fbb50031470 tx=0x7fbb5002ae80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94fa388a1b455a3f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.479+0000 7fbb54ff9640 1 -- 172.21.15.1:0/4093461121 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb500d6040 con 0x5616948402e0 2024-09-19T09:45:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.480+0000 7fbb54ff9640 1 -- 172.21.15.1:0/4093461121 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb500db070 con 0x5616948402e0 2024-09-19T09:45:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.480+0000 7fbb68070740 1 -- 172.21.15.1:0/4093461121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5616948402e0 msgr2=0x56169483a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:01.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.480+0000 7fbb68070740 1 --2- 172.21.15.1:0/4093461121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5616948402e0 0x56169483a0b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fbb50031470 tx=0x7fbb5002ae80 comp rx=0 tx=0).stop 2024-09-19T09:45:01.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.481+0000 7fbb68070740 1 -- 172.21.15.1:0/4093461121 shutdown_connections 2024-09-19T09:45:01.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.481+0000 7fbb68070740 1 --2- 172.21.15.1:0/4093461121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56169483ba60 0x56169485c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.481+0000 7fbb68070740 1 --2- 172.21.15.1:0/4093461121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561694845370 0x56169485c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.481+0000 7fbb68070740 1 --2- 172.21.15.1:0/4093461121 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5616948402e0 0x56169483a0b0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.481+0000 7fbb68070740 1 -- 172.21.15.1:0/4093461121 >> 172.21.15.1:0/4093461121 conn(0x56169483b010 msgr2=0x5616948399a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.481+0000 7fbb68070740 1 -- 172.21.15.1:0/4093461121 shutdown_connections 2024-09-19T09:45:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.481+0000 7fbb68070740 1 -- 172.21.15.1:0/4093461121 wait complete. 2024-09-19T09:45:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.482+0000 7fbb68070740 1 -- start start 2024-09-19T09:45:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.482+0000 7fbb68070740 1 Processor -- start 2024-09-19T09:45:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.482+0000 7fbb68070740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169483ba60 0x5616948691f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.482+0000 7fbb68070740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5616948402e0 0x561694869730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.482+0000 7fbb68070740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561694845370 0x561694867800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.482+0000 7fbb68070740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4400d310 con 0x5616948402e0 2024-09-19T09:45:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.482+0000 7fbb68070740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4400e780 con 0x56169483ba60 2024-09-19T09:45:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.482+0000 7fbb68070740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4400d9e0 con 0x561694845370 2024-09-19T09:45:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.482+0000 7fbb68070740 10 client.0 _ll_register_callbacks cb 0x7fbb500d4070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:45:01.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.483+0000 7fbb5f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561694845370 0x561694867800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.483+0000 7fbb5f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561694845370 0x561694867800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:49142/0 (socket says 172.21.15.1:49142) 2024-09-19T09:45:01.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.483+0000 7fbb5f7fe640 1 -- 172.21.15.1:0/389133318 learned_addr learned my addr 172.21.15.1:0/389133318 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:01.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.483+0000 7fbb5effd640 1 --2- 172.21.15.1:0/389133318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169483ba60 0x5616948691f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.484+0000 7fbb57fff640 1 --2- 172.21.15.1:0/389133318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5616948402e0 0x561694869730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.485+0000 7fbb5effd640 1 -- 172.21.15.1:0/389133318 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561694845370 msgr2=0x561694867800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:01.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.485+0000 7fbb5effd640 1 --2- 172.21.15.1:0/389133318 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561694845370 0x561694867800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.486+0000 7fbb5effd640 1 -- 172.21.15.1:0/389133318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5616948402e0 msgr2=0x561694869730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:01.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.486+0000 7fbb5effd640 1 --2- 172.21.15.1:0/389133318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5616948402e0 0x561694869730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:01.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.486+0000 7fbb5effd640 1 -- 172.21.15.1:0/389133318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561694867e70 con 0x56169483ba60 2024-09-19T09:45:01.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.486+0000 7fbb5effd640 1 --2- 172.21.15.1:0/389133318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169483ba60 0x5616948691f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbb5002aa30 tx=0x7fbb500bd5c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0f7472810e7c275 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:01.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.486+0000 7fbb4e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:45:01.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.488+0000 7fbb4e7fc640 1 -- 172.21.15.1:0/389133318 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb500d6040 con 0x56169483ba60 2024-09-19T09:45:01.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.488+0000 7fbb4e7fc640 1 -- 172.21.15.1:0/389133318 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fbb500d12f0 con 0x56169483ba60 2024-09-19T09:45:01.494 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.493+0000 7fbb68070740 1 -- 172.21.15.1:0/389133318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb500db070 con 0x56169483ba60 2024-09-19T09:45:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.497+0000 7fbb4e7fc640 1 -- 172.21.15.1:0/389133318 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbb500d1530 con 0x56169483ba60 2024-09-19T09:45:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.498+0000 7fbb68070740 10 client.25976 fetch_fsmap learned FSMap version 21 2024-09-19T09:45:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.498+0000 7fbb68070740 1 -- 172.21.15.1:0/389133318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561694867e70 con 0x56169483ba60 2024-09-19T09:45:01.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.504+0000 7fbb4e7fc640 1 -- 172.21.15.1:0/389133318 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb500db070 con 0x56169483ba60 2024-09-19T09:45:01.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.505+0000 7fbb4e7fc640 1 -- 172.21.15.1:0/389133318 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 21) ==== 8330+0+0 (secure 0 0 0) 0x7fbb500c1170 con 0x56169483ba60 2024-09-19T09:45:01.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.507+0000 7fbb68070740 10 client.25976 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T09:45:01.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.507+0000 7fbb68070740 10 client.25976 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:45:01.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.507+0000 7fbb68070740 20 client.25976 populate_metadata read hostname 'smithi001' 2024-09-19T09:45:01.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.507+0000 7fbb68070740 1 --2- 172.21.15.1:0/389133318 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5616948e5080 0x5616948e7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:01.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.507+0000 7fbb68070740 4 client.25976 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:45:01.509 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.507+0000 7fbb68070740 1 -- 172.21.15.1:0/389133318 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5616947aad70 con 0x5616948e5080 2024-09-19T09:45:01.512 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.511+0000 7fbb57fff640 1 --2- 172.21.15.1:0/389133318 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5616948e5080 0x5616948e7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:01.518 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.516+0000 7fbb57fff640 1 --2- 172.21.15.1:0/389133318 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5616948e5080 0x5616948e7470 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b26fe9ccd91963 server_cookie=1c6085f498737695 in_seq=0 out_seq=0 2024-09-19T09:45:01.518 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:01.517+0000 7fbb4e7fc640 10 client.25976 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:45:02.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:01 smithi022 ceph-mon[35583]: pgmap v547: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 76 MiB/s wr, 11.66k op/s 2024-09-19T09:45:02.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:01 smithi121 ceph-mon[35577]: pgmap v547: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 76 MiB/s wr, 11.66k op/s 2024-09-19T09:45:02.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:01 smithi001 ceph-mon[31225]: pgmap v547: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 76 MiB/s wr, 11.66k op/s 2024-09-19T09:45:03.765 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:03.763+0000 7fbb4e7fc640 1 -- 172.21.15.1:0/389133318 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5616947aad70 con 0x5616948e5080 2024-09-19T09:45:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:03.763+0000 7fbb4e7fc640 10 client.25976 handle_command_reply: tid=0 2024-09-19T09:45:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:03.763+0000 7fbb68070740 1 client.25976 shutdown 2024-09-19T09:45:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:03.763+0000 7fbb68070740 1 -- 172.21.15.1:0/389133318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169483ba60 msgr2=0x5616948691f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:03.763+0000 7fbb68070740 1 --2- 172.21.15.1:0/389133318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169483ba60 0x5616948691f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbb5002aa30 tx=0x7fbb500bd5c0 comp rx=0 tx=0).stop 2024-09-19T09:45:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:03.763+0000 7fbb68070740 1 -- 172.21.15.1:0/389133318 shutdown_connections 2024-09-19T09:45:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:03.763+0000 7fbb68070740 1 --2- 172.21.15.1:0/389133318 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5616948e5080 0x5616948e7470 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:03.763+0000 7fbb68070740 1 --2- 172.21.15.1:0/389133318 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561694845370 0x561694867800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:03.763+0000 7fbb68070740 1 --2- 172.21.15.1:0/389133318 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5616948402e0 0x561694869730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:03.763+0000 7fbb68070740 1 --2- 172.21.15.1:0/389133318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56169483ba60 0x5616948691f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:03.763+0000 7fbb68070740 1 -- 172.21.15.1:0/389133318 >> 172.21.15.1:0/389133318 conn(0x56169483b010 msgr2=0x5616948399a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:03.763+0000 7fbb4e7fc640 0 client.25976 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:45:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:03.763+0000 7fbb68070740 1 -- 172.21.15.1:0/389133318 shutdown_connections 2024-09-19T09:45:03.766 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:03.763+0000 7fbb68070740 1 -- 172.21.15.1:0/389133318 wait complete. 2024-09-19T09:45:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:03.763+0000 7fbb68070740 20 client.25976 trim_cache size 0 max 16384 2024-09-19T09:45:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:45:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:45:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:45:03.767 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:45:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:03.764+0000 7fbb652d7640 1 -- 172.21.15.1:0/1023370678 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbb400a3450 msgr2=0x7fbb400a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:03.764+0000 7fbb652d7640 1 --2- 172.21.15.1:0/1023370678 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbb400a3450 0x7fbb400a5910 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800ab50 tx=0x7fbb58009250 comp rx=0 tx=0).stop 2024-09-19T09:45:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:03.764+0000 7fbb652d7640 1 -- 172.21.15.1:0/1023370678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb60072d10 msgr2=0x7fbb60116de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:03.764+0000 7fbb652d7640 1 --2- 172.21.15.1:0/1023370678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb60072d10 0x7fbb60116de0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fbb50009850 tx=0x7fbb50032bf0 comp rx=0 tx=0).stop 2024-09-19T09:45:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:03.765+0000 7fbb652d7640 1 -- 172.21.15.1:0/1023370678 shutdown_connections 2024-09-19T09:45:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:03.765+0000 7fbb652d7640 1 --2- 172.21.15.1:0/1023370678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb60109700 0x7fbb60118360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:03.765+0000 7fbb652d7640 1 --2- 172.21.15.1:0/1023370678 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbb400a3450 0x7fbb400a5910 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:03.765+0000 7fbb652d7640 1 --2- 172.21.15.1:0/1023370678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb600736b0 0x7fbb60117320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:03.765+0000 7fbb652d7640 1 --2- 172.21.15.1:0/1023370678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb60072d10 0x7fbb60116de0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:03.765+0000 7fbb652d7640 1 -- 172.21.15.1:0/1023370678 >> 172.21.15.1:0/1023370678 conn(0x7fbb6006ecd0 msgr2=0x7fbb6010c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:03.769 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:03.765+0000 7fbb652d7640 1 -- 172.21.15.1:0/1023370678 shutdown_connections 2024-09-19T09:45:03.770 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:03.765+0000 7fbb652d7640 1 -- 172.21.15.1:0/1023370678 wait complete. 2024-09-19T09:45:03.840 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:45:03.883 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:45:04.041 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:03 smithi001 ceph-mon[31225]: pgmap v548: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 73 MiB/s wr, 11.05k op/s 2024-09-19T09:45:04.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:03 smithi022 ceph-mon[35583]: pgmap v548: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 73 MiB/s wr, 11.05k op/s 2024-09-19T09:45:04.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:03 smithi121 ceph-mon[35577]: pgmap v548: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 73 MiB/s wr, 11.05k op/s 2024-09-19T09:45:06.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:05 smithi022 ceph-mon[35583]: pgmap v549: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 73 MiB/s wr, 10.90k op/s 2024-09-19T09:45:06.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:05 smithi121 ceph-mon[35577]: pgmap v549: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 73 MiB/s wr, 10.90k op/s 2024-09-19T09:45:06.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:05 smithi001 ceph-mon[31225]: pgmap v549: 97 pgs: 97 active+clean; 13 GiB data, 41 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 73 MiB/s wr, 10.90k op/s 2024-09-19T09:45:08.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:07 smithi022 ceph-mon[35583]: pgmap v550: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 65 MiB/s wr, 9.71k op/s 2024-09-19T09:45:08.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:07 smithi121 ceph-mon[35577]: pgmap v550: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 65 MiB/s wr, 9.71k op/s 2024-09-19T09:45:08.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:07 smithi001 ceph-mon[31225]: pgmap v550: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 65 MiB/s wr, 9.71k op/s 2024-09-19T09:45:10.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:09 smithi022 ceph-mon[35583]: pgmap v551: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 90 MiB/s wr, 13.50k op/s 2024-09-19T09:45:10.115 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:09 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/3919024073' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:45:10.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:09 smithi121 ceph-mon[35577]: pgmap v551: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 90 MiB/s wr, 13.50k op/s 2024-09-19T09:45:10.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:09 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/3919024073' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:45:10.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:09 smithi001 ceph-mon[31225]: pgmap v551: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 90 MiB/s wr, 13.50k op/s 2024-09-19T09:45:10.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:09 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/3919024073' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:45:10.290 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:45:10.290 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T09:44:50:770090+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":16287,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6839/1975960689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":1975960689},{"type":"v1","addr":"172.21.15.121:6839","nonce":1975960689}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:44:50.770010+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24479":{"gid":24479,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:45:10.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.863+0000 7f8b69326640 1 -- 172.21.15.1:0/4260805678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b64108300 msgr2=0x7f8b6410ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:10.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.863+0000 7f8b69326640 1 --2- 172.21.15.1:0/4260805678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b64108300 0x7f8b6410ec70 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c009cd0 tx=0x7f8b5c02a8d0 comp rx=0 tx=0).stop 2024-09-19T09:45:10.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.863+0000 7f8b69326640 1 -- 172.21.15.1:0/4260805678 shutdown_connections 2024-09-19T09:45:10.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.863+0000 7f8b69326640 1 --2- 172.21.15.1:0/4260805678 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b64108300 0x7f8b6410ec70 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:10.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.863+0000 7f8b69326640 1 --2- 172.21.15.1:0/4260805678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b64103780 0x7f8b64107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:10.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.863+0000 7f8b69326640 1 --2- 172.21.15.1:0/4260805678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b64102dd0 0x7f8b641031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:10.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.863+0000 7f8b69326640 1 -- 172.21.15.1:0/4260805678 >> 172.21.15.1:0/4260805678 conn(0x7f8b640fc7d0 msgr2=0x7f8b640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:10.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.864+0000 7f8b69326640 1 -- 172.21.15.1:0/4260805678 shutdown_connections 2024-09-19T09:45:10.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.864+0000 7f8b69326640 1 -- 172.21.15.1:0/4260805678 wait complete. 2024-09-19T09:45:10.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.864+0000 7f8b69326640 1 Processor -- start 2024-09-19T09:45:10.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.864+0000 7f8b69326640 1 -- start start 2024-09-19T09:45:10.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.864+0000 7f8b69326640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b64102dd0 0x7f8b64198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:10.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.864+0000 7f8b69326640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b64103780 0x7f8b64198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:10.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.864+0000 7f8b69326640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b64108300 0x7f8b6419ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:10.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.864+0000 7f8b69326640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8b641120d0 con 0x7f8b64102dd0 2024-09-19T09:45:10.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.864+0000 7f8b69326640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8b64111f50 con 0x7f8b64108300 2024-09-19T09:45:10.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.864+0000 7f8b69326640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8b64112250 con 0x7f8b64103780 2024-09-19T09:45:10.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.864+0000 7f8b62ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b64102dd0 0x7f8b64198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:10.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.864+0000 7f8b62ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b64102dd0 0x7f8b64198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:39670/0 (socket says 172.21.15.1:39670) 2024-09-19T09:45:10.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.865+0000 7f8b62ffd640 1 -- 172.21.15.1:0/3919024073 learned_addr learned my addr 172.21.15.1:0/3919024073 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:10.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.865+0000 7f8b637fe640 1 --2- 172.21.15.1:0/3919024073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b64108300 0x7f8b6419ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:10.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.865+0000 7f8b627fc640 1 --2- 172.21.15.1:0/3919024073 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b64103780 0x7f8b64198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:10.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.865+0000 7f8b62ffd640 1 -- 172.21.15.1:0/3919024073 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b64103780 msgr2=0x7f8b64198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:10.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.865+0000 7f8b62ffd640 1 --2- 172.21.15.1:0/3919024073 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b64103780 0x7f8b64198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:10.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.865+0000 7f8b62ffd640 1 -- 172.21.15.1:0/3919024073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b64108300 msgr2=0x7f8b6419ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:10.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.865+0000 7f8b62ffd640 1 --2- 172.21.15.1:0/3919024073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b64108300 0x7f8b6419ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:10.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.865+0000 7f8b62ffd640 1 -- 172.21.15.1:0/3919024073 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b6419d530 con 0x7f8b64102dd0 2024-09-19T09:45:10.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.865+0000 7f8b62ffd640 1 --2- 172.21.15.1:0/3919024073 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b64102dd0 0x7f8b64198580 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400d950 tx=0x7f8b5400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:10.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.865+0000 7f8b4bfff640 1 -- 172.21.15.1:0/3919024073 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b54017070 con 0x7f8b64102dd0 2024-09-19T09:45:10.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.865+0000 7f8b4bfff640 1 -- 172.21.15.1:0/3919024073 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b54009c30 con 0x7f8b64102dd0 2024-09-19T09:45:10.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.865+0000 7f8b69326640 1 -- 172.21.15.1:0/3919024073 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b6419d820 con 0x7f8b64102dd0 2024-09-19T09:45:10.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.865+0000 7f8b4bfff640 1 -- 172.21.15.1:0/3919024073 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5400f6b0 con 0x7f8b64102dd0 2024-09-19T09:45:10.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.865+0000 7f8b69326640 1 -- 172.21.15.1:0/3919024073 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b641a5100 con 0x7f8b64102dd0 2024-09-19T09:45:10.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.866+0000 7f8b69326640 1 -- 172.21.15.1:0/3919024073 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b641031b0 con 0x7f8b64102dd0 2024-09-19T09:45:10.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.868+0000 7f8b4bfff640 1 -- 172.21.15.1:0/3919024073 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f8b540109d0 con 0x7f8b64102dd0 2024-09-19T09:45:10.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.868+0000 7f8b4bfff640 1 --2- 172.21.15.1:0/3919024073 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f8b4c0a3240 0x7f8b4c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:10.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.868+0000 7f8b627fc640 1 --2- 172.21.15.1:0/3919024073 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f8b4c0a3240 0x7f8b4c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:10.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.868+0000 7f8b4bfff640 1 -- 172.21.15.1:0/3919024073 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f8b540cf4a0 con 0x7f8b64102dd0 2024-09-19T09:45:10.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.869+0000 7f8b627fc640 1 --2- 172.21.15.1:0/3919024073 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f8b4c0a3240 0x7f8b4c0a5700 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8b640fee70 tx=0x7f8b58005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:10.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:08.872+0000 7f8b4bfff640 1 -- 172.21.15.1:0/3919024073 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8b54009de0 con 0x7f8b64102dd0 2024-09-19T09:45:10.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:09.168+0000 7f8b69326640 1 -- 172.21.15.1:0/3919024073 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b6410a290 con 0x7f8b64102dd0 2024-09-19T09:45:10.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:09.168+0000 7f8b4bfff640 1 -- 172.21.15.1:0/3919024073 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11838 (secure 0 0 0) 0x7f8b5409bb70 con 0x7f8b64102dd0 2024-09-19T09:45:10.293 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T09:45:10.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:09.170+0000 7f8b69326640 1 -- 172.21.15.1:0/3919024073 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f8b4c0a3240 msgr2=0x7f8b4c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:10.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:09.171+0000 7f8b69326640 1 --2- 172.21.15.1:0/3919024073 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f8b4c0a3240 0x7f8b4c0a5700 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8b640fee70 tx=0x7f8b58005f90 comp rx=0 tx=0).stop 2024-09-19T09:45:10.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:09.171+0000 7f8b69326640 1 -- 172.21.15.1:0/3919024073 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b64102dd0 msgr2=0x7f8b64198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:10.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:09.171+0000 7f8b69326640 1 --2- 172.21.15.1:0/3919024073 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b64102dd0 0x7f8b64198580 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400d950 tx=0x7f8b5400de10 comp rx=0 tx=0).stop 2024-09-19T09:45:10.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:09.171+0000 7f8b69326640 1 -- 172.21.15.1:0/3919024073 shutdown_connections 2024-09-19T09:45:10.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:09.171+0000 7f8b69326640 1 --2- 172.21.15.1:0/3919024073 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f8b4c0a3240 0x7f8b4c0a5700 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:10.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:09.171+0000 7f8b69326640 1 --2- 172.21.15.1:0/3919024073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b64108300 0x7f8b6419ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:10.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:09.171+0000 7f8b69326640 1 --2- 172.21.15.1:0/3919024073 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b64103780 0x7f8b64198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:10.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:09.171+0000 7f8b69326640 1 --2- 172.21.15.1:0/3919024073 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b64102dd0 0x7f8b64198580 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:10.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:09.171+0000 7f8b69326640 1 -- 172.21.15.1:0/3919024073 >> 172.21.15.1:0/3919024073 conn(0x7f8b640fc7d0 msgr2=0x7f8b64105e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:10.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:09.171+0000 7f8b69326640 1 -- 172.21.15.1:0/3919024073 shutdown_connections 2024-09-19T09:45:10.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:09.171+0000 7f8b69326640 1 -- 172.21.15.1:0/3919024073 wait complete. 2024-09-19T09:45:12.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:11 smithi022 ceph-mon[35583]: pgmap v552: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 72 MiB/s wr, 10.62k op/s 2024-09-19T09:45:12.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:11 smithi121 ceph-mon[35577]: pgmap v552: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 72 MiB/s wr, 10.62k op/s 2024-09-19T09:45:12.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:11 smithi001 ceph-mon[31225]: pgmap v552: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 72 MiB/s wr, 10.62k op/s 2024-09-19T09:45:14.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:13 smithi022 ceph-mon[35583]: pgmap v553: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 75 MiB/s wr, 10.98k op/s 2024-09-19T09:45:14.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:13 smithi121 ceph-mon[35577]: pgmap v553: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 75 MiB/s wr, 10.98k op/s 2024-09-19T09:45:14.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:13 smithi001 ceph-mon[31225]: pgmap v553: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 75 MiB/s wr, 10.98k op/s 2024-09-19T09:45:16.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:15 smithi022 ceph-mon[35583]: pgmap v554: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 87 MiB/s wr, 12.62k op/s 2024-09-19T09:45:16.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:15 smithi121 ceph-mon[35577]: pgmap v554: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 87 MiB/s wr, 12.62k op/s 2024-09-19T09:45:16.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:15 smithi001 ceph-mon[31225]: pgmap v554: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 87 MiB/s wr, 12.62k op/s 2024-09-19T09:45:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.930+0000 7fa1e709b640 1 -- 172.21.15.1:0/2560395926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1e01025e0 msgr2=0x7fa1e0108e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.930+0000 7fa1e709b640 1 --2- 172.21.15.1:0/2560395926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1e01025e0 0x7fa1e0108e70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8009be0 tx=0x7fa1d802a710 comp rx=0 tx=0).stop 2024-09-19T09:45:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.931+0000 7fa1e709b640 1 -- 172.21.15.1:0/2560395926 shutdown_connections 2024-09-19T09:45:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.931+0000 7fa1e709b640 1 --2- 172.21.15.1:0/2560395926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1e01025e0 0x7fa1e0108e70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.931+0000 7fa1e709b640 1 --2- 172.21.15.1:0/2560395926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1e0101c20 0x7fa1e01020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.931+0000 7fa1e709b640 1 --2- 172.21.15.1:0/2560395926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1e0100a30 0x7fa1e0100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.931+0000 7fa1e709b640 1 -- 172.21.15.1:0/2560395926 >> 172.21.15.1:0/2560395926 conn(0x7fa1e00fc190 msgr2=0x7fa1e00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.932+0000 7fa1e709b640 1 -- 172.21.15.1:0/2560395926 shutdown_connections 2024-09-19T09:45:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.932+0000 7fa1e709b640 1 -- 172.21.15.1:0/2560395926 wait complete. 2024-09-19T09:45:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.933+0000 7fa1e709b640 1 Processor -- start 2024-09-19T09:45:16.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.934+0000 7fa1e709b640 1 -- start start 2024-09-19T09:45:16.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.934+0000 7fa1e709b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1e0100a30 0x7fa1e019e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:16.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.934+0000 7fa1e709b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1e0101c20 0x7fa1e019e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:16.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.934+0000 7fa1e709b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1e01025e0 0x7fa1e01a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:16.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.934+0000 7fa1e709b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e010b5b0 con 0x7fa1e0100a30 2024-09-19T09:45:16.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.934+0000 7fa1e709b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e010b430 con 0x7fa1e01025e0 2024-09-19T09:45:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.934+0000 7fa1e709b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e010b730 con 0x7fa1e0101c20 2024-09-19T09:45:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.934+0000 7fa1e4e37640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1e0100a30 0x7fa1e019e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.934+0000 7fa1e4e37640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1e0100a30 0x7fa1e019e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32936/0 (socket says 172.21.15.1:32936) 2024-09-19T09:45:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.934+0000 7fa1e4e37640 1 -- 172.21.15.1:0/1266283426 learned_addr learned my addr 172.21.15.1:0/1266283426 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.934+0000 7fa1e5638640 1 --2- 172.21.15.1:0/1266283426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1e01025e0 0x7fa1e01a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.935+0000 7fa1dffff640 1 --2- 172.21.15.1:0/1266283426 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1e0101c20 0x7fa1e019e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.935+0000 7fa1e5638640 1 -- 172.21.15.1:0/1266283426 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1e0101c20 msgr2=0x7fa1e019e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.935+0000 7fa1e5638640 1 --2- 172.21.15.1:0/1266283426 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1e0101c20 0x7fa1e019e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.935+0000 7fa1e5638640 1 -- 172.21.15.1:0/1266283426 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1e0100a30 msgr2=0x7fa1e019e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.935+0000 7fa1e5638640 1 --2- 172.21.15.1:0/1266283426 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1e0100a30 0x7fa1e019e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.935+0000 7fa1e5638640 1 -- 172.21.15.1:0/1266283426 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e01959d0 con 0x7fa1e01025e0 2024-09-19T09:45:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.935+0000 7fa1e5638640 1 --2- 172.21.15.1:0/1266283426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1e01025e0 0x7fa1e01a5a40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8034040 tx=0x7fa1d8030e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.936+0000 7fa1ddffb640 1 -- 172.21.15.1:0/1266283426 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8041020 con 0x7fa1e01025e0 2024-09-19T09:45:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.936+0000 7fa1ddffb640 1 -- 172.21.15.1:0/1266283426 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1d8031920 con 0x7fa1e01025e0 2024-09-19T09:45:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.936+0000 7fa1ddffb640 1 -- 172.21.15.1:0/1266283426 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8036040 con 0x7fa1e01025e0 2024-09-19T09:45:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.936+0000 7fa1e709b640 1 -- 172.21.15.1:0/1266283426 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1e0195c60 con 0x7fa1e01025e0 2024-09-19T09:45:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.936+0000 7fa1e709b640 1 -- 172.21.15.1:0/1266283426 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1e01960d0 con 0x7fa1e01025e0 2024-09-19T09:45:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.939+0000 7fa1ddffb640 1 -- 172.21.15.1:0/1266283426 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fa1d8044020 con 0x7fa1e01025e0 2024-09-19T09:45:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.939+0000 7fa1e9e34740 1 Processor -- start 2024-09-19T09:45:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.939+0000 7fa1e9e34740 1 -- start start 2024-09-19T09:45:16.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.939+0000 7fa1ddffb640 1 --2- 172.21.15.1:0/1266283426 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fa1c80a3300 0x7fa1c80a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:16.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.939+0000 7fa1e9e34740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee9efd69a0 0x55ee9efd6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:16.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.939+0000 7fa1dffff640 1 --2- 172.21.15.1:0/1266283426 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fa1c80a3300 0x7fa1c80a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:16.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.939+0000 7fa1ddffb640 1 -- 172.21.15.1:0/1266283426 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fa1d80f0000 con 0x7fa1e01025e0 2024-09-19T09:45:16.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.940+0000 7fa1e9e34740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee9efd72e0 0x55ee9efdbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:16.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.940+0000 7fa1e9e34740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee9efdc370 0x55ee9efde830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:16.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.940+0000 7fa1e9e34740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ee9ef3a2f0 con 0x55ee9efd72e0 2024-09-19T09:45:16.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.940+0000 7fa1e9e34740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ee9eee2270 con 0x55ee9efdc370 2024-09-19T09:45:16.953 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.940+0000 7fa1e9e34740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ee9ef362b0 con 0x55ee9efd69a0 2024-09-19T09:45:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.940+0000 7fa1e5638640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee9efdc370 0x55ee9efde830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.940+0000 7fa1dffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee9efd72e0 0x55ee9efdbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.940+0000 7fa1e4e37640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee9efd69a0 0x55ee9efd6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.940+0000 7fa1e5638640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee9efdc370 0x55ee9efde830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:45290/0 (socket says 172.21.15.1:45290) 2024-09-19T09:45:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.940+0000 7fa1e5638640 1 -- 172.21.15.1:0/3255084146 learned_addr learned my addr 172.21.15.1:0/3255084146 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.940+0000 7fa1dffff640 1 --2- 172.21.15.1:0/1266283426 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fa1c80a3300 0x7fa1c80a57c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa1e019f9a0 tx=0x7fa1d00117b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.940+0000 7fa1e4e37640 1 -- 172.21.15.1:0/3255084146 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee9efdc370 msgr2=0x55ee9efde830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.940+0000 7fa1e4e37640 1 --2- 172.21.15.1:0/3255084146 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee9efdc370 0x55ee9efde830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.940+0000 7fa1e4e37640 1 -- 172.21.15.1:0/3255084146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee9efd72e0 msgr2=0x55ee9efdbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.940+0000 7fa1e4e37640 1 --2- 172.21.15.1:0/3255084146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee9efd72e0 0x55ee9efdbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.940+0000 7fa1e4e37640 1 -- 172.21.15.1:0/3255084146 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee9eee1340 con 0x55ee9efd69a0 2024-09-19T09:45:16.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.940+0000 7fa1e4e37640 1 --2- 172.21.15.1:0/3255084146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee9efd69a0 0x55ee9efd6da0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa1d400bc90 tx=0x7fa1d40107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9c401d1df9abea0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:16.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.940+0000 7fa1c6ffd640 1 -- 172.21.15.1:0/3255084146 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4004220 con 0x55ee9efd69a0 2024-09-19T09:45:16.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.941+0000 7fa1c6ffd640 1 -- 172.21.15.1:0/3255084146 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1d400be40 con 0x55ee9efd69a0 2024-09-19T09:45:16.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.941+0000 7fa1c6ffd640 1 -- 172.21.15.1:0/3255084146 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4004d20 con 0x55ee9efd69a0 2024-09-19T09:45:16.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.941+0000 7fa1e9e34740 1 -- 172.21.15.1:0/3255084146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee9efd69a0 msgr2=0x55ee9efd6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:16.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.941+0000 7fa1e9e34740 1 --2- 172.21.15.1:0/3255084146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee9efd69a0 0x55ee9efd6da0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa1d400bc90 tx=0x7fa1d40107a0 comp rx=0 tx=0).stop 2024-09-19T09:45:16.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.941+0000 7fa1e9e34740 1 -- 172.21.15.1:0/3255084146 shutdown_connections 2024-09-19T09:45:16.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.941+0000 7fa1e9e34740 1 --2- 172.21.15.1:0/3255084146 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee9efdc370 0x55ee9efde830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:16.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.941+0000 7fa1e9e34740 1 --2- 172.21.15.1:0/3255084146 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee9efd72e0 0x55ee9efdbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:16.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.941+0000 7fa1e9e34740 1 --2- 172.21.15.1:0/3255084146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee9efd69a0 0x55ee9efd6da0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:16.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.941+0000 7fa1e9e34740 1 -- 172.21.15.1:0/3255084146 >> 172.21.15.1:0/3255084146 conn(0x55ee9efd2010 msgr2=0x55ee9efd2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:16.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.941+0000 7fa1e9e34740 1 -- 172.21.15.1:0/3255084146 shutdown_connections 2024-09-19T09:45:16.955 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.941+0000 7fa1e9e34740 1 -- 172.21.15.1:0/3255084146 wait complete. 2024-09-19T09:45:16.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.942+0000 7fa1e9e34740 1 -- start start 2024-09-19T09:45:16.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.942+0000 7fa1e9e34740 1 Processor -- start 2024-09-19T09:45:16.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.942+0000 7fa1e9e34740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee9efd69a0 0x55ee9efe0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:16.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.942+0000 7fa1e9e34740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee9efd72e0 0x55ee9efe1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:16.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.942+0000 7fa1e4e37640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee9efd69a0 0x55ee9efe0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:16.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.942+0000 7fa1e4e37640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee9efd69a0 0x55ee9efe0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32956/0 (socket says 172.21.15.1:32956) 2024-09-19T09:45:16.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.942+0000 7fa1e9e34740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee9efdc370 0x55ee9efe80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:16.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.942+0000 7fa1e4e37640 1 -- 172.21.15.1:0/3028528311 learned_addr learned my addr 172.21.15.1:0/3028528311 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:16.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.942+0000 7fa1e9e34740 1 -- 172.21.15.1:0/3028528311 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55ee9efdf340 con 0x55ee9efd69a0 2024-09-19T09:45:16.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.942+0000 7fa1e9e34740 1 -- 172.21.15.1:0/3028528311 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ee9eec3290 con 0x55ee9efd72e0 2024-09-19T09:45:16.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.942+0000 7fa1e9e34740 1 -- 172.21.15.1:0/3028528311 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ee9efdf4c0 con 0x55ee9efdc370 2024-09-19T09:45:16.956 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.942+0000 7fa1dffff640 1 --2- 172.21.15.1:0/3028528311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee9efd72e0 0x55ee9efe1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:16.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.942+0000 7fa1e9e34740 10 client.0 _ll_register_callbacks cb 0x55ee9eef4140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:45:16.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.942+0000 7fa1e4e37640 1 -- 172.21.15.1:0/3028528311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee9efdc370 msgr2=0x55ee9efe80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:16.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.942+0000 7fa1e4e37640 1 --2- 172.21.15.1:0/3028528311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee9efdc370 0x55ee9efe80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:16.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.942+0000 7fa1e4e37640 1 -- 172.21.15.1:0/3028528311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee9efd72e0 msgr2=0x55ee9efe1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:16.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.942+0000 7fa1e4e37640 1 --2- 172.21.15.1:0/3028528311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee9efd72e0 0x55ee9efe1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:16.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.942+0000 7fa1e4e37640 1 -- 172.21.15.1:0/3028528311 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee9ec4d210 con 0x55ee9efd69a0 2024-09-19T09:45:16.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.942+0000 7fa1e9e34740 1 -- 172.21.15.1:0/3028528311 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ee9ef47a20 con 0x55ee9efd69a0 2024-09-19T09:45:16.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.943+0000 7fa1e4e37640 1 --2- 172.21.15.1:0/3028528311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee9efd69a0 0x55ee9efe0b30 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa1d400bc60 tx=0x7fa1d400b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daef587bc37a78e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:16.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.943+0000 7fa1bffff640 10 client.16323 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:45:16.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.943+0000 7fa1bffff640 1 -- 172.21.15.1:0/3028528311 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d402b060 con 0x55ee9efd69a0 2024-09-19T09:45:16.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.943+0000 7fa1bffff640 1 -- 172.21.15.1:0/3028528311 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fa1d401ca00 con 0x55ee9efd69a0 2024-09-19T09:45:16.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.943+0000 7fa1bffff640 1 -- 172.21.15.1:0/3028528311 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa1d401cc20 con 0x55ee9efd69a0 2024-09-19T09:45:16.957 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.943+0000 7fa1e9e34740 10 client.16323 fetch_fsmap learned FSMap version 21 2024-09-19T09:45:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.943+0000 7fa1e9e34740 1 -- 172.21.15.1:0/3028528311 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({fsmap=21}) -- 0x55ee9ed19620 con 0x55ee9efd69a0 2024-09-19T09:45:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.943+0000 7fa1bffff640 1 -- 172.21.15.1:0/3028528311 <== mon.0 v2:172.21.15.1:3300/0 4 ==== fsmap(e 21) ==== 8330+0+0 (secure 0 0 0) 0x7fa1d4026470 con 0x55ee9efd69a0 2024-09-19T09:45:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.943+0000 7fa1e9e34740 10 client.16323 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T09:45:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.943+0000 7fa1e9e34740 10 client.16323 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:45:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.943+0000 7fa1e9e34740 20 client.16323 populate_metadata read hostname 'smithi001' 2024-09-19T09:45:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.943+0000 7fa1e9e34740 1 --2- 172.21.15.1:0/3028528311 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55ee9efec370 0x55ee9efee760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.943+0000 7fa1e9e34740 4 client.16323 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:45:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.943+0000 7fa1e9e34740 1 -- 172.21.15.1:0/3028528311 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee9ef41d70 con 0x55ee9efec370 2024-09-19T09:45:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.944+0000 7fa1dffff640 1 --2- 172.21.15.1:0/3028528311 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55ee9efec370 0x55ee9efee760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.944+0000 7fa1dffff640 1 --2- 172.21.15.1:0/3028528311 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55ee9efec370 0x55ee9efee760 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fd92569d2ea70f6 server_cookie=cfc21bdc626148d6 in_seq=0 out_seq=0 2024-09-19T09:45:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.944+0000 7fa1bffff640 10 client.16323 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:45:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.945+0000 7fa1bffff640 1 -- 172.21.15.1:0/3028528311 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ee9ef41d70 con 0x55ee9efec370 2024-09-19T09:45:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.945+0000 7fa1bffff640 10 client.16323 handle_command_reply: tid=0 2024-09-19T09:45:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.945+0000 7fa1e9e34740 1 client.16323 shutdown 2024-09-19T09:45:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.945+0000 7fa1e9e34740 1 -- 172.21.15.1:0/3028528311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee9efd69a0 msgr2=0x55ee9efe0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.945+0000 7fa1e9e34740 1 --2- 172.21.15.1:0/3028528311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee9efd69a0 0x55ee9efe0b30 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa1d400bc60 tx=0x7fa1d400b9e0 comp rx=0 tx=0).stop 2024-09-19T09:45:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.945+0000 7fa1e9e34740 1 -- 172.21.15.1:0/3028528311 shutdown_connections 2024-09-19T09:45:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.945+0000 7fa1e9e34740 1 --2- 172.21.15.1:0/3028528311 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55ee9efec370 0x55ee9efee760 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.945+0000 7fa1bffff640 0 client.16323 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:45:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.945+0000 7fa1e9e34740 1 --2- 172.21.15.1:0/3028528311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee9efdc370 0x55ee9efe80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.945+0000 7fa1e9e34740 1 --2- 172.21.15.1:0/3028528311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee9efd72e0 0x55ee9efe1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.945+0000 7fa1e9e34740 1 --2- 172.21.15.1:0/3028528311 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee9efd69a0 0x55ee9efe0b30 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.945+0000 7fa1e9e34740 1 -- 172.21.15.1:0/3028528311 >> 172.21.15.1:0/3028528311 conn(0x55ee9efd2010 msgr2=0x55ee9efd3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.945+0000 7fa1e9e34740 1 -- 172.21.15.1:0/3028528311 shutdown_connections 2024-09-19T09:45:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.945+0000 7fa1e9e34740 1 -- 172.21.15.1:0/3028528311 wait complete. 2024-09-19T09:45:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.945+0000 7fa1e9e34740 20 client.16323 trim_cache size 0 max 16384 2024-09-19T09:45:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.959+0000 7fa1e9e34740 1 Processor -- start 2024-09-19T09:45:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.959+0000 7fa1e9e34740 1 -- start start 2024-09-19T09:45:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.960+0000 7fa1e9e34740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee9efd69a0 0x55ee9efe1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.960+0000 7fa1e9e34740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee9efd72e0 0x55ee9efe8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.960+0000 7fa1e9e34740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee9efdc370 0x55ee9efd23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.960+0000 7fa1e9e34740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e019d050 con 0x55ee9efd72e0 2024-09-19T09:45:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.960+0000 7fa1e9e34740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e01b87e0 con 0x55ee9efdc370 2024-09-19T09:45:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.960+0000 7fa1e9e34740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e019d6e0 con 0x55ee9efd69a0 2024-09-19T09:45:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.960+0000 7fa1e4e37640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee9efd69a0 0x55ee9efe1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.960+0000 7fa1dffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee9efd72e0 0x55ee9efe8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.960+0000 7fa1e4e37640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee9efd69a0 0x55ee9efe1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:60182/0 (socket says 172.21.15.1:60182) 2024-09-19T09:45:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.960+0000 7fa1e4e37640 1 -- 172.21.15.1:0/2405717791 learned_addr learned my addr 172.21.15.1:0/2405717791 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.960+0000 7fa1e5638640 1 --2- 172.21.15.1:0/2405717791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee9efdc370 0x55ee9efd23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.960+0000 7fa1e4e37640 1 -- 172.21.15.1:0/2405717791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee9efdc370 msgr2=0x55ee9efd23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.960+0000 7fa1e4e37640 1 --2- 172.21.15.1:0/2405717791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee9efdc370 0x55ee9efd23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.960+0000 7fa1e4e37640 1 -- 172.21.15.1:0/2405717791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee9efd72e0 msgr2=0x55ee9efe8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.960+0000 7fa1e4e37640 1 --2- 172.21.15.1:0/2405717791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee9efd72e0 0x55ee9efe8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.960+0000 7fa1e4e37640 1 -- 172.21.15.1:0/2405717791 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee9efd7f70 con 0x55ee9efd69a0 2024-09-19T09:45:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.960+0000 7fa1dffff640 1 --2- 172.21.15.1:0/2405717791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee9efd72e0 0x55ee9efe8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:45:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.960+0000 7fa1e4e37640 1 --2- 172.21.15.1:0/2405717791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee9efd69a0 0x55ee9efe1100 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa1d400ba20 tx=0x7fa1d401e070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=399be9bfefaf8fe4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.961+0000 7fa1c67fc640 1 -- 172.21.15.1:0/2405717791 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4026ac0 con 0x55ee9efd69a0 2024-09-19T09:45:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.961+0000 7fa1c67fc640 1 -- 172.21.15.1:0/2405717791 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55ee9ef47a20 con 0x55ee9efd69a0 2024-09-19T09:45:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.961+0000 7fa1c67fc640 1 -- 172.21.15.1:0/2405717791 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4005330 con 0x55ee9efd69a0 2024-09-19T09:45:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.961+0000 7fa1e9e34740 1 -- 172.21.15.1:0/2405717791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee9efd69a0 msgr2=0x55ee9efe1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.961+0000 7fa1e9e34740 1 --2- 172.21.15.1:0/2405717791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee9efd69a0 0x55ee9efe1100 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa1d400ba20 tx=0x7fa1d401e070 comp rx=0 tx=0).stop 2024-09-19T09:45:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.961+0000 7fa1e9e34740 1 -- 172.21.15.1:0/2405717791 shutdown_connections 2024-09-19T09:45:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.961+0000 7fa1e9e34740 1 --2- 172.21.15.1:0/2405717791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee9efdc370 0x55ee9efd23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.961+0000 7fa1e9e34740 1 --2- 172.21.15.1:0/2405717791 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee9efd72e0 0x55ee9efe8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.961+0000 7fa1e9e34740 1 --2- 172.21.15.1:0/2405717791 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee9efd69a0 0x55ee9efe1100 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.961+0000 7fa1e9e34740 1 -- 172.21.15.1:0/2405717791 >> 172.21.15.1:0/2405717791 conn(0x55ee9efd2010 msgr2=0x55ee9efd09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.961+0000 7fa1e9e34740 1 -- 172.21.15.1:0/2405717791 shutdown_connections 2024-09-19T09:45:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.961+0000 7fa1e9e34740 1 -- 172.21.15.1:0/2405717791 wait complete. 2024-09-19T09:45:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.962+0000 7fa1e9e34740 1 -- start start 2024-09-19T09:45:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.962+0000 7fa1e9e34740 1 Processor -- start 2024-09-19T09:45:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.962+0000 7fa1e9e34740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee9efd69a0 0x55ee9efe7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.962+0000 7fa1e9e34740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee9efd72e0 0x55ee9efe7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.962+0000 7fa1e9e34740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee9efdc370 0x55ee9efe5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.962+0000 7fa1e9e34740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e019ddb0 con 0x55ee9efd69a0 2024-09-19T09:45:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.962+0000 7fa1e9e34740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e01b8110 con 0x55ee9efdc370 2024-09-19T09:45:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.962+0000 7fa1e9e34740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e01b7370 con 0x55ee9efd72e0 2024-09-19T09:45:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.962+0000 7fa1e4e37640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee9efd69a0 0x55ee9efe7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.962+0000 7fa1e9e34740 10 client.0 _ll_register_callbacks cb 0x7fa1d0009ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:45:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.962+0000 7fa1e4e37640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee9efd69a0 0x55ee9efe7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32974/0 (socket says 172.21.15.1:32974) 2024-09-19T09:45:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.962+0000 7fa1e4e37640 1 -- 172.21.15.1:0/3248858732 learned_addr learned my addr 172.21.15.1:0/3248858732 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.962+0000 7fa1e5638640 1 --2- 172.21.15.1:0/3248858732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee9efdc370 0x55ee9efe5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.962+0000 7fa1dffff640 1 --2- 172.21.15.1:0/3248858732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee9efd72e0 0x55ee9efe7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.962+0000 7fa1e4e37640 1 -- 172.21.15.1:0/3248858732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee9efd72e0 msgr2=0x55ee9efe7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.962+0000 7fa1e4e37640 1 --2- 172.21.15.1:0/3248858732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee9efd72e0 0x55ee9efe7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.962+0000 7fa1e4e37640 1 -- 172.21.15.1:0/3248858732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee9efdc370 msgr2=0x55ee9efe5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.962+0000 7fa1e4e37640 1 --2- 172.21.15.1:0/3248858732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee9efdc370 0x55ee9efe5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.962+0000 7fa1e4e37640 1 -- 172.21.15.1:0/3248858732 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee9efe65e0 con 0x55ee9efd69a0 2024-09-19T09:45:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.962+0000 7fa1dffff640 1 --2- 172.21.15.1:0/3248858732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee9efd72e0 0x55ee9efe7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:45:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.962+0000 7fa1e5638640 1 --2- 172.21.15.1:0/3248858732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee9efdc370 0x55ee9efe5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:45:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.963+0000 7fa1e4e37640 1 --2- 172.21.15.1:0/3248858732 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee9efd69a0 0x55ee9efe7960 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4004d00 tx=0x7fa1d4004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a0029adb96189a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.963+0000 7fa1bffff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:45:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.963+0000 7fa1bffff640 1 -- 172.21.15.1:0/3248858732 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d403e070 con 0x55ee9efd69a0 2024-09-19T09:45:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.963+0000 7fa1bffff640 1 -- 172.21.15.1:0/3248858732 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fa1d40052b0 con 0x55ee9efd69a0 2024-09-19T09:45:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.963+0000 7fa1e9e34740 1 -- 172.21.15.1:0/3248858732 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ee9ef47a20 con 0x55ee9efd69a0 2024-09-19T09:45:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.963+0000 7fa1bffff640 1 -- 172.21.15.1:0/3248858732 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa1d402b050 con 0x55ee9efd69a0 2024-09-19T09:45:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.963+0000 7fa1e9e34740 10 client.16329 fetch_fsmap learned FSMap version 21 2024-09-19T09:45:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.963+0000 7fa1e9e34740 1 -- 172.21.15.1:0/3248858732 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55ee9f057870 con 0x55ee9efd69a0 2024-09-19T09:45:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.963+0000 7fa1bffff640 1 -- 172.21.15.1:0/3248858732 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55ee9ef47a20 con 0x55ee9efd69a0 2024-09-19T09:45:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.963+0000 7fa1bffff640 1 -- 172.21.15.1:0/3248858732 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8330+0+0 (secure 0 0 0) 0x7fa1d4037040 con 0x55ee9efd69a0 2024-09-19T09:45:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.964+0000 7fa1e9e34740 10 client.16329 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T09:45:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.964+0000 7fa1e9e34740 10 client.16329 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:45:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.964+0000 7fa1e9e34740 20 client.16329 populate_metadata read hostname 'smithi001' 2024-09-19T09:45:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.964+0000 7fa1e9e34740 1 --2- 172.21.15.1:0/3248858732 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55ee9efec370 0x55ee9f05a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.964+0000 7fa1e9e34740 4 client.16329 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:45:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.964+0000 7fa1e9e34740 1 -- 172.21.15.1:0/3248858732 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ee9eebe900 con 0x55ee9efec370 2024-09-19T09:45:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.964+0000 7fa1dffff640 1 --2- 172.21.15.1:0/3248858732 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55ee9efec370 0x55ee9f05a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.964+0000 7fa1bffff640 10 client.16329 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:45:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:16.964+0000 7fa1dffff640 1 --2- 172.21.15.1:0/3248858732 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55ee9efec370 0x55ee9f05a210 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8fa20f9b730e552 server_cookie=6173591db1f3873b in_seq=0 out_seq=0 2024-09-19T09:45:18.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:17 smithi022 ceph-mon[35583]: pgmap v555: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 77 MiB/s wr, 11.19k op/s 2024-09-19T09:45:18.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:17 smithi121 ceph-mon[35577]: pgmap v555: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 77 MiB/s wr, 11.19k op/s 2024-09-19T09:45:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:18.121+0000 7fa1bffff640 1 -- 172.21.15.1:0/3248858732 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ee9eebe900 con 0x55ee9efec370 2024-09-19T09:45:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:18.121+0000 7fa1bffff640 10 client.16329 handle_command_reply: tid=0 2024-09-19T09:45:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:18.121+0000 7fa1e9e34740 1 client.16329 shutdown 2024-09-19T09:45:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:18.121+0000 7fa1e9e34740 1 -- 172.21.15.1:0/3248858732 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee9efd69a0 msgr2=0x55ee9efe7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:18.121+0000 7fa1e9e34740 1 --2- 172.21.15.1:0/3248858732 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee9efd69a0 0x55ee9efe7960 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4004d00 tx=0x7fa1d4004d30 comp rx=0 tx=0).stop 2024-09-19T09:45:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:18.121+0000 7fa1e9e34740 1 -- 172.21.15.1:0/3248858732 shutdown_connections 2024-09-19T09:45:18.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:18.121+0000 7fa1e9e34740 1 --2- 172.21.15.1:0/3248858732 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55ee9efec370 0x55ee9f05a210 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:18.121+0000 7fa1bffff640 0 client.16329 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:45:18.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:18.121+0000 7fa1e9e34740 1 --2- 172.21.15.1:0/3248858732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee9efdc370 0x55ee9efe5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:18.121+0000 7fa1e9e34740 1 --2- 172.21.15.1:0/3248858732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ee9efd72e0 0x55ee9efe7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:18.121+0000 7fa1e9e34740 1 --2- 172.21.15.1:0/3248858732 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55ee9efd69a0 0x55ee9efe7960 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:18.121+0000 7fa1e9e34740 1 -- 172.21.15.1:0/3248858732 >> 172.21.15.1:0/3248858732 conn(0x55ee9efd2010 msgr2=0x55ee9efd11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:18.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:18.121+0000 7fa1e9e34740 1 -- 172.21.15.1:0/3248858732 shutdown_connections 2024-09-19T09:45:18.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:18.121+0000 7fa1e9e34740 1 -- 172.21.15.1:0/3248858732 wait complete. 2024-09-19T09:45:18.125 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:18.122+0000 7fa1e9e34740 20 client.16329 trim_cache size 0 max 16384 2024-09-19T09:45:18.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:45:18.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:45:18.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:45:18.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:45:18.126 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:18.122+0000 7fa1e709b640 1 -- 172.21.15.1:0/1266283426 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fa1c80a3300 msgr2=0x7fa1c80a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:18.127 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:18.122+0000 7fa1e709b640 1 --2- 172.21.15.1:0/1266283426 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fa1c80a3300 0x7fa1c80a57c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa1e019f9a0 tx=0x7fa1d00117b0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.127 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:18.122+0000 7fa1e709b640 1 -- 172.21.15.1:0/1266283426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1e01025e0 msgr2=0x7fa1e01a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:18.127 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:18.122+0000 7fa1e709b640 1 --2- 172.21.15.1:0/1266283426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1e01025e0 0x7fa1e01a5a40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8034040 tx=0x7fa1d8030e20 comp rx=0 tx=0).stop 2024-09-19T09:45:18.127 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:18.122+0000 7fa1e709b640 1 -- 172.21.15.1:0/1266283426 shutdown_connections 2024-09-19T09:45:18.127 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:18.122+0000 7fa1e709b640 1 --2- 172.21.15.1:0/1266283426 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fa1c80a3300 0x7fa1c80a57c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.127 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:18.122+0000 7fa1e709b640 1 --2- 172.21.15.1:0/1266283426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1e01025e0 0x7fa1e01a5a40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.127 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:18.122+0000 7fa1e709b640 1 --2- 172.21.15.1:0/1266283426 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1e0101c20 0x7fa1e019e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.127 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:18.122+0000 7fa1e709b640 1 --2- 172.21.15.1:0/1266283426 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa1e0100a30 0x7fa1e019e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:18.127 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:18.122+0000 7fa1e709b640 1 -- 172.21.15.1:0/1266283426 >> 172.21.15.1:0/1266283426 conn(0x7fa1e00fc190 msgr2=0x7fa1e0105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:18.127 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:18.123+0000 7fa1e709b640 1 -- 172.21.15.1:0/1266283426 shutdown_connections 2024-09-19T09:45:18.127 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:18.123+0000 7fa1e709b640 1 -- 172.21.15.1:0/1266283426 wait complete. 2024-09-19T09:45:18.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:17 smithi001 ceph-mon[31225]: pgmap v555: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 77 MiB/s wr, 11.19k op/s 2024-09-19T09:45:20.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:19 smithi022 ceph-mon[35583]: pgmap v556: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 81 MiB/s wr, 11.70k op/s 2024-09-19T09:45:20.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:19 smithi121 ceph-mon[35577]: pgmap v556: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 81 MiB/s wr, 11.70k op/s 2024-09-19T09:45:20.142 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:19 smithi001 ceph-mon[31225]: pgmap v556: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 81 MiB/s wr, 11.70k op/s 2024-09-19T09:45:20.144 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0' 2024-09-19T09:45:20.144 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0 2024-09-19T09:45:20.194 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:45:22.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:21 smithi022 ceph-mon[35583]: pgmap v557: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 71 MiB/s wr, 10.02k op/s 2024-09-19T09:45:22.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:21 smithi121 ceph-mon[35577]: pgmap v557: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 71 MiB/s wr, 10.02k op/s 2024-09-19T09:45:22.239 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:21 smithi001 ceph-mon[31225]: pgmap v557: 97 pgs: 97 active+clean; 13 GiB data, 42 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 71 MiB/s wr, 10.02k op/s 2024-09-19T09:45:24.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:23 smithi022 ceph-mon[35583]: pgmap v558: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 79 MiB/s wr, 11.05k op/s 2024-09-19T09:45:24.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:23 smithi121 ceph-mon[35577]: pgmap v558: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 79 MiB/s wr, 11.05k op/s 2024-09-19T09:45:24.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:23 smithi001 ceph-mon[31225]: pgmap v558: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 79 MiB/s wr, 11.05k op/s 2024-09-19T09:45:26.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:25 smithi022 ceph-mon[35583]: pgmap v559: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 84 MiB/s wr, 11.80k op/s 2024-09-19T09:45:26.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:25 smithi121 ceph-mon[35577]: pgmap v559: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 84 MiB/s wr, 11.80k op/s 2024-09-19T09:45:26.145 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-19T09:45:26.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.812+0000 7f57fb348640 1 -- 172.21.15.1:0/2003163441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57f410ea10 msgr2=0x7f57f4115360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:26.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.812+0000 7f57fb348640 1 --2- 172.21.15.1:0/2003163441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57f410ea10 0x7f57f4115360 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f57f00093a0 tx=0x7f57f002b650 comp rx=0 tx=0).stop 2024-09-19T09:45:26.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.813+0000 7f57fb348640 1 -- 172.21.15.1:0/2003163441 shutdown_connections 2024-09-19T09:45:26.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.813+0000 7f57fb348640 1 --2- 172.21.15.1:0/2003163441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57f410ea10 0x7f57f4115360 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.813+0000 7f57fb348640 1 --2- 172.21.15.1:0/2003163441 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57f4109e00 0x7f57f410e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.813+0000 7f57fb348640 1 --2- 172.21.15.1:0/2003163441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57f4109450 0x7f57f4109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.813+0000 7f57fb348640 1 -- 172.21.15.1:0/2003163441 >> 172.21.15.1:0/2003163441 conn(0x7f57f4073660 msgr2=0x7f57f4073a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:26.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.813+0000 7f57fb348640 1 -- 172.21.15.1:0/2003163441 shutdown_connections 2024-09-19T09:45:26.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.813+0000 7f57fb348640 1 -- 172.21.15.1:0/2003163441 wait complete. 2024-09-19T09:45:26.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.814+0000 7f57fb348640 1 Processor -- start 2024-09-19T09:45:26.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.816+0000 7f57fb348640 1 -- start start 2024-09-19T09:45:26.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.817+0000 7f57fb348640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57f4109450 0x7f57f41a65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:26.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.817+0000 7f57fb348640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57f4109e00 0x7f57f41a6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:26.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.817+0000 7f57fb348640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57f410ea10 0x7f57f41a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:26.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.817+0000 7f57fb348640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f57f411a5e0 con 0x7f57f4109450 2024-09-19T09:45:26.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.817+0000 7f57f9b45640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57f4109e00 0x7f57f41a6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:26.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.817+0000 7f57f9b45640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57f4109e00 0x7f57f41a6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:45348/0 (socket says 172.21.15.1:45348) 2024-09-19T09:45:26.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.818+0000 7f57f9b45640 1 -- 172.21.15.1:0/1433750119 learned_addr learned my addr 172.21.15.1:0/1433750119 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:26.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.818+0000 7f57fab47640 1 --2- 172.21.15.1:0/1433750119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57f410ea10 0x7f57f41a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:26.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.818+0000 7f57fb348640 1 -- 172.21.15.1:0/1433750119 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f57f411a460 con 0x7f57f4109e00 2024-09-19T09:45:26.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.818+0000 7f57fb348640 1 -- 172.21.15.1:0/1433750119 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f57f411a760 con 0x7f57f410ea10 2024-09-19T09:45:26.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.819+0000 7f57fa346640 1 --2- 172.21.15.1:0/1433750119 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57f4109450 0x7f57f41a65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:26.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.819+0000 7f57f9b45640 1 -- 172.21.15.1:0/1433750119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57f410ea10 msgr2=0x7f57f41a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:26.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.819+0000 7f57f9b45640 1 --2- 172.21.15.1:0/1433750119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57f410ea10 0x7f57f41a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.819+0000 7f57f9b45640 1 -- 172.21.15.1:0/1433750119 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57f4109450 msgr2=0x7f57f41a65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:26.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.819+0000 7f57f9b45640 1 --2- 172.21.15.1:0/1433750119 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57f4109450 0x7f57f41a65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.819+0000 7f57f9b45640 1 -- 172.21.15.1:0/1433750119 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f41a0ee0 con 0x7f57f4109e00 2024-09-19T09:45:26.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.822+0000 7f57f9b45640 1 --2- 172.21.15.1:0/1433750119 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57f4109e00 0x7f57f41a6ae0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f57ec00db80 tx=0x7f57ec00b630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:26.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.824+0000 7f57eb7fe640 1 -- 172.21.15.1:0/1433750119 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec01c070 con 0x7f57f4109e00 2024-09-19T09:45:26.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.824+0000 7f57eb7fe640 1 -- 172.21.15.1:0/1433750119 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57ec003e50 con 0x7f57f4109e00 2024-09-19T09:45:26.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.824+0000 7f57eb7fe640 1 -- 172.21.15.1:0/1433750119 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec0046c0 con 0x7f57f4109e00 2024-09-19T09:45:26.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.824+0000 7f57fb348640 1 -- 172.21.15.1:0/1433750119 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57f41a1170 con 0x7f57f4109e00 2024-09-19T09:45:26.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.824+0000 7f57fb348640 1 -- 172.21.15.1:0/1433750119 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57f4116390 con 0x7f57f4109e00 2024-09-19T09:45:26.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.832+0000 7f57eb7fe640 1 -- 172.21.15.1:0/1433750119 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f57ec020410 con 0x7f57f4109e00 2024-09-19T09:45:26.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.832+0000 7f57fe983740 1 Processor -- start 2024-09-19T09:45:26.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.832+0000 7f57fe983740 1 -- start start 2024-09-19T09:45:26.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.833+0000 7f57fe983740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd9c897d20 0x55bd9c896270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:26.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.833+0000 7f57fe983740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9c8967b0 0x55bd9c896bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:26.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.833+0000 7f57fe983740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bd9c8a1550 0x55bd9c8a3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:26.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.833+0000 7f57fe983740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55bd9c7fc2f0 con 0x55bd9c897d20 2024-09-19T09:45:26.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.833+0000 7f57fe983740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55bd9c7a3cf0 con 0x55bd9c8a1550 2024-09-19T09:45:26.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.833+0000 7f57fe983740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55bd9c7f82b0 con 0x55bd9c8967b0 2024-09-19T09:45:26.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.833+0000 7f57fab47640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd9c897d20 0x55bd9c896270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:26.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.833+0000 7f57fab47640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd9c897d20 0x55bd9c896270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32986/0 (socket says 172.21.15.1:32986) 2024-09-19T09:45:26.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.833+0000 7f57fab47640 1 -- 172.21.15.1:0/750755811 learned_addr learned my addr 172.21.15.1:0/750755811 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:26.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.834+0000 7f57f9b45640 1 --2- 172.21.15.1:0/750755811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bd9c8a1550 0x55bd9c8a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:26.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.834+0000 7f57fa346640 1 --2- 172.21.15.1:0/750755811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9c8967b0 0x55bd9c896bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:26.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.834+0000 7f57eb7fe640 1 --2- 172.21.15.1:0/1433750119 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f57e00a3410 0x7f57e00a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:26.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.835+0000 7f57fab47640 1 --2- 172.21.15.1:0/1433750119 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f57e00a3410 0x7f57e00a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:26.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.835+0000 7f57eb7fe640 1 -- 172.21.15.1:0/1433750119 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f57ec0d8f70 con 0x7f57f4109e00 2024-09-19T09:45:26.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.836+0000 7f57f9b45640 1 -- 172.21.15.1:0/750755811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9c8967b0 msgr2=0x55bd9c896bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:26.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.836+0000 7f57f9b45640 1 --2- 172.21.15.1:0/750755811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9c8967b0 0x55bd9c896bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.836+0000 7f57f9b45640 1 -- 172.21.15.1:0/750755811 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd9c897d20 msgr2=0x55bd9c896270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:26.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.836+0000 7f57f9b45640 1 --2- 172.21.15.1:0/750755811 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd9c897d20 0x55bd9c896270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.836+0000 7f57f9b45640 1 -- 172.21.15.1:0/750755811 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd9c7883a0 con 0x55bd9c8a1550 2024-09-19T09:45:26.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.836+0000 7f57fa346640 1 --2- 172.21.15.1:0/750755811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9c8967b0 0x55bd9c896bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:45:26.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.836+0000 7f57f9b45640 1 --2- 172.21.15.1:0/750755811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bd9c8a1550 0x55bd9c8a3940 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f57ec0d6a00 tx=0x7f57ec01a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fde8730cd814bf57 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:26.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.837+0000 7f57e8ff9640 1 -- 172.21.15.1:0/750755811 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec0a5090 con 0x55bd9c8a1550 2024-09-19T09:45:26.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.839+0000 7f57e8ff9640 1 -- 172.21.15.1:0/750755811 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57ec0a5c50 con 0x55bd9c8a1550 2024-09-19T09:45:26.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.839+0000 7f57e8ff9640 1 -- 172.21.15.1:0/750755811 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec0a4eb0 con 0x55bd9c8a1550 2024-09-19T09:45:26.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.840+0000 7f57fe983740 1 -- 172.21.15.1:0/750755811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bd9c8a1550 msgr2=0x55bd9c8a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:26.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.840+0000 7f57fe983740 1 --2- 172.21.15.1:0/750755811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bd9c8a1550 0x55bd9c8a3940 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f57ec0d6a00 tx=0x7f57ec01a000 comp rx=0 tx=0).stop 2024-09-19T09:45:26.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.843+0000 7f57fab47640 1 --2- 172.21.15.1:0/1433750119 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f57e00a3410 0x7f57e00a58d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f57f002bb70 tx=0x7f57f002b650 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:26.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.843+0000 7f57fe983740 1 -- 172.21.15.1:0/750755811 shutdown_connections 2024-09-19T09:45:26.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.843+0000 7f57fe983740 1 --2- 172.21.15.1:0/750755811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bd9c8a1550 0x55bd9c8a3940 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.843+0000 7f57fe983740 1 --2- 172.21.15.1:0/750755811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9c8967b0 0x55bd9c896bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.843+0000 7f57fe983740 1 --2- 172.21.15.1:0/750755811 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd9c897d20 0x55bd9c896270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.843+0000 7f57fe983740 1 -- 172.21.15.1:0/750755811 >> 172.21.15.1:0/750755811 conn(0x55bd9c85f310 msgr2=0x55bd9c892e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:26.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.844+0000 7f57fe983740 1 -- 172.21.15.1:0/750755811 shutdown_connections 2024-09-19T09:45:26.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.847+0000 7f57fe983740 1 -- 172.21.15.1:0/750755811 wait complete. 2024-09-19T09:45:26.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.847+0000 7f57fe983740 1 -- start start 2024-09-19T09:45:26.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.847+0000 7f57fe983740 1 Processor -- start 2024-09-19T09:45:26.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.848+0000 7f57fe983740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bd9c8967b0 0x55bd9c8a0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:26.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.848+0000 7f57fe983740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9c897d20 0x55bd9c89e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:26.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.848+0000 7f57fe983740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd9c8a1550 0x55bd9c89e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:26.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.848+0000 7f57fe983740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55bd9c8a41f0 con 0x55bd9c8a1550 2024-09-19T09:45:26.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.848+0000 7f57fe983740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55bd9c7b7060 con 0x55bd9c8967b0 2024-09-19T09:45:26.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.848+0000 7f57fe983740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55bd9c8a4370 con 0x55bd9c897d20 2024-09-19T09:45:26.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.848+0000 7f57fe983740 10 client.0 _ll_register_callbacks cb 0x55bd9c50a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:45:26.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.849+0000 7f57fab47640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd9c8a1550 0x55bd9c89e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:26.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.849+0000 7f57fab47640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd9c8a1550 0x55bd9c89e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:32994/0 (socket says 172.21.15.1:32994) 2024-09-19T09:45:26.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.849+0000 7f57fab47640 1 -- 172.21.15.1:0/1513639150 learned_addr learned my addr 172.21.15.1:0/1513639150 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:26.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.849+0000 7f57fab47640 1 -- 172.21.15.1:0/1513639150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9c897d20 msgr2=0x55bd9c89e1c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:45:26.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.849+0000 7f57fab47640 1 --2- 172.21.15.1:0/1513639150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9c897d20 0x55bd9c89e1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.849+0000 7f57fab47640 1 -- 172.21.15.1:0/1513639150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bd9c8967b0 msgr2=0x55bd9c8a0ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:45:26.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.849+0000 7f57fab47640 1 --2- 172.21.15.1:0/1513639150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bd9c8967b0 0x55bd9c8a0ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.849+0000 7f57fab47640 1 -- 172.21.15.1:0/1513639150 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd9c56d3c0 con 0x55bd9c8a1550 2024-09-19T09:45:26.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.850+0000 7f57fab47640 1 --2- 172.21.15.1:0/1513639150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd9c8a1550 0x55bd9c89e7d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f57f0032de0 tx=0x7f57f0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b6ecb8580496cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:26.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.850+0000 7f57ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:45:26.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.851+0000 7f57ddffb640 1 -- 172.21.15.1:0/1513639150 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f0045040 con 0x55bd9c8a1550 2024-09-19T09:45:26.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.851+0000 7f57fe983740 1 -- 172.21.15.1:0/1513639150 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57ec0a5c50 con 0x55bd9c8a1550 2024-09-19T09:45:26.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.851+0000 7f57ddffb640 1 -- 172.21.15.1:0/1513639150 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f57f003ec80 con 0x55bd9c8a1550 2024-09-19T09:45:26.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.852+0000 7f57ddffb640 1 -- 172.21.15.1:0/1513639150 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f57f0036040 con 0x55bd9c8a1550 2024-09-19T09:45:26.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.852+0000 7f57fe983740 10 client.16341 fetch_fsmap learned FSMap version 21 2024-09-19T09:45:26.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.852+0000 7f57fe983740 1 -- 172.21.15.1:0/1513639150 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55bd9c8c0cb0 con 0x55bd9c8a1550 2024-09-19T09:45:26.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.853+0000 7f57ddffb640 1 -- 172.21.15.1:0/1513639150 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57ec0a5c50 con 0x55bd9c8a1550 2024-09-19T09:45:26.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.854+0000 7f57ddffb640 1 -- 172.21.15.1:0/1513639150 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8330+0+0 (secure 0 0 0) 0x7f57f004b040 con 0x55bd9c8a1550 2024-09-19T09:45:26.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.854+0000 7f57fe983740 10 client.16341 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T09:45:26.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.854+0000 7f57fe983740 10 client.16341 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:45:26.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.854+0000 7f57fe983740 20 client.16341 populate_metadata read hostname 'smithi001' 2024-09-19T09:45:26.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.854+0000 7f57fe983740 1 --2- 172.21.15.1:0/1513639150 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55bd9c8c2610 0x55bd9c8c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:26.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.854+0000 7f57fe983740 4 client.16341 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:45:26.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.854+0000 7f57fe983740 1 -- 172.21.15.1:0/1513639150 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd9c809860 con 0x55bd9c8c2610 2024-09-19T09:45:26.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.858+0000 7f57fa346640 1 --2- 172.21.15.1:0/1513639150 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55bd9c8c2610 0x55bd9c8c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:26.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.859+0000 7f57fa346640 1 --2- 172.21.15.1:0/1513639150 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55bd9c8c2610 0x55bd9c8c4ad0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb1e165edc28d7c5 server_cookie=da2a6573422ede29 in_seq=0 out_seq=0 2024-09-19T09:45:26.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.859+0000 7f57ddffb640 10 client.16341 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:45:26.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.860+0000 7f57ddffb640 1 -- 172.21.15.1:0/1513639150 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bd9c809860 con 0x55bd9c8c2610 2024-09-19T09:45:26.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.860+0000 7f57ddffb640 10 client.16341 handle_command_reply: tid=0 2024-09-19T09:45:26.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.860+0000 7f57fe983740 1 client.16341 shutdown 2024-09-19T09:45:26.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.861+0000 7f57fe983740 1 -- 172.21.15.1:0/1513639150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd9c8a1550 msgr2=0x55bd9c89e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:26.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.861+0000 7f57fe983740 1 --2- 172.21.15.1:0/1513639150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd9c8a1550 0x55bd9c89e7d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f57f0032de0 tx=0x7f57f0005fd0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.155 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.861+0000 7f57fe983740 1 -- 172.21.15.1:0/1513639150 shutdown_connections 2024-09-19T09:45:26.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.861+0000 7f57fe983740 1 --2- 172.21.15.1:0/1513639150 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55bd9c8c2610 0x55bd9c8c4ad0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.861+0000 7f57fe983740 1 --2- 172.21.15.1:0/1513639150 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd9c8a1550 0x55bd9c89e7d0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.861+0000 7f57fe983740 1 --2- 172.21.15.1:0/1513639150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9c897d20 0x55bd9c89e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.861+0000 7f57fe983740 1 --2- 172.21.15.1:0/1513639150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bd9c8967b0 0x55bd9c8a0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.861+0000 7f57fe983740 1 -- 172.21.15.1:0/1513639150 >> 172.21.15.1:0/1513639150 conn(0x55bd9c85f310 msgr2=0x55bd9c898ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:26.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.863+0000 7f57ddffb640 0 client.16341 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:45:26.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.864+0000 7f57fe983740 1 -- 172.21.15.1:0/1513639150 shutdown_connections 2024-09-19T09:45:26.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.866+0000 7f57fe983740 1 -- 172.21.15.1:0/1513639150 wait complete. 2024-09-19T09:45:26.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.866+0000 7f57fe983740 20 client.16341 trim_cache size 0 max 16384 2024-09-19T09:45:26.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.894+0000 7f57fe983740 1 Processor -- start 2024-09-19T09:45:26.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.895+0000 7f57fe983740 1 -- start start 2024-09-19T09:45:26.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.895+0000 7f57fe983740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bd9c8967b0 0x55bd9c89e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:26.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.895+0000 7f57fe983740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9c897d20 0x55bd9c89e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:26.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.895+0000 7f57fe983740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd9c8a1550 0x55bd9c89ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:26.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.895+0000 7f57fe983740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f57d800c520 con 0x55bd9c8a1550 2024-09-19T09:45:26.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.895+0000 7f57fe983740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f57d800edc0 con 0x55bd9c8967b0 2024-09-19T09:45:26.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.895+0000 7f57fe983740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f57d800cbb0 con 0x55bd9c897d20 2024-09-19T09:45:26.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.895+0000 7f57f9b45640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9c897d20 0x55bd9c89e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:26.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.895+0000 7f57fa346640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bd9c8967b0 0x55bd9c89e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:26.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.896+0000 7f57fa346640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bd9c8967b0 0x55bd9c89e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:45362/0 (socket says 172.21.15.1:45362) 2024-09-19T09:45:26.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.896+0000 7f57fa346640 1 -- 172.21.15.1:0/2767432971 learned_addr learned my addr 172.21.15.1:0/2767432971 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:26.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.896+0000 7f57f9b45640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9c897d20 0x55bd9c89e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:60234/0 (socket says 172.21.15.1:60234) 2024-09-19T09:45:26.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.896+0000 7f57fa346640 1 -- 172.21.15.1:0/2767432971 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9c897d20 msgr2=0x55bd9c89e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:26.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.896+0000 7f57fa346640 1 --2- 172.21.15.1:0/2767432971 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9c897d20 0x55bd9c89e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.896+0000 7f57fa346640 1 -- 172.21.15.1:0/2767432971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd9c8a1550 msgr2=0x55bd9c89ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:26.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.897+0000 7f57fa346640 1 --2- 172.21.15.1:0/2767432971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd9c8a1550 0x55bd9c89ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.897+0000 7f57fa346640 1 -- 172.21.15.1:0/2767432971 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd9c8c4e40 con 0x55bd9c8967b0 2024-09-19T09:45:26.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.899+0000 7f57fa346640 1 --2- 172.21.15.1:0/2767432971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bd9c8967b0 0x55bd9c89e180 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f57e4010b40 tx=0x7f57e4005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86693fadb6048611 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:26.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.899+0000 7f57dffff640 1 -- 172.21.15.1:0/2767432971 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e4004020 con 0x55bd9c8967b0 2024-09-19T09:45:26.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.899+0000 7f57dffff640 1 -- 172.21.15.1:0/2767432971 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57e4004cd0 con 0x55bd9c8967b0 2024-09-19T09:45:26.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.899+0000 7f57dffff640 1 -- 172.21.15.1:0/2767432971 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e4003be0 con 0x55bd9c8967b0 2024-09-19T09:45:26.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.901+0000 7f57fe983740 1 -- 172.21.15.1:0/2767432971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bd9c8967b0 msgr2=0x55bd9c89e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:26.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.901+0000 7f57fe983740 1 --2- 172.21.15.1:0/2767432971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bd9c8967b0 0x55bd9c89e180 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f57e4010b40 tx=0x7f57e4005040 comp rx=0 tx=0).stop 2024-09-19T09:45:26.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.905+0000 7f57fe983740 1 -- 172.21.15.1:0/2767432971 shutdown_connections 2024-09-19T09:45:26.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.905+0000 7f57fe983740 1 --2- 172.21.15.1:0/2767432971 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd9c8a1550 0x55bd9c89ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.905+0000 7f57fe983740 1 --2- 172.21.15.1:0/2767432971 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9c897d20 0x55bd9c89e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.905+0000 7f57fe983740 1 --2- 172.21.15.1:0/2767432971 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bd9c8967b0 0x55bd9c89e180 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.906+0000 7f57fe983740 1 -- 172.21.15.1:0/2767432971 >> 172.21.15.1:0/2767432971 conn(0x55bd9c85f310 msgr2=0x55bd9c8994d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:26.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.914+0000 7f57fe983740 1 -- 172.21.15.1:0/2767432971 shutdown_connections 2024-09-19T09:45:26.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.914+0000 7f57fe983740 1 -- 172.21.15.1:0/2767432971 wait complete. 2024-09-19T09:45:26.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.915+0000 7f57fe983740 1 -- start start 2024-09-19T09:45:26.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.915+0000 7f57fe983740 1 Processor -- start 2024-09-19T09:45:26.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.919+0000 7f57fe983740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9c8967b0 0x55bd9c8a4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:26.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.919+0000 7f57fe983740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd9c897d20 0x55bd9c8a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:26.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.919+0000 7f57fe983740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bd9c8a1550 0x55bd9c8a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:26.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.919+0000 7f57fe983740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f57d800d280 con 0x55bd9c897d20 2024-09-19T09:45:26.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.919+0000 7f57fe983740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f57d800e6f0 con 0x55bd9c8a1550 2024-09-19T09:45:26.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.919+0000 7f57fe983740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f57d800d950 con 0x55bd9c8967b0 2024-09-19T09:45:26.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.919+0000 7f57fe983740 10 client.0 _ll_register_callbacks cb 0x7f57f0032a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:45:26.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.920+0000 7f57fab47640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bd9c8a1550 0x55bd9c8a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:26.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.920+0000 7f57fab47640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bd9c8a1550 0x55bd9c8a50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:45376/0 (socket says 172.21.15.1:45376) 2024-09-19T09:45:26.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.920+0000 7f57fab47640 1 -- 172.21.15.1:0/2993494504 learned_addr learned my addr 172.21.15.1:0/2993494504 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:26.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.920+0000 7f57f9b45640 1 --2- 172.21.15.1:0/2993494504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd9c897d20 0x55bd9c8a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:26.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.920+0000 7f57fab47640 1 -- 172.21.15.1:0/2993494504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9c8967b0 msgr2=0x55bd9c8a4620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:45:26.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.920+0000 7f57fab47640 1 --2- 172.21.15.1:0/2993494504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9c8967b0 0x55bd9c8a4620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.920+0000 7f57fab47640 1 -- 172.21.15.1:0/2993494504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd9c897d20 msgr2=0x55bd9c8a4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:26.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.920+0000 7f57fab47640 1 --2- 172.21.15.1:0/2993494504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd9c897d20 0x55bd9c8a4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.920+0000 7f57fab47640 1 -- 172.21.15.1:0/2993494504 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd9c92b450 con 0x55bd9c8a1550 2024-09-19T09:45:26.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.920+0000 7f57fab47640 1 --2- 172.21.15.1:0/2993494504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bd9c8a1550 0x55bd9c8a50a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f57f0005a80 tx=0x7f57f003e930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c29b4229b3d70aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:26.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.920+0000 7f57ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:45:26.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.921+0000 7f57ddffb640 1 -- 172.21.15.1:0/2993494504 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f0065060 con 0x55bd9c8a1550 2024-09-19T09:45:26.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.921+0000 7f57ddffb640 1 -- 172.21.15.1:0/2993494504 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f57f003ec80 con 0x55bd9c8a1550 2024-09-19T09:45:26.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.921+0000 7f57fe983740 1 -- 172.21.15.1:0/2993494504 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57e4004cd0 con 0x55bd9c8a1550 2024-09-19T09:45:26.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.921+0000 7f57ddffb640 1 -- 172.21.15.1:0/2993494504 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f57f0045070 con 0x55bd9c8a1550 2024-09-19T09:45:26.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.922+0000 7f57fe983740 10 client.26012 fetch_fsmap learned FSMap version 21 2024-09-19T09:45:26.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.922+0000 7f57fe983740 1 -- 172.21.15.1:0/2993494504 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55bd9c92c750 con 0x55bd9c8a1550 2024-09-19T09:45:26.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.922+0000 7f57ddffb640 1 -- 172.21.15.1:0/2993494504 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f57e4004cd0 con 0x55bd9c8a1550 2024-09-19T09:45:26.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.922+0000 7f57ddffb640 1 -- 172.21.15.1:0/2993494504 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 21) ==== 8330+0+0 (secure 0 0 0) 0x7f57f006a070 con 0x55bd9c8a1550 2024-09-19T09:45:26.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.923+0000 7f57fe983740 10 client.26012 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T09:45:26.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.923+0000 7f57fe983740 10 client.26012 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:45:26.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.923+0000 7f57fe983740 20 client.26012 populate_metadata read hostname 'smithi001' 2024-09-19T09:45:26.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.923+0000 7f57fe983740 1 --2- 172.21.15.1:0/2993494504 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55bd9c92ce70 0x55bd9c92f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:26.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.923+0000 7f57fe983740 4 client.26012 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:45:26.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.923+0000 7f57fe983740 1 -- 172.21.15.1:0/2993494504 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bd9c803d70 con 0x55bd9c92ce70 2024-09-19T09:45:26.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.924+0000 7f57fa346640 1 --2- 172.21.15.1:0/2993494504 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55bd9c92ce70 0x55bd9c92f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:26.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.926+0000 7f57fa346640 1 --2- 172.21.15.1:0/2993494504 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55bd9c92ce70 0x55bd9c92f290 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3318b8c76bb437e1 server_cookie=30ac6a8b4c5ce40d in_seq=0 out_seq=0 2024-09-19T09:45:26.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.926+0000 7f57ddffb640 10 client.26012 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:45:26.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.926+0000 7f57ddffb640 1 -- 172.21.15.1:0/2993494504 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bd9c803d70 con 0x55bd9c92ce70 2024-09-19T09:45:26.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.926+0000 7f57ddffb640 10 client.26012 handle_command_reply: tid=0 2024-09-19T09:45:26.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.927+0000 7f57fe983740 1 client.26012 shutdown 2024-09-19T09:45:26.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.927+0000 7f57fe983740 1 -- 172.21.15.1:0/2993494504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bd9c8a1550 msgr2=0x55bd9c8a50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:26.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.927+0000 7f57fe983740 1 --2- 172.21.15.1:0/2993494504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bd9c8a1550 0x55bd9c8a50a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f57f0005a80 tx=0x7f57f003e930 comp rx=0 tx=0).stop 2024-09-19T09:45:26.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.927+0000 7f57fe983740 1 -- 172.21.15.1:0/2993494504 shutdown_connections 2024-09-19T09:45:26.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.927+0000 7f57fe983740 1 --2- 172.21.15.1:0/2993494504 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55bd9c92ce70 0x55bd9c92f290 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.927+0000 7f57fe983740 1 --2- 172.21.15.1:0/2993494504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55bd9c8a1550 0x55bd9c8a50a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.927+0000 7f57fe983740 1 --2- 172.21.15.1:0/2993494504 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55bd9c897d20 0x55bd9c8a4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.927+0000 7f57fe983740 1 --2- 172.21.15.1:0/2993494504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bd9c8967b0 0x55bd9c8a4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.927+0000 7f57fe983740 1 -- 172.21.15.1:0/2993494504 >> 172.21.15.1:0/2993494504 conn(0x55bd9c85f310 msgr2=0x55bd9c89e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:26.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.927+0000 7f57ddffb640 0 client.26012 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:45:26.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.927+0000 7f57fe983740 1 -- 172.21.15.1:0/2993494504 shutdown_connections 2024-09-19T09:45:26.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.927+0000 7f57fe983740 1 -- 172.21.15.1:0/2993494504 wait complete. 2024-09-19T09:45:26.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.928+0000 7f57fe983740 20 client.26012 trim_cache size 0 max 16384 2024-09-19T09:45:26.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.930+0000 7f57fb348640 1 -- 172.21.15.1:0/1433750119 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f57e00a3410 msgr2=0x7f57e00a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:26.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.930+0000 7f57fb348640 1 --2- 172.21.15.1:0/1433750119 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f57e00a3410 0x7f57e00a58d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f57f002bb70 tx=0x7f57f002b650 comp rx=0 tx=0).stop 2024-09-19T09:45:26.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.930+0000 7f57fb348640 1 -- 172.21.15.1:0/1433750119 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57f4109e00 msgr2=0x7f57f41a6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:26.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.930+0000 7f57fb348640 1 --2- 172.21.15.1:0/1433750119 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57f4109e00 0x7f57f41a6ae0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f57ec00db80 tx=0x7f57ec00b630 comp rx=0 tx=0).stop 2024-09-19T09:45:26.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.930+0000 7f57fb348640 1 -- 172.21.15.1:0/1433750119 shutdown_connections 2024-09-19T09:45:26.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.930+0000 7f57fb348640 1 --2- 172.21.15.1:0/1433750119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57f410ea10 0x7f57f41a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.930+0000 7f57fb348640 1 --2- 172.21.15.1:0/1433750119 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f57e00a3410 0x7f57e00a58d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.930+0000 7f57fb348640 1 --2- 172.21.15.1:0/1433750119 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57f4109e00 0x7f57f41a6ae0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.930+0000 7f57fb348640 1 --2- 172.21.15.1:0/1433750119 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f57f4109450 0x7f57f41a65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:26.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.930+0000 7f57fb348640 1 -- 172.21.15.1:0/1433750119 >> 172.21.15.1:0/1433750119 conn(0x7f57f4073660 msgr2=0x7f57f406d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:26.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.930+0000 7f57fb348640 1 -- 172.21.15.1:0/1433750119 shutdown_connections 2024-09-19T09:45:26.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:24.930+0000 7f57fb348640 1 -- 172.21.15.1:0/1433750119 wait complete. 2024-09-19T09:45:26.164 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:25 smithi001 ceph-mon[31225]: pgmap v559: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 84 MiB/s wr, 11.80k op/s 2024-09-19T09:45:28.114 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:27 smithi022 ceph-mon[35583]: pgmap v560: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 82 MiB/s wr, 11.28k op/s 2024-09-19T09:45:28.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:27 smithi121 ceph-mon[35577]: pgmap v560: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 82 MiB/s wr, 11.28k op/s 2024-09-19T09:45:28.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:27 smithi001 ceph-mon[31225]: pgmap v560: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 82 MiB/s wr, 11.28k op/s 2024-09-19T09:45:30.117 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:29 smithi121 ceph-mon[35577]: pgmap v561: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 84 MiB/s wr, 11.57k op/s 2024-09-19T09:45:30.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:29 smithi001 ceph-mon[31225]: pgmap v561: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 84 MiB/s wr, 11.57k op/s 2024-09-19T09:45:30.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:29 smithi022 ceph-mon[35583]: pgmap v561: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 84 MiB/s wr, 11.57k op/s 2024-09-19T09:45:31.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.254+0000 7fc17c1e4640 1 -- 172.21.15.1:0/2301408338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc174102d20 msgr2=0x7fc174105190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:31.256 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.254+0000 7fc17c1e4640 1 --2- 172.21.15.1:0/2301408338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc174102d20 0x7fc174105190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc170009900 tx=0x7fc17002a420 comp rx=0 tx=0).stop 2024-09-19T09:45:31.259 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.255+0000 7fc17c1e4640 1 -- 172.21.15.1:0/2301408338 shutdown_connections 2024-09-19T09:45:31.259 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.255+0000 7fc17c1e4640 1 --2- 172.21.15.1:0/2301408338 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc1741056d0 0x7fc174105b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:31.259 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.255+0000 7fc17c1e4640 1 --2- 172.21.15.1:0/2301408338 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc174102d20 0x7fc174105190 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:31.259 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.255+0000 7fc17c1e4640 1 --2- 172.21.15.1:0/2301408338 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1741003d0 0x7fc1741027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:31.259 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.255+0000 7fc17c1e4640 1 -- 172.21.15.1:0/2301408338 >> 172.21.15.1:0/2301408338 conn(0x7fc1740fc1c0 msgr2=0x7fc1740fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:31.266 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.264+0000 7fc17c1e4640 1 -- 172.21.15.1:0/2301408338 shutdown_connections 2024-09-19T09:45:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.270+0000 7fc17c1e4640 1 -- 172.21.15.1:0/2301408338 wait complete. 2024-09-19T09:45:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.271+0000 7fc17c1e4640 1 Processor -- start 2024-09-19T09:45:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.271+0000 7fc17c1e4640 1 -- start start 2024-09-19T09:45:31.274 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.272+0000 7fc17c1e4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc1741003d0 0x7fc174072a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:31.275 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.272+0000 7fc17c1e4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc174102d20 0x7fc174072f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:31.275 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.272+0000 7fc17c1e4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1741056d0 0x7fc17410c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:31.275 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.272+0000 7fc17c1e4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc174113f20 con 0x7fc174102d20 2024-09-19T09:45:31.275 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.272+0000 7fc17c1e4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc174113da0 con 0x7fc1741003d0 2024-09-19T09:45:31.275 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.272+0000 7fc17c1e4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc1741140a0 con 0x7fc1741056d0 2024-09-19T09:45:31.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.272+0000 7fc17977f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc174102d20 0x7fc174072f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:31.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.272+0000 7fc17977f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc174102d20 0x7fc174072f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:57436/0 (socket says 172.21.15.1:57436) 2024-09-19T09:45:31.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.272+0000 7fc17977f640 1 -- 172.21.15.1:0/863467166 learned_addr learned my addr 172.21.15.1:0/863467166 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:31.282 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.273+0000 7fc17a781640 1 --2- 172.21.15.1:0/863467166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1741056d0 0x7fc17410c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:31.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.273+0000 7fc17977f640 1 -- 172.21.15.1:0/863467166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1741056d0 msgr2=0x7fc17410c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:31.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.273+0000 7fc17977f640 1 --2- 172.21.15.1:0/863467166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1741056d0 0x7fc17410c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:31.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.273+0000 7fc17977f640 1 -- 172.21.15.1:0/863467166 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc1741003d0 msgr2=0x7fc174072a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:45:31.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.273+0000 7fc17977f640 1 --2- 172.21.15.1:0/863467166 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc1741003d0 0x7fc174072a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:31.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.273+0000 7fc17977f640 1 -- 172.21.15.1:0/863467166 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc17410cf30 con 0x7fc174102d20 2024-09-19T09:45:31.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.274+0000 7fc17977f640 1 --2- 172.21.15.1:0/863467166 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc174102d20 0x7fc174072f90 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc170031440 tx=0x7fc170032dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:31.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.275+0000 7fc16affd640 1 -- 172.21.15.1:0/863467166 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc17003f030 con 0x7fc174102d20 2024-09-19T09:45:31.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.275+0000 7fc17c1e4640 1 -- 172.21.15.1:0/863467166 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc17410d1c0 con 0x7fc174102d20 2024-09-19T09:45:31.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.275+0000 7fc17c1e4640 1 -- 172.21.15.1:0/863467166 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc17410d730 con 0x7fc174102d20 2024-09-19T09:45:31.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.275+0000 7fc16affd640 1 -- 172.21.15.1:0/863467166 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc170003ce0 con 0x7fc174102d20 2024-09-19T09:45:31.283 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.275+0000 7fc16affd640 1 -- 172.21.15.1:0/863467166 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc170035070 con 0x7fc174102d20 2024-09-19T09:45:31.284 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.279+0000 7fc17f05b740 1 Processor -- start 2024-09-19T09:45:31.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.283+0000 7fc17f05b740 1 -- start start 2024-09-19T09:45:31.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.283+0000 7fc17f05b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5583b22129b0 0x5583b2212db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:31.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.283+0000 7fc17f05b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b22132f0 0x5583b2217db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:31.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.283+0000 7fc17f05b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583b2218380 0x5583b221a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:31.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.283+0000 7fc17f05b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5583b21542f0 con 0x5583b22132f0 2024-09-19T09:45:31.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.283+0000 7fc17f05b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5583b20fc270 con 0x5583b2218380 2024-09-19T09:45:31.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.283+0000 7fc17f05b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5583b21502b0 con 0x5583b22129b0 2024-09-19T09:45:31.290 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.283+0000 7fc17a781640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5583b22129b0 0x5583b2212db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:31.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.283+0000 7fc17977f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583b2218380 0x5583b221a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:31.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.283+0000 7fc17a781640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5583b22129b0 0x5583b2212db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:34328/0 (socket says 172.21.15.1:34328) 2024-09-19T09:45:31.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.283+0000 7fc17a781640 1 -- 172.21.15.1:0/2700626883 learned_addr learned my addr 172.21.15.1:0/2700626883 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:31.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.284+0000 7fc16affd640 1 -- 172.21.15.1:0/863467166 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fc170042030 con 0x7fc174102d20 2024-09-19T09:45:31.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.284+0000 7fc17a781640 1 -- 172.21.15.1:0/2700626883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583b2218380 msgr2=0x5583b221a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:31.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.284+0000 7fc17a781640 1 --2- 172.21.15.1:0/2700626883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583b2218380 0x5583b221a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:31.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.284+0000 7fc17a781640 1 -- 172.21.15.1:0/2700626883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b22132f0 msgr2=0x5583b2217db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:45:31.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.284+0000 7fc17a781640 1 --2- 172.21.15.1:0/2700626883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b22132f0 0x5583b2217db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:31.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.284+0000 7fc17a781640 1 -- 172.21.15.1:0/2700626883 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583b20fb340 con 0x5583b22129b0 2024-09-19T09:45:31.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.284+0000 7fc17a781640 1 --2- 172.21.15.1:0/2700626883 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5583b22129b0 0x5583b2212db0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009f20 tx=0x7fc16c00c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc3884a0d4388e64 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:31.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.285+0000 7fc15ffff640 1 -- 172.21.15.1:0/2700626883 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c01a070 con 0x5583b22129b0 2024-09-19T09:45:31.291 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.285+0000 7fc15ffff640 1 -- 172.21.15.1:0/2700626883 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc16c0158f0 con 0x5583b22129b0 2024-09-19T09:45:31.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.285+0000 7fc15ffff640 1 -- 172.21.15.1:0/2700626883 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c00aa30 con 0x5583b22129b0 2024-09-19T09:45:31.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.285+0000 7fc16affd640 1 --2- 172.21.15.1:0/863467166 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc1600a3450 0x7fc1600a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:31.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.285+0000 7fc16affd640 1 -- 172.21.15.1:0/863467166 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fc1700f0000 con 0x7fc174102d20 2024-09-19T09:45:31.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.286+0000 7fc17f05b740 1 -- 172.21.15.1:0/2700626883 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5583b22129b0 msgr2=0x5583b2212db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:31.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.286+0000 7fc17f05b740 1 --2- 172.21.15.1:0/2700626883 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5583b22129b0 0x5583b2212db0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009f20 tx=0x7fc16c00c8b0 comp rx=0 tx=0).stop 2024-09-19T09:45:31.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.286+0000 7fc17f05b740 1 -- 172.21.15.1:0/2700626883 shutdown_connections 2024-09-19T09:45:31.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.286+0000 7fc17f05b740 1 --2- 172.21.15.1:0/2700626883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583b2218380 0x5583b221a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:31.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.286+0000 7fc17f05b740 1 --2- 172.21.15.1:0/2700626883 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b22132f0 0x5583b2217db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:31.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.286+0000 7fc17f05b740 1 --2- 172.21.15.1:0/2700626883 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5583b22129b0 0x5583b2212db0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:31.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.286+0000 7fc17f05b740 1 -- 172.21.15.1:0/2700626883 >> 172.21.15.1:0/2700626883 conn(0x5583b220e020 msgr2=0x5583b220e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:31.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.288+0000 7fc179f80640 1 --2- 172.21.15.1:0/863467166 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc1600a3450 0x7fc1600a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:31.292 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.288+0000 7fc17f05b740 1 -- 172.21.15.1:0/2700626883 shutdown_connections 2024-09-19T09:45:31.294 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.289+0000 7fc17f05b740 1 -- 172.21.15.1:0/2700626883 wait complete. 2024-09-19T09:45:31.294 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.289+0000 7fc17f05b740 1 -- start start 2024-09-19T09:45:31.294 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.289+0000 7fc17f05b740 1 Processor -- start 2024-09-19T09:45:31.294 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.290+0000 7fc17f05b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5583b22129b0 0x5583b221ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:31.294 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.290+0000 7fc17f05b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b2218380 0x5583b221d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:31.294 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.290+0000 7fc17f05b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583b2222320 0x5583b2224710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:31.294 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.290+0000 7fc17f05b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5583b221b350 con 0x5583b2218380 2024-09-19T09:45:31.294 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.290+0000 7fc17f05b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5583b20dd290 con 0x5583b2222320 2024-09-19T09:45:31.294 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.290+0000 7fc17f05b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5583b221b4d0 con 0x5583b22129b0 2024-09-19T09:45:31.294 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.290+0000 7fc17f05b740 10 client.0 _ll_register_callbacks cb 0x5583b210e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:45:31.294 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.290+0000 7fc17a781640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583b2222320 0x5583b2224710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:31.294 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.290+0000 7fc17a781640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583b2222320 0x5583b2224710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:53234/0 (socket says 172.21.15.1:53234) 2024-09-19T09:45:31.295 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.290+0000 7fc17a781640 1 -- 172.21.15.1:0/1602290724 learned_addr learned my addr 172.21.15.1:0/1602290724 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:31.295 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.290+0000 7fc179f80640 1 --2- 172.21.15.1:0/1602290724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5583b22129b0 0x5583b221ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:31.295 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.290+0000 7fc17a781640 1 -- 172.21.15.1:0/1602290724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5583b22129b0 msgr2=0x5583b221ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:31.295 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.290+0000 7fc17a781640 1 --2- 172.21.15.1:0/1602290724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5583b22129b0 0x5583b221ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:31.295 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.290+0000 7fc17a781640 1 -- 172.21.15.1:0/1602290724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b2218380 msgr2=0x5583b221d360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:45:31.295 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.290+0000 7fc17a781640 1 --2- 172.21.15.1:0/1602290724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b2218380 0x5583b221d360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:31.295 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.290+0000 7fc17a781640 1 -- 172.21.15.1:0/1602290724 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583b1e67210 con 0x5583b2222320 2024-09-19T09:45:31.295 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.291+0000 7fc179f80640 1 --2- 172.21.15.1:0/863467166 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc1600a3450 0x7fc1600a5910 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x5583b220eea0 tx=0x7fc164006b70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:31.295 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.291+0000 7fc17a781640 1 --2- 172.21.15.1:0/1602290724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583b2222320 0x5583b2224710 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc16c000f80 tx=0x7fc16c015640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b63e49d40dcb9b68 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:31.301 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.299+0000 7fc15d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:45:31.301 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.299+0000 7fc15d7fa640 1 -- 172.21.15.1:0/1602290724 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c01a040 con 0x5583b2222320 2024-09-19T09:45:31.301 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.299+0000 7fc15d7fa640 1 -- 172.21.15.1:0/1602290724 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fc16c00a770 con 0x5583b2222320 2024-09-19T09:45:31.301 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.300+0000 7fc17f05b740 1 -- 172.21.15.1:0/1602290724 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc16c0158f0 con 0x5583b2222320 2024-09-19T09:45:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.306+0000 7fc15d7fa640 1 -- 172.21.15.1:0/1602290724 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc16c009b70 con 0x5583b2222320 2024-09-19T09:45:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.306+0000 7fc17f05b740 10 client.26021 fetch_fsmap learned FSMap version 21 2024-09-19T09:45:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.306+0000 7fc17f05b740 1 -- 172.21.15.1:0/1602290724 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5583b1f33620 con 0x5583b2222320 2024-09-19T09:45:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.309+0000 7fc15d7fa640 1 -- 172.21.15.1:0/1602290724 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc16c0158f0 con 0x5583b2222320 2024-09-19T09:45:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.309+0000 7fc15d7fa640 1 -- 172.21.15.1:0/1602290724 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 21) ==== 8330+0+0 (secure 0 0 0) 0x7fc16c020900 con 0x5583b2222320 2024-09-19T09:45:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.310+0000 7fc17f05b740 10 client.26021 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T09:45:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.310+0000 7fc17f05b740 10 client.26021 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:45:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.310+0000 7fc17f05b740 20 client.26021 populate_metadata read hostname 'smithi001' 2024-09-19T09:45:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.310+0000 7fc17f05b740 1 --2- 172.21.15.1:0/1602290724 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5583b2229220 0x5583b222b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:31.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.310+0000 7fc17f05b740 4 client.26021 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:45:31.312 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.310+0000 7fc17f05b740 1 -- 172.21.15.1:0/1602290724 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583b2161a20 con 0x5583b2229220 2024-09-19T09:45:31.313 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.311+0000 7fc179f80640 1 --2- 172.21.15.1:0/1602290724 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5583b2229220 0x5583b222b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:31.316 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.314+0000 7fc179f80640 1 --2- 172.21.15.1:0/1602290724 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5583b2229220 0x5583b222b640 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7f50a29110ab4bc server_cookie=18f35f3bc0159697 in_seq=0 out_seq=0 2024-09-19T09:45:31.318 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.316+0000 7fc15d7fa640 10 client.26021 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:45:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.320+0000 7fc15d7fa640 1 -- 172.21.15.1:0/1602290724 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5583b2161a20 con 0x5583b2229220 2024-09-19T09:45:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.320+0000 7fc15d7fa640 10 client.26021 handle_command_reply: tid=0 2024-09-19T09:45:31.322 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.320+0000 7fc17f05b740 1 client.26021 shutdown 2024-09-19T09:45:31.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.329+0000 7fc17f05b740 1 -- 172.21.15.1:0/1602290724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583b2222320 msgr2=0x5583b2224710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:31.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.329+0000 7fc17f05b740 1 --2- 172.21.15.1:0/1602290724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583b2222320 0x5583b2224710 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc16c000f80 tx=0x7fc16c015640 comp rx=0 tx=0).stop 2024-09-19T09:45:31.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.329+0000 7fc17f05b740 1 -- 172.21.15.1:0/1602290724 shutdown_connections 2024-09-19T09:45:31.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.329+0000 7fc17f05b740 1 --2- 172.21.15.1:0/1602290724 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5583b2229220 0x5583b222b640 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:31.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.329+0000 7fc17f05b740 1 --2- 172.21.15.1:0/1602290724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583b2222320 0x5583b2224710 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:31.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.329+0000 7fc17f05b740 1 --2- 172.21.15.1:0/1602290724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b2218380 0x5583b221d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:31.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.329+0000 7fc17f05b740 1 --2- 172.21.15.1:0/1602290724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5583b22129b0 0x5583b221ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:31.331 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.329+0000 7fc17f05b740 1 -- 172.21.15.1:0/1602290724 >> 172.21.15.1:0/1602290724 conn(0x5583b220e020 msgr2=0x5583b21eb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:31.332 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.330+0000 7fc15d7fa640 0 client.26021 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:45:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.332+0000 7fc17f05b740 1 -- 172.21.15.1:0/1602290724 shutdown_connections 2024-09-19T09:45:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.334+0000 7fc17f05b740 1 -- 172.21.15.1:0/1602290724 wait complete. 2024-09-19T09:45:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.337+0000 7fc17f05b740 20 client.26021 trim_cache size 0 max 16384 2024-09-19T09:45:31.377 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.376+0000 7fc17f05b740 1 Processor -- start 2024-09-19T09:45:31.378 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.376+0000 7fc17f05b740 1 -- start start 2024-09-19T09:45:31.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.376+0000 7fc17f05b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583b22129b0 0x5583b221b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:31.379 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.376+0000 7fc17f05b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b2218380 0x5583b221ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:31.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.376+0000 7fc17f05b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5583b2222320 0x5583b221d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:31.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.376+0000 7fc17f05b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc15800c550 con 0x5583b2218380 2024-09-19T09:45:31.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.376+0000 7fc17f05b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc15800edf0 con 0x5583b22129b0 2024-09-19T09:45:31.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.376+0000 7fc17f05b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc15800cbe0 con 0x5583b2222320 2024-09-19T09:45:31.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.376+0000 7fc17a781640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5583b2222320 0x5583b221d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:31.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.376+0000 7fc17a781640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5583b2222320 0x5583b221d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:34354/0 (socket says 172.21.15.1:34354) 2024-09-19T09:45:31.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.376+0000 7fc17a781640 1 -- 172.21.15.1:0/3154429719 learned_addr learned my addr 172.21.15.1:0/3154429719 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:31.380 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.377+0000 7fc179f80640 1 --2- 172.21.15.1:0/3154429719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583b22129b0 0x5583b221b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:31.381 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.378+0000 7fc17977f640 1 --2- 172.21.15.1:0/3154429719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b2218380 0x5583b221ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:31.381 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.378+0000 7fc17a781640 1 -- 172.21.15.1:0/3154429719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583b22129b0 msgr2=0x5583b221b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:31.381 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.378+0000 7fc17a781640 1 --2- 172.21.15.1:0/3154429719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583b22129b0 0x5583b221b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:31.381 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.378+0000 7fc17a781640 1 -- 172.21.15.1:0/3154429719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b2218380 msgr2=0x5583b221ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:31.381 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.378+0000 7fc17a781640 1 --2- 172.21.15.1:0/3154429719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b2218380 0x5583b221ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:31.381 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.378+0000 7fc17a781640 1 -- 172.21.15.1:0/3154429719 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583b22140c0 con 0x5583b2222320 2024-09-19T09:45:31.384 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.382+0000 7fc17a781640 1 --2- 172.21.15.1:0/3154429719 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5583b2222320 0x5583b221d360 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc16c004b90 tx=0x7fc16c0071d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c55cf931a08e70b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:31.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.383+0000 7fc15f7fe640 1 -- 172.21.15.1:0/3154429719 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c01a040 con 0x5583b2222320 2024-09-19T09:45:31.385 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.383+0000 7fc15f7fe640 1 -- 172.21.15.1:0/3154429719 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc16c025070 con 0x5583b2222320 2024-09-19T09:45:31.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.383+0000 7fc15f7fe640 1 -- 172.21.15.1:0/3154429719 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c01f750 con 0x5583b2222320 2024-09-19T09:45:31.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.385+0000 7fc17f05b740 1 -- 172.21.15.1:0/3154429719 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5583b2222320 msgr2=0x5583b221d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:31.386 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.385+0000 7fc17f05b740 1 --2- 172.21.15.1:0/3154429719 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5583b2222320 0x5583b221d360 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc16c004b90 tx=0x7fc16c0071d0 comp rx=0 tx=0).stop 2024-09-19T09:45:31.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.385+0000 7fc17f05b740 1 -- 172.21.15.1:0/3154429719 shutdown_connections 2024-09-19T09:45:31.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.385+0000 7fc17f05b740 1 --2- 172.21.15.1:0/3154429719 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5583b2222320 0x5583b221d360 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:31.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.385+0000 7fc17f05b740 1 --2- 172.21.15.1:0/3154429719 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b2218380 0x5583b221ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:31.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.385+0000 7fc17f05b740 1 --2- 172.21.15.1:0/3154429719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583b22129b0 0x5583b221b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:31.387 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.385+0000 7fc17f05b740 1 -- 172.21.15.1:0/3154429719 >> 172.21.15.1:0/3154429719 conn(0x5583b220e020 msgr2=0x5583b22145d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:31.390 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.388+0000 7fc17f05b740 1 -- 172.21.15.1:0/3154429719 shutdown_connections 2024-09-19T09:45:31.392 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.390+0000 7fc17f05b740 1 -- 172.21.15.1:0/3154429719 wait complete. 2024-09-19T09:45:31.392 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.390+0000 7fc17f05b740 1 -- start start 2024-09-19T09:45:31.392 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.390+0000 7fc17f05b740 1 Processor -- start 2024-09-19T09:45:31.393 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.391+0000 7fc17f05b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583b22129b0 0x5583b223a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:31.393 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.391+0000 7fc17f05b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5583b2218380 0x5583b223a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:31.393 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.391+0000 7fc17f05b740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b2222320 0x5583b2291d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:31.393 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.391+0000 7fc17f05b740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc15800d2b0 con 0x5583b2222320 2024-09-19T09:45:31.393 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.391+0000 7fc179f80640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583b22129b0 0x5583b223a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:31.393 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.391+0000 7fc179f80640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583b22129b0 0x5583b223a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:53244/0 (socket says 172.21.15.1:53244) 2024-09-19T09:45:31.393 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.391+0000 7fc179f80640 1 -- 172.21.15.1:0/1407401701 learned_addr learned my addr 172.21.15.1:0/1407401701 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:31.394 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.391+0000 7fc17977f640 1 --2- 172.21.15.1:0/1407401701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5583b2218380 0x5583b223a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:31.394 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.391+0000 7fc17f05b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc15800e720 con 0x5583b22129b0 2024-09-19T09:45:31.394 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.392+0000 7fc17f05b740 1 -- 172.21.15.1:0/1407401701 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc15800d980 con 0x5583b2218380 2024-09-19T09:45:31.394 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.392+0000 7fc17f05b740 10 client.0 _ll_register_callbacks cb 0x7fc16c018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:45:31.394 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.392+0000 7fc17a781640 1 --2- 172.21.15.1:0/1407401701 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b2222320 0x5583b2291d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:31.394 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.392+0000 7fc17977f640 1 -- 172.21.15.1:0/1407401701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583b22129b0 msgr2=0x5583b223a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:31.394 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.392+0000 7fc17977f640 1 --2- 172.21.15.1:0/1407401701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583b22129b0 0x5583b223a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:31.395 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.392+0000 7fc17977f640 1 -- 172.21.15.1:0/1407401701 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b2222320 msgr2=0x5583b2291d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:31.395 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.392+0000 7fc17977f640 1 --2- 172.21.15.1:0/1407401701 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b2222320 0x5583b2291d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:31.395 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.392+0000 7fc17977f640 1 -- 172.21.15.1:0/1407401701 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583b2292290 con 0x5583b2218380 2024-09-19T09:45:31.395 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.393+0000 7fc17977f640 1 --2- 172.21.15.1:0/1407401701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5583b2218380 0x5583b223a870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x5583b221e290 tx=0x7fc1700b9310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27594d25924b2900 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:31.396 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.395+0000 7fc15d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-19T09:45:31.396 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.395+0000 7fc15d7fa640 1 -- 172.21.15.1:0/1407401701 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1700b9910 con 0x5583b2218380 2024-09-19T09:45:31.397 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.395+0000 7fc17f05b740 1 -- 172.21.15.1:0/1407401701 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc16c025070 con 0x5583b2218380 2024-09-19T09:45:31.397 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.395+0000 7fc15d7fa640 1 -- 172.21.15.1:0/1407401701 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fc1700f20d0 con 0x5583b2218380 2024-09-19T09:45:31.397 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.395+0000 7fc15d7fa640 1 -- 172.21.15.1:0/1407401701 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc1700bb840 con 0x5583b2218380 2024-09-19T09:45:31.397 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.395+0000 7fc17f05b740 10 client.25834 fetch_fsmap learned FSMap version 21 2024-09-19T09:45:31.397 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.395+0000 7fc17f05b740 1 -- 172.21.15.1:0/1407401701 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5583b22934d0 con 0x5583b2218380 2024-09-19T09:45:31.398 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.396+0000 7fc15d7fa640 1 -- 172.21.15.1:0/1407401701 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc16c025070 con 0x5583b2218380 2024-09-19T09:45:31.398 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.396+0000 7fc15d7fa640 1 -- 172.21.15.1:0/1407401701 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 21) ==== 8330+0+0 (secure 0 0 0) 0x7fc1700bd960 con 0x5583b2218380 2024-09-19T09:45:31.398 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.396+0000 7fc17f05b740 10 client.25834 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T09:45:31.398 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.396+0000 7fc17f05b740 10 client.25834 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:45:31.398 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.396+0000 7fc17f05b740 20 client.25834 populate_metadata read hostname 'smithi001' 2024-09-19T09:45:31.399 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.396+0000 7fc17f05b740 1 --2- 172.21.15.1:0/1407401701 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5583b2293f00 0x5583b2296320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:31.399 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.396+0000 7fc17f05b740 4 client.25834 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:45:31.399 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.396+0000 7fc17f05b740 1 -- 172.21.15.1:0/1407401701 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5583b215bd70 con 0x5583b2293f00 2024-09-19T09:45:31.400 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.399+0000 7fc179f80640 1 --2- 172.21.15.1:0/1407401701 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5583b2293f00 0x5583b2296320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:31.402 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.400+0000 7fc179f80640 1 --2- 172.21.15.1:0/1407401701 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5583b2293f00 0x5583b2296320 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65ad0eb872905b5f server_cookie=162355927b039cc in_seq=0 out_seq=0 2024-09-19T09:45:31.402 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:31.400+0000 7fc15d7fa640 10 client.25834 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:45:32.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:31 smithi001 ceph-mon[31225]: pgmap v562: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 83 MiB/s wr, 11.59k op/s 2024-09-19T09:45:32.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:31 smithi022 ceph-mon[35583]: pgmap v562: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 83 MiB/s wr, 11.59k op/s 2024-09-19T09:45:32.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:31 smithi121 ceph-mon[35577]: pgmap v562: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 83 MiB/s wr, 11.59k op/s 2024-09-19T09:45:34.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:33 smithi001 ceph-mon[31225]: pgmap v563: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 81 MiB/s wr, 11.41k op/s 2024-09-19T09:45:34.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:33 smithi022 ceph-mon[35583]: pgmap v563: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 81 MiB/s wr, 11.41k op/s 2024-09-19T09:45:34.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:33 smithi121 ceph-mon[35577]: pgmap v563: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 81 MiB/s wr, 11.41k op/s 2024-09-19T09:45:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:34.858+0000 7fc15d7fa640 1 -- 172.21.15.1:0/1407401701 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5583b215bd70 con 0x5583b2293f00 2024-09-19T09:45:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:34.858+0000 7fc15d7fa640 10 client.25834 handle_command_reply: tid=0 2024-09-19T09:45:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:34.858+0000 7fc17f05b740 1 client.25834 shutdown 2024-09-19T09:45:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:34.858+0000 7fc17f05b740 1 -- 172.21.15.1:0/1407401701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5583b2218380 msgr2=0x5583b223a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:34.858+0000 7fc17f05b740 1 --2- 172.21.15.1:0/1407401701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5583b2218380 0x5583b223a870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x5583b221e290 tx=0x7fc1700b9310 comp rx=0 tx=0).stop 2024-09-19T09:45:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:34.858+0000 7fc17f05b740 1 -- 172.21.15.1:0/1407401701 shutdown_connections 2024-09-19T09:45:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:34.858+0000 7fc17f05b740 1 --2- 172.21.15.1:0/1407401701 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5583b2293f00 0x5583b2296320 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:34.858+0000 7fc17f05b740 1 --2- 172.21.15.1:0/1407401701 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5583b2222320 0x5583b2291d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:34.858+0000 7fc17f05b740 1 --2- 172.21.15.1:0/1407401701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5583b2218380 0x5583b223a870 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:34.858+0000 7fc17f05b740 1 --2- 172.21.15.1:0/1407401701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583b22129b0 0x5583b223a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:34.858+0000 7fc17f05b740 1 -- 172.21.15.1:0/1407401701 >> 172.21.15.1:0/1407401701 conn(0x5583b220e020 msgr2=0x5583b221ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:34.858+0000 7fc15d7fa640 0 client.25834 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:45:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:34.859+0000 7fc17f05b740 1 -- 172.21.15.1:0/1407401701 shutdown_connections 2024-09-19T09:45:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:34.859+0000 7fc17f05b740 1 -- 172.21.15.1:0/1407401701 wait complete. 2024-09-19T09:45:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:34.859+0000 7fc17f05b740 20 client.25834 trim_cache size 0 max 16384 2024-09-19T09:45:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:45:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:45:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:45:34.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:45:34.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:34.860+0000 7fc17c1e4640 1 -- 172.21.15.1:0/863467166 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc1600a3450 msgr2=0x7fc1600a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:34.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:34.860+0000 7fc17c1e4640 1 --2- 172.21.15.1:0/863467166 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc1600a3450 0x7fc1600a5910 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x5583b220eea0 tx=0x7fc164006b70 comp rx=0 tx=0).stop 2024-09-19T09:45:34.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:34.860+0000 7fc17c1e4640 1 -- 172.21.15.1:0/863467166 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc174102d20 msgr2=0x7fc174072f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:34.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:34.860+0000 7fc17c1e4640 1 --2- 172.21.15.1:0/863467166 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc174102d20 0x7fc174072f90 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc170031440 tx=0x7fc170032dc0 comp rx=0 tx=0).stop 2024-09-19T09:45:34.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:34.860+0000 7fc17c1e4640 1 -- 172.21.15.1:0/863467166 shutdown_connections 2024-09-19T09:45:34.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:34.860+0000 7fc17c1e4640 1 --2- 172.21.15.1:0/863467166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1741056d0 0x7fc17410c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:34.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:34.860+0000 7fc17c1e4640 1 --2- 172.21.15.1:0/863467166 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc174102d20 0x7fc174072f90 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:34.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:34.860+0000 7fc17c1e4640 1 --2- 172.21.15.1:0/863467166 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc1600a3450 0x7fc1600a5910 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:34.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:34.860+0000 7fc17c1e4640 1 --2- 172.21.15.1:0/863467166 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc1741003d0 0x7fc174072a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:34.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:34.860+0000 7fc17c1e4640 1 -- 172.21.15.1:0/863467166 >> 172.21.15.1:0/863467166 conn(0x7fc1740fc1c0 msgr2=0x7fc1740fc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:34.863 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:34.860+0000 7fc17c1e4640 1 -- 172.21.15.1:0/863467166 shutdown_connections 2024-09-19T09:45:34.864 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:34.860+0000 7fc17c1e4640 1 -- 172.21.15.1:0/863467166 wait complete. 2024-09-19T09:45:34.917 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:45:35.885 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:45:35.885 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:45:36.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:35 smithi001 ceph-mon[31225]: pgmap v564: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 83 MiB/s wr, 11.51k op/s 2024-09-19T09:45:36.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:35 smithi022 ceph-mon[35583]: pgmap v564: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 83 MiB/s wr, 11.51k op/s 2024-09-19T09:45:36.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:35 smithi121 ceph-mon[35577]: pgmap v564: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 83 MiB/s wr, 11.51k op/s 2024-09-19T09:45:38.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:37 smithi001 ceph-mon[31225]: pgmap v565: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 77 MiB/s wr, 10.76k op/s 2024-09-19T09:45:38.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:37 smithi022 ceph-mon[35583]: pgmap v565: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 77 MiB/s wr, 10.76k op/s 2024-09-19T09:45:38.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:37 smithi121 ceph-mon[35577]: pgmap v565: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 77 MiB/s wr, 10.76k op/s 2024-09-19T09:45:40.151 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:39 smithi001 ceph-mon[31225]: pgmap v566: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 77 MiB/s wr, 10.70k op/s 2024-09-19T09:45:40.151 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:39 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:45:40.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:39 smithi022 ceph-mon[35583]: pgmap v566: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 77 MiB/s wr, 10.70k op/s 2024-09-19T09:45:40.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:39 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:45:40.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:39 smithi121 ceph-mon[35577]: pgmap v566: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 77 MiB/s wr, 10.70k op/s 2024-09-19T09:45:40.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:39 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:45:41.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:40 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:45:41.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:41 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:45:41.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:41 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:45:41.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:41 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:45:41.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:41 smithi001 ceph-mon[31225]: Adjusting osd_memory_target on smithi121 to 175.9M 2024-09-19T09:45:41.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:41 smithi001 ceph-mon[31225]: Unable to set osd_memory_target on smithi121 to 184531558: error parsing value: Value '184531558' is below minimum 939524096 2024-09-19T09:45:41.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:41 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:45:41.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:41 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:45:41.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:41 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:45:41.249 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:41 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:45:41.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:40 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:45:41.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:40 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:45:41.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:40 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:45:41.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:40 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:45:41.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:40 smithi022 ceph-mon[35583]: Adjusting osd_memory_target on smithi121 to 175.9M 2024-09-19T09:45:41.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:40 smithi022 ceph-mon[35583]: Unable to set osd_memory_target on smithi121 to 184531558: error parsing value: Value '184531558' is below minimum 939524096 2024-09-19T09:45:41.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:40 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:45:41.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:40 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:45:41.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:40 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:45:41.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:40 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:45:41.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:40 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:45:41.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:40 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:45:41.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:40 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:45:41.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:40 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:45:41.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:40 smithi121 ceph-mon[35577]: Adjusting osd_memory_target on smithi121 to 175.9M 2024-09-19T09:45:41.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:40 smithi121 ceph-mon[35577]: Unable to set osd_memory_target on smithi121 to 184531558: error parsing value: Value '184531558' is below minimum 939524096 2024-09-19T09:45:41.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:40 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:45:41.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:40 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:45:41.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:40 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:45:41.368 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:40 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T09:45:41.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.269+0000 7f405328d640 1 -- 172.21.15.1:0/2471942261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f404c101de0 msgr2=0x7f404c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:41.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.269+0000 7f405328d640 1 --2- 172.21.15.1:0/2471942261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f404c101de0 0x7f404c1021c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f4044009ca0 tx=0x7f404402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:45:41.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.269+0000 7f405328d640 1 -- 172.21.15.1:0/2471942261 shutdown_connections 2024-09-19T09:45:41.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.269+0000 7f405328d640 1 --2- 172.21.15.1:0/2471942261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f404c106f10 0x7f404c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:41.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.269+0000 7f405328d640 1 --2- 172.21.15.1:0/2471942261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f404c102790 0x7f404c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:41.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.269+0000 7f405328d640 1 --2- 172.21.15.1:0/2471942261 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f404c101de0 0x7f404c1021c0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:41.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.269+0000 7f405328d640 1 -- 172.21.15.1:0/2471942261 >> 172.21.15.1:0/2471942261 conn(0x7f404c0fd8c0 msgr2=0x7f404c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:41.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.269+0000 7f405328d640 1 -- 172.21.15.1:0/2471942261 shutdown_connections 2024-09-19T09:45:41.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.269+0000 7f405328d640 1 -- 172.21.15.1:0/2471942261 wait complete. 2024-09-19T09:45:41.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.270+0000 7f405328d640 1 Processor -- start 2024-09-19T09:45:41.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.270+0000 7f405328d640 1 -- start start 2024-09-19T09:45:41.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.270+0000 7f405328d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f404c101de0 0x7f404c198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:41.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.270+0000 7f405328d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f404c102790 0x7f404c198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:41.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.270+0000 7f405328d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f404c106f10 0x7f404c19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:41.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.270+0000 7f405328d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f404c111f70 con 0x7f404c101de0 2024-09-19T09:45:41.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.271+0000 7f405328d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f404c111df0 con 0x7f404c106f10 2024-09-19T09:45:41.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.271+0000 7f405328d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f404c1120f0 con 0x7f404c102790 2024-09-19T09:45:41.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.271+0000 7f4051029640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f404c101de0 0x7f404c198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:41.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.271+0000 7f4051029640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f404c101de0 0x7f404c198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47144/0 (socket says 172.21.15.1:47144) 2024-09-19T09:45:41.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.271+0000 7f4051029640 1 -- 172.21.15.1:0/2226493844 learned_addr learned my addr 172.21.15.1:0/2226493844 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:41.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.271+0000 7f4051029640 1 -- 172.21.15.1:0/2226493844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f404c102790 msgr2=0x7f404c198970 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:45:41.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.271+0000 7f4051029640 1 --2- 172.21.15.1:0/2226493844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f404c102790 0x7f404c198970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:41.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.271+0000 7f4051029640 1 -- 172.21.15.1:0/2226493844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f404c106f10 msgr2=0x7f404c19cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:41.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.271+0000 7f4051029640 1 --2- 172.21.15.1:0/2226493844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f404c106f10 0x7f404c19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:41.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.271+0000 7f4051029640 1 -- 172.21.15.1:0/2226493844 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f404c19d3e0 con 0x7f404c101de0 2024-09-19T09:45:41.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.271+0000 7f4051029640 1 --2- 172.21.15.1:0/2226493844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f404c101de0 0x7f404c198430 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f404402ade0 tx=0x7f40440319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:41.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.271+0000 7f404a7fc640 1 -- 172.21.15.1:0/2226493844 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404402fa20 con 0x7f404c101de0 2024-09-19T09:45:41.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.271+0000 7f404a7fc640 1 -- 172.21.15.1:0/2226493844 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f404402fbc0 con 0x7f404c101de0 2024-09-19T09:45:41.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.272+0000 7f404a7fc640 1 -- 172.21.15.1:0/2226493844 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40440467b0 con 0x7f404c101de0 2024-09-19T09:45:41.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.272+0000 7f405328d640 1 -- 172.21.15.1:0/2226493844 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f404c19d670 con 0x7f404c101de0 2024-09-19T09:45:41.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.272+0000 7f405328d640 1 -- 172.21.15.1:0/2226493844 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f404c1a4fb0 con 0x7f404c101de0 2024-09-19T09:45:41.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.274+0000 7f404a7fc640 1 -- 172.21.15.1:0/2226493844 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f4044046950 con 0x7f404c101de0 2024-09-19T09:45:41.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.275+0000 7f404a7fc640 1 --2- 172.21.15.1:0/2226493844 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f40340a3240 0x7f40340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:41.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.275+0000 7f4055666740 1 Processor -- start 2024-09-19T09:45:41.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.275+0000 7f404a7fc640 1 -- 172.21.15.1:0/2226493844 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f40440f13f0 con 0x7f404c101de0 2024-09-19T09:45:41.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.275+0000 7f4050828640 1 --2- 172.21.15.1:0/2226493844 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f40340a3240 0x7f40340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:41.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.275+0000 7f4055666740 1 -- start start 2024-09-19T09:45:41.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.275+0000 7f4055666740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560acf563760 0x560acf563b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:41.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.275+0000 7f4055666740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560acf564080 0x560acf56e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:41.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.275+0000 7f4055666740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560acf56e940 0x560acf570d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:41.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.275+0000 7f4055666740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560acf4c92a0 con 0x560acf563760 2024-09-19T09:45:41.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.275+0000 7f4055666740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560acf470b10 con 0x560acf56e940 2024-09-19T09:45:41.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.275+0000 7f4055666740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x560acf4c5260 con 0x560acf564080 2024-09-19T09:45:41.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.275+0000 7f4051029640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560acf563760 0x560acf563b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:41.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.275+0000 7f4051029640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560acf563760 0x560acf563b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47158/0 (socket says 172.21.15.1:47158) 2024-09-19T09:45:41.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.275+0000 7f4051029640 1 -- 172.21.15.1:0/2177783570 learned_addr learned my addr 172.21.15.1:0/2177783570 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:41.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.276+0000 7f4050828640 1 --2- 172.21.15.1:0/2177783570 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560acf564080 0x560acf56e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:41.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.276+0000 7f405182a640 1 --2- 172.21.15.1:0/2177783570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560acf56e940 0x560acf570d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:41.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.276+0000 7f4050828640 1 --2- 172.21.15.1:0/2226493844 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f40340a3240 0x7f40340a5700 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f404c0fdce0 tx=0x7f404000b370 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:41.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.276+0000 7f4051029640 1 -- 172.21.15.1:0/2177783570 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560acf564080 msgr2=0x560acf56e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:41.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.276+0000 7f4051029640 1 --2- 172.21.15.1:0/2177783570 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560acf564080 0x560acf56e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:41.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.276+0000 7f4051029640 1 -- 172.21.15.1:0/2177783570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560acf56e940 msgr2=0x560acf570d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:41.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.276+0000 7f4051029640 1 --2- 172.21.15.1:0/2177783570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560acf56e940 0x560acf570d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:41.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.276+0000 7f4051029640 1 -- 172.21.15.1:0/2177783570 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560acf23ab90 con 0x560acf563760 2024-09-19T09:45:41.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.276+0000 7f4050828640 1 --2- 172.21.15.1:0/2177783570 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560acf564080 0x560acf56e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:45:41.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.276+0000 7f4051029640 1 --2- 172.21.15.1:0/2177783570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560acf563760 0x560acf563b40 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f40440ba470 tx=0x7f4044045520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17d3c1303f46d74 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:41.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.276+0000 7f40337fe640 1 -- 172.21.15.1:0/2177783570 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40440c6680 con 0x560acf563760 2024-09-19T09:45:41.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.276+0000 7f40337fe640 1 -- 172.21.15.1:0/2177783570 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4044036070 con 0x560acf563760 2024-09-19T09:45:41.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.276+0000 7f40337fe640 1 -- 172.21.15.1:0/2177783570 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40440a80e0 con 0x560acf563760 2024-09-19T09:45:41.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.277+0000 7f4055666740 1 -- 172.21.15.1:0/2177783570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560acf563760 msgr2=0x560acf563b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:41.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.277+0000 7f4055666740 1 --2- 172.21.15.1:0/2177783570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560acf563760 0x560acf563b40 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f40440ba470 tx=0x7f4044045520 comp rx=0 tx=0).stop 2024-09-19T09:45:41.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.277+0000 7f4055666740 1 -- 172.21.15.1:0/2177783570 shutdown_connections 2024-09-19T09:45:41.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.277+0000 7f4055666740 1 --2- 172.21.15.1:0/2177783570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560acf56e940 0x560acf570d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:41.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.277+0000 7f4055666740 1 --2- 172.21.15.1:0/2177783570 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560acf564080 0x560acf56e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:41.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.277+0000 7f4055666740 1 --2- 172.21.15.1:0/2177783570 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560acf563760 0x560acf563b40 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:41.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.277+0000 7f4055666740 1 -- 172.21.15.1:0/2177783570 >> 172.21.15.1:0/2177783570 conn(0x560acf55fcf0 msgr2=0x560acf5600d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:41.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.277+0000 7f4055666740 1 -- 172.21.15.1:0/2177783570 shutdown_connections 2024-09-19T09:45:41.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.277+0000 7f4055666740 1 -- 172.21.15.1:0/2177783570 wait complete. 2024-09-19T09:45:41.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.277+0000 7f4055666740 1 -- start start 2024-09-19T09:45:41.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.278+0000 7f4055666740 1 Processor -- start 2024-09-19T09:45:41.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.278+0000 7f4055666740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560acf563760 0x560acf56b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:41.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.278+0000 7f4055666740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560acf564080 0x560acf56bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:41.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.278+0000 7f4055666740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560acf56e940 0x560acf56c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:41.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.278+0000 7f4055666740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560acf4c92a0 con 0x560acf563760 2024-09-19T09:45:41.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.278+0000 7f4055666740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560acf4516e0 con 0x560acf56e940 2024-09-19T09:45:41.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.278+0000 7f4055666740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x560acf5712d0 con 0x560acf564080 2024-09-19T09:45:41.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.278+0000 7f4055666740 10 client.0 _ll_register_callbacks cb 0x560acf475a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:45:41.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.278+0000 7f4051029640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560acf563760 0x560acf56b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:41.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.278+0000 7f4051029640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560acf563760 0x560acf56b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47162/0 (socket says 172.21.15.1:47162) 2024-09-19T09:45:41.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.278+0000 7f4051029640 1 -- 172.21.15.1:0/2128617023 learned_addr learned my addr 172.21.15.1:0/2128617023 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:41.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.278+0000 7f4051029640 1 -- 172.21.15.1:0/2128617023 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560acf564080 msgr2=0x560acf56bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:41.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.278+0000 7f4051029640 1 --2- 172.21.15.1:0/2128617023 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560acf564080 0x560acf56bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:41.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.278+0000 7f4051029640 1 -- 172.21.15.1:0/2128617023 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560acf56e940 msgr2=0x560acf56c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:41.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.278+0000 7f4051029640 1 --2- 172.21.15.1:0/2128617023 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560acf56e940 0x560acf56c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:41.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.278+0000 7f4051029640 1 -- 172.21.15.1:0/2128617023 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560acf57a5b0 con 0x560acf563760 2024-09-19T09:45:41.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.279+0000 7f4051029640 1 --2- 172.21.15.1:0/2128617023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560acf563760 0x560acf56b820 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f40440b9f00 tx=0x7f40440c1fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f12479f56001db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:41.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.279+0000 7f4030ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:45:41.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.279+0000 7f4030ff9640 1 -- 172.21.15.1:0/2128617023 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4044046c40 con 0x560acf563760 2024-09-19T09:45:41.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.279+0000 7f4030ff9640 1 -- 172.21.15.1:0/2128617023 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f4044046de0 con 0x560acf563760 2024-09-19T09:45:41.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.279+0000 7f4055666740 1 -- 172.21.15.1:0/2128617023 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4044036070 con 0x560acf563760 2024-09-19T09:45:41.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.279+0000 7f4030ff9640 1 -- 172.21.15.1:0/2128617023 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f40440c61f0 con 0x560acf563760 2024-09-19T09:45:41.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.279+0000 7f4055666740 10 client.16365 fetch_fsmap learned FSMap version 21 2024-09-19T09:45:41.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.279+0000 7f4055666740 1 -- 172.21.15.1:0/2128617023 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x560acf57cf40 con 0x560acf563760 2024-09-19T09:45:41.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.279+0000 7f4030ff9640 1 -- 172.21.15.1:0/2128617023 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4044036070 con 0x560acf563760 2024-09-19T09:45:41.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.280+0000 7f4030ff9640 1 -- 172.21.15.1:0/2128617023 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8330+0+0 (secure 0 0 0) 0x7f404404e030 con 0x560acf563760 2024-09-19T09:45:41.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.280+0000 7f4055666740 10 client.16365 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T09:45:41.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.280+0000 7f4055666740 10 client.16365 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:45:41.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.280+0000 7f4055666740 20 client.16365 populate_metadata read hostname 'smithi001' 2024-09-19T09:45:41.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.280+0000 7f4055666740 1 --2- 172.21.15.1:0/2128617023 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x560acf57e330 0x560acf5807d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:41.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.280+0000 7f4055666740 4 client.16365 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:45:41.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.280+0000 7f4055666740 1 -- 172.21.15.1:0/2128617023 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560acf4d69d0 con 0x560acf57e330 2024-09-19T09:45:41.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.280+0000 7f4050828640 1 --2- 172.21.15.1:0/2128617023 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x560acf57e330 0x560acf5807d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:41.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.282+0000 7f4050828640 1 --2- 172.21.15.1:0/2128617023 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x560acf57e330 0x560acf5807d0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4e57cd6393ba6d8 server_cookie=64e047db6d9bc7ab in_seq=0 out_seq=0 2024-09-19T09:45:41.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.282+0000 7f4030ff9640 10 client.16365 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:45:41.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.283+0000 7f4030ff9640 1 -- 172.21.15.1:0/2128617023 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560acf4d69d0 con 0x560acf57e330 2024-09-19T09:45:41.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.283+0000 7f4030ff9640 10 client.16365 handle_command_reply: tid=0 2024-09-19T09:45:41.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.283+0000 7f4055666740 1 client.16365 shutdown 2024-09-19T09:45:41.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.284+0000 7f4055666740 1 -- 172.21.15.1:0/2128617023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560acf563760 msgr2=0x560acf56b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:41.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.284+0000 7f4055666740 1 --2- 172.21.15.1:0/2128617023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560acf563760 0x560acf56b820 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f40440b9f00 tx=0x7f40440c1fa0 comp rx=0 tx=0).stop 2024-09-19T09:45:41.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.284+0000 7f4055666740 1 -- 172.21.15.1:0/2128617023 shutdown_connections 2024-09-19T09:45:41.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.284+0000 7f4055666740 1 --2- 172.21.15.1:0/2128617023 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x560acf57e330 0x560acf5807d0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:41.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.284+0000 7f4055666740 1 --2- 172.21.15.1:0/2128617023 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560acf56e940 0x560acf56c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:41.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.284+0000 7f4055666740 1 --2- 172.21.15.1:0/2128617023 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560acf564080 0x560acf56bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:41.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.284+0000 7f4030ff9640 0 client.16365 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:45:41.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.284+0000 7f4055666740 1 --2- 172.21.15.1:0/2128617023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560acf563760 0x560acf56b820 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:41.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.284+0000 7f4055666740 1 -- 172.21.15.1:0/2128617023 >> 172.21.15.1:0/2128617023 conn(0x560acf55fcf0 msgr2=0x560acf55ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:41.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.284+0000 7f4055666740 1 -- 172.21.15.1:0/2128617023 shutdown_connections 2024-09-19T09:45:41.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.284+0000 7f4055666740 1 -- 172.21.15.1:0/2128617023 wait complete. 2024-09-19T09:45:41.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.284+0000 7f4055666740 20 client.16365 trim_cache size 0 max 16384 2024-09-19T09:45:41.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.303+0000 7f4055666740 1 Processor -- start 2024-09-19T09:45:41.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.303+0000 7f4055666740 1 -- start start 2024-09-19T09:45:41.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.304+0000 7f4055666740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560acf563760 0x560acf5860e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:41.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.304+0000 7f4055666740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560acf564080 0x560acf586620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:41.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.304+0000 7f4055666740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560acf56e940 0x560acf568a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:41.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.304+0000 7f4055666740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f404c1ab5f0 con 0x560acf563760 2024-09-19T09:45:41.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.304+0000 7f4055666740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f404c1ade90 con 0x560acf564080 2024-09-19T09:45:41.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.304+0000 7f4055666740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f404c1abc80 con 0x560acf56e940 2024-09-19T09:45:41.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.304+0000 7f4051029640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560acf563760 0x560acf5860e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:41.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.304+0000 7f4051029640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560acf563760 0x560acf5860e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:47178/0 (socket says 172.21.15.1:47178) 2024-09-19T09:45:41.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.304+0000 7f4051029640 1 -- 172.21.15.1:0/4257465389 learned_addr learned my addr 172.21.15.1:0/4257465389 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:41.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.304+0000 7f4050828640 1 --2- 172.21.15.1:0/4257465389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560acf564080 0x560acf586620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:41.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.304+0000 7f405182a640 1 --2- 172.21.15.1:0/4257465389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560acf56e940 0x560acf568a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:41.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.304+0000 7f4051029640 1 -- 172.21.15.1:0/4257465389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560acf56e940 msgr2=0x560acf568a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:41.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.304+0000 7f4051029640 1 --2- 172.21.15.1:0/4257465389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560acf56e940 0x560acf568a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:41.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.304+0000 7f4051029640 1 -- 172.21.15.1:0/4257465389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560acf564080 msgr2=0x560acf586620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:41.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.304+0000 7f4051029640 1 --2- 172.21.15.1:0/4257465389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560acf564080 0x560acf586620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:41.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.304+0000 7f4051029640 1 -- 172.21.15.1:0/4257465389 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560acf560da0 con 0x560acf563760 2024-09-19T09:45:41.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.304+0000 7f4051029640 1 --2- 172.21.15.1:0/4257465389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560acf563760 0x560acf5860e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f40440ba470 tx=0x7f40440bbfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33c80d1bd689d682 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:41.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.304+0000 7f4032ffd640 1 -- 172.21.15.1:0/4257465389 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40440b9d40 con 0x560acf563760 2024-09-19T09:45:41.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.305+0000 7f4032ffd640 1 -- 172.21.15.1:0/4257465389 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4044036070 con 0x560acf563760 2024-09-19T09:45:41.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.305+0000 7f4032ffd640 1 -- 172.21.15.1:0/4257465389 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40440bd010 con 0x560acf563760 2024-09-19T09:45:41.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.305+0000 7f4055666740 1 -- 172.21.15.1:0/4257465389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560acf563760 msgr2=0x560acf5860e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:41.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.306+0000 7f4055666740 1 --2- 172.21.15.1:0/4257465389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560acf563760 0x560acf5860e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f40440ba470 tx=0x7f40440bbfb0 comp rx=0 tx=0).stop 2024-09-19T09:45:41.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.306+0000 7f4055666740 1 -- 172.21.15.1:0/4257465389 shutdown_connections 2024-09-19T09:45:41.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.306+0000 7f4055666740 1 --2- 172.21.15.1:0/4257465389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560acf56e940 0x560acf568a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:41.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.306+0000 7f4055666740 1 --2- 172.21.15.1:0/4257465389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560acf564080 0x560acf586620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:41.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.306+0000 7f4055666740 1 --2- 172.21.15.1:0/4257465389 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560acf563760 0x560acf5860e0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:41.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.306+0000 7f4055666740 1 -- 172.21.15.1:0/4257465389 >> 172.21.15.1:0/4257465389 conn(0x560acf55fcf0 msgr2=0x560acf56d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:41.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.322+0000 7f4055666740 1 -- 172.21.15.1:0/4257465389 shutdown_connections 2024-09-19T09:45:41.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.323+0000 7f4055666740 1 -- 172.21.15.1:0/4257465389 wait complete. 2024-09-19T09:45:41.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.323+0000 7f4055666740 1 -- start start 2024-09-19T09:45:41.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.324+0000 7f4055666740 1 Processor -- start 2024-09-19T09:45:41.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.324+0000 7f4055666740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560acf563760 0x560acf572990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:41.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.325+0000 7f4055666740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560acf564080 0x560acf572ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:41.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.325+0000 7f4055666740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560acf56e940 0x560acf5e80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:41.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.325+0000 7f4055666740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f404c1ac350 con 0x560acf563760 2024-09-19T09:45:41.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.325+0000 7f4055666740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f404c1ad7c0 con 0x560acf564080 2024-09-19T09:45:41.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.325+0000 7f4055666740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f404c1aca20 con 0x560acf56e940 2024-09-19T09:45:41.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.325+0000 7f4050828640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560acf564080 0x560acf572ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:41.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.325+0000 7f4050828640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560acf564080 0x560acf572ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:50428/0 (socket says 172.21.15.1:50428) 2024-09-19T09:45:41.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.325+0000 7f4050828640 1 -- 172.21.15.1:0/1980588964 learned_addr learned my addr 172.21.15.1:0/1980588964 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:41.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.325+0000 7f4055666740 10 client.0 _ll_register_callbacks cb 0x7f40440bbb40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:45:41.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.326+0000 7f405182a640 1 --2- 172.21.15.1:0/1980588964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560acf56e940 0x560acf5e80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:41.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.326+0000 7f4050828640 1 -- 172.21.15.1:0/1980588964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560acf56e940 msgr2=0x560acf5e80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:41.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.326+0000 7f4050828640 1 --2- 172.21.15.1:0/1980588964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560acf56e940 0x560acf5e80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:41.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.326+0000 7f4050828640 1 -- 172.21.15.1:0/1980588964 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560acf563760 msgr2=0x560acf572990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:41.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.326+0000 7f4050828640 1 --2- 172.21.15.1:0/1980588964 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560acf563760 0x560acf572990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:41.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.326+0000 7f4050828640 1 -- 172.21.15.1:0/1980588964 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560acf55b260 con 0x560acf564080 2024-09-19T09:45:41.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.327+0000 7f4050828640 1 --2- 172.21.15.1:0/1980588964 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560acf564080 0x560acf572ed0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x560acf560b50 tx=0x7f4040004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2b879014f42ec9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:41.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.327+0000 7f4030ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:45:41.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.327+0000 7f4030ff9640 1 -- 172.21.15.1:0/1980588964 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404001e5f0 con 0x560acf564080 2024-09-19T09:45:41.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.327+0000 7f4055666740 1 -- 172.21.15.1:0/1980588964 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4044036070 con 0x560acf564080 2024-09-19T09:45:41.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.328+0000 7f4030ff9640 1 -- 172.21.15.1:0/1980588964 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f404001e790 con 0x560acf564080 2024-09-19T09:45:41.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.328+0000 7f4030ff9640 1 -- 172.21.15.1:0/1980588964 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4040033050 con 0x560acf564080 2024-09-19T09:45:41.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.328+0000 7f4055666740 10 client.26039 fetch_fsmap learned FSMap version 21 2024-09-19T09:45:41.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.328+0000 7f4055666740 1 -- 172.21.15.1:0/1980588964 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x560acf563590 con 0x560acf564080 2024-09-19T09:45:41.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.329+0000 7f4030ff9640 1 -- 172.21.15.1:0/1980588964 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4040029070 con 0x560acf564080 2024-09-19T09:45:41.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.330+0000 7f4030ff9640 1 -- 172.21.15.1:0/1980588964 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 21) ==== 8330+0+0 (secure 0 0 0) 0x7f4040036020 con 0x560acf564080 2024-09-19T09:45:41.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.330+0000 7f4055666740 10 client.26039 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T09:45:41.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.330+0000 7f4055666740 10 client.26039 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:45:41.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.330+0000 7f4055666740 20 client.26039 populate_metadata read hostname 'smithi001' 2024-09-19T09:45:41.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.330+0000 7f4055666740 1 --2- 172.21.15.1:0/1980588964 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x560acf5ee260 0x560acf5f0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:41.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.331+0000 7f4055666740 4 client.26039 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}] 2024-09-19T09:45:41.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.331+0000 7f4055666740 1 -- 172.21.15.1:0/1980588964 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}) -- 0x7f4044036070 con 0x560acf5ee260 2024-09-19T09:45:41.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.332+0000 7f4051029640 1 --2- 172.21.15.1:0/1980588964 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x560acf5ee260 0x560acf5f0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:41.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.333+0000 7f4051029640 1 --2- 172.21.15.1:0/1980588964 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x560acf5ee260 0x560acf5f0720 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b43df154cc6907a5 server_cookie=1e5109f33b84dba3 in_seq=0 out_seq=0 2024-09-19T09:45:41.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:40.335+0000 7f4030ff9640 10 client.26039 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:45:41.719 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:45:42.197 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:42 smithi001 ceph-mon[31225]: pgmap v567: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 88 MiB/s wr, 11.86k op/s 2024-09-19T09:45:42.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:42 smithi022 ceph-mon[35583]: pgmap v567: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 88 MiB/s wr, 11.86k op/s 2024-09-19T09:45:42.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:42 smithi022 ceph-mon[35583]: Adjusting osd_memory_target on smithi022 to 177.0M 2024-09-19T09:45:42.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:42 smithi022 ceph-mon[35583]: Unable to set osd_memory_target on smithi022 to 185698508: error parsing value: Value '185698508' is below minimum 939524096 2024-09-19T09:45:42.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:42 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:42.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:42 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:45:42.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:42 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:45:42.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:42 smithi121 ceph-mon[35577]: pgmap v567: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 88 MiB/s wr, 11.86k op/s 2024-09-19T09:45:42.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:42 smithi121 ceph-mon[35577]: Adjusting osd_memory_target on smithi022 to 177.0M 2024-09-19T09:45:42.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:42 smithi121 ceph-mon[35577]: Unable to set osd_memory_target on smithi022 to 185698508: error parsing value: Value '185698508' is below minimum 939524096 2024-09-19T09:45:42.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:42 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:42.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:42 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:45:42.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:42 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:45:42.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:42 smithi001 ceph-mon[31225]: Adjusting osd_memory_target on smithi022 to 177.0M 2024-09-19T09:45:42.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:42 smithi001 ceph-mon[31225]: Unable to set osd_memory_target on smithi022 to 185698508: error parsing value: Value '185698508' is below minimum 939524096 2024-09-19T09:45:42.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:42 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:45:42.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:42 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:45:42.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:42 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:45:44.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:44 smithi022 ceph-mon[35583]: pgmap v568: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 81 MiB/s wr, 10.82k op/s 2024-09-19T09:45:44.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:44 smithi121 ceph-mon[35577]: pgmap v568: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 81 MiB/s wr, 10.82k op/s 2024-09-19T09:45:44.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:44 smithi001 ceph-mon[31225]: pgmap v568: 97 pgs: 97 active+clean; 13 GiB data, 44 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 81 MiB/s wr, 10.82k op/s 2024-09-19T09:45:46.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:46 smithi022 ceph-mon[35583]: pgmap v569: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 95 MiB/s wr, 13.11k op/s 2024-09-19T09:45:46.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:46 smithi121 ceph-mon[35577]: pgmap v569: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 95 MiB/s wr, 13.11k op/s 2024-09-19T09:45:46.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:46 smithi001 ceph-mon[31225]: pgmap v569: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 95 MiB/s wr, 13.11k op/s 2024-09-19T09:45:48.002 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.985+0000 7f7f70a8d640 1 -- 172.21.15.1:0/2916312760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f6c102d30 msgr2=0x7f7f6c1031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:48.002 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.985+0000 7f7f70a8d640 1 --2- 172.21.15.1:0/2916312760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f6c102d30 0x7f7f6c1031b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f7f60009900 tx=0x7f7f6002a410 comp rx=0 tx=0).stop 2024-09-19T09:45:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.985+0000 7f7f70a8d640 1 -- 172.21.15.1:0/2916312760 shutdown_connections 2024-09-19T09:45:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.985+0000 7f7f70a8d640 1 --2- 172.21.15.1:0/2916312760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f6c1036f0 0x7f7f6c109f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.985+0000 7f7f70a8d640 1 --2- 172.21.15.1:0/2916312760 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f6c102d30 0x7f7f6c1031b0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.985+0000 7f7f70a8d640 1 --2- 172.21.15.1:0/2916312760 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f6c101b40 0x7f7f6c101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.985+0000 7f7f70a8d640 1 -- 172.21.15.1:0/2916312760 >> 172.21.15.1:0/2916312760 conn(0x7f7f6c0fd2e0 msgr2=0x7f7f6c0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.985+0000 7f7f70a8d640 1 -- 172.21.15.1:0/2916312760 shutdown_connections 2024-09-19T09:45:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.985+0000 7f7f70a8d640 1 -- 172.21.15.1:0/2916312760 wait complete. 2024-09-19T09:45:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.986+0000 7f7f70a8d640 1 Processor -- start 2024-09-19T09:45:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.986+0000 7f7f70a8d640 1 -- start start 2024-09-19T09:45:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.986+0000 7f7f70a8d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f6c101b40 0x7f7f6c19a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.986+0000 7f7f70a8d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f6c102d30 0x7f7f6c19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.003 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.986+0000 7f7f70a8d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f6c1036f0 0x7f7f6c1a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.986+0000 7f7f70a8d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c10fa60 con 0x7f7f6c1036f0 2024-09-19T09:45:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.986+0000 7f7f70a8d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c10f8e0 con 0x7f7f6c101b40 2024-09-19T09:45:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.986+0000 7f7f70a8d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c10fbe0 con 0x7f7f6c102d30 2024-09-19T09:45:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.986+0000 7f7f6ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f6c1036f0 0x7f7f6c1a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.986+0000 7f7f6ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f6c1036f0 0x7f7f6c1a1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42144/0 (socket says 172.21.15.1:42144) 2024-09-19T09:45:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.986+0000 7f7f6ad9d640 1 -- 172.21.15.1:0/3380188111 learned_addr learned my addr 172.21.15.1:0/3380188111 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.986+0000 7f7f69d9b640 1 --2- 172.21.15.1:0/3380188111 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f6c102d30 0x7f7f6c19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.986+0000 7f7f6a59c640 1 --2- 172.21.15.1:0/3380188111 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f6c101b40 0x7f7f6c19a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.986+0000 7f7f6ad9d640 1 -- 172.21.15.1:0/3380188111 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f6c102d30 msgr2=0x7f7f6c19a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.986+0000 7f7f6ad9d640 1 --2- 172.21.15.1:0/3380188111 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f6c102d30 0x7f7f6c19a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.004 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.986+0000 7f7f6ad9d640 1 -- 172.21.15.1:0/3380188111 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f6c101b40 msgr2=0x7f7f6c19a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.986+0000 7f7f6ad9d640 1 --2- 172.21.15.1:0/3380188111 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f6c101b40 0x7f7f6c19a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.986+0000 7f7f6ad9d640 1 -- 172.21.15.1:0/3380188111 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f6c1a1d00 con 0x7f7f6c1036f0 2024-09-19T09:45:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.986+0000 7f7f69d9b640 1 --2- 172.21.15.1:0/3380188111 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f6c102d30 0x7f7f6c19a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:45:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.986+0000 7f7f6ad9d640 1 --2- 172.21.15.1:0/3380188111 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f6c1036f0 0x7f7f6c1a1690 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009fd0 tx=0x7f7f6400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.987+0000 7f7f5b7fe640 1 -- 172.21.15.1:0/3380188111 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f64017070 con 0x7f7f6c1036f0 2024-09-19T09:45:48.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.987+0000 7f7f5b7fe640 1 -- 172.21.15.1:0/3380188111 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f64003e50 con 0x7f7f6c1036f0 2024-09-19T09:45:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.987+0000 7f7f5b7fe640 1 -- 172.21.15.1:0/3380188111 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f640106c0 con 0x7f7f6c1036f0 2024-09-19T09:45:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.987+0000 7f7f70a8d640 1 -- 172.21.15.1:0/3380188111 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f6c1a1ff0 con 0x7f7f6c1036f0 2024-09-19T09:45:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.987+0000 7f7f70a8d640 1 -- 172.21.15.1:0/3380188111 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f6c1a2460 con 0x7f7f6c1036f0 2024-09-19T09:45:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.990+0000 7f7f5b7fe640 1 -- 172.21.15.1:0/3380188111 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f7f64003970 con 0x7f7f6c1036f0 2024-09-19T09:45:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.990+0000 7f7f73827740 1 Processor -- start 2024-09-19T09:45:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.990+0000 7f7f73827740 1 -- start start 2024-09-19T09:45:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.990+0000 7f7f73827740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654c96961b0 0x5654c96965b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.990+0000 7f7f73827740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5654c9696af0 0x5654c969b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.990+0000 7f7f73827740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5654c969bb80 0x5654c969e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.990+0000 7f7f73827740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5654c95f12f0 con 0x5654c969bb80 2024-09-19T09:45:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.990+0000 7f7f73827740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5654c9599270 con 0x5654c96961b0 2024-09-19T09:45:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.990+0000 7f7f73827740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5654c95ed2b0 con 0x5654c9696af0 2024-09-19T09:45:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.990+0000 7f7f69d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5654c969bb80 0x5654c969e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.990+0000 7f7f69d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5654c969bb80 0x5654c969e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42156/0 (socket says 172.21.15.1:42156) 2024-09-19T09:45:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.990+0000 7f7f69d9b640 1 -- 172.21.15.1:0/1597174509 learned_addr learned my addr 172.21.15.1:0/1597174509 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.990+0000 7f7f69d9b640 1 --2- 172.21.15.1:0/1597174509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654c96961b0 0x5654c96965b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.991+0000 7f7f69d9b640 1 -- 172.21.15.1:0/1597174509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5654c9696af0 msgr2=0x5654c969b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.991+0000 7f7f69d9b640 1 --2- 172.21.15.1:0/1597174509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5654c9696af0 0x5654c969b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.991+0000 7f7f5b7fe640 1 --2- 172.21.15.1:0/3380188111 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f7f540a3240 0x7f7f540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.991+0000 7f7f69d9b640 1 -- 172.21.15.1:0/1597174509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654c96961b0 msgr2=0x5654c96965b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:48.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.991+0000 7f7f69d9b640 1 --2- 172.21.15.1:0/1597174509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654c96961b0 0x5654c96965b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.991+0000 7f7f69d9b640 1 -- 172.21.15.1:0/1597174509 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654c9598340 con 0x5654c969bb80 2024-09-19T09:45:48.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.991+0000 7f7f6ad9d640 1 --2- 172.21.15.1:0/3380188111 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f7f540a3240 0x7f7f540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.991+0000 7f7f69d9b640 1 --2- 172.21.15.1:0/1597174509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5654c969bb80 0x5654c969e040 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7f60005c40 tx=0x7f7f60000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=718b593f20f4c5ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:48.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.991+0000 7f7f5b7fe640 1 -- 172.21.15.1:0/3380188111 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f7f640cf760 con 0x7f7f6c1036f0 2024-09-19T09:45:48.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.991+0000 7f7f58ff9640 1 -- 172.21.15.1:0/1597174509 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f60035040 con 0x5654c969bb80 2024-09-19T09:45:48.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.991+0000 7f7f58ff9640 1 -- 172.21.15.1:0/1597174509 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f600035f0 con 0x5654c969bb80 2024-09-19T09:45:48.008 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.991+0000 7f7f58ff9640 1 -- 172.21.15.1:0/1597174509 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6003d6e0 con 0x5654c969bb80 2024-09-19T09:45:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.992+0000 7f7f73827740 1 -- 172.21.15.1:0/1597174509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5654c969bb80 msgr2=0x5654c969e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.992+0000 7f7f6ad9d640 1 --2- 172.21.15.1:0/3380188111 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f7f540a3240 0x7f7f540a5700 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7f640a44c0 tx=0x7f7f64066bb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.992+0000 7f7f73827740 1 --2- 172.21.15.1:0/1597174509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5654c969bb80 0x5654c969e040 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7f60005c40 tx=0x7f7f60000bc0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.992+0000 7f7f73827740 1 -- 172.21.15.1:0/1597174509 shutdown_connections 2024-09-19T09:45:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.992+0000 7f7f73827740 1 --2- 172.21.15.1:0/1597174509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5654c969bb80 0x5654c969e040 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.992+0000 7f7f73827740 1 --2- 172.21.15.1:0/1597174509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5654c9696af0 0x5654c969b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.992+0000 7f7f73827740 1 --2- 172.21.15.1:0/1597174509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654c96961b0 0x5654c96965b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.992+0000 7f7f73827740 1 -- 172.21.15.1:0/1597174509 >> 172.21.15.1:0/1597174509 conn(0x5654c9689010 msgr2=0x5654c9689410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.992+0000 7f7f73827740 1 -- 172.21.15.1:0/1597174509 shutdown_connections 2024-09-19T09:45:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.992+0000 7f7f73827740 1 -- 172.21.15.1:0/1597174509 wait complete. 2024-09-19T09:45:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.992+0000 7f7f73827740 1 -- start start 2024-09-19T09:45:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.992+0000 7f7f73827740 1 Processor -- start 2024-09-19T09:45:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.993+0000 7f7f73827740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5654c96961b0 0x5654c96a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.993+0000 7f7f73827740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654c9696af0 0x5654c96a0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.993+0000 7f7f73827740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5654c969bb80 0x5654c96a7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.993+0000 7f7f73827740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x5654c969eaf0 con 0x5654c969bb80 2024-09-19T09:45:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.993+0000 7f7f73827740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5654c957a290 con 0x5654c9696af0 2024-09-19T09:45:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.993+0000 7f7f73827740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5654c969ec70 con 0x5654c96961b0 2024-09-19T09:45:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.993+0000 7f7f69d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5654c969bb80 0x5654c96a7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.993+0000 7f7f69d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5654c969bb80 0x5654c96a7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42160/0 (socket says 172.21.15.1:42160) 2024-09-19T09:45:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.993+0000 7f7f69d9b640 1 -- 172.21.15.1:0/4216430289 learned_addr learned my addr 172.21.15.1:0/4216430289 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.993+0000 7f7f69d9b640 1 --2- 172.21.15.1:0/4216430289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5654c96961b0 0x5654c96a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.993+0000 7f7f6a59c640 1 --2- 172.21.15.1:0/4216430289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654c9696af0 0x5654c96a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.993+0000 7f7f73827740 10 client.0 _ll_register_callbacks cb 0x5654c95ab140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:45:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.993+0000 7f7f69d9b640 1 -- 172.21.15.1:0/4216430289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5654c96961b0 msgr2=0x5654c96a03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.993+0000 7f7f69d9b640 1 --2- 172.21.15.1:0/4216430289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5654c96961b0 0x5654c96a03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.993+0000 7f7f69d9b640 1 -- 172.21.15.1:0/4216430289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654c9696af0 msgr2=0x5654c96a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.993+0000 7f7f69d9b640 1 --2- 172.21.15.1:0/4216430289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654c9696af0 0x5654c96a0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.993+0000 7f7f69d9b640 1 -- 172.21.15.1:0/4216430289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654c9304210 con 0x5654c969bb80 2024-09-19T09:45:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.993+0000 7f7f69d9b640 1 --2- 172.21.15.1:0/4216430289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5654c969bb80 0x5654c96a7960 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7f60004240 tx=0x7f7f6002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b412289ad809d3b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.993+0000 7f7f51ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:45:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.993+0000 7f7f51ffb640 1 -- 172.21.15.1:0/4216430289 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f60035030 con 0x5654c969bb80 2024-09-19T09:45:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.994+0000 7f7f51ffb640 1 -- 172.21.15.1:0/4216430289 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f7f600037a0 con 0x5654c969bb80 2024-09-19T09:45:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.994+0000 7f7f73827740 1 -- 172.21.15.1:0/4216430289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f600035f0 con 0x5654c969bb80 2024-09-19T09:45:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.994+0000 7f7f51ffb640 1 -- 172.21.15.1:0/4216430289 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7f6003de10 con 0x5654c969bb80 2024-09-19T09:45:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.994+0000 7f7f73827740 10 client.16398 fetch_fsmap learned FSMap version 21 2024-09-19T09:45:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.994+0000 7f7f73827740 1 -- 172.21.15.1:0/4216430289 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5654c93d0620 con 0x5654c969bb80 2024-09-19T09:45:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.994+0000 7f7f51ffb640 1 -- 172.21.15.1:0/4216430289 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f600035f0 con 0x5654c969bb80 2024-09-19T09:45:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.994+0000 7f7f51ffb640 1 -- 172.21.15.1:0/4216430289 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8330+0+0 (secure 0 0 0) 0x7f7f60059050 con 0x5654c969bb80 2024-09-19T09:45:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.994+0000 7f7f73827740 10 client.16398 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T09:45:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.994+0000 7f7f73827740 10 client.16398 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:45:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.994+0000 7f7f73827740 20 client.16398 populate_metadata read hostname 'smithi001' 2024-09-19T09:45:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.994+0000 7f7f73827740 1 --2- 172.21.15.1:0/4216430289 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5654c96abc20 0x5654c96ae010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.994+0000 7f7f73827740 4 client.16398 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:45:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.994+0000 7f7f73827740 1 -- 172.21.15.1:0/4216430289 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654c95fea20 con 0x5654c96abc20 2024-09-19T09:45:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.994+0000 7f7f6a59c640 1 --2- 172.21.15.1:0/4216430289 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5654c96abc20 0x5654c96ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.995+0000 7f7f51ffb640 10 client.16398 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:45:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.995+0000 7f7f6a59c640 1 --2- 172.21.15.1:0/4216430289 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5654c96abc20 0x5654c96ae010 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8361e296114093ab server_cookie=8100a3e29e0e96d7 in_seq=0 out_seq=0 2024-09-19T09:45:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.995+0000 7f7f51ffb640 1 -- 172.21.15.1:0/4216430289 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5654c95fea20 con 0x5654c96abc20 2024-09-19T09:45:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.995+0000 7f7f51ffb640 10 client.16398 handle_command_reply: tid=0 2024-09-19T09:45:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.995+0000 7f7f73827740 1 client.16398 shutdown 2024-09-19T09:45:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.995+0000 7f7f73827740 1 -- 172.21.15.1:0/4216430289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5654c969bb80 msgr2=0x5654c96a7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.995+0000 7f7f73827740 1 --2- 172.21.15.1:0/4216430289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5654c969bb80 0x5654c96a7960 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7f60004240 tx=0x7f7f6002a410 comp rx=0 tx=0).stop 2024-09-19T09:45:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.995+0000 7f7f73827740 1 -- 172.21.15.1:0/4216430289 shutdown_connections 2024-09-19T09:45:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.995+0000 7f7f73827740 1 --2- 172.21.15.1:0/4216430289 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5654c96abc20 0x5654c96ae010 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.996+0000 7f7f73827740 1 --2- 172.21.15.1:0/4216430289 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5654c969bb80 0x5654c96a7960 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.996+0000 7f7f51ffb640 0 client.16398 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:45:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.996+0000 7f7f73827740 1 --2- 172.21.15.1:0/4216430289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654c9696af0 0x5654c96a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.996+0000 7f7f73827740 1 --2- 172.21.15.1:0/4216430289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5654c96961b0 0x5654c96a03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.996+0000 7f7f73827740 1 -- 172.21.15.1:0/4216430289 >> 172.21.15.1:0/4216430289 conn(0x5654c9689010 msgr2=0x5654c968a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.996+0000 7f7f73827740 1 -- 172.21.15.1:0/4216430289 shutdown_connections 2024-09-19T09:45:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.996+0000 7f7f73827740 1 -- 172.21.15.1:0/4216430289 wait complete. 2024-09-19T09:45:48.015 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:47.996+0000 7f7f73827740 20 client.16398 trim_cache size 0 max 16384 2024-09-19T09:45:48.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.010+0000 7f7f73827740 1 Processor -- start 2024-09-19T09:45:48.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.010+0000 7f7f73827740 1 -- start start 2024-09-19T09:45:48.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.010+0000 7f7f73827740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654c96961b0 0x5654c968a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.010+0000 7f7f73827740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5654c9696af0 0x5654c96a7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.010+0000 7f7f73827740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5654c969bb80 0x5654c96b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.021 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.010+0000 7f7f73827740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c1a4dc0 con 0x5654c969bb80 2024-09-19T09:45:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.010+0000 7f7f73827740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c1a7660 con 0x5654c96961b0 2024-09-19T09:45:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.010+0000 7f7f73827740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c1a5450 con 0x5654c9696af0 2024-09-19T09:45:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.010+0000 7f7f69d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654c96961b0 0x5654c968a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.010+0000 7f7f69d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654c96961b0 0x5654c968a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:39270/0 (socket says 172.21.15.1:39270) 2024-09-19T09:45:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.010+0000 7f7f69d9b640 1 -- 172.21.15.1:0/1023681500 learned_addr learned my addr 172.21.15.1:0/1023681500 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.010+0000 7f7f69d9b640 1 --2- 172.21.15.1:0/1023681500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5654c969bb80 0x5654c96b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.011+0000 7f7f6a59c640 1 --2- 172.21.15.1:0/1023681500 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5654c9696af0 0x5654c96a7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.011+0000 7f7f69d9b640 1 -- 172.21.15.1:0/1023681500 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5654c9696af0 msgr2=0x5654c96a7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.011+0000 7f7f69d9b640 1 --2- 172.21.15.1:0/1023681500 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5654c9696af0 0x5654c96a7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.011+0000 7f7f69d9b640 1 -- 172.21.15.1:0/1023681500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5654c969bb80 msgr2=0x5654c96b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.011+0000 7f7f69d9b640 1 --2- 172.21.15.1:0/1023681500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5654c969bb80 0x5654c96b27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.011+0000 7f7f69d9b640 1 -- 172.21.15.1:0/1023681500 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654c9689ca0 con 0x5654c96961b0 2024-09-19T09:45:48.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.011+0000 7f7f69d9b640 1 --2- 172.21.15.1:0/1023681500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654c96961b0 0x5654c968a690 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7f60031610 tx=0x7f7f6004c040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=297522dd6cb41a5a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:48.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.011+0000 7f7f53fff640 1 -- 172.21.15.1:0/1023681500 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f60035070 con 0x5654c96961b0 2024-09-19T09:45:48.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.011+0000 7f7f53fff640 1 -- 172.21.15.1:0/1023681500 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f60061020 con 0x5654c96961b0 2024-09-19T09:45:48.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.011+0000 7f7f53fff640 1 -- 172.21.15.1:0/1023681500 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f600055a0 con 0x5654c96961b0 2024-09-19T09:45:48.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.012+0000 7f7f73827740 1 -- 172.21.15.1:0/1023681500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654c96961b0 msgr2=0x5654c968a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:48.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.012+0000 7f7f73827740 1 --2- 172.21.15.1:0/1023681500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654c96961b0 0x5654c968a690 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7f60031610 tx=0x7f7f6004c040 comp rx=0 tx=0).stop 2024-09-19T09:45:48.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.012+0000 7f7f73827740 1 -- 172.21.15.1:0/1023681500 shutdown_connections 2024-09-19T09:45:48.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.012+0000 7f7f73827740 1 --2- 172.21.15.1:0/1023681500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5654c969bb80 0x5654c96b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.012+0000 7f7f73827740 1 --2- 172.21.15.1:0/1023681500 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5654c9696af0 0x5654c96a7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.012+0000 7f7f73827740 1 --2- 172.21.15.1:0/1023681500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654c96961b0 0x5654c968a690 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.012+0000 7f7f73827740 1 -- 172.21.15.1:0/1023681500 >> 172.21.15.1:0/1023681500 conn(0x5654c9689010 msgr2=0x5654c9689f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:48.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.012+0000 7f7f73827740 1 -- 172.21.15.1:0/1023681500 shutdown_connections 2024-09-19T09:45:48.023 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.012+0000 7f7f73827740 1 -- 172.21.15.1:0/1023681500 wait complete. 2024-09-19T09:45:48.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.012+0000 7f7f73827740 1 -- start start 2024-09-19T09:45:48.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.012+0000 7f7f73827740 1 Processor -- start 2024-09-19T09:45:48.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.012+0000 7f7f73827740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654c96961b0 0x5654c96a59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.012+0000 7f7f73827740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5654c9696af0 0x5654c96a5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.012+0000 7f7f73827740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5654c969bb80 0x5654c96a6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.012+0000 7f7f73827740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c1a5b20 con 0x5654c969bb80 2024-09-19T09:45:48.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.012+0000 7f7f73827740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c1a6f90 con 0x5654c96961b0 2024-09-19T09:45:48.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.012+0000 7f7f73827740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6c1a61f0 con 0x5654c9696af0 2024-09-19T09:45:48.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.012+0000 7f7f73827740 10 client.0 _ll_register_callbacks cb 0x7f7f60009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:45:48.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.012+0000 7f7f69d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5654c969bb80 0x5654c96a6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.012+0000 7f7f69d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5654c969bb80 0x5654c96a6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42184/0 (socket says 172.21.15.1:42184) 2024-09-19T09:45:48.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.012+0000 7f7f69d9b640 1 -- 172.21.15.1:0/2360005017 learned_addr learned my addr 172.21.15.1:0/2360005017 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:48.024 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.013+0000 7f7f6a59c640 1 --2- 172.21.15.1:0/2360005017 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5654c9696af0 0x5654c96a5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.013+0000 7f7f69d9b640 1 --2- 172.21.15.1:0/2360005017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654c96961b0 0x5654c96a59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.013+0000 7f7f69d9b640 1 -- 172.21.15.1:0/2360005017 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5654c9696af0 msgr2=0x5654c96a5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.013+0000 7f7f69d9b640 1 --2- 172.21.15.1:0/2360005017 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5654c9696af0 0x5654c96a5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.013+0000 7f7f69d9b640 1 -- 172.21.15.1:0/2360005017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654c96961b0 msgr2=0x5654c96a59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.013+0000 7f7f69d9b640 1 --2- 172.21.15.1:0/2360005017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654c96961b0 0x5654c96a59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.013+0000 7f7f69d9b640 1 -- 172.21.15.1:0/2360005017 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654c96a7490 con 0x5654c969bb80 2024-09-19T09:45:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.013+0000 7f7f69d9b640 1 --2- 172.21.15.1:0/2360005017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5654c969bb80 0x5654c96a6da0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f7f6003dfd0 tx=0x7f7f60005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937f8ec9e8f3073b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.013+0000 7f7f51ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:45:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.013+0000 7f7f51ffb640 1 -- 172.21.15.1:0/2360005017 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f60035030 con 0x5654c969bb80 2024-09-19T09:45:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.013+0000 7f7f51ffb640 1 -- 172.21.15.1:0/2360005017 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f7f6003dc10 con 0x5654c969bb80 2024-09-19T09:45:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.013+0000 7f7f73827740 1 -- 172.21.15.1:0/2360005017 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f60061020 con 0x5654c969bb80 2024-09-19T09:45:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.013+0000 7f7f51ffb640 1 -- 172.21.15.1:0/2360005017 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7f60009520 con 0x5654c969bb80 2024-09-19T09:45:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.013+0000 7f7f73827740 10 client.16404 fetch_fsmap learned FSMap version 21 2024-09-19T09:45:48.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.013+0000 7f7f73827740 1 -- 172.21.15.1:0/2360005017 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5654c9717190 con 0x5654c969bb80 2024-09-19T09:45:48.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.013+0000 7f7f51ffb640 1 -- 172.21.15.1:0/2360005017 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f60061020 con 0x5654c969bb80 2024-09-19T09:45:48.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.014+0000 7f7f51ffb640 1 -- 172.21.15.1:0/2360005017 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8330+0+0 (secure 0 0 0) 0x7f7f60059030 con 0x5654c969bb80 2024-09-19T09:45:48.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.014+0000 7f7f73827740 10 client.16404 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T09:45:48.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.014+0000 7f7f73827740 10 client.16404 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:45:48.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.014+0000 7f7f73827740 20 client.16404 populate_metadata read hostname 'smithi001' 2024-09-19T09:45:48.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.014+0000 7f7f73827740 1 --2- 172.21.15.1:0/2360005017 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5654c9717920 0x5654c9719d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.014+0000 7f7f73827740 4 client.16404 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:45:48.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.014+0000 7f7f73827740 1 -- 172.21.15.1:0/2360005017 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5654c95f8d70 con 0x5654c9717920 2024-09-19T09:45:48.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.014+0000 7f7f6a59c640 1 --2- 172.21.15.1:0/2360005017 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5654c9717920 0x5654c9719d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.026 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.014+0000 7f7f6a59c640 1 --2- 172.21.15.1:0/2360005017 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5654c9717920 0x5654c9719d40 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d138a766f80d7fdf server_cookie=128d0e008af0a253 in_seq=0 out_seq=0 2024-09-19T09:45:48.027 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:48.014+0000 7f7f51ffb640 10 client.16404 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:45:48.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:48 smithi022 ceph-mon[35583]: pgmap v570: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 92 MiB/s wr, 12.91k op/s 2024-09-19T09:45:48.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:48 smithi121 ceph-mon[35577]: pgmap v570: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 92 MiB/s wr, 12.91k op/s 2024-09-19T09:45:48.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:48 smithi001 ceph-mon[31225]: pgmap v570: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 92 MiB/s wr, 12.91k op/s 2024-09-19T09:45:48.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.277+0000 7ff3d9985640 1 -- 172.21.15.1:0/1760531407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3d410c170 msgr2=0x7ff3d410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:48.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.277+0000 7ff3d9985640 1 --2- 172.21.15.1:0/1760531407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3d410c170 0x7ff3d410e610 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc009ca0 tx=0x7ff3cc02a950 comp rx=0 tx=0).stop 2024-09-19T09:45:48.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.277+0000 7ff3d9985640 1 -- 172.21.15.1:0/1760531407 shutdown_connections 2024-09-19T09:45:48.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.277+0000 7ff3d9985640 1 --2- 172.21.15.1:0/1760531407 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3d410c170 0x7ff3d410e610 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.277+0000 7ff3d9985640 1 --2- 172.21.15.1:0/1760531407 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3d4103660 0x7ff3d410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.277+0000 7ff3d9985640 1 --2- 172.21.15.1:0/1760531407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3d4102d40 0x7ff3d4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.277+0000 7ff3d9985640 1 -- 172.21.15.1:0/1760531407 >> 172.21.15.1:0/1760531407 conn(0x7ff3d40fc7a0 msgr2=0x7ff3d40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:48.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.277+0000 7ff3d9985640 1 -- 172.21.15.1:0/1760531407 shutdown_connections 2024-09-19T09:45:48.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.277+0000 7ff3d9985640 1 -- 172.21.15.1:0/1760531407 wait complete. 2024-09-19T09:45:48.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.278+0000 7ff3d9985640 1 Processor -- start 2024-09-19T09:45:48.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.278+0000 7ff3d9985640 1 -- start start 2024-09-19T09:45:48.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.278+0000 7ff3d9985640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3d4102d40 0x7ff3d41983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.278+0000 7ff3d9985640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3d4103660 0x7ff3d4198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.278+0000 7ff3d9985640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3d410c170 0x7ff3d419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.278+0000 7ff3d9985640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d4111f70 con 0x7ff3d4103660 2024-09-19T09:45:48.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.278+0000 7ff3d9985640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d4111df0 con 0x7ff3d4102d40 2024-09-19T09:45:48.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.278+0000 7ff3d9985640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d41120f0 con 0x7ff3d410c170 2024-09-19T09:45:48.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.278+0000 7ff3d27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3d4103660 0x7ff3d4198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.278+0000 7ff3d27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3d4103660 0x7ff3d4198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42086/0 (socket says 172.21.15.1:42086) 2024-09-19T09:45:48.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.278+0000 7ff3d27fc640 1 -- 172.21.15.1:0/3097177510 learned_addr learned my addr 172.21.15.1:0/3097177510 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:48.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.278+0000 7ff3d2ffd640 1 --2- 172.21.15.1:0/3097177510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3d4102d40 0x7ff3d41983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.278+0000 7ff3d37fe640 1 --2- 172.21.15.1:0/3097177510 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3d410c170 0x7ff3d419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.279+0000 7ff3d27fc640 1 -- 172.21.15.1:0/3097177510 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3d410c170 msgr2=0x7ff3d419ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:48.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.279+0000 7ff3d27fc640 1 --2- 172.21.15.1:0/3097177510 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3d410c170 0x7ff3d419ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.279+0000 7ff3d27fc640 1 -- 172.21.15.1:0/3097177510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3d4102d40 msgr2=0x7ff3d41983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:48.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.279+0000 7ff3d27fc640 1 --2- 172.21.15.1:0/3097177510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3d4102d40 0x7ff3d41983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.279+0000 7ff3d27fc640 1 -- 172.21.15.1:0/3097177510 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3d419d3a0 con 0x7ff3d4103660 2024-09-19T09:45:48.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.279+0000 7ff3d27fc640 1 --2- 172.21.15.1:0/3097177510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3d4103660 0x7ff3d4198930 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ff3c800d740 tx=0x7ff3c800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:48.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.279+0000 7ff3d8983640 1 -- 172.21.15.1:0/3097177510 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c8017070 con 0x7ff3d4103660 2024-09-19T09:45:48.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.279+0000 7ff3d9985640 1 -- 172.21.15.1:0/3097177510 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3d419d690 con 0x7ff3d4103660 2024-09-19T09:45:48.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.279+0000 7ff3d8983640 1 -- 172.21.15.1:0/3097177510 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3c800de50 con 0x7ff3d4103660 2024-09-19T09:45:48.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.279+0000 7ff3d8983640 1 -- 172.21.15.1:0/3097177510 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c800f620 con 0x7ff3d4103660 2024-09-19T09:45:48.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.279+0000 7ff3d9985640 1 -- 172.21.15.1:0/3097177510 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3d41a4f70 con 0x7ff3d4103660 2024-09-19T09:45:48.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.282+0000 7ff3d8983640 1 -- 172.21.15.1:0/3097177510 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7ff3c8009c30 con 0x7ff3d4103660 2024-09-19T09:45:48.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.282+0000 7ff3dbd5e740 1 Processor -- start 2024-09-19T09:45:48.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.282+0000 7ff3dbd5e740 1 -- start start 2024-09-19T09:45:48.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.282+0000 7ff3dbd5e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560c52845a40 0x560c52845e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.282+0000 7ff3dbd5e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c52846360 0x560c52854c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.282+0000 7ff3dbd5e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560c52855150 0x560c52857540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.282+0000 7ff3dbd5e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560c527ab280 con 0x560c52846360 2024-09-19T09:45:48.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.282+0000 7ff3dbd5e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560c52752b10 con 0x560c52845a40 2024-09-19T09:45:48.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.282+0000 7ff3d2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c52846360 0x560c52854c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.282+0000 7ff3d8983640 1 --2- 172.21.15.1:0/3097177510 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff3bc0a3240 0x7ff3bc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.282+0000 7ff3d2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c52846360 0x560c52854c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42096/0 (socket says 172.21.15.1:42096) 2024-09-19T09:45:48.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.282+0000 7ff3d2ffd640 1 -- 172.21.15.1:0/2977957697 learned_addr learned my addr 172.21.15.1:0/2977957697 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:48.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.283+0000 7ff3dbd5e740 1 -- 172.21.15.1:0/2977957697 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x560c527a7240 con 0x560c52855150 2024-09-19T09:45:48.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.283+0000 7ff3d37fe640 1 --2- 172.21.15.1:0/3097177510 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff3bc0a3240 0x7ff3bc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.283+0000 7ff3d8983640 1 -- 172.21.15.1:0/3097177510 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7ff3c80cf3d0 con 0x7ff3d4103660 2024-09-19T09:45:48.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.283+0000 7ff3d27fc640 1 --2- 172.21.15.1:0/2977957697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560c52855150 0x560c52857540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.283+0000 7ff3d2ffd640 1 -- 172.21.15.1:0/2977957697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560c52855150 msgr2=0x560c52857540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:48.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.283+0000 7ff3d2ffd640 1 --2- 172.21.15.1:0/2977957697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560c52855150 0x560c52857540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.283+0000 7ff3d2ffd640 1 -- 172.21.15.1:0/2977957697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560c52845a40 msgr2=0x560c52845e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:48.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.283+0000 7ff3d2ffd640 1 --2- 172.21.15.1:0/2977957697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560c52845a40 0x560c52845e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.283+0000 7ff3d2ffd640 1 -- 172.21.15.1:0/2977957697 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c5275f1f0 con 0x560c52846360 2024-09-19T09:45:48.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.283+0000 7ff3d2ffd640 1 --2- 172.21.15.1:0/2977957697 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c52846360 0x560c52854c10 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ff3c400bcd0 tx=0x7ff3c40107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4dc05039e2da857 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:48.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.283+0000 7ff3d37fe640 1 --2- 172.21.15.1:0/3097177510 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff3bc0a3240 0x7ff3bc0a5700 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc005e30 tx=0x7ff3cc02fe10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:48.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.283+0000 7ff3b9ffb640 1 -- 172.21.15.1:0/2977957697 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4005220 con 0x560c52846360 2024-09-19T09:45:48.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.283+0000 7ff3b9ffb640 1 -- 172.21.15.1:0/2977957697 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3c4004c80 con 0x560c52846360 2024-09-19T09:45:48.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.283+0000 7ff3b9ffb640 1 -- 172.21.15.1:0/2977957697 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c40237d0 con 0x560c52846360 2024-09-19T09:45:48.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.284+0000 7ff3dbd5e740 1 -- 172.21.15.1:0/2977957697 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c52846360 msgr2=0x560c52854c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:48.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.284+0000 7ff3dbd5e740 1 --2- 172.21.15.1:0/2977957697 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c52846360 0x560c52854c10 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ff3c400bcd0 tx=0x7ff3c40107a0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.284+0000 7ff3dbd5e740 1 -- 172.21.15.1:0/2977957697 shutdown_connections 2024-09-19T09:45:48.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.284+0000 7ff3dbd5e740 1 --2- 172.21.15.1:0/2977957697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560c52855150 0x560c52857540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.284+0000 7ff3dbd5e740 1 --2- 172.21.15.1:0/2977957697 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c52846360 0x560c52854c10 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.284+0000 7ff3dbd5e740 1 --2- 172.21.15.1:0/2977957697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560c52845a40 0x560c52845e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.284+0000 7ff3dbd5e740 1 -- 172.21.15.1:0/2977957697 >> 172.21.15.1:0/2977957697 conn(0x560c528420f0 msgr2=0x560c528424d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:48.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.284+0000 7ff3dbd5e740 1 -- 172.21.15.1:0/2977957697 shutdown_connections 2024-09-19T09:45:48.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.284+0000 7ff3dbd5e740 1 -- 172.21.15.1:0/2977957697 wait complete. 2024-09-19T09:45:48.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.285+0000 7ff3dbd5e740 1 -- start start 2024-09-19T09:45:48.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.285+0000 7ff3dbd5e740 1 Processor -- start 2024-09-19T09:45:48.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.285+0000 7ff3dbd5e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c52845a40 0x560c5284e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.285+0000 7ff3dbd5e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560c52846360 0x560c5284e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.285+0000 7ff3dbd5e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560c52855150 0x560c5284edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.285+0000 7ff3dbd5e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x560c528489e0 con 0x560c52845a40 2024-09-19T09:45:48.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.285+0000 7ff3dbd5e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560c52765f10 con 0x560c52855150 2024-09-19T09:45:48.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.285+0000 7ff3dbd5e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x560c52848b60 con 0x560c52846360 2024-09-19T09:45:48.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.285+0000 7ff3dbd5e740 10 client.0 _ll_register_callbacks cb 0x560c5272ea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:45:48.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.285+0000 7ff3d2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c52845a40 0x560c5284e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.285+0000 7ff3d2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c52845a40 0x560c5284e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42098/0 (socket says 172.21.15.1:42098) 2024-09-19T09:45:48.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.285+0000 7ff3d2ffd640 1 -- 172.21.15.1:0/3845680016 learned_addr learned my addr 172.21.15.1:0/3845680016 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:48.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.285+0000 7ff3d27fc640 1 --2- 172.21.15.1:0/3845680016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560c52846360 0x560c5284e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.285+0000 7ff3d37fe640 1 --2- 172.21.15.1:0/3845680016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560c52855150 0x560c5284edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.285+0000 7ff3d2ffd640 1 -- 172.21.15.1:0/3845680016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560c52846360 msgr2=0x560c5284e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:48.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.285+0000 7ff3d2ffd640 1 --2- 172.21.15.1:0/3845680016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560c52846360 0x560c5284e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.285+0000 7ff3d2ffd640 1 -- 172.21.15.1:0/3845680016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560c52855150 msgr2=0x560c5284edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:48.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.285+0000 7ff3d2ffd640 1 --2- 172.21.15.1:0/3845680016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560c52855150 0x560c5284edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.285+0000 7ff3d2ffd640 1 -- 172.21.15.1:0/3845680016 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c5251c6a0 con 0x560c52845a40 2024-09-19T09:45:48.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.286+0000 7ff3b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:45:48.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.286+0000 7ff3d2ffd640 1 --2- 172.21.15.1:0/3845680016 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c52845a40 0x560c5284e330 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4005720 tx=0x7ff3c40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22fbb2e0e94b3d93 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:48.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.286+0000 7ff3b2ffd640 1 -- 172.21.15.1:0/3845680016 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4004020 con 0x560c52845a40 2024-09-19T09:45:48.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.286+0000 7ff3b2ffd640 1 -- 172.21.15.1:0/3845680016 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7ff3c40041c0 con 0x560c52845a40 2024-09-19T09:45:48.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.286+0000 7ff3dbd5e740 1 -- 172.21.15.1:0/3845680016 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3c4004c80 con 0x560c52845a40 2024-09-19T09:45:48.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.286+0000 7ff3b2ffd640 1 -- 172.21.15.1:0/3845680016 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff3c40043c0 con 0x560c52845a40 2024-09-19T09:45:48.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.286+0000 7ff3dbd5e740 10 client.16380 fetch_fsmap learned FSMap version 21 2024-09-19T09:45:48.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.286+0000 7ff3dbd5e740 1 -- 172.21.15.1:0/3845680016 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x560c5285f540 con 0x560c52845a40 2024-09-19T09:45:48.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.286+0000 7ff3b2ffd640 1 -- 172.21.15.1:0/3845680016 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3c4004c80 con 0x560c52845a40 2024-09-19T09:45:48.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.286+0000 7ff3b2ffd640 1 -- 172.21.15.1:0/3845680016 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8330+0+0 (secure 0 0 0) 0x7ff3c4003be0 con 0x560c52845a40 2024-09-19T09:45:48.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.287+0000 7ff3dbd5e740 10 client.16380 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T09:45:48.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.287+0000 7ff3dbd5e740 10 client.16380 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:45:48.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.287+0000 7ff3dbd5e740 20 client.16380 populate_metadata read hostname 'smithi001' 2024-09-19T09:45:48.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.287+0000 7ff3dbd5e740 1 --2- 172.21.15.1:0/3845680016 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x560c52860a00 0x560c52862df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.287+0000 7ff3d27fc640 1 --2- 172.21.15.1:0/3845680016 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x560c52860a00 0x560c52862df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.287+0000 7ff3dbd5e740 4 client.16380 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:45:48.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.287+0000 7ff3dbd5e740 1 -- 172.21.15.1:0/3845680016 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c527b87f0 con 0x560c52860a00 2024-09-19T09:45:48.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.289+0000 7ff3d27fc640 1 --2- 172.21.15.1:0/3845680016 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x560c52860a00 0x560c52862df0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2722ec802f4a20b server_cookie=558516cdd3255fde in_seq=0 out_seq=0 2024-09-19T09:45:48.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.289+0000 7ff3b2ffd640 10 client.16380 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:45:48.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.290+0000 7ff3b2ffd640 1 -- 172.21.15.1:0/3845680016 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560c527b87f0 con 0x560c52860a00 2024-09-19T09:45:48.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.290+0000 7ff3b2ffd640 10 client.16380 handle_command_reply: tid=0 2024-09-19T09:45:48.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.290+0000 7ff3dbd5e740 1 client.16380 shutdown 2024-09-19T09:45:48.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.290+0000 7ff3dbd5e740 1 -- 172.21.15.1:0/3845680016 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c52845a40 msgr2=0x560c5284e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:48.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.290+0000 7ff3dbd5e740 1 --2- 172.21.15.1:0/3845680016 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c52845a40 0x560c5284e330 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4005720 tx=0x7ff3c40048f0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.290+0000 7ff3dbd5e740 1 -- 172.21.15.1:0/3845680016 shutdown_connections 2024-09-19T09:45:48.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.290+0000 7ff3dbd5e740 1 --2- 172.21.15.1:0/3845680016 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x560c52860a00 0x560c52862df0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.290+0000 7ff3dbd5e740 1 --2- 172.21.15.1:0/3845680016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560c52855150 0x560c5284edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.290+0000 7ff3dbd5e740 1 --2- 172.21.15.1:0/3845680016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560c52846360 0x560c5284e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.290+0000 7ff3dbd5e740 1 --2- 172.21.15.1:0/3845680016 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c52845a40 0x560c5284e330 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.290+0000 7ff3dbd5e740 1 -- 172.21.15.1:0/3845680016 >> 172.21.15.1:0/3845680016 conn(0x560c528420f0 msgr2=0x560c52847e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:48.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.290+0000 7ff3b2ffd640 0 client.16380 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:45:48.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.291+0000 7ff3dbd5e740 1 -- 172.21.15.1:0/3845680016 shutdown_connections 2024-09-19T09:45:48.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.291+0000 7ff3dbd5e740 1 -- 172.21.15.1:0/3845680016 wait complete. 2024-09-19T09:45:48.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.291+0000 7ff3dbd5e740 20 client.16380 trim_cache size 0 max 16384 2024-09-19T09:45:48.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.308+0000 7ff3dbd5e740 1 Processor -- start 2024-09-19T09:45:48.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.308+0000 7ff3dbd5e740 1 -- start start 2024-09-19T09:45:48.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.308+0000 7ff3dbd5e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c52846360 0x560c52841160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.308+0000 7ff3dbd5e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560c52855150 0x560c52868390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.308+0000 7ff3dbd5e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560c528416a0 0x560c528688d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.308+0000 7ff3dbd5e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d41a9450 con 0x560c52846360 2024-09-19T09:45:48.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.308+0000 7ff3dbd5e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d41abcf0 con 0x560c52855150 2024-09-19T09:45:48.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.308+0000 7ff3dbd5e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d41a9ae0 con 0x560c528416a0 2024-09-19T09:45:48.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.309+0000 7ff3d2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c52846360 0x560c52841160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.309+0000 7ff3d2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c52846360 0x560c52841160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42108/0 (socket says 172.21.15.1:42108) 2024-09-19T09:45:48.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.309+0000 7ff3d2ffd640 1 -- 172.21.15.1:0/2083501584 learned_addr learned my addr 172.21.15.1:0/2083501584 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:48.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.309+0000 7ff3d27fc640 1 --2- 172.21.15.1:0/2083501584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560c52855150 0x560c52868390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.309+0000 7ff3d2ffd640 1 -- 172.21.15.1:0/2083501584 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560c528416a0 msgr2=0x560c528688d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:48.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.309+0000 7ff3d2ffd640 1 --2- 172.21.15.1:0/2083501584 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560c528416a0 0x560c528688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.309+0000 7ff3d2ffd640 1 -- 172.21.15.1:0/2083501584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560c52855150 msgr2=0x560c52868390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:48.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.309+0000 7ff3d2ffd640 1 --2- 172.21.15.1:0/2083501584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560c52855150 0x560c52868390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.309+0000 7ff3d2ffd640 1 -- 172.21.15.1:0/2083501584 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c5283d830 con 0x560c52846360 2024-09-19T09:45:48.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.309+0000 7ff3d27fc640 1 --2- 172.21.15.1:0/2083501584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560c52855150 0x560c52868390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:45:48.754 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.309+0000 7ff3d2ffd640 1 --2- 172.21.15.1:0/2083501584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c52846360 0x560c52841160 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4005d00 tx=0x7ff3c4010ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde9b5de9da2d185 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:48.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.309+0000 7ff3b97fa640 1 -- 172.21.15.1:0/2083501584 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c400be80 con 0x560c52846360 2024-09-19T09:45:48.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.309+0000 7ff3b97fa640 1 -- 172.21.15.1:0/2083501584 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3c400b410 con 0x560c52846360 2024-09-19T09:45:48.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.309+0000 7ff3b97fa640 1 -- 172.21.15.1:0/2083501584 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4023b40 con 0x560c52846360 2024-09-19T09:45:48.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.310+0000 7ff3dbd5e740 1 -- 172.21.15.1:0/2083501584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c52846360 msgr2=0x560c52841160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:48.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.310+0000 7ff3dbd5e740 1 --2- 172.21.15.1:0/2083501584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c52846360 0x560c52841160 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4005d00 tx=0x7ff3c4010ca0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.310+0000 7ff3dbd5e740 1 -- 172.21.15.1:0/2083501584 shutdown_connections 2024-09-19T09:45:48.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.310+0000 7ff3dbd5e740 1 --2- 172.21.15.1:0/2083501584 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560c528416a0 0x560c528688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.310+0000 7ff3dbd5e740 1 --2- 172.21.15.1:0/2083501584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560c52855150 0x560c52868390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.310+0000 7ff3dbd5e740 1 --2- 172.21.15.1:0/2083501584 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c52846360 0x560c52841160 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.310+0000 7ff3dbd5e740 1 -- 172.21.15.1:0/2083501584 >> 172.21.15.1:0/2083501584 conn(0x560c528420f0 msgr2=0x560c52840a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:48.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.310+0000 7ff3dbd5e740 1 -- 172.21.15.1:0/2083501584 shutdown_connections 2024-09-19T09:45:48.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.310+0000 7ff3dbd5e740 1 -- 172.21.15.1:0/2083501584 wait complete. 2024-09-19T09:45:48.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.310+0000 7ff3dbd5e740 1 -- start start 2024-09-19T09:45:48.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.310+0000 7ff3dbd5e740 1 Processor -- start 2024-09-19T09:45:48.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.311+0000 7ff3dbd5e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560c528416a0 0x560c52858b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.311+0000 7ff3dbd5e740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c52846360 0x560c52859070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.311+0000 7ff3dbd5e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560c52855150 0x560c528595b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.311+0000 7ff3dbd5e740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d41aa1b0 con 0x560c52846360 2024-09-19T09:45:48.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.311+0000 7ff3dbd5e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d41ab620 con 0x560c52855150 2024-09-19T09:45:48.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.311+0000 7ff3dbd5e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d41aa880 con 0x560c528416a0 2024-09-19T09:45:48.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.311+0000 7ff3dbd5e740 10 client.0 _ll_register_callbacks cb 0x7ff3c400bb20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:45:48.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.311+0000 7ff3d27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c52846360 0x560c52859070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.311+0000 7ff3d27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c52846360 0x560c52859070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:42124/0 (socket says 172.21.15.1:42124) 2024-09-19T09:45:48.756 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.311+0000 7ff3d27fc640 1 -- 172.21.15.1:0/249384838 learned_addr learned my addr 172.21.15.1:0/249384838 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:45:48.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.311+0000 7ff3d2ffd640 1 --2- 172.21.15.1:0/249384838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560c528416a0 0x560c52858b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.311+0000 7ff3d37fe640 1 --2- 172.21.15.1:0/249384838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560c52855150 0x560c528595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.311+0000 7ff3d27fc640 1 -- 172.21.15.1:0/249384838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560c528416a0 msgr2=0x560c52858b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:48.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.311+0000 7ff3d27fc640 1 --2- 172.21.15.1:0/249384838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560c528416a0 0x560c52858b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.311+0000 7ff3d27fc640 1 -- 172.21.15.1:0/249384838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560c52855150 msgr2=0x560c528595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:45:48.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.311+0000 7ff3d27fc640 1 --2- 172.21.15.1:0/249384838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560c52855150 0x560c528595b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.311+0000 7ff3d27fc640 1 -- 172.21.15.1:0/249384838 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c528ca410 con 0x560c52846360 2024-09-19T09:45:48.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.311+0000 7ff3d2ffd640 1 --2- 172.21.15.1:0/249384838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560c528416a0 0x560c52858b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:45:48.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.311+0000 7ff3d27fc640 1 --2- 172.21.15.1:0/249384838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c52846360 0x560c52859070 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff3c80cced0 tx=0x7ff3c809bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e8cff6edb83bf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:45:48.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.311+0000 7ff3b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:45:48.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.311+0000 7ff3b2ffd640 1 -- 172.21.15.1:0/249384838 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c80b9060 con 0x560c52846360 2024-09-19T09:45:48.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.312+0000 7ff3b2ffd640 1 -- 172.21.15.1:0/249384838 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7ff3c80ccfe0 con 0x560c52846360 2024-09-19T09:45:48.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.312+0000 7ff3dbd5e740 1 -- 172.21.15.1:0/249384838 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560c527b2d00 con 0x560c52846360 2024-09-19T09:45:48.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.312+0000 7ff3b2ffd640 1 -- 172.21.15.1:0/249384838 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff3c8020040 con 0x560c52846360 2024-09-19T09:45:48.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.312+0000 7ff3dbd5e740 10 client.16386 fetch_fsmap learned FSMap version 21 2024-09-19T09:45:48.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.312+0000 7ff3dbd5e740 1 -- 172.21.15.1:0/249384838 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x560c528cb6e0 con 0x560c52846360 2024-09-19T09:45:48.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.312+0000 7ff3b2ffd640 1 -- 172.21.15.1:0/249384838 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x560c527b2d00 con 0x560c52846360 2024-09-19T09:45:48.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.312+0000 7ff3b2ffd640 1 -- 172.21.15.1:0/249384838 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8330+0+0 (secure 0 0 0) 0x7ff3c80860b0 con 0x560c52846360 2024-09-19T09:45:48.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.312+0000 7ff3dbd5e740 10 client.16386 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T09:45:48.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.312+0000 7ff3dbd5e740 10 client.16386 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:45:48.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.312+0000 7ff3dbd5e740 20 client.16386 populate_metadata read hostname 'smithi001' 2024-09-19T09:45:48.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.312+0000 7ff3dbd5e740 1 --2- 172.21.15.1:0/249384838 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x560c528cbe40 0x560c528ce260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:45:48.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.312+0000 7ff3dbd5e740 4 client.16386 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:45:48.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.312+0000 7ff3dbd5e740 1 -- 172.21.15.1:0/249384838 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560c5272f110 con 0x560c528cbe40 2024-09-19T09:45:48.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.312+0000 7ff3d2ffd640 1 --2- 172.21.15.1:0/249384838 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x560c528cbe40 0x560c528ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:45:48.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.313+0000 7ff3d2ffd640 1 --2- 172.21.15.1:0/249384838 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x560c528cbe40 0x560c528ce260 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2874a6df63525d3 server_cookie=38729f2d789708da in_seq=0 out_seq=0 2024-09-19T09:45:48.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.313+0000 7ff3b2ffd640 10 client.16386 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:45:48.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.315+0000 7ff3b2ffd640 1 -- 172.21.15.1:0/249384838 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560c5272f110 con 0x560c528cbe40 2024-09-19T09:45:48.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.315+0000 7ff3b2ffd640 10 client.16386 handle_command_reply: tid=0 2024-09-19T09:45:48.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.315+0000 7ff3dbd5e740 1 client.16386 shutdown 2024-09-19T09:45:48.759 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:45:48.759 INFO:teuthology.orchestra.run.smithi001.stdout: "return_code": 0, 2024-09-19T09:45:48.759 INFO:teuthology.orchestra.run.smithi001.stdout: "scrub_tag": "d285e454-ea30-4f97-b756-b4510122e2da", 2024-09-19T09:45:48.759 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": "asynchronous" 2024-09-19T09:45:48.759 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:45:48.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.315+0000 7ff3dbd5e740 1 -- 172.21.15.1:0/249384838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c52846360 msgr2=0x560c52859070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:48.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.315+0000 7ff3dbd5e740 1 --2- 172.21.15.1:0/249384838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c52846360 0x560c52859070 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff3c80cced0 tx=0x7ff3c809bb20 comp rx=0 tx=0).stop 2024-09-19T09:45:48.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.315+0000 7ff3dbd5e740 1 -- 172.21.15.1:0/249384838 shutdown_connections 2024-09-19T09:45:48.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.315+0000 7ff3dbd5e740 1 --2- 172.21.15.1:0/249384838 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x560c528cbe40 0x560c528ce260 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.315+0000 7ff3dbd5e740 1 --2- 172.21.15.1:0/249384838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560c52855150 0x560c528595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.315+0000 7ff3dbd5e740 1 --2- 172.21.15.1:0/249384838 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560c52846360 0x560c52859070 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.315+0000 7ff3b2ffd640 0 client.16386 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:45:48.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.315+0000 7ff3dbd5e740 1 --2- 172.21.15.1:0/249384838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560c528416a0 0x560c52858b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.315+0000 7ff3dbd5e740 1 -- 172.21.15.1:0/249384838 >> 172.21.15.1:0/249384838 conn(0x560c528420f0 msgr2=0x560c528521d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:48.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.315+0000 7ff3dbd5e740 1 -- 172.21.15.1:0/249384838 shutdown_connections 2024-09-19T09:45:48.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.318+0000 7ff3dbd5e740 1 -- 172.21.15.1:0/249384838 wait complete. 2024-09-19T09:45:48.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.318+0000 7ff3dbd5e740 20 client.16386 trim_cache size 0 max 16384 2024-09-19T09:45:48.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.319+0000 7ff3d9985640 1 -- 172.21.15.1:0/3097177510 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff3bc0a3240 msgr2=0x7ff3bc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:48.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.319+0000 7ff3d9985640 1 --2- 172.21.15.1:0/3097177510 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff3bc0a3240 0x7ff3bc0a5700 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc005e30 tx=0x7ff3cc02fe10 comp rx=0 tx=0).stop 2024-09-19T09:45:48.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.319+0000 7ff3d9985640 1 -- 172.21.15.1:0/3097177510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3d4103660 msgr2=0x7ff3d4198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:48.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.319+0000 7ff3d9985640 1 --2- 172.21.15.1:0/3097177510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3d4103660 0x7ff3d4198930 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ff3c800d740 tx=0x7ff3c800dc00 comp rx=0 tx=0).stop 2024-09-19T09:45:48.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.319+0000 7ff3d9985640 1 -- 172.21.15.1:0/3097177510 shutdown_connections 2024-09-19T09:45:48.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.319+0000 7ff3d9985640 1 --2- 172.21.15.1:0/3097177510 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3d410c170 0x7ff3d419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.319+0000 7ff3d9985640 1 --2- 172.21.15.1:0/3097177510 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff3d4103660 0x7ff3d4198930 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.319+0000 7ff3d9985640 1 --2- 172.21.15.1:0/3097177510 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7ff3bc0a3240 0x7ff3bc0a5700 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.319+0000 7ff3d9985640 1 --2- 172.21.15.1:0/3097177510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3d4102d40 0x7ff3d41983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:48.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.319+0000 7ff3d9985640 1 -- 172.21.15.1:0/3097177510 >> 172.21.15.1:0/3097177510 conn(0x7ff3d40fc7a0 msgr2=0x7ff3d40fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:48.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.319+0000 7ff3d9985640 1 -- 172.21.15.1:0/3097177510 shutdown_connections 2024-09-19T09:45:48.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:45:47.319+0000 7ff3d9985640 1 -- 172.21.15.1:0/3097177510 wait complete. 2024-09-19T09:45:49.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:49 smithi022 ceph-mon[35583]: scrub queued for path: / 2024-09-19T09:45:49.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:49 smithi022 ceph-mon[35583]: scrub summary: idle+waiting paths [/] 2024-09-19T09:45:49.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:49 smithi022 ceph-mon[35583]: scrub summary: active paths [/] 2024-09-19T09:45:49.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:49 smithi121 ceph-mon[35577]: scrub queued for path: / 2024-09-19T09:45:49.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:49 smithi121 ceph-mon[35577]: scrub summary: idle+waiting paths [/] 2024-09-19T09:45:49.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:49 smithi121 ceph-mon[35577]: scrub summary: active paths [/] 2024-09-19T09:45:49.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:49 smithi001 ceph-mon[31225]: scrub queued for path: / 2024-09-19T09:45:49.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:49 smithi001 ceph-mon[31225]: scrub summary: idle+waiting paths [/] 2024-09-19T09:45:49.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:49 smithi001 ceph-mon[31225]: scrub summary: active paths [/] 2024-09-19T09:45:50.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:50 smithi022 ceph-mon[35583]: pgmap v571: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 92 MiB/s wr, 13.36k op/s 2024-09-19T09:45:50.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:50 smithi121 ceph-mon[35577]: pgmap v571: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 92 MiB/s wr, 13.36k op/s 2024-09-19T09:45:50.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:50 smithi001 ceph-mon[31225]: pgmap v571: 97 pgs: 97 active+clean; 13 GiB data, 43 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 92 MiB/s wr, 13.36k op/s 2024-09-19T09:45:52.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:52 smithi022 ceph-mon[35583]: pgmap v572: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 96 MiB/s wr, 14.61k op/s 2024-09-19T09:45:52.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:52 smithi121 ceph-mon[35577]: pgmap v572: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 96 MiB/s wr, 14.61k op/s 2024-09-19T09:45:52.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:52 smithi001 ceph-mon[31225]: pgmap v572: 97 pgs: 97 active+clean; 13 GiB data, 39 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 96 MiB/s wr, 14.61k op/s 2024-09-19T09:45:54.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:54 smithi022 ceph-mon[35583]: pgmap v573: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 84 MiB/s wr, 13.67k op/s 2024-09-19T09:45:54.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:54 smithi121 ceph-mon[35577]: pgmap v573: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 84 MiB/s wr, 13.67k op/s 2024-09-19T09:45:54.501 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:54 smithi001 ceph-mon[31225]: pgmap v573: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 84 MiB/s wr, 13.67k op/s 2024-09-19T09:45:56.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:56 smithi022 ceph-mon[35583]: pgmap v574: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 99 MiB/s wr, 16.26k op/s 2024-09-19T09:45:56.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:56 smithi121 ceph-mon[35577]: pgmap v574: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 99 MiB/s wr, 16.26k op/s 2024-09-19T09:45:56.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:56 smithi001 ceph-mon[31225]: pgmap v574: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 99 MiB/s wr, 16.26k op/s 2024-09-19T09:45:58.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:45:58 smithi022 ceph-mon[35583]: pgmap v575: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 86 MiB/s wr, 14.69k op/s 2024-09-19T09:45:58.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:45:58 smithi121 ceph-mon[35577]: pgmap v575: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 86 MiB/s wr, 14.69k op/s 2024-09-19T09:45:58.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:45:58 smithi001 ceph-mon[31225]: pgmap v575: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 86 MiB/s wr, 14.69k op/s 2024-09-19T09:45:59.300 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:45:59.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:59.483+0000 7f7f51ffb640 1 -- 172.21.15.1:0/2360005017 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5654c95f8d70 con 0x5654c9717920 2024-09-19T09:45:59.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:59.483+0000 7f7f51ffb640 10 client.16404 handle_command_reply: tid=0 2024-09-19T09:45:59.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:59.483+0000 7f7f73827740 1 client.16404 shutdown 2024-09-19T09:45:59.486 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:59.483+0000 7f7f73827740 1 -- 172.21.15.1:0/2360005017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5654c969bb80 msgr2=0x5654c96a6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:59.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:59.483+0000 7f7f73827740 1 --2- 172.21.15.1:0/2360005017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5654c969bb80 0x5654c96a6da0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f7f6003dfd0 tx=0x7f7f60005e50 comp rx=0 tx=0).stop 2024-09-19T09:45:59.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:59.484+0000 7f7f73827740 1 -- 172.21.15.1:0/2360005017 shutdown_connections 2024-09-19T09:45:59.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:59.484+0000 7f7f73827740 1 --2- 172.21.15.1:0/2360005017 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x5654c9717920 0x5654c9719d40 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:59.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:59.484+0000 7f7f73827740 1 --2- 172.21.15.1:0/2360005017 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x5654c969bb80 0x5654c96a6da0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:59.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:59.484+0000 7f7f73827740 1 --2- 172.21.15.1:0/2360005017 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5654c9696af0 0x5654c96a5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:59.487 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:59.484+0000 7f7f73827740 1 --2- 172.21.15.1:0/2360005017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5654c96961b0 0x5654c96a59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:59.484+0000 7f7f73827740 1 -- 172.21.15.1:0/2360005017 >> 172.21.15.1:0/2360005017 conn(0x5654c9689010 msgr2=0x5654c96879a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:59.484+0000 7f7f51ffb640 0 client.16404 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:45:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:59.484+0000 7f7f73827740 1 -- 172.21.15.1:0/2360005017 shutdown_connections 2024-09-19T09:45:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:59.484+0000 7f7f73827740 1 -- 172.21.15.1:0/2360005017 wait complete. 2024-09-19T09:45:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:59.484+0000 7f7f73827740 20 client.16404 trim_cache size 0 max 16384 2024-09-19T09:45:59.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:45:59.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:45:59.489 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:45:59.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:45:59.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:59.485+0000 7f7f70a8d640 1 -- 172.21.15.1:0/3380188111 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f7f540a3240 msgr2=0x7f7f540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:59.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:59.485+0000 7f7f70a8d640 1 --2- 172.21.15.1:0/3380188111 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f7f540a3240 0x7f7f540a5700 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7f640a44c0 tx=0x7f7f64066bb0 comp rx=0 tx=0).stop 2024-09-19T09:45:59.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:59.485+0000 7f7f70a8d640 1 -- 172.21.15.1:0/3380188111 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f6c1036f0 msgr2=0x7f7f6c1a1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:45:59.490 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:59.485+0000 7f7f70a8d640 1 --2- 172.21.15.1:0/3380188111 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f6c1036f0 0x7f7f6c1a1690 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009fd0 tx=0x7f7f6400b260 comp rx=0 tx=0).stop 2024-09-19T09:45:59.491 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:59.485+0000 7f7f70a8d640 1 -- 172.21.15.1:0/3380188111 shutdown_connections 2024-09-19T09:45:59.491 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:59.485+0000 7f7f70a8d640 1 --2- 172.21.15.1:0/3380188111 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7f6c1036f0 0x7f7f6c1a1690 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:59.491 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:59.485+0000 7f7f70a8d640 1 --2- 172.21.15.1:0/3380188111 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f6c102d30 0x7f7f6c19a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:59.491 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:59.485+0000 7f7f70a8d640 1 --2- 172.21.15.1:0/3380188111 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f7f540a3240 0x7f7f540a5700 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:59.491 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:59.485+0000 7f7f70a8d640 1 --2- 172.21.15.1:0/3380188111 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7f6c101b40 0x7f7f6c19a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:45:59.492 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:59.485+0000 7f7f70a8d640 1 -- 172.21.15.1:0/3380188111 >> 172.21.15.1:0/3380188111 conn(0x7f7f6c0fd2e0 msgr2=0x7f7f6c106150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:45:59.493 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:59.485+0000 7f7f70a8d640 1 -- 172.21.15.1:0/3380188111 shutdown_connections 2024-09-19T09:45:59.493 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:45:59.485+0000 7f7f70a8d640 1 -- 172.21.15.1:0/3380188111 wait complete. 2024-09-19T09:45:59.828 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:46:00.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:00 smithi001 ceph-mon[31225]: pgmap v576: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 80 MiB/s wr, 13.74k op/s 2024-09-19T09:46:00.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:00 smithi022 ceph-mon[35583]: pgmap v576: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 80 MiB/s wr, 13.74k op/s 2024-09-19T09:46:00.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:00 smithi121 ceph-mon[35577]: pgmap v576: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 80 MiB/s wr, 13.74k op/s 2024-09-19T09:46:02.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:02 smithi121 ceph-mon[35577]: pgmap v577: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 84 MiB/s wr, 14.41k op/s 2024-09-19T09:46:02.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:02 smithi001 ceph-mon[31225]: pgmap v577: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 84 MiB/s wr, 14.41k op/s 2024-09-19T09:46:02.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:02 smithi022 ceph-mon[35583]: pgmap v577: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 84 MiB/s wr, 14.41k op/s 2024-09-19T09:46:04.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:04 smithi121 ceph-mon[35577]: pgmap v578: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 72 MiB/s wr, 12.16k op/s 2024-09-19T09:46:04.405 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:04 smithi001 ceph-mon[31225]: pgmap v578: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 72 MiB/s wr, 12.16k op/s 2024-09-19T09:46:04.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:04 smithi022 ceph-mon[35583]: pgmap v578: 97 pgs: 97 active+clean; 13 GiB data, 40 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 72 MiB/s wr, 12.16k op/s 2024-09-19T09:46:05.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.517+0000 7f99d93b9640 1 -- 172.21.15.1:0/4093046293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99d4101de0 msgr2=0x7f99d41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:05.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.517+0000 7f99d93b9640 1 --2- 172.21.15.1:0/4093046293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99d4101de0 0x7f99d41021c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f99c4009900 tx=0x7f99c402a410 comp rx=0 tx=0).stop 2024-09-19T09:46:05.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.517+0000 7f99d93b9640 1 -- 172.21.15.1:0/4093046293 shutdown_connections 2024-09-19T09:46:05.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.517+0000 7f99d93b9640 1 --2- 172.21.15.1:0/4093046293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f99d4106f10 0x7f99d410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.517+0000 7f99d93b9640 1 --2- 172.21.15.1:0/4093046293 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99d4102790 0x7f99d41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.517+0000 7f99d93b9640 1 --2- 172.21.15.1:0/4093046293 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99d4101de0 0x7f99d41021c0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.517+0000 7f99d93b9640 1 -- 172.21.15.1:0/4093046293 >> 172.21.15.1:0/4093046293 conn(0x7f99d40fd8c0 msgr2=0x7f99d40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:05.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.517+0000 7f99d93b9640 1 -- 172.21.15.1:0/4093046293 shutdown_connections 2024-09-19T09:46:05.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.517+0000 7f99d93b9640 1 -- 172.21.15.1:0/4093046293 wait complete. 2024-09-19T09:46:05.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.517+0000 7f99d93b9640 1 Processor -- start 2024-09-19T09:46:05.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.517+0000 7f99d93b9640 1 -- start start 2024-09-19T09:46:05.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.518+0000 7f99d93b9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f99d4101de0 0x7f99d40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:05.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.518+0000 7f99d93b9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99d4102790 0x7f99d4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:05.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.518+0000 7f99d93b9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99d4106f10 0x7f99d4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:05.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.518+0000 7f99d93b9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f99d4111f70 con 0x7f99d4106f10 2024-09-19T09:46:05.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.518+0000 7f99d93b9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f99d4111df0 con 0x7f99d4101de0 2024-09-19T09:46:05.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.518+0000 7f99d93b9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f99d41120f0 con 0x7f99d4102790 2024-09-19T09:46:05.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.518+0000 7f99d37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99d4106f10 0x7f99d4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:05.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.518+0000 7f99d37fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99d4106f10 0x7f99d4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33246/0 (socket says 172.21.15.1:33246) 2024-09-19T09:46:05.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.518+0000 7f99d2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f99d4101de0 0x7f99d40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:05.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.518+0000 7f99d37fe640 1 -- 172.21.15.1:0/1390219799 learned_addr learned my addr 172.21.15.1:0/1390219799 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:05.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.518+0000 7f99d27fc640 1 --2- 172.21.15.1:0/1390219799 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99d4102790 0x7f99d4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:05.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.518+0000 7f99d37fe640 1 -- 172.21.15.1:0/1390219799 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99d4102790 msgr2=0x7f99d4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:05.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.518+0000 7f99d37fe640 1 --2- 172.21.15.1:0/1390219799 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99d4102790 0x7f99d4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.518+0000 7f99d37fe640 1 -- 172.21.15.1:0/1390219799 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f99d4101de0 msgr2=0x7f99d40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:05.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.518+0000 7f99d37fe640 1 --2- 172.21.15.1:0/1390219799 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f99d4101de0 0x7f99d40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.518+0000 7f99d37fe640 1 -- 172.21.15.1:0/1390219799 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d41a6910 con 0x7f99d4106f10 2024-09-19T09:46:05.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.518+0000 7f99d2ffd640 1 --2- 172.21.15.1:0/1390219799 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f99d4101de0 0x7f99d40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:46:05.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.518+0000 7f99d37fe640 1 --2- 172.21.15.1:0/1390219799 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99d4106f10 0x7f99d4074f70 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f99cc00eaa0 tx=0x7f99cc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:05.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.519+0000 7f99bbfff640 1 -- 172.21.15.1:0/1390219799 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc00cdb0 con 0x7f99d4106f10 2024-09-19T09:46:05.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.519+0000 7f99bbfff640 1 -- 172.21.15.1:0/1390219799 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99cc005020 con 0x7f99d4106f10 2024-09-19T09:46:05.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.519+0000 7f99d93b9640 1 -- 172.21.15.1:0/1390219799 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99d41a6c00 con 0x7f99d4106f10 2024-09-19T09:46:05.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.519+0000 7f99bbfff640 1 -- 172.21.15.1:0/1390219799 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc0116b0 con 0x7f99d4106f10 2024-09-19T09:46:05.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.519+0000 7f99d93b9640 1 -- 172.21.15.1:0/1390219799 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99d41a70f0 con 0x7f99d4106f10 2024-09-19T09:46:05.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.521+0000 7f99db792740 1 Processor -- start 2024-09-19T09:46:05.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.522+0000 7f99bbfff640 1 -- 172.21.15.1:0/1390219799 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f99cc005560 con 0x7f99d4106f10 2024-09-19T09:46:05.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.522+0000 7f99db792740 1 -- start start 2024-09-19T09:46:05.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.522+0000 7f99db792740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f9344164a0 0x55f934416880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:05.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.522+0000 7f99db792740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f934416dc0 0x55f934421140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:05.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.522+0000 7f99db792740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f934421680 0x55f934423a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:05.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.522+0000 7f99db792740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f93437c2e0 con 0x55f934421680 2024-09-19T09:46:05.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.522+0000 7f99db792740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f934323ce0 con 0x55f934416dc0 2024-09-19T09:46:05.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.522+0000 7f99db792740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f9343782a0 con 0x55f9344164a0 2024-09-19T09:46:05.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.522+0000 7f99d27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f934421680 0x55f934423a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:05.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.522+0000 7f99d2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f934416dc0 0x55f934421140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:05.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.522+0000 7f99d27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f934421680 0x55f934423a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33256/0 (socket says 172.21.15.1:33256) 2024-09-19T09:46:05.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.522+0000 7f99d27fc640 1 -- 172.21.15.1:0/2762369583 learned_addr learned my addr 172.21.15.1:0/2762369583 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:05.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.523+0000 7f99d27fc640 1 --2- 172.21.15.1:0/2762369583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f9344164a0 0x55f934416880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:05.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.523+0000 7f99d2ffd640 1 -- 172.21.15.1:0/2762369583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f9344164a0 msgr2=0x55f934416880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:05.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.523+0000 7f99d2ffd640 1 --2- 172.21.15.1:0/2762369583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f9344164a0 0x55f934416880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.523+0000 7f99d2ffd640 1 -- 172.21.15.1:0/2762369583 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f934421680 msgr2=0x55f934423a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:05.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.523+0000 7f99d2ffd640 1 --2- 172.21.15.1:0/2762369583 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f934421680 0x55f934423a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.523+0000 7f99d2ffd640 1 -- 172.21.15.1:0/2762369583 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f934308440 con 0x55f934416dc0 2024-09-19T09:46:05.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.523+0000 7f99bbfff640 1 --2- 172.21.15.1:0/1390219799 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f99bc0a3240 0x7f99bc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:05.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.523+0000 7f99d2ffd640 1 --2- 172.21.15.1:0/2762369583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f934416dc0 0x55f934421140 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f99c4005940 tx=0x7f99c4005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=567091ee973899b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:05.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.523+0000 7f99d27fc640 1 --2- 172.21.15.1:0/1390219799 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f99bc0a3240 0x7f99bc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:05.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.523+0000 7f99bbfff640 1 -- 172.21.15.1:0/1390219799 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f99cc0cfa70 con 0x7f99d4106f10 2024-09-19T09:46:05.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.523+0000 7f99b97fa640 1 -- 172.21.15.1:0/2762369583 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c4035040 con 0x55f934416dc0 2024-09-19T09:46:05.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.523+0000 7f99b97fa640 1 -- 172.21.15.1:0/2762369583 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99c40319f0 con 0x55f934416dc0 2024-09-19T09:46:05.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.523+0000 7f99d27fc640 1 --2- 172.21.15.1:0/1390219799 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f99bc0a3240 0x7f99bc0a5700 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f99c800c010 tx=0x7f99c8005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:05.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.524+0000 7f99b97fa640 1 -- 172.21.15.1:0/2762369583 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c40049b0 con 0x55f934416dc0 2024-09-19T09:46:05.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.524+0000 7f99db792740 1 -- 172.21.15.1:0/2762369583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f934416dc0 msgr2=0x55f934421140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:05.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.524+0000 7f99db792740 1 --2- 172.21.15.1:0/2762369583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f934416dc0 0x55f934421140 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f99c4005940 tx=0x7f99c4005e80 comp rx=0 tx=0).stop 2024-09-19T09:46:05.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.524+0000 7f99db792740 1 -- 172.21.15.1:0/2762369583 shutdown_connections 2024-09-19T09:46:05.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.524+0000 7f99db792740 1 --2- 172.21.15.1:0/2762369583 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f934421680 0x55f934423a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.524+0000 7f99db792740 1 --2- 172.21.15.1:0/2762369583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f934416dc0 0x55f934421140 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.524+0000 7f99db792740 1 --2- 172.21.15.1:0/2762369583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f9344164a0 0x55f934416880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.524+0000 7f99db792740 1 -- 172.21.15.1:0/2762369583 >> 172.21.15.1:0/2762369583 conn(0x55f934412a30 msgr2=0x55f934412e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:05.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.524+0000 7f99db792740 1 -- 172.21.15.1:0/2762369583 shutdown_connections 2024-09-19T09:46:05.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.524+0000 7f99db792740 1 -- 172.21.15.1:0/2762369583 wait complete. 2024-09-19T09:46:05.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.525+0000 7f99db792740 1 -- start start 2024-09-19T09:46:05.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.525+0000 7f99db792740 1 Processor -- start 2024-09-19T09:46:05.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.525+0000 7f99db792740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f9344164a0 0x55f934420e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:05.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.525+0000 7f99db792740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f934416dc0 0x55f93441e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:05.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.525+0000 7f99db792740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f934421680 0x55f93441e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:05.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.525+0000 7f99db792740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f9344242f0 con 0x55f934416dc0 2024-09-19T09:46:05.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.525+0000 7f99db792740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f934337050 con 0x55f9344164a0 2024-09-19T09:46:05.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.525+0000 7f99db792740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f934424470 con 0x55f934421680 2024-09-19T09:46:05.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.525+0000 7f99db792740 10 client.0 _ll_register_callbacks cb 0x55f934377160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:46:05.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.525+0000 7f99d27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f934416dc0 0x55f93441e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:05.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.525+0000 7f99d27fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f934416dc0 0x55f93441e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33264/0 (socket says 172.21.15.1:33264) 2024-09-19T09:46:05.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.525+0000 7f99d27fc640 1 -- 172.21.15.1:0/4058550607 learned_addr learned my addr 172.21.15.1:0/4058550607 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:05.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.525+0000 7f99d2ffd640 1 --2- 172.21.15.1:0/4058550607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f9344164a0 0x55f934420e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:05.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.525+0000 7f99d37fe640 1 --2- 172.21.15.1:0/4058550607 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f934421680 0x55f93441e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:05.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.525+0000 7f99d27fc640 1 -- 172.21.15.1:0/4058550607 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f934421680 msgr2=0x55f93441e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:05.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.525+0000 7f99d27fc640 1 --2- 172.21.15.1:0/4058550607 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f934421680 0x55f93441e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.525+0000 7f99d27fc640 1 -- 172.21.15.1:0/4058550607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f9344164a0 msgr2=0x55f934420e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:05.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.525+0000 7f99d27fc640 1 --2- 172.21.15.1:0/4058550607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f9344164a0 0x55f934420e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.525+0000 7f99d27fc640 1 -- 172.21.15.1:0/4058550607 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9340ed3c0 con 0x55f934416dc0 2024-09-19T09:46:05.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.526+0000 7f99d2ffd640 1 --2- 172.21.15.1:0/4058550607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f9344164a0 0x55f934420e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:46:05.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.526+0000 7f99d27fc640 1 --2- 172.21.15.1:0/4058550607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f934416dc0 0x55f93441e0e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f99c80106b0 tx=0x7f99c800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=167f70de3798d48c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:05.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.526+0000 7f99b6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:46:05.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.526+0000 7f99b6ff5640 1 -- 172.21.15.1:0/4058550607 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c8021830 con 0x55f934416dc0 2024-09-19T09:46:05.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.526+0000 7f99b6ff5640 1 -- 172.21.15.1:0/4058550607 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f99c80219d0 con 0x55f934416dc0 2024-09-19T09:46:05.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.526+0000 7f99db792740 1 -- 172.21.15.1:0/4058550607 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99c40319f0 con 0x55f934416dc0 2024-09-19T09:46:05.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.526+0000 7f99b6ff5640 1 -- 172.21.15.1:0/4058550607 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f99c8021bd0 con 0x55f934416dc0 2024-09-19T09:46:05.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.526+0000 7f99db792740 10 client.16416 fetch_fsmap learned FSMap version 21 2024-09-19T09:46:05.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.526+0000 7f99db792740 1 -- 172.21.15.1:0/4058550607 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f93442fb60 con 0x55f934416dc0 2024-09-19T09:46:05.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.526+0000 7f99b6ff5640 1 -- 172.21.15.1:0/4058550607 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99c40319f0 con 0x55f934416dc0 2024-09-19T09:46:05.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.527+0000 7f99b6ff5640 1 -- 172.21.15.1:0/4058550607 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8330+0+0 (secure 0 0 0) 0x7f99c802a410 con 0x55f934416dc0 2024-09-19T09:46:05.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.527+0000 7f99db792740 10 client.16416 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T09:46:05.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.527+0000 7f99db792740 10 client.16416 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:46:05.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.527+0000 7f99db792740 20 client.16416 populate_metadata read hostname 'smithi001' 2024-09-19T09:46:05.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.527+0000 7f99db792740 1 --2- 172.21.15.1:0/4058550607 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55f934431020 0x55f934433490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:05.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.527+0000 7f99db792740 4 client.16416 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:46:05.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.527+0000 7f99db792740 1 -- 172.21.15.1:0/4058550607 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f934389850 con 0x55f934431020 2024-09-19T09:46:05.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.527+0000 7f99d2ffd640 1 --2- 172.21.15.1:0/4058550607 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55f934431020 0x55f934433490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:05.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.527+0000 7f99b6ff5640 10 client.16416 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:46:05.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.527+0000 7f99d2ffd640 1 --2- 172.21.15.1:0/4058550607 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55f934431020 0x55f934433490 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8aa30f4d03f92d02 server_cookie=7cb6f786ad8f6a32 in_seq=0 out_seq=0 2024-09-19T09:46:05.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.528+0000 7f99b6ff5640 1 -- 172.21.15.1:0/4058550607 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f934389850 con 0x55f934431020 2024-09-19T09:46:05.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.528+0000 7f99b6ff5640 10 client.16416 handle_command_reply: tid=0 2024-09-19T09:46:05.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.528+0000 7f99db792740 1 client.16416 shutdown 2024-09-19T09:46:05.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.528+0000 7f99db792740 1 -- 172.21.15.1:0/4058550607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f934416dc0 msgr2=0x55f93441e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:05.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.528+0000 7f99db792740 1 --2- 172.21.15.1:0/4058550607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f934416dc0 0x55f93441e0e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f99c80106b0 tx=0x7f99c800b390 comp rx=0 tx=0).stop 2024-09-19T09:46:05.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.528+0000 7f99db792740 1 -- 172.21.15.1:0/4058550607 shutdown_connections 2024-09-19T09:46:05.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.528+0000 7f99db792740 1 --2- 172.21.15.1:0/4058550607 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55f934431020 0x55f934433490 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.528+0000 7f99db792740 1 --2- 172.21.15.1:0/4058550607 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f934421680 0x55f93441e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.528+0000 7f99db792740 1 --2- 172.21.15.1:0/4058550607 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f934416dc0 0x55f93441e0e0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.528+0000 7f99b6ff5640 0 client.16416 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:46:05.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.528+0000 7f99db792740 1 --2- 172.21.15.1:0/4058550607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f9344164a0 0x55f934420e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.528+0000 7f99db792740 1 -- 172.21.15.1:0/4058550607 >> 172.21.15.1:0/4058550607 conn(0x55f934412a30 msgr2=0x55f934418710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:05.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.528+0000 7f99db792740 1 -- 172.21.15.1:0/4058550607 shutdown_connections 2024-09-19T09:46:05.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.528+0000 7f99db792740 1 -- 172.21.15.1:0/4058550607 wait complete. 2024-09-19T09:46:05.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.528+0000 7f99db792740 20 client.16416 trim_cache size 0 max 16384 2024-09-19T09:46:05.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.545+0000 7f99db792740 1 Processor -- start 2024-09-19T09:46:05.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.545+0000 7f99db792740 1 -- start start 2024-09-19T09:46:05.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.546+0000 7f99db792740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9344164a0 0x55f9344197f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:05.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.546+0000 7f99db792740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f934416dc0 0x55f93441d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:05.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.546+0000 7f99db792740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f934421680 0x55f934438d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:05.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.546+0000 7f99db792740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f99d41ad6d0 con 0x55f9344164a0 2024-09-19T09:46:05.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.546+0000 7f99db792740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f99d41aff70 con 0x55f934416dc0 2024-09-19T09:46:05.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.546+0000 7f99db792740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f99d41add60 con 0x55f934421680 2024-09-19T09:46:05.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.546+0000 7f99d2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9344164a0 0x55f9344197f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:05.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.546+0000 7f99d2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9344164a0 0x55f9344197f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33272/0 (socket says 172.21.15.1:33272) 2024-09-19T09:46:05.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.546+0000 7f99d2ffd640 1 -- 172.21.15.1:0/4203479172 learned_addr learned my addr 172.21.15.1:0/4203479172 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:05.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.546+0000 7f99d37fe640 1 --2- 172.21.15.1:0/4203479172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f934421680 0x55f934438d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:05.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.546+0000 7f99d27fc640 1 --2- 172.21.15.1:0/4203479172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f934416dc0 0x55f93441d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:05.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.546+0000 7f99d2ffd640 1 -- 172.21.15.1:0/4203479172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f934421680 msgr2=0x55f934438d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:05.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.546+0000 7f99d2ffd640 1 --2- 172.21.15.1:0/4203479172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f934421680 0x55f934438d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.546+0000 7f99d2ffd640 1 -- 172.21.15.1:0/4203479172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f934416dc0 msgr2=0x55f93441d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:05.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.546+0000 7f99d2ffd640 1 --2- 172.21.15.1:0/4203479172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f934416dc0 0x55f93441d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.546+0000 7f99d2ffd640 1 -- 172.21.15.1:0/4203479172 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f93441d090 con 0x55f9344164a0 2024-09-19T09:46:05.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.546+0000 7f99d2ffd640 1 --2- 172.21.15.1:0/4203479172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9344164a0 0x55f9344197f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f99c4005c40 tx=0x7f99c40058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ac9bd579a50a16 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:05.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.546+0000 7f99b8ff9640 1 -- 172.21.15.1:0/4203479172 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c4035050 con 0x55f9344164a0 2024-09-19T09:46:05.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.546+0000 7f99b8ff9640 1 -- 172.21.15.1:0/4203479172 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99c4005040 con 0x55f9344164a0 2024-09-19T09:46:05.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.546+0000 7f99b8ff9640 1 -- 172.21.15.1:0/4203479172 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c4004c80 con 0x55f9344164a0 2024-09-19T09:46:05.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.547+0000 7f99db792740 1 -- 172.21.15.1:0/4203479172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9344164a0 msgr2=0x55f9344197f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:05.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.547+0000 7f99db792740 1 --2- 172.21.15.1:0/4203479172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9344164a0 0x55f9344197f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f99c4005c40 tx=0x7f99c40058d0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.547+0000 7f99db792740 1 -- 172.21.15.1:0/4203479172 shutdown_connections 2024-09-19T09:46:05.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.547+0000 7f99db792740 1 --2- 172.21.15.1:0/4203479172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f934421680 0x55f934438d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.547+0000 7f99db792740 1 --2- 172.21.15.1:0/4203479172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f934416dc0 0x55f93441d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.547+0000 7f99db792740 1 --2- 172.21.15.1:0/4203479172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9344164a0 0x55f9344197f0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.547+0000 7f99db792740 1 -- 172.21.15.1:0/4203479172 >> 172.21.15.1:0/4203479172 conn(0x55f934412a30 msgr2=0x55f9344190e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:05.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.547+0000 7f99db792740 1 -- 172.21.15.1:0/4203479172 shutdown_connections 2024-09-19T09:46:05.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.547+0000 7f99db792740 1 -- 172.21.15.1:0/4203479172 wait complete. 2024-09-19T09:46:05.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.547+0000 7f99db792740 1 -- start start 2024-09-19T09:46:05.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.548+0000 7f99db792740 1 Processor -- start 2024-09-19T09:46:05.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.548+0000 7f99db792740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9344164a0 0x55f93441b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:05.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.548+0000 7f99db792740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f934416dc0 0x55f9344296c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:05.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.548+0000 7f99db792740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f934421680 0x55f934429c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:05.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.548+0000 7f99db792740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f99d41ae430 con 0x55f9344164a0 2024-09-19T09:46:05.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.548+0000 7f99db792740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f99d41af8a0 con 0x55f934416dc0 2024-09-19T09:46:05.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.548+0000 7f99db792740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f99d41aeb00 con 0x55f934421680 2024-09-19T09:46:05.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.548+0000 7f99db792740 10 client.0 _ll_register_callbacks cb 0x7f99c80043c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:46:05.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.548+0000 7f99d2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9344164a0 0x55f93441b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:05.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.548+0000 7f99d2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9344164a0 0x55f93441b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:33278/0 (socket says 172.21.15.1:33278) 2024-09-19T09:46:05.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.548+0000 7f99d2ffd640 1 -- 172.21.15.1:0/3983503889 learned_addr learned my addr 172.21.15.1:0/3983503889 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:05.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.548+0000 7f99d37fe640 1 --2- 172.21.15.1:0/3983503889 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f934421680 0x55f934429c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:05.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.548+0000 7f99d27fc640 1 --2- 172.21.15.1:0/3983503889 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f934416dc0 0x55f9344296c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:05.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.548+0000 7f99d2ffd640 1 -- 172.21.15.1:0/3983503889 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f934421680 msgr2=0x55f934429c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:05.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.548+0000 7f99d2ffd640 1 --2- 172.21.15.1:0/3983503889 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f934421680 0x55f934429c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.548+0000 7f99d2ffd640 1 -- 172.21.15.1:0/3983503889 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f934416dc0 msgr2=0x55f9344296c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:05.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.548+0000 7f99d2ffd640 1 --2- 172.21.15.1:0/3983503889 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f934416dc0 0x55f9344296c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.548+0000 7f99d2ffd640 1 -- 172.21.15.1:0/3983503889 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9344211a0 con 0x55f9344164a0 2024-09-19T09:46:05.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.548+0000 7f99d37fe640 1 --2- 172.21.15.1:0/3983503889 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f934421680 0x55f934429c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:46:05.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.548+0000 7f99d27fc640 1 --2- 172.21.15.1:0/3983503889 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f934416dc0 0x55f9344296c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:46:05.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.548+0000 7f99d2ffd640 1 --2- 172.21.15.1:0/3983503889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9344164a0 0x55f93441b9a0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f99c402a930 tx=0x7f99c40319c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73bb96ec727664d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:05.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.548+0000 7f99b6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:46:05.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.549+0000 7f99b6ff5640 1 -- 172.21.15.1:0/3983503889 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c4035070 con 0x55f9344164a0 2024-09-19T09:46:05.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.549+0000 7f99b6ff5640 1 -- 172.21.15.1:0/3983503889 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f99c40051f0 con 0x55f9344164a0 2024-09-19T09:46:05.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.549+0000 7f99db792740 1 -- 172.21.15.1:0/3983503889 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99c4005040 con 0x55f9344164a0 2024-09-19T09:46:05.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.549+0000 7f99b6ff5640 1 -- 172.21.15.1:0/3983503889 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f99c40044c0 con 0x55f9344164a0 2024-09-19T09:46:05.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.549+0000 7f99db792740 10 client.16422 fetch_fsmap learned FSMap version 21 2024-09-19T09:46:05.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.549+0000 7f99db792740 1 -- 172.21.15.1:0/3983503889 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f93441b2a0 con 0x55f9344164a0 2024-09-19T09:46:05.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.549+0000 7f99b6ff5640 1 -- 172.21.15.1:0/3983503889 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99c4005040 con 0x55f9344164a0 2024-09-19T09:46:05.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.549+0000 7f99b6ff5640 1 -- 172.21.15.1:0/3983503889 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8330+0+0 (secure 0 0 0) 0x7f99c4003a60 con 0x55f9344164a0 2024-09-19T09:46:05.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.549+0000 7f99db792740 10 client.16422 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T09:46:05.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.549+0000 7f99db792740 10 client.16422 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:46:05.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.549+0000 7f99db792740 20 client.16422 populate_metadata read hostname 'smithi001' 2024-09-19T09:46:05.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.549+0000 7f99db792740 1 --2- 172.21.15.1:0/3983503889 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55f93449bdd0 0x55f93449e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:05.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.549+0000 7f99db792740 4 client.16422 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:46:05.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.549+0000 7f99db792740 1 -- 172.21.15.1:0/3983503889 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f934383d60 con 0x55f93449bdd0 2024-09-19T09:46:05.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.549+0000 7f99d27fc640 1 --2- 172.21.15.1:0/3983503889 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55f93449bdd0 0x55f93449e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:05.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.550+0000 7f99d27fc640 1 --2- 172.21.15.1:0/3983503889 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55f93449bdd0 0x55f93449e1c0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92455e3e47499b26 server_cookie=c6eee52e405825d7 in_seq=0 out_seq=0 2024-09-19T09:46:05.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.550+0000 7f99b6ff5640 10 client.16422 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:46:05.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.550+0000 7f99b6ff5640 1 -- 172.21.15.1:0/3983503889 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x55f934383d60 con 0x55f93449bdd0 2024-09-19T09:46:05.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.550+0000 7f99b6ff5640 10 client.16422 handle_command_reply: tid=0 2024-09-19T09:46:05.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.550+0000 7f99db792740 1 client.16422 shutdown 2024-09-19T09:46:05.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.550+0000 7f99db792740 1 -- 172.21.15.1:0/3983503889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9344164a0 msgr2=0x55f93441b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:05.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.550+0000 7f99db792740 1 --2- 172.21.15.1:0/3983503889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9344164a0 0x55f93441b9a0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f99c402a930 tx=0x7f99c40319c0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.550+0000 7f99db792740 1 -- 172.21.15.1:0/3983503889 shutdown_connections 2024-09-19T09:46:05.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.550+0000 7f99db792740 1 --2- 172.21.15.1:0/3983503889 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55f93449bdd0 0x55f93449e1c0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.550+0000 7f99db792740 1 --2- 172.21.15.1:0/3983503889 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f934421680 0x55f934429c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.550+0000 7f99db792740 1 --2- 172.21.15.1:0/3983503889 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f934416dc0 0x55f9344296c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.550+0000 7f99b6ff5640 0 client.16422 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:46:05.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.550+0000 7f99db792740 1 --2- 172.21.15.1:0/3983503889 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f9344164a0 0x55f93441b9a0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.550+0000 7f99db792740 1 -- 172.21.15.1:0/3983503889 >> 172.21.15.1:0/3983503889 conn(0x55f934412a30 msgr2=0x55f934420160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:05.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.550+0000 7f99db792740 1 -- 172.21.15.1:0/3983503889 shutdown_connections 2024-09-19T09:46:05.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.550+0000 7f99db792740 1 -- 172.21.15.1:0/3983503889 wait complete. 2024-09-19T09:46:05.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.550+0000 7f99db792740 20 client.16422 trim_cache size 0 max 16384 2024-09-19T09:46:05.682 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:46:05.682 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "scrub active (201 inodes in the stack)", 2024-09-19T09:46:05.682 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": { 2024-09-19T09:46:05.682 INFO:teuthology.orchestra.run.smithi001.stdout: "d285e454-ea30-4f97-b756-b4510122e2da": { 2024-09-19T09:46:05.682 INFO:teuthology.orchestra.run.smithi001.stdout: "path": "/", 2024-09-19T09:46:05.682 INFO:teuthology.orchestra.run.smithi001.stdout: "tag": "d285e454-ea30-4f97-b756-b4510122e2da", 2024-09-19T09:46:05.683 INFO:teuthology.orchestra.run.smithi001.stdout: "options": "recursive,force" 2024-09-19T09:46:05.683 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:46:05.683 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:46:05.683 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:46:05.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.551+0000 7f99d93b9640 1 -- 172.21.15.1:0/1390219799 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f99bc0a3240 msgr2=0x7f99bc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:05.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.551+0000 7f99d93b9640 1 --2- 172.21.15.1:0/1390219799 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f99bc0a3240 0x7f99bc0a5700 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f99c800c010 tx=0x7f99c8005c90 comp rx=0 tx=0).stop 2024-09-19T09:46:05.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.551+0000 7f99d93b9640 1 -- 172.21.15.1:0/1390219799 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99d4106f10 msgr2=0x7f99d4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:05.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.551+0000 7f99d93b9640 1 --2- 172.21.15.1:0/1390219799 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99d4106f10 0x7f99d4074f70 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f99cc00eaa0 tx=0x7f99cc00ef60 comp rx=0 tx=0).stop 2024-09-19T09:46:05.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.551+0000 7f99d93b9640 1 -- 172.21.15.1:0/1390219799 shutdown_connections 2024-09-19T09:46:05.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.551+0000 7f99d93b9640 1 --2- 172.21.15.1:0/1390219799 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f99d4106f10 0x7f99d4074f70 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.551+0000 7f99d93b9640 1 --2- 172.21.15.1:0/1390219799 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f99d4102790 0x7f99d4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.551+0000 7f99d93b9640 1 --2- 172.21.15.1:0/1390219799 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f99bc0a3240 0x7f99bc0a5700 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.551+0000 7f99d93b9640 1 --2- 172.21.15.1:0/1390219799 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f99d4101de0 0x7f99d40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:05.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.551+0000 7f99d93b9640 1 -- 172.21.15.1:0/1390219799 >> 172.21.15.1:0/1390219799 conn(0x7f99d40fd8c0 msgr2=0x7f99d40fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:05.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.551+0000 7f99d93b9640 1 -- 172.21.15.1:0/1390219799 shutdown_connections 2024-09-19T09:46:05.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:04.551+0000 7f99d93b9640 1 -- 172.21.15.1:0/1390219799 wait complete. 2024-09-19T09:46:06.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:06 smithi001 ceph-mon[31225]: pgmap v579: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 69 MiB/s wr, 11.81k op/s 2024-09-19T09:46:06.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:06 smithi022 ceph-mon[35583]: pgmap v579: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 69 MiB/s wr, 11.81k op/s 2024-09-19T09:46:06.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:06 smithi121 ceph-mon[35577]: pgmap v579: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 69 MiB/s wr, 11.81k op/s 2024-09-19T09:46:08.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:08 smithi001 ceph-mon[31225]: pgmap v580: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 56 MiB/s wr, 9.52k op/s 2024-09-19T09:46:08.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:08 smithi022 ceph-mon[35583]: pgmap v580: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 56 MiB/s wr, 9.52k op/s 2024-09-19T09:46:08.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:08 smithi121 ceph-mon[35577]: pgmap v580: 97 pgs: 97 active+clean; 13 GiB data, 38 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 56 MiB/s wr, 9.52k op/s 2024-09-19T09:46:10.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:10 smithi001 ceph-mon[31225]: pgmap v581: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 MiB/s wr, 7.39k op/s 2024-09-19T09:46:10.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:10 smithi022 ceph-mon[35583]: pgmap v581: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 MiB/s wr, 7.39k op/s 2024-09-19T09:46:10.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:10 smithi121 ceph-mon[35577]: pgmap v581: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 MiB/s wr, 7.39k op/s 2024-09-19T09:46:11.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:11.928+0000 7f4030ff9640 1 -- 172.21.15.1:0/1980588964 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f4044036070 con 0x560acf5ee260 2024-09-19T09:46:11.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:11.928+0000 7f4030ff9640 10 client.26039 handle_command_reply: tid=0 2024-09-19T09:46:11.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:11.928+0000 7f4055666740 1 client.26039 shutdown 2024-09-19T09:46:11.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:11.928+0000 7f4055666740 1 -- 172.21.15.1:0/1980588964 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560acf564080 msgr2=0x560acf572ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:11.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:11.928+0000 7f4055666740 1 --2- 172.21.15.1:0/1980588964 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560acf564080 0x560acf572ed0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x560acf560b50 tx=0x7f4040004730 comp rx=0 tx=0).stop 2024-09-19T09:46:11.932 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:46:11.932 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T09:46:11.932 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24497, 2024-09-19T09:46:11.932 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 22, 2024-09-19T09:46:11.932 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T09:46:11.932 INFO:teuthology.orchestra.run.smithi001.stdout: "d2937df4": { 2024-09-19T09:46:11.932 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 22, 2024-09-19T09:46:11.932 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T09:46:11.932 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:46:11.933 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T09:46:11.933 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:46:11.933 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:46:11.933 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T09:46:11.933 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 149.8, 2024-09-19T09:46:11.933 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T09:46:11.933 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T09:46:11.933 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T09:46:11.933 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:46:11.933 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "QUIESCED", 2024-09-19T09:46:11.933 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:46:11.933 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:46:11.933 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:46:11.933 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:46:11.934 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:46:11.934 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:46:11.934 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:46:11.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:11.929+0000 7f4055666740 1 -- 172.21.15.1:0/1980588964 shutdown_connections 2024-09-19T09:46:11.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:11.929+0000 7f4055666740 1 --2- 172.21.15.1:0/1980588964 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x560acf5ee260 0x560acf5f0720 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:11.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:11.929+0000 7f4055666740 1 --2- 172.21.15.1:0/1980588964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560acf56e940 0x560acf5e80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:11.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:11.929+0000 7f4030ff9640 0 client.26039 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:46:11.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:11.929+0000 7f4055666740 1 --2- 172.21.15.1:0/1980588964 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560acf564080 0x560acf572ed0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:11.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:11.929+0000 7f4055666740 1 --2- 172.21.15.1:0/1980588964 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x560acf563760 0x560acf572990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:11.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:11.929+0000 7f4055666740 1 -- 172.21.15.1:0/1980588964 >> 172.21.15.1:0/1980588964 conn(0x560acf55fcf0 msgr2=0x560acf5651b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:11.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:11.929+0000 7f4055666740 1 -- 172.21.15.1:0/1980588964 shutdown_connections 2024-09-19T09:46:11.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:11.929+0000 7f4055666740 1 -- 172.21.15.1:0/1980588964 wait complete. 2024-09-19T09:46:11.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:11.929+0000 7f4055666740 20 client.26039 trim_cache size 0 max 16384 2024-09-19T09:46:11.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:11.930+0000 7f405328d640 1 -- 172.21.15.1:0/2226493844 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f40340a3240 msgr2=0x7f40340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:11.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:11.930+0000 7f405328d640 1 --2- 172.21.15.1:0/2226493844 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f40340a3240 0x7f40340a5700 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f404c0fdce0 tx=0x7f404000b370 comp rx=0 tx=0).stop 2024-09-19T09:46:11.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:11.930+0000 7f405328d640 1 -- 172.21.15.1:0/2226493844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f404c101de0 msgr2=0x7f404c198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:11.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:11.930+0000 7f405328d640 1 --2- 172.21.15.1:0/2226493844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f404c101de0 0x7f404c198430 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f404402ade0 tx=0x7f40440319f0 comp rx=0 tx=0).stop 2024-09-19T09:46:11.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:11.930+0000 7f405328d640 1 -- 172.21.15.1:0/2226493844 shutdown_connections 2024-09-19T09:46:11.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:11.930+0000 7f405328d640 1 --2- 172.21.15.1:0/2226493844 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f40340a3240 0x7f40340a5700 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:11.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:11.930+0000 7f405328d640 1 --2- 172.21.15.1:0/2226493844 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f404c106f10 0x7f404c19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:11.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:11.930+0000 7f405328d640 1 --2- 172.21.15.1:0/2226493844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f404c102790 0x7f404c198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:11.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:11.930+0000 7f405328d640 1 --2- 172.21.15.1:0/2226493844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f404c101de0 0x7f404c198430 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:11.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:11.930+0000 7f405328d640 1 -- 172.21.15.1:0/2226493844 >> 172.21.15.1:0/2226493844 conn(0x7f404c0fd8c0 msgr2=0x7f404c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:11.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:11.930+0000 7f405328d640 1 -- 172.21.15.1:0/2226493844 shutdown_connections 2024-09-19T09:46:11.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:11.931+0000 7f405328d640 1 -- 172.21.15.1:0/2226493844 wait complete. 2024-09-19T09:46:12.248 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:12 smithi001 ceph-mon[31225]: pgmap v582: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 45 MiB/s wr, 7.65k op/s 2024-09-19T09:46:12.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:12 smithi022 ceph-mon[35583]: pgmap v582: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 45 MiB/s wr, 7.65k op/s 2024-09-19T09:46:12.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:12 smithi121 ceph-mon[35577]: pgmap v582: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 45 MiB/s wr, 7.65k op/s 2024-09-19T09:46:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.617+0000 7fb2f2581640 1 -- 172.21.15.1:0/243363871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2ec100a40 msgr2=0x7fb2ec100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.617+0000 7fb2f2581640 1 --2- 172.21.15.1:0/243363871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2ec100a40 0x7fb2ec100e40 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc009900 tx=0x7fb2dc02a410 comp rx=0 tx=0).stop 2024-09-19T09:46:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.617+0000 7fb2f2581640 1 -- 172.21.15.1:0/243363871 shutdown_connections 2024-09-19T09:46:12.619 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.617+0000 7fb2f2581640 1 --2- 172.21.15.1:0/243363871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2ec1025f0 0x7fb2ec108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.617+0000 7fb2f2581640 1 --2- 172.21.15.1:0/243363871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2ec101c30 0x7fb2ec1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.617+0000 7fb2f2581640 1 --2- 172.21.15.1:0/243363871 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2ec100a40 0x7fb2ec100e40 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.617+0000 7fb2f2581640 1 -- 172.21.15.1:0/243363871 >> 172.21.15.1:0/243363871 conn(0x7fb2ec0fc1c0 msgr2=0x7fb2ec0fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.617+0000 7fb2f2581640 1 -- 172.21.15.1:0/243363871 shutdown_connections 2024-09-19T09:46:12.620 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.617+0000 7fb2f2581640 1 -- 172.21.15.1:0/243363871 wait complete. 2024-09-19T09:46:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.618+0000 7fb2f2581640 1 Processor -- start 2024-09-19T09:46:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.618+0000 7fb2f2581640 1 -- start start 2024-09-19T09:46:12.622 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.618+0000 7fb2f2581640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2ec100a40 0x7fb2ec196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.618+0000 7fb2f2581640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2ec101c30 0x7fb2ec1972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.618+0000 7fb2f2581640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2ec1025f0 0x7fb2ec19e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.618+0000 7fb2f2581640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ec10c6a0 con 0x7fb2ec101c30 2024-09-19T09:46:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.618+0000 7fb2f2581640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ec10c520 con 0x7fb2ec1025f0 2024-09-19T09:46:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.618+0000 7fb2f2581640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ec10c820 con 0x7fb2ec100a40 2024-09-19T09:46:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.618+0000 7fb2ebfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2ec100a40 0x7fb2ec196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.618+0000 7fb2ebfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2ec100a40 0x7fb2ec196db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:53378/0 (socket says 172.21.15.1:53378) 2024-09-19T09:46:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.618+0000 7fb2e3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2ec101c30 0x7fb2ec1972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.618+0000 7fb2ebfff640 1 -- 172.21.15.1:0/2914430825 learned_addr learned my addr 172.21.15.1:0/2914430825 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.618+0000 7fb2f0b1e640 1 --2- 172.21.15.1:0/2914430825 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2ec1025f0 0x7fb2ec19e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.619+0000 7fb2f0b1e640 1 -- 172.21.15.1:0/2914430825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2ec100a40 msgr2=0x7fb2ec196db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:12.623 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.619+0000 7fb2f0b1e640 1 --2- 172.21.15.1:0/2914430825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2ec100a40 0x7fb2ec196db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.619+0000 7fb2f0b1e640 1 -- 172.21.15.1:0/2914430825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2ec101c30 msgr2=0x7fb2ec1972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.619+0000 7fb2f0b1e640 1 --2- 172.21.15.1:0/2914430825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2ec101c30 0x7fb2ec1972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.619+0000 7fb2f0b1e640 1 -- 172.21.15.1:0/2914430825 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2ec19e9d0 con 0x7fb2ec1025f0 2024-09-19T09:46:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.619+0000 7fb2ebfff640 1 --2- 172.21.15.1:0/2914430825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2ec100a40 0x7fb2ec196db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:46:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.619+0000 7fb2e3fff640 1 --2- 172.21.15.1:0/2914430825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2ec101c30 0x7fb2ec1972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:46:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.619+0000 7fb2f0b1e640 1 --2- 172.21.15.1:0/2914430825 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2ec1025f0 0x7fb2ec19e360 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009fd0 tx=0x7fb2e400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.619+0000 7fb2e9ffb640 1 -- 172.21.15.1:0/2914430825 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e400ce20 con 0x7fb2ec1025f0 2024-09-19T09:46:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.619+0000 7fb2f2581640 1 -- 172.21.15.1:0/2914430825 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2ec19ecc0 con 0x7fb2ec1025f0 2024-09-19T09:46:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.619+0000 7fb2e9ffb640 1 -- 172.21.15.1:0/2914430825 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2e4005020 con 0x7fb2ec1025f0 2024-09-19T09:46:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.619+0000 7fb2e9ffb640 1 -- 172.21.15.1:0/2914430825 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e4010720 con 0x7fb2ec1025f0 2024-09-19T09:46:12.624 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.619+0000 7fb2f2581640 1 -- 172.21.15.1:0/2914430825 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2ec19f1c0 con 0x7fb2ec1025f0 2024-09-19T09:46:12.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.622+0000 7fb2e9ffb640 1 -- 172.21.15.1:0/2914430825 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fb2e4005540 con 0x7fb2ec1025f0 2024-09-19T09:46:12.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.623+0000 7fb2f53f4740 1 Processor -- start 2024-09-19T09:46:12.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.623+0000 7fb2f53f4740 1 -- start start 2024-09-19T09:46:12.631 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.623+0000 7fb2f53f4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557b60bdfbb0 0x557b60bdffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.623+0000 7fb2f53f4740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b60be04f0 0x557b60be4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.623+0000 7fb2f53f4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b60be5580 0x557b60be7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.623+0000 7fb2f53f4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557b60b412f0 con 0x557b60be5580 2024-09-19T09:46:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.623+0000 7fb2f53f4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557b60ae9270 con 0x557b60bdfbb0 2024-09-19T09:46:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.623+0000 7fb2f53f4740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x557b60b3d2b0 con 0x557b60be04f0 2024-09-19T09:46:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.623+0000 7fb2ebfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b60be04f0 0x557b60be4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.623+0000 7fb2e3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557b60bdfbb0 0x557b60bdffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.623+0000 7fb2ebfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b60be04f0 0x557b60be4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:53384/0 (socket says 172.21.15.1:53384) 2024-09-19T09:46:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.623+0000 7fb2e3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557b60bdfbb0 0x557b60bdffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:59820/0 (socket says 172.21.15.1:59820) 2024-09-19T09:46:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.623+0000 7fb2ebfff640 1 -- 172.21.15.1:0/736768692 learned_addr learned my addr 172.21.15.1:0/736768692 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.623+0000 7fb2e3fff640 1 --2- 172.21.15.1:0/736768692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b60be5580 0x557b60be7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.623+0000 7fb2ebfff640 1 -- 172.21.15.1:0/736768692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557b60bdfbb0 msgr2=0x557b60bdffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.623+0000 7fb2ebfff640 1 --2- 172.21.15.1:0/736768692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557b60bdfbb0 0x557b60bdffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.623+0000 7fb2ebfff640 1 -- 172.21.15.1:0/736768692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b60be5580 msgr2=0x557b60be7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.623+0000 7fb2ebfff640 1 --2- 172.21.15.1:0/736768692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b60be5580 0x557b60be7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.623+0000 7fb2ebfff640 1 -- 172.21.15.1:0/736768692 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b60ae8340 con 0x557b60be04f0 2024-09-19T09:46:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.623+0000 7fb2e3fff640 1 --2- 172.21.15.1:0/736768692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b60be5580 0x557b60be7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:46:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.623+0000 7fb2e9ffb640 1 --2- 172.21.15.1:0/2914430825 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb2d80a3240 0x7fb2d80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.624+0000 7fb2ebfff640 1 --2- 172.21.15.1:0/736768692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b60be04f0 0x557b60be4fb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc031440 tx=0x7fb2dc005de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79ddd3e7bd93908 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.624+0000 7fb2e3fff640 1 --2- 172.21.15.1:0/2914430825 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb2d80a3240 0x7fb2d80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.624+0000 7fb2e9ffb640 1 -- 172.21.15.1:0/2914430825 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fb2e40cffc0 con 0x7fb2ec1025f0 2024-09-19T09:46:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.624+0000 7fb2e27fc640 1 -- 172.21.15.1:0/736768692 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc035040 con 0x557b60be04f0 2024-09-19T09:46:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.624+0000 7fb2e27fc640 1 -- 172.21.15.1:0/736768692 <== mon.1 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2dc0319b0 con 0x557b60be04f0 2024-09-19T09:46:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.624+0000 7fb2e27fc640 1 -- 172.21.15.1:0/736768692 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc035040 con 0x557b60be04f0 2024-09-19T09:46:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.625+0000 7fb2f53f4740 1 -- 172.21.15.1:0/736768692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b60be04f0 msgr2=0x557b60be4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.625+0000 7fb2f53f4740 1 --2- 172.21.15.1:0/736768692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b60be04f0 0x557b60be4fb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc031440 tx=0x7fb2dc005de0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.625+0000 7fb2e3fff640 1 --2- 172.21.15.1:0/2914430825 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb2d80a3240 0x7fb2d80a5700 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb2d40058c0 tx=0x7fb2d4013040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.625+0000 7fb2f53f4740 1 -- 172.21.15.1:0/736768692 shutdown_connections 2024-09-19T09:46:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.625+0000 7fb2f53f4740 1 --2- 172.21.15.1:0/736768692 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b60be5580 0x557b60be7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.625+0000 7fb2f53f4740 1 --2- 172.21.15.1:0/736768692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b60be04f0 0x557b60be4fb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.625+0000 7fb2f53f4740 1 --2- 172.21.15.1:0/736768692 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557b60bdfbb0 0x557b60bdffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.625+0000 7fb2f53f4740 1 -- 172.21.15.1:0/736768692 >> 172.21.15.1:0/736768692 conn(0x557b60bd9010 msgr2=0x557b60bd9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.625+0000 7fb2f53f4740 1 -- 172.21.15.1:0/736768692 shutdown_connections 2024-09-19T09:46:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.625+0000 7fb2f53f4740 1 -- 172.21.15.1:0/736768692 wait complete. 2024-09-19T09:46:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.625+0000 7fb2f53f4740 1 -- start start 2024-09-19T09:46:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.625+0000 7fb2f53f4740 1 Processor -- start 2024-09-19T09:46:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.626+0000 7fb2f53f4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557b60bdfbb0 0x557b60be9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.626+0000 7fb2f53f4740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b60be04f0 0x557b60bea250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:12.634 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.626+0000 7fb2f53f4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b60be5580 0x557b60bf1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:12.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.626+0000 7fb2f53f4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x557b60be84f0 con 0x557b60be5580 2024-09-19T09:46:12.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.626+0000 7fb2f53f4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557b60aca290 con 0x557b60bdfbb0 2024-09-19T09:46:12.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.626+0000 7fb2f53f4740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x557b60be8670 con 0x557b60be04f0 2024-09-19T09:46:12.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.626+0000 7fb2f53f4740 10 client.0 _ll_register_callbacks cb 0x557b60afb140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:46:12.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.626+0000 7fb2e3fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b60be04f0 0x557b60bea250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:12.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.626+0000 7fb2ebfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557b60bdfbb0 0x557b60be9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:12.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.626+0000 7fb2f0b1e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b60be5580 0x557b60bf1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:12.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.626+0000 7fb2ebfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557b60bdfbb0 0x557b60be9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:59832/0 (socket says 172.21.15.1:59832) 2024-09-19T09:46:12.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.626+0000 7fb2e3fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b60be04f0 0x557b60bea250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:53398/0 (socket says 172.21.15.1:53398) 2024-09-19T09:46:12.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.626+0000 7fb2ebfff640 1 -- 172.21.15.1:0/108052082 learned_addr learned my addr 172.21.15.1:0/108052082 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:12.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.626+0000 7fb2ebfff640 1 -- 172.21.15.1:0/108052082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b60be04f0 msgr2=0x557b60bea250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:12.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.626+0000 7fb2ebfff640 1 --2- 172.21.15.1:0/108052082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b60be04f0 0x557b60bea250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.635 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.626+0000 7fb2ebfff640 1 -- 172.21.15.1:0/108052082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b60be5580 msgr2=0x557b60bf1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:12.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.626+0000 7fb2ebfff640 1 --2- 172.21.15.1:0/108052082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b60be5580 0x557b60bf1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.626+0000 7fb2ebfff640 1 -- 172.21.15.1:0/108052082 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b60854210 con 0x557b60bdfbb0 2024-09-19T09:46:12.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.626+0000 7fb2f0b1e640 1 --2- 172.21.15.1:0/108052082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b60be5580 0x557b60bf1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:46:12.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.626+0000 7fb2e3fff640 1 --2- 172.21.15.1:0/108052082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b60be04f0 0x557b60bea250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:46:12.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.626+0000 7fb2ebfff640 1 --2- 172.21.15.1:0/108052082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557b60bdfbb0 0x557b60be9d10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc031610 tx=0x7fb2dc004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76e17005397ef447 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:12.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.626+0000 7fb2cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-19T09:46:12.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.627+0000 7fb2cb7fe640 1 -- 172.21.15.1:0/108052082 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc054060 con 0x557b60bdfbb0 2024-09-19T09:46:12.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.627+0000 7fb2cb7fe640 1 -- 172.21.15.1:0/108052082 <== mon.2 v2:172.21.15.22:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fb2dc0317b0 con 0x557b60bdfbb0 2024-09-19T09:46:12.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.627+0000 7fb2f53f4740 1 -- 172.21.15.1:0/108052082 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2dc0319b0 con 0x557b60bdfbb0 2024-09-19T09:46:12.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.627+0000 7fb2cb7fe640 1 -- 172.21.15.1:0/108052082 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb2dc035040 con 0x557b60bdfbb0 2024-09-19T09:46:12.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.627+0000 7fb2f53f4740 10 client.26093 fetch_fsmap learned FSMap version 21 2024-09-19T09:46:12.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.627+0000 7fb2f53f4740 1 -- 172.21.15.1:0/108052082 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557b60920620 con 0x557b60bdfbb0 2024-09-19T09:46:12.636 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.627+0000 7fb2cb7fe640 1 -- 172.21.15.1:0/108052082 <== mon.2 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2dc0319b0 con 0x557b60bdfbb0 2024-09-19T09:46:12.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.627+0000 7fb2cb7fe640 1 -- 172.21.15.1:0/108052082 <== mon.2 v2:172.21.15.22:3300/0 5 ==== fsmap(e 21) ==== 8330+0+0 (secure 0 0 0) 0x7fb2dc059070 con 0x557b60bdfbb0 2024-09-19T09:46:12.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.627+0000 7fb2f53f4740 10 client.26093 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T09:46:12.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.627+0000 7fb2f53f4740 10 client.26093 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:46:12.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.627+0000 7fb2f53f4740 20 client.26093 populate_metadata read hostname 'smithi001' 2024-09-19T09:46:12.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.627+0000 7fb2f53f4740 1 --2- 172.21.15.1:0/108052082 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x557b60bf55e0 0x557b60bf79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:12.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.627+0000 7fb2f53f4740 4 client.26093 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:46:12.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.627+0000 7fb2f53f4740 1 -- 172.21.15.1:0/108052082 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b60b4ea20 con 0x557b60bf55e0 2024-09-19T09:46:12.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.627+0000 7fb2e3fff640 1 --2- 172.21.15.1:0/108052082 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x557b60bf55e0 0x557b60bf79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:12.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.628+0000 7fb2cb7fe640 10 client.26093 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:46:12.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.628+0000 7fb2e3fff640 1 --2- 172.21.15.1:0/108052082 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x557b60bf55e0 0x557b60bf79f0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93bd1bff7a003971 server_cookie=9b1f4da95bcc9a28 in_seq=0 out_seq=0 2024-09-19T09:46:12.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.628+0000 7fb2cb7fe640 1 -- 172.21.15.1:0/108052082 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557b60b4ea20 con 0x557b60bf55e0 2024-09-19T09:46:12.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.628+0000 7fb2cb7fe640 10 client.26093 handle_command_reply: tid=0 2024-09-19T09:46:12.637 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.628+0000 7fb2f53f4740 1 client.26093 shutdown 2024-09-19T09:46:12.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.629+0000 7fb2f53f4740 1 -- 172.21.15.1:0/108052082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557b60bdfbb0 msgr2=0x557b60be9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:12.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.629+0000 7fb2f53f4740 1 --2- 172.21.15.1:0/108052082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557b60bdfbb0 0x557b60be9d10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc031610 tx=0x7fb2dc004270 comp rx=0 tx=0).stop 2024-09-19T09:46:12.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.629+0000 7fb2f53f4740 1 -- 172.21.15.1:0/108052082 shutdown_connections 2024-09-19T09:46:12.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.629+0000 7fb2f53f4740 1 --2- 172.21.15.1:0/108052082 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x557b60bf55e0 0x557b60bf79f0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.629+0000 7fb2f53f4740 1 --2- 172.21.15.1:0/108052082 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b60be5580 0x557b60bf1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.629+0000 7fb2f53f4740 1 --2- 172.21.15.1:0/108052082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b60be04f0 0x557b60bea250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.629+0000 7fb2cb7fe640 0 client.26093 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:46:12.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.629+0000 7fb2f53f4740 1 --2- 172.21.15.1:0/108052082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557b60bdfbb0 0x557b60be9d10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.629+0000 7fb2f53f4740 1 -- 172.21.15.1:0/108052082 >> 172.21.15.1:0/108052082 conn(0x557b60bd9010 msgr2=0x557b60bda820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:12.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.629+0000 7fb2f53f4740 1 -- 172.21.15.1:0/108052082 shutdown_connections 2024-09-19T09:46:12.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.629+0000 7fb2f53f4740 1 -- 172.21.15.1:0/108052082 wait complete. 2024-09-19T09:46:12.638 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.629+0000 7fb2f53f4740 20 client.26093 trim_cache size 0 max 16384 2024-09-19T09:46:12.655 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.651+0000 7fb2f53f4740 1 Processor -- start 2024-09-19T09:46:12.655 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.651+0000 7fb2f53f4740 1 -- start start 2024-09-19T09:46:12.655 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.651+0000 7fb2f53f4740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b60bdfbb0 0x557b60bea1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:12.655 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.651+0000 7fb2f53f4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557b60be04f0 0x557b60bf1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:12.655 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.651+0000 7fb2f53f4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b60be5580 0x557b60bd79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:12.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.651+0000 7fb2f53f4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ec1a4db0 con 0x557b60be5580 2024-09-19T09:46:12.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.651+0000 7fb2f53f4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ec1a7650 con 0x557b60be04f0 2024-09-19T09:46:12.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.651+0000 7fb2f53f4740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ec1a5440 con 0x557b60bdfbb0 2024-09-19T09:46:12.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.652+0000 7fb2f0b1e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b60be5580 0x557b60bd79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:12.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.652+0000 7fb2f0b1e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b60be5580 0x557b60bd79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46918/0 (socket says 172.21.15.1:46918) 2024-09-19T09:46:12.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.652+0000 7fb2f0b1e640 1 -- 172.21.15.1:0/3125506851 learned_addr learned my addr 172.21.15.1:0/3125506851 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:12.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.652+0000 7fb2e3fff640 1 --2- 172.21.15.1:0/3125506851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557b60be04f0 0x557b60bf1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:12.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.652+0000 7fb2ebfff640 1 --2- 172.21.15.1:0/3125506851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b60bdfbb0 0x557b60bea1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:12.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.652+0000 7fb2f0b1e640 1 -- 172.21.15.1:0/3125506851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b60bdfbb0 msgr2=0x557b60bea1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:12.656 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.652+0000 7fb2f0b1e640 1 --2- 172.21.15.1:0/3125506851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b60bdfbb0 0x557b60bea1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.652+0000 7fb2f0b1e640 1 -- 172.21.15.1:0/3125506851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557b60be04f0 msgr2=0x557b60bf1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:12.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.652+0000 7fb2f0b1e640 1 --2- 172.21.15.1:0/3125506851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557b60be04f0 0x557b60bf1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.652+0000 7fb2f0b1e640 1 -- 172.21.15.1:0/3125506851 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b60be09d0 con 0x557b60be5580 2024-09-19T09:46:12.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.652+0000 7fb2f0b1e640 1 --2- 172.21.15.1:0/3125506851 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b60be5580 0x557b60bd79a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40cdac0 tx=0x7fb2e40054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6d9bdd98751bcb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:12.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.652+0000 7fb2e1ffb640 1 -- 172.21.15.1:0/3125506851 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e40b4070 con 0x557b60be5580 2024-09-19T09:46:12.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.652+0000 7fb2e1ffb640 1 -- 172.21.15.1:0/3125506851 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2e40a5250 con 0x557b60be5580 2024-09-19T09:46:12.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.652+0000 7fb2e1ffb640 1 -- 172.21.15.1:0/3125506851 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e40a5020 con 0x557b60be5580 2024-09-19T09:46:12.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.653+0000 7fb2f53f4740 1 -- 172.21.15.1:0/3125506851 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b60be5580 msgr2=0x557b60bd79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:12.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.653+0000 7fb2f53f4740 1 --2- 172.21.15.1:0/3125506851 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b60be5580 0x557b60bd79a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40cdac0 tx=0x7fb2e40054b0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.653+0000 7fb2f53f4740 1 -- 172.21.15.1:0/3125506851 shutdown_connections 2024-09-19T09:46:12.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.653+0000 7fb2f53f4740 1 --2- 172.21.15.1:0/3125506851 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b60be5580 0x557b60bd79a0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.657 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.653+0000 7fb2f53f4740 1 --2- 172.21.15.1:0/3125506851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557b60be04f0 0x557b60bf1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.653+0000 7fb2f53f4740 1 --2- 172.21.15.1:0/3125506851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b60bdfbb0 0x557b60bea1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.653+0000 7fb2f53f4740 1 -- 172.21.15.1:0/3125506851 >> 172.21.15.1:0/3125506851 conn(0x557b60bd9010 msgr2=0x557b60be9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:12.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.653+0000 7fb2f53f4740 1 -- 172.21.15.1:0/3125506851 shutdown_connections 2024-09-19T09:46:12.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.653+0000 7fb2f53f4740 1 -- 172.21.15.1:0/3125506851 wait complete. 2024-09-19T09:46:12.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.653+0000 7fb2f53f4740 1 -- start start 2024-09-19T09:46:12.658 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.654+0000 7fb2f53f4740 1 Processor -- start 2024-09-19T09:46:12.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.654+0000 7fb2f53f4740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557b60bdfbb0 0x557b60bee910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:12.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.654+0000 7fb2f53f4740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b60be04f0 0x557b60beee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:12.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.654+0000 7fb2f53f4740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b60be5580 0x557b60befe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:12.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.654+0000 7fb2f53f4740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ec1a5b10 con 0x557b60be5580 2024-09-19T09:46:12.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.654+0000 7fb2f53f4740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ec1a6f80 con 0x557b60bdfbb0 2024-09-19T09:46:12.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.654+0000 7fb2f53f4740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ec1a61e0 con 0x557b60be04f0 2024-09-19T09:46:12.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.654+0000 7fb2f53f4740 10 client.0 _ll_register_callbacks cb 0x7fb2dc040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:46:12.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.654+0000 7fb2f0b1e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b60be5580 0x557b60befe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:12.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.654+0000 7fb2ebfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557b60bdfbb0 0x557b60bee910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:12.661 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.654+0000 7fb2f0b1e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b60be5580 0x557b60befe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46934/0 (socket says 172.21.15.1:46934) 2024-09-19T09:46:12.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.654+0000 7fb2f0b1e640 1 -- 172.21.15.1:0/3996424480 learned_addr learned my addr 172.21.15.1:0/3996424480 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:12.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.654+0000 7fb2e3fff640 1 --2- 172.21.15.1:0/3996424480 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b60be04f0 0x557b60beee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:12.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.654+0000 7fb2f0b1e640 1 -- 172.21.15.1:0/3996424480 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b60be04f0 msgr2=0x557b60beee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:12.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.654+0000 7fb2f0b1e640 1 --2- 172.21.15.1:0/3996424480 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b60be04f0 0x557b60beee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.654+0000 7fb2f0b1e640 1 -- 172.21.15.1:0/3996424480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557b60bdfbb0 msgr2=0x557b60bee910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:12.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.654+0000 7fb2f0b1e640 1 --2- 172.21.15.1:0/3996424480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557b60bdfbb0 0x557b60bee910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.654+0000 7fb2f0b1e640 1 -- 172.21.15.1:0/3996424480 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b60bf0420 con 0x557b60be5580 2024-09-19T09:46:12.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.654+0000 7fb2ebfff640 1 --2- 172.21.15.1:0/3996424480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557b60bdfbb0 0x557b60bee910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:46:12.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.654+0000 7fb2f0b1e640 1 --2- 172.21.15.1:0/3996424480 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b60be5580 0x557b60befe10 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4098fb0 tx=0x7fb2e4005b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802eed0990deb046 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:12.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.654+0000 7fb2cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:46:12.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.654+0000 7fb2cb7fe640 1 -- 172.21.15.1:0/3996424480 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e4084060 con 0x557b60be5580 2024-09-19T09:46:12.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.654+0000 7fb2cb7fe640 1 -- 172.21.15.1:0/3996424480 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fb2e409ba30 con 0x557b60be5580 2024-09-19T09:46:12.662 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.654+0000 7fb2f53f4740 1 -- 172.21.15.1:0/3996424480 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2e40a5250 con 0x557b60be5580 2024-09-19T09:46:12.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.655+0000 7fb2cb7fe640 1 -- 172.21.15.1:0/3996424480 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb2e40b4050 con 0x557b60be5580 2024-09-19T09:46:12.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.655+0000 7fb2f53f4740 10 client.16440 fetch_fsmap learned FSMap version 21 2024-09-19T09:46:12.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.655+0000 7fb2f53f4740 1 -- 172.21.15.1:0/3996424480 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557b60c602d0 con 0x557b60be5580 2024-09-19T09:46:12.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.655+0000 7fb2cb7fe640 1 -- 172.21.15.1:0/3996424480 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2e40a5250 con 0x557b60be5580 2024-09-19T09:46:12.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.655+0000 7fb2cb7fe640 1 -- 172.21.15.1:0/3996424480 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8330+0+0 (secure 0 0 0) 0x7fb2e40983a0 con 0x557b60be5580 2024-09-19T09:46:12.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.655+0000 7fb2f53f4740 10 client.16440 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T09:46:12.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.655+0000 7fb2f53f4740 10 client.16440 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:46:12.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.655+0000 7fb2f53f4740 20 client.16440 populate_metadata read hostname 'smithi001' 2024-09-19T09:46:12.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.655+0000 7fb2f53f4740 1 --2- 172.21.15.1:0/3996424480 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x557b60bf55e0 0x557b60c62c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:12.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.655+0000 7fb2f53f4740 4 client.16440 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:46:12.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.655+0000 7fb2f53f4740 1 -- 172.21.15.1:0/3996424480 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557b60b48d70 con 0x557b60bf55e0 2024-09-19T09:46:12.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.655+0000 7fb2ebfff640 1 --2- 172.21.15.1:0/3996424480 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x557b60bf55e0 0x557b60c62c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:12.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.656+0000 7fb2cb7fe640 10 client.16440 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:46:12.663 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.656+0000 7fb2ebfff640 1 --2- 172.21.15.1:0/3996424480 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x557b60bf55e0 0x557b60c62c60 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82daf6285f43f154 server_cookie=e19a261a98124cb5 in_seq=0 out_seq=0 2024-09-19T09:46:12.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.691+0000 7fb2cb7fe640 1 -- 172.21.15.1:0/3996424480 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557b60b48d70 con 0x557b60bf55e0 2024-09-19T09:46:12.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.691+0000 7fb2cb7fe640 10 client.16440 handle_command_reply: tid=0 2024-09-19T09:46:12.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.691+0000 7fb2f53f4740 1 client.16440 shutdown 2024-09-19T09:46:12.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.691+0000 7fb2f53f4740 1 -- 172.21.15.1:0/3996424480 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b60be5580 msgr2=0x557b60befe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:12.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.691+0000 7fb2f53f4740 1 --2- 172.21.15.1:0/3996424480 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b60be5580 0x557b60befe10 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4098fb0 tx=0x7fb2e4005b20 comp rx=0 tx=0).stop 2024-09-19T09:46:12.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.691+0000 7fb2f53f4740 1 -- 172.21.15.1:0/3996424480 shutdown_connections 2024-09-19T09:46:12.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.691+0000 7fb2f53f4740 1 --2- 172.21.15.1:0/3996424480 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x557b60bf55e0 0x557b60c62c60 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.691+0000 7fb2f53f4740 1 --2- 172.21.15.1:0/3996424480 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x557b60be5580 0x557b60befe10 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.694 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.691+0000 7fb2f53f4740 1 --2- 172.21.15.1:0/3996424480 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b60be04f0 0x557b60beee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.691+0000 7fb2f53f4740 1 --2- 172.21.15.1:0/3996424480 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557b60bdfbb0 0x557b60bee910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.691+0000 7fb2cb7fe640 0 client.16440 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:46:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.691+0000 7fb2f53f4740 1 -- 172.21.15.1:0/3996424480 >> 172.21.15.1:0/3996424480 conn(0x557b60bd9010 msgr2=0x557b60bd79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.692+0000 7fb2f53f4740 1 -- 172.21.15.1:0/3996424480 shutdown_connections 2024-09-19T09:46:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.692+0000 7fb2f53f4740 1 -- 172.21.15.1:0/3996424480 wait complete. 2024-09-19T09:46:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.692+0000 7fb2f53f4740 20 client.16440 trim_cache size 0 max 16384 2024-09-19T09:46:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:46:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:46:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:46:12.695 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:46:12.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.692+0000 7fb2f2581640 1 -- 172.21.15.1:0/2914430825 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb2d80a3240 msgr2=0x7fb2d80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:12.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.692+0000 7fb2f2581640 1 --2- 172.21.15.1:0/2914430825 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb2d80a3240 0x7fb2d80a5700 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb2d40058c0 tx=0x7fb2d4013040 comp rx=0 tx=0).stop 2024-09-19T09:46:12.696 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.692+0000 7fb2f2581640 1 -- 172.21.15.1:0/2914430825 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2ec1025f0 msgr2=0x7fb2ec19e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:12.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.692+0000 7fb2f2581640 1 --2- 172.21.15.1:0/2914430825 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2ec1025f0 0x7fb2ec19e360 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009fd0 tx=0x7fb2e400ef10 comp rx=0 tx=0).stop 2024-09-19T09:46:12.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.692+0000 7fb2f2581640 1 -- 172.21.15.1:0/2914430825 shutdown_connections 2024-09-19T09:46:12.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.692+0000 7fb2f2581640 1 --2- 172.21.15.1:0/2914430825 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb2d80a3240 0x7fb2d80a5700 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.692+0000 7fb2f2581640 1 --2- 172.21.15.1:0/2914430825 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb2ec1025f0 0x7fb2ec19e360 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.692+0000 7fb2f2581640 1 --2- 172.21.15.1:0/2914430825 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2ec101c30 0x7fb2ec1972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.692+0000 7fb2f2581640 1 --2- 172.21.15.1:0/2914430825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2ec100a40 0x7fb2ec196db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:12.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.692+0000 7fb2f2581640 1 -- 172.21.15.1:0/2914430825 >> 172.21.15.1:0/2914430825 conn(0x7fb2ec0fc1c0 msgr2=0x7fb2ec105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:12.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.692+0000 7fb2f2581640 1 -- 172.21.15.1:0/2914430825 shutdown_connections 2024-09-19T09:46:12.697 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:12.692+0000 7fb2f2581640 1 -- 172.21.15.1:0/2914430825 wait complete. 2024-09-19T09:46:12.887 INFO:tasks.cephfs.filesystem:scrub status for tag:d285e454-ea30-4f97-b756-b4510122e2da - {'path': '/', 'tag': 'd285e454-ea30-4f97-b756-b4510122e2da', 'options': 'recursive,force'} 2024-09-19T09:46:14.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:14 smithi001 ceph-mon[31225]: pgmap v583: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 44 MiB/s wr, 7.41k op/s 2024-09-19T09:46:14.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:14 smithi001 ceph-mon[31225]: scrub summary: idle+waiting paths [/] 2024-09-19T09:46:14.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:14 smithi001 ceph-mon[31225]: scrub summary: idle 2024-09-19T09:46:14.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:14 smithi022 ceph-mon[35583]: pgmap v583: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 44 MiB/s wr, 7.41k op/s 2024-09-19T09:46:14.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:14 smithi022 ceph-mon[35583]: scrub summary: idle+waiting paths [/] 2024-09-19T09:46:14.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:14 smithi022 ceph-mon[35583]: scrub summary: idle 2024-09-19T09:46:14.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:14 smithi121 ceph-mon[35577]: pgmap v583: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 44 MiB/s wr, 7.41k op/s 2024-09-19T09:46:14.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:14 smithi121 ceph-mon[35577]: scrub summary: idle+waiting paths [/] 2024-09-19T09:46:14.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:14 smithi121 ceph-mon[35577]: scrub summary: idle 2024-09-19T09:46:16.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:16 smithi001 ceph-mon[31225]: pgmap v584: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 37 MiB/s wr, 6.43k op/s 2024-09-19T09:46:16.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:16 smithi022 ceph-mon[35583]: pgmap v584: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 37 MiB/s wr, 6.43k op/s 2024-09-19T09:46:16.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:16 smithi121 ceph-mon[35577]: pgmap v584: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 37 MiB/s wr, 6.43k op/s 2024-09-19T09:46:18.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:18 smithi001 ceph-mon[31225]: pgmap v585: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 35 MiB/s wr, 6.00k op/s 2024-09-19T09:46:18.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:18 smithi022 ceph-mon[35583]: pgmap v585: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 35 MiB/s wr, 6.00k op/s 2024-09-19T09:46:18.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:18 smithi121 ceph-mon[35577]: pgmap v585: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 35 MiB/s wr, 6.00k op/s 2024-09-19T09:46:20.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:20 smithi001 ceph-mon[31225]: pgmap v586: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 27 MiB/s wr, 4.90k op/s 2024-09-19T09:46:20.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:20 smithi022 ceph-mon[35583]: pgmap v586: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 27 MiB/s wr, 4.90k op/s 2024-09-19T09:46:20.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:20 smithi121 ceph-mon[35577]: pgmap v586: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 27 MiB/s wr, 4.90k op/s 2024-09-19T09:46:20.728 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd2937df4', quiesce took 90.0 seconds. Will release after: -60.2 2024-09-19T09:46:20.729 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:46:20.998 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:46:22.399 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:22 smithi001 ceph-mon[31225]: pgmap v587: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 24 MiB/s wr, 4.22k op/s 2024-09-19T09:46:22.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:22 smithi022 ceph-mon[35583]: pgmap v587: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 24 MiB/s wr, 4.22k op/s 2024-09-19T09:46:22.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:22 smithi121 ceph-mon[35577]: pgmap v587: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 24 MiB/s wr, 4.22k op/s 2024-09-19T09:46:23.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.319+0000 7fc44e0b8640 1 -- 172.21.15.1:0/1098133105 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc448101240 msgr2=0x7fc448101680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:23.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.319+0000 7fc44e0b8640 1 --2- 172.21.15.1:0/1098133105 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc448101240 0x7fc448101680 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fc43c009900 tx=0x7fc43c02a410 comp rx=0 tx=0).stop 2024-09-19T09:46:23.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.319+0000 7fc44e0b8640 1 -- 172.21.15.1:0/1098133105 shutdown_connections 2024-09-19T09:46:23.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.319+0000 7fc44e0b8640 1 --2- 172.21.15.1:0/1098133105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc448101bc0 0x7fc44810d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:23.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.319+0000 7fc44e0b8640 1 --2- 172.21.15.1:0/1098133105 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc448101240 0x7fc448101680 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:23.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.319+0000 7fc44e0b8640 1 --2- 172.21.15.1:0/1098133105 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc448105a90 0x7fc448105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:23.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.319+0000 7fc44e0b8640 1 -- 172.21.15.1:0/1098133105 >> 172.21.15.1:0/1098133105 conn(0x7fc448077210 msgr2=0x7fc4480fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:23.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.319+0000 7fc44e0b8640 1 -- 172.21.15.1:0/1098133105 shutdown_connections 2024-09-19T09:46:23.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.319+0000 7fc44e0b8640 1 -- 172.21.15.1:0/1098133105 wait complete. 2024-09-19T09:46:23.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.320+0000 7fc44e0b8640 1 Processor -- start 2024-09-19T09:46:23.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.320+0000 7fc44e0b8640 1 -- start start 2024-09-19T09:46:23.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.320+0000 7fc44e0b8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc448101240 0x7fc448198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:23.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.320+0000 7fc44e0b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc448101bc0 0x7fc4481989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:23.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.320+0000 7fc44e0b8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc448105a90 0x7fc44819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:23.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.320+0000 7fc44e0b8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc448110f70 con 0x7fc448101bc0 2024-09-19T09:46:23.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.320+0000 7fc44e0b8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc448110df0 con 0x7fc448105a90 2024-09-19T09:46:23.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.320+0000 7fc44e0b8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc4481110f0 con 0x7fc448101240 2024-09-19T09:46:23.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.321+0000 7fc446ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc448101bc0 0x7fc4481989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:23.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.321+0000 7fc446ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc448101bc0 0x7fc4481989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51274/0 (socket says 172.21.15.1:51274) 2024-09-19T09:46:23.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.321+0000 7fc446ffd640 1 -- 172.21.15.1:0/1800730853 learned_addr learned my addr 172.21.15.1:0/1800730853 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:23.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.321+0000 7fc4477fe640 1 --2- 172.21.15.1:0/1800730853 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc448101240 0x7fc448198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:23.435 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.321+0000 7fc447fff640 1 --2- 172.21.15.1:0/1800730853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc448105a90 0x7fc44819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:23.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.321+0000 7fc446ffd640 1 -- 172.21.15.1:0/1800730853 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc448101240 msgr2=0x7fc448198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:23.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.321+0000 7fc446ffd640 1 --2- 172.21.15.1:0/1800730853 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc448101240 0x7fc448198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:23.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.321+0000 7fc446ffd640 1 -- 172.21.15.1:0/1800730853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc448105a90 msgr2=0x7fc44819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:23.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.321+0000 7fc446ffd640 1 --2- 172.21.15.1:0/1800730853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc448105a90 0x7fc44819cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:23.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.321+0000 7fc446ffd640 1 -- 172.21.15.1:0/1800730853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44819d440 con 0x7fc448101bc0 2024-09-19T09:46:23.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.321+0000 7fc447fff640 1 --2- 172.21.15.1:0/1800730853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc448105a90 0x7fc44819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:46:23.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.321+0000 7fc446ffd640 1 --2- 172.21.15.1:0/1800730853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc448101bc0 0x7fc4481989d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc43c006010 tx=0x7fc43c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:23.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.321+0000 7fc444ff9640 1 -- 172.21.15.1:0/1800730853 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c03f070 con 0x7fc448101bc0 2024-09-19T09:46:23.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.321+0000 7fc44e0b8640 1 -- 172.21.15.1:0/1800730853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc44819d6d0 con 0x7fc448101bc0 2024-09-19T09:46:23.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.321+0000 7fc444ff9640 1 -- 172.21.15.1:0/1800730853 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc43c031c30 con 0x7fc448101bc0 2024-09-19T09:46:23.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.321+0000 7fc444ff9640 1 -- 172.21.15.1:0/1800730853 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c035030 con 0x7fc448101bc0 2024-09-19T09:46:23.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.321+0000 7fc44e0b8640 1 -- 172.21.15.1:0/1800730853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4481a5010 con 0x7fc448101bc0 2024-09-19T09:46:23.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.323+0000 7fc44e0b8640 1 -- 172.21.15.1:0/1800730853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc448101680 con 0x7fc448101bc0 2024-09-19T09:46:23.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.324+0000 7fc444ff9640 1 -- 172.21.15.1:0/1800730853 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fc43c042070 con 0x7fc448101bc0 2024-09-19T09:46:23.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.324+0000 7fc444ff9640 1 --2- 172.21.15.1:0/1800730853 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc4300a3240 0x7fc4300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:23.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.325+0000 7fc4477fe640 1 --2- 172.21.15.1:0/1800730853 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc4300a3240 0x7fc4300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:23.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.325+0000 7fc444ff9640 1 -- 172.21.15.1:0/1800730853 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fc43c0f05d0 con 0x7fc448101bc0 2024-09-19T09:46:23.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.325+0000 7fc4477fe640 1 --2- 172.21.15.1:0/1800730853 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc4300a3240 0x7fc4300a5700 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc43800bb60 tx=0x7fc43800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:23.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.328+0000 7fc444ff9640 1 -- 172.21.15.1:0/1800730853 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc43c031de0 con 0x7fc448101bc0 2024-09-19T09:46:23.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.538+0000 7fc44e0b8640 1 -- 172.21.15.1:0/1800730853 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc448109fc0 con 0x7fc448101bc0 2024-09-19T09:46:23.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.539+0000 7fc444ff9640 1 -- 172.21.15.1:0/1800730853 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11838 (secure 0 0 0) 0x7fc43c0bd2b0 con 0x7fc448101bc0 2024-09-19T09:46:23.541 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:46:23.541 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T09:44:50:770090+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":16287,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6839/1975960689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":1975960689},{"type":"v1","addr":"172.21.15.121:6839","nonce":1975960689}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:44:50.770010+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24479":{"gid":24479,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:46:23.541 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T09:46:23.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.541+0000 7fc44e0b8640 1 -- 172.21.15.1:0/1800730853 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc4300a3240 msgr2=0x7fc4300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:23.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.541+0000 7fc44e0b8640 1 --2- 172.21.15.1:0/1800730853 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc4300a3240 0x7fc4300a5700 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc43800bb60 tx=0x7fc43800b390 comp rx=0 tx=0).stop 2024-09-19T09:46:23.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.541+0000 7fc44e0b8640 1 -- 172.21.15.1:0/1800730853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc448101bc0 msgr2=0x7fc4481989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:23.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.541+0000 7fc44e0b8640 1 --2- 172.21.15.1:0/1800730853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc448101bc0 0x7fc4481989d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc43c006010 tx=0x7fc43c003c10 comp rx=0 tx=0).stop 2024-09-19T09:46:23.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.541+0000 7fc44e0b8640 1 -- 172.21.15.1:0/1800730853 shutdown_connections 2024-09-19T09:46:23.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.541+0000 7fc44e0b8640 1 --2- 172.21.15.1:0/1800730853 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fc4300a3240 0x7fc4300a5700 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:23.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.541+0000 7fc44e0b8640 1 --2- 172.21.15.1:0/1800730853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc448105a90 0x7fc44819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:23.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.541+0000 7fc44e0b8640 1 --2- 172.21.15.1:0/1800730853 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc448101bc0 0x7fc4481989d0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:23.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.541+0000 7fc44e0b8640 1 --2- 172.21.15.1:0/1800730853 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc448101240 0x7fc448198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:23.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.541+0000 7fc44e0b8640 1 -- 172.21.15.1:0/1800730853 >> 172.21.15.1:0/1800730853 conn(0x7fc448077210 msgr2=0x7fc448100380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:23.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.541+0000 7fc44e0b8640 1 -- 172.21.15.1:0/1800730853 shutdown_connections 2024-09-19T09:46:23.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:23.541+0000 7fc44e0b8640 1 -- 172.21.15.1:0/1800730853 wait complete. 2024-09-19T09:46:24.193 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db --set-id d2937df4 --release --await' 2024-09-19T09:46:24.193 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db --set-id d2937df4 --release --await 2024-09-19T09:46:24.453 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:46:24.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:24 smithi001 ceph-mon[31225]: pgmap v588: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 18 MiB/s wr, 3.15k op/s 2024-09-19T09:46:24.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:24 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1800730853' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:46:24.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:24 smithi022 ceph-mon[35583]: pgmap v588: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 18 MiB/s wr, 3.15k op/s 2024-09-19T09:46:24.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:24 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1800730853' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:46:24.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:24 smithi121 ceph-mon[35577]: pgmap v588: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 18 MiB/s wr, 3.15k op/s 2024-09-19T09:46:24.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:24 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1800730853' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:46:24.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.939+0000 7fb5f53a8640 1 -- 172.21.15.1:0/223414623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5f010c170 msgr2=0x7fb5f010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:24.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.939+0000 7fb5f53a8640 1 --2- 172.21.15.1:0/223414623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5f010c170 0x7fb5f010e610 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8009900 tx=0x7fb5e802a480 comp rx=0 tx=0).stop 2024-09-19T09:46:24.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.939+0000 7fb5f53a8640 1 -- 172.21.15.1:0/223414623 shutdown_connections 2024-09-19T09:46:24.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.939+0000 7fb5f53a8640 1 --2- 172.21.15.1:0/223414623 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5f010c170 0x7fb5f010e610 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.939+0000 7fb5f53a8640 1 --2- 172.21.15.1:0/223414623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5f0103660 0x7fb5f010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.939+0000 7fb5f53a8640 1 --2- 172.21.15.1:0/223414623 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb5f0102d40 0x7fb5f0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.939+0000 7fb5f53a8640 1 -- 172.21.15.1:0/223414623 >> 172.21.15.1:0/223414623 conn(0x7fb5f00fc7a0 msgr2=0x7fb5f00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:24.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.939+0000 7fb5f53a8640 1 -- 172.21.15.1:0/223414623 shutdown_connections 2024-09-19T09:46:24.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.939+0000 7fb5f53a8640 1 -- 172.21.15.1:0/223414623 wait complete. 2024-09-19T09:46:24.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.940+0000 7fb5f53a8640 1 Processor -- start 2024-09-19T09:46:24.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.940+0000 7fb5f53a8640 1 -- start start 2024-09-19T09:46:24.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.940+0000 7fb5f53a8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5f0102d40 0x7fb5f0198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:24.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.940+0000 7fb5f53a8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb5f0103660 0x7fb5f0198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:24.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.940+0000 7fb5f53a8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5f010c170 0x7fb5f019cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:24.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.940+0000 7fb5f53a8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f0111f30 con 0x7fb5f0102d40 2024-09-19T09:46:24.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.940+0000 7fb5f53a8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f0111db0 con 0x7fb5f010c170 2024-09-19T09:46:24.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.940+0000 7fb5f53a8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f01120b0 con 0x7fb5f0103660 2024-09-19T09:46:24.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.940+0000 7fb5eeffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5f0102d40 0x7fb5f0198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:24.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.940+0000 7fb5eeffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5f0102d40 0x7fb5f0198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51284/0 (socket says 172.21.15.1:51284) 2024-09-19T09:46:24.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.940+0000 7fb5eeffd640 1 -- 172.21.15.1:0/3471455366 learned_addr learned my addr 172.21.15.1:0/3471455366 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:24.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.940+0000 7fb5ee7fc640 1 --2- 172.21.15.1:0/3471455366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb5f0103660 0x7fb5f0198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:24.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.941+0000 7fb5ef7fe640 1 --2- 172.21.15.1:0/3471455366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5f010c170 0x7fb5f019cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:24.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.941+0000 7fb5eeffd640 1 -- 172.21.15.1:0/3471455366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb5f0103660 msgr2=0x7fb5f0198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:24.973 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.941+0000 7fb5eeffd640 1 --2- 172.21.15.1:0/3471455366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb5f0103660 0x7fb5f0198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.941+0000 7fb5eeffd640 1 -- 172.21.15.1:0/3471455366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5f010c170 msgr2=0x7fb5f019cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:24.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.941+0000 7fb5eeffd640 1 --2- 172.21.15.1:0/3471455366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5f010c170 0x7fb5f019cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.941+0000 7fb5eeffd640 1 -- 172.21.15.1:0/3471455366 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f019d300 con 0x7fb5f0102d40 2024-09-19T09:46:24.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.941+0000 7fb5eeffd640 1 --2- 172.21.15.1:0/3471455366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5f0102d40 0x7fb5f0198350 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb5e000cce0 tx=0x7fb5e000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:24.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.941+0000 7fb5d7fff640 1 -- 172.21.15.1:0/3471455366 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e000f650 con 0x7fb5f0102d40 2024-09-19T09:46:24.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.941+0000 7fb5f53a8640 1 -- 172.21.15.1:0/3471455366 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5f019d5f0 con 0x7fb5f0102d40 2024-09-19T09:46:24.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.941+0000 7fb5d7fff640 1 -- 172.21.15.1:0/3471455366 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5e000fcd0 con 0x7fb5f0102d40 2024-09-19T09:46:24.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.941+0000 7fb5d7fff640 1 -- 172.21.15.1:0/3471455366 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0018c70 con 0x7fb5f0102d40 2024-09-19T09:46:24.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.941+0000 7fb5f53a8640 1 -- 172.21.15.1:0/3471455366 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5f01a4ed0 con 0x7fb5f0102d40 2024-09-19T09:46:24.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.944+0000 7fb5f7781740 1 Processor -- start 2024-09-19T09:46:24.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.944+0000 7fb5f7781740 1 -- start start 2024-09-19T09:46:24.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.944+0000 7fb5f7781740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559149f7d060 0x559149f7d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:24.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.944+0000 7fb5d7fff640 1 -- 172.21.15.1:0/3471455366 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fb5e000f7f0 con 0x7fb5f0102d40 2024-09-19T09:46:24.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.944+0000 7fb5f7781740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559149f7d980 0x559149f87d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:24.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.945+0000 7fb5f7781740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559149f88240 0x559149f8a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:24.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.945+0000 7fb5f7781740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559149ee2620 con 0x559149f7d060 2024-09-19T09:46:24.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.945+0000 7fb5f7781740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559149e89e50 con 0x559149f7d980 2024-09-19T09:46:24.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.945+0000 7fb5f7781740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559149ede5e0 con 0x559149f88240 2024-09-19T09:46:24.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.945+0000 7fb5ef7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559149f7d060 0x559149f7d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:24.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.945+0000 7fb5ef7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559149f7d060 0x559149f7d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51300/0 (socket says 172.21.15.1:51300) 2024-09-19T09:46:24.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.945+0000 7fb5ef7fe640 1 -- 172.21.15.1:0/3952792 learned_addr learned my addr 172.21.15.1:0/3952792 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:24.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.945+0000 7fb5eeffd640 1 --2- 172.21.15.1:0/3952792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559149f7d980 0x559149f87d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:24.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.945+0000 7fb5ee7fc640 1 --2- 172.21.15.1:0/3952792 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559149f88240 0x559149f8a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:24.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.945+0000 7fb5ef7fe640 1 -- 172.21.15.1:0/3952792 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559149f88240 msgr2=0x559149f8a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:24.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.945+0000 7fb5ef7fe640 1 --2- 172.21.15.1:0/3952792 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559149f88240 0x559149f8a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.945+0000 7fb5ef7fe640 1 -- 172.21.15.1:0/3952792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559149f7d980 msgr2=0x559149f87d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:24.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.945+0000 7fb5ef7fe640 1 --2- 172.21.15.1:0/3952792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559149f7d980 0x559149f87d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.945+0000 7fb5ef7fe640 1 -- 172.21.15.1:0/3952792 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559149e7ad40 con 0x559149f7d060 2024-09-19T09:46:24.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.945+0000 7fb5ef7fe640 1 --2- 172.21.15.1:0/3952792 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559149f7d060 0x559149f7d440 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8005940 tx=0x7fb5e8032cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3efac4448716de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:24.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.945+0000 7fb5d57fa640 1 -- 172.21.15.1:0/3952792 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e803f070 con 0x559149f7d060 2024-09-19T09:46:24.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.945+0000 7fb5d7fff640 1 --2- 172.21.15.1:0/3471455366 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb5d80a3240 0x7fb5d80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:24.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.945+0000 7fb5d57fa640 1 -- 172.21.15.1:0/3952792 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5e80317b0 con 0x559149f7d060 2024-09-19T09:46:24.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.945+0000 7fb5d57fa640 1 -- 172.21.15.1:0/3952792 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8035070 con 0x559149f7d060 2024-09-19T09:46:24.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.946+0000 7fb5eeffd640 1 --2- 172.21.15.1:0/3471455366 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb5d80a3240 0x7fb5d80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:24.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.946+0000 7fb5d7fff640 1 -- 172.21.15.1:0/3471455366 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fb5e00cfdb0 con 0x7fb5f0102d40 2024-09-19T09:46:24.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.946+0000 7fb5f7781740 1 -- 172.21.15.1:0/3952792 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559149f7d060 msgr2=0x559149f7d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:24.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.946+0000 7fb5eeffd640 1 --2- 172.21.15.1:0/3471455366 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb5d80a3240 0x7fb5d80a5700 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb5e00a4b10 tx=0x7fb5e0098040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:24.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.946+0000 7fb5f7781740 1 --2- 172.21.15.1:0/3952792 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559149f7d060 0x559149f7d440 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8005940 tx=0x7fb5e8032cb0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.946+0000 7fb5f7781740 1 -- 172.21.15.1:0/3952792 shutdown_connections 2024-09-19T09:46:24.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.946+0000 7fb5f7781740 1 --2- 172.21.15.1:0/3952792 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559149f88240 0x559149f8a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.946+0000 7fb5f7781740 1 --2- 172.21.15.1:0/3952792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559149f7d980 0x559149f87d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.946+0000 7fb5f7781740 1 --2- 172.21.15.1:0/3952792 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559149f7d060 0x559149f7d440 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.946+0000 7fb5f7781740 1 -- 172.21.15.1:0/3952792 >> 172.21.15.1:0/3952792 conn(0x559149f795f0 msgr2=0x559149f799d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:24.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.946+0000 7fb5f7781740 1 -- 172.21.15.1:0/3952792 shutdown_connections 2024-09-19T09:46:24.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.946+0000 7fb5f7781740 1 -- 172.21.15.1:0/3952792 wait complete. 2024-09-19T09:46:24.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.947+0000 7fb5f7781740 1 -- start start 2024-09-19T09:46:24.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.947+0000 7fb5f7781740 1 Processor -- start 2024-09-19T09:46:24.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.947+0000 7fb5f7781740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559149f7d060 0x559149f85170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:24.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.947+0000 7fb5f7781740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559149f7d980 0x559149f856b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:24.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.947+0000 7fb5f7781740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559149f88240 0x559149f85bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:24.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.947+0000 7fb5f7781740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x559149f8ae10 con 0x559149f7d980 2024-09-19T09:46:24.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.947+0000 7fb5f7781740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559149e6af10 con 0x559149f7d060 2024-09-19T09:46:24.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.947+0000 7fb5f7781740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559149f8af90 con 0x559149f88240 2024-09-19T09:46:24.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.947+0000 7fb5f7781740 10 client.0 _ll_register_callbacks cb 0x559149e8edb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:46:24.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.947+0000 7fb5ee7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559149f7d980 0x559149f856b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:24.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.947+0000 7fb5ee7fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559149f7d980 0x559149f856b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51310/0 (socket says 172.21.15.1:51310) 2024-09-19T09:46:24.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.947+0000 7fb5ee7fc640 1 -- 172.21.15.1:0/2494343724 learned_addr learned my addr 172.21.15.1:0/2494343724 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:24.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.947+0000 7fb5ef7fe640 1 --2- 172.21.15.1:0/2494343724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559149f7d060 0x559149f85170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:24.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.947+0000 7fb5ef7fe640 1 --2- 172.21.15.1:0/2494343724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559149f88240 0x559149f85bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:24.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.947+0000 7fb5ee7fc640 1 -- 172.21.15.1:0/2494343724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559149f88240 msgr2=0x559149f85bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:24.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.947+0000 7fb5ee7fc640 1 --2- 172.21.15.1:0/2494343724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559149f88240 0x559149f85bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.947+0000 7fb5ee7fc640 1 -- 172.21.15.1:0/2494343724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559149f7d060 msgr2=0x559149f85170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:24.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.947+0000 7fb5ee7fc640 1 --2- 172.21.15.1:0/2494343724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559149f7d060 0x559149f85170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.947+0000 7fb5ee7fc640 1 -- 172.21.15.1:0/2494343724 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559149bf1580 con 0x559149f7d980 2024-09-19T09:46:24.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.948+0000 7fb5ee7fc640 1 --2- 172.21.15.1:0/2494343724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559149f7d980 0x559149f856b0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400b960 tx=0x7fb5e400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a34ac5f176ea80ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:24.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.948+0000 7fb5d2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:46:24.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.948+0000 7fb5d2ff5640 1 -- 172.21.15.1:0/2494343724 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e401b440 con 0x559149f7d980 2024-09-19T09:46:24.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.948+0000 7fb5d2ff5640 1 -- 172.21.15.1:0/2494343724 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fb5e401b5e0 con 0x559149f7d980 2024-09-19T09:46:24.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.948+0000 7fb5f7781740 1 -- 172.21.15.1:0/2494343724 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5e80317b0 con 0x559149f7d980 2024-09-19T09:46:24.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.948+0000 7fb5d2ff5640 1 -- 172.21.15.1:0/2494343724 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb5e401b7e0 con 0x559149f7d980 2024-09-19T09:46:24.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.948+0000 7fb5f7781740 10 client.16458 fetch_fsmap learned FSMap version 21 2024-09-19T09:46:24.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.948+0000 7fb5f7781740 1 -- 172.21.15.1:0/2494343724 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559149cbb960 con 0x559149f7d980 2024-09-19T09:46:24.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.948+0000 7fb5d2ff5640 1 -- 172.21.15.1:0/2494343724 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5e80317b0 con 0x559149f7d980 2024-09-19T09:46:24.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.948+0000 7fb5d2ff5640 1 -- 172.21.15.1:0/2494343724 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8330+0+0 (secure 0 0 0) 0x7fb5e4019020 con 0x559149f7d980 2024-09-19T09:46:24.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.948+0000 7fb5f7781740 10 client.16458 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T09:46:24.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.948+0000 7fb5f7781740 10 client.16458 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:46:24.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.948+0000 7fb5f7781740 20 client.16458 populate_metadata read hostname 'smithi001' 2024-09-19T09:46:24.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.948+0000 7fb5f7781740 1 --2- 172.21.15.1:0/2494343724 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x559149f97eb0 0x559149f9a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:24.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.948+0000 7fb5f7781740 4 client.16458 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:46:24.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.948+0000 7fb5f7781740 1 -- 172.21.15.1:0/2494343724 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559149eefb90 con 0x559149f97eb0 2024-09-19T09:46:24.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.949+0000 7fb5ef7fe640 1 --2- 172.21.15.1:0/2494343724 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x559149f97eb0 0x559149f9a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:24.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.949+0000 7fb5d2ff5640 10 client.16458 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:46:24.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.949+0000 7fb5ef7fe640 1 --2- 172.21.15.1:0/2494343724 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x559149f97eb0 0x559149f9a310 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75608628528f41da server_cookie=389f28bfcfdcc4e1 in_seq=0 out_seq=0 2024-09-19T09:46:24.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.950+0000 7fb5d2ff5640 1 -- 172.21.15.1:0/2494343724 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559149eefb90 con 0x559149f97eb0 2024-09-19T09:46:24.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.950+0000 7fb5d2ff5640 10 client.16458 handle_command_reply: tid=0 2024-09-19T09:46:24.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.950+0000 7fb5f7781740 1 client.16458 shutdown 2024-09-19T09:46:24.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.950+0000 7fb5f7781740 1 -- 172.21.15.1:0/2494343724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559149f7d980 msgr2=0x559149f856b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:24.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.950+0000 7fb5f7781740 1 --2- 172.21.15.1:0/2494343724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559149f7d980 0x559149f856b0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400b960 tx=0x7fb5e400be20 comp rx=0 tx=0).stop 2024-09-19T09:46:24.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.950+0000 7fb5f7781740 1 -- 172.21.15.1:0/2494343724 shutdown_connections 2024-09-19T09:46:24.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.950+0000 7fb5f7781740 1 --2- 172.21.15.1:0/2494343724 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x559149f97eb0 0x559149f9a310 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.950+0000 7fb5f7781740 1 --2- 172.21.15.1:0/2494343724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559149f88240 0x559149f85bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.950+0000 7fb5f7781740 1 --2- 172.21.15.1:0/2494343724 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559149f7d980 0x559149f856b0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.950+0000 7fb5f7781740 1 --2- 172.21.15.1:0/2494343724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559149f7d060 0x559149f85170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.950+0000 7fb5f7781740 1 -- 172.21.15.1:0/2494343724 >> 172.21.15.1:0/2494343724 conn(0x559149f795f0 msgr2=0x559149f78750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:24.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.950+0000 7fb5d2ff5640 0 client.16458 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:46:24.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.950+0000 7fb5f7781740 1 -- 172.21.15.1:0/2494343724 shutdown_connections 2024-09-19T09:46:24.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.950+0000 7fb5f7781740 1 -- 172.21.15.1:0/2494343724 wait complete. 2024-09-19T09:46:24.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.950+0000 7fb5f7781740 20 client.16458 trim_cache size 0 max 16384 2024-09-19T09:46:24.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.967+0000 7fb5f7781740 1 Processor -- start 2024-09-19T09:46:24.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.967+0000 7fb5f7781740 1 -- start start 2024-09-19T09:46:24.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.968+0000 7fb5f7781740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559149f7d060 0x559149f87040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:24.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.968+0000 7fb5f7781740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559149f7d980 0x559149f7fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:24.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.968+0000 7fb5f7781740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559149f88240 0x559149f9fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:24.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.968+0000 7fb5f7781740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f01ab490 con 0x559149f88240 2024-09-19T09:46:24.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.968+0000 7fb5f7781740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f01add30 con 0x559149f7d980 2024-09-19T09:46:24.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.968+0000 7fb5f7781740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f01abb20 con 0x559149f7d060 2024-09-19T09:46:24.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.968+0000 7fb5ef7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559149f88240 0x559149f9fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:24.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.968+0000 7fb5ef7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559149f88240 0x559149f9fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51318/0 (socket says 172.21.15.1:51318) 2024-09-19T09:46:24.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.968+0000 7fb5ef7fe640 1 -- 172.21.15.1:0/3719755104 learned_addr learned my addr 172.21.15.1:0/3719755104 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:24.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.968+0000 7fb5ef7fe640 1 --2- 172.21.15.1:0/3719755104 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559149f7d060 0x559149f87040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:24.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.968+0000 7fb5ee7fc640 1 --2- 172.21.15.1:0/3719755104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559149f7d980 0x559149f7fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:24.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.968+0000 7fb5ef7fe640 1 -- 172.21.15.1:0/3719755104 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559149f7d060 msgr2=0x559149f87040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:24.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.968+0000 7fb5ef7fe640 1 --2- 172.21.15.1:0/3719755104 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559149f7d060 0x559149f87040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.968+0000 7fb5ef7fe640 1 -- 172.21.15.1:0/3719755104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559149f7d980 msgr2=0x559149f7fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:24.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.968+0000 7fb5ef7fe640 1 --2- 172.21.15.1:0/3719755104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559149f7d980 0x559149f7fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.968+0000 7fb5ef7fe640 1 -- 172.21.15.1:0/3719755104 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559149f96a50 con 0x559149f88240 2024-09-19T09:46:24.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.968+0000 7fb5ef7fe640 1 --2- 172.21.15.1:0/3719755104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559149f88240 0x559149f9fc20 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8033000 tx=0x7fb5e8005370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e632b4627d10db5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:24.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.968+0000 7fb5d4ff9640 1 -- 172.21.15.1:0/3719755104 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8035040 con 0x559149f88240 2024-09-19T09:46:24.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.969+0000 7fb5d4ff9640 1 -- 172.21.15.1:0/3719755104 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5e8054070 con 0x559149f88240 2024-09-19T09:46:24.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.969+0000 7fb5d4ff9640 1 -- 172.21.15.1:0/3719755104 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e803f040 con 0x559149f88240 2024-09-19T09:46:24.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.969+0000 7fb5f7781740 1 -- 172.21.15.1:0/3719755104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559149f88240 msgr2=0x559149f9fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:24.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.969+0000 7fb5f7781740 1 --2- 172.21.15.1:0/3719755104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559149f88240 0x559149f9fc20 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8033000 tx=0x7fb5e8005370 comp rx=0 tx=0).stop 2024-09-19T09:46:24.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.969+0000 7fb5f7781740 1 -- 172.21.15.1:0/3719755104 shutdown_connections 2024-09-19T09:46:24.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.969+0000 7fb5f7781740 1 --2- 172.21.15.1:0/3719755104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559149f88240 0x559149f9fc20 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.969+0000 7fb5f7781740 1 --2- 172.21.15.1:0/3719755104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559149f7d980 0x559149f7fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.969+0000 7fb5f7781740 1 --2- 172.21.15.1:0/3719755104 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559149f7d060 0x559149f87040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.969+0000 7fb5f7781740 1 -- 172.21.15.1:0/3719755104 >> 172.21.15.1:0/3719755104 conn(0x559149f795f0 msgr2=0x559149f78750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:24.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.969+0000 7fb5f7781740 1 -- 172.21.15.1:0/3719755104 shutdown_connections 2024-09-19T09:46:24.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.969+0000 7fb5f7781740 1 -- 172.21.15.1:0/3719755104 wait complete. 2024-09-19T09:46:24.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.970+0000 7fb5f7781740 1 -- start start 2024-09-19T09:46:24.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.970+0000 7fb5f7781740 1 Processor -- start 2024-09-19T09:46:24.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.970+0000 7fb5f7781740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559149f7d060 0x559149f905d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:24.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.970+0000 7fb5f7781740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559149f7d980 0x559149f90b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:24.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.970+0000 7fb5f7781740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559149f88240 0x559149f8cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:24.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.970+0000 7fb5f7781740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f01ac1f0 con 0x559149f7d060 2024-09-19T09:46:24.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.970+0000 7fb5f7781740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f01ad660 con 0x559149f7d980 2024-09-19T09:46:24.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.970+0000 7fb5f7781740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f01ac8c0 con 0x559149f88240 2024-09-19T09:46:24.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.970+0000 7fb5f7781740 10 client.0 _ll_register_callbacks cb 0x7fb5e40044a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:46:24.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.970+0000 7fb5ef7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559149f7d060 0x559149f905d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:24.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.970+0000 7fb5ef7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559149f7d060 0x559149f905d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:51328/0 (socket says 172.21.15.1:51328) 2024-09-19T09:46:24.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.970+0000 7fb5ef7fe640 1 -- 172.21.15.1:0/3379895929 learned_addr learned my addr 172.21.15.1:0/3379895929 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:24.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.971+0000 7fb5ef7fe640 1 --2- 172.21.15.1:0/3379895929 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559149f88240 0x559149f8cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:24.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.971+0000 7fb5ef7fe640 1 -- 172.21.15.1:0/3379895929 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559149f88240 msgr2=0x559149f8cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:24.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.971+0000 7fb5ef7fe640 1 --2- 172.21.15.1:0/3379895929 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559149f88240 0x559149f8cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.971+0000 7fb5ee7fc640 1 --2- 172.21.15.1:0/3379895929 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559149f7d980 0x559149f90b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:24.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.971+0000 7fb5ef7fe640 1 -- 172.21.15.1:0/3379895929 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559149f7d980 msgr2=0x559149f90b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:24.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.971+0000 7fb5ef7fe640 1 --2- 172.21.15.1:0/3379895929 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559149f7d980 0x559149f90b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.971+0000 7fb5ef7fe640 1 -- 172.21.15.1:0/3379895929 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559149f7a6a0 con 0x559149f7d060 2024-09-19T09:46:24.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.971+0000 7fb5ef7fe640 1 --2- 172.21.15.1:0/3379895929 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559149f7d060 0x559149f905d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80059d0 tx=0x7fb5e8004c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a0cbcf08c73544 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:24.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.971+0000 7fb5d2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:46:24.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.971+0000 7fb5d2ff5640 1 -- 172.21.15.1:0/3379895929 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8062060 con 0x559149f7d060 2024-09-19T09:46:24.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.971+0000 7fb5d2ff5640 1 -- 172.21.15.1:0/3379895929 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fb5e8004ce0 con 0x559149f7d060 2024-09-19T09:46:24.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.971+0000 7fb5f7781740 1 -- 172.21.15.1:0/3379895929 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5e8054070 con 0x559149f7d060 2024-09-19T09:46:24.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.971+0000 7fb5d2ff5640 1 -- 172.21.15.1:0/3379895929 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb5e803f070 con 0x559149f7d060 2024-09-19T09:46:24.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.971+0000 7fb5f7781740 10 client.16464 fetch_fsmap learned FSMap version 21 2024-09-19T09:46:24.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.971+0000 7fb5f7781740 1 -- 172.21.15.1:0/3379895929 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55914a003720 con 0x559149f7d060 2024-09-19T09:46:24.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.972+0000 7fb5d2ff5640 1 -- 172.21.15.1:0/3379895929 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5e8054070 con 0x559149f7d060 2024-09-19T09:46:24.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.972+0000 7fb5d2ff5640 1 -- 172.21.15.1:0/3379895929 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8330+0+0 (secure 0 0 0) 0x7fb5e8004160 con 0x559149f7d060 2024-09-19T09:46:24.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.972+0000 7fb5f7781740 10 client.16464 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T09:46:24.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.972+0000 7fb5f7781740 10 client.16464 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:46:24.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.972+0000 7fb5f7781740 20 client.16464 populate_metadata read hostname 'smithi001' 2024-09-19T09:46:24.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.972+0000 7fb5f7781740 1 --2- 172.21.15.1:0/3379895929 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55914a0039a0 0x55914a005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:24.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.972+0000 7fb5f7781740 4 client.16464 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d2937df4", "release": true, "await": true}] 2024-09-19T09:46:24.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.972+0000 7fb5f7781740 1 -- 172.21.15.1:0/3379895929 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d2937df4", "release": true, "await": true}) -- 0x559149f80d90 con 0x55914a0039a0 2024-09-19T09:46:24.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.972+0000 7fb5ee7fc640 1 --2- 172.21.15.1:0/3379895929 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55914a0039a0 0x55914a005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:24.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.973+0000 7fb5d2ff5640 10 client.16464 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:46:24.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.973+0000 7fb5ee7fc640 1 --2- 172.21.15.1:0/3379895929 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55914a0039a0 0x55914a005d90 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7543a4f782fa1692 server_cookie=1b0ad62b5cba8877 in_seq=0 out_seq=0 2024-09-19T09:46:24.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.994+0000 7fb5d2ff5640 1 -- 172.21.15.1:0/3379895929 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x559149f80d90 con 0x55914a0039a0 2024-09-19T09:46:24.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.994+0000 7fb5d2ff5640 10 client.16464 handle_command_reply: tid=0 2024-09-19T09:46:24.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.994+0000 7fb5f7781740 1 client.16464 shutdown 2024-09-19T09:46:24.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.994+0000 7fb5f7781740 1 -- 172.21.15.1:0/3379895929 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559149f7d060 msgr2=0x559149f905d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:24.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.994+0000 7fb5f7781740 1 --2- 172.21.15.1:0/3379895929 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559149f7d060 0x559149f905d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fb5e80059d0 tx=0x7fb5e8004c40 comp rx=0 tx=0).stop 2024-09-19T09:46:24.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.995+0000 7fb5f7781740 1 -- 172.21.15.1:0/3379895929 shutdown_connections 2024-09-19T09:46:24.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.995+0000 7fb5f7781740 1 --2- 172.21.15.1:0/3379895929 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55914a0039a0 0x55914a005d90 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.995+0000 7fb5f7781740 1 --2- 172.21.15.1:0/3379895929 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559149f88240 0x559149f8cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.995+0000 7fb5f7781740 1 --2- 172.21.15.1:0/3379895929 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559149f7d980 0x559149f90b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.995+0000 7fb5f7781740 1 --2- 172.21.15.1:0/3379895929 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x559149f7d060 0x559149f905d0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:24.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.995+0000 7fb5f7781740 1 -- 172.21.15.1:0/3379895929 >> 172.21.15.1:0/3379895929 conn(0x559149f795f0 msgr2=0x559149f77f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:24.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.995+0000 7fb5d2ff5640 0 client.16464 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:46:24.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.997+0000 7fb5f7781740 1 -- 172.21.15.1:0/3379895929 shutdown_connections 2024-09-19T09:46:24.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.997+0000 7fb5f7781740 1 -- 172.21.15.1:0/3379895929 wait complete. 2024-09-19T09:46:24.999 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.998+0000 7fb5f7781740 20 client.16464 trim_cache size 0 max 16384 2024-09-19T09:46:25.000 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:46:25.000 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T09:46:25.000 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24497, 2024-09-19T09:46:25.000 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 24, 2024-09-19T09:46:25.000 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": { 2024-09-19T09:46:25.000 INFO:teuthology.orchestra.run.smithi001.stdout: "d2937df4": { 2024-09-19T09:46:25.000 INFO:teuthology.orchestra.run.smithi001.stdout: "version": 24, 2024-09-19T09:46:25.000 INFO:teuthology.orchestra.run.smithi001.stdout: "age_ref": 0.0, 2024-09-19T09:46:25.000 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:46:25.001 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T09:46:25.001 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:46:25.001 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:46:25.001 INFO:teuthology.orchestra.run.smithi001.stdout: "timeout": 90.0, 2024-09-19T09:46:25.001 INFO:teuthology.orchestra.run.smithi001.stdout: "expiration": 149.8, 2024-09-19T09:46:25.001 INFO:teuthology.orchestra.run.smithi001.stdout: "members": { 2024-09-19T09:46:25.001 INFO:teuthology.orchestra.run.smithi001.stdout: "file:/": { 2024-09-19T09:46:25.001 INFO:teuthology.orchestra.run.smithi001.stdout: "excluded": false, 2024-09-19T09:46:25.001 INFO:teuthology.orchestra.run.smithi001.stdout: "state": { 2024-09-19T09:46:25.001 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RELEASED", 2024-09-19T09:46:25.001 INFO:teuthology.orchestra.run.smithi001.stdout: "age": 0.0 2024-09-19T09:46:25.001 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:46:25.001 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:46:25.001 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:46:25.001 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:46:25.002 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:46:25.002 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:46:25.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.998+0000 7fb5f53a8640 1 -- 172.21.15.1:0/3471455366 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb5d80a3240 msgr2=0x7fb5d80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:25.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.998+0000 7fb5f53a8640 1 --2- 172.21.15.1:0/3471455366 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb5d80a3240 0x7fb5d80a5700 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb5e00a4b10 tx=0x7fb5e0098040 comp rx=0 tx=0).stop 2024-09-19T09:46:25.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.998+0000 7fb5f53a8640 1 -- 172.21.15.1:0/3471455366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5f0102d40 msgr2=0x7fb5f0198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:25.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.998+0000 7fb5f53a8640 1 --2- 172.21.15.1:0/3471455366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5f0102d40 0x7fb5f0198350 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb5e000cce0 tx=0x7fb5e000a620 comp rx=0 tx=0).stop 2024-09-19T09:46:25.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.998+0000 7fb5f53a8640 1 -- 172.21.15.1:0/3471455366 shutdown_connections 2024-09-19T09:46:25.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.998+0000 7fb5f53a8640 1 --2- 172.21.15.1:0/3471455366 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fb5d80a3240 0x7fb5d80a5700 secure :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb5e00a4b10 tx=0x7fb5e0098040 comp rx=0 tx=0).stop 2024-09-19T09:46:25.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.998+0000 7fb5f53a8640 1 --2- 172.21.15.1:0/3471455366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb5f010c170 0x7fb5f019cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:25.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.998+0000 7fb5f53a8640 1 --2- 172.21.15.1:0/3471455366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb5f0103660 0x7fb5f0198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:25.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.998+0000 7fb5f53a8640 1 --2- 172.21.15.1:0/3471455366 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb5f0102d40 0x7fb5f0198350 secure :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb5e000cce0 tx=0x7fb5e000a620 comp rx=0 tx=0).stop 2024-09-19T09:46:25.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.998+0000 7fb5f53a8640 1 -- 172.21.15.1:0/3471455366 >> 172.21.15.1:0/3471455366 conn(0x7fb5f00fc7a0 msgr2=0x7fb5f00fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:25.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.999+0000 7fb5f53a8640 1 -- 172.21.15.1:0/3471455366 shutdown_connections 2024-09-19T09:46:25.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:24.999+0000 7fb5f53a8640 1 -- 172.21.15.1:0/3471455366 wait complete. 2024-09-19T09:46:25.855 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.852+0000 7fadb4a77640 1 -- 172.21.15.1:0/4100542962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadb0101c30 msgr2=0x7fadb01020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:25.855 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.852+0000 7fadb4a77640 1 --2- 172.21.15.1:0/4100542962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadb0101c30 0x7fadb01020b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fada000b880 tx=0x7fada0005f90 comp rx=0 tx=0).stop 2024-09-19T09:46:25.861 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.858+0000 7fadb4a77640 1 -- 172.21.15.1:0/4100542962 shutdown_connections 2024-09-19T09:46:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.858+0000 7fadb4a77640 1 --2- 172.21.15.1:0/4100542962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadb01025f0 0x7fadb0108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.858+0000 7fadb4a77640 1 --2- 172.21.15.1:0/4100542962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadb0101c30 0x7fadb01020b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.858+0000 7fadb4a77640 1 --2- 172.21.15.1:0/4100542962 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadb0100a40 0x7fadb0100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:25.862 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.858+0000 7fadb4a77640 1 -- 172.21.15.1:0/4100542962 >> 172.21.15.1:0/4100542962 conn(0x7fadb00fc1c0 msgr2=0x7fadb00fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:25.865 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.862+0000 7fadb4a77640 1 -- 172.21.15.1:0/4100542962 shutdown_connections 2024-09-19T09:46:25.866 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.862+0000 7fadb4a77640 1 -- 172.21.15.1:0/4100542962 wait complete. 2024-09-19T09:46:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.863+0000 7fadb4a77640 1 Processor -- start 2024-09-19T09:46:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.864+0000 7fadb4a77640 1 -- start start 2024-09-19T09:46:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.864+0000 7fadb4a77640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadb0100a40 0x7fadb0070c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.864+0000 7fadb4a77640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadb0101c30 0x7fadb0071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.864+0000 7fadb4a77640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadb01025f0 0x7fadb01b6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.864+0000 7fadb4a77640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fadb010b640 con 0x7fadb0101c30 2024-09-19T09:46:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.864+0000 7fadb4a77640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fadb010b4c0 con 0x7fadb01025f0 2024-09-19T09:46:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.864+0000 7fadb4a77640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fadb010b7c0 con 0x7fadb0100a40 2024-09-19T09:46:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.865+0000 7fadadd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadb0101c30 0x7fadb0071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.865+0000 7fadadd9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadb0101c30 0x7fadb0071140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41270/0 (socket says 172.21.15.1:41270) 2024-09-19T09:46:25.869 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.865+0000 7fadadd9b640 1 -- 172.21.15.1:0/4148387184 learned_addr learned my addr 172.21.15.1:0/4148387184 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:25.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.866+0000 7fadaed9d640 1 --2- 172.21.15.1:0/4148387184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadb01025f0 0x7fadb01b6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:25.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.866+0000 7fadae59c640 1 --2- 172.21.15.1:0/4148387184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadb0100a40 0x7fadb0070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:25.870 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.867+0000 7fadadd9b640 1 -- 172.21.15.1:0/4148387184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadb0100a40 msgr2=0x7fadb0070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.867+0000 7fadadd9b640 1 --2- 172.21.15.1:0/4148387184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadb0100a40 0x7fadb0070c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.867+0000 7fadadd9b640 1 -- 172.21.15.1:0/4148387184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadb01025f0 msgr2=0x7fadb01b6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.867+0000 7fadadd9b640 1 --2- 172.21.15.1:0/4148387184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadb01025f0 0x7fadb01b6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.867+0000 7fadadd9b640 1 -- 172.21.15.1:0/4148387184 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadb01b7240 con 0x7fadb0101c30 2024-09-19T09:46:25.871 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.869+0000 7fadadd9b640 1 --2- 172.21.15.1:0/4148387184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadb0101c30 0x7fadb0071140 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fada0032fd0 tx=0x7fada0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:25.872 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.870+0000 7fad9f7fe640 1 -- 172.21.15.1:0/4148387184 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada0040020 con 0x7fadb0101c30 2024-09-19T09:46:25.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.870+0000 7fadb4a77640 1 -- 172.21.15.1:0/4148387184 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadb01b7410 con 0x7fadb0101c30 2024-09-19T09:46:25.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.870+0000 7fadb4a77640 1 -- 172.21.15.1:0/4148387184 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadb01b78d0 con 0x7fadb0101c30 2024-09-19T09:46:25.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.870+0000 7fad9f7fe640 1 -- 172.21.15.1:0/4148387184 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fada000ae30 con 0x7fadb0101c30 2024-09-19T09:46:25.873 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.870+0000 7fad9f7fe640 1 -- 172.21.15.1:0/4148387184 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada00326e0 con 0x7fadb0101c30 2024-09-19T09:46:25.877 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.875+0000 7fadb780a740 1 Processor -- start 2024-09-19T09:46:25.879 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.876+0000 7fad9f7fe640 1 -- 172.21.15.1:0/4148387184 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fada0043020 con 0x7fadb0101c30 2024-09-19T09:46:25.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.877+0000 7fadb780a740 1 -- start start 2024-09-19T09:46:25.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.877+0000 7fadb780a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db3b1359a0 0x55db3b135da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:25.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.877+0000 7fadb780a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55db3b1362e0 0x55db3b13ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:25.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.877+0000 7fadb780a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db3b13b370 0x55db3b13d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:25.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.877+0000 7fadb780a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55db3b0992f0 con 0x55db3b1359a0 2024-09-19T09:46:25.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.877+0000 7fadb780a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55db3b041270 con 0x55db3b13b370 2024-09-19T09:46:25.880 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.877+0000 7fadb780a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55db3b0952b0 con 0x55db3b1362e0 2024-09-19T09:46:25.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.878+0000 7fadadd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db3b13b370 0x55db3b13d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:25.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.878+0000 7fadadd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db3b13b370 0x55db3b13d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:51714/0 (socket says 172.21.15.1:51714) 2024-09-19T09:46:25.881 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.878+0000 7fadadd9b640 1 -- 172.21.15.1:0/297425575 learned_addr learned my addr 172.21.15.1:0/297425575 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:25.883 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.880+0000 7fad9f7fe640 1 --2- 172.21.15.1:0/4148387184 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fad980a3450 0x7fad980a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:25.884 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.880+0000 7fad9f7fe640 1 -- 172.21.15.1:0/4148387184 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fada00ef9c0 con 0x7fadb0101c30 2024-09-19T09:46:25.884 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.881+0000 7fadaed9d640 1 --2- 172.21.15.1:0/4148387184 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fad980a3450 0x7fad980a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:25.884 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.881+0000 7fadaed9d640 1 --2- 172.21.15.1:0/297425575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db3b1359a0 0x55db3b135da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.881+0000 7fadadd9b640 1 -- 172.21.15.1:0/297425575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55db3b1362e0 msgr2=0x55db3b13ada0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:46:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.881+0000 7fadadd9b640 1 --2- 172.21.15.1:0/297425575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55db3b1362e0 0x55db3b13ada0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.881+0000 7fadadd9b640 1 -- 172.21.15.1:0/297425575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db3b1359a0 msgr2=0x55db3b135da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.881+0000 7fadadd9b640 1 --2- 172.21.15.1:0/297425575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db3b1359a0 0x55db3b135da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:25.885 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.881+0000 7fadadd9b640 1 -- 172.21.15.1:0/297425575 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db3b040340 con 0x55db3b13b370 2024-09-19T09:46:25.887 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.882+0000 7fadaed9d640 1 --2- 172.21.15.1:0/4148387184 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fad980a3450 0x7fad980a5910 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fada8009a60 tx=0x7fada80098b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:25.887 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.884+0000 7fadadd9b640 1 --2- 172.21.15.1:0/297425575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db3b13b370 0x55db3b13d830 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fada00b8370 tx=0x7fada0000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bb8511b74ca3b30 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:25.891 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.889+0000 7fad9cff9640 1 -- 172.21.15.1:0/297425575 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada00bbd70 con 0x55db3b13b370 2024-09-19T09:46:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.889+0000 7fad9cff9640 1 -- 172.21.15.1:0/297425575 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fada00dc070 con 0x55db3b13b370 2024-09-19T09:46:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.889+0000 7fad9cff9640 1 -- 172.21.15.1:0/297425575 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada00ba0e0 con 0x55db3b13b370 2024-09-19T09:46:25.895 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.891+0000 7fadb780a740 1 -- 172.21.15.1:0/297425575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db3b13b370 msgr2=0x55db3b13d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:25.896 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.891+0000 7fadb780a740 1 --2- 172.21.15.1:0/297425575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db3b13b370 0x55db3b13d830 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fada00b8370 tx=0x7fada0000bc0 comp rx=0 tx=0).stop 2024-09-19T09:46:25.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.895+0000 7fadb780a740 1 -- 172.21.15.1:0/297425575 shutdown_connections 2024-09-19T09:46:25.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.895+0000 7fadb780a740 1 --2- 172.21.15.1:0/297425575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db3b13b370 0x55db3b13d830 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:25.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.895+0000 7fadb780a740 1 --2- 172.21.15.1:0/297425575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55db3b1362e0 0x55db3b13ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:25.898 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.895+0000 7fadb780a740 1 --2- 172.21.15.1:0/297425575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db3b1359a0 0x55db3b135da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:25.899 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.895+0000 7fadb780a740 1 -- 172.21.15.1:0/297425575 >> 172.21.15.1:0/297425575 conn(0x55db3b131010 msgr2=0x55db3b131410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:25.904 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.901+0000 7fadb780a740 1 -- 172.21.15.1:0/297425575 shutdown_connections 2024-09-19T09:46:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.903+0000 7fadb780a740 1 -- 172.21.15.1:0/297425575 wait complete. 2024-09-19T09:46:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.904+0000 7fadb780a740 1 -- start start 2024-09-19T09:46:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.904+0000 7fadb780a740 1 Processor -- start 2024-09-19T09:46:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.905+0000 7fadb780a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db3b1359a0 0x55db3b13f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.905+0000 7fadb780a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db3b1362e0 0x55db3b13fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.905+0000 7fadb780a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55db3b13b370 0x55db3b146c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.905+0000 7fadb780a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55db3b0992f0 con 0x55db3b1362e0 2024-09-19T09:46:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.905+0000 7fadb780a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55db3b022290 con 0x55db3b1359a0 2024-09-19T09:46:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.905+0000 7fadb780a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55db3b041270 con 0x55db3b13b370 2024-09-19T09:46:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.905+0000 7fadb780a740 10 client.0 _ll_register_callbacks cb 0x55db3b053140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:46:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.906+0000 7fadaed9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55db3b13b370 0x55db3b146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.906+0000 7fadaed9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55db3b13b370 0x55db3b146c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:53622/0 (socket says 172.21.15.1:53622) 2024-09-19T09:46:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.906+0000 7fadaed9d640 1 -- 172.21.15.1:0/427575343 learned_addr learned my addr 172.21.15.1:0/427575343 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:25.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.907+0000 7fadadd9b640 1 --2- 172.21.15.1:0/427575343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db3b1362e0 0x55db3b13fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:25.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.909+0000 7fadaed9d640 1 -- 172.21.15.1:0/427575343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db3b1359a0 msgr2=0x55db3b13f6e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:46:25.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.909+0000 7fadaed9d640 1 --2- 172.21.15.1:0/427575343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db3b1359a0 0x55db3b13f6e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:25.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.909+0000 7fadaed9d640 1 -- 172.21.15.1:0/427575343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db3b1362e0 msgr2=0x55db3b13fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:25.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.909+0000 7fadaed9d640 1 --2- 172.21.15.1:0/427575343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db3b1362e0 0x55db3b13fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:25.912 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.909+0000 7fadaed9d640 1 -- 172.21.15.1:0/427575343 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db3adac210 con 0x55db3b13b370 2024-09-19T09:46:25.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.910+0000 7fadaed9d640 1 --2- 172.21.15.1:0/427575343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55db3b13b370 0x55db3b146c60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fada800cd80 tx=0x7fada8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25a380ba0c230dac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:25.913 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.911+0000 7fad95ffb640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-19T09:46:25.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.911+0000 7fad95ffb640 1 -- 172.21.15.1:0/427575343 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada802c060 con 0x55db3b13b370 2024-09-19T09:46:25.914 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.911+0000 7fad95ffb640 1 -- 172.21.15.1:0/427575343 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fada8027410 con 0x55db3b13b370 2024-09-19T09:46:25.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.913+0000 7fadb780a740 1 -- 172.21.15.1:0/427575343 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fada00dc070 con 0x55db3b13b370 2024-09-19T09:46:25.917 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.915+0000 7fad95ffb640 1 -- 172.21.15.1:0/427575343 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fada8027610 con 0x55db3b13b370 2024-09-19T09:46:25.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.916+0000 7fadb780a740 10 client.25939 fetch_fsmap learned FSMap version 21 2024-09-19T09:46:25.918 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.916+0000 7fadb780a740 1 -- 172.21.15.1:0/427575343 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55db3ae78620 con 0x55db3b13b370 2024-09-19T09:46:25.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.919+0000 7fad95ffb640 1 -- 172.21.15.1:0/427575343 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fada00dc070 con 0x55db3b13b370 2024-09-19T09:46:25.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.919+0000 7fad95ffb640 1 -- 172.21.15.1:0/427575343 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 21) ==== 8330+0+0 (secure 0 0 0) 0x7fada801b070 con 0x55db3b13b370 2024-09-19T09:46:25.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.919+0000 7fadb780a740 10 client.25939 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T09:46:25.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.919+0000 7fadb780a740 10 client.25939 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:46:25.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.919+0000 7fadb780a740 20 client.25939 populate_metadata read hostname 'smithi001' 2024-09-19T09:46:25.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.919+0000 7fadb780a740 1 --2- 172.21.15.1:0/427575343 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55db3b14b8a0 0x55db3b14dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:25.922 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.919+0000 7fadb780a740 4 client.25939 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:46:25.923 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.919+0000 7fadb780a740 1 -- 172.21.15.1:0/427575343 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db3b0a6a20 con 0x55db3b14b8a0 2024-09-19T09:46:25.927 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.924+0000 7fadae59c640 1 --2- 172.21.15.1:0/427575343 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55db3b14b8a0 0x55db3b14dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:25.928 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.926+0000 7fad95ffb640 10 client.25939 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:46:25.928 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.926+0000 7fadae59c640 1 --2- 172.21.15.1:0/427575343 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55db3b14b8a0 0x55db3b14dd40 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c238a48520970f9 server_cookie=b76e79050ddf53ca in_seq=0 out_seq=0 2024-09-19T09:46:25.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.930+0000 7fad95ffb640 1 -- 172.21.15.1:0/427575343 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55db3b0a6a20 con 0x55db3b14b8a0 2024-09-19T09:46:25.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.930+0000 7fad95ffb640 10 client.25939 handle_command_reply: tid=0 2024-09-19T09:46:25.933 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.930+0000 7fadb780a740 1 client.25939 shutdown 2024-09-19T09:46:25.937 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.934+0000 7fadb780a740 1 -- 172.21.15.1:0/427575343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55db3b13b370 msgr2=0x55db3b146c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:25.937 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.934+0000 7fadb780a740 1 --2- 172.21.15.1:0/427575343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55db3b13b370 0x55db3b146c60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fada800cd80 tx=0x7fada8004a40 comp rx=0 tx=0).stop 2024-09-19T09:46:25.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.935+0000 7fadb780a740 1 -- 172.21.15.1:0/427575343 shutdown_connections 2024-09-19T09:46:25.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.935+0000 7fadb780a740 1 --2- 172.21.15.1:0/427575343 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55db3b14b8a0 0x55db3b14dd40 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:25.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.935+0000 7fadb780a740 1 --2- 172.21.15.1:0/427575343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55db3b13b370 0x55db3b146c60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:25.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.935+0000 7fadb780a740 1 --2- 172.21.15.1:0/427575343 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db3b1362e0 0x55db3b13fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:25.939 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.935+0000 7fadb780a740 1 --2- 172.21.15.1:0/427575343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db3b1359a0 0x55db3b13f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:25.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.935+0000 7fadb780a740 1 -- 172.21.15.1:0/427575343 >> 172.21.15.1:0/427575343 conn(0x55db3b131010 msgr2=0x55db3b132820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:25.940 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.935+0000 7fad95ffb640 0 client.25939 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:46:25.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.939+0000 7fadb780a740 1 -- 172.21.15.1:0/427575343 shutdown_connections 2024-09-19T09:46:25.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.940+0000 7fadb780a740 1 -- 172.21.15.1:0/427575343 wait complete. 2024-09-19T09:46:25.942 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.940+0000 7fadb780a740 20 client.25939 trim_cache size 0 max 16384 2024-09-19T09:46:25.964 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd2937df4', total seconds elapsed: 95.2 2024-09-19T09:46:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.973+0000 7fadb780a740 1 Processor -- start 2024-09-19T09:46:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.974+0000 7fadb780a740 1 -- start start 2024-09-19T09:46:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.974+0000 7fadb780a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55db3b1359a0 0x55db3b131ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.974+0000 7fadb780a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db3b1362e0 0x55db3b146c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.974+0000 7fadb780a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db3b13b370 0x55db3b132400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.974+0000 7fadb780a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fad9000c560 con 0x55db3b13b370 2024-09-19T09:46:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.974+0000 7fadb780a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fad9000ee00 con 0x55db3b1362e0 2024-09-19T09:46:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.974+0000 7fadb780a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fad9000cbf0 con 0x55db3b1359a0 2024-09-19T09:46:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.974+0000 7fadadd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db3b1362e0 0x55db3b146c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.974+0000 7fadadd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db3b1362e0 0x55db3b146c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:51724/0 (socket says 172.21.15.1:51724) 2024-09-19T09:46:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.974+0000 7fadadd9b640 1 -- 172.21.15.1:0/2168354929 learned_addr learned my addr 172.21.15.1:0/2168354929 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.974+0000 7fadaed9d640 1 --2- 172.21.15.1:0/2168354929 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db3b13b370 0x55db3b132400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.975+0000 7fadadd9b640 1 -- 172.21.15.1:0/2168354929 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55db3b1359a0 msgr2=0x55db3b131ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:46:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.975+0000 7fadadd9b640 1 --2- 172.21.15.1:0/2168354929 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55db3b1359a0 0x55db3b131ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.975+0000 7fadadd9b640 1 -- 172.21.15.1:0/2168354929 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db3b13b370 msgr2=0x55db3b132400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.975+0000 7fadadd9b640 1 --2- 172.21.15.1:0/2168354929 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db3b13b370 0x55db3b132400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.975+0000 7fadadd9b640 1 -- 172.21.15.1:0/2168354929 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db3b13a780 con 0x55db3b1362e0 2024-09-19T09:46:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.976+0000 7fadadd9b640 1 --2- 172.21.15.1:0/2168354929 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db3b1362e0 0x55db3b146c20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fada000b850 tx=0x7fada00dc190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e35d01e9d0e0c559 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.977+0000 7fad97fff640 1 -- 172.21.15.1:0/2168354929 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada00f5020 con 0x55db3b1362e0 2024-09-19T09:46:25.980 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.977+0000 7fad97fff640 1 -- 172.21.15.1:0/2168354929 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fada00f5380 con 0x55db3b1362e0 2024-09-19T09:46:25.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.978+0000 7fad97fff640 1 -- 172.21.15.1:0/2168354929 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada00d4030 con 0x55db3b1362e0 2024-09-19T09:46:25.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.978+0000 7fadb780a740 1 -- 172.21.15.1:0/2168354929 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db3b1362e0 msgr2=0x55db3b146c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:25.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.978+0000 7fadb780a740 1 --2- 172.21.15.1:0/2168354929 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db3b1362e0 0x55db3b146c20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fada000b850 tx=0x7fada00dc190 comp rx=0 tx=0).stop 2024-09-19T09:46:25.981 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.978+0000 7fadb780a740 1 -- 172.21.15.1:0/2168354929 shutdown_connections 2024-09-19T09:46:25.982 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.978+0000 7fadb780a740 1 --2- 172.21.15.1:0/2168354929 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db3b13b370 0x55db3b132400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:25.982 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.978+0000 7fadb780a740 1 --2- 172.21.15.1:0/2168354929 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db3b1362e0 0x55db3b146c20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:25.982 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.978+0000 7fadb780a740 1 --2- 172.21.15.1:0/2168354929 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55db3b1359a0 0x55db3b131ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:25.982 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.978+0000 7fadb780a740 1 -- 172.21.15.1:0/2168354929 >> 172.21.15.1:0/2168354929 conn(0x55db3b131010 msgr2=0x55db3b13f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:25.989 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.986+0000 7fadb780a740 1 -- 172.21.15.1:0/2168354929 shutdown_connections 2024-09-19T09:46:25.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.990+0000 7fadb780a740 1 -- 172.21.15.1:0/2168354929 wait complete. 2024-09-19T09:46:25.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.990+0000 7fadb780a740 1 -- start start 2024-09-19T09:46:25.993 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.991+0000 7fadb780a740 1 Processor -- start 2024-09-19T09:46:25.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.991+0000 7fadb780a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55db3b1359a0 0x55db3b1442b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:25.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.991+0000 7fadb780a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db3b1362e0 0x55db3b1447f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:25.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.991+0000 7fadb780a740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db3b13b370 0x55db3b145800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:25.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.991+0000 7fadb780a740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fad9000d2c0 con 0x55db3b13b370 2024-09-19T09:46:25.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.991+0000 7fadb780a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fad9000e730 con 0x55db3b1362e0 2024-09-19T09:46:25.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.991+0000 7fadb780a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fad9000d990 con 0x55db3b1359a0 2024-09-19T09:46:25.994 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.991+0000 7fadb780a740 10 client.0 _ll_register_callbacks cb 0x7fada800cc40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:46:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.992+0000 7fadaed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db3b13b370 0x55db3b145800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.992+0000 7fadaed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db3b13b370 0x55db3b145800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41308/0 (socket says 172.21.15.1:41308) 2024-09-19T09:46:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.992+0000 7fadaed9d640 1 -- 172.21.15.1:0/2634106589 learned_addr learned my addr 172.21.15.1:0/2634106589 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.992+0000 7fadadd9b640 1 --2- 172.21.15.1:0/2634106589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db3b1362e0 0x55db3b1447f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:25.995 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.992+0000 7fadae59c640 1 --2- 172.21.15.1:0/2634106589 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55db3b1359a0 0x55db3b1442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.992+0000 7fadaed9d640 1 -- 172.21.15.1:0/2634106589 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55db3b1359a0 msgr2=0x55db3b1442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.992+0000 7fadaed9d640 1 --2- 172.21.15.1:0/2634106589 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55db3b1359a0 0x55db3b1442b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.992+0000 7fadaed9d640 1 -- 172.21.15.1:0/2634106589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db3b1362e0 msgr2=0x55db3b1447f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.992+0000 7fadaed9d640 1 --2- 172.21.15.1:0/2634106589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db3b1362e0 0x55db3b1447f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.992+0000 7fadaed9d640 1 -- 172.21.15.1:0/2634106589 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db3b145e10 con 0x55db3b13b370 2024-09-19T09:46:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.993+0000 7fadaed9d640 1 --2- 172.21.15.1:0/2634106589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db3b13b370 0x55db3b145800 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fada8005b00 tx=0x7fada8009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7f62b36258367f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:25.996 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.993+0000 7fad95ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:46:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.994+0000 7fad95ffb640 1 -- 172.21.15.1:0/2634106589 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada8036080 con 0x55db3b13b370 2024-09-19T09:46:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.994+0000 7fadb780a740 1 -- 172.21.15.1:0/2634106589 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fada00f5380 con 0x55db3b13b370 2024-09-19T09:46:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.994+0000 7fad95ffb640 1 -- 172.21.15.1:0/2634106589 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fada8030dc0 con 0x55db3b13b370 2024-09-19T09:46:25.997 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.994+0000 7fad95ffb640 1 -- 172.21.15.1:0/2634106589 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fada8004ab0 con 0x55db3b13b370 2024-09-19T09:46:26.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.997+0000 7fadb780a740 10 client.16482 fetch_fsmap learned FSMap version 21 2024-09-19T09:46:26.000 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.997+0000 7fadb780a740 1 -- 172.21.15.1:0/2634106589 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55db3b1b6650 con 0x55db3b13b370 2024-09-19T09:46:26.001 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.998+0000 7fad95ffb640 1 -- 172.21.15.1:0/2634106589 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fada00f5380 con 0x55db3b13b370 2024-09-19T09:46:26.001 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.998+0000 7fad95ffb640 1 -- 172.21.15.1:0/2634106589 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8330+0+0 (secure 0 0 0) 0x7fada801b040 con 0x55db3b13b370 2024-09-19T09:46:26.001 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.998+0000 7fadb780a740 10 client.16482 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T09:46:26.001 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.998+0000 7fadb780a740 10 client.16482 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:46:26.001 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.998+0000 7fadb780a740 20 client.16482 populate_metadata read hostname 'smithi001' 2024-09-19T09:46:26.001 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.998+0000 7fadb780a740 1 --2- 172.21.15.1:0/2634106589 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55db3b1b7000 0x55db3b1b9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:26.001 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.998+0000 7fadb780a740 4 client.16482 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:46:26.002 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.998+0000 7fadb780a740 1 -- 172.21.15.1:0/2634106589 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55db3b0a0d70 con 0x55db3b1b7000 2024-09-19T09:46:26.002 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:25.999+0000 7fadae59c640 1 --2- 172.21.15.1:0/2634106589 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55db3b1b7000 0x55db3b1b9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:26.005 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:26.003+0000 7fad95ffb640 10 client.16482 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:46:26.006 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:26.003+0000 7fadae59c640 1 --2- 172.21.15.1:0/2634106589 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55db3b1b7000 0x55db3b1b9420 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cdd37768b561833 server_cookie=25ffb70c5696b7be in_seq=0 out_seq=0 2024-09-19T09:46:26.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:26.135+0000 7fad95ffb640 1 -- 172.21.15.1:0/2634106589 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55db3b0a0d70 con 0x55db3b1b7000 2024-09-19T09:46:26.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:26.135+0000 7fad95ffb640 10 client.16482 handle_command_reply: tid=0 2024-09-19T09:46:26.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:26.135+0000 7fadb780a740 1 client.16482 shutdown 2024-09-19T09:46:26.138 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:26.135+0000 7fadb780a740 1 -- 172.21.15.1:0/2634106589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db3b13b370 msgr2=0x55db3b145800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:26.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:26.135+0000 7fadb780a740 1 --2- 172.21.15.1:0/2634106589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db3b13b370 0x55db3b145800 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fada8005b00 tx=0x7fada8009740 comp rx=0 tx=0).stop 2024-09-19T09:46:26.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:26.136+0000 7fadb780a740 1 -- 172.21.15.1:0/2634106589 shutdown_connections 2024-09-19T09:46:26.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:26.136+0000 7fadb780a740 1 --2- 172.21.15.1:0/2634106589 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55db3b1b7000 0x55db3b1b9420 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:26.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:26.136+0000 7fadb780a740 1 --2- 172.21.15.1:0/2634106589 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55db3b13b370 0x55db3b145800 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:26.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:26.136+0000 7fadb780a740 1 --2- 172.21.15.1:0/2634106589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55db3b1362e0 0x55db3b1447f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:26.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:26.136+0000 7fadb780a740 1 --2- 172.21.15.1:0/2634106589 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55db3b1359a0 0x55db3b1442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:26.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:26.136+0000 7fad95ffb640 0 client.16482 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:46:26.139 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:26.136+0000 7fadb780a740 1 -- 172.21.15.1:0/2634106589 >> 172.21.15.1:0/2634106589 conn(0x55db3b131010 msgr2=0x55db3b12f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:26.140 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:26.136+0000 7fadb780a740 1 -- 172.21.15.1:0/2634106589 shutdown_connections 2024-09-19T09:46:26.140 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:26.136+0000 7fadb780a740 1 -- 172.21.15.1:0/2634106589 wait complete. 2024-09-19T09:46:26.140 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:26.136+0000 7fadb780a740 20 client.16482 trim_cache size 0 max 16384 2024-09-19T09:46:26.140 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:{ 2024-09-19T09:46:26.140 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "message": "", 2024-09-19T09:46:26.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout: "return_code": 0 2024-09-19T09:46:26.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stdout:} 2024-09-19T09:46:26.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:26.137+0000 7fadb4a77640 1 -- 172.21.15.1:0/4148387184 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fad980a3450 msgr2=0x7fad980a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:26.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:26.137+0000 7fadb4a77640 1 --2- 172.21.15.1:0/4148387184 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fad980a3450 0x7fad980a5910 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fada8009a60 tx=0x7fada80098b0 comp rx=0 tx=0).stop 2024-09-19T09:46:26.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:26.137+0000 7fadb4a77640 1 -- 172.21.15.1:0/4148387184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadb0101c30 msgr2=0x7fadb0071140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:26.141 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:26.137+0000 7fadb4a77640 1 --2- 172.21.15.1:0/4148387184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadb0101c30 0x7fadb0071140 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fada0032fd0 tx=0x7fada0004270 comp rx=0 tx=0).stop 2024-09-19T09:46:26.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:26.137+0000 7fadb4a77640 1 -- 172.21.15.1:0/4148387184 shutdown_connections 2024-09-19T09:46:26.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:26.137+0000 7fadb4a77640 1 --2- 172.21.15.1:0/4148387184 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fad980a3450 0x7fad980a5910 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:26.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:26.137+0000 7fadb4a77640 1 --2- 172.21.15.1:0/4148387184 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadb01025f0 0x7fadb01b6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:26.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:26.137+0000 7fadb4a77640 1 --2- 172.21.15.1:0/4148387184 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadb0101c30 0x7fadb0071140 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:26.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:26.137+0000 7fadb4a77640 1 --2- 172.21.15.1:0/4148387184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadb0100a40 0x7fadb0070c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:26.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:26.137+0000 7fadb4a77640 1 -- 172.21.15.1:0/4148387184 >> 172.21.15.1:0/4148387184 conn(0x7fadb00fc1c0 msgr2=0x7fadb0105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:26.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:26.137+0000 7fadb4a77640 1 -- 172.21.15.1:0/4148387184 shutdown_connections 2024-09-19T09:46:26.142 INFO:teuthology.task.background_exec.ubuntu@smithi001.front.sepia.ceph.com.smithi001.stderr:2024-09-19T09:46:26.137+0000 7fadb4a77640 1 -- 172.21.15.1:0/4148387184 wait complete. 2024-09-19T09:46:26.457 INFO:tasks.workunit.client.0.smithi001.stdout:Syncing()...1 sec 2024-09-19T09:46:26.458 INFO:tasks.workunit.client.0.smithi001.stdout:FFSB benchmark finished at: Thu Sep 19 09:46:26 2024 2024-09-19T09:46:26.458 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-09-19T09:46:26.458 INFO:tasks.workunit.client.0.smithi001.stdout:Results: 2024-09-19T09:46:26.458 INFO:tasks.workunit.client.0.smithi001.stdout:Benchmark took 354.44 sec 2024-09-19T09:46:26.458 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-09-19T09:46:26.458 INFO:tasks.workunit.client.0.smithi001.stdout:Total Results 2024-09-19T09:46:26.458 INFO:tasks.workunit.client.0.smithi001.stdout:=============== 2024-09-19T09:46:26.458 INFO:tasks.workunit.client.0.smithi001.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-09-19T09:46:26.458 INFO:tasks.workunit.client.0.smithi001.stdout: ======= ============ ========= ======= =========== ========== 2024-09-19T09:46:26.458 INFO:tasks.workunit.client.0.smithi001.stdout: write : 10312960 29096.66 100.000% 100.000% 114MB/sec 2024-09-19T09:46:26.458 INFO:tasks.workunit.client.0.smithi001.stdout:- 2024-09-19T09:46:26.458 INFO:tasks.workunit.client.0.smithi001.stdout:29096.66 Transactions per Second 2024-09-19T09:46:26.458 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-09-19T09:46:26.459 INFO:tasks.workunit.client.0.smithi001.stdout:Throughput Results 2024-09-19T09:46:26.459 INFO:tasks.workunit.client.0.smithi001.stdout:=================== 2024-09-19T09:46:26.459 INFO:tasks.workunit.client.0.smithi001.stdout:Write Throughput: 114MB/sec 2024-09-19T09:46:26.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:26 smithi001 ceph-mon[31225]: pgmap v589: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.4 MiB/s wr, 1.02k op/s 2024-09-19T09:46:26.502 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-09-19T09:46:26.502 INFO:tasks.workunit.client.0.smithi001.stdout:System Call Latency statistics in millisecs 2024-09-19T09:46:26.502 INFO:tasks.workunit.client.0.smithi001.stdout:===== 2024-09-19T09:46:26.502 INFO:tasks.workunit.client.0.smithi001.stdout: Min Avg Max Total Calls 2024-09-19T09:46:26.502 INFO:tasks.workunit.client.0.smithi001.stdout: ======== ======== ======== ============ 2024-09-19T09:46:26.502 INFO:tasks.workunit.client.0.smithi001.stdout:[ open] 0.004000 0.363227 45.028000 8057 2024-09-19T09:46:26.503 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-19T09:46:26.503 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-19T09:46:26.503 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-19T09:46:26.503 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-19T09:46:26.503 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-19T09:46:26.503 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-19T09:46:26.503 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-09-19T09:46:26.503 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[7] 20.000000 - 50.000000 : 39 2024-09-19T09:46:26.503 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[8] 10.000000 - 20.000000 : 75 2024-09-19T09:46:26.503 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[9] 5.000000 - 10.000000 : 55 2024-09-19T09:46:26.503 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[10] 2.000000 - 5.000000 : 70 2024-09-19T09:46:26.503 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[11] 1.000000 - 2.000000 : 37 2024-09-19T09:46:26.503 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[12] 0.500000 - 1.000000 : 35 2024-09-19T09:46:26.504 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[13] 0.200000 - 0.500000 : 8 2024-09-19T09:46:26.504 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[14] 0.100000 - 0.200000 : 31 2024-09-19T09:46:26.504 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[15] 0.050000 - 0.100000 : 106 2024-09-19T09:46:26.504 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[16] 0.020000 - 0.050000 : 2414 2024-09-19T09:46:26.504 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[17] 0.010000 - 0.020000 : 4234 2024-09-19T09:46:26.504 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[18] 0.000000 - 0.010000 : 953 2024-09-19T09:46:26.504 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-09-19T09:46:26.504 INFO:tasks.workunit.client.0.smithi001.stdout:[ write] 0.001000 0.996838 58304.355469 10312960 2024-09-19T09:46:26.504 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[0] 5000.000000 - 10000.000000 : 309 2024-09-19T09:46:26.504 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[1] 2000.000000 - 5000.000000 : 375 2024-09-19T09:46:26.504 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[2] 1000.000000 - 2000.000000 : 279 2024-09-19T09:46:26.504 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[3] 500.000000 - 1000.000000 : 281 2024-09-19T09:46:26.504 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[4] 200.000000 - 500.000000 : 372 2024-09-19T09:46:26.504 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[5] 100.000000 - 200.000000 : 306 2024-09-19T09:46:26.505 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[6] 50.000000 - 100.000000 : 513 2024-09-19T09:46:26.505 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[7] 20.000000 - 50.000000 : 2702 2024-09-19T09:46:26.505 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[8] 10.000000 - 20.000000 : 3044 2024-09-19T09:46:26.505 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[9] 5.000000 - 10.000000 : 1597 2024-09-19T09:46:26.505 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[10] 2.000000 - 5.000000 : 1670 2024-09-19T09:46:26.505 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[11] 1.000000 - 2.000000 : 1201 2024-09-19T09:46:26.505 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[12] 0.500000 - 1.000000 : 1136 2024-09-19T09:46:26.505 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[13] 0.200000 - 0.500000 : 1377 2024-09-19T09:46:26.505 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[14] 0.100000 - 0.200000 : 1909 2024-09-19T09:46:26.505 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[15] 0.050000 - 0.100000 : 6129 2024-09-19T09:46:26.505 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[16] 0.020000 - 0.050000 : 25189 2024-09-19T09:46:26.505 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[17] 0.010000 - 0.020000 : 63660 2024-09-19T09:46:26.505 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[18] 0.000000 - 0.010000 : 10200622 2024-09-19T09:46:26.505 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-09-19T09:46:26.506 INFO:tasks.workunit.client.0.smithi001.stdout:[ lseek] 0.000000 0.001336 95.446999 10312960 2024-09-19T09:46:26.506 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-19T09:46:26.506 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-19T09:46:26.506 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-19T09:46:26.506 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-19T09:46:26.506 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-19T09:46:26.506 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-19T09:46:26.506 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[6] 50.000000 - 100.000000 : 6 2024-09-19T09:46:26.506 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[7] 20.000000 - 50.000000 : 118 2024-09-19T09:46:26.506 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[8] 10.000000 - 20.000000 : 123 2024-09-19T09:46:26.506 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[9] 5.000000 - 10.000000 : 133 2024-09-19T09:46:26.506 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[10] 2.000000 - 5.000000 : 141 2024-09-19T09:46:26.506 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[11] 1.000000 - 2.000000 : 99 2024-09-19T09:46:26.506 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[12] 0.500000 - 1.000000 : 120 2024-09-19T09:46:26.506 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[13] 0.200000 - 0.500000 : 171 2024-09-19T09:46:26.507 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[14] 0.100000 - 0.200000 : 195 2024-09-19T09:46:26.507 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[15] 0.050000 - 0.100000 : 478 2024-09-19T09:46:26.507 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[16] 0.020000 - 0.050000 : 2028 2024-09-19T09:46:26.507 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[17] 0.010000 - 0.020000 : 4563 2024-09-19T09:46:26.507 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[18] 0.000000 - 0.010000 : 10304785 2024-09-19T09:46:26.507 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-09-19T09:46:26.507 INFO:tasks.workunit.client.0.smithi001.stdout:[ close] 0.001000 0.007533 20.718000 8057 2024-09-19T09:46:26.507 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-19T09:46:26.507 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-19T09:46:26.507 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-19T09:46:26.507 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-19T09:46:26.507 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-19T09:46:26.507 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-19T09:46:26.507 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-09-19T09:46:26.508 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[7] 20.000000 - 50.000000 : 1 2024-09-19T09:46:26.508 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[8] 10.000000 - 20.000000 : 0 2024-09-19T09:46:26.508 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[9] 5.000000 - 10.000000 : 0 2024-09-19T09:46:26.508 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[10] 2.000000 - 5.000000 : 1 2024-09-19T09:46:26.508 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[11] 1.000000 - 2.000000 : 0 2024-09-19T09:46:26.508 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[12] 0.500000 - 1.000000 : 0 2024-09-19T09:46:26.508 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[13] 0.200000 - 0.500000 : 1 2024-09-19T09:46:26.508 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[14] 0.100000 - 0.200000 : 1 2024-09-19T09:46:26.508 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[15] 0.050000 - 0.100000 : 2 2024-09-19T09:46:26.508 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[16] 0.020000 - 0.050000 : 21 2024-09-19T09:46:26.508 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[17] 0.010000 - 0.020000 : 49 2024-09-19T09:46:26.508 INFO:tasks.workunit.client.0.smithi001.stdout: msec_range[18] 0.000000 - 0.010000 : 7981 2024-09-19T09:46:26.508 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-09-19T09:46:26.508 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-09-19T09:46:26.509 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-09-19T09:46:26.509 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-09-19T09:46:26.509 INFO:tasks.workunit.client.0.smithi001.stdout:2.8% User Time 2024-09-19T09:46:26.509 INFO:tasks.workunit.client.0.smithi001.stdout:9.6% System Time 2024-09-19T09:46:26.509 INFO:tasks.workunit.client.0.smithi001.stdout:12.4% CPU Utilization 2024-09-19T09:46:26.517 INFO:tasks.workunit.client.0.smithi001.stderr:+ cd .. 2024-09-19T09:46:26.521 INFO:tasks.workunit.client.0.smithi001.stderr:+ rm -r tmp ffsb 2024-09-19T09:46:26.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:26 smithi022 ceph-mon[35583]: pgmap v589: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.4 MiB/s wr, 1.02k op/s 2024-09-19T09:46:26.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:26 smithi121 ceph-mon[35577]: pgmap v589: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.4 MiB/s wr, 1.02k op/s 2024-09-19T09:46:27.779 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T09:46:27.779 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T09:46:27.856 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2024-09-19T09:46:27.856 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T09:46:28.329 DEBUG:teuthology.parallel:result is None 2024-09-19T09:46:28.330 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T09:46:28.371 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T09:46:28.371 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-19T09:46:28.388 INFO:tasks.quiescer:joining Quiescers 2024-09-19T09:46:28.388 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-19T09:46:28.389 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:46:28.419 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:28 smithi121 ceph-mon[35577]: pgmap v590: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.9 MiB/s wr, 1.33k op/s 2024-09-19T09:46:28.443 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:28 smithi001 ceph-mon[31225]: pgmap v590: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.9 MiB/s wr, 1.33k op/s 2024-09-19T09:46:28.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:28 smithi022 ceph-mon[35583]: pgmap v590: 97 pgs: 97 active+clean; 13 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.9 MiB/s wr, 1.33k op/s 2024-09-19T09:46:28.812 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:46:29.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.433+0000 7f618ec5d640 1 -- 172.21.15.1:0/914536315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6188106f10 msgr2=0x7f618810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:29.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.433+0000 7f618ec5d640 1 --2- 172.21.15.1:0/914536315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6188106f10 0x7f618810ea90 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f6180009ca0 tx=0x7f618002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:46:29.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.433+0000 7f618ec5d640 1 -- 172.21.15.1:0/914536315 shutdown_connections 2024-09-19T09:46:29.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.433+0000 7f618ec5d640 1 --2- 172.21.15.1:0/914536315 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6188106f10 0x7f618810ea90 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:29.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.433+0000 7f618ec5d640 1 --2- 172.21.15.1:0/914536315 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6188102790 0x7f61881067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:29.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.433+0000 7f618ec5d640 1 --2- 172.21.15.1:0/914536315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6188101de0 0x7f61881021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:29.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.433+0000 7f618ec5d640 1 -- 172.21.15.1:0/914536315 >> 172.21.15.1:0/914536315 conn(0x7f61880fd880 msgr2=0x7f61880ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:29.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.434+0000 7f618ec5d640 1 -- 172.21.15.1:0/914536315 shutdown_connections 2024-09-19T09:46:29.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.434+0000 7f618ec5d640 1 -- 172.21.15.1:0/914536315 wait complete. 2024-09-19T09:46:29.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.434+0000 7f618ec5d640 1 Processor -- start 2024-09-19T09:46:29.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.435+0000 7f618ec5d640 1 -- start start 2024-09-19T09:46:29.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.435+0000 7f618ec5d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6188101de0 0x7f6188198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:29.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.435+0000 7f618ec5d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6188102790 0x7f6188198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:29.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.435+0000 7f618ec5d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6188106f10 0x7f618819ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:29.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.435+0000 7f618ec5d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6188111fe0 con 0x7f6188102790 2024-09-19T09:46:29.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.435+0000 7f618ec5d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6188111e60 con 0x7f6188106f10 2024-09-19T09:46:29.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.435+0000 7f618ec5d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6188112160 con 0x7f6188101de0 2024-09-19T09:46:29.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.435+0000 7f618c9f9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6188101de0 0x7f6188198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:29.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.435+0000 7f618c9f9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6188101de0 0x7f6188198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:53646/0 (socket says 172.21.15.1:53646) 2024-09-19T09:46:29.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.435+0000 7f618c9f9640 1 -- 172.21.15.1:0/2955278715 learned_addr learned my addr 172.21.15.1:0/2955278715 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:29.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.435+0000 7f618d1fa640 1 --2- 172.21.15.1:0/2955278715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6188106f10 0x7f618819ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:29.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.435+0000 7f617ffff640 1 --2- 172.21.15.1:0/2955278715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6188102790 0x7f6188198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:29.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.436+0000 7f618d1fa640 1 -- 172.21.15.1:0/2955278715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6188101de0 msgr2=0x7f6188198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:29.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.436+0000 7f618d1fa640 1 --2- 172.21.15.1:0/2955278715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6188101de0 0x7f6188198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:29.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.436+0000 7f618d1fa640 1 -- 172.21.15.1:0/2955278715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6188102790 msgr2=0x7f6188198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:29.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.436+0000 7f618d1fa640 1 --2- 172.21.15.1:0/2955278715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6188102790 0x7f6188198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:29.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.436+0000 7f618d1fa640 1 -- 172.21.15.1:0/2955278715 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618819d3d0 con 0x7f6188106f10 2024-09-19T09:46:29.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.436+0000 7f618d1fa640 1 --2- 172.21.15.1:0/2955278715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6188106f10 0x7f618819ccf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6180005e30 tx=0x7f6180003f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:29.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.437+0000 7f617dffb640 1 -- 172.21.15.1:0/2955278715 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6180031650 con 0x7f6188106f10 2024-09-19T09:46:29.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.437+0000 7f618ec5d640 1 -- 172.21.15.1:0/2955278715 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f618819d660 con 0x7f6188106f10 2024-09-19T09:46:29.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.437+0000 7f617dffb640 1 -- 172.21.15.1:0/2955278715 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61800317f0 con 0x7f6188106f10 2024-09-19T09:46:29.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.437+0000 7f617dffb640 1 -- 172.21.15.1:0/2955278715 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618002f990 con 0x7f6188106f10 2024-09-19T09:46:29.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.437+0000 7f618ec5d640 1 -- 172.21.15.1:0/2955278715 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f618819dae0 con 0x7f6188106f10 2024-09-19T09:46:29.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.440+0000 7f617dffb640 1 -- 172.21.15.1:0/2955278715 <== mon.2 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f618002fb30 con 0x7f6188106f10 2024-09-19T09:46:29.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.441+0000 7f617dffb640 1 --2- 172.21.15.1:0/2955278715 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f61700a3340 0x7f61700a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:29.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.442+0000 7f617dffb640 1 -- 172.21.15.1:0/2955278715 <== mon.2 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f61800f0b80 con 0x7f6188106f10 2024-09-19T09:46:29.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.440+0000 7f618ec5d640 1 -- 172.21.15.1:0/2955278715 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61881021c0 con 0x7f6188106f10 2024-09-19T09:46:29.445 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.442+0000 7f618c9f9640 1 --2- 172.21.15.1:0/2955278715 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f61700a3340 0x7f61700a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:29.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.443+0000 7f618c9f9640 1 --2- 172.21.15.1:0/2955278715 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f61700a3340 0x7f61700a5800 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6184009c90 tx=0x7f6184005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:29.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.452+0000 7f617dffb640 1 -- 172.21.15.1:0/2955278715 <== mon.2 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f61800bd860 con 0x7f6188106f10 2024-09-19T09:46:29.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.840+0000 7f618ec5d640 1 -- 172.21.15.1:0/2955278715 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f618810a120 con 0x7f6188106f10 2024-09-19T09:46:29.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.841+0000 7f617dffb640 1 -- 172.21.15.1:0/2955278715 <== mon.2 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11838 (secure 0 0 0) 0x7f61800319a0 con 0x7f6188106f10 2024-09-19T09:46:29.844 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:46:29.844 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T09:44:50:770090+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":16287,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6839/1975960689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":1975960689},{"type":"v1","addr":"172.21.15.121:6839","nonce":1975960689}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:44:50.770010+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24479":{"gid":24479,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:46:29.845 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T09:46:29.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.844+0000 7f618ec5d640 1 -- 172.21.15.1:0/2955278715 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f61700a3340 msgr2=0x7f61700a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:29.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.844+0000 7f618ec5d640 1 --2- 172.21.15.1:0/2955278715 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f61700a3340 0x7f61700a5800 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6184009c90 tx=0x7f6184005f90 comp rx=0 tx=0).stop 2024-09-19T09:46:29.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.844+0000 7f618ec5d640 1 -- 172.21.15.1:0/2955278715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6188106f10 msgr2=0x7f618819ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:29.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.844+0000 7f618ec5d640 1 --2- 172.21.15.1:0/2955278715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6188106f10 0x7f618819ccf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6180005e30 tx=0x7f6180003f10 comp rx=0 tx=0).stop 2024-09-19T09:46:29.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.844+0000 7f618ec5d640 1 -- 172.21.15.1:0/2955278715 shutdown_connections 2024-09-19T09:46:29.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.844+0000 7f618ec5d640 1 --2- 172.21.15.1:0/2955278715 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f61700a3340 0x7f61700a5800 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:29.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.844+0000 7f618ec5d640 1 --2- 172.21.15.1:0/2955278715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6188106f10 0x7f618819ccf0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:29.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.844+0000 7f618ec5d640 1 --2- 172.21.15.1:0/2955278715 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6188102790 0x7f6188198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:29.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.844+0000 7f618ec5d640 1 --2- 172.21.15.1:0/2955278715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6188101de0 0x7f6188198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:29.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.844+0000 7f618ec5d640 1 -- 172.21.15.1:0/2955278715 >> 172.21.15.1:0/2955278715 conn(0x7f61880fd880 msgr2=0x7f61880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:29.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.845+0000 7f618ec5d640 1 -- 172.21.15.1:0/2955278715 shutdown_connections 2024-09-19T09:46:29.848 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:29.845+0000 7f618ec5d640 1 -- 172.21.15.1:0/2955278715 wait complete. 2024-09-19T09:46:30.416 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:30 smithi022 ceph-mon[35583]: pgmap v591: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 3.6 MiB/s wr, 831 op/s 2024-09-19T09:46:30.417 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:30 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/2955278715' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:46:30.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:30 smithi001 ceph-mon[31225]: pgmap v591: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 3.6 MiB/s wr, 831 op/s 2024-09-19T09:46:30.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:30 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/2955278715' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:46:30.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:30 smithi121 ceph-mon[35577]: pgmap v591: 97 pgs: 97 active+clean; 12 GiB data, 37 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 3.6 MiB/s wr, 831 op/s 2024-09-19T09:46:30.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:30 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/2955278715' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:46:31.025 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db --cancel --all' 2024-09-19T09:46:31.026 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db --cancel --all 2024-09-19T09:46:31.444 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:46:31.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.981+0000 7f841342b640 1 -- 172.21.15.1:0/1205462973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f840c100a60 msgr2=0x7f840c100ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:31.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.981+0000 7f841342b640 1 --2- 172.21.15.1:0/1205462973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f840c100a60 0x7f840c100ec0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f83fc00b9f0 tx=0x7f83fc02c0a0 comp rx=0 tx=0).stop 2024-09-19T09:46:31.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.982+0000 7f841342b640 1 -- 172.21.15.1:0/1205462973 shutdown_connections 2024-09-19T09:46:31.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.982+0000 7f841342b640 1 --2- 172.21.15.1:0/1205462973 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f840c101400 0x7f840c10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:31.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.982+0000 7f841342b640 1 --2- 172.21.15.1:0/1205462973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f840c100a60 0x7f840c100ec0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:31.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.982+0000 7f841342b640 1 --2- 172.21.15.1:0/1205462973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f840c106a60 0x7f840c106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:31.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.982+0000 7f841342b640 1 -- 172.21.15.1:0/1205462973 >> 172.21.15.1:0/1205462973 conn(0x7f840c0fc780 msgr2=0x7f840c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:31.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.982+0000 7f841342b640 1 -- 172.21.15.1:0/1205462973 shutdown_connections 2024-09-19T09:46:31.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.982+0000 7f841342b640 1 -- 172.21.15.1:0/1205462973 wait complete. 2024-09-19T09:46:31.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.983+0000 7f841342b640 1 Processor -- start 2024-09-19T09:46:31.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.983+0000 7f841342b640 1 -- start start 2024-09-19T09:46:31.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.984+0000 7f841342b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f840c100a60 0x7f840c10c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:31.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.984+0000 7f841342b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f840c101400 0x7f840c10ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:31.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.984+0000 7f841342b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f840c106a60 0x7f840c1a3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:31.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.984+0000 7f841342b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f840c10fa90 con 0x7f840c106a60 2024-09-19T09:46:31.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.984+0000 7f841342b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f840c10f910 con 0x7f840c101400 2024-09-19T09:46:31.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.984+0000 7f841342b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f840c10fc10 con 0x7f840c100a60 2024-09-19T09:46:31.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.984+0000 7f84119c8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f840c106a60 0x7f840c1a3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:31.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.984+0000 7f84119c8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f840c106a60 0x7f840c1a3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41360/0 (socket says 172.21.15.1:41360) 2024-09-19T09:46:31.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.984+0000 7f84119c8640 1 -- 172.21.15.1:0/1281268194 learned_addr learned my addr 172.21.15.1:0/1281268194 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:31.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.984+0000 7f84109c6640 1 --2- 172.21.15.1:0/1281268194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f840c101400 0x7f840c10ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:31.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.984+0000 7f84111c7640 1 --2- 172.21.15.1:0/1281268194 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f840c100a60 0x7f840c10c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:31.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.984+0000 7f84119c8640 1 -- 172.21.15.1:0/1281268194 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f840c100a60 msgr2=0x7f840c10c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:31.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.984+0000 7f84119c8640 1 --2- 172.21.15.1:0/1281268194 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f840c100a60 0x7f840c10c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:31.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.984+0000 7f84119c8640 1 -- 172.21.15.1:0/1281268194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f840c101400 msgr2=0x7f840c10ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:31.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.984+0000 7f84119c8640 1 --2- 172.21.15.1:0/1281268194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f840c101400 0x7f840c10ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:31.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.984+0000 7f84119c8640 1 -- 172.21.15.1:0/1281268194 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f840c1a3a10 con 0x7f840c106a60 2024-09-19T09:46:31.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.985+0000 7f84119c8640 1 --2- 172.21.15.1:0/1281268194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f840c106a60 0x7f840c1a3330 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f840400eb10 tx=0x7f840400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:31.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.985+0000 7f84027fc640 1 -- 172.21.15.1:0/1281268194 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8404004b20 con 0x7f840c106a60 2024-09-19T09:46:31.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.985+0000 7f841342b640 1 -- 172.21.15.1:0/1281268194 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f840c1a3d00 con 0x7f840c106a60 2024-09-19T09:46:31.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.985+0000 7f841342b640 1 -- 172.21.15.1:0/1281268194 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f840c1ab620 con 0x7f840c106a60 2024-09-19T09:46:31.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.985+0000 7f84027fc640 1 -- 172.21.15.1:0/1281268194 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8404004cc0 con 0x7f840c106a60 2024-09-19T09:46:31.989 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.985+0000 7f84027fc640 1 -- 172.21.15.1:0/1281268194 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8404010760 con 0x7f840c106a60 2024-09-19T09:46:31.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.988+0000 7f84027fc640 1 -- 172.21.15.1:0/1281268194 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f8404005020 con 0x7f840c106a60 2024-09-19T09:46:31.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.989+0000 7f8415804740 1 Processor -- start 2024-09-19T09:46:31.992 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.989+0000 7f8415804740 1 -- start start 2024-09-19T09:46:31.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.989+0000 7f8415804740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7110dba00 0x55c7110dbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:31.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.989+0000 7f8415804740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c7110dc320 0x55c7110e66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:31.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.989+0000 7f8415804740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c7110e6be0 0x55c7110e8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:31.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.989+0000 7f8415804740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c711040200 con 0x55c7110dba00 2024-09-19T09:46:31.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.989+0000 7f8415804740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55c710fe6dc0 con 0x55c7110dc320 2024-09-19T09:46:31.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.989+0000 7f8415804740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c71103c1c0 con 0x55c7110e6be0 2024-09-19T09:46:31.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.989+0000 7f84027fc640 1 --2- 172.21.15.1:0/1281268194 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f83f80a32c0 0x7f83f80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:31.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.990+0000 7f84109c6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7110dba00 0x55c7110dbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:31.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.990+0000 7f84119c8640 1 --2- 172.21.15.1:0/1281268194 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f83f80a32c0 0x7f83f80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:31.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.990+0000 7f84111c7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c7110dc320 0x55c7110e66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:31.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.990+0000 7f84109c6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7110dba00 0x55c7110dbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41374/0 (socket says 172.21.15.1:41374) 2024-09-19T09:46:31.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.990+0000 7f84027fc640 1 -- 172.21.15.1:0/1281268194 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f84040cfd60 con 0x7f840c106a60 2024-09-19T09:46:31.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.990+0000 7f84109c6640 1 -- 172.21.15.1:0/3102865926 learned_addr learned my addr 172.21.15.1:0/3102865926 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:31.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.990+0000 7f84109c6640 1 -- 172.21.15.1:0/3102865926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c7110e6be0 msgr2=0x55c7110e8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:31.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.990+0000 7f84109c6640 1 --2- 172.21.15.1:0/3102865926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c7110e6be0 0x55c7110e8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:31.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.990+0000 7f84109c6640 1 -- 172.21.15.1:0/3102865926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c7110dc320 msgr2=0x55c7110e66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:31.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.990+0000 7f84109c6640 1 --2- 172.21.15.1:0/3102865926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c7110dc320 0x55c7110e66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:31.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.990+0000 7f84109c6640 1 -- 172.21.15.1:0/3102865926 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c710db1620 con 0x55c7110dba00 2024-09-19T09:46:31.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.990+0000 7f84119c8640 1 --2- 172.21.15.1:0/1281268194 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f83f80a32c0 0x7f83f80a5780 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f84040a4ac0 tx=0x7f8404091860 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:31.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.991+0000 7f84109c6640 1 --2- 172.21.15.1:0/3102865926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7110dba00 0x55c7110dbde0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f83fc00b800 tx=0x7f83fc005cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf905f95c0a8350c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:31.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.991+0000 7f83f77fe640 1 -- 172.21.15.1:0/3102865926 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83fc042030 con 0x55c7110dba00 2024-09-19T09:46:31.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.991+0000 7f83f77fe640 1 -- 172.21.15.1:0/3102865926 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83fc0092a0 con 0x55c7110dba00 2024-09-19T09:46:31.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.991+0000 7f83f77fe640 1 -- 172.21.15.1:0/3102865926 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83fc039070 con 0x55c7110dba00 2024-09-19T09:46:32.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.991+0000 7f8415804740 1 -- 172.21.15.1:0/3102865926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7110dba00 msgr2=0x55c7110dbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:32.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.991+0000 7f8415804740 1 --2- 172.21.15.1:0/3102865926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7110dba00 0x55c7110dbde0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f83fc00b800 tx=0x7f83fc005cb0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.992+0000 7f8415804740 1 -- 172.21.15.1:0/3102865926 shutdown_connections 2024-09-19T09:46:32.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.992+0000 7f8415804740 1 --2- 172.21.15.1:0/3102865926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c7110e6be0 0x55c7110e8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.992+0000 7f8415804740 1 --2- 172.21.15.1:0/3102865926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c7110dc320 0x55c7110e66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.992+0000 7f8415804740 1 --2- 172.21.15.1:0/3102865926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7110dba00 0x55c7110dbde0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.992+0000 7f8415804740 1 -- 172.21.15.1:0/3102865926 >> 172.21.15.1:0/3102865926 conn(0x55c7110d7f90 msgr2=0x55c7110d8370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:32.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.992+0000 7f8415804740 1 -- 172.21.15.1:0/3102865926 shutdown_connections 2024-09-19T09:46:32.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.992+0000 7f8415804740 1 -- 172.21.15.1:0/3102865926 wait complete. 2024-09-19T09:46:32.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.992+0000 7f8415804740 1 -- start start 2024-09-19T09:46:32.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.992+0000 7f8415804740 1 Processor -- start 2024-09-19T09:46:32.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.992+0000 7f8415804740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c7110dba00 0x55c7110e6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:32.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.992+0000 7f8415804740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7110dc320 0x55c7110e36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:32.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.993+0000 7f8415804740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c7110e6be0 0x55c7110e3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:32.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.993+0000 7f8415804740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55c7110e97b0 con 0x55c7110dc320 2024-09-19T09:46:32.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.993+0000 7f8415804740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55c710fdac50 con 0x55c7110dba00 2024-09-19T09:46:32.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.993+0000 7f8415804740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c7110e9930 con 0x55c7110e6be0 2024-09-19T09:46:32.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.993+0000 7f8415804740 10 client.0 _ll_register_callbacks cb 0x55c710fecba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:46:32.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.993+0000 7f84111c7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7110dc320 0x55c7110e36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:32.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.993+0000 7f84109c6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c7110dba00 0x55c7110e6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:32.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.993+0000 7f84111c7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7110dc320 0x55c7110e36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41382/0 (socket says 172.21.15.1:41382) 2024-09-19T09:46:32.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.993+0000 7f84111c7640 1 -- 172.21.15.1:0/1277608217 learned_addr learned my addr 172.21.15.1:0/1277608217 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:32.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.993+0000 7f84109c6640 1 --2- 172.21.15.1:0/1277608217 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c7110e6be0 0x55c7110e3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:32.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.993+0000 7f84111c7640 1 -- 172.21.15.1:0/1277608217 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c7110e6be0 msgr2=0x55c7110e3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:32.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.993+0000 7f84111c7640 1 --2- 172.21.15.1:0/1277608217 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c7110e6be0 0x55c7110e3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.993+0000 7f84111c7640 1 -- 172.21.15.1:0/1277608217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c7110dba00 msgr2=0x55c7110e6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:32.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.993+0000 7f84111c7640 1 --2- 172.21.15.1:0/1277608217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c7110dba00 0x55c7110e6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.993+0000 7f84111c7640 1 -- 172.21.15.1:0/1277608217 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7110e4460 con 0x55c7110dc320 2024-09-19T09:46:32.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.993+0000 7f84111c7640 1 --2- 172.21.15.1:0/1277608217 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7110dc320 0x55c7110e36f0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f840800d9a0 tx=0x7f840800de60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380f0e7468c087fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:32.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.993+0000 7f83f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:46:32.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.993+0000 7f83f4ff9640 1 -- 172.21.15.1:0/1277608217 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840801b640 con 0x55c7110dc320 2024-09-19T09:46:32.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.994+0000 7f8415804740 1 -- 172.21.15.1:0/1277608217 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83fc0092a0 con 0x55c7110dc320 2024-09-19T09:46:32.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.994+0000 7f83f4ff9640 1 -- 172.21.15.1:0/1277608217 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f840801b7e0 con 0x55c7110dc320 2024-09-19T09:46:32.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.994+0000 7f83f4ff9640 1 -- 172.21.15.1:0/1277608217 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f840801b9e0 con 0x55c7110dc320 2024-09-19T09:46:32.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.994+0000 7f8415804740 10 client.16500 fetch_fsmap learned FSMap version 21 2024-09-19T09:46:32.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.994+0000 7f8415804740 1 -- 172.21.15.1:0/1277608217 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c7110f53a0 con 0x55c7110dc320 2024-09-19T09:46:32.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.994+0000 7f83f4ff9640 1 -- 172.21.15.1:0/1277608217 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83fc0092a0 con 0x55c7110dc320 2024-09-19T09:46:32.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.994+0000 7f83f4ff9640 1 -- 172.21.15.1:0/1277608217 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8330+0+0 (secure 0 0 0) 0x7f8408019020 con 0x55c7110dc320 2024-09-19T09:46:32.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.994+0000 7f8415804740 10 client.16500 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T09:46:32.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.994+0000 7f8415804740 10 client.16500 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:46:32.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.994+0000 7f8415804740 20 client.16500 populate_metadata read hostname 'smithi001' 2024-09-19T09:46:32.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.994+0000 7f8415804740 1 --2- 172.21.15.1:0/1277608217 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55c7110f6800 0x55c7110f8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:32.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.994+0000 7f8415804740 4 client.16500 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:46:32.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.994+0000 7f8415804740 1 -- 172.21.15.1:0/1277608217 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c71104d770 con 0x55c7110f6800 2024-09-19T09:46:32.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.994+0000 7f84109c6640 1 --2- 172.21.15.1:0/1277608217 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55c7110f6800 0x55c7110f8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:32.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.995+0000 7f83f4ff9640 10 client.16500 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:46:32.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.995+0000 7f84109c6640 1 --2- 172.21.15.1:0/1277608217 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55c7110f6800 0x55c7110f8c10 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59c1ab690cb3aa04 server_cookie=5bc03633e14dabbe in_seq=0 out_seq=0 2024-09-19T09:46:32.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.995+0000 7f83f4ff9640 1 -- 172.21.15.1:0/1277608217 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c71104d770 con 0x55c7110f6800 2024-09-19T09:46:32.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.995+0000 7f83f4ff9640 10 client.16500 handle_command_reply: tid=0 2024-09-19T09:46:32.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.995+0000 7f8415804740 1 client.16500 shutdown 2024-09-19T09:46:32.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.996+0000 7f8415804740 1 -- 172.21.15.1:0/1277608217 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7110dc320 msgr2=0x55c7110e36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:32.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.996+0000 7f8415804740 1 --2- 172.21.15.1:0/1277608217 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7110dc320 0x55c7110e36f0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f840800d9a0 tx=0x7f840800de60 comp rx=0 tx=0).stop 2024-09-19T09:46:32.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.996+0000 7f8415804740 1 -- 172.21.15.1:0/1277608217 shutdown_connections 2024-09-19T09:46:32.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.996+0000 7f8415804740 1 --2- 172.21.15.1:0/1277608217 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55c7110f6800 0x55c7110f8c10 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.996+0000 7f83f4ff9640 0 client.16500 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:46:32.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.996+0000 7f8415804740 1 --2- 172.21.15.1:0/1277608217 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c7110e6be0 0x55c7110e3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.996+0000 7f8415804740 1 --2- 172.21.15.1:0/1277608217 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7110dc320 0x55c7110e36f0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.996+0000 7f8415804740 1 --2- 172.21.15.1:0/1277608217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c7110dba00 0x55c7110e6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.996+0000 7f8415804740 1 -- 172.21.15.1:0/1277608217 >> 172.21.15.1:0/1277608217 conn(0x55c7110d7f90 msgr2=0x55c7110d71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:32.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.996+0000 7f8415804740 1 -- 172.21.15.1:0/1277608217 shutdown_connections 2024-09-19T09:46:32.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.996+0000 7f8415804740 1 -- 172.21.15.1:0/1277608217 wait complete. 2024-09-19T09:46:32.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:31.997+0000 7f8415804740 20 client.16500 trim_cache size 0 max 16384 2024-09-19T09:46:32.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.019+0000 7f8415804740 1 Processor -- start 2024-09-19T09:46:32.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.019+0000 7f8415804740 1 -- start start 2024-09-19T09:46:32.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.019+0000 7f8415804740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7110dba00 0x55c7110e38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:32.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.019+0000 7f8415804740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c7110dc320 0x55c7110f2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:32.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.019+0000 7f8415804740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c7110e6be0 0x55c7110dec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:32.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.019+0000 7f8415804740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f83f000c460 con 0x55c7110dba00 2024-09-19T09:46:32.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.019+0000 7f8415804740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f83f000ed00 con 0x55c7110dc320 2024-09-19T09:46:32.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.019+0000 7f8415804740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f83f000caf0 con 0x55c7110e6be0 2024-09-19T09:46:32.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.019+0000 7f84109c6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7110dba00 0x55c7110e38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:32.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.019+0000 7f84109c6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7110dba00 0x55c7110e38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41392/0 (socket says 172.21.15.1:41392) 2024-09-19T09:46:32.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.019+0000 7f84109c6640 1 -- 172.21.15.1:0/1861508442 learned_addr learned my addr 172.21.15.1:0/1861508442 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:32.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.019+0000 7f84111c7640 1 --2- 172.21.15.1:0/1861508442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c7110dc320 0x55c7110f2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:32.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.019+0000 7f84109c6640 1 --2- 172.21.15.1:0/1861508442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c7110e6be0 0x55c7110dec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:32.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.020+0000 7f84109c6640 1 -- 172.21.15.1:0/1861508442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c7110e6be0 msgr2=0x55c7110dec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:32.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.020+0000 7f84109c6640 1 --2- 172.21.15.1:0/1861508442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c7110e6be0 0x55c7110dec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.020+0000 7f84109c6640 1 -- 172.21.15.1:0/1861508442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c7110dc320 msgr2=0x55c7110f2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:32.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.020+0000 7f84109c6640 1 --2- 172.21.15.1:0/1861508442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c7110dc320 0x55c7110f2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.020+0000 7f84109c6640 1 -- 172.21.15.1:0/1861508442 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7110e26a0 con 0x55c7110dba00 2024-09-19T09:46:32.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.020+0000 7f84109c6640 1 --2- 172.21.15.1:0/1861508442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7110dba00 0x55c7110e38e0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f83fc00b9f0 tx=0x7f83fc005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d770358eb1db15d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:32.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.020+0000 7f83f6ffd640 1 -- 172.21.15.1:0/1861508442 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83fc039040 con 0x55c7110dba00 2024-09-19T09:46:32.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.020+0000 7f83f6ffd640 1 -- 172.21.15.1:0/1861508442 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83fc0092a0 con 0x55c7110dba00 2024-09-19T09:46:32.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.020+0000 7f83f6ffd640 1 -- 172.21.15.1:0/1861508442 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83fc009b30 con 0x55c7110dba00 2024-09-19T09:46:32.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.021+0000 7f8415804740 1 -- 172.21.15.1:0/1861508442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7110dba00 msgr2=0x55c7110e38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:32.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.021+0000 7f8415804740 1 --2- 172.21.15.1:0/1861508442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7110dba00 0x55c7110e38e0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f83fc00b9f0 tx=0x7f83fc005520 comp rx=0 tx=0).stop 2024-09-19T09:46:32.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.021+0000 7f8415804740 1 -- 172.21.15.1:0/1861508442 shutdown_connections 2024-09-19T09:46:32.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.021+0000 7f8415804740 1 --2- 172.21.15.1:0/1861508442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c7110e6be0 0x55c7110dec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.021+0000 7f8415804740 1 --2- 172.21.15.1:0/1861508442 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c7110dc320 0x55c7110f2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.021+0000 7f8415804740 1 --2- 172.21.15.1:0/1861508442 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7110dba00 0x55c7110e38e0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.021+0000 7f8415804740 1 -- 172.21.15.1:0/1861508442 >> 172.21.15.1:0/1861508442 conn(0x55c7110d7f90 msgr2=0x55c7110de500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:32.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.021+0000 7f8415804740 1 -- 172.21.15.1:0/1861508442 shutdown_connections 2024-09-19T09:46:32.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.021+0000 7f8415804740 1 -- 172.21.15.1:0/1861508442 wait complete. 2024-09-19T09:46:32.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.021+0000 7f8415804740 1 -- start start 2024-09-19T09:46:32.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.021+0000 7f8415804740 1 Processor -- start 2024-09-19T09:46:32.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.022+0000 7f8415804740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c7110dba00 0x55c7110eec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:32.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.022+0000 7f8415804740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c7110dc320 0x55c7110ef150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:32.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.022+0000 7f8415804740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7110e6be0 0x55c7110dfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:32.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.022+0000 7f8415804740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f83f000d1c0 con 0x55c7110e6be0 2024-09-19T09:46:32.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.022+0000 7f8415804740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f83f000e630 con 0x55c7110dc320 2024-09-19T09:46:32.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.022+0000 7f8415804740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f83f000d890 con 0x55c7110dba00 2024-09-19T09:46:32.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.022+0000 7f84109c6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c7110dba00 0x55c7110eec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:32.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.022+0000 7f8415804740 10 client.0 _ll_register_callbacks cb 0x7f8408004500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:46:32.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.022+0000 7f84109c6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c7110dba00 0x55c7110eec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.1:53708/0 (socket says 172.21.15.1:53708) 2024-09-19T09:46:32.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.022+0000 7f84109c6640 1 -- 172.21.15.1:0/4291180787 learned_addr learned my addr 172.21.15.1:0/4291180787 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:32.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.022+0000 7f84109c6640 1 --2- 172.21.15.1:0/4291180787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7110e6be0 0x55c7110dfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:32.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.022+0000 7f84111c7640 1 --2- 172.21.15.1:0/4291180787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c7110dc320 0x55c7110ef150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:32.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.022+0000 7f84109c6640 1 -- 172.21.15.1:0/4291180787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c7110dc320 msgr2=0x55c7110ef150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:32.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.022+0000 7f84109c6640 1 --2- 172.21.15.1:0/4291180787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c7110dc320 0x55c7110ef150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.022+0000 7f84109c6640 1 -- 172.21.15.1:0/4291180787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7110e6be0 msgr2=0x55c7110dfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:32.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.022+0000 7f84109c6640 1 --2- 172.21.15.1:0/4291180787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7110e6be0 0x55c7110dfd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.022+0000 7f84109c6640 1 -- 172.21.15.1:0/4291180787 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7110e0310 con 0x55c7110dba00 2024-09-19T09:46:32.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.023+0000 7f84109c6640 1 --2- 172.21.15.1:0/4291180787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c7110dba00 0x55c7110eec10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f83fc009810 tx=0x7f83fc02c0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e208e44763660b83 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:32.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.023+0000 7f83f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-19T09:46:32.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.023+0000 7f83f4ff9640 1 -- 172.21.15.1:0/4291180787 <== mon.1 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83fc057020 con 0x55c7110dba00 2024-09-19T09:46:32.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.023+0000 7f8415804740 1 -- 172.21.15.1:0/4291180787 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83fc0092a0 con 0x55c7110dba00 2024-09-19T09:46:32.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.023+0000 7f83f4ff9640 1 -- 172.21.15.1:0/4291180787 <== mon.1 v2:172.21.15.121:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f83fc004260 con 0x55c7110dba00 2024-09-19T09:46:32.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.023+0000 7f83f4ff9640 1 -- 172.21.15.1:0/4291180787 <== mon.1 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f83fc042040 con 0x55c7110dba00 2024-09-19T09:46:32.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.023+0000 7f8415804740 10 client.25963 fetch_fsmap learned FSMap version 21 2024-09-19T09:46:32.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.023+0000 7f8415804740 1 -- 172.21.15.1:0/4291180787 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c711160d70 con 0x55c7110dba00 2024-09-19T09:46:32.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.023+0000 7f83f4ff9640 1 -- 172.21.15.1:0/4291180787 <== mon.1 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83fc0092a0 con 0x55c7110dba00 2024-09-19T09:46:32.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.023+0000 7f83f4ff9640 1 -- 172.21.15.1:0/4291180787 <== mon.1 v2:172.21.15.121:3300/0 5 ==== fsmap(e 21) ==== 8330+0+0 (secure 0 0 0) 0x7f83fc004a30 con 0x55c7110dba00 2024-09-19T09:46:32.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.023+0000 7f8415804740 10 client.25963 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T09:46:32.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.023+0000 7f8415804740 10 client.25963 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:46:32.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.023+0000 7f8415804740 20 client.25963 populate_metadata read hostname 'smithi001' 2024-09-19T09:46:32.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.023+0000 7f8415804740 1 --2- 172.21.15.1:0/4291180787 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55c7110f6800 0x55c711162f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:32.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.023+0000 7f8415804740 4 client.25963 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-19T09:46:32.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.023+0000 7f8415804740 1 -- 172.21.15.1:0/4291180787 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55c711047c80 con 0x55c7110f6800 2024-09-19T09:46:32.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.024+0000 7f84111c7640 1 --2- 172.21.15.1:0/4291180787 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55c7110f6800 0x55c711162f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:32.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.024+0000 7f84111c7640 1 --2- 172.21.15.1:0/4291180787 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55c7110f6800 0x55c711162f50 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b1aa678f8e56e06 server_cookie=f0480d1ad38c6369 in_seq=0 out_seq=0 2024-09-19T09:46:32.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.024+0000 7f83f4ff9640 10 client.25963 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:46:32.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.024+0000 7f83f4ff9640 1 -- 172.21.15.1:0/4291180787 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x55c711047c80 con 0x55c7110f6800 2024-09-19T09:46:32.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.024+0000 7f83f4ff9640 10 client.25963 handle_command_reply: tid=0 2024-09-19T09:46:32.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.024+0000 7f8415804740 1 client.25963 shutdown 2024-09-19T09:46:32.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.024+0000 7f8415804740 1 -- 172.21.15.1:0/4291180787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c7110dba00 msgr2=0x55c7110eec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:32.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.024+0000 7f8415804740 1 --2- 172.21.15.1:0/4291180787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c7110dba00 0x55c7110eec10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f83fc009810 tx=0x7f83fc02c0a0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.024+0000 7f8415804740 1 -- 172.21.15.1:0/4291180787 shutdown_connections 2024-09-19T09:46:32.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.024+0000 7f8415804740 1 --2- 172.21.15.1:0/4291180787 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x55c7110f6800 0x55c711162f50 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.025+0000 7f8415804740 1 --2- 172.21.15.1:0/4291180787 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55c7110e6be0 0x55c7110dfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.025+0000 7f8415804740 1 --2- 172.21.15.1:0/4291180787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c7110dc320 0x55c7110ef150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.025+0000 7f8415804740 1 --2- 172.21.15.1:0/4291180787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c7110dba00 0x55c7110eec10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.025+0000 7f8415804740 1 -- 172.21.15.1:0/4291180787 >> 172.21.15.1:0/4291180787 conn(0x55c7110d7f90 msgr2=0x55c7110ded20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:32.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.025+0000 7f83f4ff9640 0 client.25963 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:46:32.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.025+0000 7f8415804740 1 -- 172.21.15.1:0/4291180787 shutdown_connections 2024-09-19T09:46:32.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.025+0000 7f8415804740 1 -- 172.21.15.1:0/4291180787 wait complete. 2024-09-19T09:46:32.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.025+0000 7f8415804740 20 client.25963 trim_cache size 0 max 16384 2024-09-19T09:46:32.035 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:46:32.035 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 21, 2024-09-19T09:46:32.035 INFO:teuthology.orchestra.run.smithi001.stdout: "leader": 24497, 2024-09-19T09:46:32.035 INFO:teuthology.orchestra.run.smithi001.stdout: "set_version": 24, 2024-09-19T09:46:32.035 INFO:teuthology.orchestra.run.smithi001.stdout: "sets": {} 2024-09-19T09:46:32.035 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:46:32.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.025+0000 7f841342b640 1 -- 172.21.15.1:0/1281268194 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f83f80a32c0 msgr2=0x7f83f80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:32.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.025+0000 7f841342b640 1 --2- 172.21.15.1:0/1281268194 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f83f80a32c0 0x7f83f80a5780 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f84040a4ac0 tx=0x7f8404091860 comp rx=0 tx=0).stop 2024-09-19T09:46:32.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.025+0000 7f841342b640 1 -- 172.21.15.1:0/1281268194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f840c106a60 msgr2=0x7f840c1a3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:32.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.025+0000 7f841342b640 1 --2- 172.21.15.1:0/1281268194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f840c106a60 0x7f840c1a3330 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f840400eb10 tx=0x7f840400c2d0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.026+0000 7f841342b640 1 -- 172.21.15.1:0/1281268194 shutdown_connections 2024-09-19T09:46:32.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.026+0000 7f841342b640 1 --2- 172.21.15.1:0/1281268194 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f840c106a60 0x7f840c1a3330 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.026+0000 7f841342b640 1 --2- 172.21.15.1:0/1281268194 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f83f80a32c0 0x7f83f80a5780 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.026+0000 7f841342b640 1 --2- 172.21.15.1:0/1281268194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f840c101400 0x7f840c10ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.026+0000 7f841342b640 1 --2- 172.21.15.1:0/1281268194 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f840c100a60 0x7f840c10c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:32.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.026+0000 7f841342b640 1 -- 172.21.15.1:0/1281268194 >> 172.21.15.1:0/1281268194 conn(0x7f840c0fc780 msgr2=0x7f840c102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:32.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.026+0000 7f841342b640 1 -- 172.21.15.1:0/1281268194 shutdown_connections 2024-09-19T09:46:32.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:32.026+0000 7f841342b640 1 -- 172.21.15.1:0/1281268194 wait complete. 2024-09-19T09:46:32.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:32 smithi001 ceph-mon[31225]: pgmap v592: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 7.5 MiB/s wr, 1.70k op/s 2024-09-19T09:46:32.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:32 smithi022 ceph-mon[35583]: pgmap v592: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 7.5 MiB/s wr, 1.70k op/s 2024-09-19T09:46:32.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:32 smithi121 ceph-mon[35577]: pgmap v592: 97 pgs: 97 active+clean; 11 GiB data, 35 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 7.5 MiB/s wr, 1.70k op/s 2024-09-19T09:46:32.873 INFO:tasks.quiescer:done joining Quiescers 2024-09-19T09:46:32.873 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-19T09:46:32.884 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi001.front.sepia.ceph.com 2024-09-19T09:46:32.895 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-19T09:46:32.906 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-19T09:46:34.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:34 smithi001 ceph-mon[31225]: pgmap v593: 97 pgs: 97 active+clean; 9.8 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 7.9 MiB/s wr, 1.83k op/s 2024-09-19T09:46:34.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:34 smithi022 ceph-mon[35583]: pgmap v593: 97 pgs: 97 active+clean; 9.8 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 7.9 MiB/s wr, 1.83k op/s 2024-09-19T09:46:34.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:34 smithi121 ceph-mon[35577]: pgmap v593: 97 pgs: 97 active+clean; 9.8 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 7.9 MiB/s wr, 1.83k op/s 2024-09-19T09:46:36.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:36 smithi001 ceph-mon[31225]: pgmap v594: 97 pgs: 97 active+clean; 8.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 7.9 MiB/s wr, 1.86k op/s 2024-09-19T09:46:36.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:36 smithi022 ceph-mon[35583]: pgmap v594: 97 pgs: 97 active+clean; 8.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 7.9 MiB/s wr, 1.86k op/s 2024-09-19T09:46:36.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:36 smithi121 ceph-mon[35577]: pgmap v594: 97 pgs: 97 active+clean; 8.1 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 7.9 MiB/s wr, 1.86k op/s 2024-09-19T09:46:38.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:38 smithi001 ceph-mon[31225]: pgmap v595: 97 pgs: 97 active+clean; 5.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 7.9 MiB/s wr, 1.91k op/s 2024-09-19T09:46:38.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:38 smithi022 ceph-mon[35583]: pgmap v595: 97 pgs: 97 active+clean; 5.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 7.9 MiB/s wr, 1.91k op/s 2024-09-19T09:46:38.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:38 smithi121 ceph-mon[35577]: pgmap v595: 97 pgs: 97 active+clean; 5.7 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 7.9 MiB/s wr, 1.91k op/s 2024-09-19T09:46:40.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:40 smithi001 ceph-mon[31225]: pgmap v596: 97 pgs: 97 active+clean; 3.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 6.4 MiB/s wr, 1.62k op/s 2024-09-19T09:46:40.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:40 smithi022 ceph-mon[35583]: pgmap v596: 97 pgs: 97 active+clean; 3.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 6.4 MiB/s wr, 1.62k op/s 2024-09-19T09:46:40.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:40 smithi121 ceph-mon[35577]: pgmap v596: 97 pgs: 97 active+clean; 3.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 6.4 MiB/s wr, 1.62k op/s 2024-09-19T09:46:42.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:42 smithi001 ceph-mon[31225]: pgmap v597: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 4.3 MiB/s wr, 1.19k op/s 2024-09-19T09:46:42.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:42 smithi022 ceph-mon[35583]: pgmap v597: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 4.3 MiB/s wr, 1.19k op/s 2024-09-19T09:46:42.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:42 smithi121 ceph-mon[35577]: pgmap v597: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 4.3 MiB/s wr, 1.19k op/s 2024-09-19T09:46:42.888 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:46:43.144 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:46:43.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:43 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:46:43.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:43 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:43.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:43 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:46:43.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:43 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:46:43.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:43 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:46:43.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:43 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:43.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:43 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:46:43.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:43 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:46:43.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:43 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:46:43.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:43 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:46:43.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:43 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:46:43.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:43 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' 2024-09-19T09:46:44.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:44 smithi001 ceph-mon[31225]: pgmap v598: 97 pgs: 97 active+clean; 220 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 458 KiB/s wr, 348 op/s 2024-09-19T09:46:44.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:44 smithi022 ceph-mon[35583]: pgmap v598: 97 pgs: 97 active+clean; 220 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 458 KiB/s wr, 348 op/s 2024-09-19T09:46:44.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:44 smithi121 ceph-mon[35577]: pgmap v598: 97 pgs: 97 active+clean; 220 MiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 458 KiB/s wr, 348 op/s 2024-09-19T09:46:46.450 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:46 smithi001 ceph-mon[31225]: pgmap v599: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 13 KiB/s wr, 236 op/s 2024-09-19T09:46:46.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:46 smithi022 ceph-mon[35583]: pgmap v599: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 13 KiB/s wr, 236 op/s 2024-09-19T09:46:46.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:46 smithi121 ceph-mon[35577]: pgmap v599: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 13 KiB/s wr, 236 op/s 2024-09-19T09:46:48.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:48 smithi001 ceph-mon[31225]: pgmap v600: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 938 B/s wr, 198 op/s 2024-09-19T09:46:48.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:48 smithi022 ceph-mon[35583]: pgmap v600: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 938 B/s wr, 198 op/s 2024-09-19T09:46:48.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:48 smithi121 ceph-mon[35577]: pgmap v600: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 938 B/s wr, 198 op/s 2024-09-19T09:46:49.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.087+0000 7f8760423640 1 -- 172.21.15.1:0/3638790429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8758100e20 msgr2=0x7f8758101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:49.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.087+0000 7f8760423640 1 --2- 172.21.15.1:0/3638790429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8758100e20 0x7f8758101200 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f8754009900 tx=0x7f875402a480 comp rx=0 tx=0).stop 2024-09-19T09:46:49.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.087+0000 7f8760423640 1 -- 172.21.15.1:0/3638790429 shutdown_connections 2024-09-19T09:46:49.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.087+0000 7f8760423640 1 --2- 172.21.15.1:0/3638790429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8758102ef0 0x7f875810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.087+0000 7f8760423640 1 --2- 172.21.15.1:0/3638790429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8758102570 0x7f87581029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.087+0000 7f8760423640 1 --2- 172.21.15.1:0/3638790429 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8758100e20 0x7f8758101200 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.087+0000 7f8760423640 1 -- 172.21.15.1:0/3638790429 >> 172.21.15.1:0/3638790429 conn(0x7f87580fc7d0 msgr2=0x7f87580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:49.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.087+0000 7f8760423640 1 -- 172.21.15.1:0/3638790429 shutdown_connections 2024-09-19T09:46:49.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.087+0000 7f8760423640 1 -- 172.21.15.1:0/3638790429 wait complete. 2024-09-19T09:46:49.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.087+0000 7f8760423640 1 Processor -- start 2024-09-19T09:46:49.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.087+0000 7f8760423640 1 -- start start 2024-09-19T09:46:49.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.088+0000 7f8760423640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8758100e20 0x7f875819a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:49.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.088+0000 7f8760423640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8758102570 0x7f875819abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:49.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.088+0000 7f8760423640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8758102ef0 0x7f875819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:49.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.088+0000 7f8760423640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8758110f50 con 0x7f8758102ef0 2024-09-19T09:46:49.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.088+0000 7f8760423640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8758110dd0 con 0x7f8758102570 2024-09-19T09:46:49.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.088+0000 7f8760423640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f87581110d0 con 0x7f8758100e20 2024-09-19T09:46:49.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.088+0000 7f875e9c0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8758102ef0 0x7f875819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:49.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.088+0000 7f875e9c0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8758102ef0 0x7f875819ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48522/0 (socket says 172.21.15.1:48522) 2024-09-19T09:46:49.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.088+0000 7f875e9c0640 1 -- 172.21.15.1:0/891341065 learned_addr learned my addr 172.21.15.1:0/891341065 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:49.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.088+0000 7f875e1bf640 1 --2- 172.21.15.1:0/891341065 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8758100e20 0x7f875819a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:49.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.088+0000 7f875d9be640 1 --2- 172.21.15.1:0/891341065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8758102570 0x7f875819abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:49.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.088+0000 7f875e9c0640 1 -- 172.21.15.1:0/891341065 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8758100e20 msgr2=0x7f875819a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:49.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.088+0000 7f875e9c0640 1 --2- 172.21.15.1:0/891341065 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8758100e20 0x7f875819a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.088+0000 7f875e9c0640 1 -- 172.21.15.1:0/891341065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8758102570 msgr2=0x7f875819abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:49.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.088+0000 7f875e9c0640 1 --2- 172.21.15.1:0/891341065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8758102570 0x7f875819abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.088+0000 7f875e9c0640 1 -- 172.21.15.1:0/891341065 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f875819f660 con 0x7f8758102ef0 2024-09-19T09:46:49.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.089+0000 7f875e9c0640 1 --2- 172.21.15.1:0/891341065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8758102ef0 0x7f875819ef80 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f875000eaa0 tx=0x7f875000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:49.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.089+0000 7f874f7fe640 1 -- 172.21.15.1:0/891341065 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8750004d20 con 0x7f8758102ef0 2024-09-19T09:46:49.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.089+0000 7f874f7fe640 1 -- 172.21.15.1:0/891341065 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8750005020 con 0x7f8758102ef0 2024-09-19T09:46:49.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.089+0000 7f8760423640 1 -- 172.21.15.1:0/891341065 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f875819f950 con 0x7f8758102ef0 2024-09-19T09:46:49.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.089+0000 7f874f7fe640 1 -- 172.21.15.1:0/891341065 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87500116d0 con 0x7f8758102ef0 2024-09-19T09:46:49.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.089+0000 7f8760423640 1 -- 172.21.15.1:0/891341065 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87581a7230 con 0x7f8758102ef0 2024-09-19T09:46:49.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.091+0000 7f87627fc740 1 Processor -- start 2024-09-19T09:46:49.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.092+0000 7f874f7fe640 1 -- 172.21.15.1:0/891341065 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f87500051d0 con 0x7f8758102ef0 2024-09-19T09:46:49.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.092+0000 7f87627fc740 1 -- start start 2024-09-19T09:46:49.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.092+0000 7f87627fc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b47e954a0 0x556b47e95880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:49.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.092+0000 7f87627fc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b47e95dc0 0x556b47ea0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:49.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.092+0000 7f87627fc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556b47ea0680 0x556b47ea2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:49.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.092+0000 7f87627fc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556b47dfb2e0 con 0x556b47e954a0 2024-09-19T09:46:49.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.092+0000 7f87627fc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556b47da2ce0 con 0x556b47ea0680 2024-09-19T09:46:49.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.092+0000 7f87627fc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x556b47df72a0 con 0x556b47e95dc0 2024-09-19T09:46:49.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.093+0000 7f875d9be640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b47e954a0 0x556b47e95880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:49.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.093+0000 7f875d9be640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b47e954a0 0x556b47e95880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48524/0 (socket says 172.21.15.1:48524) 2024-09-19T09:46:49.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.093+0000 7f875d9be640 1 -- 172.21.15.1:0/4198773928 learned_addr learned my addr 172.21.15.1:0/4198773928 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:49.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.093+0000 7f875e1bf640 1 --2- 172.21.15.1:0/4198773928 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b47e95dc0 0x556b47ea0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:49.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.093+0000 7f875d9be640 1 --2- 172.21.15.1:0/4198773928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556b47ea0680 0x556b47ea2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:49.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.093+0000 7f874f7fe640 1 --2- 172.21.15.1:0/891341065 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f87440a32c0 0x7f87440a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:49.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.093+0000 7f875d9be640 1 -- 172.21.15.1:0/4198773928 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b47e95dc0 msgr2=0x556b47ea0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:49.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.093+0000 7f875d9be640 1 --2- 172.21.15.1:0/4198773928 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b47e95dc0 0x556b47ea0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.093+0000 7f875d9be640 1 -- 172.21.15.1:0/4198773928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556b47ea0680 msgr2=0x556b47ea2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:49.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.093+0000 7f875d9be640 1 --2- 172.21.15.1:0/4198773928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556b47ea0680 0x556b47ea2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.093+0000 7f875d9be640 1 -- 172.21.15.1:0/4198773928 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b47d87440 con 0x556b47e954a0 2024-09-19T09:46:49.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.093+0000 7f875e9c0640 1 --2- 172.21.15.1:0/891341065 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f87440a32c0 0x7f87440a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:49.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.093+0000 7f875d9be640 1 --2- 172.21.15.1:0/4198773928 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b47e954a0 0x556b47e95880 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f87480135e0 tx=0x7f874800a800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aebbec8cac712e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:49.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.093+0000 7f874f7fe640 1 -- 172.21.15.1:0/891341065 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f87500cfa30 con 0x7f8758102ef0 2024-09-19T09:46:49.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.093+0000 7f874cdea640 1 -- 172.21.15.1:0/4198773928 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8748019030 con 0x556b47e954a0 2024-09-19T09:46:49.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.094+0000 7f874cdea640 1 -- 172.21.15.1:0/4198773928 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87480110d0 con 0x556b47e954a0 2024-09-19T09:46:49.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.094+0000 7f874cdea640 1 -- 172.21.15.1:0/4198773928 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874800f850 con 0x556b47e954a0 2024-09-19T09:46:49.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.094+0000 7f87627fc740 1 -- 172.21.15.1:0/4198773928 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b47e954a0 msgr2=0x556b47e95880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:49.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.094+0000 7f87627fc740 1 --2- 172.21.15.1:0/4198773928 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b47e954a0 0x556b47e95880 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f87480135e0 tx=0x7f874800a800 comp rx=0 tx=0).stop 2024-09-19T09:46:49.244 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.094+0000 7f875e9c0640 1 --2- 172.21.15.1:0/891341065 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f87440a32c0 0x7f87440a5780 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f875009bd10 tx=0x7f875001c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:49.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.094+0000 7f87627fc740 1 -- 172.21.15.1:0/4198773928 shutdown_connections 2024-09-19T09:46:49.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.094+0000 7f87627fc740 1 --2- 172.21.15.1:0/4198773928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556b47ea0680 0x556b47ea2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.094+0000 7f87627fc740 1 --2- 172.21.15.1:0/4198773928 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b47e95dc0 0x556b47ea0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.094+0000 7f87627fc740 1 --2- 172.21.15.1:0/4198773928 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b47e954a0 0x556b47e95880 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.094+0000 7f87627fc740 1 -- 172.21.15.1:0/4198773928 >> 172.21.15.1:0/4198773928 conn(0x556b47e91a30 msgr2=0x556b47e91e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:49.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.095+0000 7f87627fc740 1 -- 172.21.15.1:0/4198773928 shutdown_connections 2024-09-19T09:46:49.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.095+0000 7f87627fc740 1 -- 172.21.15.1:0/4198773928 wait complete. 2024-09-19T09:46:49.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.095+0000 7f87627fc740 1 -- start start 2024-09-19T09:46:49.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.095+0000 7f87627fc740 1 Processor -- start 2024-09-19T09:46:49.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.095+0000 7f87627fc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b47e954a0 0x556b47e9fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:49.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.095+0000 7f87627fc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556b47e95dc0 0x556b47e9d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:49.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.095+0000 7f87627fc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b47ea0680 0x556b47e9d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:49.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.095+0000 7f87627fc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x556b47ea3250 con 0x556b47e954a0 2024-09-19T09:46:49.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.095+0000 7f87627fc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556b47db6050 con 0x556b47e95dc0 2024-09-19T09:46:49.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.095+0000 7f87627fc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x556b47ea33d0 con 0x556b47ea0680 2024-09-19T09:46:49.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.095+0000 7f87627fc740 10 client.0 _ll_register_callbacks cb 0x556b47df6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:46:49.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.095+0000 7f875d9be640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b47e954a0 0x556b47e9fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:49.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.095+0000 7f875d9be640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b47e954a0 0x556b47e9fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48526/0 (socket says 172.21.15.1:48526) 2024-09-19T09:46:49.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.095+0000 7f875d9be640 1 -- 172.21.15.1:0/909951703 learned_addr learned my addr 172.21.15.1:0/909951703 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:49.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.095+0000 7f875e1bf640 1 --2- 172.21.15.1:0/909951703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556b47e95dc0 0x556b47e9d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:49.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.096+0000 7f875d9be640 1 --2- 172.21.15.1:0/909951703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b47ea0680 0x556b47e9d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:49.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.096+0000 7f875d9be640 1 -- 172.21.15.1:0/909951703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b47ea0680 msgr2=0x556b47e9d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:49.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.096+0000 7f875d9be640 1 --2- 172.21.15.1:0/909951703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b47ea0680 0x556b47e9d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.096+0000 7f875d9be640 1 -- 172.21.15.1:0/909951703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556b47e95dc0 msgr2=0x556b47e9d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:49.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.096+0000 7f875d9be640 1 --2- 172.21.15.1:0/909951703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556b47e95dc0 0x556b47e9d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.096+0000 7f875d9be640 1 -- 172.21.15.1:0/909951703 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b47b6c3c0 con 0x556b47e954a0 2024-09-19T09:46:49.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.096+0000 7f875d9be640 1 --2- 172.21.15.1:0/909951703 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b47e954a0 0x556b47e9fff0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f8748011330 tx=0x7f8748011280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37cc140a8f3fe711 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:49.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.096+0000 7f8741ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:46:49.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.096+0000 7f8741ffb640 1 -- 172.21.15.1:0/909951703 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8748019040 con 0x556b47e954a0 2024-09-19T09:46:49.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.096+0000 7f8741ffb640 1 -- 172.21.15.1:0/909951703 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f8748005240 con 0x556b47e954a0 2024-09-19T09:46:49.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.096+0000 7f87627fc740 1 -- 172.21.15.1:0/909951703 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87480110d0 con 0x556b47e954a0 2024-09-19T09:46:49.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.096+0000 7f8741ffb640 1 -- 172.21.15.1:0/909951703 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8748032050 con 0x556b47e954a0 2024-09-19T09:46:49.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.096+0000 7f87627fc740 10 client.16518 fetch_fsmap learned FSMap version 21 2024-09-19T09:46:49.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.096+0000 7f87627fc740 1 -- 172.21.15.1:0/909951703 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x556b47eaec20 con 0x556b47e954a0 2024-09-19T09:46:49.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.096+0000 7f8741ffb640 1 -- 172.21.15.1:0/909951703 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87480110d0 con 0x556b47e954a0 2024-09-19T09:46:49.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.097+0000 7f8741ffb640 1 -- 172.21.15.1:0/909951703 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8330+0+0 (secure 0 0 0) 0x7f874800f5d0 con 0x556b47e954a0 2024-09-19T09:46:49.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.097+0000 7f87627fc740 10 client.16518 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T09:46:49.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.097+0000 7f87627fc740 10 client.16518 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:46:49.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.097+0000 7f87627fc740 20 client.16518 populate_metadata read hostname 'smithi001' 2024-09-19T09:46:49.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.097+0000 7f87627fc740 1 --2- 172.21.15.1:0/909951703 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x556b47eaffd0 0x556b47eb23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:49.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.097+0000 7f87627fc740 4 client.16518 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:46:49.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.097+0000 7f87627fc740 1 -- 172.21.15.1:0/909951703 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b47e08850 con 0x556b47eaffd0 2024-09-19T09:46:49.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.097+0000 7f875e1bf640 1 --2- 172.21.15.1:0/909951703 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x556b47eaffd0 0x556b47eb23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:49.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.097+0000 7f8741ffb640 10 client.16518 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:46:49.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.097+0000 7f875e1bf640 1 --2- 172.21.15.1:0/909951703 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x556b47eaffd0 0x556b47eb23c0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5cc56b09d702830 server_cookie=ddaf4bda4880308b in_seq=0 out_seq=0 2024-09-19T09:46:49.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.098+0000 7f8741ffb640 1 -- 172.21.15.1:0/909951703 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556b47e08850 con 0x556b47eaffd0 2024-09-19T09:46:49.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.098+0000 7f8741ffb640 10 client.16518 handle_command_reply: tid=0 2024-09-19T09:46:49.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.098+0000 7f87627fc740 1 client.16518 shutdown 2024-09-19T09:46:49.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.098+0000 7f87627fc740 1 -- 172.21.15.1:0/909951703 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b47e954a0 msgr2=0x556b47e9fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:49.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.098+0000 7f87627fc740 1 --2- 172.21.15.1:0/909951703 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b47e954a0 0x556b47e9fff0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f8748011330 tx=0x7f8748011280 comp rx=0 tx=0).stop 2024-09-19T09:46:49.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.098+0000 7f87627fc740 1 -- 172.21.15.1:0/909951703 shutdown_connections 2024-09-19T09:46:49.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.098+0000 7f87627fc740 1 --2- 172.21.15.1:0/909951703 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x556b47eaffd0 0x556b47eb23c0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.098+0000 7f87627fc740 1 --2- 172.21.15.1:0/909951703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b47ea0680 0x556b47e9d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.098+0000 7f87627fc740 1 --2- 172.21.15.1:0/909951703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556b47e95dc0 0x556b47e9d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.098+0000 7f87627fc740 1 --2- 172.21.15.1:0/909951703 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b47e954a0 0x556b47e9fff0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.098+0000 7f87627fc740 1 -- 172.21.15.1:0/909951703 >> 172.21.15.1:0/909951703 conn(0x556b47e91a30 msgr2=0x556b47e97760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:49.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.098+0000 7f8741ffb640 0 client.16518 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:46:49.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.098+0000 7f87627fc740 1 -- 172.21.15.1:0/909951703 shutdown_connections 2024-09-19T09:46:49.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.098+0000 7f87627fc740 1 -- 172.21.15.1:0/909951703 wait complete. 2024-09-19T09:46:49.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.098+0000 7f87627fc740 20 client.16518 trim_cache size 0 max 16384 2024-09-19T09:46:49.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.116+0000 7f87627fc740 1 Processor -- start 2024-09-19T09:46:49.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.116+0000 7f87627fc740 1 -- start start 2024-09-19T09:46:49.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.116+0000 7f87627fc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556b47e954a0 0x556b47eac4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:49.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.116+0000 7f87627fc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b47e95dc0 0x556b47e9cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:49.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.116+0000 7f87627fc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b47ea0680 0x556b47eb7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:49.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.116+0000 7f87627fc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f87581ad720 con 0x556b47ea0680 2024-09-19T09:46:49.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.116+0000 7f87627fc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f87581affc0 con 0x556b47e954a0 2024-09-19T09:46:49.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.116+0000 7f87627fc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f87581addb0 con 0x556b47e95dc0 2024-09-19T09:46:49.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.116+0000 7f875d9be640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b47ea0680 0x556b47eb7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:49.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.116+0000 7f875d9be640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b47ea0680 0x556b47eb7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48528/0 (socket says 172.21.15.1:48528) 2024-09-19T09:46:49.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.116+0000 7f875d9be640 1 -- 172.21.15.1:0/415757668 learned_addr learned my addr 172.21.15.1:0/415757668 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:49.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.116+0000 7f875d9be640 1 --2- 172.21.15.1:0/415757668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556b47e954a0 0x556b47eac4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:49.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.116+0000 7f875e1bf640 1 --2- 172.21.15.1:0/415757668 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b47e95dc0 0x556b47e9cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:49.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.116+0000 7f875d9be640 1 -- 172.21.15.1:0/415757668 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b47e95dc0 msgr2=0x556b47e9cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:49.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.116+0000 7f875d9be640 1 --2- 172.21.15.1:0/415757668 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b47e95dc0 0x556b47e9cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.116+0000 7f875d9be640 1 -- 172.21.15.1:0/415757668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556b47e954a0 msgr2=0x556b47eac4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:49.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.116+0000 7f875d9be640 1 --2- 172.21.15.1:0/415757668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556b47e954a0 0x556b47eac4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.116+0000 7f875d9be640 1 -- 172.21.15.1:0/415757668 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b47ea0360 con 0x556b47ea0680 2024-09-19T09:46:49.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.117+0000 7f875d9be640 1 --2- 172.21.15.1:0/415757668 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b47ea0680 0x556b47eb7ae0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f8748001eb0 tx=0x7f874800af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef5b4140e2ea7f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:49.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.117+0000 7f8743fff640 1 -- 172.21.15.1:0/415757668 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8748019030 con 0x556b47ea0680 2024-09-19T09:46:49.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.117+0000 7f8743fff640 1 -- 172.21.15.1:0/415757668 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f874800a6f0 con 0x556b47ea0680 2024-09-19T09:46:49.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.117+0000 7f8743fff640 1 -- 172.21.15.1:0/415757668 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874800f790 con 0x556b47ea0680 2024-09-19T09:46:49.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.117+0000 7f87627fc740 1 -- 172.21.15.1:0/415757668 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b47ea0680 msgr2=0x556b47eb7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:49.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.117+0000 7f87627fc740 1 --2- 172.21.15.1:0/415757668 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b47ea0680 0x556b47eb7ae0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f8748001eb0 tx=0x7f874800af50 comp rx=0 tx=0).stop 2024-09-19T09:46:49.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.117+0000 7f87627fc740 1 -- 172.21.15.1:0/415757668 shutdown_connections 2024-09-19T09:46:49.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.117+0000 7f87627fc740 1 --2- 172.21.15.1:0/415757668 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b47ea0680 0x556b47eb7ae0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.117+0000 7f87627fc740 1 --2- 172.21.15.1:0/415757668 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b47e95dc0 0x556b47e9cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.117+0000 7f87627fc740 1 --2- 172.21.15.1:0/415757668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556b47e954a0 0x556b47eac4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.117+0000 7f87627fc740 1 -- 172.21.15.1:0/415757668 >> 172.21.15.1:0/415757668 conn(0x556b47e91a30 msgr2=0x556b47e98900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:49.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.118+0000 7f87627fc740 1 -- 172.21.15.1:0/415757668 shutdown_connections 2024-09-19T09:46:49.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.118+0000 7f87627fc740 1 -- 172.21.15.1:0/415757668 wait complete. 2024-09-19T09:46:49.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.118+0000 7f87627fc740 1 -- start start 2024-09-19T09:46:49.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.118+0000 7f87627fc740 1 Processor -- start 2024-09-19T09:46:49.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.118+0000 7f87627fc740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b47e954a0 0x556b47ea88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:49.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.118+0000 7f87627fc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556b47e95dc0 0x556b47ea8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:49.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.118+0000 7f87627fc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b47ea0680 0x556b47ea3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:49.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.118+0000 7f87627fc740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f87581ae480 con 0x556b47e954a0 2024-09-19T09:46:49.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.118+0000 7f87627fc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f87581af8f0 con 0x556b47e95dc0 2024-09-19T09:46:49.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.118+0000 7f87627fc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f87581aeb50 con 0x556b47ea0680 2024-09-19T09:46:49.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.118+0000 7f87627fc740 10 client.0 _ll_register_callbacks cb 0x7f8754009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:46:49.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.118+0000 7f875d9be640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b47e954a0 0x556b47ea88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:49.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.119+0000 7f875d9be640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b47e954a0 0x556b47ea88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:48540/0 (socket says 172.21.15.1:48540) 2024-09-19T09:46:49.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.119+0000 7f875d9be640 1 -- 172.21.15.1:0/371482496 learned_addr learned my addr 172.21.15.1:0/371482496 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:49.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.119+0000 7f875e1bf640 1 --2- 172.21.15.1:0/371482496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556b47e95dc0 0x556b47ea8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:49.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.119+0000 7f875d9be640 1 -- 172.21.15.1:0/371482496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b47ea0680 msgr2=0x556b47ea3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:49.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.119+0000 7f875d9be640 1 --2- 172.21.15.1:0/371482496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b47ea0680 0x556b47ea3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.119+0000 7f875d9be640 1 -- 172.21.15.1:0/371482496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556b47e95dc0 msgr2=0x556b47ea8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:46:49.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.119+0000 7f875d9be640 1 --2- 172.21.15.1:0/371482496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556b47e95dc0 0x556b47ea8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.119+0000 7f875d9be640 1 -- 172.21.15.1:0/371482496 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b47ea4500 con 0x556b47e954a0 2024-09-19T09:46:49.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.119+0000 7f875d9be640 1 --2- 172.21.15.1:0/371482496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b47e954a0 0x556b47ea88f0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f874800ac30 tx=0x7f87480134d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a2fe68e14d3ab8f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:49.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.119+0000 7f8741ffb640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:46:49.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.119+0000 7f8741ffb640 1 -- 172.21.15.1:0/371482496 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874803b070 con 0x556b47e954a0 2024-09-19T09:46:49.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.119+0000 7f8741ffb640 1 -- 172.21.15.1:0/371482496 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f874800f530 con 0x556b47e954a0 2024-09-19T09:46:49.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.119+0000 7f87627fc740 1 -- 172.21.15.1:0/371482496 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f874800a6f0 con 0x556b47e954a0 2024-09-19T09:46:49.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.119+0000 7f8741ffb640 1 -- 172.21.15.1:0/371482496 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8748047050 con 0x556b47e954a0 2024-09-19T09:46:49.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.119+0000 7f87627fc740 10 client.16524 fetch_fsmap learned FSMap version 21 2024-09-19T09:46:49.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.119+0000 7f87627fc740 1 -- 172.21.15.1:0/371482496 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x556b47f1a640 con 0x556b47e954a0 2024-09-19T09:46:49.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.120+0000 7f8741ffb640 1 -- 172.21.15.1:0/371482496 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f874800a6f0 con 0x556b47e954a0 2024-09-19T09:46:49.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.120+0000 7f8741ffb640 1 -- 172.21.15.1:0/371482496 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8330+0+0 (secure 0 0 0) 0x7f874802ba20 con 0x556b47e954a0 2024-09-19T09:46:49.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.120+0000 7f87627fc740 10 client.16524 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T09:46:49.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.120+0000 7f87627fc740 10 client.16524 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:46:49.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.120+0000 7f87627fc740 20 client.16524 populate_metadata read hostname 'smithi001' 2024-09-19T09:46:49.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.120+0000 7f87627fc740 1 --2- 172.21.15.1:0/371482496 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x556b47f1ad90 0x556b47f1d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:49.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.120+0000 7f87627fc740 4 client.16524 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:46:49.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.120+0000 7f87627fc740 1 -- 172.21.15.1:0/371482496 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556b47e02d60 con 0x556b47f1ad90 2024-09-19T09:46:49.254 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:46:49.254 INFO:teuthology.orchestra.run.smithi001.stdout: "status": "no active scrubs running", 2024-09-19T09:46:49.254 INFO:teuthology.orchestra.run.smithi001.stdout: "scrubs": {} 2024-09-19T09:46:49.254 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:46:49.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.120+0000 7f875e1bf640 1 --2- 172.21.15.1:0/371482496 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x556b47f1ad90 0x556b47f1d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:49.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.121+0000 7f875e1bf640 1 --2- 172.21.15.1:0/371482496 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x556b47f1ad90 0x556b47f1d1b0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7782e148851efb4a server_cookie=e4d78f4ef4a896b5 in_seq=0 out_seq=0 2024-09-19T09:46:49.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.121+0000 7f8741ffb640 10 client.16524 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:46:49.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.121+0000 7f8741ffb640 1 -- 172.21.15.1:0/371482496 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x556b47e02d60 con 0x556b47f1ad90 2024-09-19T09:46:49.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.121+0000 7f8741ffb640 10 client.16524 handle_command_reply: tid=0 2024-09-19T09:46:49.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.121+0000 7f87627fc740 1 client.16524 shutdown 2024-09-19T09:46:49.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.121+0000 7f87627fc740 1 -- 172.21.15.1:0/371482496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b47e954a0 msgr2=0x556b47ea88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:49.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.121+0000 7f87627fc740 1 --2- 172.21.15.1:0/371482496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b47e954a0 0x556b47ea88f0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f874800ac30 tx=0x7f87480134d0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.121+0000 7f87627fc740 1 -- 172.21.15.1:0/371482496 shutdown_connections 2024-09-19T09:46:49.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.121+0000 7f87627fc740 1 --2- 172.21.15.1:0/371482496 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x556b47f1ad90 0x556b47f1d1b0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.121+0000 7f87627fc740 1 --2- 172.21.15.1:0/371482496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b47ea0680 0x556b47ea3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.121+0000 7f87627fc740 1 --2- 172.21.15.1:0/371482496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556b47e95dc0 0x556b47ea8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.121+0000 7f8741ffb640 0 client.16524 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:46:49.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.121+0000 7f87627fc740 1 --2- 172.21.15.1:0/371482496 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x556b47e954a0 0x556b47ea88f0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.121+0000 7f87627fc740 1 -- 172.21.15.1:0/371482496 >> 172.21.15.1:0/371482496 conn(0x556b47e91a30 msgr2=0x556b47e9eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:49.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.121+0000 7f87627fc740 1 -- 172.21.15.1:0/371482496 shutdown_connections 2024-09-19T09:46:49.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.121+0000 7f87627fc740 1 -- 172.21.15.1:0/371482496 wait complete. 2024-09-19T09:46:49.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.121+0000 7f87627fc740 20 client.16524 trim_cache size 0 max 16384 2024-09-19T09:46:49.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.122+0000 7f8760423640 1 -- 172.21.15.1:0/891341065 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f87440a32c0 msgr2=0x7f87440a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:49.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.122+0000 7f8760423640 1 --2- 172.21.15.1:0/891341065 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f87440a32c0 0x7f87440a5780 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f875009bd10 tx=0x7f875001c040 comp rx=0 tx=0).stop 2024-09-19T09:46:49.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.122+0000 7f8760423640 1 -- 172.21.15.1:0/891341065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8758102ef0 msgr2=0x7f875819ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:49.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.122+0000 7f8760423640 1 --2- 172.21.15.1:0/891341065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8758102ef0 0x7f875819ef80 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f875000eaa0 tx=0x7f875000eea0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.122+0000 7f8760423640 1 -- 172.21.15.1:0/891341065 shutdown_connections 2024-09-19T09:46:49.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.122+0000 7f8760423640 1 --2- 172.21.15.1:0/891341065 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8758102ef0 0x7f875819ef80 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.122+0000 7f8760423640 1 --2- 172.21.15.1:0/891341065 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f87440a32c0 0x7f87440a5780 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.122+0000 7f8760423640 1 --2- 172.21.15.1:0/891341065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8758102570 0x7f875819abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.122+0000 7f8760423640 1 --2- 172.21.15.1:0/891341065 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8758100e20 0x7f875819a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:49.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.122+0000 7f8760423640 1 -- 172.21.15.1:0/891341065 >> 172.21.15.1:0/891341065 conn(0x7f87580fc7d0 msgr2=0x7f875806a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:49.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.122+0000 7f8760423640 1 -- 172.21.15.1:0/891341065 shutdown_connections 2024-09-19T09:46:49.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:48.122+0000 7f8760423640 1 -- 172.21.15.1:0/891341065 wait complete. 2024-09-19T09:46:50.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:50 smithi001 ceph-mon[31225]: pgmap v601: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 938 B/s wr, 147 op/s 2024-09-19T09:46:50.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:50 smithi022 ceph-mon[35583]: pgmap v601: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 938 B/s wr, 147 op/s 2024-09-19T09:46:50.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:50 smithi121 ceph-mon[35577]: pgmap v601: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 938 B/s wr, 147 op/s 2024-09-19T09:46:52.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:52 smithi001 ceph-mon[31225]: pgmap v602: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 426 B/s wr, 109 op/s 2024-09-19T09:46:52.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:52 smithi022 ceph-mon[35583]: pgmap v602: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 426 B/s wr, 109 op/s 2024-09-19T09:46:52.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:52 smithi121 ceph-mon[35577]: pgmap v602: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 426 B/s wr, 109 op/s 2024-09-19T09:46:54.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:54 smithi001 ceph-mon[31225]: pgmap v603: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 44 op/s 2024-09-19T09:46:54.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:54 smithi022 ceph-mon[35583]: pgmap v603: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 44 op/s 2024-09-19T09:46:54.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:54 smithi121 ceph-mon[35577]: pgmap v603: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 44 op/s 2024-09-19T09:46:56.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:56 smithi001 ceph-mon[31225]: pgmap v604: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 16 op/s 2024-09-19T09:46:56.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:56 smithi022 ceph-mon[35583]: pgmap v604: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 16 op/s 2024-09-19T09:46:56.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:56 smithi121 ceph-mon[35577]: pgmap v604: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 16 op/s 2024-09-19T09:46:57.336 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:46:57.337 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:46:57.604 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:46:58.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:46:58 smithi001 ceph-mon[31225]: pgmap v605: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:46:58.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:46:58 smithi022 ceph-mon[35583]: pgmap v605: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:46:58.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:46:58 smithi121 ceph-mon[35577]: pgmap v605: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:46:59.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.442+0000 7fddd8b0c640 1 -- 172.21.15.1:0/1455188062 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddd4074eb0 msgr2=0x7fddd4112660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:59.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.442+0000 7fddd8b0c640 1 --2- 172.21.15.1:0/1455188062 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddd4074eb0 0x7fddd4112660 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fddbc009900 tx=0x7fddbc02a480 comp rx=0 tx=0).stop 2024-09-19T09:46:59.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.442+0000 7fddd8b0c640 1 -- 172.21.15.1:0/1455188062 shutdown_connections 2024-09-19T09:46:59.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.442+0000 7fddd8b0c640 1 --2- 172.21.15.1:0/1455188062 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fddd4112ba0 0x7fddd4114f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:59.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.442+0000 7fddd8b0c640 1 --2- 172.21.15.1:0/1455188062 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddd4074eb0 0x7fddd4112660 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:59.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.442+0000 7fddd8b0c640 1 --2- 172.21.15.1:0/1455188062 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddd4074590 0x7fddd4074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:59.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.442+0000 7fddd8b0c640 1 -- 172.21.15.1:0/1455188062 >> 172.21.15.1:0/1455188062 conn(0x7fddd40fd8b0 msgr2=0x7fddd40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:59.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.442+0000 7fddd8b0c640 1 -- 172.21.15.1:0/1455188062 shutdown_connections 2024-09-19T09:46:59.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.442+0000 7fddd8b0c640 1 -- 172.21.15.1:0/1455188062 wait complete. 2024-09-19T09:46:59.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.442+0000 7fddd8b0c640 1 Processor -- start 2024-09-19T09:46:59.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.443+0000 7fddd8b0c640 1 -- start start 2024-09-19T09:46:59.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.443+0000 7fddd8b0c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddd4074590 0x7fddd41a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:59.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.443+0000 7fddd8b0c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fddd4074eb0 0x7fddd41a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:59.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.443+0000 7fddd8b0c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddd4112ba0 0x7fddd419e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:59.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.443+0000 7fddd8b0c640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fddd4118570 con 0x7fddd4112ba0 2024-09-19T09:46:59.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.443+0000 7fddd8b0c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fddd41183f0 con 0x7fddd4074590 2024-09-19T09:46:59.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.443+0000 7fddd8b0c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fddd41186f0 con 0x7fddd4074eb0 2024-09-19T09:46:59.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.443+0000 7fddd2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddd4112ba0 0x7fddd419e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:59.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.443+0000 7fddd2d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddd4112ba0 0x7fddd419e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53900/0 (socket says 172.21.15.1:53900) 2024-09-19T09:46:59.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.443+0000 7fddd2d9d640 1 -- 172.21.15.1:0/231490493 learned_addr learned my addr 172.21.15.1:0/231490493 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:46:59.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.443+0000 7fddcbfff640 1 --2- 172.21.15.1:0/231490493 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fddd4074eb0 0x7fddd41a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:59.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.443+0000 7fddd259c640 1 --2- 172.21.15.1:0/231490493 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddd4074590 0x7fddd41a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:59.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.443+0000 7fddd2d9d640 1 -- 172.21.15.1:0/231490493 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fddd4074eb0 msgr2=0x7fddd41a4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:59.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.443+0000 7fddd2d9d640 1 --2- 172.21.15.1:0/231490493 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fddd4074eb0 0x7fddd41a4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:59.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.443+0000 7fddd2d9d640 1 -- 172.21.15.1:0/231490493 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddd4074590 msgr2=0x7fddd41a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:59.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.443+0000 7fddd2d9d640 1 --2- 172.21.15.1:0/231490493 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddd4074590 0x7fddd41a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:59.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.443+0000 7fddd2d9d640 1 -- 172.21.15.1:0/231490493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd419f000 con 0x7fddd4112ba0 2024-09-19T09:46:59.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.443+0000 7fddd2d9d640 1 --2- 172.21.15.1:0/231490493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddd4112ba0 0x7fddd419e8d0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fddcc00e9d0 tx=0x7fddcc00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:59.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.444+0000 7fddcb7fe640 1 -- 172.21.15.1:0/231490493 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddcc00cd80 con 0x7fddd4112ba0 2024-09-19T09:46:59.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.444+0000 7fddcb7fe640 1 -- 172.21.15.1:0/231490493 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddcc005020 con 0x7fddd4112ba0 2024-09-19T09:46:59.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.444+0000 7fddd8b0c640 1 -- 172.21.15.1:0/231490493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd419f2f0 con 0x7fddd4112ba0 2024-09-19T09:46:59.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.444+0000 7fddcb7fe640 1 -- 172.21.15.1:0/231490493 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddcc0116d0 con 0x7fddd4112ba0 2024-09-19T09:46:59.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.444+0000 7fddd8b0c640 1 -- 172.21.15.1:0/231490493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd41ab5e0 con 0x7fddd4112ba0 2024-09-19T09:46:59.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.445+0000 7fddd8b0c640 1 -- 172.21.15.1:0/231490493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddd4074970 con 0x7fddd4112ba0 2024-09-19T09:46:59.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.446+0000 7fddcb7fe640 1 -- 172.21.15.1:0/231490493 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fddcc0051d0 con 0x7fddd4112ba0 2024-09-19T09:46:59.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.447+0000 7fddcb7fe640 1 --2- 172.21.15.1:0/231490493 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fddc00a3240 0x7fddc00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:46:59.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.447+0000 7fddd259c640 1 --2- 172.21.15.1:0/231490493 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fddc00a3240 0x7fddc00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:46:59.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.447+0000 7fddcb7fe640 1 -- 172.21.15.1:0/231490493 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fddcc0cfe50 con 0x7fddd4112ba0 2024-09-19T09:46:59.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.447+0000 7fddd259c640 1 --2- 172.21.15.1:0/231490493 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fddc00a3240 0x7fddc00a5700 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fddd419fa10 tx=0x7fddc4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:46:59.470 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.451+0000 7fddcb7fe640 1 -- 172.21.15.1:0/231490493 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fddcc016030 con 0x7fddd4112ba0 2024-09-19T09:46:59.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.661+0000 7fddd8b0c640 1 -- 172.21.15.1:0/231490493 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fddd402d7c0 con 0x7fddd4112ba0 2024-09-19T09:46:59.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.661+0000 7fddcb7fe640 1 -- 172.21.15.1:0/231490493 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11838 (secure 0 0 0) 0x7fddcc09cb30 con 0x7fddd4112ba0 2024-09-19T09:46:59.664 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:46:59.664 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T09:44:50:770090+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":16287,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6839/1975960689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":1975960689},{"type":"v1","addr":"172.21.15.121:6839","nonce":1975960689}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:44:50.770010+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24479":{"gid":24479,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:46:59.664 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T09:46:59.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.664+0000 7fddd8b0c640 1 -- 172.21.15.1:0/231490493 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fddc00a3240 msgr2=0x7fddc00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:59.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.664+0000 7fddd8b0c640 1 --2- 172.21.15.1:0/231490493 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fddc00a3240 0x7fddc00a5700 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fddd419fa10 tx=0x7fddc4005f90 comp rx=0 tx=0).stop 2024-09-19T09:46:59.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.664+0000 7fddd8b0c640 1 -- 172.21.15.1:0/231490493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddd4112ba0 msgr2=0x7fddd419e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:46:59.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.664+0000 7fddd8b0c640 1 --2- 172.21.15.1:0/231490493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddd4112ba0 0x7fddd419e8d0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fddcc00e9d0 tx=0x7fddcc00ee90 comp rx=0 tx=0).stop 2024-09-19T09:46:59.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.664+0000 7fddd8b0c640 1 -- 172.21.15.1:0/231490493 shutdown_connections 2024-09-19T09:46:59.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.664+0000 7fddd8b0c640 1 --2- 172.21.15.1:0/231490493 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fddd4112ba0 0x7fddd419e8d0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:59.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.664+0000 7fddd8b0c640 1 --2- 172.21.15.1:0/231490493 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fddd4074eb0 0x7fddd41a4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:59.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.664+0000 7fddd8b0c640 1 --2- 172.21.15.1:0/231490493 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fddc00a3240 0x7fddc00a5700 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:59.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.664+0000 7fddd8b0c640 1 --2- 172.21.15.1:0/231490493 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddd4074590 0x7fddd41a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:46:59.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.664+0000 7fddd8b0c640 1 -- 172.21.15.1:0/231490493 >> 172.21.15.1:0/231490493 conn(0x7fddd40fd8b0 msgr2=0x7fddd40ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:46:59.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.664+0000 7fddd8b0c640 1 -- 172.21.15.1:0/231490493 shutdown_connections 2024-09-19T09:46:59.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:46:59.664+0000 7fddd8b0c640 1 -- 172.21.15.1:0/231490493 wait complete. 2024-09-19T09:47:00.234 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:00 smithi001 ceph-mon[31225]: pgmap v606: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:47:00.234 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:00 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/231490493' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:47:00.265 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:47:00.524 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:47:00.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:00 smithi022 ceph-mon[35583]: pgmap v606: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:47:00.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:00 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/231490493' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:47:00.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:00 smithi121 ceph-mon[35577]: pgmap v606: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:47:00.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:00 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/231490493' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:47:01.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.036+0000 7fe5e6924640 1 -- 172.21.15.1:0/1051602896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5e0102d40 msgr2=0x7fe5e0103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:01.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.036+0000 7fe5e6924640 1 --2- 172.21.15.1:0/1051602896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5e0102d40 0x7fe5e0103120 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0009900 tx=0x7fe5d002a480 comp rx=0 tx=0).stop 2024-09-19T09:47:01.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.036+0000 7fe5e6924640 1 -- 172.21.15.1:0/1051602896 shutdown_connections 2024-09-19T09:47:01.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.036+0000 7fe5e6924640 1 --2- 172.21.15.1:0/1051602896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5e010c170 0x7fe5e010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.036+0000 7fe5e6924640 1 --2- 172.21.15.1:0/1051602896 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5e0103660 0x7fe5e010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.036+0000 7fe5e6924640 1 --2- 172.21.15.1:0/1051602896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5e0102d40 0x7fe5e0103120 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.037+0000 7fe5e6924640 1 -- 172.21.15.1:0/1051602896 >> 172.21.15.1:0/1051602896 conn(0x7fe5e00fc7a0 msgr2=0x7fe5e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:01.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.037+0000 7fe5e6924640 1 -- 172.21.15.1:0/1051602896 shutdown_connections 2024-09-19T09:47:01.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.037+0000 7fe5e6924640 1 -- 172.21.15.1:0/1051602896 wait complete. 2024-09-19T09:47:01.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.037+0000 7fe5e6924640 1 Processor -- start 2024-09-19T09:47:01.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.037+0000 7fe5e6924640 1 -- start start 2024-09-19T09:47:01.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.037+0000 7fe5e6924640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5e0102d40 0x7fe5e0198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:01.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.038+0000 7fe5e6924640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5e0103660 0x7fe5e01989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:01.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.038+0000 7fe5e6924640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5e010c170 0x7fe5e019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:01.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.038+0000 7fe5e6924640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e0111f70 con 0x7fe5e0102d40 2024-09-19T09:47:01.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.038+0000 7fe5e6924640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e0111df0 con 0x7fe5e010c170 2024-09-19T09:47:01.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.038+0000 7fe5e6924640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e01120f0 con 0x7fe5e0103660 2024-09-19T09:47:01.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.038+0000 7fe5dffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5e0102d40 0x7fe5e0198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:01.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.038+0000 7fe5dffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5e0102d40 0x7fe5e0198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53914/0 (socket says 172.21.15.1:53914) 2024-09-19T09:47:01.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.038+0000 7fe5dffff640 1 -- 172.21.15.1:0/1640833771 learned_addr learned my addr 172.21.15.1:0/1640833771 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:47:01.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.038+0000 7fe5e4ec1640 1 --2- 172.21.15.1:0/1640833771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5e010c170 0x7fe5e019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:01.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.038+0000 7fe5df7fe640 1 --2- 172.21.15.1:0/1640833771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5e0103660 0x7fe5e01989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:01.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.038+0000 7fe5dffff640 1 -- 172.21.15.1:0/1640833771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5e0103660 msgr2=0x7fe5e01989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:01.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.038+0000 7fe5dffff640 1 --2- 172.21.15.1:0/1640833771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5e0103660 0x7fe5e01989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.038+0000 7fe5dffff640 1 -- 172.21.15.1:0/1640833771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5e010c170 msgr2=0x7fe5e019cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:01.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.038+0000 7fe5dffff640 1 --2- 172.21.15.1:0/1640833771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5e010c170 0x7fe5e019cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.038+0000 7fe5dffff640 1 -- 172.21.15.1:0/1640833771 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e019d420 con 0x7fe5e0102d40 2024-09-19T09:47:01.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.038+0000 7fe5df7fe640 1 --2- 172.21.15.1:0/1640833771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5e0103660 0x7fe5e01989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:47:01.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.038+0000 7fe5e4ec1640 1 --2- 172.21.15.1:0/1640833771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5e010c170 0x7fe5e019cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:47:01.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.038+0000 7fe5dffff640 1 --2- 172.21.15.1:0/1640833771 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5e0102d40 0x7fe5e0198470 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0006010 tx=0x7fe5d00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:01.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.038+0000 7fe5dd7fa640 1 -- 172.21.15.1:0/1640833771 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d003f030 con 0x7fe5e0102d40 2024-09-19T09:47:01.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.039+0000 7fe5e6924640 1 -- 172.21.15.1:0/1640833771 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5e019d6b0 con 0x7fe5e0102d40 2024-09-19T09:47:01.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.039+0000 7fe5dd7fa640 1 -- 172.21.15.1:0/1640833771 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5d0003ce0 con 0x7fe5e0102d40 2024-09-19T09:47:01.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.039+0000 7fe5dd7fa640 1 -- 172.21.15.1:0/1640833771 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0035070 con 0x7fe5e0102d40 2024-09-19T09:47:01.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.039+0000 7fe5e6924640 1 -- 172.21.15.1:0/1640833771 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5e01a4ff0 con 0x7fe5e0102d40 2024-09-19T09:47:01.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.041+0000 7fe5dd7fa640 1 -- 172.21.15.1:0/1640833771 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fe5d0042030 con 0x7fe5e0102d40 2024-09-19T09:47:01.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.041+0000 7fe5e8cfd740 1 Processor -- start 2024-09-19T09:47:01.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.041+0000 7fe5e8cfd740 1 -- start start 2024-09-19T09:47:01.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.042+0000 7fe5e8cfd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563714e66b40 0x563714e65090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:01.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.042+0000 7fe5e8cfd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563714e655d0 0x563714e65a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:01.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.042+0000 7fe5e8cfd740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563714e74780 0x563714e76b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:01.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.042+0000 7fe5e8cfd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563714dcb2f0 con 0x563714e655d0 2024-09-19T09:47:01.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.042+0000 7fe5e8cfd740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563714d72cf0 con 0x563714e74780 2024-09-19T09:47:01.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.042+0000 7fe5e8cfd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563714dc72b0 con 0x563714e66b40 2024-09-19T09:47:01.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.042+0000 7fe5dd7fa640 1 --2- 172.21.15.1:0/1640833771 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe5c80a3240 0x7fe5c80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:01.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.042+0000 7fe5dffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563714e655d0 0x563714e65a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:01.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.042+0000 7fe5e4ec1640 1 --2- 172.21.15.1:0/1640833771 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe5c80a3240 0x7fe5c80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:01.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.042+0000 7fe5df7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563714e74780 0x563714e76b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:01.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.042+0000 7fe5dffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563714e655d0 0x563714e65a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53920/0 (socket says 172.21.15.1:53920) 2024-09-19T09:47:01.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.042+0000 7fe5dffff640 1 -- 172.21.15.1:0/473012755 learned_addr learned my addr 172.21.15.1:0/473012755 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:47:01.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.042+0000 7fe5e4ec1640 1 --2- 172.21.15.1:0/473012755 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563714e66b40 0x563714e65090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:01.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.042+0000 7fe5dd7fa640 1 -- 172.21.15.1:0/1640833771 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fe5d00efe80 con 0x7fe5e0102d40 2024-09-19T09:47:01.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.042+0000 7fe5dffff640 1 -- 172.21.15.1:0/473012755 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563714e66b40 msgr2=0x563714e65090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:47:01.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.042+0000 7fe5dffff640 1 --2- 172.21.15.1:0/473012755 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563714e66b40 0x563714e65090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.042+0000 7fe5dffff640 1 -- 172.21.15.1:0/473012755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563714e74780 msgr2=0x563714e76b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:47:01.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.042+0000 7fe5dffff640 1 --2- 172.21.15.1:0/473012755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563714e74780 0x563714e76b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.042+0000 7fe5dffff640 1 -- 172.21.15.1:0/473012755 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563714d573a0 con 0x563714e655d0 2024-09-19T09:47:01.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.042+0000 7fe5dffff640 1 --2- 172.21.15.1:0/473012755 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563714e655d0 0x563714e65a10 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fe5d00c4c60 tx=0x7fe5d008f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2997d6d6b90b2aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:01.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.042+0000 7fe5e4ec1640 1 --2- 172.21.15.1:0/1640833771 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe5c80a3240 0x7fe5c80a5700 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8005c40 tx=0x7fe5d8012550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:01.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.043+0000 7fe5c67fc640 1 -- 172.21.15.1:0/473012755 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0049070 con 0x563714e655d0 2024-09-19T09:47:01.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.043+0000 7fe5c67fc640 1 -- 172.21.15.1:0/473012755 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5d003e530 con 0x563714e655d0 2024-09-19T09:47:01.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.043+0000 7fe5c67fc640 1 -- 172.21.15.1:0/473012755 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d00c5190 con 0x563714e655d0 2024-09-19T09:47:01.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.043+0000 7fe5e8cfd740 1 -- 172.21.15.1:0/473012755 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563714e655d0 msgr2=0x563714e65a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:01.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.043+0000 7fe5e8cfd740 1 --2- 172.21.15.1:0/473012755 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563714e655d0 0x563714e65a10 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fe5d00c4c60 tx=0x7fe5d008f510 comp rx=0 tx=0).stop 2024-09-19T09:47:01.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.043+0000 7fe5e8cfd740 1 -- 172.21.15.1:0/473012755 shutdown_connections 2024-09-19T09:47:01.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.043+0000 7fe5e8cfd740 1 --2- 172.21.15.1:0/473012755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563714e74780 0x563714e76b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.043+0000 7fe5e8cfd740 1 --2- 172.21.15.1:0/473012755 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563714e655d0 0x563714e65a10 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.043+0000 7fe5e8cfd740 1 --2- 172.21.15.1:0/473012755 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563714e66b40 0x563714e65090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.043+0000 7fe5e8cfd740 1 -- 172.21.15.1:0/473012755 >> 172.21.15.1:0/473012755 conn(0x563714e2e310 msgr2=0x563714e61c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:01.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.043+0000 7fe5e8cfd740 1 -- 172.21.15.1:0/473012755 shutdown_connections 2024-09-19T09:47:01.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.043+0000 7fe5e8cfd740 1 -- 172.21.15.1:0/473012755 wait complete. 2024-09-19T09:47:01.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.044+0000 7fe5e8cfd740 1 -- start start 2024-09-19T09:47:01.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.044+0000 7fe5e8cfd740 1 Processor -- start 2024-09-19T09:47:01.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.044+0000 7fe5e8cfd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563714e655d0 0x563714e741e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:01.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.044+0000 7fe5e8cfd740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563714e66b40 0x563714e71490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:01.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.044+0000 7fe5e8cfd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563714e74780 0x563714e71c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:01.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.044+0000 7fe5e8cfd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x563714dcb2f0 con 0x563714e655d0 2024-09-19T09:47:01.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.044+0000 7fe5e8cfd740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563714d86060 con 0x563714e66b40 2024-09-19T09:47:01.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.044+0000 7fe5e8cfd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563714e77240 con 0x563714e74780 2024-09-19T09:47:01.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.044+0000 7fe5e8cfd740 10 client.0 _ll_register_callbacks cb 0x563714ad98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:47:01.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.044+0000 7fe5dffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563714e655d0 0x563714e741e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:01.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.044+0000 7fe5dffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563714e655d0 0x563714e741e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53936/0 (socket says 172.21.15.1:53936) 2024-09-19T09:47:01.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.044+0000 7fe5dffff640 1 -- 172.21.15.1:0/3362230976 learned_addr learned my addr 172.21.15.1:0/3362230976 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:47:01.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.044+0000 7fe5df7fe640 1 --2- 172.21.15.1:0/3362230976 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563714e66b40 0x563714e71490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:01.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.044+0000 7fe5e4ec1640 1 --2- 172.21.15.1:0/3362230976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563714e74780 0x563714e71c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:01.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.045+0000 7fe5dffff640 1 -- 172.21.15.1:0/3362230976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563714e74780 msgr2=0x563714e71c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:47:01.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.045+0000 7fe5dffff640 1 --2- 172.21.15.1:0/3362230976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563714e74780 0x563714e71c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.045+0000 7fe5dffff640 1 -- 172.21.15.1:0/3362230976 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563714e66b40 msgr2=0x563714e71490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:47:01.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.045+0000 7fe5dffff640 1 --2- 172.21.15.1:0/3362230976 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563714e66b40 0x563714e71490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.045+0000 7fe5dffff640 1 -- 172.21.15.1:0/3362230976 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563714b3c3c0 con 0x563714e655d0 2024-09-19T09:47:01.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.045+0000 7fe5dffff640 1 --2- 172.21.15.1:0/3362230976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563714e655d0 0x563714e741e0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe5d00bc2d0 tx=0x7fe5d00bc200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21895d0c7c52f0d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:01.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.045+0000 7fe5bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:47:01.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.045+0000 7fe5bf7fe640 1 -- 172.21.15.1:0/3362230976 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0049040 con 0x563714e655d0 2024-09-19T09:47:01.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.045+0000 7fe5bf7fe640 1 -- 172.21.15.1:0/3362230976 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fe5d00b8c40 con 0x563714e655d0 2024-09-19T09:47:01.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.045+0000 7fe5e8cfd740 1 -- 172.21.15.1:0/3362230976 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5d003e530 con 0x563714e655d0 2024-09-19T09:47:01.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.045+0000 7fe5bf7fe640 1 -- 172.21.15.1:0/3362230976 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe5d00044e0 con 0x563714e655d0 2024-09-19T09:47:01.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.045+0000 7fe5e8cfd740 10 client.16542 fetch_fsmap learned FSMap version 21 2024-09-19T09:47:01.076 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.045+0000 7fe5e8cfd740 1 -- 172.21.15.1:0/3362230976 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x563714e82be0 con 0x563714e655d0 2024-09-19T09:47:01.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.045+0000 7fe5bf7fe640 1 -- 172.21.15.1:0/3362230976 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5d003e530 con 0x563714e655d0 2024-09-19T09:47:01.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.046+0000 7fe5bf7fe640 1 -- 172.21.15.1:0/3362230976 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8330+0+0 (secure 0 0 0) 0x7fe5d003e200 con 0x563714e655d0 2024-09-19T09:47:01.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.046+0000 7fe5e8cfd740 10 client.16542 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T09:47:01.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.046+0000 7fe5e8cfd740 10 client.16542 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:47:01.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.046+0000 7fe5e8cfd740 20 client.16542 populate_metadata read hostname 'smithi001' 2024-09-19T09:47:01.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.046+0000 7fe5e8cfd740 1 --2- 172.21.15.1:0/3362230976 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563714e83f30 0x563714e86320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:01.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.046+0000 7fe5e8cfd740 4 client.16542 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:47:01.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.046+0000 7fe5e8cfd740 1 -- 172.21.15.1:0/3362230976 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563714dd8860 con 0x563714e83f30 2024-09-19T09:47:01.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.046+0000 7fe5df7fe640 1 --2- 172.21.15.1:0/3362230976 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563714e83f30 0x563714e86320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:01.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.046+0000 7fe5df7fe640 1 --2- 172.21.15.1:0/3362230976 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563714e83f30 0x563714e86320 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3b995a3ab3b556d server_cookie=280417272908529e in_seq=0 out_seq=0 2024-09-19T09:47:01.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.046+0000 7fe5bf7fe640 10 client.16542 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:47:01.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.047+0000 7fe5bf7fe640 1 -- 172.21.15.1:0/3362230976 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563714dd8860 con 0x563714e83f30 2024-09-19T09:47:01.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.047+0000 7fe5bf7fe640 10 client.16542 handle_command_reply: tid=0 2024-09-19T09:47:01.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.047+0000 7fe5e8cfd740 1 client.16542 shutdown 2024-09-19T09:47:01.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.048+0000 7fe5e8cfd740 1 -- 172.21.15.1:0/3362230976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563714e655d0 msgr2=0x563714e741e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:01.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.048+0000 7fe5e8cfd740 1 --2- 172.21.15.1:0/3362230976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563714e655d0 0x563714e741e0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe5d00bc2d0 tx=0x7fe5d00bc200 comp rx=0 tx=0).stop 2024-09-19T09:47:01.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.048+0000 7fe5e8cfd740 1 -- 172.21.15.1:0/3362230976 shutdown_connections 2024-09-19T09:47:01.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.048+0000 7fe5e8cfd740 1 --2- 172.21.15.1:0/3362230976 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563714e83f30 0x563714e86320 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.048+0000 7fe5e8cfd740 1 --2- 172.21.15.1:0/3362230976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563714e74780 0x563714e71c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.048+0000 7fe5e8cfd740 1 --2- 172.21.15.1:0/3362230976 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563714e66b40 0x563714e71490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.048+0000 7fe5bf7fe640 0 client.16542 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:47:01.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.048+0000 7fe5e8cfd740 1 --2- 172.21.15.1:0/3362230976 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563714e655d0 0x563714e741e0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.048+0000 7fe5e8cfd740 1 -- 172.21.15.1:0/3362230976 >> 172.21.15.1:0/3362230976 conn(0x563714e2e310 msgr2=0x563714e67990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:01.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.048+0000 7fe5e8cfd740 1 -- 172.21.15.1:0/3362230976 shutdown_connections 2024-09-19T09:47:01.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.048+0000 7fe5e8cfd740 1 -- 172.21.15.1:0/3362230976 wait complete. 2024-09-19T09:47:01.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.048+0000 7fe5e8cfd740 20 client.16542 trim_cache size 0 max 16384 2024-09-19T09:47:01.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.061+0000 7fe5e8cfd740 1 Processor -- start 2024-09-19T09:47:01.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.061+0000 7fe5e8cfd740 1 -- start start 2024-09-19T09:47:01.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.061+0000 7fe5e8cfd740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563714e655d0 0x563714e66410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:01.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.061+0000 7fe5e8cfd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563714e66b40 0x563714e61e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:01.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.061+0000 7fe5e8cfd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563714e74780 0x563714e8bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:01.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.061+0000 7fe5e8cfd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e01a9410 con 0x563714e74780 2024-09-19T09:47:01.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.061+0000 7fe5e8cfd740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e01abcb0 con 0x563714e655d0 2024-09-19T09:47:01.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.061+0000 7fe5e8cfd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e01a9aa0 con 0x563714e66b40 2024-09-19T09:47:01.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.061+0000 7fe5dffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563714e655d0 0x563714e66410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:01.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.061+0000 7fe5dffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563714e655d0 0x563714e66410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.1:58620/0 (socket says 172.21.15.1:58620) 2024-09-19T09:47:01.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.061+0000 7fe5e4ec1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563714e74780 0x563714e8bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:01.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.061+0000 7fe5df7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563714e66b40 0x563714e61e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:01.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.061+0000 7fe5dffff640 1 -- 172.21.15.1:0/4063425054 learned_addr learned my addr 172.21.15.1:0/4063425054 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:47:01.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.062+0000 7fe5dffff640 1 -- 172.21.15.1:0/4063425054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563714e66b40 msgr2=0x563714e61e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:47:01.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.062+0000 7fe5dffff640 1 --2- 172.21.15.1:0/4063425054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563714e66b40 0x563714e61e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.062+0000 7fe5dffff640 1 -- 172.21.15.1:0/4063425054 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563714e74780 msgr2=0x563714e8bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:47:01.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.062+0000 7fe5dffff640 1 --2- 172.21.15.1:0/4063425054 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563714e74780 0x563714e8bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.062+0000 7fe5dffff640 1 -- 172.21.15.1:0/4063425054 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563714e86650 con 0x563714e655d0 2024-09-19T09:47:01.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.062+0000 7fe5dffff640 1 --2- 172.21.15.1:0/4063425054 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563714e655d0 0x563714e66410 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe5d00f0170 tx=0x7fe5d0005890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc3709a2d1daa47e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:01.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.062+0000 7fe5c5ffb640 1 -- 172.21.15.1:0/4063425054 <== mon.2 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0049040 con 0x563714e655d0 2024-09-19T09:47:01.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.062+0000 7fe5c5ffb640 1 -- 172.21.15.1:0/4063425054 <== mon.2 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5d00c5190 con 0x563714e655d0 2024-09-19T09:47:01.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.062+0000 7fe5c5ffb640 1 -- 172.21.15.1:0/4063425054 <== mon.2 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d003bbb0 con 0x563714e655d0 2024-09-19T09:47:01.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.063+0000 7fe5e8cfd740 1 -- 172.21.15.1:0/4063425054 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563714e655d0 msgr2=0x563714e66410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:01.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.063+0000 7fe5e8cfd740 1 --2- 172.21.15.1:0/4063425054 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563714e655d0 0x563714e66410 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe5d00f0170 tx=0x7fe5d0005890 comp rx=0 tx=0).stop 2024-09-19T09:47:01.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.063+0000 7fe5e8cfd740 1 -- 172.21.15.1:0/4063425054 shutdown_connections 2024-09-19T09:47:01.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.063+0000 7fe5e8cfd740 1 --2- 172.21.15.1:0/4063425054 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563714e74780 0x563714e8bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.063+0000 7fe5e8cfd740 1 --2- 172.21.15.1:0/4063425054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563714e66b40 0x563714e61e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.063+0000 7fe5e8cfd740 1 --2- 172.21.15.1:0/4063425054 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563714e655d0 0x563714e66410 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.063+0000 7fe5e8cfd740 1 -- 172.21.15.1:0/4063425054 >> 172.21.15.1:0/4063425054 conn(0x563714e2e310 msgr2=0x563714e61700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:01.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.063+0000 7fe5e8cfd740 1 -- 172.21.15.1:0/4063425054 shutdown_connections 2024-09-19T09:47:01.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.063+0000 7fe5e8cfd740 1 -- 172.21.15.1:0/4063425054 wait complete. 2024-09-19T09:47:01.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.063+0000 7fe5e8cfd740 1 -- start start 2024-09-19T09:47:01.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.063+0000 7fe5e8cfd740 1 Processor -- start 2024-09-19T09:47:01.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.064+0000 7fe5e8cfd740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563714e655d0 0x563714e6bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:01.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.064+0000 7fe5e8cfd740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563714e66b40 0x563714e7c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:01.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.064+0000 7fe5e8cfd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563714e74780 0x563714e7ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:01.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.064+0000 7fe5e8cfd740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e01aa170 con 0x563714e655d0 2024-09-19T09:47:01.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.064+0000 7fe5e8cfd740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e01ab5e0 con 0x563714e66b40 2024-09-19T09:47:01.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.064+0000 7fe5e8cfd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e01aa840 con 0x563714e74780 2024-09-19T09:47:01.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.064+0000 7fe5e8cfd740 10 client.0 _ll_register_callbacks cb 0x7fe5d4009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:47:01.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.064+0000 7fe5dffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563714e655d0 0x563714e6bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:01.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.064+0000 7fe5dffff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563714e655d0 0x563714e6bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53958/0 (socket says 172.21.15.1:53958) 2024-09-19T09:47:01.081 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.064+0000 7fe5dffff640 1 -- 172.21.15.1:0/1881677416 learned_addr learned my addr 172.21.15.1:0/1881677416 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:47:01.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.064+0000 7fe5e4ec1640 1 --2- 172.21.15.1:0/1881677416 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563714e74780 0x563714e7ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:01.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.064+0000 7fe5df7fe640 1 --2- 172.21.15.1:0/1881677416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563714e66b40 0x563714e7c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:01.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.064+0000 7fe5dffff640 1 -- 172.21.15.1:0/1881677416 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563714e74780 msgr2=0x563714e7ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:47:01.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.064+0000 7fe5dffff640 1 --2- 172.21.15.1:0/1881677416 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563714e74780 0x563714e7ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.064+0000 7fe5dffff640 1 -- 172.21.15.1:0/1881677416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563714e66b40 msgr2=0x563714e7c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:47:01.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.064+0000 7fe5dffff640 1 --2- 172.21.15.1:0/1881677416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563714e66b40 0x563714e7c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.064+0000 7fe5dffff640 1 -- 172.21.15.1:0/1881677416 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563714e7cfd0 con 0x563714e655d0 2024-09-19T09:47:01.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.064+0000 7fe5dffff640 1 --2- 172.21.15.1:0/1881677416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563714e655d0 0x563714e6bd80 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0005ab0 tx=0x7fe5d00bc420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78563f54eb589140 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:01.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.064+0000 7fe5bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-09-19T09:47:01.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.064+0000 7fe5bf7fe640 1 -- 172.21.15.1:0/1881677416 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0049040 con 0x563714e655d0 2024-09-19T09:47:01.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.064+0000 7fe5bf7fe640 1 -- 172.21.15.1:0/1881677416 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fe5d003bdb0 con 0x563714e655d0 2024-09-19T09:47:01.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.064+0000 7fe5e8cfd740 1 -- 172.21.15.1:0/1881677416 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5d00c5190 con 0x563714e655d0 2024-09-19T09:47:01.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.065+0000 7fe5bf7fe640 1 -- 172.21.15.1:0/1881677416 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe5d00bba20 con 0x563714e655d0 2024-09-19T09:47:01.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.065+0000 7fe5e8cfd740 10 client.16548 fetch_fsmap learned FSMap version 21 2024-09-19T09:47:01.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.065+0000 7fe5e8cfd740 1 -- 172.21.15.1:0/1881677416 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x563714e7cfd0 con 0x563714e655d0 2024-09-19T09:47:01.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.065+0000 7fe5bf7fe640 1 -- 172.21.15.1:0/1881677416 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5d00c5190 con 0x563714e655d0 2024-09-19T09:47:01.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.065+0000 7fe5bf7fe640 1 -- 172.21.15.1:0/1881677416 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 21) ==== 8330+0+0 (secure 0 0 0) 0x7fe5d0031af0 con 0x563714e655d0 2024-09-19T09:47:01.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.065+0000 7fe5e8cfd740 10 client.16548 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T09:47:01.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.065+0000 7fe5e8cfd740 10 client.16548 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:47:01.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.065+0000 7fe5e8cfd740 20 client.16548 populate_metadata read hostname 'smithi001' 2024-09-19T09:47:01.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.065+0000 7fe5e8cfd740 1 --2- 172.21.15.1:0/1881677416 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563714eeace0 0x563714eed0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:01.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.065+0000 7fe5e8cfd740 4 client.16548 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:47:01.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.065+0000 7fe5e8cfd740 1 -- 172.21.15.1:0/1881677416 --> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563714dd2d70 con 0x563714eeace0 2024-09-19T09:47:01.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.065+0000 7fe5df7fe640 1 --2- 172.21.15.1:0/1881677416 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563714eeace0 0x563714eed0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:01.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.066+0000 7fe5df7fe640 1 --2- 172.21.15.1:0/1881677416 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563714eeace0 0x563714eed0d0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5d08ba145bec8df server_cookie=229b118bdace1b9e in_seq=0 out_seq=0 2024-09-19T09:47:01.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.066+0000 7fe5bf7fe640 10 client.16548 ms_handle_connect on v2:172.21.15.22:6838/2513831228 2024-09-19T09:47:01.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.066+0000 7fe5bf7fe640 1 -- 172.21.15.1:0/1881677416 <== mds.0 v2:172.21.15.22:6838/2513831228 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563714dd2d70 con 0x563714eeace0 2024-09-19T09:47:01.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.066+0000 7fe5bf7fe640 10 client.16548 handle_command_reply: tid=0 2024-09-19T09:47:01.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.066+0000 7fe5e8cfd740 1 client.16548 shutdown 2024-09-19T09:47:01.083 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.066+0000 7fe5e8cfd740 1 -- 172.21.15.1:0/1881677416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563714e655d0 msgr2=0x563714e6bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:01.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.066+0000 7fe5e8cfd740 1 --2- 172.21.15.1:0/1881677416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563714e655d0 0x563714e6bd80 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0005ab0 tx=0x7fe5d00bc420 comp rx=0 tx=0).stop 2024-09-19T09:47:01.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.066+0000 7fe5e8cfd740 1 -- 172.21.15.1:0/1881677416 shutdown_connections 2024-09-19T09:47:01.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.066+0000 7fe5e8cfd740 1 --2- 172.21.15.1:0/1881677416 >> [v2:172.21.15.22:6838/2513831228,v1:172.21.15.22:6839/2513831228] conn(0x563714eeace0 0x563714eed0d0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.066+0000 7fe5e8cfd740 1 --2- 172.21.15.1:0/1881677416 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563714e74780 0x563714e7ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.066+0000 7fe5e8cfd740 1 --2- 172.21.15.1:0/1881677416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563714e66b40 0x563714e7c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.066+0000 7fe5bf7fe640 0 client.16548 ms_handle_reset on v2:172.21.15.22:6838/2513831228 2024-09-19T09:47:01.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.066+0000 7fe5e8cfd740 1 --2- 172.21.15.1:0/1881677416 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x563714e655d0 0x563714e6bd80 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.066+0000 7fe5e8cfd740 1 -- 172.21.15.1:0/1881677416 >> 172.21.15.1:0/1881677416 conn(0x563714e2e310 msgr2=0x563714e67110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:01.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.066+0000 7fe5e8cfd740 1 -- 172.21.15.1:0/1881677416 shutdown_connections 2024-09-19T09:47:01.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.066+0000 7fe5e8cfd740 1 -- 172.21.15.1:0/1881677416 wait complete. 2024-09-19T09:47:01.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.066+0000 7fe5e8cfd740 20 client.16548 trim_cache size 0 max 16384 2024-09-19T09:47:01.085 INFO:teuthology.orchestra.run.smithi001.stdout:[] 2024-09-19T09:47:01.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.067+0000 7fe5e6924640 1 -- 172.21.15.1:0/1640833771 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe5c80a3240 msgr2=0x7fe5c80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:01.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.067+0000 7fe5e6924640 1 --2- 172.21.15.1:0/1640833771 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe5c80a3240 0x7fe5c80a5700 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8005c40 tx=0x7fe5d8012550 comp rx=0 tx=0).stop 2024-09-19T09:47:01.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.067+0000 7fe5e6924640 1 -- 172.21.15.1:0/1640833771 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5e0102d40 msgr2=0x7fe5e0198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:01.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.067+0000 7fe5e6924640 1 --2- 172.21.15.1:0/1640833771 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5e0102d40 0x7fe5e0198470 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0006010 tx=0x7fe5d00042f0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.067+0000 7fe5e6924640 1 -- 172.21.15.1:0/1640833771 shutdown_connections 2024-09-19T09:47:01.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.067+0000 7fe5e6924640 1 --2- 172.21.15.1:0/1640833771 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe5c80a3240 0x7fe5c80a5700 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.067+0000 7fe5e6924640 1 --2- 172.21.15.1:0/1640833771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5e010c170 0x7fe5e019cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.067+0000 7fe5e6924640 1 --2- 172.21.15.1:0/1640833771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5e0103660 0x7fe5e01989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.067+0000 7fe5e6924640 1 --2- 172.21.15.1:0/1640833771 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5e0102d40 0x7fe5e0198470 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.067+0000 7fe5e6924640 1 -- 172.21.15.1:0/1640833771 >> 172.21.15.1:0/1640833771 conn(0x7fe5e00fc7a0 msgr2=0x7fe5e00fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:01.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.067+0000 7fe5e6924640 1 -- 172.21.15.1:0/1640833771 shutdown_connections 2024-09-19T09:47:01.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.067+0000 7fe5e6924640 1 -- 172.21.15.1:0/1640833771 wait complete. 2024-09-19T09:47:01.775 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-19T09:47:01.776 INFO:tasks.fwd_scrub:done joining 2024-09-19T09:47:01.776 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-19T09:47:01.786 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:47:01.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.893+0000 7f8b859e4640 1 -- 172.21.15.1:0/798874467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b80101c40 msgr2=0x7f8b801020c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:01.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.893+0000 7f8b859e4640 1 --2- 172.21.15.1:0/798874467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b80101c40 0x7f8b801020c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f8b68009900 tx=0x7f8b6802a410 comp rx=0 tx=0).stop 2024-09-19T09:47:01.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.893+0000 7f8b859e4640 1 -- 172.21.15.1:0/798874467 shutdown_connections 2024-09-19T09:47:01.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.893+0000 7f8b859e4640 1 --2- 172.21.15.1:0/798874467 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b80102600 0x7f8b80108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.893+0000 7f8b859e4640 1 --2- 172.21.15.1:0/798874467 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b80101c40 0x7f8b801020c0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.893+0000 7f8b859e4640 1 --2- 172.21.15.1:0/798874467 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b80100a50 0x7f8b80100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.893+0000 7f8b859e4640 1 -- 172.21.15.1:0/798874467 >> 172.21.15.1:0/798874467 conn(0x7f8b800fc190 msgr2=0x7f8b800fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:01.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.893+0000 7f8b859e4640 1 -- 172.21.15.1:0/798874467 shutdown_connections 2024-09-19T09:47:01.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.893+0000 7f8b859e4640 1 -- 172.21.15.1:0/798874467 wait complete. 2024-09-19T09:47:01.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.894+0000 7f8b859e4640 1 Processor -- start 2024-09-19T09:47:01.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.894+0000 7f8b859e4640 1 -- start start 2024-09-19T09:47:01.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.894+0000 7f8b859e4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b80100a50 0x7f8b8010b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:01.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.894+0000 7f8b859e4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b80101c40 0x7f8b80109a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:01.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.894+0000 7f8b859e4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b80102600 0x7f8b80109f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:01.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.894+0000 7f8b859e4640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8010d820 con 0x7f8b80100a50 2024-09-19T09:47:01.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.894+0000 7f8b859e4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8010d6a0 con 0x7f8b80102600 2024-09-19T09:47:01.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.894+0000 7f8b859e4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8010d9a0 con 0x7f8b80101c40 2024-09-19T09:47:01.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.894+0000 7f8b7effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b80100a50 0x7f8b8010b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:01.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.894+0000 7f8b7effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b80100a50 0x7f8b8010b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53972/0 (socket says 172.21.15.1:53972) 2024-09-19T09:47:01.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.894+0000 7f8b7effd640 1 -- 172.21.15.1:0/1640901869 learned_addr learned my addr 172.21.15.1:0/1640901869 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:47:01.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.894+0000 7f8b7f7fe640 1 --2- 172.21.15.1:0/1640901869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b80102600 0x7f8b80109f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:01.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.894+0000 7f8b7effd640 1 -- 172.21.15.1:0/1640901869 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b80101c40 msgr2=0x7f8b80109a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:01.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.894+0000 7f8b77fff640 1 --2- 172.21.15.1:0/1640901869 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b80101c40 0x7f8b80109a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:01.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.894+0000 7f8b7effd640 1 --2- 172.21.15.1:0/1640901869 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b80101c40 0x7f8b80109a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.894+0000 7f8b7effd640 1 -- 172.21.15.1:0/1640901869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b80102600 msgr2=0x7f8b80109f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:01.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.894+0000 7f8b7effd640 1 --2- 172.21.15.1:0/1640901869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b80102600 0x7f8b80109f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:01.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.894+0000 7f8b7effd640 1 -- 172.21.15.1:0/1640901869 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b8010a7e0 con 0x7f8b80100a50 2024-09-19T09:47:01.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.895+0000 7f8b7effd640 1 --2- 172.21.15.1:0/1640901869 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b80100a50 0x7f8b8010b3d0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f8b7000d950 tx=0x7f8b7000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:01.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.895+0000 7f8b849e2640 1 -- 172.21.15.1:0/1640901869 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b70017020 con 0x7f8b80100a50 2024-09-19T09:47:01.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.895+0000 7f8b849e2640 1 -- 172.21.15.1:0/1640901869 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b70009c30 con 0x7f8b80100a50 2024-09-19T09:47:01.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.895+0000 7f8b859e4640 1 -- 172.21.15.1:0/1640901869 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b801a1f90 con 0x7f8b80100a50 2024-09-19T09:47:01.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.895+0000 7f8b849e2640 1 -- 172.21.15.1:0/1640901869 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7000f740 con 0x7f8b80100a50 2024-09-19T09:47:01.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.895+0000 7f8b859e4640 1 -- 172.21.15.1:0/1640901869 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b801a23f0 con 0x7f8b80100a50 2024-09-19T09:47:01.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.896+0000 7f8b859e4640 1 -- 172.21.15.1:0/1640901869 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b80107e40 con 0x7f8b80100a50 2024-09-19T09:47:01.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.897+0000 7f8b849e2640 1 -- 172.21.15.1:0/1640901869 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f8b7001a020 con 0x7f8b80100a50 2024-09-19T09:47:01.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.898+0000 7f8b849e2640 1 --2- 172.21.15.1:0/1640901869 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f8b6c0a32d0 0x7f8b6c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:01.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.898+0000 7f8b77fff640 1 --2- 172.21.15.1:0/1640901869 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f8b6c0a32d0 0x7f8b6c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:01.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.898+0000 7f8b849e2640 1 -- 172.21.15.1:0/1640901869 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f8b700cf2f0 con 0x7f8b80100a50 2024-09-19T09:47:01.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.898+0000 7f8b77fff640 1 --2- 172.21.15.1:0/1640901869 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f8b6c0a32d0 0x7f8b6c0a5790 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8b68031610 tx=0x7f8b68000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:01.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:01.902+0000 7f8b849e2640 1 -- 172.21.15.1:0/1640901869 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8b70021070 con 0x7f8b80100a50 2024-09-19T09:47:02.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.083+0000 7f8b859e4640 1 -- 172.21.15.1:0/1640901869 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8b80062f70 con 0x7f8b80100a50 2024-09-19T09:47:02.087 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.085+0000 7f8b849e2640 1 -- 172.21.15.1:0/1640901869 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22612 (secure 0 0 0) 0x7f8b70009de0 con 0x7f8b80100a50 2024-09-19T09:47:02.087 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:47:02.087 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":84,"fsid":"57238232-7669-11ef-bceb-c7b262605968","created":"2024-09-19T09:28:28.406983+0000","modified":"2024-09-19T09:44:50.109294+0000","last_up_change":"2024-09-19T09:35:21.422825+0000","last_in_change":"2024-09-19T09:34:57.199184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:31:30.566509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:36:09.521275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:36:11.954337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c165571d-43f1-4c43-ba1e-35872d914f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6803","nonce":502676986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6805","nonce":502676986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6809","nonce":502676986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6807","nonce":502676986}]},"public_addr":"172.21.15.1:6803/502676986","cluster_addr":"172.21.15.1:6805/502676986","heartbeat_back_addr":"172.21.15.1:6809/502676986","heartbeat_front_addr":"172.21.15.1:6807/502676986","state":["exists","up"]},{"osd":1,"uuid":"baf120f8-8ba3-4aa5-a12a-41cdc97ff11b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6801","nonce":3735826323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6803","nonce":3735826323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6807","nonce":3735826323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6805","nonce":3735826323}]},"public_addr":"172.21.15.22:6801/3735826323","cluster_addr":"172.21.15.22:6803/3735826323","heartbeat_back_addr":"172.21.15.22:6807/3735826323","heartbeat_front_addr":"172.21.15.22:6805/3735826323","state":["exists","up"]},{"osd":2,"uuid":"72c520bf-c5cc-44ee-a38c-c9bac0a6280b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6801","nonce":1924970833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6803","nonce":1924970833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6807","nonce":1924970833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6805","nonce":1924970833}]},"public_addr":"172.21.15.121:6801/1924970833","cluster_addr":"172.21.15.121:6803/1924970833","heartbeat_back_addr":"172.21.15.121:6807/1924970833","heartbeat_front_addr":"172.21.15.121:6805/1924970833","state":["exists","up"]},{"osd":3,"uuid":"adad6d17-16d9-4c43-b581-35ac1bb9d807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6811","nonce":1515009793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6813","nonce":1515009793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6817","nonce":1515009793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6815","nonce":1515009793}]},"public_addr":"172.21.15.1:6811/1515009793","cluster_addr":"172.21.15.1:6813/1515009793","heartbeat_back_addr":"172.21.15.1:6817/1515009793","heartbeat_front_addr":"172.21.15.1:6815/1515009793","state":["exists","up"]},{"osd":4,"uuid":"8fb06efe-c3a0-48a3-9730-3e8f3e60922d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6809","nonce":923697266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6811","nonce":923697266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6815","nonce":923697266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6813","nonce":923697266}]},"public_addr":"172.21.15.22:6809/923697266","cluster_addr":"172.21.15.22:6811/923697266","heartbeat_back_addr":"172.21.15.22:6815/923697266","heartbeat_front_addr":"172.21.15.22:6813/923697266","state":["exists","up"]},{"osd":5,"uuid":"3b2f428c-8a5a-49be-9f43-a9f379a1c7e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6809","nonce":3137245658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6811","nonce":3137245658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6815","nonce":3137245658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6813","nonce":3137245658}]},"public_addr":"172.21.15.121:6809/3137245658","cluster_addr":"172.21.15.121:6811/3137245658","heartbeat_back_addr":"172.21.15.121:6815/3137245658","heartbeat_front_addr":"172.21.15.121:6813/3137245658","state":["exists","up"]},{"osd":6,"uuid":"5aecec68-ff7e-440c-bd39-cc35ab89cc91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6819","nonce":3376780798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6821","nonce":3376780798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6825","nonce":3376780798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6823","nonce":3376780798}]},"public_addr":"172.21.15.1:6819/3376780798","cluster_addr":"172.21.15.1:6821/3376780798","heartbeat_back_addr":"172.21.15.1:6825/3376780798","heartbeat_front_addr":"172.21.15.1:6823/3376780798","state":["exists","up"]},{"osd":7,"uuid":"46556bdf-199e-4268-873b-6d87b54e1176","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6817","nonce":2920985295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6819","nonce":2920985295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6823","nonce":2920985295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6821","nonce":2920985295}]},"public_addr":"172.21.15.22:6817/2920985295","cluster_addr":"172.21.15.22:6819/2920985295","heartbeat_back_addr":"172.21.15.22:6823/2920985295","heartbeat_front_addr":"172.21.15.22:6821/2920985295","state":["exists","up"]},{"osd":8,"uuid":"e7c3792a-94a4-4440-be74-d6abdf3d9566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6817","nonce":3589985967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6819","nonce":3589985967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6823","nonce":3589985967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6821","nonce":3589985967}]},"public_addr":"172.21.15.121:6817/3589985967","cluster_addr":"172.21.15.121:6819/3589985967","heartbeat_back_addr":"172.21.15.121:6823/3589985967","heartbeat_front_addr":"172.21.15.121:6821/3589985967","state":["exists","up"]},{"osd":9,"uuid":"8af80ac9-d681-4966-b083-ead5185eff12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6827","nonce":1143859822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6829","nonce":1143859822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6833","nonce":1143859822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6831","nonce":1143859822}]},"public_addr":"172.21.15.1:6827/1143859822","cluster_addr":"172.21.15.1:6829/1143859822","heartbeat_back_addr":"172.21.15.1:6833/1143859822","heartbeat_front_addr":"172.21.15.1:6831/1143859822","state":["exists","up"]},{"osd":10,"uuid":"34edd06a-7f60-4465-bfe1-0c646abd53f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6825","nonce":343155547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6827","nonce":343155547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6831","nonce":343155547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6829","nonce":343155547}]},"public_addr":"172.21.15.22:6825/343155547","cluster_addr":"172.21.15.22:6827/343155547","heartbeat_back_addr":"172.21.15.22:6831/343155547","heartbeat_front_addr":"172.21.15.22:6829/343155547","state":["exists","up"]},{"osd":11,"uuid":"5a831eb6-ad66-4ab6-a30a-b6299ce1f88d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6825","nonce":3202514460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6827","nonce":3202514460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6831","nonce":3202514460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6829","nonce":3202514460}]},"public_addr":"172.21.15.121:6825/3202514460","cluster_addr":"172.21.15.121:6827/3202514460","heartbeat_back_addr":"172.21.15.121:6831/3202514460","heartbeat_front_addr":"172.21.15.121:6829/3202514460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:30:37.582893+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:01.915252+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:26.783477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:53.407014+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:19.407005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:45.022320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:11.377986+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:36.818700+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:01.745428+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:27.928916+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:53.363906+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:19.037551+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6800/1028873727":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/3137949087":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/1951370933":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2008363642":"2024-09-20T09:28:50.074985+0000","172.21.15.1:0/3006931063":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2486161758":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6801/1296304385":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6801/1028873727":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2783823049":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6800/1296304385":"2024-09-20T09:28:50.074985+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:47:02.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.087+0000 7f8b859e4640 1 -- 172.21.15.1:0/1640901869 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f8b6c0a32d0 msgr2=0x7f8b6c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:02.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.087+0000 7f8b859e4640 1 --2- 172.21.15.1:0/1640901869 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f8b6c0a32d0 0x7f8b6c0a5790 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8b68031610 tx=0x7f8b68000bc0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.087+0000 7f8b859e4640 1 -- 172.21.15.1:0/1640901869 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b80100a50 msgr2=0x7f8b8010b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:02.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.087+0000 7f8b859e4640 1 --2- 172.21.15.1:0/1640901869 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b80100a50 0x7f8b8010b3d0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f8b7000d950 tx=0x7f8b7000de10 comp rx=0 tx=0).stop 2024-09-19T09:47:02.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.087+0000 7f8b859e4640 1 -- 172.21.15.1:0/1640901869 shutdown_connections 2024-09-19T09:47:02.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.087+0000 7f8b859e4640 1 --2- 172.21.15.1:0/1640901869 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f8b6c0a32d0 0x7f8b6c0a5790 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.087+0000 7f8b859e4640 1 --2- 172.21.15.1:0/1640901869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b80102600 0x7f8b80109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.087+0000 7f8b859e4640 1 --2- 172.21.15.1:0/1640901869 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b80101c40 0x7f8b80109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.087+0000 7f8b859e4640 1 --2- 172.21.15.1:0/1640901869 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b80100a50 0x7f8b8010b3d0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.087+0000 7f8b859e4640 1 -- 172.21.15.1:0/1640901869 >> 172.21.15.1:0/1640901869 conn(0x7f8b800fc190 msgr2=0x7f8b80105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:02.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.087+0000 7f8b859e4640 1 -- 172.21.15.1:0/1640901869 shutdown_connections 2024-09-19T09:47:02.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.087+0000 7f8b859e4640 1 -- 172.21.15.1:0/1640901869 wait complete. 2024-09-19T09:47:02.100 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T09:31:30.566509+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T09:36:09.521275+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T09:36:11.954337+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T09:47:02.101 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T09:47:02.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.206+0000 7f9396aed640 1 -- 172.21.15.1:0/2219540966 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93901036e0 msgr2=0x7f9390109f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:02.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.206+0000 7f9396aed640 1 --2- 172.21.15.1:0/2219540966 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93901036e0 0x7f9390109f70 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f9388009ca0 tx=0x7f938802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.206+0000 7f9396aed640 1 -- 172.21.15.1:0/2219540966 shutdown_connections 2024-09-19T09:47:02.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.206+0000 7f9396aed640 1 --2- 172.21.15.1:0/2219540966 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93901036e0 0x7f9390109f70 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.206+0000 7f9396aed640 1 --2- 172.21.15.1:0/2219540966 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9390102d20 0x7f93901031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.206+0000 7f9396aed640 1 --2- 172.21.15.1:0/2219540966 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9390101b30 0x7f9390101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.206+0000 7f9396aed640 1 -- 172.21.15.1:0/2219540966 >> 172.21.15.1:0/2219540966 conn(0x7f93900fd2b0 msgr2=0x7f93900ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:02.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.206+0000 7f9396aed640 1 -- 172.21.15.1:0/2219540966 shutdown_connections 2024-09-19T09:47:02.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.206+0000 7f9396aed640 1 -- 172.21.15.1:0/2219540966 wait complete. 2024-09-19T09:47:02.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.206+0000 7f9396aed640 1 Processor -- start 2024-09-19T09:47:02.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.206+0000 7f9396aed640 1 -- start start 2024-09-19T09:47:02.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.206+0000 7f9396aed640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9390101b30 0x7f9390197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:02.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.207+0000 7f9396aed640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9390102d20 0x7f9390198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:02.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.207+0000 7f9396aed640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93901036e0 0x7f939019f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:02.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.207+0000 7f9396aed640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f939010d790 con 0x7f93901036e0 2024-09-19T09:47:02.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.207+0000 7f9396aed640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f939010d610 con 0x7f9390101b30 2024-09-19T09:47:02.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.207+0000 7f9396aed640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f939010d910 con 0x7f9390102d20 2024-09-19T09:47:02.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.207+0000 7f939508a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93901036e0 0x7f939019f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:02.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.207+0000 7f939508a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93901036e0 0x7f939019f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53982/0 (socket says 172.21.15.1:53982) 2024-09-19T09:47:02.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.207+0000 7f939508a640 1 -- 172.21.15.1:0/2589593327 learned_addr learned my addr 172.21.15.1:0/2589593327 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:47:02.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.207+0000 7f938ffff640 1 --2- 172.21.15.1:0/2589593327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9390102d20 0x7f9390198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:02.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.207+0000 7f9394889640 1 --2- 172.21.15.1:0/2589593327 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9390101b30 0x7f9390197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:02.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.207+0000 7f939508a640 1 -- 172.21.15.1:0/2589593327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9390102d20 msgr2=0x7f9390198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:02.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.207+0000 7f939508a640 1 --2- 172.21.15.1:0/2589593327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9390102d20 0x7f9390198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.207+0000 7f939508a640 1 -- 172.21.15.1:0/2589593327 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9390101b30 msgr2=0x7f9390197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:02.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.207+0000 7f939508a640 1 --2- 172.21.15.1:0/2589593327 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9390101b30 0x7f9390197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.207+0000 7f939508a640 1 -- 172.21.15.1:0/2589593327 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f939019fa60 con 0x7f93901036e0 2024-09-19T09:47:02.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.207+0000 7f939508a640 1 --2- 172.21.15.1:0/2589593327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93901036e0 0x7f939019f3f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f9388005e30 tx=0x7f9388031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:02.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.207+0000 7f938dffb640 1 -- 172.21.15.1:0/2589593327 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9388003c30 con 0x7f93901036e0 2024-09-19T09:47:02.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.207+0000 7f9396aed640 1 -- 172.21.15.1:0/2589593327 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f939019fcf0 con 0x7f93901036e0 2024-09-19T09:47:02.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.207+0000 7f938dffb640 1 -- 172.21.15.1:0/2589593327 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9388003dd0 con 0x7f93901036e0 2024-09-19T09:47:02.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.207+0000 7f938dffb640 1 -- 172.21.15.1:0/2589593327 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938802fde0 con 0x7f93901036e0 2024-09-19T09:47:02.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.208+0000 7f9396aed640 1 -- 172.21.15.1:0/2589593327 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93901a01e0 con 0x7f93901036e0 2024-09-19T09:47:02.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.209+0000 7f9396aed640 1 -- 172.21.15.1:0/2589593327 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9390108f20 con 0x7f93901036e0 2024-09-19T09:47:02.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.210+0000 7f938dffb640 1 -- 172.21.15.1:0/2589593327 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f9388004050 con 0x7f93901036e0 2024-09-19T09:47:02.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.211+0000 7f938dffb640 1 --2- 172.21.15.1:0/2589593327 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f93800a3250 0x7f93800a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:02.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.211+0000 7f938dffb640 1 -- 172.21.15.1:0/2589593327 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f93880f0eb0 con 0x7f93901036e0 2024-09-19T09:47:02.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.211+0000 7f9394889640 1 --2- 172.21.15.1:0/2589593327 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f93800a3250 0x7f93800a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:02.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.211+0000 7f9394889640 1 --2- 172.21.15.1:0/2589593327 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f93800a3250 0x7f93800a5710 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9384005fd0 tx=0x7f9384005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:02.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.214+0000 7f938dffb640 1 -- 172.21.15.1:0/2589593327 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f93880bdc20 con 0x7f93901036e0 2024-09-19T09:47:02.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.390+0000 7f9396aed640 1 -- 172.21.15.1:0/2589593327 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9390062df0 con 0x7f93901036e0 2024-09-19T09:47:02.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.390+0000 7f938dffb640 1 -- 172.21.15.1:0/2589593327 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) ==== 93+0+10 (secure 0 0 0) 0x7f93880bd520 con 0x7f93901036e0 2024-09-19T09:47:02.412 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 1 2024-09-19T09:47:02.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.392+0000 7f9396aed640 1 -- 172.21.15.1:0/2589593327 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f93800a3250 msgr2=0x7f93800a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:02.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.392+0000 7f9396aed640 1 --2- 172.21.15.1:0/2589593327 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f93800a3250 0x7f93800a5710 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9384005fd0 tx=0x7f9384005850 comp rx=0 tx=0).stop 2024-09-19T09:47:02.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.392+0000 7f9396aed640 1 -- 172.21.15.1:0/2589593327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93901036e0 msgr2=0x7f939019f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:02.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.392+0000 7f9396aed640 1 --2- 172.21.15.1:0/2589593327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93901036e0 0x7f939019f3f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f9388005e30 tx=0x7f9388031ee0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.392+0000 7f9396aed640 1 -- 172.21.15.1:0/2589593327 shutdown_connections 2024-09-19T09:47:02.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.392+0000 7f9396aed640 1 --2- 172.21.15.1:0/2589593327 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f93901036e0 0x7f939019f3f0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.392+0000 7f9396aed640 1 --2- 172.21.15.1:0/2589593327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9390102d20 0x7f9390198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.392+0000 7f9396aed640 1 --2- 172.21.15.1:0/2589593327 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f93800a3250 0x7f93800a5710 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.392+0000 7f9396aed640 1 --2- 172.21.15.1:0/2589593327 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9390101b30 0x7f9390197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.392+0000 7f9396aed640 1 -- 172.21.15.1:0/2589593327 >> 172.21.15.1:0/2589593327 conn(0x7f93900fd2b0 msgr2=0x7f93901060f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:02.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.392+0000 7f9396aed640 1 -- 172.21.15.1:0/2589593327 shutdown_connections 2024-09-19T09:47:02.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.392+0000 7f9396aed640 1 -- 172.21.15.1:0/2589593327 wait complete. 2024-09-19T09:47:02.415 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:02 smithi001 ceph-mon[31225]: pgmap v607: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:47:02.415 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:02 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1640901869' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:47:02.416 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T09:47:02.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.521+0000 7f3e37559640 1 -- 172.21.15.1:0/2797957329 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e30102650 msgr2=0x7f3e30104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:02.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.521+0000 7f3e37559640 1 --2- 172.21.15.1:0/2797957329 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e30102650 0x7f3e30104a40 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c009900 tx=0x7f3e2c02a410 comp rx=0 tx=0).stop 2024-09-19T09:47:02.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.522+0000 7f3e37559640 1 -- 172.21.15.1:0/2797957329 shutdown_connections 2024-09-19T09:47:02.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.522+0000 7f3e37559640 1 --2- 172.21.15.1:0/2797957329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e301078b0 0x7f3e30109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.522+0000 7f3e37559640 1 --2- 172.21.15.1:0/2797957329 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e30104f80 0x7f3e30107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.522+0000 7f3e37559640 1 --2- 172.21.15.1:0/2797957329 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e30102650 0x7f3e30104a40 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.522+0000 7f3e37559640 1 -- 172.21.15.1:0/2797957329 >> 172.21.15.1:0/2797957329 conn(0x7f3e300fc190 msgr2=0x7f3e300fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:02.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.522+0000 7f3e37559640 1 -- 172.21.15.1:0/2797957329 shutdown_connections 2024-09-19T09:47:02.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.522+0000 7f3e37559640 1 -- 172.21.15.1:0/2797957329 wait complete. 2024-09-19T09:47:02.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.522+0000 7f3e37559640 1 Processor -- start 2024-09-19T09:47:02.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.522+0000 7f3e37559640 1 -- start start 2024-09-19T09:47:02.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.522+0000 7f3e37559640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e30102650 0x7f3e30101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:02.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.522+0000 7f3e37559640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e30104f80 0x7f3e30100600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:02.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.522+0000 7f3e37559640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e301078b0 0x7f3e30100b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:02.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.522+0000 7f3e37559640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3010d7f0 con 0x7f3e30104f80 2024-09-19T09:47:02.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.522+0000 7f3e37559640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3010d670 con 0x7f3e301078b0 2024-09-19T09:47:02.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.522+0000 7f3e37559640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3010d970 con 0x7f3e30102650 2024-09-19T09:47:02.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.522+0000 7f3e34af4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e30104f80 0x7f3e30100600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:02.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.522+0000 7f3e34af4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e30104f80 0x7f3e30100600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:53998/0 (socket says 172.21.15.1:53998) 2024-09-19T09:47:02.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.522+0000 7f3e34af4640 1 -- 172.21.15.1:0/3386481434 learned_addr learned my addr 172.21.15.1:0/3386481434 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:47:02.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.523+0000 7f3e35af6640 1 --2- 172.21.15.1:0/3386481434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e301078b0 0x7f3e30100b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:02.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.523+0000 7f3e34af4640 1 -- 172.21.15.1:0/3386481434 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e30102650 msgr2=0x7f3e30101fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:02.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.523+0000 7f3e34af4640 1 --2- 172.21.15.1:0/3386481434 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e30102650 0x7f3e30101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.523+0000 7f3e34af4640 1 -- 172.21.15.1:0/3386481434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e301078b0 msgr2=0x7f3e30100b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:02.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.523+0000 7f3e34af4640 1 --2- 172.21.15.1:0/3386481434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e301078b0 0x7f3e30100b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.523+0000 7f3e34af4640 1 -- 172.21.15.1:0/3386481434 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e301013d0 con 0x7f3e30104f80 2024-09-19T09:47:02.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.523+0000 7f3e34af4640 1 --2- 172.21.15.1:0/3386481434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e30104f80 0x7f3e30100600 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f3e2000d740 tx=0x7f3e2000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:02.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.523+0000 7f3e267fc640 1 -- 172.21.15.1:0/3386481434 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e20017070 con 0x7f3e30104f80 2024-09-19T09:47:02.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.523+0000 7f3e267fc640 1 -- 172.21.15.1:0/3386481434 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e2000de50 con 0x7f3e30104f80 2024-09-19T09:47:02.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.523+0000 7f3e37559640 1 -- 172.21.15.1:0/3386481434 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e301a1fa0 con 0x7f3e30104f80 2024-09-19T09:47:02.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.523+0000 7f3e267fc640 1 -- 172.21.15.1:0/3386481434 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e20004e00 con 0x7f3e30104f80 2024-09-19T09:47:02.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.523+0000 7f3e37559640 1 -- 172.21.15.1:0/3386481434 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e301a2460 con 0x7f3e30104f80 2024-09-19T09:47:02.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.524+0000 7f3e37559640 1 -- 172.21.15.1:0/3386481434 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e300fdc80 con 0x7f3e30104f80 2024-09-19T09:47:02.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.525+0000 7f3e267fc640 1 -- 172.21.15.1:0/3386481434 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f3e20004fa0 con 0x7f3e30104f80 2024-09-19T09:47:02.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.526+0000 7f3e267fc640 1 --2- 172.21.15.1:0/3386481434 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3e1c0a32d0 0x7f3e1c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:02.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.527+0000 7f3e352f5640 1 --2- 172.21.15.1:0/3386481434 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3e1c0a32d0 0x7f3e1c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:02.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.527+0000 7f3e267fc640 1 -- 172.21.15.1:0/3386481434 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f3e200cf340 con 0x7f3e30104f80 2024-09-19T09:47:02.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.527+0000 7f3e352f5640 1 --2- 172.21.15.1:0/3386481434 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3e1c0a32d0 0x7f3e1c0a5790 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c0096c0 tx=0x7f3e2c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:02.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.531+0000 7f3e267fc640 1 -- 172.21.15.1:0/3386481434 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3e2009c020 con 0x7f3e30104f80 2024-09-19T09:47:02.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:02 smithi022 ceph-mon[35583]: pgmap v607: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:47:02.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:02 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1640901869' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:47:02.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:02 smithi121 ceph-mon[35577]: pgmap v607: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:47:02.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:02 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1640901869' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:47:02.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.711+0000 7f3e37559640 1 -- 172.21.15.1:0/3386481434 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3e30062df0 con 0x7f3e30104f80 2024-09-19T09:47:02.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.711+0000 7f3e267fc640 1 -- 172.21.15.1:0/3386481434 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) ==== 104+0+11 (secure 0 0 0) 0x7f3e200860f0 con 0x7f3e30104f80 2024-09-19T09:47:02.713 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 32 2024-09-19T09:47:02.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.714+0000 7f3e37559640 1 -- 172.21.15.1:0/3386481434 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3e1c0a32d0 msgr2=0x7f3e1c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:02.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.714+0000 7f3e37559640 1 --2- 172.21.15.1:0/3386481434 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3e1c0a32d0 0x7f3e1c0a5790 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c0096c0 tx=0x7f3e2c031400 comp rx=0 tx=0).stop 2024-09-19T09:47:02.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.714+0000 7f3e37559640 1 -- 172.21.15.1:0/3386481434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e30104f80 msgr2=0x7f3e30100600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:02.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.714+0000 7f3e37559640 1 --2- 172.21.15.1:0/3386481434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e30104f80 0x7f3e30100600 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f3e2000d740 tx=0x7f3e2000dc00 comp rx=0 tx=0).stop 2024-09-19T09:47:02.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.714+0000 7f3e37559640 1 -- 172.21.15.1:0/3386481434 shutdown_connections 2024-09-19T09:47:02.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.714+0000 7f3e37559640 1 --2- 172.21.15.1:0/3386481434 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3e1c0a32d0 0x7f3e1c0a5790 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.714+0000 7f3e37559640 1 --2- 172.21.15.1:0/3386481434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e301078b0 0x7f3e30100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.714+0000 7f3e37559640 1 --2- 172.21.15.1:0/3386481434 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3e30104f80 0x7f3e30100600 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.714+0000 7f3e37559640 1 --2- 172.21.15.1:0/3386481434 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3e30102650 0x7f3e30101fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.714+0000 7f3e37559640 1 -- 172.21.15.1:0/3386481434 >> 172.21.15.1:0/3386481434 conn(0x7f3e300fc190 msgr2=0x7f3e30102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:02.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.714+0000 7f3e37559640 1 -- 172.21.15.1:0/3386481434 shutdown_connections 2024-09-19T09:47:02.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.714+0000 7f3e37559640 1 -- 172.21.15.1:0/3386481434 wait complete. 2024-09-19T09:47:02.727 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T09:47:02.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.833+0000 7f69ff065640 1 -- 172.21.15.1:0/979376943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69f8102d10 msgr2=0x7f69f8103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:02.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.833+0000 7f69ff065640 1 --2- 172.21.15.1:0/979376943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69f8102d10 0x7f69f8103190 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f69e0009900 tx=0x7f69e002a410 comp rx=0 tx=0).stop 2024-09-19T09:47:02.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.833+0000 7f69ff065640 1 -- 172.21.15.1:0/979376943 shutdown_connections 2024-09-19T09:47:02.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.833+0000 7f69ff065640 1 --2- 172.21.15.1:0/979376943 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69f81036d0 0x7f69f8109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.833+0000 7f69ff065640 1 --2- 172.21.15.1:0/979376943 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69f8102d10 0x7f69f8103190 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.833+0000 7f69ff065640 1 --2- 172.21.15.1:0/979376943 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69f8101b20 0x7f69f8101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.833+0000 7f69ff065640 1 -- 172.21.15.1:0/979376943 >> 172.21.15.1:0/979376943 conn(0x7f69f80fd2a0 msgr2=0x7f69f80ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:02.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.833+0000 7f69ff065640 1 -- 172.21.15.1:0/979376943 shutdown_connections 2024-09-19T09:47:02.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.833+0000 7f69ff065640 1 -- 172.21.15.1:0/979376943 wait complete. 2024-09-19T09:47:02.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.833+0000 7f69ff065640 1 Processor -- start 2024-09-19T09:47:02.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.834+0000 7f69ff065640 1 -- start start 2024-09-19T09:47:02.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.834+0000 7f69ff065640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69f8101b20 0x7f69f8197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:02.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.834+0000 7f69ff065640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69f8102d10 0x7f69f8198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:02.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.834+0000 7f69ff065640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69f81036d0 0x7f69f819f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:02.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.834+0000 7f69ff065640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f69f810d7f0 con 0x7f69f81036d0 2024-09-19T09:47:02.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.834+0000 7f69ff065640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f69f810d670 con 0x7f69f8101b20 2024-09-19T09:47:02.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.834+0000 7f69ff065640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f69f810d970 con 0x7f69f8102d10 2024-09-19T09:47:02.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.834+0000 7f69fd602640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69f81036d0 0x7f69f819f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:02.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.834+0000 7f69fd602640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69f81036d0 0x7f69f819f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54020/0 (socket says 172.21.15.1:54020) 2024-09-19T09:47:02.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.834+0000 7f69fd602640 1 -- 172.21.15.1:0/3247812158 learned_addr learned my addr 172.21.15.1:0/3247812158 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:47:02.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.834+0000 7f69fce01640 1 --2- 172.21.15.1:0/3247812158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69f8101b20 0x7f69f8197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:02.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.834+0000 7f69f7fff640 1 --2- 172.21.15.1:0/3247812158 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69f8102d10 0x7f69f8198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:02.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.834+0000 7f69fd602640 1 -- 172.21.15.1:0/3247812158 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69f8102d10 msgr2=0x7f69f8198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:02.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.834+0000 7f69fd602640 1 --2- 172.21.15.1:0/3247812158 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69f8102d10 0x7f69f8198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.834+0000 7f69fd602640 1 -- 172.21.15.1:0/3247812158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69f8101b20 msgr2=0x7f69f8197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:02.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.834+0000 7f69fd602640 1 --2- 172.21.15.1:0/3247812158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69f8101b20 0x7f69f8197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:02.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.834+0000 7f69fd602640 1 -- 172.21.15.1:0/3247812158 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f819fa60 con 0x7f69f81036d0 2024-09-19T09:47:02.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.834+0000 7f69fce01640 1 --2- 172.21.15.1:0/3247812158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69f8101b20 0x7f69f8197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:47:02.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.834+0000 7f69f7fff640 1 --2- 172.21.15.1:0/3247812158 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69f8102d10 0x7f69f8198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:47:02.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.834+0000 7f69fd602640 1 --2- 172.21.15.1:0/3247812158 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69f81036d0 0x7f69f819f3f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f69f000d750 tx=0x7f69f000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:02.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.834+0000 7f69f5ffb640 1 -- 172.21.15.1:0/3247812158 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f0017070 con 0x7f69f81036d0 2024-09-19T09:47:02.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.835+0000 7f69f5ffb640 1 -- 172.21.15.1:0/3247812158 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69f0005500 con 0x7f69f81036d0 2024-09-19T09:47:02.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.835+0000 7f69ff065640 1 -- 172.21.15.1:0/3247812158 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f819fd50 con 0x7f69f81036d0 2024-09-19T09:47:02.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.835+0000 7f69f5ffb640 1 -- 172.21.15.1:0/3247812158 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f0004d90 con 0x7f69f81036d0 2024-09-19T09:47:02.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.835+0000 7f69ff065640 1 -- 172.21.15.1:0/3247812158 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f81a01f0 con 0x7f69f81036d0 2024-09-19T09:47:02.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.836+0000 7f69ff065640 1 -- 172.21.15.1:0/3247812158 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69f8108f60 con 0x7f69f81036d0 2024-09-19T09:47:02.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.837+0000 7f69f5ffb640 1 -- 172.21.15.1:0/3247812158 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f69f0004f30 con 0x7f69f81036d0 2024-09-19T09:47:02.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.837+0000 7f69f5ffb640 1 --2- 172.21.15.1:0/3247812158 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f69e40a32d0 0x7f69e40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:02.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.838+0000 7f69fce01640 1 --2- 172.21.15.1:0/3247812158 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f69e40a32d0 0x7f69e40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:02.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.838+0000 7f69f5ffb640 1 -- 172.21.15.1:0/3247812158 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f69f00cf420 con 0x7f69f81036d0 2024-09-19T09:47:02.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.838+0000 7f69fce01640 1 --2- 172.21.15.1:0/3247812158 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f69e40a32d0 0x7f69e40a5790 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f69f8102b70 tx=0x7f69e8009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:02.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:02.842+0000 7f69f5ffb640 1 -- 172.21.15.1:0/3247812158 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f69f009c100 con 0x7f69f81036d0 2024-09-19T09:47:03.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.019+0000 7f69ff065640 1 -- 172.21.15.1:0/3247812158 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f69f8062ec0 con 0x7f69f81036d0 2024-09-19T09:47:03.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.019+0000 7f69f5ffb640 1 -- 172.21.15.1:0/3247812158 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) ==== 100+0+11 (secure 0 0 0) 0x7f69f009ba00 con 0x7f69f81036d0 2024-09-19T09:47:03.021 INFO:teuthology.orchestra.run.smithi001.stdout:pg_num: 64 2024-09-19T09:47:03.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.021+0000 7f69ff065640 1 -- 172.21.15.1:0/3247812158 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f69e40a32d0 msgr2=0x7f69e40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:03.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.021+0000 7f69ff065640 1 --2- 172.21.15.1:0/3247812158 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f69e40a32d0 0x7f69e40a5790 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f69f8102b70 tx=0x7f69e8009520 comp rx=0 tx=0).stop 2024-09-19T09:47:03.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.021+0000 7f69ff065640 1 -- 172.21.15.1:0/3247812158 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69f81036d0 msgr2=0x7f69f819f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:03.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.021+0000 7f69ff065640 1 --2- 172.21.15.1:0/3247812158 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69f81036d0 0x7f69f819f3f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f69f000d750 tx=0x7f69f000dc10 comp rx=0 tx=0).stop 2024-09-19T09:47:03.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.021+0000 7f69ff065640 1 -- 172.21.15.1:0/3247812158 shutdown_connections 2024-09-19T09:47:03.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.021+0000 7f69ff065640 1 --2- 172.21.15.1:0/3247812158 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f69f81036d0 0x7f69f819f3f0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:03.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.021+0000 7f69ff065640 1 --2- 172.21.15.1:0/3247812158 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69f8102d10 0x7f69f8198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:03.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.021+0000 7f69ff065640 1 --2- 172.21.15.1:0/3247812158 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f69e40a32d0 0x7f69e40a5790 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:03.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.021+0000 7f69ff065640 1 --2- 172.21.15.1:0/3247812158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f69f8101b20 0x7f69f8197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:03.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.021+0000 7f69ff065640 1 -- 172.21.15.1:0/3247812158 >> 172.21.15.1:0/3247812158 conn(0x7f69f80fd2a0 msgr2=0x7f69f8106130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:03.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.021+0000 7f69ff065640 1 -- 172.21.15.1:0/3247812158 shutdown_connections 2024-09-19T09:47:03.024 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.021+0000 7f69ff065640 1 -- 172.21.15.1:0/3247812158 wait complete. 2024-09-19T09:47:03.035 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-19T09:47:03.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.136+0000 7fbefb1c0640 1 -- 172.21.15.1:0/2425851115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbef4100a50 msgr2=0x7fbef4100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:03.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.136+0000 7fbefb1c0640 1 --2- 172.21.15.1:0/2425851115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbef4100a50 0x7fbef4100e50 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fbee4009900 tx=0x7fbee402a410 comp rx=0 tx=0).stop 2024-09-19T09:47:03.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.136+0000 7fbefb1c0640 1 -- 172.21.15.1:0/2425851115 shutdown_connections 2024-09-19T09:47:03.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.136+0000 7fbefb1c0640 1 --2- 172.21.15.1:0/2425851115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbef4102600 0x7fbef4108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:03.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.136+0000 7fbefb1c0640 1 --2- 172.21.15.1:0/2425851115 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbef4101c40 0x7fbef41020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:03.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.136+0000 7fbefb1c0640 1 --2- 172.21.15.1:0/2425851115 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbef4100a50 0x7fbef4100e50 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:03.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.136+0000 7fbefb1c0640 1 -- 172.21.15.1:0/2425851115 >> 172.21.15.1:0/2425851115 conn(0x7fbef40fc190 msgr2=0x7fbef40fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:03.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.137+0000 7fbefb1c0640 1 -- 172.21.15.1:0/2425851115 shutdown_connections 2024-09-19T09:47:03.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.137+0000 7fbefb1c0640 1 -- 172.21.15.1:0/2425851115 wait complete. 2024-09-19T09:47:03.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.137+0000 7fbefb1c0640 1 Processor -- start 2024-09-19T09:47:03.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.137+0000 7fbefb1c0640 1 -- start start 2024-09-19T09:47:03.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.137+0000 7fbefb1c0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbef4100a50 0x7fbef4197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:03.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.137+0000 7fbefb1c0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbef4101c40 0x7fbef41983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:03.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.137+0000 7fbefb1c0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbef4102600 0x7fbef419f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:03.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.137+0000 7fbefb1c0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbef410c6d0 con 0x7fbef4101c40 2024-09-19T09:47:03.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.137+0000 7fbefb1c0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbef410c550 con 0x7fbef4102600 2024-09-19T09:47:03.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.137+0000 7fbefb1c0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbef410c850 con 0x7fbef4100a50 2024-09-19T09:47:03.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.137+0000 7fbef3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbef4101c40 0x7fbef41983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:03.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.137+0000 7fbef3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbef4101c40 0x7fbef41983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54030/0 (socket says 172.21.15.1:54030) 2024-09-19T09:47:03.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.138+0000 7fbef3fff640 1 -- 172.21.15.1:0/1698020436 learned_addr learned my addr 172.21.15.1:0/1698020436 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:47:03.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.138+0000 7fbef975d640 1 --2- 172.21.15.1:0/1698020436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbef4102600 0x7fbef419f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:03.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.138+0000 7fbef8f5c640 1 --2- 172.21.15.1:0/1698020436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbef4100a50 0x7fbef4197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:03.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.138+0000 7fbef3fff640 1 -- 172.21.15.1:0/1698020436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbef4100a50 msgr2=0x7fbef4197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:03.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.138+0000 7fbef3fff640 1 --2- 172.21.15.1:0/1698020436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbef4100a50 0x7fbef4197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:03.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.138+0000 7fbef3fff640 1 -- 172.21.15.1:0/1698020436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbef4102600 msgr2=0x7fbef419f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:03.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.138+0000 7fbef3fff640 1 --2- 172.21.15.1:0/1698020436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbef4102600 0x7fbef419f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:03.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.138+0000 7fbef3fff640 1 -- 172.21.15.1:0/1698020436 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef419fad0 con 0x7fbef4101c40 2024-09-19T09:47:03.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.138+0000 7fbef3fff640 1 --2- 172.21.15.1:0/1698020436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbef4101c40 0x7fbef41983f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fbedc00c970 tx=0x7fbedc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:03.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.138+0000 7fbef1ffb640 1 -- 172.21.15.1:0/1698020436 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbedc007bb0 con 0x7fbef4101c40 2024-09-19T09:47:03.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.138+0000 7fbef1ffb640 1 -- 172.21.15.1:0/1698020436 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbedc007d50 con 0x7fbef4101c40 2024-09-19T09:47:03.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.138+0000 7fbefb1c0640 1 -- 172.21.15.1:0/1698020436 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbef419fdc0 con 0x7fbef4101c40 2024-09-19T09:47:03.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.138+0000 7fbef1ffb640 1 -- 172.21.15.1:0/1698020436 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbedc00f450 con 0x7fbef4101c40 2024-09-19T09:47:03.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.138+0000 7fbefb1c0640 1 -- 172.21.15.1:0/1698020436 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbef41a0280 con 0x7fbef4101c40 2024-09-19T09:47:03.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.139+0000 7fbefb1c0640 1 -- 172.21.15.1:0/1698020436 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbef41a0510 con 0x7fbef4101c40 2024-09-19T09:47:03.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.140+0000 7fbef1ffb640 1 -- 172.21.15.1:0/1698020436 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fbedc005020 con 0x7fbef4101c40 2024-09-19T09:47:03.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.141+0000 7fbef1ffb640 1 --2- 172.21.15.1:0/1698020436 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbee00a32d0 0x7fbee00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:03.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.141+0000 7fbef8f5c640 1 --2- 172.21.15.1:0/1698020436 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbee00a32d0 0x7fbee00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:03.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.141+0000 7fbef1ffb640 1 -- 172.21.15.1:0/1698020436 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fbedc0cf6c0 con 0x7fbef4101c40 2024-09-19T09:47:03.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.142+0000 7fbef8f5c640 1 --2- 172.21.15.1:0/1698020436 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbee00a32d0 0x7fbee00a5790 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbee4006010 tx=0x7fbee4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:03.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.145+0000 7fbef1ffb640 1 -- 172.21.15.1:0/1698020436 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbedc014030 con 0x7fbef4101c40 2024-09-19T09:47:03.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.370+0000 7fbefb1c0640 1 -- 172.21.15.1:0/1698020436 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fbef41a0db0 con 0x7fbef4101c40 2024-09-19T09:47:03.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.378+0000 7fbef1ffb640 1 -- 172.21.15.1:0/1698020436 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+742331 (secure 0 0 0) 0x7fbedc09c3a0 con 0x7fbef4101c40 2024-09-19T09:47:03.389 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:47:03.390 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:47:03.390 INFO:teuthology.orchestra.run.smithi001.stdout: "epoch": 18, 2024-09-19T09:47:03.390 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.390 INFO:teuthology.orchestra.run.smithi001.stdout: "active_gid": 14150, 2024-09-19T09:47:03.390 INFO:teuthology.orchestra.run.smithi001.stdout: "active_name": "x", 2024-09-19T09:47:03.390 INFO:teuthology.orchestra.run.smithi001.stdout: "active_addrs": { 2024-09-19T09:47:03.390 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-19T09:47:03.390 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.390 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-19T09:47:03.390 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:6800", 2024-09-19T09:47:03.390 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 3871697789 2024-09-19T09:47:03.390 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.390 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.391 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-09-19T09:47:03.391 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:6801", 2024-09-19T09:47:03.391 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 3871697789 2024-09-19T09:47:03.391 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.391 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-19T09:47:03.391 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.391 INFO:teuthology.orchestra.run.smithi001.stdout: "active_addr": "172.21.15.1:6801/3871697789", 2024-09-19T09:47:03.391 INFO:teuthology.orchestra.run.smithi001.stdout: "active_change": "2024-09-19T09:29:14.047073+0000", 2024-09-19T09:47:03.391 INFO:teuthology.orchestra.run.smithi001.stdout: "active_mgr_features": 4540701547738038271, 2024-09-19T09:47:03.391 INFO:teuthology.orchestra.run.smithi001.stdout: "available": true, 2024-09-19T09:47:03.391 INFO:teuthology.orchestra.run.smithi001.stdout: "standbys": [ 2024-09-19T09:47:03.391 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.391 INFO:teuthology.orchestra.run.smithi001.stdout: "gid": 24109, 2024-09-19T09:47:03.392 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "z", 2024-09-19T09:47:03.392 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_features": 4540701547738038271, 2024-09-19T09:47:03.392 INFO:teuthology.orchestra.run.smithi001.stdout: "available_modules": [ 2024-09-19T09:47:03.392 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.392 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "alerts", 2024-09-19T09:47:03.392 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.392 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.392 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.392 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T09:47:03.392 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T09:47:03.392 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:03.392 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.392 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.393 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T09:47:03.393 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.393 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.393 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.393 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T09:47:03.393 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.393 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.393 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.393 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.393 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.393 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.393 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.393 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.394 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.394 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.394 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.394 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.394 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.394 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.394 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.394 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.394 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.394 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.394 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.394 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.394 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.394 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.395 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.395 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.395 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.395 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.395 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.395 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.395 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.395 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.395 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.395 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.395 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.395 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.395 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.396 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.396 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.396 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.396 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.396 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.396 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.396 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.396 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.396 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.396 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.396 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.396 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.396 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.397 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.397 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.397 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.397 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.397 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.397 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.397 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.397 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.397 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.397 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.397 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.397 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.397 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.397 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.398 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.398 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.398 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.398 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.398 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.398 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.398 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.398 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.398 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.398 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.398 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.398 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.398 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_destination": { 2024-09-19T09:47:03.399 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_destination", 2024-09-19T09:47:03.399 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.399 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.399 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.399 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.399 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.399 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.399 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.399 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email address to send alerts to", 2024-09-19T09:47:03.399 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.399 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.399 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.399 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.399 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_from_name": { 2024-09-19T09:47:03.400 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_from_name", 2024-09-19T09:47:03.400 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.400 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.400 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.400 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "Ceph", 2024-09-19T09:47:03.400 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.400 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.400 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.400 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email From: name", 2024-09-19T09:47:03.400 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.400 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.400 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.400 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.400 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_host": { 2024-09-19T09:47:03.401 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_host", 2024-09-19T09:47:03.401 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.401 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.401 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.401 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.401 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.401 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.401 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.401 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP server", 2024-09-19T09:47:03.401 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.401 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.401 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.401 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.402 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_password": { 2024-09-19T09:47:03.402 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_password", 2024-09-19T09:47:03.402 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.402 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.402 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.402 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.402 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.402 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.402 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.402 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Password to authenticate with", 2024-09-19T09:47:03.402 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.402 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.402 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.402 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.403 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_port": { 2024-09-19T09:47:03.403 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_port", 2024-09-19T09:47:03.403 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.403 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.403 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.403 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "465", 2024-09-19T09:47:03.403 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.403 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.403 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.403 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP port", 2024-09-19T09:47:03.403 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.403 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.403 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.403 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.404 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_sender": { 2024-09-19T09:47:03.404 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_sender", 2024-09-19T09:47:03.404 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.404 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.404 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.404 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.404 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.404 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.404 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.404 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP envelope sender", 2024-09-19T09:47:03.404 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.404 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.405 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.405 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.405 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_ssl": { 2024-09-19T09:47:03.405 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_ssl", 2024-09-19T09:47:03.405 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.405 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.405 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.405 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.405 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.405 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.405 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.405 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T09:47:03.405 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.406 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.406 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.406 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.406 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_user": { 2024-09-19T09:47:03.406 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_user", 2024-09-19T09:47:03.406 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.406 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.406 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.406 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.406 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.406 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.406 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.406 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "User to authenticate as", 2024-09-19T09:47:03.406 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.406 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.407 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.407 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.407 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.407 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.407 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.407 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "balancer", 2024-09-19T09:47:03.407 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.407 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.407 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.407 INFO:teuthology.orchestra.run.smithi001.stdout: "active": { 2024-09-19T09:47:03.407 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "active", 2024-09-19T09:47:03.407 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.407 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.407 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.408 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.408 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.408 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.408 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.408 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T09:47:03.408 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.408 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.408 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.408 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.408 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_time": { 2024-09-19T09:47:03.408 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_time", 2024-09-19T09:47:03.408 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.408 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.408 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.409 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0000", 2024-09-19T09:47:03.409 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.409 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.409 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.409 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T09:47:03.409 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:47:03.412 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.412 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.412 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.412 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_weekday": { 2024-09-19T09:47:03.412 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_weekday", 2024-09-19T09:47:03.412 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T09:47:03.413 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.413 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.413 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T09:47:03.413 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-19T09:47:03.413 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-19T09:47:03.413 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.413 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T09:47:03.413 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:47:03.413 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.413 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.413 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.413 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_max_iterations": { 2024-09-19T09:47:03.413 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_max_iterations", 2024-09-19T09:47:03.413 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T09:47:03.414 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.414 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.414 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "25", 2024-09-19T09:47:03.414 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T09:47:03.414 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "250", 2024-09-19T09:47:03.414 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.414 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T09:47:03.414 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.414 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.414 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.414 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.414 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_metrics": { 2024-09-19T09:47:03.414 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_metrics", 2024-09-19T09:47:03.414 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.415 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.415 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.415 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T09:47:03.415 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.415 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.415 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.415 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T09:47:03.415 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T09:47:03.415 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.415 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.415 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.415 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_step": { 2024-09-19T09:47:03.415 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_step", 2024-09-19T09:47:03.415 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:47:03.416 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.416 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.416 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.5", 2024-09-19T09:47:03.416 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0.001", 2024-09-19T09:47:03.416 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "0.999", 2024-09-19T09:47:03.416 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.416 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "aggressiveness of optimization", 2024-09-19T09:47:03.416 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T09:47:03.416 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.416 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.416 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.416 INFO:teuthology.orchestra.run.smithi001.stdout: "end_time": { 2024-09-19T09:47:03.416 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_time", 2024-09-19T09:47:03.416 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.417 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.417 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.417 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2359", 2024-09-19T09:47:03.417 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.417 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.417 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.417 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T09:47:03.417 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:47:03.417 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.417 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.417 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.417 INFO:teuthology.orchestra.run.smithi001.stdout: "end_weekday": { 2024-09-19T09:47:03.417 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_weekday", 2024-09-19T09:47:03.417 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T09:47:03.417 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.418 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.418 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T09:47:03.418 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-19T09:47:03.418 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-19T09:47:03.418 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.418 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T09:47:03.418 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:47:03.418 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.418 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.418 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.418 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.418 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.418 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.419 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.419 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.419 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.419 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.419 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.419 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.419 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.419 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.419 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.419 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.419 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.419 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.419 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.419 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.419 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.420 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.420 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.420 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.420 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.420 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.420 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.420 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.420 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.420 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.420 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.420 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.420 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.420 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.421 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.421 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.421 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.421 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.421 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.421 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.421 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.421 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.421 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.421 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.421 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.421 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.421 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.421 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.422 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.422 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.422 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.422 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.422 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.422 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.422 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.422 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.422 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.422 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.422 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.422 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.422 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.423 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.423 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.423 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.423 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.423 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.423 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.423 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.423 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.423 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.423 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.423 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.423 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.423 INFO:teuthology.orchestra.run.smithi001.stdout: "min_score": { 2024-09-19T09:47:03.423 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_score", 2024-09-19T09:47:03.423 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:47:03.424 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.424 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.424 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T09:47:03.424 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.424 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.424 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.424 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T09:47:03.424 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.424 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.424 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.424 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.424 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-19T09:47:03.424 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-19T09:47:03.425 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.425 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.425 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.425 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "upmap", 2024-09-19T09:47:03.425 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.425 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.425 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.425 INFO:teuthology.orchestra.run.smithi001.stdout: "crush-compat", 2024-09-19T09:47:03.425 INFO:teuthology.orchestra.run.smithi001.stdout: "none", 2024-09-19T09:47:03.425 INFO:teuthology.orchestra.run.smithi001.stdout: "read", 2024-09-19T09:47:03.425 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap", 2024-09-19T09:47:03.425 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap-read" 2024-09-19T09:47:03.425 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.426 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Balancer mode", 2024-09-19T09:47:03.426 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.426 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.426 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.426 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.426 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_ids": { 2024-09-19T09:47:03.426 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_ids", 2024-09-19T09:47:03.426 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.426 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.426 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.426 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.426 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.427 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.427 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.427 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T09:47:03.427 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.427 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.427 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.427 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.427 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T09:47:03.427 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T09:47:03.427 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:03.427 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.427 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.427 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T09:47:03.427 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.428 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.428 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.428 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T09:47:03.428 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.428 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.428 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.428 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.428 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_deviation": { 2024-09-19T09:47:03.428 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_deviation", 2024-09-19T09:47:03.428 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.428 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.428 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.428 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T09:47:03.429 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T09:47:03.429 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.429 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.429 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T09:47:03.429 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T09:47:03.429 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.429 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.429 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.429 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_optimizations": { 2024-09-19T09:47:03.429 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_optimizations", 2024-09-19T09:47:03.429 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T09:47:03.429 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.429 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.429 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:47:03.430 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.430 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.430 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.430 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T09:47:03.430 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.430 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.430 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.430 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.430 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.430 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.430 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.430 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm", 2024-09-19T09:47:03.430 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.430 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.431 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.431 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_down_multiplier": { 2024-09-19T09:47:03.431 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_down_multiplier", 2024-09-19T09:47:03.431 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:47:03.431 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.431 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.431 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-19T09:47:03.431 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.431 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.431 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.431 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T09:47:03.431 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.431 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.431 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.432 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.432 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_refresh_rate": { 2024-09-19T09:47:03.432 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_refresh_rate", 2024-09-19T09:47:03.432 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:03.432 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.432 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.432 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "20", 2024-09-19T09:47:03.432 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.432 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.432 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.432 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T09:47:03.432 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.432 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.433 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.433 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.433 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_starting_port": { 2024-09-19T09:47:03.433 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_starting_port", 2024-09-19T09:47:03.433 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.433 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.433 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.433 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4721", 2024-09-19T09:47:03.433 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.433 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.433 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.433 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T09:47:03.433 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.434 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.434 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.434 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.434 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_ptrace": { 2024-09-19T09:47:03.434 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_ptrace", 2024-09-19T09:47:03.434 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.434 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.434 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.434 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.434 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.434 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.434 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.434 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T09:47:03.434 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T09:47:03.434 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.435 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.435 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.435 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_interval": { 2024-09-19T09:47:03.435 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_interval", 2024-09-19T09:47:03.435 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:03.435 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.435 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.435 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T09:47:03.435 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.435 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.435 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.435 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T09:47:03.435 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.435 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.436 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.436 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.436 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_memory_target_ratio": { 2024-09-19T09:47:03.436 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T09:47:03.436 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:47:03.436 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.436 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.436 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.7", 2024-09-19T09:47:03.436 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.436 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.436 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.436 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T09:47:03.437 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.437 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.437 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.437 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.437 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm_log_destination": { 2024-09-19T09:47:03.437 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm_log_destination", 2024-09-19T09:47:03.437 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.437 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.437 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.437 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.437 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.437 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.437 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.438 INFO:teuthology.orchestra.run.smithi001.stdout: "file", 2024-09-19T09:47:03.438 INFO:teuthology.orchestra.run.smithi001.stdout: "file,syslog", 2024-09-19T09:47:03.438 INFO:teuthology.orchestra.run.smithi001.stdout: "syslog" 2024-09-19T09:47:03.438 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.438 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T09:47:03.438 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.438 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.438 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.438 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.438 INFO:teuthology.orchestra.run.smithi001.stdout: "cgroups_split": { 2024-09-19T09:47:03.438 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cgroups_split", 2024-09-19T09:47:03.438 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.438 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.439 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.439 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.439 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.439 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.439 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.439 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T09:47:03.439 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.439 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.439 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.439 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.439 INFO:teuthology.orchestra.run.smithi001.stdout: "config_checks_enabled": { 2024-09-19T09:47:03.439 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_checks_enabled", 2024-09-19T09:47:03.439 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.439 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.440 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.440 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.440 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.440 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.440 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.440 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T09:47:03.440 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.440 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.440 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.440 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.440 INFO:teuthology.orchestra.run.smithi001.stdout: "config_dashboard": { 2024-09-19T09:47:03.440 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_dashboard", 2024-09-19T09:47:03.441 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.441 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.441 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.441 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.441 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.441 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.441 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.441 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T09:47:03.441 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.441 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.441 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.441 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.441 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_alertmanager": { 2024-09-19T09:47:03.441 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_alertmanager", 2024-09-19T09:47:03.441 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.442 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.442 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.442 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T09:47:03.442 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.442 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.442 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.442 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T09:47:03.442 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.442 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.442 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.442 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.442 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_base": { 2024-09-19T09:47:03.442 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_base", 2024-09-19T09:47:03.443 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.443 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.443 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.443 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T09:47:03.443 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.443 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.443 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.443 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Container image name, without the tag", 2024-09-19T09:47:03.443 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.443 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.443 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.443 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.443 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_elasticsearch": { 2024-09-19T09:47:03.444 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_elasticsearch", 2024-09-19T09:47:03.444 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.444 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.444 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.444 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T09:47:03.444 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.444 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.444 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.444 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "elasticsearch container image", 2024-09-19T09:47:03.444 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.444 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.444 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.444 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.444 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_grafana": { 2024-09-19T09:47:03.445 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_grafana", 2024-09-19T09:47:03.445 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.445 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.445 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.445 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T09:47:03.445 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.445 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.445 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.445 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T09:47:03.445 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.445 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.445 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.445 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.445 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_haproxy": { 2024-09-19T09:47:03.446 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_haproxy", 2024-09-19T09:47:03.446 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.446 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.446 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.446 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T09:47:03.446 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.446 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.446 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.446 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "HAproxy container image", 2024-09-19T09:47:03.446 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.446 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.446 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.447 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.447 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_agent": { 2024-09-19T09:47:03.447 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_agent", 2024-09-19T09:47:03.447 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.447 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.447 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.447 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T09:47:03.447 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.447 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.447 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.447 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger agent container image", 2024-09-19T09:47:03.447 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.447 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.447 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.448 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.448 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_collector": { 2024-09-19T09:47:03.448 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_collector", 2024-09-19T09:47:03.448 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.448 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.448 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.448 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T09:47:03.448 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.448 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.448 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.448 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger collector container image", 2024-09-19T09:47:03.448 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.449 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.449 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.449 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.449 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_query": { 2024-09-19T09:47:03.449 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_query", 2024-09-19T09:47:03.449 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.449 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.449 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.449 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T09:47:03.449 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.449 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.449 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.449 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger query container image", 2024-09-19T09:47:03.450 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.450 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.450 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.450 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.450 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_keepalived": { 2024-09-19T09:47:03.450 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_keepalived", 2024-09-19T09:47:03.450 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.450 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.450 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.450 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T09:47:03.450 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.450 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.450 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.450 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Keepalived container image", 2024-09-19T09:47:03.451 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.451 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.451 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.451 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.451 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_loki": { 2024-09-19T09:47:03.451 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_loki", 2024-09-19T09:47:03.451 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.451 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.451 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.451 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T09:47:03.451 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.451 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.451 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.451 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Loki container image", 2024-09-19T09:47:03.452 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.452 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.452 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.452 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.452 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_node_exporter": { 2024-09-19T09:47:03.452 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_node_exporter", 2024-09-19T09:47:03.452 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.452 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.452 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.452 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T09:47:03.452 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.452 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.452 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.452 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T09:47:03.453 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.453 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.453 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.453 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.453 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_nvmeof": { 2024-09-19T09:47:03.453 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_nvmeof", 2024-09-19T09:47:03.453 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.453 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.453 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.453 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T09:47:03.453 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.453 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.453 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.454 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Nvme-of container image", 2024-09-19T09:47:03.454 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.454 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.454 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.454 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.454 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_prometheus": { 2024-09-19T09:47:03.454 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_prometheus", 2024-09-19T09:47:03.454 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.454 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.454 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.454 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T09:47:03.454 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.454 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.454 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.455 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T09:47:03.455 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.455 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.455 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.455 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.455 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_promtail": { 2024-09-19T09:47:03.455 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_promtail", 2024-09-19T09:47:03.455 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.455 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.455 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.455 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T09:47:03.455 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.455 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.455 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.456 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Promtail container image", 2024-09-19T09:47:03.456 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.456 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.456 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.456 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.456 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_samba": { 2024-09-19T09:47:03.456 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_samba", 2024-09-19T09:47:03.456 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.456 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.456 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.456 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T09:47:03.456 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.456 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.456 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.457 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Samba/SMB container image", 2024-09-19T09:47:03.457 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.457 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.457 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.457 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.457 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_snmp_gateway": { 2024-09-19T09:47:03.457 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_snmp_gateway", 2024-09-19T09:47:03.457 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.457 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.457 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.457 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T09:47:03.457 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.457 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.457 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.458 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SNMP Gateway container image", 2024-09-19T09:47:03.458 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.458 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.458 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.458 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.458 INFO:teuthology.orchestra.run.smithi001.stdout: "container_init": { 2024-09-19T09:47:03.458 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_init", 2024-09-19T09:47:03.458 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.458 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.458 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.458 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.458 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.459 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.459 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.459 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T09:47:03.459 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.459 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.459 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.459 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.459 INFO:teuthology.orchestra.run.smithi001.stdout: "daemon_cache_timeout": { 2024-09-19T09:47:03.459 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "daemon_cache_timeout", 2024-09-19T09:47:03.459 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:03.459 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.459 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.459 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T09:47:03.460 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.460 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.460 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.460 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T09:47:03.460 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.460 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.460 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.460 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.460 INFO:teuthology.orchestra.run.smithi001.stdout: "default_cephadm_command_timeout": { 2024-09-19T09:47:03.460 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T09:47:03.460 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.460 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.460 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.461 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "900", 2024-09-19T09:47:03.461 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.461 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.461 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.461 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T09:47:03.461 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.461 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.461 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.461 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.461 INFO:teuthology.orchestra.run.smithi001.stdout: "default_registry": { 2024-09-19T09:47:03.461 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_registry", 2024-09-19T09:47:03.461 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.461 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.461 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.462 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io", 2024-09-19T09:47:03.462 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.462 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.462 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.462 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T09:47:03.462 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.462 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.462 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.462 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.462 INFO:teuthology.orchestra.run.smithi001.stdout: "device_cache_timeout": { 2024-09-19T09:47:03.462 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_cache_timeout", 2024-09-19T09:47:03.462 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:03.463 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.463 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.463 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1800", 2024-09-19T09:47:03.463 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.463 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.463 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.463 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache device inventory", 2024-09-19T09:47:03.463 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.463 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.463 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.463 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.463 INFO:teuthology.orchestra.run.smithi001.stdout: "device_enhanced_scan": { 2024-09-19T09:47:03.463 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_enhanced_scan", 2024-09-19T09:47:03.463 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.464 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.464 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.464 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.464 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.464 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.464 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.464 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T09:47:03.464 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.464 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.464 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.464 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.464 INFO:teuthology.orchestra.run.smithi001.stdout: "facts_cache_timeout": { 2024-09-19T09:47:03.464 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "facts_cache_timeout", 2024-09-19T09:47:03.465 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:03.465 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.465 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.465 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T09:47:03.465 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.465 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.465 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.465 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache host facts data", 2024-09-19T09:47:03.465 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.465 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.465 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.465 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.465 INFO:teuthology.orchestra.run.smithi001.stdout: "grafana_dashboards_path": { 2024-09-19T09:47:03.466 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "grafana_dashboards_path", 2024-09-19T09:47:03.466 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.466 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.466 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.466 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T09:47:03.466 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.466 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.466 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.466 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T09:47:03.466 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.466 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.466 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.466 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.467 INFO:teuthology.orchestra.run.smithi001.stdout: "host_check_interval": { 2024-09-19T09:47:03.467 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "host_check_interval", 2024-09-19T09:47:03.467 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:03.467 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.467 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.467 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T09:47:03.467 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.467 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.467 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.467 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to perform a host check", 2024-09-19T09:47:03.467 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.467 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.467 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.468 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.468 INFO:teuthology.orchestra.run.smithi001.stdout: "hw_monitoring": { 2024-09-19T09:47:03.468 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hw_monitoring", 2024-09-19T09:47:03.468 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.468 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.468 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.468 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.468 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.468 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.468 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.468 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T09:47:03.468 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.468 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.469 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.469 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.469 INFO:teuthology.orchestra.run.smithi001.stdout: "inventory_list_all": { 2024-09-19T09:47:03.469 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "inventory_list_all", 2024-09-19T09:47:03.469 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.469 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.469 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.469 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.469 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.469 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.469 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.469 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T09:47:03.470 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.470 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.470 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.470 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.470 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.470 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.470 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.470 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.470 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.470 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.470 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.470 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.470 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.471 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.471 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.471 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.471 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.471 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.471 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.471 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.471 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.471 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.471 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.471 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.471 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.471 INFO:teuthology.orchestra.run.smithi001.stdout: "log_refresh_metadata": { 2024-09-19T09:47:03.471 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_refresh_metadata", 2024-09-19T09:47:03.471 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.472 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.472 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.472 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.472 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.472 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.472 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.472 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T09:47:03.472 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.472 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.472 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.472 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.473 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.473 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.473 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.473 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.473 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.473 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.473 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.473 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.473 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.473 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T09:47:03.473 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.473 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.473 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.474 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.474 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.474 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.474 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.474 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.474 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.474 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.474 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.474 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.474 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.474 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.474 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.474 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.475 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.475 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.475 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.475 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.475 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.475 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.475 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.475 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.475 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.475 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.475 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.475 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.476 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.476 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.476 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.476 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.476 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.476 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.476 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.476 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.476 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.476 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.476 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.476 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T09:47:03.476 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T09:47:03.477 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.477 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.477 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.477 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.477 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.477 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.477 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.477 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T09:47:03.477 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.477 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.477 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.477 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.477 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T09:47:03.478 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T09:47:03.478 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.478 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.478 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.478 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "*", 2024-09-19T09:47:03.478 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.478 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.478 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.478 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T09:47:03.478 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.478 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.478 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.478 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.478 INFO:teuthology.orchestra.run.smithi001.stdout: "max_count_per_host": { 2024-09-19T09:47:03.478 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_count_per_host", 2024-09-19T09:47:03.479 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.479 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.479 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.479 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:47:03.479 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.479 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.479 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.479 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of daemons per service per host", 2024-09-19T09:47:03.479 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.479 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.479 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.479 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.479 INFO:teuthology.orchestra.run.smithi001.stdout: "max_osd_draining_count": { 2024-09-19T09:47:03.479 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_osd_draining_count", 2024-09-19T09:47:03.480 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.480 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.480 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.480 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:47:03.480 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.480 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.480 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.480 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T09:47:03.480 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.480 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.480 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.480 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.480 INFO:teuthology.orchestra.run.smithi001.stdout: "migration_current": { 2024-09-19T09:47:03.480 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "migration_current", 2024-09-19T09:47:03.481 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.481 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.481 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.481 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.481 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.481 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.481 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.481 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "internal - do not modify", 2024-09-19T09:47:03.481 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.481 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.481 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.481 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.481 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-19T09:47:03.481 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-19T09:47:03.481 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.482 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.482 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.482 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "root", 2024-09-19T09:47:03.482 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.482 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.482 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.482 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm-package", 2024-09-19T09:47:03.482 INFO:teuthology.orchestra.run.smithi001.stdout: "root" 2024-09-19T09:47:03.482 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.482 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T09:47:03.482 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.482 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.482 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.482 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.483 INFO:teuthology.orchestra.run.smithi001.stdout: "oob_default_addr": { 2024-09-19T09:47:03.483 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "oob_default_addr", 2024-09-19T09:47:03.483 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.483 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.483 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.483 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "169.254.1.1", 2024-09-19T09:47:03.483 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.483 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.483 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.483 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T09:47:03.483 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.483 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.483 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.483 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.483 INFO:teuthology.orchestra.run.smithi001.stdout: "prometheus_alerts_path": { 2024-09-19T09:47:03.484 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus_alerts_path", 2024-09-19T09:47:03.484 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.484 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.484 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.484 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T09:47:03.484 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.484 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.484 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.484 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T09:47:03.484 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.484 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.484 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.484 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.484 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_insecure": { 2024-09-19T09:47:03.485 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_insecure", 2024-09-19T09:47:03.485 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.485 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.485 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.485 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.485 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.485 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.485 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.485 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T09:47:03.485 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.485 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.485 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.486 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.486 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_password": { 2024-09-19T09:47:03.486 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_password", 2024-09-19T09:47:03.486 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.486 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.486 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.486 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.486 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.486 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.486 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.486 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T09:47:03.486 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.486 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.486 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.486 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.487 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_url": { 2024-09-19T09:47:03.487 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_url", 2024-09-19T09:47:03.487 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.487 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.487 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.487 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.487 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.487 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.487 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.487 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T09:47:03.487 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.487 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.487 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.487 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.488 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_username": { 2024-09-19T09:47:03.488 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_username", 2024-09-19T09:47:03.488 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.488 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.488 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.488 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.488 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.488 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.488 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.488 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T09:47:03.488 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.488 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.488 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.489 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.489 INFO:teuthology.orchestra.run.smithi001.stdout: "secure_monitoring_stack": { 2024-09-19T09:47:03.489 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secure_monitoring_stack", 2024-09-19T09:47:03.489 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.489 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.489 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.489 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.489 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.489 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.489 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.489 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T09:47:03.489 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.489 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.490 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.490 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.490 INFO:teuthology.orchestra.run.smithi001.stdout: "service_discovery_port": { 2024-09-19T09:47:03.490 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "service_discovery_port", 2024-09-19T09:47:03.490 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.490 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.490 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.490 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8765", 2024-09-19T09:47:03.490 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.490 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.490 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.490 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "cephadm service discovery port", 2024-09-19T09:47:03.490 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.490 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.491 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.491 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.491 INFO:teuthology.orchestra.run.smithi001.stdout: "ssh_config_file": { 2024-09-19T09:47:03.491 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssh_config_file", 2024-09-19T09:47:03.491 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.491 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.491 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.491 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.491 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.491 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.491 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.491 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T09:47:03.491 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.491 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.492 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.492 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.492 INFO:teuthology.orchestra.run.smithi001.stdout: "use_agent": { 2024-09-19T09:47:03.492 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_agent", 2024-09-19T09:47:03.492 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.492 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.492 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.492 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.492 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.492 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.492 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.492 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T09:47:03.492 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.493 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.493 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.493 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.493 INFO:teuthology.orchestra.run.smithi001.stdout: "use_repo_digest": { 2024-09-19T09:47:03.493 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_repo_digest", 2024-09-19T09:47:03.493 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.493 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.493 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.493 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.493 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.493 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.493 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.493 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T09:47:03.493 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.494 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.494 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.494 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.494 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_failed_host_check": { 2024-09-19T09:47:03.494 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_failed_host_check", 2024-09-19T09:47:03.494 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.494 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.494 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.494 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.494 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.494 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.494 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.494 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T09:47:03.494 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.494 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.495 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.495 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.495 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_daemons": { 2024-09-19T09:47:03.495 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_daemons", 2024-09-19T09:47:03.495 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.495 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.495 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.495 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.495 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.495 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.495 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.495 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T09:47:03.495 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.495 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.496 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.496 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.496 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_hosts": { 2024-09-19T09:47:03.496 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_hosts", 2024-09-19T09:47:03.496 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.496 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.496 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.496 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.496 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.496 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.496 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.496 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T09:47:03.496 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.497 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.497 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.497 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.497 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.497 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.497 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.497 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crash", 2024-09-19T09:47:03.497 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.497 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.497 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.497 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.497 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.497 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.498 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.498 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.498 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.498 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.498 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.498 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.498 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.498 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.498 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.498 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.498 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.498 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.498 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.498 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.498 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.499 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.499 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.499 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.499 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.499 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.499 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.499 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.499 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.499 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.499 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.499 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.499 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.499 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.499 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.499 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.500 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.500 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.500 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.500 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.500 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.500 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.500 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.500 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.500 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.500 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.500 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.500 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.500 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.500 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.501 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.501 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.501 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.501 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.501 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.501 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.501 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.501 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.501 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.501 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.501 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.501 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.501 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.501 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.501 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.502 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.502 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.502 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.502 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.502 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.502 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.502 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.502 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.502 INFO:teuthology.orchestra.run.smithi001.stdout: "retain_interval": { 2024-09-19T09:47:03.502 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retain_interval", 2024-09-19T09:47:03.502 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:03.502 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.502 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.502 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "31536000", 2024-09-19T09:47:03.502 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.503 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.503 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.503 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T09:47:03.503 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.503 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.503 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.503 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.503 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_recent_interval": { 2024-09-19T09:47:03.503 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_recent_interval", 2024-09-19T09:47:03.503 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:03.503 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.503 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.503 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1209600", 2024-09-19T09:47:03.503 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.503 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.504 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.504 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T09:47:03.504 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.504 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.504 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.504 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.504 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.504 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.504 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.504 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dashboard", 2024-09-19T09:47:03.504 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.504 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.504 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.504 INFO:teuthology.orchestra.run.smithi001.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T09:47:03.504 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T09:47:03.505 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.505 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.505 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.505 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:47:03.505 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.505 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.505 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.505 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.505 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.505 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.505 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.505 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.505 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T09:47:03.506 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T09:47:03.506 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.506 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.506 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.506 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.506 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.506 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.506 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.506 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.506 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.506 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.506 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.506 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.506 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T09:47:03.506 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T09:47:03.507 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.507 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.507 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.507 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.507 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.507 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.507 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.507 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.507 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.507 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.507 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.507 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.507 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_ENABLED": { 2024-09-19T09:47:03.507 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T09:47:03.507 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.508 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.508 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.508 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.508 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.508 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.508 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.508 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.508 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.508 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.508 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.508 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.508 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T09:47:03.508 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T09:47:03.508 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.509 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.509 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.509 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.509 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.509 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.509 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.509 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.509 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.509 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.509 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.509 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.509 INFO:teuthology.orchestra.run.smithi001.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T09:47:03.509 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T09:47:03.509 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.510 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.510 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.510 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.510 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.510 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.510 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.510 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.510 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.510 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.510 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.510 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.510 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T09:47:03.511 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T09:47:03.511 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.511 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.511 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.511 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.511 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.511 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.511 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.511 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.511 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.511 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.511 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.511 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.511 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T09:47:03.512 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T09:47:03.512 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.512 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.512 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.512 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.512 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.512 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.512 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.512 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.512 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.512 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.512 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.512 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.513 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T09:47:03.513 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T09:47:03.513 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.513 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.513 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.513 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.513 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.513 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.513 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.513 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.513 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.513 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.513 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.513 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.514 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T09:47:03.514 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T09:47:03.514 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.514 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.514 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.514 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.514 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.514 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.514 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.514 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.514 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.514 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.514 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.514 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.515 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T09:47:03.515 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T09:47:03.515 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.515 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.515 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.515 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.515 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.515 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.515 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.515 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.515 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.515 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.515 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.516 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.516 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T09:47:03.516 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T09:47:03.516 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.516 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.516 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.516 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.516 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.516 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.516 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.516 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.516 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.516 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.516 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.517 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.517 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T09:47:03.517 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T09:47:03.517 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.517 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.517 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.517 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.517 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.517 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.517 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.517 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.517 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.517 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.517 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.518 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.518 INFO:teuthology.orchestra.run.smithi001.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T09:47:03.518 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T09:47:03.518 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.518 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.518 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.518 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.518 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.518 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.518 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.518 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.518 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.518 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.518 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.519 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.519 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T09:47:03.519 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T09:47:03.519 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.519 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.519 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.519 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-19T09:47:03.519 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.519 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.519 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.519 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.519 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.519 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.519 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.520 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.520 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T09:47:03.520 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T09:47:03.520 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.520 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.520 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.520 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.520 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.520 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.520 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.520 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.520 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.520 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.520 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.521 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.521 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_URL": { 2024-09-19T09:47:03.521 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_URL", 2024-09-19T09:47:03.521 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.521 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.521 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.521 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.521 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.521 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.521 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.521 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.521 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.521 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.521 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.522 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.522 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T09:47:03.522 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T09:47:03.522 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.522 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.522 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.522 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-19T09:47:03.522 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.522 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.522 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.522 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.522 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.522 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.522 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.522 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.523 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T09:47:03.523 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T09:47:03.523 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.523 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.523 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.523 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.523 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.523 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.523 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.523 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.523 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.523 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.523 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.523 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.523 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T09:47:03.524 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T09:47:03.524 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.524 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.524 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.524 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.524 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.524 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.524 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.524 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.524 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.524 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.524 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.525 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.525 INFO:teuthology.orchestra.run.smithi001.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T09:47:03.525 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T09:47:03.525 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.525 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.525 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.525 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.525 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.525 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.525 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.525 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.525 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.525 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.525 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.526 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.526 INFO:teuthology.orchestra.run.smithi001.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T09:47:03.526 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T09:47:03.526 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.526 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.526 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.526 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.526 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.526 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.526 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.526 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.526 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.526 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.527 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.527 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.527 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T09:47:03.527 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T09:47:03.527 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.527 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.527 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.527 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.527 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.527 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.527 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.527 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.527 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.528 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.528 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.528 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.528 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T09:47:03.528 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T09:47:03.528 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.528 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.528 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.528 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.528 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.528 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.528 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.528 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.529 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.529 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.529 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.529 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.529 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T09:47:03.529 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T09:47:03.529 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.529 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.529 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.529 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.529 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.529 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.529 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.530 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.530 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.530 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.530 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.530 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.530 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T09:47:03.530 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T09:47:03.530 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.530 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.530 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.530 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.530 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.530 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.531 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.531 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.531 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.531 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.531 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.531 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.531 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T09:47:03.531 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T09:47:03.531 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.531 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.531 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.531 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.531 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.531 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.532 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.532 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.532 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.532 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.532 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.532 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.532 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T09:47:03.532 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T09:47:03.532 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.532 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.532 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.532 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.532 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.532 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.533 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.533 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.533 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.533 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.533 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.533 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.533 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T09:47:03.533 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T09:47:03.533 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.533 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.533 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.533 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.533 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.534 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.534 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.534 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.534 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.534 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.534 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.534 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.534 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T09:47:03.534 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T09:47:03.534 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.534 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.534 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.534 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.534 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.535 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.535 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.535 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.535 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.535 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.535 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.535 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.535 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T09:47:03.535 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T09:47:03.535 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.535 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.535 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.535 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.535 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.536 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.536 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.536 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.536 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.536 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.536 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.536 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.536 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T09:47:03.536 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T09:47:03.536 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.536 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.536 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.536 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.537 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.537 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.537 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.537 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.537 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.537 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.537 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.537 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.537 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T09:47:03.537 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T09:47:03.537 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.537 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.537 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.538 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T09:47:03.538 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.538 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.538 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.538 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.538 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.538 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.538 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.538 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.538 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T09:47:03.538 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T09:47:03.538 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.538 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.539 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.539 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:47:03.539 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.539 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.539 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.539 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.539 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.539 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.539 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.539 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.539 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T09:47:03.539 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T09:47:03.539 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.540 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.540 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.540 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8", 2024-09-19T09:47:03.540 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.540 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.540 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.540 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.540 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.540 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.540 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.540 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.540 INFO:teuthology.orchestra.run.smithi001.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T09:47:03.540 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T09:47:03.541 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.541 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.541 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.541 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "45", 2024-09-19T09:47:03.541 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.541 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.541 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.541 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.541 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.541 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.541 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.541 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.541 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T09:47:03.541 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T09:47:03.542 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.542 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.542 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.542 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.542 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.542 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.542 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.542 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.542 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.542 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.542 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.542 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.542 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T09:47:03.542 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T09:47:03.542 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.543 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.543 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.543 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-19T09:47:03.543 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.543 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.543 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.543 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.543 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.543 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.543 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.543 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.543 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T09:47:03.543 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T09:47:03.543 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.544 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.544 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.544 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.544 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.544 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.544 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.544 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.544 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.544 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.544 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.544 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.544 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T09:47:03.544 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T09:47:03.545 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.545 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.545 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.545 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.545 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.545 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.545 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.545 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.545 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.545 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.545 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.545 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.545 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T09:47:03.545 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T09:47:03.546 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.546 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.546 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.546 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T09:47:03.546 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.546 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.546 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.546 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.546 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.546 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.546 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.546 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.546 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T09:47:03.546 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T09:47:03.547 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.547 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.547 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.547 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:47:03.547 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.547 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.547 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.547 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.547 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.547 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.547 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.547 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.547 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T09:47:03.547 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T09:47:03.548 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.548 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.548 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.548 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T09:47:03.548 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.548 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.548 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.548 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.548 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.548 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.548 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.548 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.549 INFO:teuthology.orchestra.run.smithi001.stdout: "cross_origin_url": { 2024-09-19T09:47:03.549 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cross_origin_url", 2024-09-19T09:47:03.549 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.549 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.549 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.549 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.549 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.549 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.549 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.549 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.549 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.549 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.549 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.549 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.550 INFO:teuthology.orchestra.run.smithi001.stdout: "crt_file": { 2024-09-19T09:47:03.550 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crt_file", 2024-09-19T09:47:03.550 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.550 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.550 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.550 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.550 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.550 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.550 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.550 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.550 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.550 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.550 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.550 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.551 INFO:teuthology.orchestra.run.smithi001.stdout: "debug": { 2024-09-19T09:47:03.551 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "debug", 2024-09-19T09:47:03.551 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.551 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.551 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.551 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.551 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.551 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.551 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.551 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable/disable debug options", 2024-09-19T09:47:03.551 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.551 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.551 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.552 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.552 INFO:teuthology.orchestra.run.smithi001.stdout: "jwt_token_ttl": { 2024-09-19T09:47:03.552 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "jwt_token_ttl", 2024-09-19T09:47:03.552 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.552 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.552 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.552 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "28800", 2024-09-19T09:47:03.552 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.552 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.552 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.552 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.552 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.552 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.552 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.553 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.553 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-19T09:47:03.553 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-19T09:47:03.553 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.553 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.553 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.553 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.553 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.553 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.553 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.553 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.553 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.553 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.553 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.554 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.554 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.554 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.554 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.554 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.554 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.554 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.554 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.554 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.554 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.554 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.554 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.554 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.555 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.555 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.555 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.555 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.555 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.555 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.555 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.555 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.555 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.555 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.555 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.555 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.555 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.555 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.556 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.556 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.556 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.556 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.556 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.556 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.556 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.556 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.556 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.556 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.556 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.556 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.556 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.556 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.557 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.557 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.557 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.557 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.557 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.557 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.557 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.557 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.557 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.557 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.557 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.557 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.557 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.558 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.558 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.558 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.558 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.558 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.558 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.558 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.558 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.558 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.558 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.558 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.558 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.558 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.558 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.559 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.559 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.559 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.559 INFO:teuthology.orchestra.run.smithi001.stdout: "motd": { 2024-09-19T09:47:03.559 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "motd", 2024-09-19T09:47:03.559 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.559 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.559 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.559 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.559 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.559 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.559 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.559 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "The message of the day", 2024-09-19T09:47:03.559 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.560 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.560 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.560 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.560 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect_resolve_ip_addr": { 2024-09-19T09:47:03.560 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T09:47:03.560 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.560 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.560 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.560 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.560 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.560 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.560 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.560 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.561 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.561 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.561 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.561 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.561 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-19T09:47:03.561 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-19T09:47:03.561 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.561 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.561 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.561 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-19T09:47:03.561 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.561 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.561 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.561 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.562 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.562 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.562 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.562 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.562 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-19T09:47:03.562 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-19T09:47:03.562 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.562 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.562 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.562 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8080", 2024-09-19T09:47:03.562 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.562 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.562 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.563 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.563 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.563 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.563 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.563 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.563 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-19T09:47:03.563 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-19T09:47:03.563 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.563 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.563 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.563 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.563 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.563 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.563 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.564 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.564 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.564 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.564 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.564 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.564 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl_server_port": { 2024-09-19T09:47:03.564 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl_server_port", 2024-09-19T09:47:03.564 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.564 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.564 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.564 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8443", 2024-09-19T09:47:03.564 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.564 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.564 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.565 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.565 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.565 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.565 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.565 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.565 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-19T09:47:03.565 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-19T09:47:03.565 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.565 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.565 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.565 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "redirect", 2024-09-19T09:47:03.565 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.566 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.566 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.566 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.566 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect" 2024-09-19T09:47:03.566 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.566 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.566 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.566 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.566 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.566 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.566 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-19T09:47:03.566 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-19T09:47:03.566 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.567 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.567 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.567 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-19T09:47:03.567 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-19T09:47:03.567 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-19T09:47:03.567 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.567 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.567 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.567 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.567 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.567 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.567 INFO:teuthology.orchestra.run.smithi001.stdout: "url_prefix": { 2024-09-19T09:47:03.567 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url_prefix", 2024-09-19T09:47:03.567 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.568 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.568 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.568 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.568 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.568 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.568 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.568 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.568 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.568 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.568 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.568 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.568 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.568 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.569 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.569 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "devicehealth", 2024-09-19T09:47:03.569 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.569 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.569 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.569 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_monitoring": { 2024-09-19T09:47:03.569 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_monitoring", 2024-09-19T09:47:03.569 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.569 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.569 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.569 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.569 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.569 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.570 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.570 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "monitor device health metrics", 2024-09-19T09:47:03.570 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.570 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.570 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.570 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.570 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.570 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.570 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.570 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.570 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.570 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.570 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.570 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.571 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.571 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.571 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.571 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.571 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.571 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.571 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.571 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.571 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.571 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.571 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.571 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.571 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.572 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.572 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.572 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.572 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.572 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.572 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.572 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.572 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.572 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.572 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.572 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.572 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.572 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.572 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.572 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.573 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.573 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.573 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.573 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.573 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.573 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.573 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.573 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.573 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.573 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.573 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.573 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.574 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.574 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.574 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.574 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.574 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.574 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.574 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.574 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.574 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.574 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.574 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.574 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.574 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.574 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.574 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.575 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.575 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.575 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.575 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.575 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.575 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.575 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.575 INFO:teuthology.orchestra.run.smithi001.stdout: "mark_out_threshold": { 2024-09-19T09:47:03.575 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mark_out_threshold", 2024-09-19T09:47:03.575 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:03.575 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.575 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.575 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2419200", 2024-09-19T09:47:03.575 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.576 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.576 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.576 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T09:47:03.576 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.576 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.576 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.576 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.576 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": { 2024-09-19T09:47:03.576 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_name", 2024-09-19T09:47:03.576 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.576 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.576 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.576 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "device_health_metrics", 2024-09-19T09:47:03.577 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.577 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.577 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.577 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T09:47:03.577 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.577 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.577 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.577 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.577 INFO:teuthology.orchestra.run.smithi001.stdout: "retention_period": { 2024-09-19T09:47:03.577 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retention_period", 2024-09-19T09:47:03.577 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:03.577 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.577 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.577 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15552000", 2024-09-19T09:47:03.578 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.578 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.578 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.578 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain device health metrics", 2024-09-19T09:47:03.578 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.578 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.578 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.578 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.578 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_frequency": { 2024-09-19T09:47:03.578 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_frequency", 2024-09-19T09:47:03.578 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:03.578 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.578 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.578 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-19T09:47:03.578 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.579 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.579 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.579 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T09:47:03.579 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.579 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.579 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.579 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.579 INFO:teuthology.orchestra.run.smithi001.stdout: "self_heal": { 2024-09-19T09:47:03.579 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "self_heal", 2024-09-19T09:47:03.579 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.579 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.579 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.579 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.580 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.580 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.580 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.580 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T09:47:03.580 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.580 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.580 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.580 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.580 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T09:47:03.580 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T09:47:03.580 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:03.580 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.580 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.580 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T09:47:03.581 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.581 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.581 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.581 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T09:47:03.581 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.581 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.581 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.581 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.581 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_threshold": { 2024-09-19T09:47:03.581 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_threshold", 2024-09-19T09:47:03.581 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:03.581 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.581 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.581 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7257600", 2024-09-19T09:47:03.582 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.582 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.582 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.582 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T09:47:03.582 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.582 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.582 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.582 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.582 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.582 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.582 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.582 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "diskprediction_local", 2024-09-19T09:47:03.582 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.582 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.582 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.583 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.583 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.583 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.583 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.583 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.583 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.583 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.583 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.583 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.583 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.583 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.583 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.583 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.583 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.583 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.584 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.584 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.584 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.584 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.584 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.584 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.584 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.584 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.584 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.584 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.584 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.584 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.584 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.585 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.585 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.585 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.585 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.585 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.585 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.585 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.585 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.585 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.585 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.585 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.585 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.585 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.585 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.585 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.586 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.586 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.586 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.586 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.586 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.586 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.586 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.586 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.586 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.586 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.586 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.586 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.586 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.586 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.586 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.587 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.587 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.587 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.587 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.587 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.587 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.587 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.587 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.587 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.587 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.587 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.587 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.587 INFO:teuthology.orchestra.run.smithi001.stdout: "predict_interval": { 2024-09-19T09:47:03.587 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predict_interval", 2024-09-19T09:47:03.588 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.588 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.588 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.588 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-19T09:47:03.588 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.588 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.588 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.588 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.588 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.588 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.588 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.588 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.588 INFO:teuthology.orchestra.run.smithi001.stdout: "predictor_model": { 2024-09-19T09:47:03.588 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predictor_model", 2024-09-19T09:47:03.589 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.589 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.589 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.589 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "prophetstor", 2024-09-19T09:47:03.589 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.589 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.589 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.589 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.589 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.589 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.589 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.589 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.589 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T09:47:03.590 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T09:47:03.590 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.590 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.590 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.590 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T09:47:03.590 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.590 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.590 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.590 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.590 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.590 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.590 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.590 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.590 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.590 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.590 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.591 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "influx", 2024-09-19T09:47:03.591 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": false, 2024-09-19T09:47:03.591 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "influxdb python module not found", 2024-09-19T09:47:03.591 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.591 INFO:teuthology.orchestra.run.smithi001.stdout: "batch_size": { 2024-09-19T09:47:03.591 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "batch_size", 2024-09-19T09:47:03.591 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.591 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.591 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.591 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5000", 2024-09-19T09:47:03.591 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.591 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.591 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.591 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T09:47:03.591 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.591 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.592 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.592 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.592 INFO:teuthology.orchestra.run.smithi001.stdout: "database": { 2024-09-19T09:47:03.592 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "database", 2024-09-19T09:47:03.592 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.592 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.592 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.592 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "ceph", 2024-09-19T09:47:03.592 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.592 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.592 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.592 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T09:47:03.592 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.593 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.593 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.593 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.593 INFO:teuthology.orchestra.run.smithi001.stdout: "hostname": { 2024-09-19T09:47:03.593 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hostname", 2024-09-19T09:47:03.593 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.593 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.593 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.593 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.593 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.593 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.593 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.593 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server hostname", 2024-09-19T09:47:03.593 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.593 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.594 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.594 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.594 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T09:47:03.594 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T09:47:03.594 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:03.594 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.594 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.594 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "30", 2024-09-19T09:47:03.594 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "5", 2024-09-19T09:47:03.594 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.594 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.594 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T09:47:03.594 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.594 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.594 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.595 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.595 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.595 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.595 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.595 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.595 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.595 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.595 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.595 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.595 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.595 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.595 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.595 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.595 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.595 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.595 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.596 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.596 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.596 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.596 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.596 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.596 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.596 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.596 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.596 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.596 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.596 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.596 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.596 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.597 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.597 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.597 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.597 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.597 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.597 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.597 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.597 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.597 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.597 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.597 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.597 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.597 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.598 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.598 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.598 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.598 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.598 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.598 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.598 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.598 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.598 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.598 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.598 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.598 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.598 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.598 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.599 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.599 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.599 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.599 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.599 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.599 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.599 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.599 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.599 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.599 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.599 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.599 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.599 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.599 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.600 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.600 INFO:teuthology.orchestra.run.smithi001.stdout: "password": { 2024-09-19T09:47:03.600 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "password", 2024-09-19T09:47:03.600 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.600 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.600 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.600 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.600 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.600 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.600 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.600 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "password of InfluxDB server user", 2024-09-19T09:47:03.600 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.600 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.601 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.601 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.601 INFO:teuthology.orchestra.run.smithi001.stdout: "port": { 2024-09-19T09:47:03.601 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "port", 2024-09-19T09:47:03.601 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.601 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.601 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.601 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8086", 2024-09-19T09:47:03.601 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.601 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.601 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.601 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server port", 2024-09-19T09:47:03.601 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.602 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.602 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.602 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.602 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-19T09:47:03.602 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-19T09:47:03.602 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.602 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.602 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.602 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "false", 2024-09-19T09:47:03.602 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.602 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.602 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.602 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:47:03.602 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.602 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.603 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.603 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.603 INFO:teuthology.orchestra.run.smithi001.stdout: "threads": { 2024-09-19T09:47:03.603 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threads", 2024-09-19T09:47:03.603 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.603 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.603 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.603 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T09:47:03.603 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T09:47:03.603 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "32", 2024-09-19T09:47:03.603 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.603 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T09:47:03.603 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.604 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.604 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.604 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.604 INFO:teuthology.orchestra.run.smithi001.stdout: "username": { 2024-09-19T09:47:03.604 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "username", 2024-09-19T09:47:03.604 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.604 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.604 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.604 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.604 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.604 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.604 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.604 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "username of InfluxDB server user", 2024-09-19T09:47:03.605 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.605 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.605 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.605 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.605 INFO:teuthology.orchestra.run.smithi001.stdout: "verify_ssl": { 2024-09-19T09:47:03.605 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "verify_ssl", 2024-09-19T09:47:03.605 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.605 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.605 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.605 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "true", 2024-09-19T09:47:03.605 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.605 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.605 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.606 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:47:03.606 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.606 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.606 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.606 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.606 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.606 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.606 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.606 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "insights", 2024-09-19T09:47:03.606 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.606 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.606 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.606 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.606 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.606 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.607 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.607 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.607 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.607 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.607 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.607 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.607 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.607 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.607 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.607 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.607 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.607 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.607 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.607 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.608 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.608 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.608 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.608 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.608 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.608 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.608 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.608 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.608 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.608 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.608 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.608 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.608 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.609 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.609 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.609 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.609 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.609 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.609 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.609 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.609 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.609 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.609 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.609 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.609 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.609 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.609 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.610 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.610 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.610 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.610 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.610 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.610 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.610 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.610 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.610 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.610 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.610 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.610 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.610 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.611 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.611 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.611 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.611 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.611 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.611 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.611 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.611 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.611 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.611 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.611 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.611 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.611 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.611 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.612 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.612 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.612 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "iostat", 2024-09-19T09:47:03.612 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.612 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.612 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.612 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.612 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.612 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.612 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.612 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.612 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.613 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.613 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.613 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.613 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.613 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.613 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.613 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.613 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.613 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.613 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.613 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.616 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.616 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.616 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.616 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.616 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.616 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.616 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.616 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.616 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.616 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.617 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.617 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.617 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.617 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.617 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.617 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.617 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.617 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.617 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.617 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.617 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.617 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.617 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.617 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.618 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.618 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.618 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.618 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.618 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.618 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.618 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.618 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.618 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.618 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.618 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.618 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.618 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.618 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.618 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.619 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.619 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.619 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.619 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.619 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.619 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.619 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.619 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.619 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.619 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.619 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.619 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.619 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.619 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.619 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.620 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.620 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.620 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "k8sevents", 2024-09-19T09:47:03.620 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.620 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.620 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.620 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_event_retention_days": { 2024-09-19T09:47:03.620 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ceph_event_retention_days", 2024-09-19T09:47:03.620 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.620 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.620 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.620 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7", 2024-09-19T09:47:03.621 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.621 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.621 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.621 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T09:47:03.621 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.621 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.621 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.621 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.621 INFO:teuthology.orchestra.run.smithi001.stdout: "config_check_secs": { 2024-09-19T09:47:03.621 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_check_secs", 2024-09-19T09:47:03.621 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.621 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.621 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.621 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:47:03.622 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "10", 2024-09-19T09:47:03.622 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.622 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.622 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T09:47:03.622 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.622 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.622 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.622 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.622 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.622 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.622 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.622 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.623 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.623 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.623 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.623 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.623 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.623 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.623 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.623 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.623 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.623 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.623 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.623 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.623 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.623 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.624 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.624 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.624 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.624 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.624 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.624 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.624 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.624 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.624 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.624 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.624 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.624 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.624 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.625 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.625 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.625 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.625 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.625 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.625 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.625 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.625 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.625 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.625 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.625 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.625 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.625 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.626 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.626 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.626 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.626 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.626 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.626 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.626 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.626 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.626 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.626 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.626 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.626 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.626 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.626 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.627 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.627 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.627 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.627 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.627 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.627 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.627 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.627 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.627 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.627 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.627 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.627 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.627 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.628 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.628 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.628 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "localpool", 2024-09-19T09:47:03.628 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.628 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.628 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.628 INFO:teuthology.orchestra.run.smithi001.stdout: "failure_domain": { 2024-09-19T09:47:03.628 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "failure_domain", 2024-09-19T09:47:03.628 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.628 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.628 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.628 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "host", 2024-09-19T09:47:03.628 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.629 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.629 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.629 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "failure domain for any created local pool", 2024-09-19T09:47:03.629 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T09:47:03.629 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.629 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.629 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.629 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.629 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.629 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.629 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.629 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.629 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.630 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.630 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.630 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.630 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.630 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.630 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.630 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.630 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.630 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.630 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.630 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.630 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.630 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.630 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.631 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.631 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.631 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.631 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.631 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.631 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.631 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.631 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.631 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.631 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.631 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.631 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.631 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.632 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.632 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.632 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.632 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.632 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.632 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.632 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.632 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.632 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.632 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.632 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.632 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.632 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.633 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.633 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.633 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.633 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.633 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.633 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.633 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.633 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.633 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.633 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.633 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.633 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.633 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.634 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.634 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.634 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.634 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.634 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.634 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.634 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.634 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.634 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.634 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.634 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.634 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": { 2024-09-19T09:47:03.634 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_size", 2024-09-19T09:47:03.634 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.634 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.635 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.635 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.635 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.635 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.635 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.635 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default min_size for any created local pool", 2024-09-19T09:47:03.635 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T09:47:03.635 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.635 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.635 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.635 INFO:teuthology.orchestra.run.smithi001.stdout: "num_rep": { 2024-09-19T09:47:03.635 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "num_rep", 2024-09-19T09:47:03.635 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.635 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.635 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.635 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3", 2024-09-19T09:47:03.636 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.636 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.636 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.636 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default replica count for any created local pool", 2024-09-19T09:47:03.636 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.636 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.636 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.636 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.636 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": { 2024-09-19T09:47:03.636 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_num", 2024-09-19T09:47:03.636 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.637 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.637 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.637 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "128", 2024-09-19T09:47:03.637 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.637 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.637 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.637 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T09:47:03.637 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.637 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.637 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.637 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.637 INFO:teuthology.orchestra.run.smithi001.stdout: "prefix": { 2024-09-19T09:47:03.637 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prefix", 2024-09-19T09:47:03.637 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.638 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.638 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.638 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.638 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.638 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.638 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.638 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name prefix for any created local pool", 2024-09-19T09:47:03.638 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.638 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.638 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.638 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.638 INFO:teuthology.orchestra.run.smithi001.stdout: "subtree": { 2024-09-19T09:47:03.638 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "subtree", 2024-09-19T09:47:03.638 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.639 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.639 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.639 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "rack", 2024-09-19T09:47:03.639 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.639 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.639 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.639 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T09:47:03.639 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T09:47:03.639 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.639 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.639 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.639 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.640 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.640 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.640 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mds_autoscaler", 2024-09-19T09:47:03.640 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.640 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.640 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.640 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.640 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.640 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.640 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.640 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.640 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.640 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.640 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.641 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.641 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.641 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.641 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.641 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.641 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.641 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.641 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.641 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.641 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.641 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.641 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.641 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.642 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.642 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.642 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.642 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.642 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.642 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.642 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.642 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.642 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.642 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.642 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.642 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.642 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.642 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.643 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.643 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.643 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.643 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.643 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.643 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.643 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.643 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.643 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.643 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.643 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.643 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.643 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.643 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.644 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.644 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.644 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.644 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.644 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.644 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.644 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.644 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.644 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.644 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.644 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.644 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.644 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.645 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.645 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.645 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.645 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.645 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.645 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.645 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.645 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.645 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.645 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.645 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.645 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirroring", 2024-09-19T09:47:03.645 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.646 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.646 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.646 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.646 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.646 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.646 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.646 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.646 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.646 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.646 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.646 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.646 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.646 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.646 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.647 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.647 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.647 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.647 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.647 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.647 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.647 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.647 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.647 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.647 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.647 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.647 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.647 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.648 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.648 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.648 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.648 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.648 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.648 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.648 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.648 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.648 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.648 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.648 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.648 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.648 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.648 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.649 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.649 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.649 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.649 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.649 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.649 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.649 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.649 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.649 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.649 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.649 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.649 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.649 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.650 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.650 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.650 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.650 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.650 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.650 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.650 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.650 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.650 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.650 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.650 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.650 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.650 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.651 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.651 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.651 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.651 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.651 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.651 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.651 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.651 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.651 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "nfs", 2024-09-19T09:47:03.651 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.651 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.651 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.651 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.651 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.652 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.652 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.652 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.652 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.652 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.652 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.652 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.652 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.652 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.652 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.652 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.652 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.652 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.653 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.653 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.653 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.653 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.653 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.653 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.653 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.653 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.653 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.653 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.653 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.653 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.653 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.653 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.654 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.654 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.654 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.654 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.654 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.654 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.654 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.654 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.654 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.654 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.654 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.654 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.654 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.654 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.655 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.655 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.655 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.655 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.655 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.655 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.655 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.655 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.655 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.655 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.655 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.655 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.655 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.655 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.656 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.656 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.656 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.656 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.656 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.656 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.656 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.656 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.656 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.656 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.656 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.656 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.656 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.657 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.657 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.657 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.657 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-19T09:47:03.657 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.657 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.657 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.657 INFO:teuthology.orchestra.run.smithi001.stdout: "fail_fs": { 2024-09-19T09:47:03.657 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "fail_fs", 2024-09-19T09:47:03.657 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.657 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.657 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.657 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.658 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.658 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.658 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.658 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T09:47:03.658 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.658 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.658 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.658 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.658 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.658 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.658 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.658 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.658 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.658 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.659 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.659 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.659 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.659 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.659 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.659 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.659 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.659 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.659 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.659 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.659 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.659 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.659 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.659 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.660 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.660 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.660 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.660 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.660 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.660 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.660 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.660 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.660 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.660 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.660 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.660 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.660 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.660 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.661 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.661 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.661 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.661 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.661 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.661 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.661 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.661 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.661 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.661 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.661 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.661 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.661 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.661 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.662 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.662 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.662 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.662 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.662 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.662 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.662 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.662 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.662 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.662 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.662 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.662 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.662 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.662 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.663 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.663 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.663 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.663 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.663 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.663 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.663 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.663 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.663 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator": { 2024-09-19T09:47:03.663 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-19T09:47:03.663 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.663 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.663 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.663 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.664 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.664 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.664 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.664 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm", 2024-09-19T09:47:03.664 INFO:teuthology.orchestra.run.smithi001.stdout: "rook", 2024-09-19T09:47:03.664 INFO:teuthology.orchestra.run.smithi001.stdout: "test_orchestrator" 2024-09-19T09:47:03.664 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.664 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Orchestrator backend", 2024-09-19T09:47:03.664 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.664 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.664 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.664 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.664 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.665 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.665 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.665 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_perf_query", 2024-09-19T09:47:03.665 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.665 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.665 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.665 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.665 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.665 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.665 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.665 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.665 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.666 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.666 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.666 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.666 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.666 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.666 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.666 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.666 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.666 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.666 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.666 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.666 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.666 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.667 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.667 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.667 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.667 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.667 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.667 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.667 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.667 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.667 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.667 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.667 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.667 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.667 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.667 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.668 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.668 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.668 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.668 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.668 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.668 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.668 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.668 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.668 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.668 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.668 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.668 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.668 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.669 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.669 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.669 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.669 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.669 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.669 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.669 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.669 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.669 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.669 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.669 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.669 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.669 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.669 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.670 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.670 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.670 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.670 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.670 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.670 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.670 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.670 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.670 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.670 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.670 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.670 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.670 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.671 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_support", 2024-09-19T09:47:03.671 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.671 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.671 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.671 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.671 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.671 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.671 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.671 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.671 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.671 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.671 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.671 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.671 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.672 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.672 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.672 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.672 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.672 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.672 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.672 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.672 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.672 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.672 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.672 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.672 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.672 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.673 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.673 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.673 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.673 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.673 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.673 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.673 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.673 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.673 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.673 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.673 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.673 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.673 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.673 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.674 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.674 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.674 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.674 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.674 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.674 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.674 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.674 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.674 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.674 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.674 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.674 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.674 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.674 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.675 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.675 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.675 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.675 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.675 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.675 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.675 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.675 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.675 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.675 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.675 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.675 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.675 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.675 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.676 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.676 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.676 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.676 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.676 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.676 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.676 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.676 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.676 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_autoscaler", 2024-09-19T09:47:03.676 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.676 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.676 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.676 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.676 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.677 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.677 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.677 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.677 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.677 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.677 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.677 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.677 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.677 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.677 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.677 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.677 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.677 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.677 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.678 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.678 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.678 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.678 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.678 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.678 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.678 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.678 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.678 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.678 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.678 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.678 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.678 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.678 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.679 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.679 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.679 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.679 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.679 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.679 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.679 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.679 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.679 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.679 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.679 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.679 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.680 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.680 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.680 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.680 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.680 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.680 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.680 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.680 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.680 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.680 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.680 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.680 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.680 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.681 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.681 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.681 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.681 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.681 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.681 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.681 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.681 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.681 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.681 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.681 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.681 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.681 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.681 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.682 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.682 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T09:47:03.682 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T09:47:03.682 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:03.682 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.682 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.682 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T09:47:03.682 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.682 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.682 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.682 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.682 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.683 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.683 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.683 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.683 INFO:teuthology.orchestra.run.smithi001.stdout: "threshold": { 2024-09-19T09:47:03.683 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threshold", 2024-09-19T09:47:03.683 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:47:03.683 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.683 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.683 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-19T09:47:03.683 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1.0", 2024-09-19T09:47:03.683 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.683 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.683 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "scaling threshold", 2024-09-19T09:47:03.684 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T09:47:03.684 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.684 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.684 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.684 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.684 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.684 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.684 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "progress", 2024-09-19T09:47:03.684 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.684 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.684 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.684 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_pg_recovery_event": { 2024-09-19T09:47:03.684 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_pg_recovery_event", 2024-09-19T09:47:03.685 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.685 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.685 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.685 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.685 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.685 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.685 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.685 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T09:47:03.685 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.685 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.685 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.685 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.685 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-19T09:47:03.686 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-19T09:47:03.686 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.686 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.686 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.686 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.686 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.686 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.686 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.686 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.686 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.686 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.686 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.686 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.686 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.687 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.687 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.687 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.687 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.687 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.687 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.687 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.687 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.687 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.687 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.687 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.687 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.687 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.687 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.688 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.688 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.688 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.688 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.688 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.688 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.688 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.688 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.688 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.688 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.688 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.688 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.688 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.688 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.689 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.689 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.689 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.689 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.689 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.689 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.689 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.689 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.689 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.689 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.689 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.689 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.689 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.690 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.690 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.690 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.690 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.690 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.690 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.690 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.690 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.690 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.690 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.690 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.690 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.690 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.690 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.691 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.691 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.691 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.691 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.691 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.691 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.691 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.691 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.691 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.691 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.691 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.691 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.691 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.692 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.692 INFO:teuthology.orchestra.run.smithi001.stdout: "max_completed_events": { 2024-09-19T09:47:03.692 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_completed_events", 2024-09-19T09:47:03.692 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.692 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.692 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.692 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "50", 2024-09-19T09:47:03.692 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.692 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.692 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.692 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "number of past completed events to remember", 2024-09-19T09:47:03.692 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.692 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.693 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.693 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.693 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T09:47:03.693 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T09:47:03.693 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:03.693 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.693 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.693 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T09:47:03.693 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.693 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.693 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.693 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long the module is going to sleep", 2024-09-19T09:47:03.693 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.693 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.694 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.694 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.694 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.694 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.694 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.694 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus", 2024-09-19T09:47:03.694 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.694 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.694 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.694 INFO:teuthology.orchestra.run.smithi001.stdout: "cache": { 2024-09-19T09:47:03.694 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cache", 2024-09-19T09:47:03.694 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.694 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.694 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.695 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.695 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.695 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.695 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.695 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.695 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.695 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.695 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.695 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.695 INFO:teuthology.orchestra.run.smithi001.stdout: "exclude_perf_counters": { 2024-09-19T09:47:03.695 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "exclude_perf_counters", 2024-09-19T09:47:03.695 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.695 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.695 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.695 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.695 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.696 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.696 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.696 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T09:47:03.696 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T09:47:03.696 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.696 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.696 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.696 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.696 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.696 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.696 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.696 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.696 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.697 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.697 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.697 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.697 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.697 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.697 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.697 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.697 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.697 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.697 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.697 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.697 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.697 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.697 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.698 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.698 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.698 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.698 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.698 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.698 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.698 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.698 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.698 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.698 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.698 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.698 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.698 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.698 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.698 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.699 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.699 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.699 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.699 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.699 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.699 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.699 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.699 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.699 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.699 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.699 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.699 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.699 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.699 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.699 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.700 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.700 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.700 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.700 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.700 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.700 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.700 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.700 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.700 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.700 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.700 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.700 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.700 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.701 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.701 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.701 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.701 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.701 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.701 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.701 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.701 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools": { 2024-09-19T09:47:03.701 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools", 2024-09-19T09:47:03.701 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.701 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.701 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.701 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.701 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.701 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.702 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.702 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.702 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.702 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.702 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.702 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.702 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T09:47:03.702 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T09:47:03.702 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.702 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.702 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.702 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "300", 2024-09-19T09:47:03.702 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.702 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.703 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.703 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.703 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.703 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.703 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.703 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.703 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_interval": { 2024-09-19T09:47:03.703 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_interval", 2024-09-19T09:47:03.703 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:47:03.703 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.703 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.703 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15.0", 2024-09-19T09:47:03.703 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.703 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.703 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.703 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.704 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.704 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.704 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.704 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.704 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-19T09:47:03.704 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-19T09:47:03.704 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.704 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.704 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.704 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-19T09:47:03.704 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.704 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.704 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.704 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T09:47:03.705 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.705 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.705 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.705 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.705 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-19T09:47:03.705 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-19T09:47:03.705 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.705 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.705 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.705 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "9283", 2024-09-19T09:47:03.705 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.705 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.705 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.705 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T09:47:03.705 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.706 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.706 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.706 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.706 INFO:teuthology.orchestra.run.smithi001.stdout: "stale_cache_strategy": { 2024-09-19T09:47:03.706 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stale_cache_strategy", 2024-09-19T09:47:03.706 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.706 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.706 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.706 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "log", 2024-09-19T09:47:03.706 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.706 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.706 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.706 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.706 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.707 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.707 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.707 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.707 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-19T09:47:03.707 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-19T09:47:03.707 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.707 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.707 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.707 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "default", 2024-09-19T09:47:03.707 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.707 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.707 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.707 INFO:teuthology.orchestra.run.smithi001.stdout: "default", 2024-09-19T09:47:03.707 INFO:teuthology.orchestra.run.smithi001.stdout: "error" 2024-09-19T09:47:03.707 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.707 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.708 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.708 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.708 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.708 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.708 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-19T09:47:03.708 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-19T09:47:03.708 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.708 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.708 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.708 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-19T09:47:03.708 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-19T09:47:03.708 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-19T09:47:03.708 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.708 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.709 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.709 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.709 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.709 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.709 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.709 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.709 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.709 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_support", 2024-09-19T09:47:03.709 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.709 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.709 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.709 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.709 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.709 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.709 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.710 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.710 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.710 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.710 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.710 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.710 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.710 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.710 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.710 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.710 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.710 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.710 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.710 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.710 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.711 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.711 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.711 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.711 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.711 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.711 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.711 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.711 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.711 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.711 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.711 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.711 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.711 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.711 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.712 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.712 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.712 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.712 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.712 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.712 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.712 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.712 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.712 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.712 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.712 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.712 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.712 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.712 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.713 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.713 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.713 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.713 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.713 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.713 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.713 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.713 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.713 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.713 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.713 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.713 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.713 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.714 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.714 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.714 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.714 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.714 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.714 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.714 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.714 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.714 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.714 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.714 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.714 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_snap_create": { 2024-09-19T09:47:03.714 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_snap_create", 2024-09-19T09:47:03.714 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.715 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.715 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.715 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:47:03.715 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.715 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.715 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.715 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.715 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.715 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.715 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.715 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.715 INFO:teuthology.orchestra.run.smithi001.stdout: "mirror_snapshot_schedule": { 2024-09-19T09:47:03.715 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T09:47:03.715 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.715 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.716 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.716 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.716 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.716 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.716 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.716 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.716 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.716 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.716 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.716 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.716 INFO:teuthology.orchestra.run.smithi001.stdout: "trash_purge_schedule": { 2024-09-19T09:47:03.716 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "trash_purge_schedule", 2024-09-19T09:47:03.716 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.716 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.717 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.717 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.717 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.717 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.717 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.717 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.717 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.717 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.717 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.717 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.717 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.717 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.717 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.717 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "restful", 2024-09-19T09:47:03.717 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.718 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.718 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.718 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_auth": { 2024-09-19T09:47:03.718 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_auth", 2024-09-19T09:47:03.718 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.718 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.718 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.718 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.718 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.718 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.718 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.718 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.718 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.718 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.718 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.718 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.719 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-19T09:47:03.719 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-19T09:47:03.719 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.719 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.719 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.719 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.719 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.719 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.719 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.719 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.719 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.720 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.720 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.720 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.720 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.720 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.720 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.720 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.720 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.720 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.720 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.720 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.720 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.721 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.721 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.721 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.721 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.721 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.721 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.721 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.721 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.721 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.721 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.721 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.721 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.721 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.721 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.722 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.722 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.722 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.722 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.722 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.722 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.722 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.722 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.722 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.722 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.722 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.722 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.722 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.722 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.722 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.723 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.723 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.723 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.723 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.723 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.723 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.723 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.723 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.723 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.723 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.723 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.723 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.723 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.723 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.723 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.723 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.724 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.724 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.724 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.724 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.724 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.724 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.724 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.724 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.724 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.724 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.724 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.724 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.724 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.724 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.724 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.725 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.725 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-19T09:47:03.725 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-19T09:47:03.725 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.725 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.725 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.725 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.725 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.725 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.725 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.725 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.725 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.725 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.725 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.726 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.726 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-19T09:47:03.726 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-19T09:47:03.726 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.726 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.726 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.726 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.726 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.726 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.726 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.726 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.726 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.726 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.727 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.727 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.727 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.727 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.727 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.727 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rgw", 2024-09-19T09:47:03.727 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.727 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.727 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.727 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.727 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.727 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.727 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.728 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.728 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.728 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.728 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.728 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.728 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.728 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.728 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.728 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.728 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.728 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.728 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.728 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.729 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.729 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.729 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.729 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.729 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.729 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.729 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.729 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.729 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.729 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.729 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.729 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.729 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.729 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.730 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.730 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.730 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.730 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.730 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.730 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.730 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.730 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.730 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.730 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.730 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.730 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.730 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.730 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.730 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.731 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.731 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.731 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.731 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.731 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.731 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.731 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.731 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.731 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.731 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.731 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.731 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.731 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.731 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.732 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.732 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.732 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.732 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.732 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.732 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.732 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.732 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.732 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.732 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.732 INFO:teuthology.orchestra.run.smithi001.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T09:47:03.732 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T09:47:03.732 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.733 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.733 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.733 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T09:47:03.733 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.733 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.733 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.733 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T09:47:03.733 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.733 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.733 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.733 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.733 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.733 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.734 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.734 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rook", 2024-09-19T09:47:03.734 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.734 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.734 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.734 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.734 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.734 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.734 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.734 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.734 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.734 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.734 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.735 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.735 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.735 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.735 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.735 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.735 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.735 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.735 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.735 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.735 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.735 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.735 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.736 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.736 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.736 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.736 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.736 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.736 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.736 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.736 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.736 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.736 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.736 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.736 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.736 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.737 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.737 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.737 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.737 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.737 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.737 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.737 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.737 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.737 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.737 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.737 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.738 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.738 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.738 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.738 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.738 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.738 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.738 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.738 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.738 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.738 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.738 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.738 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.738 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.739 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.739 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.739 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.739 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.739 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.739 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.739 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.739 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.739 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.739 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.739 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.739 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.739 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.739 INFO:teuthology.orchestra.run.smithi001.stdout: "storage_class": { 2024-09-19T09:47:03.740 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "storage_class", 2024-09-19T09:47:03.740 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.740 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.740 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.740 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "local", 2024-09-19T09:47:03.740 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.740 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.740 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.740 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T09:47:03.740 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.740 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.740 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.741 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.741 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.741 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.741 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.741 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "selftest", 2024-09-19T09:47:03.741 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.741 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.741 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.741 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.741 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.741 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.741 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.741 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.741 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.742 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.742 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.742 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.742 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.742 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.742 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.742 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.742 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.742 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.742 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.742 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.742 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.742 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.742 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.743 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.743 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.743 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.743 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.743 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.743 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.743 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.743 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.743 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.743 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.743 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.743 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.743 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.744 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.744 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.744 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.744 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.744 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.744 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.744 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.744 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.744 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.744 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.744 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.744 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.744 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.744 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.745 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.745 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.745 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.745 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.745 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.745 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.745 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.745 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.745 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.745 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.745 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.745 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.745 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.745 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.746 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.746 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.746 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.746 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.746 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.746 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.746 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.746 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.746 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.746 INFO:teuthology.orchestra.run.smithi001.stdout: "roption1": { 2024-09-19T09:47:03.746 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption1", 2024-09-19T09:47:03.746 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.746 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.746 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.746 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.747 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.747 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.747 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.747 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.747 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.747 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.747 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.747 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.747 INFO:teuthology.orchestra.run.smithi001.stdout: "roption2": { 2024-09-19T09:47:03.747 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption2", 2024-09-19T09:47:03.747 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.747 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.747 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.748 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "xyz", 2024-09-19T09:47:03.748 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.748 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.748 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.748 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.748 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.748 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.748 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.748 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.748 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption1": { 2024-09-19T09:47:03.748 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption1", 2024-09-19T09:47:03.748 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.748 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.749 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.749 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.749 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.749 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.749 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.749 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.749 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.749 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.749 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.749 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.749 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption2": { 2024-09-19T09:47:03.749 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption2", 2024-09-19T09:47:03.749 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.749 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.750 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.750 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.750 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.750 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.750 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.750 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.750 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.750 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.750 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.750 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.750 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption3": { 2024-09-19T09:47:03.750 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption3", 2024-09-19T09:47:03.750 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:47:03.750 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.750 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.751 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.751 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.751 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.751 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.751 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.751 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.751 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.751 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.751 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.751 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption4": { 2024-09-19T09:47:03.751 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption4", 2024-09-19T09:47:03.751 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.751 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.751 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.751 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.751 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.752 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.752 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.752 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.752 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.752 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.752 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.752 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.752 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption5": { 2024-09-19T09:47:03.752 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption5", 2024-09-19T09:47:03.752 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.752 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.752 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.752 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.752 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.752 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.753 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.753 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.753 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.753 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.753 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.753 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.753 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption6": { 2024-09-19T09:47:03.753 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption6", 2024-09-19T09:47:03.753 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.753 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.753 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.753 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.753 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.753 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.754 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.754 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.754 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.754 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.754 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.754 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.754 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption7": { 2024-09-19T09:47:03.754 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption7", 2024-09-19T09:47:03.754 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.754 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.754 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.754 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.754 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T09:47:03.754 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "42", 2024-09-19T09:47:03.754 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.755 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.755 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.755 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.755 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.755 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.755 INFO:teuthology.orchestra.run.smithi001.stdout: "testkey": { 2024-09-19T09:47:03.755 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testkey", 2024-09-19T09:47:03.755 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.755 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.755 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.755 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.755 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.755 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.755 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.755 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.756 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.756 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.756 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.756 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.756 INFO:teuthology.orchestra.run.smithi001.stdout: "testlkey": { 2024-09-19T09:47:03.756 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testlkey", 2024-09-19T09:47:03.756 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.756 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.756 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.756 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.756 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.756 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.756 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.756 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.756 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.757 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.757 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.757 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.757 INFO:teuthology.orchestra.run.smithi001.stdout: "testnewline": { 2024-09-19T09:47:03.757 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testnewline", 2024-09-19T09:47:03.757 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.757 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.757 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.757 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.757 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.757 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.757 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.757 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.757 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.757 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.757 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.758 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.758 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.758 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.758 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.758 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snap_schedule", 2024-09-19T09:47:03.758 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.758 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.758 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.758 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_m_granularity": { 2024-09-19T09:47:03.758 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_m_granularity", 2024-09-19T09:47:03.758 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.758 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.758 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.758 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.758 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.759 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.759 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.759 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T09:47:03.759 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.759 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.759 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.759 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.759 INFO:teuthology.orchestra.run.smithi001.stdout: "dump_on_update": { 2024-09-19T09:47:03.759 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dump_on_update", 2024-09-19T09:47:03.759 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.759 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.759 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.759 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.759 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.760 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.760 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.760 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "dump database to debug log on update", 2024-09-19T09:47:03.760 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.760 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.760 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.760 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.760 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.760 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.760 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.760 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.760 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.760 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.760 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.760 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.761 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.761 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.761 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.761 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.761 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.761 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.761 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.761 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.761 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.761 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.761 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.761 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.761 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.761 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.762 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.762 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.762 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.762 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.762 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.762 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.762 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.762 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.762 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.762 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.762 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.762 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.763 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.763 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.763 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.763 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.763 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.763 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.763 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.763 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.763 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.763 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.763 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.763 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.763 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.763 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.764 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.764 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.764 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.764 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.764 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.764 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.764 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.764 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.764 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.764 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.764 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.764 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.764 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.765 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.765 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.765 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.765 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.765 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.765 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.765 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.765 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.765 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.765 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.765 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.765 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.765 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stats", 2024-09-19T09:47:03.766 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.766 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.766 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.766 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.766 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.766 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.766 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.766 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.766 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.766 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.766 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.766 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.766 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.767 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.767 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.767 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.767 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.767 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.767 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.767 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.767 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.767 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.767 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.767 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.767 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.767 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.767 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.768 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.768 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.768 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.768 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.768 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.768 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.768 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.768 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.768 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.768 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.768 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.768 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.768 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.768 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.768 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.769 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.769 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.769 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.769 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.769 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.769 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.769 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.769 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.769 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.769 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.769 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.769 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.769 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.770 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.770 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.770 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.770 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.770 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.770 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.770 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.770 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.770 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.770 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.770 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.770 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.770 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.770 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.771 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.771 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.771 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.771 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.771 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.771 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.771 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.771 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "status", 2024-09-19T09:47:03.771 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.771 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.771 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.771 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.771 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.771 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.772 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.772 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.772 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.772 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.772 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.772 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.772 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.772 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.772 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.772 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.772 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.772 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.772 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.772 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.773 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.773 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.773 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.773 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.773 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.773 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.773 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.773 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.773 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.773 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.773 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.773 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.773 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.773 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.773 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.774 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.774 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.774 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.774 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.774 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.774 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.774 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.774 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.774 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.774 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.774 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.774 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.775 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.775 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.775 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.775 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.775 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.775 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.775 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.775 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.775 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.775 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.775 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.775 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.775 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.775 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.776 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.776 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.776 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.776 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.776 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.776 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.776 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.776 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.776 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.776 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.776 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.776 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.776 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.777 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.777 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.777 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telegraf", 2024-09-19T09:47:03.777 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.777 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.777 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.777 INFO:teuthology.orchestra.run.smithi001.stdout: "address": { 2024-09-19T09:47:03.777 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "address", 2024-09-19T09:47:03.777 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.777 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.777 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.777 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T09:47:03.777 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.778 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.778 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.778 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.778 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.778 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.778 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.778 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.778 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T09:47:03.778 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T09:47:03.778 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:03.778 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.778 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.778 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15", 2024-09-19T09:47:03.779 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.779 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.779 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.779 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.779 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.779 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.779 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.779 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.779 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.779 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.779 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.779 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.779 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.779 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.780 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.780 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.780 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.780 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.780 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.780 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.780 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.780 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.780 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.780 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.780 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.780 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.780 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.781 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.781 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.781 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.781 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.781 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.781 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.781 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.781 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.781 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.781 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.781 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.781 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.781 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.782 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.782 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.782 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.782 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.782 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.782 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.782 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.782 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.782 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.782 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.782 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.782 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.782 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.783 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.783 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.783 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.783 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.783 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.783 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.783 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.783 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.783 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.783 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.783 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.783 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.783 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.784 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.784 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.784 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.784 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.784 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.784 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.784 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.784 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.784 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.784 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.784 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.784 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.784 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.784 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.785 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.785 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telemetry", 2024-09-19T09:47:03.785 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.785 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.785 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.785 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_basic": { 2024-09-19T09:47:03.785 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_basic", 2024-09-19T09:47:03.785 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.785 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.785 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.785 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.785 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.785 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.785 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.786 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T09:47:03.786 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.786 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.786 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.786 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.786 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_crash": { 2024-09-19T09:47:03.786 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_crash", 2024-09-19T09:47:03.786 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.786 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.786 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.786 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.786 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.786 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.786 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.787 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T09:47:03.787 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.787 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.787 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.787 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.787 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_device": { 2024-09-19T09:47:03.787 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_device", 2024-09-19T09:47:03.787 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.787 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.787 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.787 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.787 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.787 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.787 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.788 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T09:47:03.788 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.788 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.788 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.788 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.788 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_ident": { 2024-09-19T09:47:03.788 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_ident", 2024-09-19T09:47:03.788 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.788 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.788 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.788 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.788 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.788 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.788 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.789 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T09:47:03.789 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.789 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.789 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.789 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.789 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_perf": { 2024-09-19T09:47:03.789 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_perf", 2024-09-19T09:47:03.789 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.789 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.789 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.789 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.789 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.789 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.789 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.790 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T09:47:03.790 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.790 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.790 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.790 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.790 INFO:teuthology.orchestra.run.smithi001.stdout: "contact": { 2024-09-19T09:47:03.790 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "contact", 2024-09-19T09:47:03.790 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.790 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.790 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.790 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.790 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.790 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.790 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.790 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.791 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.791 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.791 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.791 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.791 INFO:teuthology.orchestra.run.smithi001.stdout: "description": { 2024-09-19T09:47:03.791 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "description", 2024-09-19T09:47:03.791 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.791 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.791 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.791 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.791 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.791 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.791 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.791 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.791 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.792 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.792 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.792 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.792 INFO:teuthology.orchestra.run.smithi001.stdout: "device_url": { 2024-09-19T09:47:03.792 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_url", 2024-09-19T09:47:03.792 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.792 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.792 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.792 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T09:47:03.792 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.792 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.792 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.792 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.792 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.792 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.793 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.793 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.793 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-19T09:47:03.793 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-19T09:47:03.793 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.793 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.793 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.793 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.793 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.793 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.793 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.793 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.793 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.793 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.793 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.794 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.794 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T09:47:03.794 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T09:47:03.794 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.794 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.794 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.794 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "24", 2024-09-19T09:47:03.794 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "8", 2024-09-19T09:47:03.794 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.794 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.794 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.794 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.794 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.794 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.794 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.795 INFO:teuthology.orchestra.run.smithi001.stdout: "last_opt_revision": { 2024-09-19T09:47:03.795 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "last_opt_revision", 2024-09-19T09:47:03.795 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.795 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.795 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.795 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1", 2024-09-19T09:47:03.795 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.795 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.795 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.795 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.795 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.795 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.795 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.795 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.795 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard": { 2024-09-19T09:47:03.796 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard", 2024-09-19T09:47:03.796 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.796 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.796 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.796 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.796 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.796 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.796 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.796 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.796 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.796 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.796 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.796 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.796 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard_description": { 2024-09-19T09:47:03.797 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard_description", 2024-09-19T09:47:03.797 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.797 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.797 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.797 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.797 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.797 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.797 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.797 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.797 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.797 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.797 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.797 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.797 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.798 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.798 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.798 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.798 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.798 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.798 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.798 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.798 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.798 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.798 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.798 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.798 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.798 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.798 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.798 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.799 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.799 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.799 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.799 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.799 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.799 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.799 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.799 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.799 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.799 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.799 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.799 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.799 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.799 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.799 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.799 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.800 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.800 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.800 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.800 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.800 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.800 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.800 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.800 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.800 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.800 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.800 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.800 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.800 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.800 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.801 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.801 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.801 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.801 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.801 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.801 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.801 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.801 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.801 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.801 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.801 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.801 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.801 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.801 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.802 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.802 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.802 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.802 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.802 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.802 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.802 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.802 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.802 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.802 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.802 INFO:teuthology.orchestra.run.smithi001.stdout: "organization": { 2024-09-19T09:47:03.802 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "organization", 2024-09-19T09:47:03.802 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.802 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.803 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.803 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.803 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.803 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.803 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.803 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.803 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.803 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.803 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.803 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.803 INFO:teuthology.orchestra.run.smithi001.stdout: "proxy": { 2024-09-19T09:47:03.803 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "proxy", 2024-09-19T09:47:03.803 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.804 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.804 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.804 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.804 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.804 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.804 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.804 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.804 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.804 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.804 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.804 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.804 INFO:teuthology.orchestra.run.smithi001.stdout: "url": { 2024-09-19T09:47:03.804 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url", 2024-09-19T09:47:03.805 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.805 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.805 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.805 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T09:47:03.805 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.805 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.805 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.805 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.805 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.805 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.805 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.805 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.805 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.806 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.806 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.806 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "test_orchestrator", 2024-09-19T09:47:03.806 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.806 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.806 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.806 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.806 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.806 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.806 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.806 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.806 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.806 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.806 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.807 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.807 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.807 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.807 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.807 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.807 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.807 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.807 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.807 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.807 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.807 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.807 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.807 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.807 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.808 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.808 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.808 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.808 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.808 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.808 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.808 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.808 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.808 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.808 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.808 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.808 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.808 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.809 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.809 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.809 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.809 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.809 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.809 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.809 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.809 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.809 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.809 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.809 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.809 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.809 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.809 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.809 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.810 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.810 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.810 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.810 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.810 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.810 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.810 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.810 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.810 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.810 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.810 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.810 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.810 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.810 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.811 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.811 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.811 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.811 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.811 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.811 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.811 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.811 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.811 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.811 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "volumes", 2024-09-19T09:47:03.811 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.811 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.811 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.812 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.812 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.812 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.812 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.812 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.812 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.812 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.812 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.812 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.812 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.812 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.812 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.812 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.812 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.813 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.813 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.813 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.813 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.813 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.813 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.813 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.813 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.813 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.813 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.813 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.813 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.813 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.814 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.814 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.814 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.814 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.814 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.814 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.814 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.814 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.814 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.814 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.814 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.814 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.814 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.815 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.815 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.815 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.815 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.815 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.815 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.815 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.815 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.815 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.815 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.815 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.815 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.815 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.815 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.815 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.816 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.816 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.816 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.816 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.816 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.816 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.816 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.816 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.816 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.816 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.816 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.816 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.816 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.816 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.817 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.817 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_clones": { 2024-09-19T09:47:03.817 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_clones", 2024-09-19T09:47:03.817 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.817 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.817 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.817 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4", 2024-09-19T09:47:03.817 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.817 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.817 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.817 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T09:47:03.817 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.817 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.818 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.818 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.818 INFO:teuthology.orchestra.run.smithi001.stdout: "periodic_async_work": { 2024-09-19T09:47:03.818 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "periodic_async_work", 2024-09-19T09:47:03.818 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.818 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.818 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.818 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.818 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.818 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.818 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.818 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Periodically check for async work", 2024-09-19T09:47:03.818 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.819 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.819 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.819 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.819 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_delay": { 2024-09-19T09:47:03.819 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_delay", 2024-09-19T09:47:03.819 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.819 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.819 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.819 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T09:47:03.819 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.819 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.819 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.819 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T09:47:03.819 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.820 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.820 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.820 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.820 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_no_wait": { 2024-09-19T09:47:03.820 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T09:47:03.820 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.820 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.820 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.820 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.820 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.820 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.820 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.820 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T09:47:03.820 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.820 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.821 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.821 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.821 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.821 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.821 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.821 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix", 2024-09-19T09:47:03.821 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.821 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.821 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.821 INFO:teuthology.orchestra.run.smithi001.stdout: "discovery_interval": { 2024-09-19T09:47:03.821 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "discovery_interval", 2024-09-19T09:47:03.821 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T09:47:03.821 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.822 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.822 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "100", 2024-09-19T09:47:03.822 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.822 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.822 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.822 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.822 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.822 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.822 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.822 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.822 INFO:teuthology.orchestra.run.smithi001.stdout: "identifier": { 2024-09-19T09:47:03.822 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "identifier", 2024-09-19T09:47:03.822 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.822 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.823 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.823 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.823 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.823 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.823 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.823 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.823 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.823 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.823 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.823 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.823 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T09:47:03.823 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T09:47:03.823 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:03.824 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.824 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.824 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T09:47:03.824 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.824 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.824 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.824 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.824 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.824 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.824 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.824 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.824 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.824 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.824 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.825 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.825 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.825 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.825 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.825 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.825 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.825 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.825 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.825 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.825 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.825 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.825 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.825 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.826 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.826 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.826 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.826 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.826 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.826 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.826 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.826 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.826 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.826 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.826 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.826 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.826 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.827 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.827 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.827 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.827 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.827 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.827 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.827 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.827 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.827 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.827 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.827 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.827 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.827 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.827 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.828 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.828 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.828 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.828 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.828 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.828 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.828 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.828 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.828 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.828 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.828 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.828 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.828 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.829 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.829 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.829 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.829 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.829 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.829 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.829 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.829 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.829 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.829 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.829 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.829 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.829 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.829 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.830 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_host": { 2024-09-19T09:47:03.830 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_host", 2024-09-19T09:47:03.830 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.830 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.830 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.830 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.830 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.830 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.830 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.830 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.830 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.830 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.830 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.830 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.830 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_port": { 2024-09-19T09:47:03.831 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_port", 2024-09-19T09:47:03.831 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.831 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.831 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.831 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10051", 2024-09-19T09:47:03.831 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.831 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.831 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.831 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.831 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.831 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.831 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.831 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.832 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_sender": { 2024-09-19T09:47:03.832 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_sender", 2024-09-19T09:47:03.832 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.832 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.832 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.832 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T09:47:03.832 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.832 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.832 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.832 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.832 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.832 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.832 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.833 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.833 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.833 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.833 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-19T09:47:03.833 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.833 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.833 INFO:teuthology.orchestra.run.smithi001.stdout: "gid": 24116, 2024-09-19T09:47:03.833 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "y", 2024-09-19T09:47:03.833 INFO:teuthology.orchestra.run.smithi001.stdout: "mgr_features": 4540701547738038271, 2024-09-19T09:47:03.833 INFO:teuthology.orchestra.run.smithi001.stdout: "available_modules": [ 2024-09-19T09:47:03.833 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.833 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "alerts", 2024-09-19T09:47:03.833 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.834 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.834 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.834 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T09:47:03.834 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T09:47:03.834 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:03.834 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.834 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.834 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T09:47:03.834 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.834 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.834 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.834 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T09:47:03.834 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.834 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.835 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.835 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.835 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.835 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.835 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.835 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.835 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.835 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.835 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.835 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.835 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.835 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.835 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.835 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.835 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.836 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.836 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.836 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.836 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.836 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.836 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.836 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.836 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.836 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.836 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.836 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.836 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.836 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.836 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.836 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.837 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.837 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.837 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.837 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.837 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.837 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.837 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.837 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.837 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.837 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.837 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.837 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.838 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.838 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.838 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.838 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.838 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.838 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.838 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.838 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.838 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.838 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.838 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.838 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.838 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.839 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.839 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.839 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.839 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.839 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.839 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.839 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.839 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.839 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.839 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.839 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.839 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.839 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.839 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.840 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.840 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.840 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.840 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_destination": { 2024-09-19T09:47:03.840 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_destination", 2024-09-19T09:47:03.840 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.840 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.840 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.840 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.840 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.840 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.840 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.840 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email address to send alerts to", 2024-09-19T09:47:03.840 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.840 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.841 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.841 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.841 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_from_name": { 2024-09-19T09:47:03.841 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_from_name", 2024-09-19T09:47:03.841 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.841 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.841 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.841 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "Ceph", 2024-09-19T09:47:03.841 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.841 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.841 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.841 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email From: name", 2024-09-19T09:47:03.841 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.841 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.842 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.842 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.842 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_host": { 2024-09-19T09:47:03.842 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_host", 2024-09-19T09:47:03.842 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.842 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.842 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.842 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.842 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.842 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.842 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.842 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP server", 2024-09-19T09:47:03.842 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.843 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.843 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.843 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.843 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_password": { 2024-09-19T09:47:03.843 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_password", 2024-09-19T09:47:03.843 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.843 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.843 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.843 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.843 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.843 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.843 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.843 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Password to authenticate with", 2024-09-19T09:47:03.843 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.843 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.844 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.844 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.844 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_port": { 2024-09-19T09:47:03.844 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_port", 2024-09-19T09:47:03.844 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.844 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.844 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.844 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "465", 2024-09-19T09:47:03.844 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.844 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.844 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.844 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP port", 2024-09-19T09:47:03.844 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.844 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.845 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.845 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.845 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_sender": { 2024-09-19T09:47:03.845 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_sender", 2024-09-19T09:47:03.845 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.845 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.845 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.845 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.845 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.845 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.845 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.845 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP envelope sender", 2024-09-19T09:47:03.846 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.846 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.846 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.846 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.846 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_ssl": { 2024-09-19T09:47:03.846 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_ssl", 2024-09-19T09:47:03.846 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.846 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.846 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.846 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.846 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.846 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.846 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.846 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T09:47:03.847 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.847 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.847 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.847 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.847 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_user": { 2024-09-19T09:47:03.847 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_user", 2024-09-19T09:47:03.847 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.847 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.847 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.847 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.847 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.847 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.847 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.847 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "User to authenticate as", 2024-09-19T09:47:03.847 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.848 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.848 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.848 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.848 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.848 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.848 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.848 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "balancer", 2024-09-19T09:47:03.848 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.848 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.848 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.848 INFO:teuthology.orchestra.run.smithi001.stdout: "active": { 2024-09-19T09:47:03.848 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "active", 2024-09-19T09:47:03.848 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.848 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.849 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.849 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.849 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.849 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.849 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.849 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T09:47:03.849 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.849 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.849 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.849 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.849 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_time": { 2024-09-19T09:47:03.849 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_time", 2024-09-19T09:47:03.849 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.849 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.850 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.850 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0000", 2024-09-19T09:47:03.850 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.850 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.850 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.850 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T09:47:03.850 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:47:03.850 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.850 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.850 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.850 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_weekday": { 2024-09-19T09:47:03.850 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_weekday", 2024-09-19T09:47:03.850 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T09:47:03.850 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.850 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.851 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T09:47:03.851 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-19T09:47:03.851 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-19T09:47:03.851 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.851 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T09:47:03.851 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:47:03.851 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.851 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.851 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.851 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_max_iterations": { 2024-09-19T09:47:03.851 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_max_iterations", 2024-09-19T09:47:03.851 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T09:47:03.851 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.851 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.851 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "25", 2024-09-19T09:47:03.852 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T09:47:03.852 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "250", 2024-09-19T09:47:03.852 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.852 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T09:47:03.852 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.852 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.852 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.852 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.852 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_metrics": { 2024-09-19T09:47:03.852 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_metrics", 2024-09-19T09:47:03.852 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.852 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.852 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.852 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T09:47:03.852 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.853 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.853 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.853 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T09:47:03.853 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T09:47:03.853 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.853 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.853 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.853 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_step": { 2024-09-19T09:47:03.853 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_step", 2024-09-19T09:47:03.853 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:47:03.853 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.853 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.853 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.5", 2024-09-19T09:47:03.853 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0.001", 2024-09-19T09:47:03.854 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "0.999", 2024-09-19T09:47:03.854 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.854 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "aggressiveness of optimization", 2024-09-19T09:47:03.854 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T09:47:03.854 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.854 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.854 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.854 INFO:teuthology.orchestra.run.smithi001.stdout: "end_time": { 2024-09-19T09:47:03.854 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_time", 2024-09-19T09:47:03.854 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.854 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.854 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.854 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2359", 2024-09-19T09:47:03.854 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.854 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.855 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.855 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T09:47:03.855 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:47:03.855 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.855 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.855 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.855 INFO:teuthology.orchestra.run.smithi001.stdout: "end_weekday": { 2024-09-19T09:47:03.855 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_weekday", 2024-09-19T09:47:03.855 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T09:47:03.855 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.855 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.855 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T09:47:03.855 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-19T09:47:03.855 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-19T09:47:03.856 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.856 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T09:47:03.856 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:47:03.856 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.856 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.856 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.856 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.856 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.856 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.856 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.856 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.856 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.856 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.856 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.856 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.857 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.857 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.857 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.857 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.857 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.857 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.857 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.857 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.857 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.857 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.857 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.857 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.857 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.857 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.858 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.858 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.858 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.858 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.858 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.858 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.858 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.858 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.858 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.858 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.858 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.858 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.858 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.858 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.858 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.858 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.859 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.859 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.859 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.859 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.859 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.859 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.859 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.859 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.859 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.859 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.859 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.859 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.859 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.859 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.860 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.860 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.860 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.860 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.860 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.860 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.860 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.860 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.860 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.860 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.860 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.860 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.860 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.860 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.860 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.861 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.861 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.861 INFO:teuthology.orchestra.run.smithi001.stdout: "min_score": { 2024-09-19T09:47:03.861 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_score", 2024-09-19T09:47:03.861 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:47:03.861 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.861 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.861 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T09:47:03.861 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.861 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.861 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.861 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T09:47:03.861 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.861 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.861 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.862 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.862 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-19T09:47:03.862 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-19T09:47:03.862 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.862 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.862 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.862 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "upmap", 2024-09-19T09:47:03.862 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.862 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.862 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.862 INFO:teuthology.orchestra.run.smithi001.stdout: "crush-compat", 2024-09-19T09:47:03.862 INFO:teuthology.orchestra.run.smithi001.stdout: "none", 2024-09-19T09:47:03.862 INFO:teuthology.orchestra.run.smithi001.stdout: "read", 2024-09-19T09:47:03.862 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap", 2024-09-19T09:47:03.862 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap-read" 2024-09-19T09:47:03.863 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.863 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Balancer mode", 2024-09-19T09:47:03.863 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.863 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.863 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.863 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.863 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_ids": { 2024-09-19T09:47:03.863 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_ids", 2024-09-19T09:47:03.863 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.863 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.863 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.863 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.863 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.863 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.864 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.864 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T09:47:03.864 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.864 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.864 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.864 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.864 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T09:47:03.864 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T09:47:03.864 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:03.864 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.864 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.864 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T09:47:03.864 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.864 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.865 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.865 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T09:47:03.865 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.865 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.865 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.865 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.865 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_deviation": { 2024-09-19T09:47:03.865 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_deviation", 2024-09-19T09:47:03.865 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.865 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.865 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.865 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T09:47:03.865 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T09:47:03.865 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.866 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.866 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T09:47:03.866 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T09:47:03.866 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.866 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.866 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.866 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_optimizations": { 2024-09-19T09:47:03.866 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_optimizations", 2024-09-19T09:47:03.866 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T09:47:03.866 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.866 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.866 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:47:03.866 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.866 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.866 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.867 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T09:47:03.867 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.867 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.867 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.867 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.867 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.867 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.867 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.867 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm", 2024-09-19T09:47:03.867 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.867 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.867 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.867 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_down_multiplier": { 2024-09-19T09:47:03.867 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_down_multiplier", 2024-09-19T09:47:03.867 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:47:03.868 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.868 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.868 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-19T09:47:03.868 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.868 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.868 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.868 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T09:47:03.868 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.868 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.868 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.868 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.868 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_refresh_rate": { 2024-09-19T09:47:03.868 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_refresh_rate", 2024-09-19T09:47:03.868 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:03.868 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.868 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.869 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "20", 2024-09-19T09:47:03.869 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.869 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.869 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.869 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T09:47:03.869 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.869 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.869 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.870 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.870 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_starting_port": { 2024-09-19T09:47:03.870 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_starting_port", 2024-09-19T09:47:03.870 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.870 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.870 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.870 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4721", 2024-09-19T09:47:03.870 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.870 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.870 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.870 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T09:47:03.871 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.871 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.871 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.871 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.871 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_ptrace": { 2024-09-19T09:47:03.871 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_ptrace", 2024-09-19T09:47:03.871 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.871 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.871 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.871 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.871 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.871 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.871 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.871 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T09:47:03.871 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T09:47:03.872 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.872 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.872 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.872 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_interval": { 2024-09-19T09:47:03.872 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_interval", 2024-09-19T09:47:03.872 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:03.872 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.872 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.872 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T09:47:03.872 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.872 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.872 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.872 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T09:47:03.872 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.872 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.873 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.873 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.873 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_memory_target_ratio": { 2024-09-19T09:47:03.873 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T09:47:03.873 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:47:03.873 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.873 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.873 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.7", 2024-09-19T09:47:03.873 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.873 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.873 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.873 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T09:47:03.873 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.874 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.874 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.874 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.874 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm_log_destination": { 2024-09-19T09:47:03.874 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm_log_destination", 2024-09-19T09:47:03.874 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.874 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.874 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.874 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.874 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.874 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.874 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.874 INFO:teuthology.orchestra.run.smithi001.stdout: "file", 2024-09-19T09:47:03.874 INFO:teuthology.orchestra.run.smithi001.stdout: "file,syslog", 2024-09-19T09:47:03.875 INFO:teuthology.orchestra.run.smithi001.stdout: "syslog" 2024-09-19T09:47:03.875 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.875 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T09:47:03.875 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.875 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.875 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.875 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.875 INFO:teuthology.orchestra.run.smithi001.stdout: "cgroups_split": { 2024-09-19T09:47:03.875 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cgroups_split", 2024-09-19T09:47:03.875 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.875 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.875 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.875 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.875 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.875 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.876 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.876 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T09:47:03.876 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.876 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.876 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.876 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.876 INFO:teuthology.orchestra.run.smithi001.stdout: "config_checks_enabled": { 2024-09-19T09:47:03.876 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_checks_enabled", 2024-09-19T09:47:03.876 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.876 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.876 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.876 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.876 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.876 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.877 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.877 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T09:47:03.877 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.877 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.877 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.877 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.877 INFO:teuthology.orchestra.run.smithi001.stdout: "config_dashboard": { 2024-09-19T09:47:03.877 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_dashboard", 2024-09-19T09:47:03.877 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.877 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.877 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.877 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.877 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.878 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.878 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.878 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T09:47:03.878 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.878 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.878 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.878 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.878 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_alertmanager": { 2024-09-19T09:47:03.878 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_alertmanager", 2024-09-19T09:47:03.878 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.878 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.878 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.878 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T09:47:03.879 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.879 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.879 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.879 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T09:47:03.879 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.879 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.879 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.879 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.879 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_base": { 2024-09-19T09:47:03.879 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_base", 2024-09-19T09:47:03.879 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.879 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.879 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.879 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T09:47:03.880 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.880 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.880 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.880 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Container image name, without the tag", 2024-09-19T09:47:03.880 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.880 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.880 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.880 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.880 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_elasticsearch": { 2024-09-19T09:47:03.880 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_elasticsearch", 2024-09-19T09:47:03.880 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.880 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.880 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.880 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T09:47:03.881 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.881 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.881 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.881 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "elasticsearch container image", 2024-09-19T09:47:03.881 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.881 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.881 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.881 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.881 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_grafana": { 2024-09-19T09:47:03.881 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_grafana", 2024-09-19T09:47:03.881 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.881 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.881 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.882 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T09:47:03.882 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.882 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.882 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.882 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T09:47:03.882 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.882 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.882 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.882 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.882 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_haproxy": { 2024-09-19T09:47:03.882 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_haproxy", 2024-09-19T09:47:03.882 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.883 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.883 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.883 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T09:47:03.883 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.883 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.883 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.883 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "HAproxy container image", 2024-09-19T09:47:03.883 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.883 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.883 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.883 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.883 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_agent": { 2024-09-19T09:47:03.883 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_agent", 2024-09-19T09:47:03.883 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.884 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.884 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.884 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T09:47:03.884 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.884 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.884 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.884 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger agent container image", 2024-09-19T09:47:03.884 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.884 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.884 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.884 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.884 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_collector": { 2024-09-19T09:47:03.885 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_collector", 2024-09-19T09:47:03.885 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.885 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.885 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.885 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T09:47:03.885 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.885 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.885 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.885 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger collector container image", 2024-09-19T09:47:03.885 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.885 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.885 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.885 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.886 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_query": { 2024-09-19T09:47:03.886 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_query", 2024-09-19T09:47:03.886 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.886 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.886 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.886 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T09:47:03.886 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.886 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.886 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.886 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger query container image", 2024-09-19T09:47:03.886 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.886 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.886 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.886 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.887 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_keepalived": { 2024-09-19T09:47:03.887 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_keepalived", 2024-09-19T09:47:03.887 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.887 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.887 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.887 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T09:47:03.887 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.887 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.887 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.887 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Keepalived container image", 2024-09-19T09:47:03.887 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.887 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.887 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.887 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.888 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_loki": { 2024-09-19T09:47:03.888 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_loki", 2024-09-19T09:47:03.888 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.888 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.888 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.888 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T09:47:03.888 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.888 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.888 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.888 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Loki container image", 2024-09-19T09:47:03.888 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.888 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.888 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.888 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.889 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_node_exporter": { 2024-09-19T09:47:03.889 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_node_exporter", 2024-09-19T09:47:03.889 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.889 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.889 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.889 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T09:47:03.889 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.889 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.889 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.889 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T09:47:03.889 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.889 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.889 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.889 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.889 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_nvmeof": { 2024-09-19T09:47:03.889 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_nvmeof", 2024-09-19T09:47:03.890 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.890 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.890 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.890 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T09:47:03.890 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.890 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.890 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.890 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Nvme-of container image", 2024-09-19T09:47:03.890 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.890 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.890 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.890 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.890 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_prometheus": { 2024-09-19T09:47:03.890 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_prometheus", 2024-09-19T09:47:03.890 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.891 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.891 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.891 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T09:47:03.891 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.891 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.891 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.891 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T09:47:03.891 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.891 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.891 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.891 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.891 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_promtail": { 2024-09-19T09:47:03.891 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_promtail", 2024-09-19T09:47:03.891 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.891 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.891 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.892 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T09:47:03.892 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.892 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.892 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.892 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Promtail container image", 2024-09-19T09:47:03.892 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.892 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.892 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.892 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.892 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_samba": { 2024-09-19T09:47:03.892 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_samba", 2024-09-19T09:47:03.892 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.892 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.892 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.892 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T09:47:03.893 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.893 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.893 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.893 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Samba/SMB container image", 2024-09-19T09:47:03.893 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.893 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.893 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.893 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.893 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_snmp_gateway": { 2024-09-19T09:47:03.893 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_snmp_gateway", 2024-09-19T09:47:03.893 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.893 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.893 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.893 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T09:47:03.893 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.894 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.894 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.894 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SNMP Gateway container image", 2024-09-19T09:47:03.894 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.894 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.894 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.894 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.894 INFO:teuthology.orchestra.run.smithi001.stdout: "container_init": { 2024-09-19T09:47:03.894 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_init", 2024-09-19T09:47:03.894 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.894 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.894 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.894 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.894 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.894 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.895 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.895 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T09:47:03.895 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.895 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.895 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.895 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.895 INFO:teuthology.orchestra.run.smithi001.stdout: "daemon_cache_timeout": { 2024-09-19T09:47:03.895 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "daemon_cache_timeout", 2024-09-19T09:47:03.895 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:03.895 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.895 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.895 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T09:47:03.895 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.895 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.895 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.895 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T09:47:03.896 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.896 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.896 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.896 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.896 INFO:teuthology.orchestra.run.smithi001.stdout: "default_cephadm_command_timeout": { 2024-09-19T09:47:03.896 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T09:47:03.896 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.896 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.896 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.896 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "900", 2024-09-19T09:47:03.896 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.896 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.896 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.897 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T09:47:03.897 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.897 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.897 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.897 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.897 INFO:teuthology.orchestra.run.smithi001.stdout: "default_registry": { 2024-09-19T09:47:03.897 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_registry", 2024-09-19T09:47:03.897 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.897 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.897 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.897 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io", 2024-09-19T09:47:03.897 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.897 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.897 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.898 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T09:47:03.898 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.898 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.898 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.898 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.898 INFO:teuthology.orchestra.run.smithi001.stdout: "device_cache_timeout": { 2024-09-19T09:47:03.898 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_cache_timeout", 2024-09-19T09:47:03.898 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:03.898 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.898 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.898 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1800", 2024-09-19T09:47:03.898 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.898 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.899 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.899 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache device inventory", 2024-09-19T09:47:03.899 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.899 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.899 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.899 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.899 INFO:teuthology.orchestra.run.smithi001.stdout: "device_enhanced_scan": { 2024-09-19T09:47:03.899 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_enhanced_scan", 2024-09-19T09:47:03.899 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.899 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.899 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.899 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.899 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.899 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.899 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.900 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T09:47:03.900 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.900 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.900 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.900 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.900 INFO:teuthology.orchestra.run.smithi001.stdout: "facts_cache_timeout": { 2024-09-19T09:47:03.900 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "facts_cache_timeout", 2024-09-19T09:47:03.900 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:03.900 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.900 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.900 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T09:47:03.900 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.900 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.900 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.901 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache host facts data", 2024-09-19T09:47:03.901 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.901 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.901 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.901 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.901 INFO:teuthology.orchestra.run.smithi001.stdout: "grafana_dashboards_path": { 2024-09-19T09:47:03.901 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "grafana_dashboards_path", 2024-09-19T09:47:03.901 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.901 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.901 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.901 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T09:47:03.901 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.901 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.901 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.902 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T09:47:03.902 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.902 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.902 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.902 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.902 INFO:teuthology.orchestra.run.smithi001.stdout: "host_check_interval": { 2024-09-19T09:47:03.902 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "host_check_interval", 2024-09-19T09:47:03.902 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:03.902 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.902 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.902 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T09:47:03.902 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.902 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.902 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.902 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to perform a host check", 2024-09-19T09:47:03.903 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.903 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.903 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.903 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.903 INFO:teuthology.orchestra.run.smithi001.stdout: "hw_monitoring": { 2024-09-19T09:47:03.903 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hw_monitoring", 2024-09-19T09:47:03.903 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.903 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.903 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.903 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.903 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.903 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.904 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.904 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T09:47:03.904 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.904 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.904 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.904 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.904 INFO:teuthology.orchestra.run.smithi001.stdout: "inventory_list_all": { 2024-09-19T09:47:03.904 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "inventory_list_all", 2024-09-19T09:47:03.904 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.904 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.904 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.904 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.904 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.904 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.904 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.905 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T09:47:03.905 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.905 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.905 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.905 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.905 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.905 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.905 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.905 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.905 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.905 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.905 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.905 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.906 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.906 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.906 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.906 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.906 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.906 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.906 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.906 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.906 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.906 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.906 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.906 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.906 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.906 INFO:teuthology.orchestra.run.smithi001.stdout: "log_refresh_metadata": { 2024-09-19T09:47:03.907 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_refresh_metadata", 2024-09-19T09:47:03.907 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.907 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.907 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.907 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.907 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.907 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.907 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.907 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T09:47:03.907 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.907 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.907 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.907 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.907 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.908 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.908 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.908 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.908 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.908 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.908 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.908 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.908 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.908 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T09:47:03.908 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.908 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.908 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.908 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.908 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.908 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.909 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.909 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.909 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.909 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.909 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.909 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.909 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.909 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.909 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.909 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.909 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.909 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.909 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.909 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.909 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.910 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.910 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.910 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.910 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.910 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.910 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.910 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.910 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.910 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.910 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.910 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.910 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.910 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.910 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.911 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.911 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.911 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.911 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.911 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T09:47:03.911 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T09:47:03.911 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.911 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.911 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.911 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.911 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.911 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.911 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.911 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T09:47:03.912 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.912 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.912 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.912 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.912 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T09:47:03.912 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T09:47:03.912 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.912 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.912 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.912 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "*", 2024-09-19T09:47:03.912 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.912 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.912 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.912 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T09:47:03.912 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.913 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.913 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.913 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.913 INFO:teuthology.orchestra.run.smithi001.stdout: "max_count_per_host": { 2024-09-19T09:47:03.913 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_count_per_host", 2024-09-19T09:47:03.913 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.913 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.913 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.913 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:47:03.913 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.913 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.913 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.913 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of daemons per service per host", 2024-09-19T09:47:03.913 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.914 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.914 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.914 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.914 INFO:teuthology.orchestra.run.smithi001.stdout: "max_osd_draining_count": { 2024-09-19T09:47:03.914 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_osd_draining_count", 2024-09-19T09:47:03.914 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.914 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.914 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.914 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:47:03.914 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.914 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.914 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.914 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T09:47:03.914 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.914 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.914 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.915 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.915 INFO:teuthology.orchestra.run.smithi001.stdout: "migration_current": { 2024-09-19T09:47:03.915 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "migration_current", 2024-09-19T09:47:03.915 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.915 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.915 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.915 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.915 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.915 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.915 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.915 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "internal - do not modify", 2024-09-19T09:47:03.915 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.915 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.915 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.915 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.916 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-19T09:47:03.916 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-19T09:47:03.916 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.916 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.916 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.916 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "root", 2024-09-19T09:47:03.916 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.916 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.916 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.916 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm-package", 2024-09-19T09:47:03.916 INFO:teuthology.orchestra.run.smithi001.stdout: "root" 2024-09-19T09:47:03.916 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.916 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T09:47:03.916 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.917 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.917 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.917 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.917 INFO:teuthology.orchestra.run.smithi001.stdout: "oob_default_addr": { 2024-09-19T09:47:03.917 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "oob_default_addr", 2024-09-19T09:47:03.917 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.917 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.917 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.917 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "169.254.1.1", 2024-09-19T09:47:03.917 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.917 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.917 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.917 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T09:47:03.917 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.917 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.918 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.918 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.918 INFO:teuthology.orchestra.run.smithi001.stdout: "prometheus_alerts_path": { 2024-09-19T09:47:03.918 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus_alerts_path", 2024-09-19T09:47:03.918 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.918 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.918 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.918 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T09:47:03.918 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.918 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.918 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.918 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T09:47:03.918 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.918 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.919 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.919 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.919 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_insecure": { 2024-09-19T09:47:03.919 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_insecure", 2024-09-19T09:47:03.919 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.919 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.919 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.919 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.919 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.919 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.919 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.919 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T09:47:03.919 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.919 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.919 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.919 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.920 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_password": { 2024-09-19T09:47:03.920 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_password", 2024-09-19T09:47:03.920 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.920 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.920 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.920 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.920 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.920 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.920 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.920 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T09:47:03.920 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.920 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.920 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.920 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.921 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_url": { 2024-09-19T09:47:03.921 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_url", 2024-09-19T09:47:03.921 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.921 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.921 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.921 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.921 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.921 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.921 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.921 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T09:47:03.921 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.921 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.921 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.921 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.921 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_username": { 2024-09-19T09:47:03.922 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_username", 2024-09-19T09:47:03.922 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.922 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.922 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.922 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.922 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.922 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.922 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.922 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T09:47:03.922 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.922 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.922 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.922 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.922 INFO:teuthology.orchestra.run.smithi001.stdout: "secure_monitoring_stack": { 2024-09-19T09:47:03.922 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secure_monitoring_stack", 2024-09-19T09:47:03.923 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.923 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.923 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.923 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.923 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.923 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.923 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.923 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T09:47:03.923 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.923 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.923 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.923 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.923 INFO:teuthology.orchestra.run.smithi001.stdout: "service_discovery_port": { 2024-09-19T09:47:03.923 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "service_discovery_port", 2024-09-19T09:47:03.923 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.923 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.924 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.924 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8765", 2024-09-19T09:47:03.924 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.924 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.924 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.924 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "cephadm service discovery port", 2024-09-19T09:47:03.924 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.924 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.924 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.924 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.924 INFO:teuthology.orchestra.run.smithi001.stdout: "ssh_config_file": { 2024-09-19T09:47:03.924 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssh_config_file", 2024-09-19T09:47:03.924 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.925 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.925 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.925 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.925 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.925 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.925 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.925 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T09:47:03.925 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.925 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.925 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.925 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.925 INFO:teuthology.orchestra.run.smithi001.stdout: "use_agent": { 2024-09-19T09:47:03.925 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_agent", 2024-09-19T09:47:03.925 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.926 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.926 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.926 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.926 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.926 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.926 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.926 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T09:47:03.926 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.926 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.926 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.926 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.926 INFO:teuthology.orchestra.run.smithi001.stdout: "use_repo_digest": { 2024-09-19T09:47:03.926 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_repo_digest", 2024-09-19T09:47:03.926 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.926 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.927 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.927 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.927 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.927 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.927 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.927 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T09:47:03.927 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.927 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.927 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.927 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.927 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_failed_host_check": { 2024-09-19T09:47:03.927 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_failed_host_check", 2024-09-19T09:47:03.928 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.928 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.928 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.928 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.928 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.928 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.928 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.928 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T09:47:03.928 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.928 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.928 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.928 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.928 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_daemons": { 2024-09-19T09:47:03.928 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_daemons", 2024-09-19T09:47:03.928 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.929 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.929 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.929 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.929 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.929 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.929 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.929 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T09:47:03.929 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.929 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.929 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.929 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.929 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_hosts": { 2024-09-19T09:47:03.929 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_hosts", 2024-09-19T09:47:03.929 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.930 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.930 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.930 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.930 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.930 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.930 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.930 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T09:47:03.930 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.930 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.930 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.930 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.930 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.930 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.930 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.931 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crash", 2024-09-19T09:47:03.931 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.931 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.931 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.931 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.931 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.931 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.931 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.931 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.931 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.931 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.931 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.931 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.931 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.931 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.932 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.932 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.932 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.932 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.932 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.932 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.932 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.932 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.932 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.932 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.932 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.932 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.932 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.933 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.933 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.933 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.933 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.933 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.933 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.933 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.933 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.933 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.933 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.933 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.933 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.933 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.933 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.934 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.934 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.934 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.934 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.934 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.934 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.934 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.934 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.934 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.934 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.934 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.934 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.934 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.934 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.935 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.935 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.935 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.935 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.935 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.935 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.935 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.935 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.935 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.935 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.935 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.935 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.935 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.935 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.936 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.936 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.936 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.936 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.936 INFO:teuthology.orchestra.run.smithi001.stdout: "retain_interval": { 2024-09-19T09:47:03.936 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retain_interval", 2024-09-19T09:47:03.936 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:03.936 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.936 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.936 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "31536000", 2024-09-19T09:47:03.936 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.936 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.936 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.936 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T09:47:03.937 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.937 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.937 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.937 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.937 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_recent_interval": { 2024-09-19T09:47:03.937 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_recent_interval", 2024-09-19T09:47:03.937 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:03.937 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.937 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.937 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1209600", 2024-09-19T09:47:03.937 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.937 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.937 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.937 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T09:47:03.938 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.938 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.938 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.938 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.938 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:03.938 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.938 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:03.938 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dashboard", 2024-09-19T09:47:03.938 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:03.938 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:03.938 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:03.938 INFO:teuthology.orchestra.run.smithi001.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T09:47:03.938 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T09:47:03.939 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.939 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.939 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.939 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:47:03.939 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.939 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.939 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.939 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.939 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.939 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.939 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.939 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.939 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T09:47:03.939 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T09:47:03.940 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.940 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.940 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.940 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.940 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.940 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.940 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.940 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.940 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.940 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.940 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.940 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.940 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T09:47:03.941 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T09:47:03.941 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.941 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.941 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.941 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.941 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.941 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.941 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.941 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.941 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.941 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.941 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.941 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.941 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_ENABLED": { 2024-09-19T09:47:03.942 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T09:47:03.942 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.942 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.942 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.942 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.942 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.942 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.942 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.942 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.942 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.942 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.942 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.942 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.942 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T09:47:03.942 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T09:47:03.943 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.943 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.943 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.943 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.943 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.943 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.943 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.943 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.943 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.943 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.943 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.943 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.943 INFO:teuthology.orchestra.run.smithi001.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T09:47:03.943 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T09:47:03.943 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.944 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.944 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.944 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.944 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.944 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.944 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.944 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.944 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.944 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.944 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.944 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.944 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T09:47:03.944 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T09:47:03.945 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.945 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.945 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.945 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.945 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.945 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.945 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.945 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.945 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.945 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.945 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.945 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.945 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T09:47:03.945 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T09:47:03.946 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.946 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.946 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.946 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.946 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.946 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.946 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.946 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.946 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.946 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.946 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.946 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.946 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T09:47:03.946 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T09:47:03.947 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.947 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.947 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.947 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.947 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.947 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.947 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.947 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.947 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.947 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.947 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.947 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.947 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T09:47:03.947 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T09:47:03.948 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.948 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.948 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.948 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.948 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.948 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.948 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.948 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.948 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.948 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.948 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.948 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.948 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T09:47:03.949 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T09:47:03.949 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.949 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.949 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.949 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.949 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.949 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.949 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.949 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.949 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.949 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.949 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.949 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.949 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T09:47:03.949 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T09:47:03.950 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.950 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.950 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.950 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.950 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.950 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.950 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.950 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.950 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.950 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.950 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.950 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.950 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T09:47:03.950 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T09:47:03.951 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.951 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.951 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.951 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.951 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.951 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.951 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.951 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.951 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.951 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.951 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.951 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.951 INFO:teuthology.orchestra.run.smithi001.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T09:47:03.951 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T09:47:03.951 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.952 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.952 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.952 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.952 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.952 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.952 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.952 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.952 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.952 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.952 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.952 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.952 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T09:47:03.952 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T09:47:03.952 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.952 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.953 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.953 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-19T09:47:03.953 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.953 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.953 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.953 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.953 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.953 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.953 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.953 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.953 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T09:47:03.953 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T09:47:03.953 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.953 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.953 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.954 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.954 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.954 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.954 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.954 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.954 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.954 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.954 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.954 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.954 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_URL": { 2024-09-19T09:47:03.954 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_URL", 2024-09-19T09:47:03.954 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.954 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.954 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.954 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.955 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.955 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.955 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.955 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.955 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.955 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.955 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.955 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.955 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T09:47:03.955 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T09:47:03.955 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.955 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.955 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.955 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-19T09:47:03.955 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.956 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.956 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.956 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.956 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.956 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.956 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.956 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.956 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T09:47:03.956 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T09:47:03.956 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.956 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.956 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.956 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.956 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.956 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.957 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.957 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.957 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.957 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.957 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.957 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.957 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T09:47:03.957 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T09:47:03.957 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.957 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.957 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.957 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.957 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.957 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.958 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.958 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.958 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.958 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.958 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.958 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.958 INFO:teuthology.orchestra.run.smithi001.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T09:47:03.958 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T09:47:03.958 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.958 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.958 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.958 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.958 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.958 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.958 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.959 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.959 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.959 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.959 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.959 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.959 INFO:teuthology.orchestra.run.smithi001.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T09:47:03.959 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T09:47:03.959 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.959 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.959 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.959 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.959 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.959 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.959 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.959 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.960 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.960 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.960 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.960 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.960 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T09:47:03.960 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T09:47:03.960 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.960 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.960 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.960 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.960 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.960 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.960 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.960 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.960 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.961 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.961 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.961 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.961 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T09:47:03.961 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T09:47:03.961 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.961 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.961 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.961 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.961 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.961 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.961 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.961 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.961 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.961 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.962 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.962 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.962 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T09:47:03.962 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T09:47:03.962 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.962 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.962 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.962 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.962 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.962 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.962 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.962 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.962 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.962 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.962 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.962 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.963 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T09:47:03.963 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T09:47:03.963 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.963 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.963 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.963 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.963 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.963 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.963 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.963 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.963 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.963 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.963 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.963 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.963 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T09:47:03.963 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T09:47:03.964 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.964 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.964 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.964 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.964 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.964 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.964 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.964 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.964 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.964 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.964 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.964 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.964 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T09:47:03.964 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T09:47:03.964 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.965 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.965 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.965 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.965 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.965 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.965 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.965 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.965 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.965 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.965 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.965 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.965 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T09:47:03.965 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T09:47:03.965 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.966 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.966 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.966 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.966 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.966 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.966 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.966 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.966 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.966 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.966 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.966 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.966 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T09:47:03.966 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T09:47:03.966 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.966 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.966 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.967 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.967 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.967 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.967 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.967 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.967 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.967 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.967 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.967 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.967 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T09:47:03.967 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T09:47:03.967 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.967 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.967 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.967 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.968 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.968 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.968 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.968 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.968 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.968 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.968 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.968 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.968 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T09:47:03.968 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T09:47:03.968 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.968 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.968 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.969 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.969 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.969 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.969 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.969 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.969 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.969 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.969 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.969 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.969 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T09:47:03.969 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T09:47:03.969 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.969 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.970 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.970 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T09:47:03.970 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.970 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.970 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.970 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.970 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.970 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.970 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.970 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.970 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T09:47:03.970 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T09:47:03.970 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.971 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.971 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.971 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:47:03.971 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.971 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.971 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.971 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.971 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.971 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.971 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.971 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.971 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T09:47:03.971 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T09:47:03.971 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.972 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.972 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.972 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8", 2024-09-19T09:47:03.972 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.972 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.972 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.972 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.972 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.972 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.972 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.972 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.973 INFO:teuthology.orchestra.run.smithi001.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T09:47:03.973 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T09:47:03.973 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.973 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.973 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.973 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "45", 2024-09-19T09:47:03.973 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.973 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.973 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.973 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.973 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.973 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.973 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.974 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.974 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T09:47:03.974 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T09:47:03.974 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.974 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.974 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.974 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.974 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.974 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.974 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.974 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.974 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.974 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.975 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.975 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.975 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T09:47:03.975 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T09:47:03.975 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.975 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.975 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.975 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-19T09:47:03.975 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.975 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.975 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.975 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.975 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.976 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.976 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.976 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.976 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T09:47:03.976 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T09:47:03.976 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.976 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.976 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.976 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.976 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.976 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.976 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.976 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.977 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.977 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.977 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.977 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.977 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T09:47:03.977 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T09:47:03.977 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.977 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.977 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.977 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.977 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.977 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.977 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.978 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.978 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.978 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.978 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.978 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.978 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T09:47:03.978 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T09:47:03.978 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.978 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.978 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.978 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T09:47:03.978 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.978 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.978 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.978 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.979 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.979 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.979 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.979 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.979 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T09:47:03.979 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T09:47:03.979 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.979 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.979 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.979 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:47:03.979 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.979 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.979 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.979 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.979 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.980 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.980 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.980 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.980 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T09:47:03.980 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T09:47:03.980 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.980 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.980 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.980 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T09:47:03.980 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.980 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.980 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.980 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.981 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.981 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.981 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.981 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.981 INFO:teuthology.orchestra.run.smithi001.stdout: "cross_origin_url": { 2024-09-19T09:47:03.981 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cross_origin_url", 2024-09-19T09:47:03.981 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.981 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.981 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.981 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.981 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.981 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.981 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.981 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.982 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.982 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.982 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.982 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.982 INFO:teuthology.orchestra.run.smithi001.stdout: "crt_file": { 2024-09-19T09:47:03.982 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crt_file", 2024-09-19T09:47:03.982 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.982 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.982 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.982 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.982 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.982 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.982 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.982 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.983 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.983 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.983 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.983 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.983 INFO:teuthology.orchestra.run.smithi001.stdout: "debug": { 2024-09-19T09:47:03.983 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "debug", 2024-09-19T09:47:03.983 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.983 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.983 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.983 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.983 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.983 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.983 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.984 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable/disable debug options", 2024-09-19T09:47:03.984 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.984 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.984 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.984 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.984 INFO:teuthology.orchestra.run.smithi001.stdout: "jwt_token_ttl": { 2024-09-19T09:47:03.984 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "jwt_token_ttl", 2024-09-19T09:47:03.984 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.984 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.984 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.984 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "28800", 2024-09-19T09:47:03.984 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.984 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.985 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.985 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.985 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.985 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.985 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.985 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.985 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-19T09:47:03.985 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-19T09:47:03.985 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.985 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.985 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.985 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.985 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.985 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.986 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.986 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.986 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.986 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.986 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.986 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.986 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:03.986 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:03.986 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.986 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.986 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.986 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.986 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.986 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.987 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.987 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.987 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.987 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.987 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.987 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.987 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.987 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.987 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.987 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.987 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.987 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.987 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.987 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:03.988 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:03.988 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.988 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.988 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.988 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.988 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.988 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.988 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.988 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.988 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.988 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.988 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.989 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.989 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:03.989 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:03.989 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.989 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.989 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.989 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:03.989 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.989 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.989 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.989 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:03.989 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:03.989 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:03.989 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.989 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:03.990 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:03.990 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.990 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.990 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.990 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.990 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.990 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.990 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:03.990 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:03.990 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.990 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.990 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:03.990 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.990 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.990 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.991 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.991 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.991 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.991 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.991 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.991 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.991 INFO:teuthology.orchestra.run.smithi001.stdout: "motd": { 2024-09-19T09:47:03.991 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "motd", 2024-09-19T09:47:03.991 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.991 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.991 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.991 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:03.991 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.991 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.991 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.992 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "The message of the day", 2024-09-19T09:47:03.992 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.992 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.992 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.992 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.992 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect_resolve_ip_addr": { 2024-09-19T09:47:03.992 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T09:47:03.992 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.992 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.992 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.992 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:03.992 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.992 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.992 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.992 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.993 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.993 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.993 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.993 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.993 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-19T09:47:03.993 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-19T09:47:03.993 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.993 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.993 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.993 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-19T09:47:03.993 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.993 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.993 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.993 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.993 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.994 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.994 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.994 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.994 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-19T09:47:03.994 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-19T09:47:03.994 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.994 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.994 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.994 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8080", 2024-09-19T09:47:03.994 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.994 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.994 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.994 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.994 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.994 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.995 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.995 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.995 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-19T09:47:03.995 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-19T09:47:03.995 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:03.995 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.995 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.995 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:03.995 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.995 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.995 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.995 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.995 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.995 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.995 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.996 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.996 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl_server_port": { 2024-09-19T09:47:03.996 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl_server_port", 2024-09-19T09:47:03.996 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.996 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.996 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.996 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8443", 2024-09-19T09:47:03.996 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.996 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.996 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.996 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.996 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.996 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.997 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.997 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.997 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-19T09:47:03.997 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-19T09:47:03.997 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:03.997 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.997 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.997 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "redirect", 2024-09-19T09:47:03.997 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:03.997 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:03.997 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:03.997 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:03.997 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect" 2024-09-19T09:47:03.997 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:03.997 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.998 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.998 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.998 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.998 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.998 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-19T09:47:03.998 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-19T09:47:03.998 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:03.998 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:03.998 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:03.998 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-19T09:47:03.998 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-19T09:47:03.998 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-19T09:47:03.998 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:03.999 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:03.999 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:03.999 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:03.999 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:03.999 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:03.999 INFO:teuthology.orchestra.run.smithi001.stdout: "url_prefix": { 2024-09-19T09:47:04.000 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url_prefix", 2024-09-19T09:47:04.000 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.000 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.000 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.000 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.000 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.000 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.001 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.001 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.001 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.001 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.001 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.001 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.001 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.001 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.001 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.001 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "devicehealth", 2024-09-19T09:47:04.001 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.001 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.001 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.001 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_monitoring": { 2024-09-19T09:47:04.002 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_monitoring", 2024-09-19T09:47:04.002 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.002 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.002 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.002 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.002 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.002 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.002 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.002 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "monitor device health metrics", 2024-09-19T09:47:04.002 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.002 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.002 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.002 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.003 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.003 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.003 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.003 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.003 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.003 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.003 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.003 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.003 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.003 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.003 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.003 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.004 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.004 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.004 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.004 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.004 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.004 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.004 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.004 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.004 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.004 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.004 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.004 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.004 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.005 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.005 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.005 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.005 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.005 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.005 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.005 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.005 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.005 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.005 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.005 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.005 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.005 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.005 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.005 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.006 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.006 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.006 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.006 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.006 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.006 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.006 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.006 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.006 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.006 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.006 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.006 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.006 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.006 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.006 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.007 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.007 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.007 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.007 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.007 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.007 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.007 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.007 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.007 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.007 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.007 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.007 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.007 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.007 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.008 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.008 INFO:teuthology.orchestra.run.smithi001.stdout: "mark_out_threshold": { 2024-09-19T09:47:04.008 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mark_out_threshold", 2024-09-19T09:47:04.008 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:04.008 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.008 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.008 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2419200", 2024-09-19T09:47:04.008 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.008 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.008 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.008 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T09:47:04.008 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.008 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.008 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.009 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.009 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": { 2024-09-19T09:47:04.009 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_name", 2024-09-19T09:47:04.009 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.009 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.009 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.009 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "device_health_metrics", 2024-09-19T09:47:04.009 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.009 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.009 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.009 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T09:47:04.009 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.009 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.009 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.009 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.010 INFO:teuthology.orchestra.run.smithi001.stdout: "retention_period": { 2024-09-19T09:47:04.010 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retention_period", 2024-09-19T09:47:04.010 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:04.010 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.010 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.010 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15552000", 2024-09-19T09:47:04.010 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.010 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.010 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.010 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain device health metrics", 2024-09-19T09:47:04.010 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.010 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.010 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.010 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.011 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_frequency": { 2024-09-19T09:47:04.011 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_frequency", 2024-09-19T09:47:04.011 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:04.011 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.011 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.011 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-19T09:47:04.011 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.011 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.011 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.011 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T09:47:04.012 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.012 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.012 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.012 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.012 INFO:teuthology.orchestra.run.smithi001.stdout: "self_heal": { 2024-09-19T09:47:04.012 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "self_heal", 2024-09-19T09:47:04.012 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.012 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.012 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.012 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.012 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.012 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.012 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.013 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T09:47:04.013 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.013 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.013 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.013 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.013 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T09:47:04.013 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T09:47:04.013 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:04.013 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.013 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.013 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T09:47:04.013 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.013 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.013 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.013 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T09:47:04.014 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.014 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.014 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.014 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.014 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_threshold": { 2024-09-19T09:47:04.014 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_threshold", 2024-09-19T09:47:04.014 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:04.014 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.014 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.014 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7257600", 2024-09-19T09:47:04.014 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.014 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.014 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.014 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T09:47:04.015 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.015 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.015 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.015 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.015 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.015 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.015 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.015 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "diskprediction_local", 2024-09-19T09:47:04.015 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.015 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.015 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.015 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.015 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.015 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.015 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.015 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.016 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.016 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.016 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.016 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.016 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.016 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.016 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.016 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.016 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.016 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.016 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.016 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.016 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.016 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.016 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.016 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.017 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.017 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.017 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.017 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.017 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.017 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.017 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.017 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.017 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.017 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.017 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.017 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.018 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.018 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.018 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.018 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.018 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.018 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.018 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.018 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.018 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.018 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.018 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.018 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.019 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.019 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.019 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.019 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.019 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.019 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.019 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.019 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.019 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.019 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.019 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.019 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.019 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.019 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.019 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.019 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.020 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.020 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.020 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.020 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.020 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.020 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.020 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.020 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.020 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.020 INFO:teuthology.orchestra.run.smithi001.stdout: "predict_interval": { 2024-09-19T09:47:04.020 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predict_interval", 2024-09-19T09:47:04.020 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.020 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.020 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.021 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-19T09:47:04.021 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.021 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.021 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.021 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.021 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.021 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.021 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.021 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.022 INFO:teuthology.orchestra.run.smithi001.stdout: "predictor_model": { 2024-09-19T09:47:04.022 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predictor_model", 2024-09-19T09:47:04.022 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.022 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.022 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.022 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "prophetstor", 2024-09-19T09:47:04.022 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.022 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.022 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.022 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.022 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.022 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.022 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.022 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.022 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T09:47:04.023 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T09:47:04.023 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.023 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.023 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.023 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T09:47:04.023 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.023 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.023 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.023 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.023 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.023 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.023 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.023 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.023 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.023 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.023 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.024 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "influx", 2024-09-19T09:47:04.024 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": false, 2024-09-19T09:47:04.024 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "influxdb python module not found", 2024-09-19T09:47:04.024 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.024 INFO:teuthology.orchestra.run.smithi001.stdout: "batch_size": { 2024-09-19T09:47:04.024 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "batch_size", 2024-09-19T09:47:04.024 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.024 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.024 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.024 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5000", 2024-09-19T09:47:04.024 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.024 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.024 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.024 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T09:47:04.024 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.025 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.025 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.025 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.025 INFO:teuthology.orchestra.run.smithi001.stdout: "database": { 2024-09-19T09:47:04.025 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "database", 2024-09-19T09:47:04.025 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.025 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.025 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.025 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "ceph", 2024-09-19T09:47:04.025 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.025 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.025 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.025 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T09:47:04.025 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.025 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.025 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.026 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.026 INFO:teuthology.orchestra.run.smithi001.stdout: "hostname": { 2024-09-19T09:47:04.026 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hostname", 2024-09-19T09:47:04.026 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.026 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.026 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.026 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.026 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.026 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.026 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.026 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server hostname", 2024-09-19T09:47:04.026 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.026 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.026 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.026 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.026 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T09:47:04.027 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T09:47:04.027 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:04.027 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.027 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.027 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "30", 2024-09-19T09:47:04.027 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "5", 2024-09-19T09:47:04.027 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.027 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.027 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T09:47:04.027 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.027 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.027 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.027 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.028 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.028 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.028 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.028 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.028 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.028 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.028 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.028 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.028 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.028 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.028 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.028 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.028 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.028 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.029 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.029 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.029 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.029 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.029 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.029 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.029 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.029 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.029 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.029 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.029 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.029 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.029 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.029 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.030 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.030 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.030 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.030 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.030 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.030 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.030 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.030 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.030 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.030 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.030 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.030 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.030 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.031 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.031 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.031 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.031 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.031 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.031 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.031 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.031 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.031 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.031 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.031 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.031 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.031 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.032 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.032 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.032 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.032 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.032 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.032 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.032 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.032 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.033 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.033 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.033 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.033 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.033 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.033 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.033 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.033 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.033 INFO:teuthology.orchestra.run.smithi001.stdout: "password": { 2024-09-19T09:47:04.033 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "password", 2024-09-19T09:47:04.033 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.033 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.033 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.034 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.034 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.034 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.034 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.034 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "password of InfluxDB server user", 2024-09-19T09:47:04.034 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.034 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.034 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.034 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.034 INFO:teuthology.orchestra.run.smithi001.stdout: "port": { 2024-09-19T09:47:04.034 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "port", 2024-09-19T09:47:04.034 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.034 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.034 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.034 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8086", 2024-09-19T09:47:04.035 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.035 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.035 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.035 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server port", 2024-09-19T09:47:04.035 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.035 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.035 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.035 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.035 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-19T09:47:04.035 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-19T09:47:04.035 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.035 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.035 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.035 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "false", 2024-09-19T09:47:04.035 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.035 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.036 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.036 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:47:04.036 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.036 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.036 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.036 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.036 INFO:teuthology.orchestra.run.smithi001.stdout: "threads": { 2024-09-19T09:47:04.036 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threads", 2024-09-19T09:47:04.036 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.036 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.036 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.036 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T09:47:04.036 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T09:47:04.036 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "32", 2024-09-19T09:47:04.036 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.037 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T09:47:04.037 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.037 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.037 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.037 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.037 INFO:teuthology.orchestra.run.smithi001.stdout: "username": { 2024-09-19T09:47:04.037 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "username", 2024-09-19T09:47:04.037 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.037 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.037 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.037 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.037 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.037 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.038 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.038 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "username of InfluxDB server user", 2024-09-19T09:47:04.038 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.038 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.038 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.038 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.038 INFO:teuthology.orchestra.run.smithi001.stdout: "verify_ssl": { 2024-09-19T09:47:04.038 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "verify_ssl", 2024-09-19T09:47:04.038 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.038 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.038 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.038 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "true", 2024-09-19T09:47:04.038 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.038 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.039 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.039 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:47:04.039 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.039 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.039 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.039 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.039 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.039 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.039 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.039 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "insights", 2024-09-19T09:47:04.039 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.039 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.039 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.039 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.039 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.040 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.040 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.040 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.040 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.040 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.040 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.040 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.040 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.040 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.040 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.040 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.040 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.040 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.040 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.040 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.041 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.041 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.041 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.041 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.041 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.041 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.041 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.041 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.041 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.041 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.041 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.041 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.041 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.041 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.042 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.042 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.042 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.042 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.042 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.042 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.043 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.043 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.043 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.043 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.043 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.043 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.043 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.043 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.043 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.043 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.043 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.043 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.043 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.044 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.044 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.044 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.044 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.044 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.044 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.044 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.044 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.044 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.044 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.044 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.044 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.044 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.045 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.045 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.045 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.045 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.045 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.045 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.045 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.045 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.045 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.045 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.045 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "iostat", 2024-09-19T09:47:04.045 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.045 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.046 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.046 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.046 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.046 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.046 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.046 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.046 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.046 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.046 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.046 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.046 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.047 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.047 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.047 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.047 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.047 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.047 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.047 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.047 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.047 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.047 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.047 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.047 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.047 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.047 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.047 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.048 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.048 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.048 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.048 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.048 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.048 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.048 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.048 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.048 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.048 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.048 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.048 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.048 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.048 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.048 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.048 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.049 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.049 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.049 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.049 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.049 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.049 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.049 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.049 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.049 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.049 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.049 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.049 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.049 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.049 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.049 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.049 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.050 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.050 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.050 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.050 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.050 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.050 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.050 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.050 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.050 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.050 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.050 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.050 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.050 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.050 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.050 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.051 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.051 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "k8sevents", 2024-09-19T09:47:04.051 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.051 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.051 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.051 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_event_retention_days": { 2024-09-19T09:47:04.051 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ceph_event_retention_days", 2024-09-19T09:47:04.051 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.051 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.051 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.051 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7", 2024-09-19T09:47:04.051 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.051 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.051 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.051 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T09:47:04.052 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.052 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.052 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.052 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.052 INFO:teuthology.orchestra.run.smithi001.stdout: "config_check_secs": { 2024-09-19T09:47:04.052 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_check_secs", 2024-09-19T09:47:04.052 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.052 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.052 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.052 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:47:04.052 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "10", 2024-09-19T09:47:04.053 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.053 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.053 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T09:47:04.053 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.053 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.053 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.053 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.053 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.053 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.053 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.053 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.053 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.053 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.053 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.054 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.054 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.054 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.054 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.054 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.054 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.054 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.054 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.054 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.054 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.054 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.054 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.054 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.054 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.054 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.054 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.055 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.055 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.055 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.055 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.055 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.055 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.055 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.055 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.055 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.055 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.055 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.055 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.055 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.055 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.055 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.055 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.056 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.056 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.056 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.056 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.056 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.056 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.056 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.056 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.056 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.056 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.056 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.056 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.056 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.056 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.056 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.057 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.057 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.057 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.057 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.057 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.057 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.057 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.057 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.057 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.057 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.057 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.057 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.057 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.058 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.058 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.058 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.058 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.058 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.058 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.058 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "localpool", 2024-09-19T09:47:04.058 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.058 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.058 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.058 INFO:teuthology.orchestra.run.smithi001.stdout: "failure_domain": { 2024-09-19T09:47:04.058 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "failure_domain", 2024-09-19T09:47:04.058 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.058 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.058 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.059 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "host", 2024-09-19T09:47:04.059 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.059 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.059 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.059 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "failure domain for any created local pool", 2024-09-19T09:47:04.059 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T09:47:04.059 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.059 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.059 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.059 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.059 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.059 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.059 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.059 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.059 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.059 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.060 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.060 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.060 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.060 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.060 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.060 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.060 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.060 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.060 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.060 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.060 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.060 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.060 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.060 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.061 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.061 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.061 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.061 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.061 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.061 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.061 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.061 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.061 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.061 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.061 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.061 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.061 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.061 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.062 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.062 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.062 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.062 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.062 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.062 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.062 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.062 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.062 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.062 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.062 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.062 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.062 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.062 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.063 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.063 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.063 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.063 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.063 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.063 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.063 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.063 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.063 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.063 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.063 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.064 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.064 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.064 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.064 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.064 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.064 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.064 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.064 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.064 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.065 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.065 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": { 2024-09-19T09:47:04.065 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_size", 2024-09-19T09:47:04.065 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.065 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.065 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.065 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.065 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.065 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.065 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.065 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default min_size for any created local pool", 2024-09-19T09:47:04.065 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T09:47:04.065 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.065 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.065 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.066 INFO:teuthology.orchestra.run.smithi001.stdout: "num_rep": { 2024-09-19T09:47:04.066 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "num_rep", 2024-09-19T09:47:04.066 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.066 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.066 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.066 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3", 2024-09-19T09:47:04.066 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.066 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.066 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.066 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default replica count for any created local pool", 2024-09-19T09:47:04.067 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.067 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.067 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.067 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.067 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": { 2024-09-19T09:47:04.067 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_num", 2024-09-19T09:47:04.067 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.067 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.067 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.067 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "128", 2024-09-19T09:47:04.067 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.067 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.067 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.068 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T09:47:04.068 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.068 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.068 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.068 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.068 INFO:teuthology.orchestra.run.smithi001.stdout: "prefix": { 2024-09-19T09:47:04.068 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prefix", 2024-09-19T09:47:04.068 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.068 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.068 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.068 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.068 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.068 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.068 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.069 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name prefix for any created local pool", 2024-09-19T09:47:04.069 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.069 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.069 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.069 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.069 INFO:teuthology.orchestra.run.smithi001.stdout: "subtree": { 2024-09-19T09:47:04.069 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "subtree", 2024-09-19T09:47:04.069 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.069 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.069 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.069 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "rack", 2024-09-19T09:47:04.069 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.069 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.069 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.070 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T09:47:04.070 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T09:47:04.070 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.070 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.070 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.070 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.070 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.070 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.070 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mds_autoscaler", 2024-09-19T09:47:04.070 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.070 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.070 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.070 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.071 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.071 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.071 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.071 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.071 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.071 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.071 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.071 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.071 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.071 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.071 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.071 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.071 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.072 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.072 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.072 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.072 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.072 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.072 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.072 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.072 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.072 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.072 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.072 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.072 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.073 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.073 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.073 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.073 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.073 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.073 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.073 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.073 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.073 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.073 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.074 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.074 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.074 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.074 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.074 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.074 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.074 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.074 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.074 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.074 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.074 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.074 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.074 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.074 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.075 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.075 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.075 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.075 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.075 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.075 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.075 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.075 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.075 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.075 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.075 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.075 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.075 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.075 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.076 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.076 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.076 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.076 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.076 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.076 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.076 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.076 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.076 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.077 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirroring", 2024-09-19T09:47:04.077 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.077 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.077 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.077 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.077 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.077 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.077 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.077 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.078 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.078 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.078 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.078 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.078 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.078 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.079 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.079 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.079 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.079 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.079 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.079 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.080 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.080 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.080 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.080 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.080 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.080 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.080 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.080 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.080 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.080 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.080 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.080 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.080 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.080 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.080 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.081 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.081 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.081 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.081 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.081 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.081 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.081 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.081 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.081 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.081 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.081 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.081 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.081 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.081 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.081 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.082 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.082 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.082 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.082 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.082 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.082 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.082 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.082 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.082 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.082 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.083 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.083 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.083 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.083 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.083 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.083 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.083 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.083 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.083 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.083 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.083 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.083 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.083 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.083 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.084 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.084 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.084 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "nfs", 2024-09-19T09:47:04.084 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.084 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.084 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.084 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.084 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.085 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.085 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.085 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.085 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.085 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.085 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.085 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.085 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.085 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.085 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.085 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.085 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.085 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.085 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.086 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.086 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.086 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.086 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.086 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.086 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.086 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.086 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.086 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.086 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.086 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.086 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.086 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.086 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.087 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.087 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.087 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.087 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.087 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.087 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.087 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.087 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.087 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.087 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.087 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.087 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.087 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.088 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.088 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.088 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.088 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.088 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.088 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.088 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.088 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.088 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.088 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.088 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.088 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.088 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.088 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.088 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.089 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.089 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.089 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.089 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.089 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.089 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.089 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.089 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.089 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.089 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.089 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.089 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.089 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.089 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.089 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.090 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-19T09:47:04.090 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.090 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.090 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.090 INFO:teuthology.orchestra.run.smithi001.stdout: "fail_fs": { 2024-09-19T09:47:04.090 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "fail_fs", 2024-09-19T09:47:04.090 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.090 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.090 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.090 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.090 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.090 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.090 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.090 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T09:47:04.090 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.091 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.091 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.091 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.091 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.091 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.091 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.091 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.091 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.091 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.091 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.091 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.091 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.091 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.091 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.091 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.091 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.091 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.092 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.092 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.092 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.092 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.092 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.092 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.092 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.092 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.092 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.092 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.092 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.092 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.092 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.092 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.092 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.093 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.093 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.093 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.093 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.093 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.093 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.093 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.093 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.093 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.093 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.093 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.093 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.093 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.093 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.094 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.094 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.094 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.094 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.094 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.094 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.094 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.094 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.094 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.094 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.094 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.095 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.095 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.095 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.095 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.095 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.095 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.095 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.095 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.095 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.095 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.095 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.095 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.095 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.095 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.095 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.096 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.096 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator": { 2024-09-19T09:47:04.096 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-19T09:47:04.096 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.096 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.096 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.096 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.096 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.096 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.096 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.096 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm", 2024-09-19T09:47:04.096 INFO:teuthology.orchestra.run.smithi001.stdout: "rook", 2024-09-19T09:47:04.097 INFO:teuthology.orchestra.run.smithi001.stdout: "test_orchestrator" 2024-09-19T09:47:04.097 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.097 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Orchestrator backend", 2024-09-19T09:47:04.097 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.097 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.097 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.097 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.097 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.097 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.098 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.098 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_perf_query", 2024-09-19T09:47:04.098 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.098 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.098 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.098 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.098 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.098 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.098 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.098 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.098 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.098 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.098 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.099 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.099 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.099 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.099 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.099 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.099 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.099 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.099 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.099 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.099 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.099 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.099 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.099 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.099 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.100 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.100 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.100 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.100 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.100 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.100 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.100 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.100 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.100 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.100 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.100 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.100 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.100 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.101 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.101 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.101 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.101 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.101 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.101 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.101 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.101 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.101 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.101 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.101 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.101 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.101 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.102 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.102 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.102 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.102 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.102 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.102 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.102 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.102 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.102 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.102 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.102 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.102 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.103 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.103 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.103 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.103 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.103 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.103 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.103 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.103 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.103 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.103 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.103 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.104 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.104 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.104 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_support", 2024-09-19T09:47:04.104 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.104 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.104 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.104 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.104 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.104 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.104 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.104 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.104 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.105 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.105 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.105 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.105 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.105 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.105 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.105 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.105 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.105 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.105 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.105 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.105 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.106 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.106 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.106 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.106 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.106 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.106 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.106 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.106 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.106 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.106 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.106 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.106 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.106 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.107 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.107 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.107 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.107 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.107 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.107 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.107 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.107 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.107 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.107 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.107 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.107 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.107 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.107 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.108 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.108 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.108 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.108 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.108 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.108 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.108 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.108 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.108 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.108 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.108 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.108 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.109 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.109 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.109 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.109 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.109 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.109 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.109 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.109 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.109 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.109 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.109 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.109 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.109 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.110 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.110 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.110 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.110 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_autoscaler", 2024-09-19T09:47:04.110 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.110 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.110 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.110 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.110 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.110 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.110 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.110 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.110 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.111 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.111 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.111 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.111 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.111 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.111 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.111 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.111 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.111 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.111 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.111 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.111 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.112 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.112 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.112 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.112 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.112 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.112 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.112 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.112 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.112 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.112 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.112 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.112 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.112 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.112 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.113 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.113 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.113 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.113 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.113 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.113 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.113 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.113 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.113 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.113 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.114 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.114 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.114 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.114 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.114 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.114 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.114 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.114 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.114 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.114 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.114 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.114 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.114 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.114 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.115 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.115 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.115 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.115 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.115 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.115 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.115 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.115 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.115 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.115 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.116 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.116 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.116 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.116 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.116 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T09:47:04.116 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T09:47:04.116 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:04.116 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.116 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.116 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T09:47:04.116 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.116 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.116 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.116 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.117 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.117 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.117 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.117 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.117 INFO:teuthology.orchestra.run.smithi001.stdout: "threshold": { 2024-09-19T09:47:04.117 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threshold", 2024-09-19T09:47:04.117 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:47:04.117 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.117 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.117 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-19T09:47:04.117 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1.0", 2024-09-19T09:47:04.117 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.117 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.117 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "scaling threshold", 2024-09-19T09:47:04.117 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T09:47:04.118 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.118 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.118 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.118 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.118 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.118 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.118 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "progress", 2024-09-19T09:47:04.118 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.118 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.118 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.118 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_pg_recovery_event": { 2024-09-19T09:47:04.119 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_pg_recovery_event", 2024-09-19T09:47:04.119 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.119 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.119 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.119 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.119 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.119 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.119 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.119 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T09:47:04.119 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.119 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.119 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.120 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.120 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-19T09:47:04.120 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-19T09:47:04.120 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.120 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.120 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.120 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.120 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.120 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.120 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.120 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.120 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.120 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.121 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.121 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.121 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.121 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.121 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.121 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.121 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.121 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.121 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.121 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.121 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.122 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.122 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.122 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.122 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.122 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.122 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.122 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.122 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.122 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.122 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.122 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.122 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.122 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.122 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.123 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.123 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.123 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.123 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.123 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.123 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.123 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.123 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.123 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.123 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.123 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.123 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.123 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.123 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.123 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.124 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.124 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.124 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.124 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.124 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.124 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.124 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.124 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.124 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.124 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.124 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.124 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.124 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.125 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.125 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.125 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.125 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.125 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.125 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.125 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.125 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.125 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.125 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.125 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.126 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.126 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.126 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.126 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.126 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.126 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.126 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.126 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.126 INFO:teuthology.orchestra.run.smithi001.stdout: "max_completed_events": { 2024-09-19T09:47:04.126 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_completed_events", 2024-09-19T09:47:04.126 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.126 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.126 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.126 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "50", 2024-09-19T09:47:04.126 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.127 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.127 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.127 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "number of past completed events to remember", 2024-09-19T09:47:04.127 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.127 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.127 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.127 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.127 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T09:47:04.127 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T09:47:04.127 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:04.127 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.127 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.127 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T09:47:04.127 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.127 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.128 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.128 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long the module is going to sleep", 2024-09-19T09:47:04.128 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.128 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.128 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.128 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.128 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.128 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.128 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.128 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus", 2024-09-19T09:47:04.128 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.128 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.128 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.129 INFO:teuthology.orchestra.run.smithi001.stdout: "cache": { 2024-09-19T09:47:04.129 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cache", 2024-09-19T09:47:04.129 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.129 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.129 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.129 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.129 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.129 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.129 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.129 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.129 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.129 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.129 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.129 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.130 INFO:teuthology.orchestra.run.smithi001.stdout: "exclude_perf_counters": { 2024-09-19T09:47:04.130 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "exclude_perf_counters", 2024-09-19T09:47:04.130 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.130 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.130 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.130 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.130 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.130 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.130 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.130 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T09:47:04.130 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T09:47:04.130 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.130 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.131 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.131 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.131 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.131 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.131 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.131 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.131 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.131 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.131 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.131 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.131 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.131 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.131 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.131 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.132 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.132 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.132 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.132 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.132 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.132 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.132 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.132 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.132 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.132 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.132 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.132 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.132 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.133 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.133 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.133 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.133 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.133 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.133 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.133 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.133 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.133 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.133 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.133 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.133 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.134 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.134 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.134 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.134 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.134 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.134 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.134 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.134 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.134 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.134 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.134 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.134 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.135 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.135 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.135 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.135 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.135 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.135 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.135 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.135 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.135 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.135 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.135 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.135 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.136 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.136 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.136 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.136 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.136 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.136 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.136 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.136 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.136 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools": { 2024-09-19T09:47:04.137 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools", 2024-09-19T09:47:04.137 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.137 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.137 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.137 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.137 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.137 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.137 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.137 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.137 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.137 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.137 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.137 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.137 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T09:47:04.137 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T09:47:04.138 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.138 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.138 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.138 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "300", 2024-09-19T09:47:04.138 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.138 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.138 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.138 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.138 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.138 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.138 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.139 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.139 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_interval": { 2024-09-19T09:47:04.139 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_interval", 2024-09-19T09:47:04.139 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:47:04.139 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.139 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.139 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15.0", 2024-09-19T09:47:04.139 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.139 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.139 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.139 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.139 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.139 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.139 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.139 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.140 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-19T09:47:04.140 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-19T09:47:04.140 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.140 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.140 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.140 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-19T09:47:04.140 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.140 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.140 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.140 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T09:47:04.140 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.140 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.140 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.140 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.140 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-19T09:47:04.141 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-19T09:47:04.141 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.141 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.141 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.141 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "9283", 2024-09-19T09:47:04.141 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.141 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.141 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.141 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T09:47:04.141 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.141 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.141 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.141 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.141 INFO:teuthology.orchestra.run.smithi001.stdout: "stale_cache_strategy": { 2024-09-19T09:47:04.142 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stale_cache_strategy", 2024-09-19T09:47:04.142 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.142 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.142 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.142 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "log", 2024-09-19T09:47:04.142 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.142 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.142 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.142 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.142 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.142 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.142 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.142 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.143 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-19T09:47:04.143 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-19T09:47:04.143 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.143 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.143 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.143 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "default", 2024-09-19T09:47:04.143 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.143 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.143 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.143 INFO:teuthology.orchestra.run.smithi001.stdout: "default", 2024-09-19T09:47:04.144 INFO:teuthology.orchestra.run.smithi001.stdout: "error" 2024-09-19T09:47:04.144 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.144 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.144 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.144 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.144 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.144 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.144 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-19T09:47:04.144 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-19T09:47:04.144 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.144 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.145 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.145 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-19T09:47:04.145 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-19T09:47:04.145 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-19T09:47:04.145 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.145 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.145 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.145 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.145 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.145 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.145 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.145 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.145 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.145 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_support", 2024-09-19T09:47:04.146 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.146 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.146 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.146 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.146 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.146 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.146 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.146 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.146 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.146 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.147 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.147 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.147 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.147 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.147 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.147 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.147 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.147 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.147 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.147 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.147 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.147 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.147 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.148 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.148 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.148 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.148 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.148 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.148 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.149 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.149 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.149 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.149 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.149 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.149 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.150 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.150 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.150 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.150 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.150 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.150 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.150 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.150 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.150 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.150 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.150 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.151 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.151 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.151 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.151 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.151 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.151 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.151 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.151 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.151 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.151 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.151 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.151 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.151 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.151 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.152 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.152 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.152 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.152 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.152 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.152 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.152 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.152 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.152 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.152 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.152 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.152 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.152 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.153 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_snap_create": { 2024-09-19T09:47:04.153 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_snap_create", 2024-09-19T09:47:04.153 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.153 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.153 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.153 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:47:04.153 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.153 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.153 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.153 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.153 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.153 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.153 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.153 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.154 INFO:teuthology.orchestra.run.smithi001.stdout: "mirror_snapshot_schedule": { 2024-09-19T09:47:04.154 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T09:47:04.154 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.154 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.154 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.154 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.154 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.154 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.154 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.154 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.154 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.154 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.154 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.154 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.154 INFO:teuthology.orchestra.run.smithi001.stdout: "trash_purge_schedule": { 2024-09-19T09:47:04.154 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "trash_purge_schedule", 2024-09-19T09:47:04.155 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.155 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.155 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.155 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.155 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.155 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.155 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.155 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.155 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.155 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.155 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.155 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.155 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.155 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.155 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.156 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "restful", 2024-09-19T09:47:04.156 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.156 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.156 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.156 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_auth": { 2024-09-19T09:47:04.156 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_auth", 2024-09-19T09:47:04.156 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.156 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.156 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.156 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.156 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.156 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.156 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.156 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.156 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.157 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.157 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.157 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.157 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-19T09:47:04.157 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-19T09:47:04.157 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.157 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.157 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.157 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.157 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.157 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.158 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.158 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.158 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.158 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.158 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.158 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.158 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.158 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.158 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.158 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.158 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.158 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.158 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.159 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.159 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.159 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.159 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.159 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.159 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.159 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.159 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.159 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.159 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.159 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.159 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.159 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.159 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.159 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.159 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.160 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.160 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.160 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.160 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.160 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.160 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.160 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.160 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.160 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.160 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.160 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.160 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.160 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.161 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.161 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.161 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.161 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.161 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.161 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.161 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.161 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.161 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.161 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.161 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.161 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.161 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.161 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.162 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.162 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.162 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.162 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.162 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.162 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.162 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.162 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.162 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.162 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.162 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.162 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.162 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.162 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.162 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.162 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.163 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.163 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.163 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.163 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.163 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-19T09:47:04.163 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-19T09:47:04.163 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.163 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.163 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.163 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.163 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.163 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.163 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.163 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.163 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.164 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.164 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.164 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.164 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-19T09:47:04.164 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-19T09:47:04.164 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.164 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.164 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.164 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.164 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.164 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.165 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.165 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.165 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.165 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.165 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.165 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.165 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.165 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.165 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.165 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rgw", 2024-09-19T09:47:04.165 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.165 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.165 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.165 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.166 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.166 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.166 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.166 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.166 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.166 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.166 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.166 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.166 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.166 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.166 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.166 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.166 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.166 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.167 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.167 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.167 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.167 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.167 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.167 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.167 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.167 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.167 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.167 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.167 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.168 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.168 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.168 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.168 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.168 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.168 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.168 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.168 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.168 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.168 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.168 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.168 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.168 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.168 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.168 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.168 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.169 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.169 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.169 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.169 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.169 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.169 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.169 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.169 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.169 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.169 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.169 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.169 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.169 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.169 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.170 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.170 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.170 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.170 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.170 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.170 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.170 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.170 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.170 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.170 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.170 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.170 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.170 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.170 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.170 INFO:teuthology.orchestra.run.smithi001.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T09:47:04.171 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T09:47:04.171 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.171 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.171 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.171 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T09:47:04.171 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.171 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.171 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.171 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T09:47:04.171 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.171 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.171 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.171 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.172 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.172 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.172 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.172 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rook", 2024-09-19T09:47:04.172 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.172 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.172 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.172 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.172 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.173 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.173 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.173 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.173 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.173 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.173 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.173 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.173 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.173 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.173 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.173 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.173 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.173 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.174 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.174 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.174 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.174 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.174 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.174 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.174 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.174 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.174 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.174 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.174 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.174 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.174 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.175 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.175 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.175 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.175 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.175 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.175 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.175 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.175 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.175 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.175 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.175 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.175 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.175 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.175 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.175 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.176 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.176 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.176 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.176 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.176 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.176 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.176 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.176 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.176 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.176 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.176 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.177 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.177 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.177 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.177 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.177 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.177 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.177 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.177 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.177 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.178 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.178 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.178 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.178 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.178 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.178 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.178 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.178 INFO:teuthology.orchestra.run.smithi001.stdout: "storage_class": { 2024-09-19T09:47:04.179 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "storage_class", 2024-09-19T09:47:04.179 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.179 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.179 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.179 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "local", 2024-09-19T09:47:04.179 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.179 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.179 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.179 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T09:47:04.179 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.179 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.179 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.179 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.180 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.180 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.180 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.180 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "selftest", 2024-09-19T09:47:04.180 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.180 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.180 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.180 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.180 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.180 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.180 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.180 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.180 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.181 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.181 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.181 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.181 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.181 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.181 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.182 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.182 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.182 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.182 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.182 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.182 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.183 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.183 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.183 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.183 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.183 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.183 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.183 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.184 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.184 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.184 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.184 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.184 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.184 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.184 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.184 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.185 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.185 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.185 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.185 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.185 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.185 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.185 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.185 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.185 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.185 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.185 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.185 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.186 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.186 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.186 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.186 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.186 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.186 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.186 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.186 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.186 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.186 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.186 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.186 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.187 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.187 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.187 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.187 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.187 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.187 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.187 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.187 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.187 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.187 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.187 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.188 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.188 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.188 INFO:teuthology.orchestra.run.smithi001.stdout: "roption1": { 2024-09-19T09:47:04.188 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption1", 2024-09-19T09:47:04.188 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.188 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.188 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.188 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.188 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.188 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.188 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.189 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.189 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.189 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.189 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.189 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.189 INFO:teuthology.orchestra.run.smithi001.stdout: "roption2": { 2024-09-19T09:47:04.189 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption2", 2024-09-19T09:47:04.189 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.189 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.189 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.189 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "xyz", 2024-09-19T09:47:04.189 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.190 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.190 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.190 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.190 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.190 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.190 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.190 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.190 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption1": { 2024-09-19T09:47:04.190 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption1", 2024-09-19T09:47:04.190 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.190 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.190 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.190 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.191 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.191 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.191 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.191 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.191 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.191 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.191 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.191 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.191 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption2": { 2024-09-19T09:47:04.191 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption2", 2024-09-19T09:47:04.191 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.191 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.191 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.191 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.191 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.192 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.192 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.192 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.192 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.192 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.192 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.192 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.193 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption3": { 2024-09-19T09:47:04.193 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption3", 2024-09-19T09:47:04.193 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:47:04.193 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.193 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.193 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.193 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.193 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.193 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.193 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.194 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.194 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.194 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.194 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.194 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption4": { 2024-09-19T09:47:04.194 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption4", 2024-09-19T09:47:04.194 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.194 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.194 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.194 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.194 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.194 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.194 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.194 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.195 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.195 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.195 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.195 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.195 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption5": { 2024-09-19T09:47:04.195 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption5", 2024-09-19T09:47:04.195 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.195 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.195 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.195 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.195 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.195 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.195 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.195 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.195 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.196 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.196 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.196 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.196 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption6": { 2024-09-19T09:47:04.196 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption6", 2024-09-19T09:47:04.196 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.196 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.196 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.196 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.196 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.196 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.196 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.196 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.197 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.197 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.197 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.197 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.197 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption7": { 2024-09-19T09:47:04.197 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption7", 2024-09-19T09:47:04.197 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.197 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.197 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.197 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.197 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T09:47:04.197 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "42", 2024-09-19T09:47:04.197 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.198 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.198 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.198 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.198 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.198 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.198 INFO:teuthology.orchestra.run.smithi001.stdout: "testkey": { 2024-09-19T09:47:04.198 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testkey", 2024-09-19T09:47:04.198 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.198 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.198 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.199 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.199 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.199 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.199 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.199 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.199 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.199 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.199 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.199 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.199 INFO:teuthology.orchestra.run.smithi001.stdout: "testlkey": { 2024-09-19T09:47:04.199 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testlkey", 2024-09-19T09:47:04.199 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.199 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.199 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.199 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.200 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.200 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.200 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.200 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.200 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.200 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.200 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.200 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.200 INFO:teuthology.orchestra.run.smithi001.stdout: "testnewline": { 2024-09-19T09:47:04.200 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testnewline", 2024-09-19T09:47:04.200 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.200 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.200 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.200 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.201 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.201 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.201 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.201 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.201 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.201 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.201 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.201 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.201 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.201 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.201 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.201 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snap_schedule", 2024-09-19T09:47:04.201 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.201 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.202 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.202 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_m_granularity": { 2024-09-19T09:47:04.202 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_m_granularity", 2024-09-19T09:47:04.202 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.202 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.202 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.202 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.202 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.202 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.202 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.202 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T09:47:04.202 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.202 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.202 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.202 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.203 INFO:teuthology.orchestra.run.smithi001.stdout: "dump_on_update": { 2024-09-19T09:47:04.203 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dump_on_update", 2024-09-19T09:47:04.203 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.203 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.203 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.203 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.203 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.203 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.203 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.203 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "dump database to debug log on update", 2024-09-19T09:47:04.203 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.204 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.204 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.204 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.204 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.204 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.204 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.204 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.204 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.204 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.204 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.204 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.205 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.205 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.205 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.205 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.205 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.205 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.205 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.205 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.205 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.205 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.205 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.205 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.205 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.206 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.206 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.206 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.206 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.206 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.206 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.206 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.206 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.206 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.206 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.206 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.206 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.206 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.207 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.207 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.207 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.207 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.207 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.207 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.207 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.207 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.207 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.208 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.208 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.208 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.208 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.208 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.208 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.208 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.208 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.208 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.208 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.208 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.209 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.209 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.209 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.209 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.209 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.209 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.209 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.209 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.209 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.209 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.210 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.210 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.210 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.210 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.210 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.210 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.210 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.210 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.210 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.210 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stats", 2024-09-19T09:47:04.210 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.210 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.211 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.211 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.211 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.211 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.211 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.211 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.211 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.211 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.211 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.211 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.211 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.211 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.211 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.211 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.212 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.212 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.212 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.212 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.212 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.212 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.212 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.212 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.212 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.212 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.212 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.212 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.212 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.212 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.213 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.213 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.213 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.213 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.213 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.213 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.213 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.213 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.213 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.213 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.213 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.213 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.213 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.214 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.214 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.214 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.214 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.214 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.214 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.214 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.214 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.214 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.214 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.214 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.215 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.215 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.215 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.215 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.215 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.215 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.215 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.215 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.215 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.215 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.215 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.215 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.215 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.215 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.215 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.216 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.216 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.216 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.216 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.216 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.216 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.216 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.216 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "status", 2024-09-19T09:47:04.216 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.216 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.216 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.216 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.216 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.216 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.217 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.217 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.217 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.217 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.217 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.217 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.217 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.217 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.217 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.217 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.217 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.217 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.217 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.217 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.218 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.218 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.218 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.218 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.218 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.218 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.218 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.218 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.218 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.218 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.218 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.218 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.219 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.219 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.219 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.219 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.219 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.219 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.219 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.219 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.219 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.219 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.220 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.220 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.220 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.220 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.220 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.220 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.220 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.220 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.220 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.220 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.220 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.220 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.220 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.221 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.221 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.221 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.221 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.221 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.221 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.221 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.221 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.221 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.221 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.221 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.221 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.221 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.221 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.222 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.222 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.222 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.222 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.222 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.222 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.222 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.222 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telegraf", 2024-09-19T09:47:04.222 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.222 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.222 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.222 INFO:teuthology.orchestra.run.smithi001.stdout: "address": { 2024-09-19T09:47:04.222 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "address", 2024-09-19T09:47:04.222 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.223 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.223 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.223 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T09:47:04.223 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.223 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.223 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.223 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.223 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.223 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.223 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.223 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.223 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T09:47:04.223 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T09:47:04.224 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:04.224 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.224 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.224 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15", 2024-09-19T09:47:04.224 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.224 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.224 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.224 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.224 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.224 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.224 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.224 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.224 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.224 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.225 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.225 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.225 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.225 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.225 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.225 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.225 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.225 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.225 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.225 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.225 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.225 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.226 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.226 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.226 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.226 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.226 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.226 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.226 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.226 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.226 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.226 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.226 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.226 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.226 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.226 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.226 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.227 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.227 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.227 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.227 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.227 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.227 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.227 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.227 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.227 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.227 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.227 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.227 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.227 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.227 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.227 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.228 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.228 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.228 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.228 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.228 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.228 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.228 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.228 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.228 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.228 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.228 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.228 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.228 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.228 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.229 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.229 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.229 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.229 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.229 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.229 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.229 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.229 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.229 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.229 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.230 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.230 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.230 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.230 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.230 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.230 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telemetry", 2024-09-19T09:47:04.230 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.230 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.230 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.230 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_basic": { 2024-09-19T09:47:04.230 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_basic", 2024-09-19T09:47:04.230 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.230 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.230 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.231 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.231 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.231 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.231 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.231 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T09:47:04.231 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.231 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.231 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.231 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.231 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_crash": { 2024-09-19T09:47:04.231 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_crash", 2024-09-19T09:47:04.231 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.231 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.231 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.232 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.232 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.232 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.232 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.232 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T09:47:04.232 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.232 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.232 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.232 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.232 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_device": { 2024-09-19T09:47:04.232 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_device", 2024-09-19T09:47:04.232 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.232 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.232 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.233 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.233 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.233 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.233 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.233 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T09:47:04.233 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.233 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.233 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.233 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.233 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_ident": { 2024-09-19T09:47:04.233 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_ident", 2024-09-19T09:47:04.234 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.234 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.234 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.234 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.234 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.234 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.234 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.234 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T09:47:04.234 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.234 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.234 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.235 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.235 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_perf": { 2024-09-19T09:47:04.235 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_perf", 2024-09-19T09:47:04.235 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.235 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.235 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.236 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.236 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.236 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.236 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.236 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T09:47:04.236 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.237 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.237 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.237 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.237 INFO:teuthology.orchestra.run.smithi001.stdout: "contact": { 2024-09-19T09:47:04.237 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "contact", 2024-09-19T09:47:04.237 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.237 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.237 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.237 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.237 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.237 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.237 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.237 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.237 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.238 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.238 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.238 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.238 INFO:teuthology.orchestra.run.smithi001.stdout: "description": { 2024-09-19T09:47:04.238 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "description", 2024-09-19T09:47:04.238 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.238 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.238 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.238 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.238 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.238 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.239 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.239 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.239 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.239 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.239 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.239 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.239 INFO:teuthology.orchestra.run.smithi001.stdout: "device_url": { 2024-09-19T09:47:04.239 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_url", 2024-09-19T09:47:04.239 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.239 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.239 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.239 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T09:47:04.240 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.240 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.240 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.240 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.240 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.240 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.240 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.240 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.240 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-19T09:47:04.240 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-19T09:47:04.240 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.241 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.241 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.241 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.241 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.241 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.241 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.241 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.241 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.241 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.241 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.241 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.241 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T09:47:04.241 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T09:47:04.242 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.242 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.242 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.242 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "24", 2024-09-19T09:47:04.242 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "8", 2024-09-19T09:47:04.242 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.242 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.242 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.242 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.242 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.242 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.242 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.243 INFO:teuthology.orchestra.run.smithi001.stdout: "last_opt_revision": { 2024-09-19T09:47:04.243 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "last_opt_revision", 2024-09-19T09:47:04.243 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.243 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.243 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.243 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1", 2024-09-19T09:47:04.243 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.243 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.243 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.243 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.243 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.243 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.244 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.244 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.244 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard": { 2024-09-19T09:47:04.244 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard", 2024-09-19T09:47:04.244 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.244 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.244 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.244 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.244 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.244 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.244 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.244 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.244 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.245 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.245 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.245 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.245 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard_description": { 2024-09-19T09:47:04.245 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard_description", 2024-09-19T09:47:04.245 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.245 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.245 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.245 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.245 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.245 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.245 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.245 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.245 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.246 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.246 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.246 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.246 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.246 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.246 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.246 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.246 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.246 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.246 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.246 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.246 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.247 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.247 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.247 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.247 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.247 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.247 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.247 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.247 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.247 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.247 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.247 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.247 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.247 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.248 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.248 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.248 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.248 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.248 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.248 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.248 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.248 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.248 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.248 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.248 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.248 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.248 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.248 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.249 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.249 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.249 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.249 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.249 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.249 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.249 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.249 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.249 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.249 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.249 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.249 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.249 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.249 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.249 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.250 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.250 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.250 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.250 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.250 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.250 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.250 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.250 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.250 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.250 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.251 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.251 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.251 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.251 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.251 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.251 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.251 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.251 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.251 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.251 INFO:teuthology.orchestra.run.smithi001.stdout: "organization": { 2024-09-19T09:47:04.251 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "organization", 2024-09-19T09:47:04.251 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.251 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.251 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.251 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.252 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.252 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.252 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.252 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.252 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.252 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.252 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.252 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.252 INFO:teuthology.orchestra.run.smithi001.stdout: "proxy": { 2024-09-19T09:47:04.252 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "proxy", 2024-09-19T09:47:04.252 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.252 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.252 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.253 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.253 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.253 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.253 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.253 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.253 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.253 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.253 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.253 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.253 INFO:teuthology.orchestra.run.smithi001.stdout: "url": { 2024-09-19T09:47:04.253 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url", 2024-09-19T09:47:04.253 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.253 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.253 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.254 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T09:47:04.254 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.254 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.254 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.254 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.254 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.254 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.254 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.254 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.254 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.254 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.254 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.254 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "test_orchestrator", 2024-09-19T09:47:04.254 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.254 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.255 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.255 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.255 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.255 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.255 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.255 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.255 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.255 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.255 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.255 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.255 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.255 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.255 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.255 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.255 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.256 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.256 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.256 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.256 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.256 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.256 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.256 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.256 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.256 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.256 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.256 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.256 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.256 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.256 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.257 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.257 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.257 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.257 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.257 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.257 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.257 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.257 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.257 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.257 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.257 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.257 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.257 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.257 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.258 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.258 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.258 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.258 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.258 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.258 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.258 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.258 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.258 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.258 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.258 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.258 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.259 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.259 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.259 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.259 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.259 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.259 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.259 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.259 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.259 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.259 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.259 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.259 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.259 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.259 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.260 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.260 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.260 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.260 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.260 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.260 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "volumes", 2024-09-19T09:47:04.260 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.260 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.260 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.260 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.260 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.260 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.261 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.261 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.261 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.261 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.261 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.261 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.261 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.261 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.261 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.261 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.261 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.261 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.262 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.262 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.262 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.262 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.262 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.262 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.262 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.262 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.262 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.262 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.262 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.262 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.262 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.262 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.262 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.263 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.263 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.263 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.263 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.263 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.263 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.263 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.263 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.263 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.263 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.263 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.263 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.264 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.264 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.264 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.264 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.264 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.264 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.264 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.264 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.264 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.264 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.264 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.265 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.265 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.265 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.265 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.265 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.265 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.265 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.265 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.265 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.265 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.265 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.265 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.265 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.266 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.266 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.266 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.266 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.266 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_clones": { 2024-09-19T09:47:04.266 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_clones", 2024-09-19T09:47:04.266 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.266 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.266 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.266 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4", 2024-09-19T09:47:04.266 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.266 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.267 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.267 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T09:47:04.267 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.267 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.267 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.267 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.267 INFO:teuthology.orchestra.run.smithi001.stdout: "periodic_async_work": { 2024-09-19T09:47:04.267 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "periodic_async_work", 2024-09-19T09:47:04.267 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.267 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.267 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.267 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.267 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.267 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.268 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.268 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Periodically check for async work", 2024-09-19T09:47:04.268 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.268 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.268 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.268 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.268 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_delay": { 2024-09-19T09:47:04.268 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_delay", 2024-09-19T09:47:04.268 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.268 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.268 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.268 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T09:47:04.269 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.269 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.269 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.269 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T09:47:04.269 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.269 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.269 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.269 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.269 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_no_wait": { 2024-09-19T09:47:04.269 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T09:47:04.269 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.269 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.269 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.270 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.270 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.270 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.270 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.270 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T09:47:04.270 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.270 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.270 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.270 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.270 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.270 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.270 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.270 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix", 2024-09-19T09:47:04.271 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.271 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.271 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.271 INFO:teuthology.orchestra.run.smithi001.stdout: "discovery_interval": { 2024-09-19T09:47:04.271 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "discovery_interval", 2024-09-19T09:47:04.271 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T09:47:04.271 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.271 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.271 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "100", 2024-09-19T09:47:04.271 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.272 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.272 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.272 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.272 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.272 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.272 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.272 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.272 INFO:teuthology.orchestra.run.smithi001.stdout: "identifier": { 2024-09-19T09:47:04.272 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "identifier", 2024-09-19T09:47:04.272 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.272 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.273 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.273 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.273 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.273 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.273 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.273 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.273 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.273 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.273 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.273 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.273 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T09:47:04.274 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T09:47:04.274 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:04.274 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.274 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.274 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T09:47:04.274 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.274 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.274 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.274 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.274 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.274 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.274 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.274 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.275 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.275 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.275 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.275 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.275 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.275 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.275 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.275 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.275 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.275 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.275 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.275 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.275 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.275 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.275 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.276 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.276 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.276 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.276 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.276 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.276 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.276 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.276 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.276 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.276 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.276 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.276 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.277 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.277 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.277 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.277 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.277 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.277 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.277 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.277 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.277 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.277 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.277 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.277 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.278 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.278 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.278 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.278 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.278 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.278 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.278 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.278 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.279 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.279 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.279 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.279 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.279 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.279 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.279 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.279 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.279 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.279 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.279 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.279 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.279 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.280 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.280 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.280 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.280 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.280 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.280 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.280 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.280 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.280 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.280 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.280 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_host": { 2024-09-19T09:47:04.280 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_host", 2024-09-19T09:47:04.280 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.281 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.281 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.281 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.281 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.281 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.281 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.281 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.281 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.281 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.281 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.281 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.282 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_port": { 2024-09-19T09:47:04.282 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_port", 2024-09-19T09:47:04.282 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.282 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.282 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.282 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10051", 2024-09-19T09:47:04.282 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.282 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.282 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.282 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.282 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.282 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.282 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.282 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.283 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_sender": { 2024-09-19T09:47:04.283 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_sender", 2024-09-19T09:47:04.283 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.283 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.283 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.283 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T09:47:04.283 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.283 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.283 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.283 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.283 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.283 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.283 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.284 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.284 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.284 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.284 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-19T09:47:04.284 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.284 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.284 INFO:teuthology.orchestra.run.smithi001.stdout: "modules": [ 2024-09-19T09:47:04.284 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm", 2024-09-19T09:47:04.284 INFO:teuthology.orchestra.run.smithi001.stdout: "dashboard", 2024-09-19T09:47:04.284 INFO:teuthology.orchestra.run.smithi001.stdout: "iostat", 2024-09-19T09:47:04.284 INFO:teuthology.orchestra.run.smithi001.stdout: "nfs", 2024-09-19T09:47:04.284 INFO:teuthology.orchestra.run.smithi001.stdout: "restful" 2024-09-19T09:47:04.284 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.285 INFO:teuthology.orchestra.run.smithi001.stdout: "available_modules": [ 2024-09-19T09:47:04.285 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.285 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "alerts", 2024-09-19T09:47:04.285 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.285 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.285 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.285 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T09:47:04.285 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T09:47:04.285 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:04.285 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.285 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.285 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T09:47:04.285 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.286 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.286 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.286 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T09:47:04.286 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.286 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.286 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.286 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.286 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.286 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.286 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.286 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.286 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.286 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.286 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.286 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.287 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.287 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.287 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.287 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.287 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.287 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.287 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.287 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.287 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.287 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.287 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.287 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.287 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.287 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.287 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.288 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.288 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.288 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.288 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.288 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.288 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.288 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.288 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.288 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.288 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.288 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.288 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.288 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.288 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.288 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.289 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.289 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.289 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.289 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.289 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.289 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.289 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.289 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.289 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.289 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.289 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.289 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.289 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.290 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.290 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.290 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.290 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.290 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.290 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.290 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.290 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.290 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.290 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.290 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.290 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.290 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.290 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.291 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.291 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.291 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.291 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.291 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.291 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_destination": { 2024-09-19T09:47:04.291 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_destination", 2024-09-19T09:47:04.291 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.291 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.291 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.291 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.291 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.291 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.291 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.292 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email address to send alerts to", 2024-09-19T09:47:04.292 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.292 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.292 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.292 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.292 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_from_name": { 2024-09-19T09:47:04.292 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_from_name", 2024-09-19T09:47:04.292 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.292 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.292 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.292 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "Ceph", 2024-09-19T09:47:04.292 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.293 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.293 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.293 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Email From: name", 2024-09-19T09:47:04.293 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.293 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.293 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.293 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.293 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_host": { 2024-09-19T09:47:04.293 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_host", 2024-09-19T09:47:04.293 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.293 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.293 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.293 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.294 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.294 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.294 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.294 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP server", 2024-09-19T09:47:04.294 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.294 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.294 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.294 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.294 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_password": { 2024-09-19T09:47:04.294 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_password", 2024-09-19T09:47:04.294 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.294 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.294 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.294 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.294 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.294 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.295 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.295 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Password to authenticate with", 2024-09-19T09:47:04.295 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.295 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.295 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.295 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.295 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_port": { 2024-09-19T09:47:04.295 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_port", 2024-09-19T09:47:04.295 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.295 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.295 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.295 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "465", 2024-09-19T09:47:04.295 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.296 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.296 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.296 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP port", 2024-09-19T09:47:04.296 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.296 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.296 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.296 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.296 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_sender": { 2024-09-19T09:47:04.296 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_sender", 2024-09-19T09:47:04.296 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.296 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.296 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.296 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.296 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.297 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.297 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.297 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SMTP envelope sender", 2024-09-19T09:47:04.297 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.297 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.297 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.297 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.297 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_ssl": { 2024-09-19T09:47:04.297 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_ssl", 2024-09-19T09:47:04.297 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.297 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.297 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.297 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.298 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.298 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.298 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.298 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T09:47:04.298 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.298 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.298 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.298 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.298 INFO:teuthology.orchestra.run.smithi001.stdout: "smtp_user": { 2024-09-19T09:47:04.298 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "smtp_user", 2024-09-19T09:47:04.298 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.298 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.299 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.299 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.299 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.299 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.299 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.299 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "User to authenticate as", 2024-09-19T09:47:04.299 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.299 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.299 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.299 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.299 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.299 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.299 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.299 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "balancer", 2024-09-19T09:47:04.299 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.300 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.300 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.300 INFO:teuthology.orchestra.run.smithi001.stdout: "active": { 2024-09-19T09:47:04.300 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "active", 2024-09-19T09:47:04.300 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.300 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.300 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.300 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.300 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.300 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.300 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.300 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T09:47:04.300 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.301 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.301 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.301 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.301 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_time": { 2024-09-19T09:47:04.301 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_time", 2024-09-19T09:47:04.301 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.301 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.301 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.301 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0000", 2024-09-19T09:47:04.301 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.301 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.301 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.301 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T09:47:04.301 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:47:04.302 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.302 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.302 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.302 INFO:teuthology.orchestra.run.smithi001.stdout: "begin_weekday": { 2024-09-19T09:47:04.302 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "begin_weekday", 2024-09-19T09:47:04.302 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T09:47:04.302 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.302 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.302 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T09:47:04.302 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-19T09:47:04.303 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-19T09:47:04.303 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.303 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T09:47:04.303 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:47:04.303 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.303 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.304 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.304 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_max_iterations": { 2024-09-19T09:47:04.304 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_max_iterations", 2024-09-19T09:47:04.304 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T09:47:04.304 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.304 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.304 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "25", 2024-09-19T09:47:04.304 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T09:47:04.304 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "250", 2024-09-19T09:47:04.304 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.305 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T09:47:04.305 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.305 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.305 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.305 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.305 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_metrics": { 2024-09-19T09:47:04.305 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_metrics", 2024-09-19T09:47:04.305 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.305 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.305 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.306 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T09:47:04.306 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.306 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.306 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.306 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T09:47:04.306 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T09:47:04.306 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.306 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.306 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.306 INFO:teuthology.orchestra.run.smithi001.stdout: "crush_compat_step": { 2024-09-19T09:47:04.306 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crush_compat_step", 2024-09-19T09:47:04.306 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:47:04.306 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.306 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.306 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.5", 2024-09-19T09:47:04.307 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0.001", 2024-09-19T09:47:04.307 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "0.999", 2024-09-19T09:47:04.307 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.307 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "aggressiveness of optimization", 2024-09-19T09:47:04.307 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T09:47:04.307 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.307 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.307 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.307 INFO:teuthology.orchestra.run.smithi001.stdout: "end_time": { 2024-09-19T09:47:04.307 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_time", 2024-09-19T09:47:04.307 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.307 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.307 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.307 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2359", 2024-09-19T09:47:04.307 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.308 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.308 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.308 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T09:47:04.308 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:47:04.308 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.308 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.308 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.308 INFO:teuthology.orchestra.run.smithi001.stdout: "end_weekday": { 2024-09-19T09:47:04.308 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "end_weekday", 2024-09-19T09:47:04.308 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T09:47:04.308 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.308 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.309 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T09:47:04.309 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "0", 2024-09-19T09:47:04.309 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "6", 2024-09-19T09:47:04.309 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.309 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T09:47:04.309 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:47:04.309 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.309 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.309 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.309 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.309 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.309 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.309 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.309 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.310 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.310 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.310 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.310 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.310 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.310 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.310 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.310 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.310 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.310 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.310 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.310 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.310 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.310 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.310 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.310 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.310 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.311 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.311 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.311 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.311 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.311 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.311 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.311 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.311 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.311 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.311 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.311 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.311 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.311 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.311 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.311 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.311 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.312 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.312 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.312 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.312 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.312 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.312 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.312 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.312 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.312 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.312 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.312 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.312 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.312 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.312 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.312 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.313 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.313 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.313 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.313 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.313 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.313 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.313 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.313 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.313 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.313 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.313 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.313 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.313 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.313 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.314 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.314 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.314 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.314 INFO:teuthology.orchestra.run.smithi001.stdout: "min_score": { 2024-09-19T09:47:04.314 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_score", 2024-09-19T09:47:04.314 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:47:04.314 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.314 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.314 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T09:47:04.314 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.314 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.314 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.314 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T09:47:04.314 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.314 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.314 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.315 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.315 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-19T09:47:04.315 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-19T09:47:04.315 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.315 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.315 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.315 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "upmap", 2024-09-19T09:47:04.315 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.315 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.315 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.315 INFO:teuthology.orchestra.run.smithi001.stdout: "crush-compat", 2024-09-19T09:47:04.315 INFO:teuthology.orchestra.run.smithi001.stdout: "none", 2024-09-19T09:47:04.315 INFO:teuthology.orchestra.run.smithi001.stdout: "read", 2024-09-19T09:47:04.316 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap", 2024-09-19T09:47:04.316 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap-read" 2024-09-19T09:47:04.316 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.316 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Balancer mode", 2024-09-19T09:47:04.316 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.316 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.316 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.316 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.316 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_ids": { 2024-09-19T09:47:04.316 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_ids", 2024-09-19T09:47:04.316 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.316 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.316 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.316 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.317 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.317 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.317 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.317 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T09:47:04.317 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.317 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.317 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.317 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.317 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T09:47:04.317 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T09:47:04.317 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:04.317 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.317 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.317 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T09:47:04.318 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.318 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.318 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.318 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T09:47:04.318 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.318 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.318 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.318 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.318 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_deviation": { 2024-09-19T09:47:04.318 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_deviation", 2024-09-19T09:47:04.318 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.318 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.318 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.318 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T09:47:04.319 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T09:47:04.319 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.319 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.319 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T09:47:04.319 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T09:47:04.319 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.319 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.319 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.319 INFO:teuthology.orchestra.run.smithi001.stdout: "upmap_max_optimizations": { 2024-09-19T09:47:04.319 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "upmap_max_optimizations", 2024-09-19T09:47:04.319 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T09:47:04.319 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.320 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.320 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:47:04.320 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.320 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.320 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.320 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T09:47:04.320 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.320 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.320 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.320 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.320 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.321 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.321 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.321 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm", 2024-09-19T09:47:04.321 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.321 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.321 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.321 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_down_multiplier": { 2024-09-19T09:47:04.321 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_down_multiplier", 2024-09-19T09:47:04.321 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:47:04.321 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.321 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.322 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-19T09:47:04.322 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.322 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.322 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.322 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T09:47:04.322 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.322 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.322 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.322 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.322 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_refresh_rate": { 2024-09-19T09:47:04.322 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_refresh_rate", 2024-09-19T09:47:04.322 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:04.322 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.322 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.322 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "20", 2024-09-19T09:47:04.322 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.323 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.323 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.323 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T09:47:04.323 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.323 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.323 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.323 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.323 INFO:teuthology.orchestra.run.smithi001.stdout: "agent_starting_port": { 2024-09-19T09:47:04.323 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "agent_starting_port", 2024-09-19T09:47:04.323 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.323 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.323 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.323 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4721", 2024-09-19T09:47:04.323 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.324 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.324 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.324 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T09:47:04.324 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.324 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.324 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.324 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.324 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_ptrace": { 2024-09-19T09:47:04.324 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_ptrace", 2024-09-19T09:47:04.324 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.324 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.324 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.324 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.324 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.324 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.325 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.325 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T09:47:04.325 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T09:47:04.325 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.325 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.325 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.325 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_interval": { 2024-09-19T09:47:04.325 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_interval", 2024-09-19T09:47:04.325 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:04.325 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.325 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.325 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T09:47:04.326 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.326 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.326 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.326 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T09:47:04.326 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.326 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.326 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.326 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.326 INFO:teuthology.orchestra.run.smithi001.stdout: "autotune_memory_target_ratio": { 2024-09-19T09:47:04.326 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T09:47:04.326 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:47:04.326 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.327 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.327 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0.7", 2024-09-19T09:47:04.327 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.327 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.327 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.327 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T09:47:04.327 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.327 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.327 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.327 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.327 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm_log_destination": { 2024-09-19T09:47:04.327 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cephadm_log_destination", 2024-09-19T09:47:04.327 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.328 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.328 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.328 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.328 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.328 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.328 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.328 INFO:teuthology.orchestra.run.smithi001.stdout: "file", 2024-09-19T09:47:04.328 INFO:teuthology.orchestra.run.smithi001.stdout: "file,syslog", 2024-09-19T09:47:04.328 INFO:teuthology.orchestra.run.smithi001.stdout: "syslog" 2024-09-19T09:47:04.328 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.328 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T09:47:04.328 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.328 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.329 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.329 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.329 INFO:teuthology.orchestra.run.smithi001.stdout: "cgroups_split": { 2024-09-19T09:47:04.329 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cgroups_split", 2024-09-19T09:47:04.329 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.329 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.329 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.329 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.329 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.329 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.329 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.329 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T09:47:04.329 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.330 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.330 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.330 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.330 INFO:teuthology.orchestra.run.smithi001.stdout: "config_checks_enabled": { 2024-09-19T09:47:04.330 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_checks_enabled", 2024-09-19T09:47:04.330 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.330 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.330 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.330 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.330 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.330 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.330 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.330 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T09:47:04.331 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.331 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.331 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.331 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.331 INFO:teuthology.orchestra.run.smithi001.stdout: "config_dashboard": { 2024-09-19T09:47:04.331 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_dashboard", 2024-09-19T09:47:04.331 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.331 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.331 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.331 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.331 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.331 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.331 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.331 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T09:47:04.332 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.332 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.332 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.332 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.332 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_alertmanager": { 2024-09-19T09:47:04.332 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_alertmanager", 2024-09-19T09:47:04.332 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.332 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.332 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.332 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T09:47:04.332 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.332 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.332 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.333 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T09:47:04.333 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.333 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.333 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.333 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.333 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_base": { 2024-09-19T09:47:04.333 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_base", 2024-09-19T09:47:04.333 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.333 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.333 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.333 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T09:47:04.333 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.334 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.334 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.334 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Container image name, without the tag", 2024-09-19T09:47:04.334 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.334 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.334 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.334 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.334 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_elasticsearch": { 2024-09-19T09:47:04.334 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_elasticsearch", 2024-09-19T09:47:04.334 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.334 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.335 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.335 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T09:47:04.335 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.335 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.335 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.335 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "elasticsearch container image", 2024-09-19T09:47:04.335 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.335 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.335 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.335 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.335 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_grafana": { 2024-09-19T09:47:04.335 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_grafana", 2024-09-19T09:47:04.335 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.335 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.335 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.335 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T09:47:04.336 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.336 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.336 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.336 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T09:47:04.336 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.336 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.336 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.336 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.336 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_haproxy": { 2024-09-19T09:47:04.336 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_haproxy", 2024-09-19T09:47:04.336 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.336 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.336 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.336 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T09:47:04.336 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.336 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.337 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.337 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "HAproxy container image", 2024-09-19T09:47:04.337 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.337 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.337 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.337 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.337 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_agent": { 2024-09-19T09:47:04.337 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_agent", 2024-09-19T09:47:04.337 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.337 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.337 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.337 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T09:47:04.337 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.337 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.338 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.338 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger agent container image", 2024-09-19T09:47:04.338 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.338 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.338 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.338 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.338 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_collector": { 2024-09-19T09:47:04.338 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_collector", 2024-09-19T09:47:04.338 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.338 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.338 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.338 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T09:47:04.338 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.338 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.339 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.339 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger collector container image", 2024-09-19T09:47:04.339 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.339 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.339 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.339 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.339 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_jaeger_query": { 2024-09-19T09:47:04.339 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_jaeger_query", 2024-09-19T09:47:04.339 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.339 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.339 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.339 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T09:47:04.339 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.339 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.340 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.340 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Jaeger query container image", 2024-09-19T09:47:04.340 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.340 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.340 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.340 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.340 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_keepalived": { 2024-09-19T09:47:04.340 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_keepalived", 2024-09-19T09:47:04.340 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.340 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.340 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.340 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T09:47:04.340 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.340 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.341 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.341 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Keepalived container image", 2024-09-19T09:47:04.341 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.341 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.341 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.341 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.341 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_loki": { 2024-09-19T09:47:04.341 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_loki", 2024-09-19T09:47:04.341 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.341 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.341 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.341 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T09:47:04.341 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.341 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.341 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.341 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Loki container image", 2024-09-19T09:47:04.342 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.342 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.342 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.342 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.342 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_node_exporter": { 2024-09-19T09:47:04.342 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_node_exporter", 2024-09-19T09:47:04.342 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.342 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.342 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.342 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T09:47:04.342 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.342 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.342 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.342 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T09:47:04.342 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.342 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.343 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.343 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.343 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_nvmeof": { 2024-09-19T09:47:04.343 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_nvmeof", 2024-09-19T09:47:04.343 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.343 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.343 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.343 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T09:47:04.343 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.343 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.344 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.344 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Nvme-of container image", 2024-09-19T09:47:04.344 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.344 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.344 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.344 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.344 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_prometheus": { 2024-09-19T09:47:04.344 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_prometheus", 2024-09-19T09:47:04.344 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.344 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.345 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.345 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T09:47:04.345 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.345 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.345 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.345 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Prometheus container image", 2024-09-19T09:47:04.345 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.345 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.345 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.345 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.345 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_promtail": { 2024-09-19T09:47:04.345 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_promtail", 2024-09-19T09:47:04.345 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.345 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.345 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.346 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T09:47:04.346 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.346 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.346 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.346 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Promtail container image", 2024-09-19T09:47:04.346 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.346 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.346 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.346 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.346 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_samba": { 2024-09-19T09:47:04.346 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_samba", 2024-09-19T09:47:04.346 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.346 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.346 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.347 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T09:47:04.347 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.347 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.347 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.347 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Samba/SMB container image", 2024-09-19T09:47:04.347 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.347 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.347 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.347 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.347 INFO:teuthology.orchestra.run.smithi001.stdout: "container_image_snmp_gateway": { 2024-09-19T09:47:04.347 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_image_snmp_gateway", 2024-09-19T09:47:04.348 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.348 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.348 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.348 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T09:47:04.348 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.348 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.348 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.348 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "SNMP Gateway container image", 2024-09-19T09:47:04.348 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.348 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.348 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.348 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.348 INFO:teuthology.orchestra.run.smithi001.stdout: "container_init": { 2024-09-19T09:47:04.348 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "container_init", 2024-09-19T09:47:04.349 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.349 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.349 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.349 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.349 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.349 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.349 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.349 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T09:47:04.349 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.349 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.349 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.349 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.349 INFO:teuthology.orchestra.run.smithi001.stdout: "daemon_cache_timeout": { 2024-09-19T09:47:04.349 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "daemon_cache_timeout", 2024-09-19T09:47:04.349 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:04.349 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.350 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.350 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T09:47:04.350 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.350 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.350 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.350 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T09:47:04.350 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.350 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.350 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.350 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.350 INFO:teuthology.orchestra.run.smithi001.stdout: "default_cephadm_command_timeout": { 2024-09-19T09:47:04.350 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T09:47:04.350 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.350 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.350 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.351 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "900", 2024-09-19T09:47:04.351 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.351 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.351 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.351 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T09:47:04.351 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.351 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.351 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.351 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.351 INFO:teuthology.orchestra.run.smithi001.stdout: "default_registry": { 2024-09-19T09:47:04.351 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "default_registry", 2024-09-19T09:47:04.351 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.351 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.351 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.351 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "docker.io", 2024-09-19T09:47:04.351 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.352 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.352 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.352 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T09:47:04.352 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.352 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.352 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.352 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.352 INFO:teuthology.orchestra.run.smithi001.stdout: "device_cache_timeout": { 2024-09-19T09:47:04.352 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_cache_timeout", 2024-09-19T09:47:04.352 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:04.352 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.352 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.353 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1800", 2024-09-19T09:47:04.353 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.353 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.353 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.353 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache device inventory", 2024-09-19T09:47:04.353 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.353 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.353 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.353 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.353 INFO:teuthology.orchestra.run.smithi001.stdout: "device_enhanced_scan": { 2024-09-19T09:47:04.353 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_enhanced_scan", 2024-09-19T09:47:04.353 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.353 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.353 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.353 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.354 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.354 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.354 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.354 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T09:47:04.354 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.354 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.354 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.354 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.354 INFO:teuthology.orchestra.run.smithi001.stdout: "facts_cache_timeout": { 2024-09-19T09:47:04.354 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "facts_cache_timeout", 2024-09-19T09:47:04.354 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:04.354 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.354 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.354 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T09:47:04.354 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.354 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.355 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.355 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "seconds to cache host facts data", 2024-09-19T09:47:04.355 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.355 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.355 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.355 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.355 INFO:teuthology.orchestra.run.smithi001.stdout: "grafana_dashboards_path": { 2024-09-19T09:47:04.355 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "grafana_dashboards_path", 2024-09-19T09:47:04.355 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.355 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.355 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.355 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T09:47:04.355 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.355 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.355 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.356 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T09:47:04.356 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.356 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.356 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.356 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.356 INFO:teuthology.orchestra.run.smithi001.stdout: "host_check_interval": { 2024-09-19T09:47:04.356 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "host_check_interval", 2024-09-19T09:47:04.356 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:04.356 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.356 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.356 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T09:47:04.356 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.356 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.356 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.357 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to perform a host check", 2024-09-19T09:47:04.357 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.357 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.357 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.357 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.357 INFO:teuthology.orchestra.run.smithi001.stdout: "hw_monitoring": { 2024-09-19T09:47:04.357 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hw_monitoring", 2024-09-19T09:47:04.357 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.357 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.357 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.357 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.357 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.357 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.358 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.358 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T09:47:04.358 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.358 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.358 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.358 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.358 INFO:teuthology.orchestra.run.smithi001.stdout: "inventory_list_all": { 2024-09-19T09:47:04.358 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "inventory_list_all", 2024-09-19T09:47:04.358 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.358 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.358 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.358 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.358 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.358 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.358 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.358 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T09:47:04.359 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.359 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.359 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.359 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.359 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.359 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.359 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.359 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.359 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.359 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.359 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.359 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.359 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.359 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.359 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.360 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.360 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.360 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.360 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.360 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.360 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.360 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.360 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.360 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.360 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.360 INFO:teuthology.orchestra.run.smithi001.stdout: "log_refresh_metadata": { 2024-09-19T09:47:04.360 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_refresh_metadata", 2024-09-19T09:47:04.360 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.360 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.361 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.361 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.361 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.361 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.361 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.361 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T09:47:04.361 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.361 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.361 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.361 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.361 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.361 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.361 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.362 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.362 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.362 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.362 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.362 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.362 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.362 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T09:47:04.362 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.362 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.362 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.362 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.362 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.362 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.362 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.362 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.363 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.363 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.363 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.363 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.363 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.363 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.363 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.363 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.363 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.363 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.363 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.363 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.363 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.364 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.364 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.364 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.364 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.364 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.364 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.364 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.364 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.364 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.364 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.364 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.364 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.365 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.365 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.365 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.365 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.365 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.365 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.365 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T09:47:04.365 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T09:47:04.365 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.365 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.365 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.365 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.366 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.366 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.366 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.366 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T09:47:04.366 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.366 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.366 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.366 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.366 INFO:teuthology.orchestra.run.smithi001.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T09:47:04.366 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T09:47:04.366 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.366 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.366 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.367 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "*", 2024-09-19T09:47:04.367 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.367 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.367 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.367 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T09:47:04.367 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.367 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.367 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.367 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.367 INFO:teuthology.orchestra.run.smithi001.stdout: "max_count_per_host": { 2024-09-19T09:47:04.367 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_count_per_host", 2024-09-19T09:47:04.367 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.367 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.367 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.368 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:47:04.368 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.368 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.368 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.368 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of daemons per service per host", 2024-09-19T09:47:04.368 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.368 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.368 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.368 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.368 INFO:teuthology.orchestra.run.smithi001.stdout: "max_osd_draining_count": { 2024-09-19T09:47:04.368 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_osd_draining_count", 2024-09-19T09:47:04.368 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.368 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.369 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.369 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:47:04.369 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.369 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.369 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.369 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T09:47:04.369 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.369 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.369 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.369 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.369 INFO:teuthology.orchestra.run.smithi001.stdout: "migration_current": { 2024-09-19T09:47:04.369 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "migration_current", 2024-09-19T09:47:04.369 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.369 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.370 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.370 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.370 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.370 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.370 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.370 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "internal - do not modify", 2024-09-19T09:47:04.370 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.370 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.370 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.370 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.370 INFO:teuthology.orchestra.run.smithi001.stdout: "mode": { 2024-09-19T09:47:04.370 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mode", 2024-09-19T09:47:04.370 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.370 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.371 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.371 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "root", 2024-09-19T09:47:04.371 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.371 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.371 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.371 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm-package", 2024-09-19T09:47:04.371 INFO:teuthology.orchestra.run.smithi001.stdout: "root" 2024-09-19T09:47:04.371 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.371 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T09:47:04.371 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.371 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.371 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.371 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.372 INFO:teuthology.orchestra.run.smithi001.stdout: "oob_default_addr": { 2024-09-19T09:47:04.372 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "oob_default_addr", 2024-09-19T09:47:04.372 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.372 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.372 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.372 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "169.254.1.1", 2024-09-19T09:47:04.372 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.372 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.372 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.372 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T09:47:04.373 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.373 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.373 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.373 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.373 INFO:teuthology.orchestra.run.smithi001.stdout: "prometheus_alerts_path": { 2024-09-19T09:47:04.373 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus_alerts_path", 2024-09-19T09:47:04.373 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.373 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.373 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.373 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T09:47:04.373 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.373 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.374 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.374 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T09:47:04.374 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.374 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.374 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.374 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.374 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_insecure": { 2024-09-19T09:47:04.374 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_insecure", 2024-09-19T09:47:04.374 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.374 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.374 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.374 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.375 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.375 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.375 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.375 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T09:47:04.375 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.375 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.375 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.375 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.375 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_password": { 2024-09-19T09:47:04.375 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_password", 2024-09-19T09:47:04.375 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.375 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.375 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.376 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.376 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.376 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.376 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.376 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T09:47:04.376 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.376 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.376 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.376 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.376 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_url": { 2024-09-19T09:47:04.376 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_url", 2024-09-19T09:47:04.376 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.376 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.377 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.377 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.377 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.377 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.377 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.377 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T09:47:04.377 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.377 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.377 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.377 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.377 INFO:teuthology.orchestra.run.smithi001.stdout: "registry_username": { 2024-09-19T09:47:04.377 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "registry_username", 2024-09-19T09:47:04.378 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.378 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.378 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.378 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.378 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.378 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.378 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.378 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T09:47:04.378 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.379 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.379 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.379 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.379 INFO:teuthology.orchestra.run.smithi001.stdout: "secure_monitoring_stack": { 2024-09-19T09:47:04.379 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secure_monitoring_stack", 2024-09-19T09:47:04.379 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.379 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.379 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.379 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.379 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.379 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.380 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.380 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T09:47:04.380 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.380 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.380 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.380 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.380 INFO:teuthology.orchestra.run.smithi001.stdout: "service_discovery_port": { 2024-09-19T09:47:04.380 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "service_discovery_port", 2024-09-19T09:47:04.380 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.380 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.380 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.380 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8765", 2024-09-19T09:47:04.380 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.381 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.381 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.381 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "cephadm service discovery port", 2024-09-19T09:47:04.381 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.381 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.381 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.381 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.381 INFO:teuthology.orchestra.run.smithi001.stdout: "ssh_config_file": { 2024-09-19T09:47:04.381 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssh_config_file", 2024-09-19T09:47:04.381 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.381 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.381 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.381 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.381 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.382 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.382 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.382 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T09:47:04.382 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.382 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.382 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.382 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.382 INFO:teuthology.orchestra.run.smithi001.stdout: "use_agent": { 2024-09-19T09:47:04.382 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_agent", 2024-09-19T09:47:04.382 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.382 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.382 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.382 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.382 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.382 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.383 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.383 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T09:47:04.383 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.383 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.383 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.383 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.383 INFO:teuthology.orchestra.run.smithi001.stdout: "use_repo_digest": { 2024-09-19T09:47:04.383 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "use_repo_digest", 2024-09-19T09:47:04.383 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.383 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.383 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.383 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.383 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.383 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.384 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.384 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T09:47:04.384 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.384 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.384 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.384 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.384 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_failed_host_check": { 2024-09-19T09:47:04.384 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_failed_host_check", 2024-09-19T09:47:04.384 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.384 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.384 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.384 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.384 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.385 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.385 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.385 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T09:47:04.385 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.385 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.385 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.385 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.385 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_daemons": { 2024-09-19T09:47:04.385 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_daemons", 2024-09-19T09:47:04.385 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.385 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.385 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.386 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.386 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.386 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.386 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.386 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T09:47:04.386 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.386 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.386 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.386 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.386 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_on_stray_hosts": { 2024-09-19T09:47:04.386 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_on_stray_hosts", 2024-09-19T09:47:04.387 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.387 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.387 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.387 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.387 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.387 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.387 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.387 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T09:47:04.387 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.387 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.387 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.387 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.387 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.387 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.388 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.388 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crash", 2024-09-19T09:47:04.388 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.388 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.388 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.388 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.388 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.388 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.388 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.388 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.388 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.388 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.388 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.388 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.388 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.389 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.389 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.389 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.389 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.389 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.389 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.389 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.389 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.389 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.389 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.389 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.389 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.389 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.389 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.390 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.390 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.390 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.390 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.390 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.390 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.390 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.390 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.390 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.390 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.390 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.390 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.390 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.390 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.391 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.391 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.391 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.391 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.391 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.391 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.391 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.391 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.391 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.391 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.391 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.391 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.391 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.391 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.392 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.392 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.392 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.392 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.392 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.392 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.392 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.392 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.392 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.392 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.392 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.392 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.392 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.392 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.393 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.393 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.393 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.393 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.393 INFO:teuthology.orchestra.run.smithi001.stdout: "retain_interval": { 2024-09-19T09:47:04.393 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retain_interval", 2024-09-19T09:47:04.393 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:04.393 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.393 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.393 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "31536000", 2024-09-19T09:47:04.393 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.393 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.393 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.393 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T09:47:04.394 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.394 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.394 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.394 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.394 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_recent_interval": { 2024-09-19T09:47:04.394 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_recent_interval", 2024-09-19T09:47:04.394 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:04.394 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.394 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.394 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1209600", 2024-09-19T09:47:04.394 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.394 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.394 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.395 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T09:47:04.395 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.395 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.395 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.395 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.395 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.395 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.395 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.395 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dashboard", 2024-09-19T09:47:04.395 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.395 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.395 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.395 INFO:teuthology.orchestra.run.smithi001.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T09:47:04.395 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T09:47:04.396 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.396 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.396 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.396 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:47:04.396 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.396 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.396 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.396 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.396 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.396 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.396 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.396 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.396 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T09:47:04.397 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T09:47:04.397 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.397 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.397 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.397 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.397 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.397 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.397 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.397 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.397 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.397 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.397 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.397 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.397 INFO:teuthology.orchestra.run.smithi001.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T09:47:04.398 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T09:47:04.398 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.398 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.398 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.398 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.398 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.398 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.398 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.398 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.398 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.398 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.398 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.398 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.398 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_ENABLED": { 2024-09-19T09:47:04.398 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T09:47:04.399 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.399 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.399 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.399 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.399 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.399 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.399 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.399 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.399 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.399 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.399 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.399 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.399 INFO:teuthology.orchestra.run.smithi001.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T09:47:04.399 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T09:47:04.399 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.400 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.400 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.400 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.400 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.400 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.400 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.400 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.400 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.400 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.400 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.400 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.400 INFO:teuthology.orchestra.run.smithi001.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T09:47:04.400 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T09:47:04.401 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.401 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.401 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.401 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.401 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.401 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.401 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.401 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.401 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.401 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.401 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.401 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.401 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T09:47:04.401 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T09:47:04.402 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.402 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.402 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.402 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.402 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.402 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.402 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.402 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.402 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.402 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.402 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.402 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.402 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T09:47:04.402 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T09:47:04.402 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.402 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.403 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.403 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.403 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.403 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.403 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.403 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.403 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.403 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.403 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.403 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.403 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T09:47:04.403 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T09:47:04.403 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.403 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.404 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.404 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.404 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.404 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.404 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.404 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.404 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.404 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.404 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.404 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.404 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T09:47:04.404 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T09:47:04.404 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.404 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.404 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.405 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.405 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.405 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.405 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.405 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.405 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.405 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.405 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.405 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.405 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T09:47:04.405 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T09:47:04.406 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.406 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.406 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.406 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.406 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.406 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.406 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.406 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.406 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.406 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.406 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.406 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.407 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T09:47:04.407 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T09:47:04.407 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.407 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.407 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.407 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.407 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.407 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.407 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.407 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.407 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.407 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.407 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.407 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.407 INFO:teuthology.orchestra.run.smithi001.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T09:47:04.407 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T09:47:04.408 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.408 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.408 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.408 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.408 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.408 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.408 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.408 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.408 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.408 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.408 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.408 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.409 INFO:teuthology.orchestra.run.smithi001.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T09:47:04.409 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T09:47:04.409 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.409 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.409 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.409 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.409 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.409 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.409 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.409 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.409 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.409 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.409 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.410 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.410 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T09:47:04.410 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T09:47:04.410 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.410 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.410 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.410 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-19T09:47:04.410 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.410 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.410 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.410 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.410 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.410 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.410 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.411 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.411 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T09:47:04.411 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T09:47:04.411 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.411 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.411 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.411 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.411 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.411 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.412 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.412 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.412 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.412 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.412 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.412 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.413 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_URL": { 2024-09-19T09:47:04.413 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_URL", 2024-09-19T09:47:04.413 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.413 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.413 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.413 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.413 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.413 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.413 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.414 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.414 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.414 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.414 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.414 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.414 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T09:47:04.414 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T09:47:04.414 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.414 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.414 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.414 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-19T09:47:04.414 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.414 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.414 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.415 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.415 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.415 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.415 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.415 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.415 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T09:47:04.415 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T09:47:04.415 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.415 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.415 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.415 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.415 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.415 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.416 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.416 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.416 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.416 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.416 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.416 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.416 INFO:teuthology.orchestra.run.smithi001.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T09:47:04.416 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T09:47:04.417 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.417 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.417 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.417 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.417 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.417 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.417 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.417 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.417 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.417 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.417 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.417 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.417 INFO:teuthology.orchestra.run.smithi001.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T09:47:04.418 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T09:47:04.418 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.418 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.418 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.418 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.418 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.418 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.418 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.418 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.418 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.418 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.418 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.418 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.419 INFO:teuthology.orchestra.run.smithi001.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T09:47:04.419 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T09:47:04.419 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.419 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.419 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.419 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.419 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.419 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.419 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.419 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.419 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.420 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.420 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.420 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.420 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T09:47:04.420 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T09:47:04.420 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.420 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.420 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.420 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.420 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.420 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.420 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.420 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.421 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.421 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.421 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.421 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.421 INFO:teuthology.orchestra.run.smithi001.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T09:47:04.421 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T09:47:04.421 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.421 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.421 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.421 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.421 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.422 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.422 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.422 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.422 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.422 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.422 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.422 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.422 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T09:47:04.422 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T09:47:04.422 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.422 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.422 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.422 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.422 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.423 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.423 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.423 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.423 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.423 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.423 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.423 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.423 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T09:47:04.423 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T09:47:04.423 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.423 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.423 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.423 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.423 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.424 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.424 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.424 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.424 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.424 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.424 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.424 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.424 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T09:47:04.424 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T09:47:04.424 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.424 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.424 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.424 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.424 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.425 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.425 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.425 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.425 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.425 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.425 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.425 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.425 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T09:47:04.425 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T09:47:04.425 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.425 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.425 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.425 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.425 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.426 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.426 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.426 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.426 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.426 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.426 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.426 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.426 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T09:47:04.426 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T09:47:04.426 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.426 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.427 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.427 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.427 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.427 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.427 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.427 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.427 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.427 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.427 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.427 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.427 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T09:47:04.427 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T09:47:04.427 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.428 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.428 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.428 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.428 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.428 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.428 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.428 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.428 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.428 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.428 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.428 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.428 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T09:47:04.428 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T09:47:04.429 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.429 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.429 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.429 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.432 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.432 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.432 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.432 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.432 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.432 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.432 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.432 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.432 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T09:47:04.432 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T09:47:04.432 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.432 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.433 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.433 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.433 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.433 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.433 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.433 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.433 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.433 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.433 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.433 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.433 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T09:47:04.433 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T09:47:04.433 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.433 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.434 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.434 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T09:47:04.434 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.434 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.434 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.434 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.434 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.435 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.435 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.435 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.435 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T09:47:04.435 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T09:47:04.435 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.436 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.436 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.436 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:47:04.436 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.436 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.437 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.437 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.437 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.437 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.437 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.437 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.437 INFO:teuthology.orchestra.run.smithi001.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T09:47:04.437 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T09:47:04.437 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.437 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.438 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.438 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8", 2024-09-19T09:47:04.438 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.438 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.438 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.438 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.438 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.438 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.438 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.438 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.438 INFO:teuthology.orchestra.run.smithi001.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T09:47:04.438 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T09:47:04.438 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.439 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.439 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.439 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "45", 2024-09-19T09:47:04.439 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.439 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.439 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.439 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.439 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.439 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.439 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.439 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.440 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T09:47:04.440 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T09:47:04.440 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.440 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.440 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.440 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.440 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.440 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.440 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.440 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.440 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.440 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.440 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.440 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.441 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T09:47:04.441 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T09:47:04.441 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.441 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.441 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.441 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "admin", 2024-09-19T09:47:04.441 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.441 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.441 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.441 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.441 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.441 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.441 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.441 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.442 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T09:47:04.442 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T09:47:04.442 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.442 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.442 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.442 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.442 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.442 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.442 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.442 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.442 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.442 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.442 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.443 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.443 INFO:teuthology.orchestra.run.smithi001.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T09:47:04.443 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T09:47:04.443 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.443 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.443 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.443 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.443 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.443 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.443 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.443 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.444 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.444 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.444 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.444 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.444 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T09:47:04.444 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T09:47:04.444 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.444 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.444 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.444 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T09:47:04.445 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.445 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.445 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.445 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.445 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.445 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.445 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.445 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.445 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T09:47:04.445 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T09:47:04.445 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.445 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.445 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.445 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:47:04.445 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.446 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.446 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.446 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.446 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.446 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.446 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.446 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.446 INFO:teuthology.orchestra.run.smithi001.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T09:47:04.446 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T09:47:04.446 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.446 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.446 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.446 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T09:47:04.446 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.447 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.447 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.447 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.447 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.447 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.447 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.447 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.447 INFO:teuthology.orchestra.run.smithi001.stdout: "cross_origin_url": { 2024-09-19T09:47:04.447 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cross_origin_url", 2024-09-19T09:47:04.447 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.447 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.448 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.448 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.448 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.448 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.448 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.448 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.448 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.448 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.448 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.448 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.448 INFO:teuthology.orchestra.run.smithi001.stdout: "crt_file": { 2024-09-19T09:47:04.448 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "crt_file", 2024-09-19T09:47:04.448 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.449 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.449 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.449 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.449 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.449 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.449 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.449 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.449 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.449 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.449 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.449 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.449 INFO:teuthology.orchestra.run.smithi001.stdout: "debug": { 2024-09-19T09:47:04.449 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "debug", 2024-09-19T09:47:04.449 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.450 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.450 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.450 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.450 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.450 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.450 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.450 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Enable/disable debug options", 2024-09-19T09:47:04.450 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.450 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.450 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.450 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.450 INFO:teuthology.orchestra.run.smithi001.stdout: "jwt_token_ttl": { 2024-09-19T09:47:04.450 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "jwt_token_ttl", 2024-09-19T09:47:04.451 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.451 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.451 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.451 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "28800", 2024-09-19T09:47:04.451 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.451 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.451 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.451 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.451 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.451 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.451 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.451 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.451 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-19T09:47:04.451 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-19T09:47:04.451 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.452 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.452 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.452 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.452 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.452 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.452 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.452 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.452 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.452 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.452 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.453 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.453 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.453 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.453 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.453 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.453 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.453 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.453 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.454 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.454 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.454 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.454 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.454 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.454 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.454 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.454 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.454 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.454 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.454 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.454 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.455 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.455 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.455 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.455 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.455 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.455 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.455 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.455 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.455 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.455 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.455 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.455 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.455 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.455 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.455 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.456 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.456 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.456 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.456 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.456 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.456 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.456 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.456 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.456 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.456 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.456 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.456 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.456 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.457 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.457 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.457 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.457 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.457 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.457 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.457 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.457 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.457 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.457 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.457 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.457 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.457 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.457 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.458 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.458 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.458 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.458 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.458 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.458 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.458 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.458 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.458 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.458 INFO:teuthology.orchestra.run.smithi001.stdout: "motd": { 2024-09-19T09:47:04.458 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "motd", 2024-09-19T09:47:04.458 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.458 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.458 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.459 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.459 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.459 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.459 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.459 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "The message of the day", 2024-09-19T09:47:04.459 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.459 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.459 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.459 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.459 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect_resolve_ip_addr": { 2024-09-19T09:47:04.459 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T09:47:04.459 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.459 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.459 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.460 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.460 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.460 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.460 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.460 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.460 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.460 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.460 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.460 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.460 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-19T09:47:04.460 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-19T09:47:04.460 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.460 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.460 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.461 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-19T09:47:04.461 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.461 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.461 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.461 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.461 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.461 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.461 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.461 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.461 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-19T09:47:04.461 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-19T09:47:04.461 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.461 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.461 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.462 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8080", 2024-09-19T09:47:04.462 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.462 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.462 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.462 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.462 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.462 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.462 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.462 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.462 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-19T09:47:04.462 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-19T09:47:04.462 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.462 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.462 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.462 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.463 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.463 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.463 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.463 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.463 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.463 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.463 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.463 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.463 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl_server_port": { 2024-09-19T09:47:04.463 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl_server_port", 2024-09-19T09:47:04.463 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.463 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.463 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.463 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8443", 2024-09-19T09:47:04.464 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.464 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.464 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.464 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.464 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.464 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.464 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.464 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.464 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-19T09:47:04.464 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-19T09:47:04.464 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.464 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.464 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.464 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "redirect", 2024-09-19T09:47:04.464 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.465 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.465 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.465 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.465 INFO:teuthology.orchestra.run.smithi001.stdout: "redirect" 2024-09-19T09:47:04.465 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.465 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.465 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.465 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.465 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.465 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.465 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-19T09:47:04.465 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-19T09:47:04.466 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.466 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.466 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.466 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-19T09:47:04.466 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-19T09:47:04.466 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-19T09:47:04.466 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.466 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.466 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.466 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.466 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.466 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.466 INFO:teuthology.orchestra.run.smithi001.stdout: "url_prefix": { 2024-09-19T09:47:04.466 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url_prefix", 2024-09-19T09:47:04.466 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.467 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.467 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.467 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.467 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.467 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.467 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.467 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.467 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.467 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.467 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.467 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.467 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.467 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.467 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.467 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "devicehealth", 2024-09-19T09:47:04.468 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.468 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.468 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.468 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_monitoring": { 2024-09-19T09:47:04.468 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_monitoring", 2024-09-19T09:47:04.468 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.468 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.468 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.468 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.468 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.468 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.468 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.469 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "monitor device health metrics", 2024-09-19T09:47:04.469 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.469 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.469 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.469 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.469 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.469 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.469 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.469 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.469 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.469 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.469 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.469 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.469 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.470 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.470 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.470 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.470 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.470 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.470 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.470 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.470 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.470 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.470 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.470 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.470 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.470 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.470 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.471 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.471 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.471 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.471 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.471 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.471 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.471 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.471 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.471 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.471 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.471 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.472 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.472 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.472 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.472 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.472 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.472 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.472 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.472 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.472 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.472 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.472 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.472 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.473 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.473 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.473 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.473 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.473 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.473 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.473 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.473 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.473 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.473 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.473 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.473 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.474 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.474 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.474 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.474 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.474 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.474 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.474 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.474 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.474 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.474 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.474 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.474 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.475 INFO:teuthology.orchestra.run.smithi001.stdout: "mark_out_threshold": { 2024-09-19T09:47:04.475 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mark_out_threshold", 2024-09-19T09:47:04.475 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:04.475 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.475 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.475 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "2419200", 2024-09-19T09:47:04.475 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.475 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.475 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.475 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T09:47:04.475 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.475 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.476 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.476 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.476 INFO:teuthology.orchestra.run.smithi001.stdout: "pool_name": { 2024-09-19T09:47:04.476 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pool_name", 2024-09-19T09:47:04.476 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.476 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.476 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.476 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "device_health_metrics", 2024-09-19T09:47:04.476 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.476 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.476 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.476 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T09:47:04.476 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.477 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.477 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.477 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.477 INFO:teuthology.orchestra.run.smithi001.stdout: "retention_period": { 2024-09-19T09:47:04.477 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "retention_period", 2024-09-19T09:47:04.477 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:04.477 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.477 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.477 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15552000", 2024-09-19T09:47:04.477 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.477 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.477 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.477 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long to retain device health metrics", 2024-09-19T09:47:04.478 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.478 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.478 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.478 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.478 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_frequency": { 2024-09-19T09:47:04.478 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_frequency", 2024-09-19T09:47:04.478 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:04.478 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.478 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.478 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-19T09:47:04.478 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.478 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.478 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.478 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T09:47:04.479 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.479 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.479 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.479 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.479 INFO:teuthology.orchestra.run.smithi001.stdout: "self_heal": { 2024-09-19T09:47:04.479 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "self_heal", 2024-09-19T09:47:04.479 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.479 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.480 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.480 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.480 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.480 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.480 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.480 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T09:47:04.480 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.480 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.480 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.480 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.480 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T09:47:04.480 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T09:47:04.480 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:04.480 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.481 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.481 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T09:47:04.481 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.481 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.481 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.481 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T09:47:04.481 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.481 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.481 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.481 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.481 INFO:teuthology.orchestra.run.smithi001.stdout: "warn_threshold": { 2024-09-19T09:47:04.481 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "warn_threshold", 2024-09-19T09:47:04.481 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:04.481 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.482 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.482 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7257600", 2024-09-19T09:47:04.482 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.482 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.482 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.482 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T09:47:04.482 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.482 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.482 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.482 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.482 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.482 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.482 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.482 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "diskprediction_local", 2024-09-19T09:47:04.483 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.483 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.483 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.483 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.483 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.483 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.483 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.483 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.483 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.483 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.483 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.483 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.483 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.483 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.484 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.484 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.484 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.484 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.484 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.484 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.484 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.484 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.484 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.484 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.484 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.484 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.484 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.484 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.485 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.485 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.485 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.485 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.485 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.485 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.485 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.485 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.485 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.485 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.485 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.486 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.486 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.486 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.486 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.486 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.486 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.486 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.486 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.486 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.486 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.486 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.487 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.487 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.487 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.487 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.487 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.487 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.487 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.487 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.487 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.487 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.487 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.487 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.487 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.487 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.487 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.488 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.488 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.488 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.488 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.488 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.488 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.488 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.488 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.488 INFO:teuthology.orchestra.run.smithi001.stdout: "predict_interval": { 2024-09-19T09:47:04.488 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predict_interval", 2024-09-19T09:47:04.488 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.488 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.488 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.488 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "86400", 2024-09-19T09:47:04.489 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.489 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.489 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.489 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.489 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.489 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.489 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.489 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.489 INFO:teuthology.orchestra.run.smithi001.stdout: "predictor_model": { 2024-09-19T09:47:04.489 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "predictor_model", 2024-09-19T09:47:04.489 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.489 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.489 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.489 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "prophetstor", 2024-09-19T09:47:04.490 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.490 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.490 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.490 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.490 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.490 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.490 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.490 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.490 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T09:47:04.490 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T09:47:04.490 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.491 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.491 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.491 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "600", 2024-09-19T09:47:04.491 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.491 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.491 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.491 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.491 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.491 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.491 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.491 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.491 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.491 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.492 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.492 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "influx", 2024-09-19T09:47:04.492 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": false, 2024-09-19T09:47:04.492 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "influxdb python module not found", 2024-09-19T09:47:04.492 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.492 INFO:teuthology.orchestra.run.smithi001.stdout: "batch_size": { 2024-09-19T09:47:04.492 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "batch_size", 2024-09-19T09:47:04.492 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.492 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.492 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.492 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5000", 2024-09-19T09:47:04.492 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.492 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.492 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.492 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T09:47:04.492 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.493 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.493 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.493 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.493 INFO:teuthology.orchestra.run.smithi001.stdout: "database": { 2024-09-19T09:47:04.493 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "database", 2024-09-19T09:47:04.493 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.493 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.493 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.493 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "ceph", 2024-09-19T09:47:04.493 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.493 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.493 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.494 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T09:47:04.494 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.494 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.494 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.494 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.494 INFO:teuthology.orchestra.run.smithi001.stdout: "hostname": { 2024-09-19T09:47:04.494 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "hostname", 2024-09-19T09:47:04.494 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.494 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.495 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.495 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.495 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.495 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.495 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.495 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server hostname", 2024-09-19T09:47:04.495 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.495 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.495 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.495 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.495 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T09:47:04.495 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T09:47:04.495 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:04.496 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.496 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.496 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "30", 2024-09-19T09:47:04.496 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "5", 2024-09-19T09:47:04.496 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.496 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.496 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T09:47:04.496 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.496 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.497 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.497 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.497 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.497 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.497 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.497 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.498 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.498 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.498 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.498 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.498 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.498 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.498 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.499 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.499 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.499 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.499 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.499 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.499 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.499 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.500 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.500 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.500 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.500 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.500 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.500 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.500 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.500 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.501 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.501 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.501 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.501 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.501 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.501 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.502 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.502 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.502 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.502 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.502 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.502 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.503 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.503 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.503 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.503 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.503 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.503 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.503 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.503 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.503 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.503 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.504 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.504 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.504 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.504 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.504 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.504 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.504 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.504 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.504 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.504 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.505 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.505 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.505 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.505 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.505 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.505 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.505 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.505 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.505 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.505 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.505 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.505 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.505 INFO:teuthology.orchestra.run.smithi001.stdout: "password": { 2024-09-19T09:47:04.506 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "password", 2024-09-19T09:47:04.506 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.506 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.506 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.506 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.506 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.506 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.506 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.506 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "password of InfluxDB server user", 2024-09-19T09:47:04.506 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.506 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.506 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.506 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.507 INFO:teuthology.orchestra.run.smithi001.stdout: "port": { 2024-09-19T09:47:04.507 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "port", 2024-09-19T09:47:04.507 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.507 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.507 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.507 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "8086", 2024-09-19T09:47:04.507 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.507 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.507 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.507 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "InfluxDB server port", 2024-09-19T09:47:04.507 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.507 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.507 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.507 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.507 INFO:teuthology.orchestra.run.smithi001.stdout: "ssl": { 2024-09-19T09:47:04.507 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ssl", 2024-09-19T09:47:04.508 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.508 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.508 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.508 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "false", 2024-09-19T09:47:04.508 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.508 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.508 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.508 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:47:04.508 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.508 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.508 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.508 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.508 INFO:teuthology.orchestra.run.smithi001.stdout: "threads": { 2024-09-19T09:47:04.508 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threads", 2024-09-19T09:47:04.509 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.509 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.509 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.509 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T09:47:04.509 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T09:47:04.509 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "32", 2024-09-19T09:47:04.509 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.509 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T09:47:04.509 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.509 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.509 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.509 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.509 INFO:teuthology.orchestra.run.smithi001.stdout: "username": { 2024-09-19T09:47:04.510 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "username", 2024-09-19T09:47:04.510 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.510 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.510 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.510 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.510 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.510 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.510 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.510 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "username of InfluxDB server user", 2024-09-19T09:47:04.510 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.510 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.510 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.510 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.510 INFO:teuthology.orchestra.run.smithi001.stdout: "verify_ssl": { 2024-09-19T09:47:04.511 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "verify_ssl", 2024-09-19T09:47:04.511 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.511 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.511 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.511 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "true", 2024-09-19T09:47:04.511 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.511 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.511 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.511 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:47:04.511 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.511 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.511 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.511 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.511 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.511 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.512 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.512 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "insights", 2024-09-19T09:47:04.512 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.512 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.512 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.512 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.512 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.512 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.512 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.512 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.512 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.512 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.512 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.512 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.513 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.513 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.513 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.513 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.513 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.513 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.513 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.513 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.513 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.513 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.513 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.513 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.514 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.514 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.514 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.514 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.514 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.514 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.514 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.514 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.514 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.514 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.514 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.514 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.514 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.515 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.515 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.515 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.515 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.515 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.515 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.515 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.515 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.515 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.515 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.515 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.515 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.515 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.515 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.516 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.516 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.516 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.516 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.516 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.516 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.516 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.516 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.516 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.516 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.516 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.516 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.516 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.517 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.517 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.517 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.517 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.517 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.517 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.517 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.517 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.517 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.517 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.517 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.517 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.517 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "iostat", 2024-09-19T09:47:04.517 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.518 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.518 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.518 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.518 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.518 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.518 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.518 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.518 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.518 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.518 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.518 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.518 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.518 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.518 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.519 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.519 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.519 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.519 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.519 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.519 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.519 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.519 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.519 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.519 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.519 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.520 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.520 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.520 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.520 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.520 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.520 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.520 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.520 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.520 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.520 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.520 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.520 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.520 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.520 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.521 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.521 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.521 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.521 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.521 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.521 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.521 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.521 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.521 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.521 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.521 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.521 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.521 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.521 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.522 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.522 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.522 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.522 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.522 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.522 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.522 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.522 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.522 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.522 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.522 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.522 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.522 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.522 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.523 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.523 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.523 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.523 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.523 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.523 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.523 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.523 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.523 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "k8sevents", 2024-09-19T09:47:04.523 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.523 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.523 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.523 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_event_retention_days": { 2024-09-19T09:47:04.523 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "ceph_event_retention_days", 2024-09-19T09:47:04.524 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.524 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.524 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.524 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "7", 2024-09-19T09:47:04.524 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.524 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.524 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.524 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T09:47:04.524 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.524 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.524 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.524 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.524 INFO:teuthology.orchestra.run.smithi001.stdout: "config_check_secs": { 2024-09-19T09:47:04.524 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "config_check_secs", 2024-09-19T09:47:04.525 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.525 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.525 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.525 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:47:04.525 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "10", 2024-09-19T09:47:04.525 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.525 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.525 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T09:47:04.525 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.525 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.525 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.525 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.525 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.525 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.526 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.526 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.526 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.526 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.526 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.526 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.526 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.526 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.526 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.526 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.526 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.526 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.526 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.526 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.526 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.527 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.527 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.527 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.527 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.527 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.527 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.527 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.527 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.527 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.527 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.527 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.527 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.527 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.527 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.528 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.528 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.528 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.528 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.528 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.528 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.528 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.528 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.528 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.528 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.528 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.528 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.528 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.528 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.529 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.529 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.529 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.529 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.529 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.529 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.529 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.529 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.529 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.529 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.529 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.529 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.529 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.529 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.530 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.530 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.530 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.530 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.530 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.530 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.530 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.530 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.530 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.530 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.530 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.530 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.530 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.530 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.531 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "localpool", 2024-09-19T09:47:04.531 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.531 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.531 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.531 INFO:teuthology.orchestra.run.smithi001.stdout: "failure_domain": { 2024-09-19T09:47:04.531 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "failure_domain", 2024-09-19T09:47:04.531 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.531 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.531 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.531 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "host", 2024-09-19T09:47:04.531 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.531 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.531 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.531 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "failure domain for any created local pool", 2024-09-19T09:47:04.532 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T09:47:04.532 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.532 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.532 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.532 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.532 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.532 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.532 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.532 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.532 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.532 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.532 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.532 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.532 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.533 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.533 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.533 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.533 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.533 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.533 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.533 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.533 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.533 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.533 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.533 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.533 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.533 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.534 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.534 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.534 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.534 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.534 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.534 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.534 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.534 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.534 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.534 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.534 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.534 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.534 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.534 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.535 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.535 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.535 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.535 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.535 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.535 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.535 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.535 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.535 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.535 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.535 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.535 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.535 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.535 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.536 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.536 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.536 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.536 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.536 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.536 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.536 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.536 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.536 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.536 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.536 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.536 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.537 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.537 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.537 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.537 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.537 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.537 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.537 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.537 INFO:teuthology.orchestra.run.smithi001.stdout: "min_size": { 2024-09-19T09:47:04.537 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "min_size", 2024-09-19T09:47:04.537 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.537 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.537 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.537 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.537 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.538 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.538 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.538 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default min_size for any created local pool", 2024-09-19T09:47:04.538 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T09:47:04.538 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.538 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.538 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.538 INFO:teuthology.orchestra.run.smithi001.stdout: "num_rep": { 2024-09-19T09:47:04.538 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "num_rep", 2024-09-19T09:47:04.538 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.538 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.538 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.538 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3", 2024-09-19T09:47:04.538 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.539 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.539 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.539 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default replica count for any created local pool", 2024-09-19T09:47:04.539 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.539 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.539 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.539 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.539 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_num": { 2024-09-19T09:47:04.539 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_num", 2024-09-19T09:47:04.539 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.539 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.539 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.539 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "128", 2024-09-19T09:47:04.539 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.540 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.540 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.540 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T09:47:04.540 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.540 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.540 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.540 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.540 INFO:teuthology.orchestra.run.smithi001.stdout: "prefix": { 2024-09-19T09:47:04.540 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prefix", 2024-09-19T09:47:04.540 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.540 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.540 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.540 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.541 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.541 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.541 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.541 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "name prefix for any created local pool", 2024-09-19T09:47:04.541 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.541 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.541 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.541 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.541 INFO:teuthology.orchestra.run.smithi001.stdout: "subtree": { 2024-09-19T09:47:04.541 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "subtree", 2024-09-19T09:47:04.541 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.541 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.542 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.542 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "rack", 2024-09-19T09:47:04.542 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.542 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.542 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.542 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T09:47:04.542 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T09:47:04.542 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.542 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.542 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.542 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.542 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.542 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.542 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mds_autoscaler", 2024-09-19T09:47:04.542 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.543 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.543 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.543 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.543 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.543 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.543 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.543 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.543 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.543 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.543 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.543 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.543 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.543 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.543 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.544 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.544 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.544 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.544 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.544 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.544 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.544 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.544 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.544 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.544 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.544 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.544 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.544 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.545 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.545 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.545 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.545 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.545 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.545 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.545 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.545 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.545 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.545 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.545 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.545 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.545 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.545 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.546 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.546 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.546 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.546 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.546 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.546 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.546 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.546 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.546 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.546 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.546 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.546 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.546 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.546 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.546 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.547 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.547 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.547 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.547 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.547 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.547 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.547 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.547 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.547 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.547 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.547 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.547 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.547 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.547 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.548 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.548 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.548 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.548 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.548 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.548 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirroring", 2024-09-19T09:47:04.548 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.548 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.548 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.548 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.548 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.548 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.548 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.548 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.549 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.549 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.549 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.549 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.549 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.549 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.549 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.549 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.549 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.549 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.549 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.549 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.549 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.550 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.550 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.550 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.550 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.550 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.550 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.550 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.550 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.550 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.550 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.550 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.550 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.550 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.550 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.551 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.551 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.551 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.551 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.551 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.551 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.551 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.551 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.551 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.551 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.551 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.551 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.551 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.552 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.552 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.552 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.552 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.552 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.552 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.552 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.552 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.552 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.552 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.552 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.552 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.552 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.552 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.553 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.553 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.553 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.553 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.553 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.553 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.553 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.553 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.553 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.553 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.553 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.553 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.553 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.553 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.554 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "nfs", 2024-09-19T09:47:04.554 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.554 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.554 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.554 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.554 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.554 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.554 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.554 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.554 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.554 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.554 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.554 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.554 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.554 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.555 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.555 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.555 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.555 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.555 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.555 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.555 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.555 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.555 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.555 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.555 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.555 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.555 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.555 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.556 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.556 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.556 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.556 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.556 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.556 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.556 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.556 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.556 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.556 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.556 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.556 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.556 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.556 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.556 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.557 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.557 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.557 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.557 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.557 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.557 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.557 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.557 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.557 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.557 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.557 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.557 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.557 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.558 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.558 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.558 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.558 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.558 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.558 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.558 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.558 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.558 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.558 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.558 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.558 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.558 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.558 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.559 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.559 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.559 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.559 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.559 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.559 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.559 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-19T09:47:04.559 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.559 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.559 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.559 INFO:teuthology.orchestra.run.smithi001.stdout: "fail_fs": { 2024-09-19T09:47:04.559 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "fail_fs", 2024-09-19T09:47:04.559 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.559 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.559 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.560 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.560 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.560 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.560 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.560 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T09:47:04.560 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.560 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.560 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.560 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.560 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.560 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.560 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.560 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.561 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.561 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.561 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.561 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.561 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.561 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.561 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.561 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.561 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.561 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.561 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.561 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.561 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.561 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.562 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.562 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.562 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.562 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.562 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.562 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.562 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.562 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.562 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.562 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.562 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.562 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.562 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.562 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.563 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.563 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.563 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.563 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.563 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.563 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.563 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.563 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.563 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.563 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.563 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.563 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.563 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.564 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.564 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.564 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.564 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.564 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.564 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.564 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.564 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.564 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.564 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.564 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.564 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.564 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.564 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.565 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.565 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.565 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.565 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.565 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.565 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.565 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.565 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.565 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.565 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.565 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.565 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator": { 2024-09-19T09:47:04.565 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "orchestrator", 2024-09-19T09:47:04.565 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.566 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.566 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.566 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.566 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.566 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.566 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.566 INFO:teuthology.orchestra.run.smithi001.stdout: "cephadm", 2024-09-19T09:47:04.566 INFO:teuthology.orchestra.run.smithi001.stdout: "rook", 2024-09-19T09:47:04.566 INFO:teuthology.orchestra.run.smithi001.stdout: "test_orchestrator" 2024-09-19T09:47:04.566 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.566 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Orchestrator backend", 2024-09-19T09:47:04.566 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.566 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.567 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.567 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.567 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.567 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.567 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.567 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_perf_query", 2024-09-19T09:47:04.567 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.567 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.567 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.567 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.567 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.567 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.567 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.567 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.568 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.568 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.568 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.568 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.568 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.568 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.568 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.568 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.568 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.568 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.568 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.568 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.568 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.568 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.568 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.569 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.569 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.569 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.569 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.569 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.569 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.569 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.569 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.569 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.569 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.569 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.569 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.569 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.569 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.569 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.570 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.570 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.570 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.570 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.570 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.570 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.570 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.570 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.570 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.570 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.570 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.570 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.570 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.570 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.570 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.571 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.571 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.571 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.571 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.571 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.571 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.571 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.571 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.571 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.571 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.571 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.571 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.571 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.571 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.571 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.571 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.572 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.572 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.572 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.572 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.572 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.572 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.572 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.572 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "osd_support", 2024-09-19T09:47:04.572 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.572 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.572 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.572 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.572 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.572 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.572 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.573 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.573 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.573 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.573 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.573 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.573 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.573 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.573 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.573 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.573 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.573 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.573 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.573 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.573 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.574 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.574 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.574 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.574 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.574 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.574 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.574 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.574 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.574 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.574 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.574 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.574 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.574 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.574 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.574 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.575 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.575 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.575 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.575 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.575 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.575 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.575 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.575 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.575 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.575 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.575 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.575 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.575 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.575 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.576 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.576 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.576 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.576 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.576 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.576 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.576 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.576 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.576 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.576 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.576 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.576 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.576 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.577 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.577 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.577 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.577 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.577 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.577 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.577 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.577 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.577 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.577 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.577 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.577 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.577 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.577 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "pg_autoscaler", 2024-09-19T09:47:04.578 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.578 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.578 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.578 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.578 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.578 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.578 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.578 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.578 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.578 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.578 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.578 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.578 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.578 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.578 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.579 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.579 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.579 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.579 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.579 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.579 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.579 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.579 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.579 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.579 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.579 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.579 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.579 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.579 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.580 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.580 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.580 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.580 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.580 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.580 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.580 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.580 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.580 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.580 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.580 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.580 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.580 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.581 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.581 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.581 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.581 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.581 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.581 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.581 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.581 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.581 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.581 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.581 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.581 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.581 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.581 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.582 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.582 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.582 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.582 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.582 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.582 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.582 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.582 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.582 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.582 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.582 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.582 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.582 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.582 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.583 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.583 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.583 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.583 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T09:47:04.583 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T09:47:04.583 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:04.583 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.583 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.583 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T09:47:04.583 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.583 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.583 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.583 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.583 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.584 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.584 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.584 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.584 INFO:teuthology.orchestra.run.smithi001.stdout: "threshold": { 2024-09-19T09:47:04.584 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "threshold", 2024-09-19T09:47:04.584 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:47:04.584 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.584 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.584 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "3.0", 2024-09-19T09:47:04.584 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1.0", 2024-09-19T09:47:04.584 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.584 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.584 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "scaling threshold", 2024-09-19T09:47:04.584 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T09:47:04.584 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.585 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.585 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.585 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.585 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.585 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.585 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "progress", 2024-09-19T09:47:04.585 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.585 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.585 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.585 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_pg_recovery_event": { 2024-09-19T09:47:04.585 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_pg_recovery_event", 2024-09-19T09:47:04.585 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.585 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.585 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.586 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.586 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.586 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.586 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.586 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T09:47:04.586 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.586 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.586 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.586 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.586 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-19T09:47:04.586 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-19T09:47:04.586 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.586 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.586 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.587 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.587 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.587 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.587 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.587 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.587 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.587 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.587 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.587 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.587 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.587 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.587 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.587 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.587 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.588 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.588 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.588 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.588 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.588 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.588 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.588 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.588 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.588 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.588 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.588 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.588 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.588 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.589 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.589 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.589 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.589 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.589 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.589 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.589 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.589 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.589 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.589 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.589 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.589 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.589 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.589 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.589 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.590 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.590 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.590 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.590 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.590 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.590 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.590 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.590 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.590 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.590 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.590 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.590 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.590 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.590 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.590 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.591 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.591 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.591 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.591 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.591 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.591 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.591 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.591 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.591 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.591 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.591 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.591 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.591 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.591 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.591 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.592 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.592 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.592 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.592 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.592 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.592 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.592 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.592 INFO:teuthology.orchestra.run.smithi001.stdout: "max_completed_events": { 2024-09-19T09:47:04.592 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_completed_events", 2024-09-19T09:47:04.592 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.592 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.592 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.592 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "50", 2024-09-19T09:47:04.592 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.592 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.593 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.593 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "number of past completed events to remember", 2024-09-19T09:47:04.593 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.593 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.593 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.593 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.593 INFO:teuthology.orchestra.run.smithi001.stdout: "sleep_interval": { 2024-09-19T09:47:04.593 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "sleep_interval", 2024-09-19T09:47:04.593 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:04.593 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.593 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.593 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T09:47:04.593 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.593 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.594 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.594 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "how long the module is going to sleep", 2024-09-19T09:47:04.594 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.594 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.594 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.594 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.594 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.594 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.594 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.594 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "prometheus", 2024-09-19T09:47:04.594 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.594 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.594 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.594 INFO:teuthology.orchestra.run.smithi001.stdout: "cache": { 2024-09-19T09:47:04.594 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "cache", 2024-09-19T09:47:04.595 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.595 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.595 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.595 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.595 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.595 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.595 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.595 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.595 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.595 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.595 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.595 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.595 INFO:teuthology.orchestra.run.smithi001.stdout: "exclude_perf_counters": { 2024-09-19T09:47:04.595 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "exclude_perf_counters", 2024-09-19T09:47:04.595 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.596 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.596 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.596 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.596 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.596 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.596 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.596 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T09:47:04.596 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T09:47:04.596 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.596 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.596 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.596 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.596 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.596 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.597 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.597 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.597 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.597 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.597 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.597 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.597 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.597 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.597 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.597 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.597 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.597 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.597 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.597 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.597 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.598 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.598 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.598 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.598 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.598 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.598 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.598 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.598 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.598 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.598 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.598 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.598 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.598 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.598 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.598 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.598 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.599 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.599 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.599 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.599 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.599 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.599 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.599 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.599 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.599 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.599 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.599 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.599 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.599 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.599 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.599 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.599 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.600 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.600 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.600 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.600 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.600 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.600 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.600 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.600 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.600 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.600 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.600 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.600 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.600 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.600 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.600 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.600 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.601 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.601 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.601 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.601 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.601 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools": { 2024-09-19T09:47:04.601 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools", 2024-09-19T09:47:04.601 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.601 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.601 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.601 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.601 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.601 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.601 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.601 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.602 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.602 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.602 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.602 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.602 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T09:47:04.602 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T09:47:04.602 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.602 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.602 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.602 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "300", 2024-09-19T09:47:04.602 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.602 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.602 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.602 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.603 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.603 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.603 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.603 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.603 INFO:teuthology.orchestra.run.smithi001.stdout: "scrape_interval": { 2024-09-19T09:47:04.603 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "scrape_interval", 2024-09-19T09:47:04.603 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:47:04.603 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.603 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.603 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15.0", 2024-09-19T09:47:04.603 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.603 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.603 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.603 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.603 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.603 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.604 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.604 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.604 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-19T09:47:04.604 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-19T09:47:04.604 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.604 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.604 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.604 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "::", 2024-09-19T09:47:04.604 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.604 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.604 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.604 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T09:47:04.604 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.604 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.604 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.605 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.605 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-19T09:47:04.605 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-19T09:47:04.605 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.605 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.605 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.605 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "9283", 2024-09-19T09:47:04.605 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.605 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.605 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.605 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T09:47:04.605 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.605 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.605 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.606 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.606 INFO:teuthology.orchestra.run.smithi001.stdout: "stale_cache_strategy": { 2024-09-19T09:47:04.606 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stale_cache_strategy", 2024-09-19T09:47:04.606 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.606 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.606 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.606 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "log", 2024-09-19T09:47:04.606 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.606 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.606 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.606 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.606 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.606 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.606 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.607 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.607 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_behaviour": { 2024-09-19T09:47:04.607 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_behaviour", 2024-09-19T09:47:04.607 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.607 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.607 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.607 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "default", 2024-09-19T09:47:04.607 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.607 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.607 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.607 INFO:teuthology.orchestra.run.smithi001.stdout: "default", 2024-09-19T09:47:04.607 INFO:teuthology.orchestra.run.smithi001.stdout: "error" 2024-09-19T09:47:04.607 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.607 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.607 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.607 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.608 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.608 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.608 INFO:teuthology.orchestra.run.smithi001.stdout: "standby_error_status_code": { 2024-09-19T09:47:04.608 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "standby_error_status_code", 2024-09-19T09:47:04.608 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.608 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.608 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.608 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "500", 2024-09-19T09:47:04.608 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "400", 2024-09-19T09:47:04.608 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "599", 2024-09-19T09:47:04.608 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.608 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.608 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.608 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.608 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.609 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.609 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.609 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.609 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.609 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_support", 2024-09-19T09:47:04.609 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.609 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.609 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.609 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.609 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.609 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.609 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.609 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.609 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.610 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.610 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.610 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.610 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.610 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.610 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.610 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.610 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.610 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.610 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.610 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.610 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.610 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.610 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.610 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.611 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.611 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.611 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.611 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.611 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.611 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.611 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.611 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.611 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.611 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.611 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.611 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.611 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.611 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.612 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.612 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.612 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.612 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.612 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.612 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.612 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.612 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.612 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.612 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.612 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.612 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.612 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.613 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.613 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.613 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.613 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.613 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.613 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.613 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.613 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.613 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.613 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.613 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.613 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.613 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.613 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.613 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.614 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.614 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.614 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.614 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.614 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.614 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.614 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.614 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_snap_create": { 2024-09-19T09:47:04.614 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_snap_create", 2024-09-19T09:47:04.614 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.614 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.614 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.614 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10", 2024-09-19T09:47:04.615 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.615 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.615 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.615 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.615 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.615 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.615 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.615 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.615 INFO:teuthology.orchestra.run.smithi001.stdout: "mirror_snapshot_schedule": { 2024-09-19T09:47:04.615 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T09:47:04.615 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.615 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.615 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.615 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.615 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.616 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.616 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.616 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.616 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.616 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.616 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.616 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.616 INFO:teuthology.orchestra.run.smithi001.stdout: "trash_purge_schedule": { 2024-09-19T09:47:04.616 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "trash_purge_schedule", 2024-09-19T09:47:04.616 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.616 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.616 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.616 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.616 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.617 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.617 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.617 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.617 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.617 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.617 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.617 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.617 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.617 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.617 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.617 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "restful", 2024-09-19T09:47:04.617 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.617 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.617 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.617 INFO:teuthology.orchestra.run.smithi001.stdout: "enable_auth": { 2024-09-19T09:47:04.618 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enable_auth", 2024-09-19T09:47:04.618 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.618 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.618 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.618 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.618 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.618 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.618 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.618 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.618 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.618 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.618 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.618 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.618 INFO:teuthology.orchestra.run.smithi001.stdout: "key_file": { 2024-09-19T09:47:04.618 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "key_file", 2024-09-19T09:47:04.618 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.619 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.619 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.619 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.619 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.619 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.619 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.619 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.619 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.619 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.619 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.619 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.619 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.619 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.619 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.619 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.619 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.620 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.620 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.620 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.620 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.620 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.620 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.620 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.620 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.620 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.620 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.620 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.620 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.620 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.620 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.620 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.621 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.621 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.621 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.621 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.621 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.621 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.621 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.621 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.621 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.621 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.621 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.621 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.621 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.621 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.621 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.621 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.622 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.622 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.622 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.622 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.622 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.622 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.622 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.622 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.622 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.622 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.622 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.622 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.622 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.622 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.622 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.622 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.623 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.623 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.623 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.623 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.623 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.623 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.623 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.623 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.623 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.623 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.623 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.623 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.623 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.623 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.623 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.623 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.624 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.624 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.624 INFO:teuthology.orchestra.run.smithi001.stdout: "server_addr": { 2024-09-19T09:47:04.624 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_addr", 2024-09-19T09:47:04.624 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.624 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.624 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.624 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.624 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.624 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.624 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.624 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.624 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.624 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.624 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.625 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.625 INFO:teuthology.orchestra.run.smithi001.stdout: "server_port": { 2024-09-19T09:47:04.625 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "server_port", 2024-09-19T09:47:04.625 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.625 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.625 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.625 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.625 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.625 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.625 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.625 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.625 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.625 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.625 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.625 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.626 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.626 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.626 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.626 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rgw", 2024-09-19T09:47:04.626 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.626 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.626 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.626 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.626 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.626 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.626 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.626 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.626 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.626 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.627 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.627 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.627 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.627 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.627 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.627 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.627 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.627 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.627 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.627 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.627 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.627 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.627 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.627 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.628 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.628 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.628 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.628 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.628 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.628 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.628 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.628 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.628 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.628 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.628 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.628 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.628 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.628 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.628 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.628 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.629 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.629 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.629 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.629 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.629 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.629 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.629 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.629 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.629 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.629 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.629 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.629 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.629 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.630 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.630 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.630 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.630 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.630 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.630 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.630 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.630 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.630 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.630 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.630 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.630 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.630 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.630 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.630 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.631 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.631 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.631 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.631 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.631 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.631 INFO:teuthology.orchestra.run.smithi001.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T09:47:04.631 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T09:47:04.631 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.631 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.631 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.631 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "5", 2024-09-19T09:47:04.631 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.631 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.631 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.631 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T09:47:04.632 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.632 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.632 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.632 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.632 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.632 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.632 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.632 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rook", 2024-09-19T09:47:04.632 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.632 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.632 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.632 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.632 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.633 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.633 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.633 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.633 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.633 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.633 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.633 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.633 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.633 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.633 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.633 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.633 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.633 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.633 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.634 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.634 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.634 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.634 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.634 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.634 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.634 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.634 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.634 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.634 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.634 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.634 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.634 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.634 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.634 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.635 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.635 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.635 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.635 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.635 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.635 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.635 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.635 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.635 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.635 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.635 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.635 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.635 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.635 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.636 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.636 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.636 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.636 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.636 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.636 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.636 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.636 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.636 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.636 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.636 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.636 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.636 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.636 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.637 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.637 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.637 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.637 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.637 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.637 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.637 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.637 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.637 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.637 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.637 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.637 INFO:teuthology.orchestra.run.smithi001.stdout: "storage_class": { 2024-09-19T09:47:04.637 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "storage_class", 2024-09-19T09:47:04.637 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.638 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.638 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.638 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "local", 2024-09-19T09:47:04.638 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.638 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.638 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.638 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T09:47:04.638 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.638 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.638 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.638 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.638 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.638 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.638 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.639 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "selftest", 2024-09-19T09:47:04.639 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.639 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.639 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.639 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.639 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.639 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.639 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.639 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.639 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.639 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.639 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.640 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.640 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.640 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.640 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.640 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.640 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.640 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.640 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.640 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.640 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.640 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.640 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.640 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.641 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.641 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.641 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.641 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.641 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.641 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.641 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.641 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.641 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.641 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.641 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.641 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.641 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.642 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.642 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.642 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.642 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.642 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.642 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.642 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.642 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.642 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.642 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.642 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.642 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.642 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.643 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.643 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.643 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.643 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.643 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.643 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.643 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.643 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.643 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.643 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.643 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.643 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.643 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.643 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.644 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.644 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.644 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.644 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.644 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.644 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.644 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.644 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.644 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.644 INFO:teuthology.orchestra.run.smithi001.stdout: "roption1": { 2024-09-19T09:47:04.644 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption1", 2024-09-19T09:47:04.644 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.644 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.645 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.645 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.645 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.645 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.645 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.645 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.645 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.645 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.645 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.645 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.645 INFO:teuthology.orchestra.run.smithi001.stdout: "roption2": { 2024-09-19T09:47:04.645 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "roption2", 2024-09-19T09:47:04.645 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.645 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.646 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.646 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "xyz", 2024-09-19T09:47:04.646 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.646 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.646 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.646 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.646 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.646 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.646 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.646 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.646 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption1": { 2024-09-19T09:47:04.646 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption1", 2024-09-19T09:47:04.646 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.647 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.647 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.647 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.647 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.647 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.647 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.647 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.647 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.647 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.647 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.647 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.647 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption2": { 2024-09-19T09:47:04.647 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption2", 2024-09-19T09:47:04.647 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.648 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.648 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.648 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.648 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.648 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.648 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.648 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.648 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.648 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.648 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.648 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.648 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption3": { 2024-09-19T09:47:04.648 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption3", 2024-09-19T09:47:04.649 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "float", 2024-09-19T09:47:04.649 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.649 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.649 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.649 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.649 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.649 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.649 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.649 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.649 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.649 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.649 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.649 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption4": { 2024-09-19T09:47:04.649 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption4", 2024-09-19T09:47:04.650 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.650 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.650 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.650 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.650 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.650 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.650 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.650 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.650 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.650 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.650 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.650 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.650 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption5": { 2024-09-19T09:47:04.650 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption5", 2024-09-19T09:47:04.651 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.651 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.651 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.651 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.651 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.651 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.651 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.651 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.651 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.651 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.651 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.651 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.651 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption6": { 2024-09-19T09:47:04.651 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption6", 2024-09-19T09:47:04.651 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.651 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.652 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.652 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.652 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.652 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.652 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.652 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.652 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.652 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.652 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.652 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.652 INFO:teuthology.orchestra.run.smithi001.stdout: "rwoption7": { 2024-09-19T09:47:04.652 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rwoption7", 2024-09-19T09:47:04.652 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.652 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.653 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.653 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.653 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "1", 2024-09-19T09:47:04.653 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "42", 2024-09-19T09:47:04.653 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.653 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.653 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.653 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.653 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.653 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.653 INFO:teuthology.orchestra.run.smithi001.stdout: "testkey": { 2024-09-19T09:47:04.653 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testkey", 2024-09-19T09:47:04.653 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.653 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.654 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.654 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.654 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.654 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.654 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.654 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.654 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.654 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.654 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.654 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.654 INFO:teuthology.orchestra.run.smithi001.stdout: "testlkey": { 2024-09-19T09:47:04.654 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testlkey", 2024-09-19T09:47:04.654 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.654 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.655 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.655 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.655 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.655 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.655 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.655 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.655 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.655 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.655 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.655 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.655 INFO:teuthology.orchestra.run.smithi001.stdout: "testnewline": { 2024-09-19T09:47:04.655 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "testnewline", 2024-09-19T09:47:04.655 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.655 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.655 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.656 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.656 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.656 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.656 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.656 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.656 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.656 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.656 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.656 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.656 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.656 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.656 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.656 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snap_schedule", 2024-09-19T09:47:04.657 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.657 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.657 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.657 INFO:teuthology.orchestra.run.smithi001.stdout: "allow_m_granularity": { 2024-09-19T09:47:04.657 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "allow_m_granularity", 2024-09-19T09:47:04.657 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.657 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.657 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.657 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.657 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.657 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.657 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.657 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T09:47:04.657 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.658 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.658 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.658 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.658 INFO:teuthology.orchestra.run.smithi001.stdout: "dump_on_update": { 2024-09-19T09:47:04.658 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "dump_on_update", 2024-09-19T09:47:04.658 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.658 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.658 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.658 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.658 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.658 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.658 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.658 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "dump database to debug log on update", 2024-09-19T09:47:04.658 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.659 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.659 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.659 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.659 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.659 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.659 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.659 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.659 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.659 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.659 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.659 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.659 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.659 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.659 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.659 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.660 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.660 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.660 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.660 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.660 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.660 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.660 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.660 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.660 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.660 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.660 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.660 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.660 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.660 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.661 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.661 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.661 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.661 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.661 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.661 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.661 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.661 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.661 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.661 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.661 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.661 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.661 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.661 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.662 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.662 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.662 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.662 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.662 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.662 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.662 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.662 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.662 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.662 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.662 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.662 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.662 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.662 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.662 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.663 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.663 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.663 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.663 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.663 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.663 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.663 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.663 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.663 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.663 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.663 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.663 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.663 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.663 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.664 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.664 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.664 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.664 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.664 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "stats", 2024-09-19T09:47:04.664 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.664 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.664 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.664 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.664 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.664 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.664 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.664 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.664 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.664 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.665 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.665 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.665 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.665 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.665 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.665 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.665 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.665 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.665 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.665 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.665 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.665 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.665 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.665 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.665 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.666 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.666 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.666 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.666 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.666 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.666 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.666 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.666 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.666 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.666 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.666 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.666 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.666 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.666 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.667 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.667 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.667 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.667 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.667 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.667 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.667 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.667 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.667 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.667 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.667 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.667 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.667 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.667 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.668 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.668 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.668 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.668 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.668 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.668 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.668 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.668 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.668 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.668 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.668 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.668 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.668 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.668 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.669 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.669 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.669 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.669 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.669 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.669 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.669 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.669 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.669 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.669 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "status", 2024-09-19T09:47:04.669 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.669 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.669 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.669 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.669 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.670 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.670 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.670 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.670 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.670 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.670 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.670 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.670 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.670 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.670 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.670 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.670 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.670 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.670 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.670 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.671 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.671 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.671 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.671 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.671 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.671 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.671 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.671 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.671 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.671 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.671 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.671 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.671 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.671 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.671 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.671 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.672 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.672 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.672 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.672 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.672 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.672 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.672 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.672 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.672 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.672 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.672 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.672 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.672 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.672 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.672 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.673 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.673 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.673 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.673 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.673 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.673 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.673 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.673 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.673 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.673 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.673 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.673 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.673 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.673 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.673 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.674 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.674 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.674 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.674 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.674 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.674 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.674 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.674 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.674 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.674 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.674 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telegraf", 2024-09-19T09:47:04.674 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.674 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.674 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.674 INFO:teuthology.orchestra.run.smithi001.stdout: "address": { 2024-09-19T09:47:04.674 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "address", 2024-09-19T09:47:04.675 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.675 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.675 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.675 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T09:47:04.675 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.675 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.675 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.675 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.675 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.675 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.675 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.675 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.675 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T09:47:04.675 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T09:47:04.675 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:04.676 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.676 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.676 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "15", 2024-09-19T09:47:04.676 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.676 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.676 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.676 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.676 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.676 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.676 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.676 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.676 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.676 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.676 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.676 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.677 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.677 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.677 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.677 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.677 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.677 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.677 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.677 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.677 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.677 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.677 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.677 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.677 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.677 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.678 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.678 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.678 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.678 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.678 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.678 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.678 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.678 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.678 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.678 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.678 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.678 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.678 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.678 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.679 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.679 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.679 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.679 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.679 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.679 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.679 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.679 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.679 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.679 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.679 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.679 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.679 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.679 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.679 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.680 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.680 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.680 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.680 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.680 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.680 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.680 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.680 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.680 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.680 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.680 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.680 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.680 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.680 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.681 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.681 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.681 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.681 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.681 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.681 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.681 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.681 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.681 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.681 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.681 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.681 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.681 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "telemetry", 2024-09-19T09:47:04.681 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.682 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.682 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.682 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_basic": { 2024-09-19T09:47:04.682 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_basic", 2024-09-19T09:47:04.682 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.682 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.682 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.682 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.682 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.682 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.682 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.682 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T09:47:04.682 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.682 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.682 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.683 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.683 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_crash": { 2024-09-19T09:47:04.683 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_crash", 2024-09-19T09:47:04.683 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.683 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.683 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.683 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.683 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.683 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.683 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.683 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T09:47:04.683 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.683 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.683 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.683 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.684 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_device": { 2024-09-19T09:47:04.684 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_device", 2024-09-19T09:47:04.684 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.684 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.684 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.684 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.684 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.684 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.684 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.684 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T09:47:04.684 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.684 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.684 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.685 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.685 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_ident": { 2024-09-19T09:47:04.685 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_ident", 2024-09-19T09:47:04.685 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.685 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.685 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.685 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.685 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.685 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.685 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.685 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T09:47:04.685 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.685 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.685 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.685 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.686 INFO:teuthology.orchestra.run.smithi001.stdout: "channel_perf": { 2024-09-19T09:47:04.686 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "channel_perf", 2024-09-19T09:47:04.686 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.686 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.686 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.686 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.686 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.686 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.686 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.686 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T09:47:04.686 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.686 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.686 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.686 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.687 INFO:teuthology.orchestra.run.smithi001.stdout: "contact": { 2024-09-19T09:47:04.687 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "contact", 2024-09-19T09:47:04.687 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.687 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.687 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.687 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.687 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.687 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.687 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.687 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.687 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.687 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.687 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.687 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.687 INFO:teuthology.orchestra.run.smithi001.stdout: "description": { 2024-09-19T09:47:04.687 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "description", 2024-09-19T09:47:04.688 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.688 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.688 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.688 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.688 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.688 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.688 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.688 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.688 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.688 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.688 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.688 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.688 INFO:teuthology.orchestra.run.smithi001.stdout: "device_url": { 2024-09-19T09:47:04.688 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "device_url", 2024-09-19T09:47:04.688 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.688 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.689 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.689 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T09:47:04.689 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.689 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.689 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.689 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.689 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.689 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.689 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.689 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.689 INFO:teuthology.orchestra.run.smithi001.stdout: "enabled": { 2024-09-19T09:47:04.689 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "enabled", 2024-09-19T09:47:04.689 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.689 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.689 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.689 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.690 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.690 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.690 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.690 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.690 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.690 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.690 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.690 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.690 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T09:47:04.690 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T09:47:04.690 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.690 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.690 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.690 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "24", 2024-09-19T09:47:04.690 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "8", 2024-09-19T09:47:04.691 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.691 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.691 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.691 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.691 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.691 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.691 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.691 INFO:teuthology.orchestra.run.smithi001.stdout: "last_opt_revision": { 2024-09-19T09:47:04.691 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "last_opt_revision", 2024-09-19T09:47:04.691 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.691 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.691 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.691 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "1", 2024-09-19T09:47:04.691 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.691 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.691 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.691 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.692 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.692 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.692 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.692 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.692 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard": { 2024-09-19T09:47:04.692 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard", 2024-09-19T09:47:04.692 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.692 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.692 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.692 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.692 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.692 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.692 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.692 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.692 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.693 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.693 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.693 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.693 INFO:teuthology.orchestra.run.smithi001.stdout: "leaderboard_description": { 2024-09-19T09:47:04.693 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "leaderboard_description", 2024-09-19T09:47:04.693 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.693 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.693 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.693 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.693 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.693 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.693 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.693 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.693 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.693 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.694 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.694 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.694 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.694 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.694 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.694 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.694 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.694 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.694 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.694 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.694 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.694 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.694 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.694 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.694 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.694 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.695 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.695 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.695 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.695 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.695 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.695 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.695 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.695 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.695 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.695 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.695 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.695 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.695 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.695 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.695 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.695 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.696 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.696 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.696 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.696 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.696 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.696 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.696 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.696 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.696 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.696 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.696 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.696 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.696 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.696 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.696 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.697 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.697 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.697 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.697 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.697 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.697 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.697 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.697 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.697 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.697 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.697 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.697 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.697 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.698 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.698 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.698 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.698 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.698 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.698 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.698 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.698 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.698 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.698 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.698 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.698 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.698 INFO:teuthology.orchestra.run.smithi001.stdout: "organization": { 2024-09-19T09:47:04.698 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "organization", 2024-09-19T09:47:04.698 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.699 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.699 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.699 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.699 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.699 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.699 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.699 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.699 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.699 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.699 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.699 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.699 INFO:teuthology.orchestra.run.smithi001.stdout: "proxy": { 2024-09-19T09:47:04.699 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "proxy", 2024-09-19T09:47:04.699 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.700 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.700 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.700 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.700 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.700 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.700 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.700 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.700 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.700 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.700 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.700 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.700 INFO:teuthology.orchestra.run.smithi001.stdout: "url": { 2024-09-19T09:47:04.700 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "url", 2024-09-19T09:47:04.700 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.700 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.701 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.701 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T09:47:04.701 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.701 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.701 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.701 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.701 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.701 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.701 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.701 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.701 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.701 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.701 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.701 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "test_orchestrator", 2024-09-19T09:47:04.701 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.701 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.702 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.702 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.702 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.702 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.702 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.702 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.702 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.702 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.702 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.702 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.702 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.702 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.702 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.702 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.702 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.703 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.703 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.703 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.703 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.703 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.703 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.703 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.703 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.703 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.703 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.703 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.703 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.703 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.703 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.703 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.704 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.704 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.704 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.704 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.704 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.704 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.704 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.704 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.704 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.704 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.704 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.704 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.704 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.704 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.705 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.705 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.705 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.705 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.705 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.705 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.705 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.705 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.705 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.705 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.705 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.705 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.705 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.705 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.706 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.706 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.706 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.706 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.706 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.706 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.706 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.706 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.706 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.706 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.706 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.706 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.706 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.706 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.707 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.707 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.707 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "volumes", 2024-09-19T09:47:04.707 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.707 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.707 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.707 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.707 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.707 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.707 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.707 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.707 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.707 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.707 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.708 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.708 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.708 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.708 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.708 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.708 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.708 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.708 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.708 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.708 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.708 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.708 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.708 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.709 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.709 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.709 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.709 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.709 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.709 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.709 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.709 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.709 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.709 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.709 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.709 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.709 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.710 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.710 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.710 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.710 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.710 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.710 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.710 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.710 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.710 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.710 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.710 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.710 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.710 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.710 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.711 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.711 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.711 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.711 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.711 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.711 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.711 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.711 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.711 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.711 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.711 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.711 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.711 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.711 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.711 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.712 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.712 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.712 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.712 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.712 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.712 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.712 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.712 INFO:teuthology.orchestra.run.smithi001.stdout: "max_concurrent_clones": { 2024-09-19T09:47:04.712 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "max_concurrent_clones", 2024-09-19T09:47:04.712 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.712 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.712 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.712 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "4", 2024-09-19T09:47:04.712 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.712 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.713 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.713 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T09:47:04.713 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.713 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.713 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.713 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.713 INFO:teuthology.orchestra.run.smithi001.stdout: "periodic_async_work": { 2024-09-19T09:47:04.713 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "periodic_async_work", 2024-09-19T09:47:04.713 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.713 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.713 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.713 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.713 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.713 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.714 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.714 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Periodically check for async work", 2024-09-19T09:47:04.714 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.714 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.714 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.714 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.714 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_delay": { 2024-09-19T09:47:04.714 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_delay", 2024-09-19T09:47:04.714 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.714 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.714 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.714 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "0", 2024-09-19T09:47:04.714 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.714 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.714 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.715 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T09:47:04.715 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.715 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.715 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.715 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.715 INFO:teuthology.orchestra.run.smithi001.stdout: "snapshot_clone_no_wait": { 2024-09-19T09:47:04.715 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T09:47:04.715 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.715 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.715 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.715 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "True", 2024-09-19T09:47:04.715 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.715 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.716 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.716 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T09:47:04.716 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.716 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.716 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.716 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.716 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.716 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.716 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.716 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix", 2024-09-19T09:47:04.716 INFO:teuthology.orchestra.run.smithi001.stdout: "can_run": true, 2024-09-19T09:47:04.716 INFO:teuthology.orchestra.run.smithi001.stdout: "error_string": "", 2024-09-19T09:47:04.716 INFO:teuthology.orchestra.run.smithi001.stdout: "module_options": { 2024-09-19T09:47:04.716 INFO:teuthology.orchestra.run.smithi001.stdout: "discovery_interval": { 2024-09-19T09:47:04.717 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "discovery_interval", 2024-09-19T09:47:04.717 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "uint", 2024-09-19T09:47:04.717 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.717 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.717 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "100", 2024-09-19T09:47:04.717 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.717 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.717 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.717 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.717 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.717 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.717 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.717 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.717 INFO:teuthology.orchestra.run.smithi001.stdout: "identifier": { 2024-09-19T09:47:04.718 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "identifier", 2024-09-19T09:47:04.718 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.718 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.718 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.718 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.718 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.718 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.718 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.718 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.718 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.718 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.718 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.718 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.718 INFO:teuthology.orchestra.run.smithi001.stdout: "interval": { 2024-09-19T09:47:04.719 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "interval", 2024-09-19T09:47:04.719 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "secs", 2024-09-19T09:47:04.719 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.719 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.719 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "60", 2024-09-19T09:47:04.719 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.719 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.719 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.719 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.719 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.719 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.719 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.719 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.719 INFO:teuthology.orchestra.run.smithi001.stdout: "log_level": { 2024-09-19T09:47:04.719 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_level", 2024-09-19T09:47:04.720 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.720 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.720 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.720 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.720 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.720 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.720 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.720 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.720 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.720 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.720 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.720 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.720 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.720 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.721 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.721 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.721 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.721 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.721 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.721 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster": { 2024-09-19T09:47:04.721 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster", 2024-09-19T09:47:04.721 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.721 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.721 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.721 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.721 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.721 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.721 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.721 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.722 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.722 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.722 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.722 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.722 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_cluster_level": { 2024-09-19T09:47:04.722 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_cluster_level", 2024-09-19T09:47:04.722 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.722 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.722 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.722 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "info", 2024-09-19T09:47:04.722 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.722 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.722 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [ 2024-09-19T09:47:04.722 INFO:teuthology.orchestra.run.smithi001.stdout: "", 2024-09-19T09:47:04.723 INFO:teuthology.orchestra.run.smithi001.stdout: "critical", 2024-09-19T09:47:04.723 INFO:teuthology.orchestra.run.smithi001.stdout: "debug", 2024-09-19T09:47:04.723 INFO:teuthology.orchestra.run.smithi001.stdout: "error", 2024-09-19T09:47:04.723 INFO:teuthology.orchestra.run.smithi001.stdout: "info", 2024-09-19T09:47:04.723 INFO:teuthology.orchestra.run.smithi001.stdout: "warning" 2024-09-19T09:47:04.723 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.723 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.723 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.723 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.723 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.723 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.723 INFO:teuthology.orchestra.run.smithi001.stdout: "log_to_file": { 2024-09-19T09:47:04.723 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "log_to_file", 2024-09-19T09:47:04.723 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "bool", 2024-09-19T09:47:04.723 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.724 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 1, 2024-09-19T09:47:04.724 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "False", 2024-09-19T09:47:04.724 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.724 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.724 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.724 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.724 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.724 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.724 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.724 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.724 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_host": { 2024-09-19T09:47:04.724 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_host", 2024-09-19T09:47:04.724 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.724 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.725 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.725 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "", 2024-09-19T09:47:04.725 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.725 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.725 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.725 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.725 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.725 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.725 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.725 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.725 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_port": { 2024-09-19T09:47:04.725 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_port", 2024-09-19T09:47:04.725 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "int", 2024-09-19T09:47:04.725 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.726 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.726 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "10051", 2024-09-19T09:47:04.726 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.726 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.726 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.726 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.726 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.726 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.726 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.726 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.726 INFO:teuthology.orchestra.run.smithi001.stdout: "zabbix_sender": { 2024-09-19T09:47:04.726 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "zabbix_sender", 2024-09-19T09:47:04.726 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "str", 2024-09-19T09:47:04.726 INFO:teuthology.orchestra.run.smithi001.stdout: "level": "advanced", 2024-09-19T09:47:04.726 INFO:teuthology.orchestra.run.smithi001.stdout: "flags": 0, 2024-09-19T09:47:04.727 INFO:teuthology.orchestra.run.smithi001.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T09:47:04.727 INFO:teuthology.orchestra.run.smithi001.stdout: "min": "", 2024-09-19T09:47:04.727 INFO:teuthology.orchestra.run.smithi001.stdout: "max": "", 2024-09-19T09:47:04.727 INFO:teuthology.orchestra.run.smithi001.stdout: "enum_allowed": [], 2024-09-19T09:47:04.727 INFO:teuthology.orchestra.run.smithi001.stdout: "desc": "", 2024-09-19T09:47:04.727 INFO:teuthology.orchestra.run.smithi001.stdout: "long_desc": "", 2024-09-19T09:47:04.727 INFO:teuthology.orchestra.run.smithi001.stdout: "tags": [], 2024-09-19T09:47:04.727 INFO:teuthology.orchestra.run.smithi001.stdout: "see_also": [] 2024-09-19T09:47:04.727 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.727 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.727 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.727 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.727 INFO:teuthology.orchestra.run.smithi001.stdout: "services": { 2024-09-19T09:47:04.727 INFO:teuthology.orchestra.run.smithi001.stdout: "dashboard": "https://172.21.15.1:8443/" 2024-09-19T09:47:04.728 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.728 INFO:teuthology.orchestra.run.smithi001.stdout: "always_on_modules": { 2024-09-19T09:47:04.728 INFO:teuthology.orchestra.run.smithi001.stdout: "octopus": [ 2024-09-19T09:47:04.728 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-09-19T09:47:04.728 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-09-19T09:47:04.728 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-09-19T09:47:04.728 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-09-19T09:47:04.728 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-09-19T09:47:04.728 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-09-19T09:47:04.728 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-09-19T09:47:04.728 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-09-19T09:47:04.728 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-09-19T09:47:04.728 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-09-19T09:47:04.728 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.729 INFO:teuthology.orchestra.run.smithi001.stdout: "pacific": [ 2024-09-19T09:47:04.729 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-09-19T09:47:04.729 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-09-19T09:47:04.729 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-09-19T09:47:04.729 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-09-19T09:47:04.729 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-09-19T09:47:04.729 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-09-19T09:47:04.729 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-09-19T09:47:04.729 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-09-19T09:47:04.729 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-09-19T09:47:04.729 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-09-19T09:47:04.729 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.729 INFO:teuthology.orchestra.run.smithi001.stdout: "quincy": [ 2024-09-19T09:47:04.729 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-09-19T09:47:04.729 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-09-19T09:47:04.730 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-09-19T09:47:04.730 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-09-19T09:47:04.730 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-09-19T09:47:04.730 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-09-19T09:47:04.730 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-09-19T09:47:04.730 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-09-19T09:47:04.730 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-09-19T09:47:04.730 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-09-19T09:47:04.730 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.730 INFO:teuthology.orchestra.run.smithi001.stdout: "reef": [ 2024-09-19T09:47:04.730 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-09-19T09:47:04.730 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-09-19T09:47:04.730 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-09-19T09:47:04.730 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-09-19T09:47:04.730 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-09-19T09:47:04.731 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-09-19T09:47:04.731 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-09-19T09:47:04.731 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-09-19T09:47:04.731 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-09-19T09:47:04.731 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-09-19T09:47:04.731 INFO:teuthology.orchestra.run.smithi001.stdout: ], 2024-09-19T09:47:04.731 INFO:teuthology.orchestra.run.smithi001.stdout: "squid": [ 2024-09-19T09:47:04.731 INFO:teuthology.orchestra.run.smithi001.stdout: "balancer", 2024-09-19T09:47:04.731 INFO:teuthology.orchestra.run.smithi001.stdout: "crash", 2024-09-19T09:47:04.731 INFO:teuthology.orchestra.run.smithi001.stdout: "devicehealth", 2024-09-19T09:47:04.731 INFO:teuthology.orchestra.run.smithi001.stdout: "orchestrator", 2024-09-19T09:47:04.731 INFO:teuthology.orchestra.run.smithi001.stdout: "pg_autoscaler", 2024-09-19T09:47:04.731 INFO:teuthology.orchestra.run.smithi001.stdout: "progress", 2024-09-19T09:47:04.731 INFO:teuthology.orchestra.run.smithi001.stdout: "rbd_support", 2024-09-19T09:47:04.732 INFO:teuthology.orchestra.run.smithi001.stdout: "status", 2024-09-19T09:47:04.732 INFO:teuthology.orchestra.run.smithi001.stdout: "telemetry", 2024-09-19T09:47:04.732 INFO:teuthology.orchestra.run.smithi001.stdout: "volumes" 2024-09-19T09:47:04.732 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-19T09:47:04.732 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.732 INFO:teuthology.orchestra.run.smithi001.stdout: "last_failure_osd_epoch": 3, 2024-09-19T09:47:04.732 INFO:teuthology.orchestra.run.smithi001.stdout: "active_clients": [ 2024-09-19T09:47:04.732 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.732 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "devicehealth", 2024-09-19T09:47:04.732 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-19T09:47:04.732 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.732 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-19T09:47:04.732 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:0", 2024-09-19T09:47:04.732 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 44706134 2024-09-19T09:47:04.733 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.733 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-19T09:47:04.733 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.733 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.733 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "libcephsqlite", 2024-09-19T09:47:04.733 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-19T09:47:04.733 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.733 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-19T09:47:04.733 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:0", 2024-09-19T09:47:04.733 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 1262110380 2024-09-19T09:47:04.733 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.733 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-19T09:47:04.733 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.733 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.734 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "rbd_support", 2024-09-19T09:47:04.734 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-19T09:47:04.734 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.734 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-19T09:47:04.734 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:0", 2024-09-19T09:47:04.734 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 3056123799 2024-09-19T09:47:04.734 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.734 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-19T09:47:04.734 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:04.734 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.734 INFO:teuthology.orchestra.run.smithi001.stdout: "name": "volumes", 2024-09-19T09:47:04.734 INFO:teuthology.orchestra.run.smithi001.stdout: "addrvec": [ 2024-09-19T09:47:04.734 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-09-19T09:47:04.734 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v2", 2024-09-19T09:47:04.735 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:0", 2024-09-19T09:47:04.735 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 3629407954 2024-09-19T09:47:04.735 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.735 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-19T09:47:04.735 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:04.735 INFO:teuthology.orchestra.run.smithi001.stdout: ] 2024-09-19T09:47:04.735 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:47:04.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.383+0000 7fbefb1c0640 1 -- 172.21.15.1:0/1698020436 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbee00a32d0 msgr2=0x7fbee00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:04.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.383+0000 7fbefb1c0640 1 --2- 172.21.15.1:0/1698020436 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbee00a32d0 0x7fbee00a5790 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbee4006010 tx=0x7fbee4000bc0 comp rx=0 tx=0).stop 2024-09-19T09:47:04.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.383+0000 7fbefb1c0640 1 -- 172.21.15.1:0/1698020436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbef4101c40 msgr2=0x7fbef41983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:04.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.383+0000 7fbefb1c0640 1 --2- 172.21.15.1:0/1698020436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbef4101c40 0x7fbef41983f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fbedc00c970 tx=0x7fbedc00ce30 comp rx=0 tx=0).stop 2024-09-19T09:47:04.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.383+0000 7fbefb1c0640 1 -- 172.21.15.1:0/1698020436 shutdown_connections 2024-09-19T09:47:04.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.383+0000 7fbefb1c0640 1 --2- 172.21.15.1:0/1698020436 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fbee00a32d0 0x7fbee00a5790 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:04.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.383+0000 7fbefb1c0640 1 --2- 172.21.15.1:0/1698020436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbef4102600 0x7fbef419f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:04.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.383+0000 7fbefb1c0640 1 --2- 172.21.15.1:0/1698020436 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbef4101c40 0x7fbef41983f0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:04.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.383+0000 7fbefb1c0640 1 --2- 172.21.15.1:0/1698020436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbef4100a50 0x7fbef4197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:04.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.383+0000 7fbefb1c0640 1 -- 172.21.15.1:0/1698020436 >> 172.21.15.1:0/1698020436 conn(0x7fbef40fc190 msgr2=0x7fbef406a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:04.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.383+0000 7fbefb1c0640 1 -- 172.21.15.1:0/1698020436 shutdown_connections 2024-09-19T09:47:04.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:03.383+0000 7fbefb1c0640 1 -- 172.21.15.1:0/1698020436 wait complete. 2024-09-19T09:47:04.738 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:03 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/2589593327' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:47:04.738 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:03 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/3386481434' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:47:04.738 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:03 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/3247812158' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:47:04.738 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:04 smithi121 ceph-mon[35577]: pgmap v608: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:47:04.738 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:04 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1698020436' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T09:47:04.738 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:03 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/2589593327' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:47:04.738 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:03 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/3386481434' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:47:04.738 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:03 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/3247812158' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:47:04.738 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:04 smithi022 ceph-mon[35583]: pgmap v608: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:47:04.738 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:04 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1698020436' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T09:47:04.739 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:03 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/2589593327' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:47:04.739 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:03 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/3386481434' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:47:04.739 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:03 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/3247812158' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:47:04.745 DEBUG:tasks.check_counter:Getting stats from a 2024-09-19T09:47:04.745 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-19T09:47:04.746 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:04 smithi001 ceph-mon[31225]: pgmap v608: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:47:04.746 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:04 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1698020436' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T09:47:05.049 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:47:05.605 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:47:05.605 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:47:05.605 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 183, 2024-09-19T09:47:05.605 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 180, 2024-09-19T09:47:05.606 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 469344, 2024-09-19T09:47:05.606 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 110288, 2024-09-19T09:47:05.606 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 4, 2024-09-19T09:47:05.606 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 0, 2024-09-19T09:47:05.606 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.029191491, 2024-09-19T09:47:05.606 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.011958465, 2024-09-19T09:47:05.606 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.019542760, 2024-09-19T09:47:05.606 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:47:05.607 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:05.607 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 179, 2024-09-19T09:47:05.607 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.013606793, 2024-09-19T09:47:05.607 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000076015 2024-09-19T09:47:05.607 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:05.608 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:05.608 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:47:05.608 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:47:05.608 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:47:05.608 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:05.609 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 469344, 2024-09-19T09:47:05.609 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 110288 2024-09-19T09:47:05.609 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:05.609 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:47:05.609 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 1, 2024-09-19T09:47:05.609 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 136, 2024-09-19T09:47:05.609 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 160, 2024-09-19T09:47:05.610 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 102416, 2024-09-19T09:47:05.610 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 3, 2024-09-19T09:47:05.610 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 2, 2024-09-19T09:47:05.610 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.011132179, 2024-09-19T09:47:05.610 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.008186879, 2024-09-19T09:47:05.610 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.001099710, 2024-09-19T09:47:05.610 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:47:05.610 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:05.610 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 134, 2024-09-19T09:47:05.610 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.010180148, 2024-09-19T09:47:05.611 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000075971 2024-09-19T09:47:05.611 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:05.611 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:05.611 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:47:05.611 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:47:05.611 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:47:05.612 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:05.612 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:47:05.612 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 102416 2024-09-19T09:47:05.612 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:05.612 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:47:05.612 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 4, 2024-09-19T09:47:05.612 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 4, 2024-09-19T09:47:05.612 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 2992, 2024-09-19T09:47:05.612 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 448, 2024-09-19T09:47:05.612 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 2, 2024-09-19T09:47:05.612 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 1, 2024-09-19T09:47:05.612 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.002340759, 2024-09-19T09:47:05.612 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.000037660, 2024-09-19T09:47:05.612 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.002297984, 2024-09-19T09:47:05.613 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:47:05.613 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:05.613 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 3, 2024-09-19T09:47:05.613 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.004108996, 2024-09-19T09:47:05.613 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.001369665 2024-09-19T09:47:05.613 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:05.613 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:05.613 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:47:05.613 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:47:05.613 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:47:05.613 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:05.613 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T09:47:05.613 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T09:47:05.614 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:05.614 INFO:teuthology.orchestra.run.smithi001.stdout: "cct": { 2024-09-19T09:47:05.614 INFO:teuthology.orchestra.run.smithi001.stdout: "total_workers": 0, 2024-09-19T09:47:05.614 INFO:teuthology.orchestra.run.smithi001.stdout: "unhealthy_workers": 0 2024-09-19T09:47:05.614 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:05.614 INFO:teuthology.orchestra.run.smithi001.stdout: "mempool": { 2024-09-19T09:47:05.614 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:47:05.614 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_items": 0, 2024-09-19T09:47:05.614 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:47:05.614 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:47:05.614 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:47:05.615 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:47:05.615 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:47:05.615 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:47:05.615 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:47:05.615 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:47:05.615 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:47:05.616 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:47:05.616 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:47:05.616 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:47:05.616 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:47:05.616 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_items": 0, 2024-09-19T09:47:05.616 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:47:05.616 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_items": 0, 2024-09-19T09:47:05.616 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:47:05.616 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:47:05.616 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:47:05.616 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:47:05.617 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:47:05.617 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:47:05.617 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:47:05.617 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_items": 0, 2024-09-19T09:47:05.617 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:47:05.617 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:47:05.617 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:47:05.617 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_items": 0, 2024-09-19T09:47:05.617 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_bytes": 0, 2024-09-19T09:47:05.617 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_items": 0, 2024-09-19T09:47:05.617 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:47:05.618 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:47:05.618 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:47:05.618 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:47:05.618 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_bytes": 149007, 2024-09-19T09:47:05.618 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_items": 30, 2024-09-19T09:47:05.618 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:47:05.618 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_items": 0, 2024-09-19T09:47:05.618 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_bytes": 0, 2024-09-19T09:47:05.618 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_items": 0, 2024-09-19T09:47:05.618 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:47:05.618 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_items": 0, 2024-09-19T09:47:05.618 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:47:05.618 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_items": 0, 2024-09-19T09:47:05.619 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_bytes": 0, 2024-09-19T09:47:05.619 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_items": 0, 2024-09-19T09:47:05.619 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:47:05.619 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:47:05.619 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_bytes": 0, 2024-09-19T09:47:05.619 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_items": 0, 2024-09-19T09:47:05.619 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_bytes": 928, 2024-09-19T09:47:05.619 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_items": 2, 2024-09-19T09:47:05.619 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_bytes": 0, 2024-09-19T09:47:05.619 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_items": 0, 2024-09-19T09:47:05.620 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_bytes": 0, 2024-09-19T09:47:05.620 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_items": 0 2024-09-19T09:47:05.620 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:05.620 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:47:05.620 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-19T09:47:05.620 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 104857600, 2024-09-19T09:47:05.620 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-19T09:47:05.620 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 184, 2024-09-19T09:47:05.620 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 443470, 2024-09-19T09:47:05.620 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-19T09:47:05.620 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 184, 2024-09-19T09:47:05.620 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-09-19T09:47:05.621 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-09-19T09:47:05.621 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 184, 2024-09-19T09:47:05.621 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 443470, 2024-09-19T09:47:05.621 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-19T09:47:05.621 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:47:05.621 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:47:05.621 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:47:05.621 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:05.621 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:05.621 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:47:06.388 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2024-09-19T09:47:06.388 DEBUG:tasks.check_counter:Getting stats from d 2024-09-19T09:47:06.389 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-19T09:47:06.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:06 smithi001 ceph-mon[31225]: pgmap v609: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:47:06.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:06 smithi022 ceph-mon[35583]: pgmap v609: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:47:06.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:06 smithi121 ceph-mon[35577]: pgmap v609: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:47:06.652 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:47:07.158 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:47:07.158 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:47:07.158 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 4, 2024-09-19T09:47:07.158 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 4, 2024-09-19T09:47:07.158 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 2992, 2024-09-19T09:47:07.158 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 448, 2024-09-19T09:47:07.158 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 4, 2024-09-19T09:47:07.159 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 0, 2024-09-19T09:47:07.159 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.003465529, 2024-09-19T09:47:07.159 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.000041173, 2024-09-19T09:47:07.159 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.002337505, 2024-09-19T09:47:07.159 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:47:07.159 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:07.159 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 3, 2024-09-19T09:47:07.159 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.004228732, 2024-09-19T09:47:07.159 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.001409577 2024-09-19T09:47:07.159 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:07.159 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:07.159 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:47:07.159 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:47:07.159 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:47:07.159 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:07.160 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T09:47:07.160 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T09:47:07.160 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:07.160 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:47:07.160 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 188, 2024-09-19T09:47:07.160 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 185, 2024-09-19T09:47:07.160 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 470704, 2024-09-19T09:47:07.160 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 113488, 2024-09-19T09:47:07.160 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 2, 2024-09-19T09:47:07.160 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 1, 2024-09-19T09:47:07.160 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.025504710, 2024-09-19T09:47:07.160 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.012099275, 2024-09-19T09:47:07.160 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.016645906, 2024-09-19T09:47:07.160 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:47:07.161 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:07.161 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 184, 2024-09-19T09:47:07.161 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.013074040, 2024-09-19T09:47:07.161 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000071054 2024-09-19T09:47:07.161 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:07.161 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:07.161 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:47:07.161 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:47:07.161 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:47:07.161 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:07.161 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 470704, 2024-09-19T09:47:07.161 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 113488 2024-09-19T09:47:07.161 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:07.161 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:47:07.162 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 1, 2024-09-19T09:47:07.162 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 141, 2024-09-19T09:47:07.162 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 160, 2024-09-19T09:47:07.162 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 103296, 2024-09-19T09:47:07.162 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 3, 2024-09-19T09:47:07.162 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 2, 2024-09-19T09:47:07.162 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.010966528, 2024-09-19T09:47:07.162 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.008281194, 2024-09-19T09:47:07.162 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.001145881, 2024-09-19T09:47:07.162 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:47:07.162 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:07.162 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 139, 2024-09-19T09:47:07.162 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.009910898, 2024-09-19T09:47:07.162 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000071301 2024-09-19T09:47:07.162 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:07.162 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:07.163 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:47:07.163 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:47:07.163 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:47:07.163 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:07.163 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:47:07.163 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 103296 2024-09-19T09:47:07.163 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:07.163 INFO:teuthology.orchestra.run.smithi001.stdout: "cct": { 2024-09-19T09:47:07.163 INFO:teuthology.orchestra.run.smithi001.stdout: "total_workers": 0, 2024-09-19T09:47:07.163 INFO:teuthology.orchestra.run.smithi001.stdout: "unhealthy_workers": 0 2024-09-19T09:47:07.163 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:07.163 INFO:teuthology.orchestra.run.smithi001.stdout: "mempool": { 2024-09-19T09:47:07.163 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:47:07.163 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_items": 0, 2024-09-19T09:47:07.164 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:47:07.164 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:47:07.164 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:47:07.164 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:47:07.164 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:47:07.164 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:47:07.164 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:47:07.164 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:47:07.164 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:47:07.164 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:47:07.164 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:47:07.164 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:47:07.164 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:47:07.164 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_items": 0, 2024-09-19T09:47:07.165 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:47:07.165 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_items": 0, 2024-09-19T09:47:07.165 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:47:07.165 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:47:07.165 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:47:07.165 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:47:07.165 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:47:07.165 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:47:07.165 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:47:07.165 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_items": 0, 2024-09-19T09:47:07.165 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:47:07.165 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:47:07.165 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:47:07.165 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_items": 0, 2024-09-19T09:47:07.165 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_bytes": 0, 2024-09-19T09:47:07.166 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_items": 0, 2024-09-19T09:47:07.166 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:47:07.166 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:47:07.166 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:47:07.166 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:47:07.166 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_bytes": 148945, 2024-09-19T09:47:07.166 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_items": 29, 2024-09-19T09:47:07.166 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:47:07.166 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_items": 0, 2024-09-19T09:47:07.166 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_bytes": 0, 2024-09-19T09:47:07.166 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_items": 0, 2024-09-19T09:47:07.166 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:47:07.166 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_items": 0, 2024-09-19T09:47:07.166 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:47:07.167 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_items": 0, 2024-09-19T09:47:07.167 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_bytes": 0, 2024-09-19T09:47:07.167 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_items": 0, 2024-09-19T09:47:07.167 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:47:07.167 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:47:07.167 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_bytes": 0, 2024-09-19T09:47:07.167 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_items": 0, 2024-09-19T09:47:07.167 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_bytes": 928, 2024-09-19T09:47:07.167 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_items": 2, 2024-09-19T09:47:07.167 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_bytes": 0, 2024-09-19T09:47:07.167 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_items": 0, 2024-09-19T09:47:07.167 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_bytes": 0, 2024-09-19T09:47:07.167 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_items": 0 2024-09-19T09:47:07.167 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:07.168 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:47:07.168 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-19T09:47:07.168 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 104857600, 2024-09-19T09:47:07.168 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-19T09:47:07.168 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 189, 2024-09-19T09:47:07.168 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 444120, 2024-09-19T09:47:07.168 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-19T09:47:07.168 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 189, 2024-09-19T09:47:07.168 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-09-19T09:47:07.168 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-09-19T09:47:07.168 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 189, 2024-09-19T09:47:07.168 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 444120, 2024-09-19T09:47:07.168 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-19T09:47:07.169 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:47:07.169 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:47:07.169 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:47:07.169 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:07.169 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:07.169 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:47:08.091 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-09-19T09:47:08.092 DEBUG:tasks.check_counter:Getting stats from g 2024-09-19T09:47:08.092 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-19T09:47:08.358 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:47:08.479 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:08 smithi001 ceph-mon[31225]: pgmap v610: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:47:08.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:08 smithi022 ceph-mon[35583]: pgmap v610: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:47:08.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:08 smithi121 ceph-mon[35577]: pgmap v610: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:47:08.872 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:47:08.873 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:47:08.873 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 185, 2024-09-19T09:47:08.873 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 182, 2024-09-19T09:47:08.873 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 469888, 2024-09-19T09:47:08.873 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 111568, 2024-09-19T09:47:08.873 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 4, 2024-09-19T09:47:08.873 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 0, 2024-09-19T09:47:08.873 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.031850588, 2024-09-19T09:47:08.873 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.012629620, 2024-09-19T09:47:08.873 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.022086524, 2024-09-19T09:47:08.874 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:47:08.874 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:08.874 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 181, 2024-09-19T09:47:08.874 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.012642398, 2024-09-19T09:47:08.874 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000069847 2024-09-19T09:47:08.874 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:08.874 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:08.874 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:47:08.874 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:47:08.874 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:47:08.874 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:08.874 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 469888, 2024-09-19T09:47:08.874 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 111568 2024-09-19T09:47:08.874 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:08.875 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:47:08.875 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 1, 2024-09-19T09:47:08.875 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 138, 2024-09-19T09:47:08.875 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 160, 2024-09-19T09:47:08.875 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 102768, 2024-09-19T09:47:08.875 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 3, 2024-09-19T09:47:08.875 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 2, 2024-09-19T09:47:08.875 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.011341794, 2024-09-19T09:47:08.875 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.008155431, 2024-09-19T09:47:08.875 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.001597117, 2024-09-19T09:47:08.875 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:47:08.875 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:08.875 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 136, 2024-09-19T09:47:08.875 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.009993328, 2024-09-19T09:47:08.876 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000073480 2024-09-19T09:47:08.876 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:08.876 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:08.876 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:47:08.876 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:47:08.876 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:47:08.876 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:08.876 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:47:08.876 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 102768 2024-09-19T09:47:08.876 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:08.876 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:47:08.876 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 4, 2024-09-19T09:47:08.876 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 4, 2024-09-19T09:47:08.876 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 2992, 2024-09-19T09:47:08.876 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 448, 2024-09-19T09:47:08.877 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 2, 2024-09-19T09:47:08.877 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 1, 2024-09-19T09:47:08.877 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.002369970, 2024-09-19T09:47:08.877 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.000043925, 2024-09-19T09:47:08.877 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.002277869, 2024-09-19T09:47:08.877 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:47:08.877 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:08.877 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 3, 2024-09-19T09:47:08.877 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.004204669, 2024-09-19T09:47:08.877 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.001401556 2024-09-19T09:47:08.877 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:08.877 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:08.877 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:47:08.877 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:47:08.878 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:47:08.878 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:08.878 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T09:47:08.878 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T09:47:08.878 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:08.878 INFO:teuthology.orchestra.run.smithi001.stdout: "cct": { 2024-09-19T09:47:08.878 INFO:teuthology.orchestra.run.smithi001.stdout: "total_workers": 0, 2024-09-19T09:47:08.878 INFO:teuthology.orchestra.run.smithi001.stdout: "unhealthy_workers": 0 2024-09-19T09:47:08.878 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:08.878 INFO:teuthology.orchestra.run.smithi001.stdout: "mempool": { 2024-09-19T09:47:08.878 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:47:08.878 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_items": 0, 2024-09-19T09:47:08.878 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:47:08.878 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:47:08.878 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:47:08.879 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:47:08.879 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:47:08.879 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:47:08.879 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:47:08.879 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:47:08.879 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:47:08.879 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:47:08.879 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:47:08.879 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:47:08.879 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:47:08.879 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_items": 0, 2024-09-19T09:47:08.879 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:47:08.879 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_items": 0, 2024-09-19T09:47:08.879 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:47:08.879 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:47:08.880 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:47:08.880 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:47:08.880 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:47:08.880 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:47:08.880 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:47:08.880 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_items": 0, 2024-09-19T09:47:08.880 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:47:08.880 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:47:08.880 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:47:08.880 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_items": 0, 2024-09-19T09:47:08.880 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_bytes": 0, 2024-09-19T09:47:08.880 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_items": 0, 2024-09-19T09:47:08.880 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:47:08.880 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:47:08.880 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:47:08.881 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:47:08.881 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_bytes": 149007, 2024-09-19T09:47:08.881 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_items": 30, 2024-09-19T09:47:08.881 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:47:08.881 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_items": 0, 2024-09-19T09:47:08.881 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_bytes": 0, 2024-09-19T09:47:08.881 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_items": 0, 2024-09-19T09:47:08.881 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:47:08.881 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_items": 0, 2024-09-19T09:47:08.881 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:47:08.881 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_items": 0, 2024-09-19T09:47:08.881 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_bytes": 0, 2024-09-19T09:47:08.881 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_items": 0, 2024-09-19T09:47:08.881 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:47:08.881 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:47:08.882 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_bytes": 0, 2024-09-19T09:47:08.882 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_items": 0, 2024-09-19T09:47:08.882 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_bytes": 928, 2024-09-19T09:47:08.882 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_items": 2, 2024-09-19T09:47:08.882 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_bytes": 0, 2024-09-19T09:47:08.882 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_items": 0, 2024-09-19T09:47:08.882 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_bytes": 0, 2024-09-19T09:47:08.882 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_items": 0 2024-09-19T09:47:08.882 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:08.882 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:47:08.882 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-19T09:47:08.882 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 104857600, 2024-09-19T09:47:08.882 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-19T09:47:08.882 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 186, 2024-09-19T09:47:08.882 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 443730, 2024-09-19T09:47:08.883 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-19T09:47:08.883 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 186, 2024-09-19T09:47:08.883 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-09-19T09:47:08.883 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-09-19T09:47:08.883 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 186, 2024-09-19T09:47:08.883 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 443730, 2024-09-19T09:47:08.883 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-19T09:47:08.883 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:47:08.883 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:47:08.883 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:47:08.883 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:08.883 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:08.883 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:47:09.554 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-09-19T09:47:09.554 DEBUG:tasks.check_counter:Getting stats from j 2024-09-19T09:47:09.554 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-19T09:47:09.810 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:47:10.308 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-09-19T09:47:10.309 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:47:10.309 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 0, 2024-09-19T09:47:10.309 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 2, 2024-09-19T09:47:10.309 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 0, 2024-09-19T09:47:10.309 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 0, 2024-09-19T09:47:10.309 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 4, 2024-09-19T09:47:10.309 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 0, 2024-09-19T09:47:10.309 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.001420025, 2024-09-19T09:47:10.309 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T09:47:10.309 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.000267467, 2024-09-19T09:47:10.309 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:47:10.309 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:10.309 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:47:10.310 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:47:10.310 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:47:10.310 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:10.310 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:10.310 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:47:10.310 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:47:10.310 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:47:10.310 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:10.310 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:47:10.310 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:47:10.310 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:10.310 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:47:10.310 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 1, 2024-09-19T09:47:10.310 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 142, 2024-09-19T09:47:10.311 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 160, 2024-09-19T09:47:10.311 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 103472, 2024-09-19T09:47:10.311 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 3, 2024-09-19T09:47:10.311 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 2, 2024-09-19T09:47:10.311 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.011715506, 2024-09-19T09:47:10.311 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.008536234, 2024-09-19T09:47:10.311 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.001646580, 2024-09-19T09:47:10.311 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:47:10.311 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:10.311 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 140, 2024-09-19T09:47:10.311 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.006914752, 2024-09-19T09:47:10.311 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000049391 2024-09-19T09:47:10.312 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:10.312 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:10.312 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:47:10.312 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:47:10.312 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:47:10.312 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:10.312 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:47:10.312 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 103472 2024-09-19T09:47:10.312 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:10.312 INFO:teuthology.orchestra.run.smithi001.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:47:10.312 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_messages": 194, 2024-09-19T09:47:10.312 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages": 189, 2024-09-19T09:47:10.312 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_bytes": 474240, 2024-09-19T09:47:10.312 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_bytes": 115216, 2024-09-19T09:47:10.313 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_created_connections": 2, 2024-09-19T09:47:10.313 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_active_connections": 1, 2024-09-19T09:47:10.313 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_total_time": 0.031802132, 2024-09-19T09:47:10.313 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_send_time": 0.012435278, 2024-09-19T09:47:10.313 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_recv_time": 0.023353745, 2024-09-19T09:47:10.313 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:47:10.313 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:10.313 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 189, 2024-09-19T09:47:10.313 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.015094570, 2024-09-19T09:47:10.313 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000079865 2024-09-19T09:47:10.313 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:10.313 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:10.313 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:47:10.313 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:47:10.314 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:47:10.314 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:10.314 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_recv_encrypted_bytes": 474240, 2024-09-19T09:47:10.314 INFO:teuthology.orchestra.run.smithi001.stdout: "msgr_send_encrypted_bytes": 115216 2024-09-19T09:47:10.314 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:10.314 INFO:teuthology.orchestra.run.smithi001.stdout: "cct": { 2024-09-19T09:47:10.314 INFO:teuthology.orchestra.run.smithi001.stdout: "total_workers": 0, 2024-09-19T09:47:10.314 INFO:teuthology.orchestra.run.smithi001.stdout: "unhealthy_workers": 0 2024-09-19T09:47:10.314 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:10.314 INFO:teuthology.orchestra.run.smithi001.stdout: "mempool": { 2024-09-19T09:47:10.314 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:47:10.314 INFO:teuthology.orchestra.run.smithi001.stdout: "bloom_filter_items": 0, 2024-09-19T09:47:10.314 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:47:10.314 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:47:10.314 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:47:10.315 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:47:10.315 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:47:10.315 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:47:10.315 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:47:10.315 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:47:10.315 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:47:10.315 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:47:10.315 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:47:10.315 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:47:10.315 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:47:10.315 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_extent_items": 0, 2024-09-19T09:47:10.315 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:47:10.315 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_blob_items": 0, 2024-09-19T09:47:10.315 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:47:10.316 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:47:10.316 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:47:10.316 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:47:10.316 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:47:10.316 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:47:10.316 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:47:10.316 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_txc_items": 0, 2024-09-19T09:47:10.316 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:47:10.316 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:47:10.316 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:47:10.316 INFO:teuthology.orchestra.run.smithi001.stdout: "bluestore_writing_items": 0, 2024-09-19T09:47:10.316 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_bytes": 0, 2024-09-19T09:47:10.316 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_items": 0, 2024-09-19T09:47:10.316 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:47:10.317 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:47:10.317 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:47:10.317 INFO:teuthology.orchestra.run.smithi001.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:47:10.317 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_bytes": 148967, 2024-09-19T09:47:10.317 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_anon_items": 29, 2024-09-19T09:47:10.317 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:47:10.317 INFO:teuthology.orchestra.run.smithi001.stdout: "buffer_meta_items": 0, 2024-09-19T09:47:10.317 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_bytes": 0, 2024-09-19T09:47:10.317 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_items": 0, 2024-09-19T09:47:10.317 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:47:10.317 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_mapbl_items": 0, 2024-09-19T09:47:10.317 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:47:10.317 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_pglog_items": 0, 2024-09-19T09:47:10.318 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_bytes": 0, 2024-09-19T09:47:10.318 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_items": 0, 2024-09-19T09:47:10.318 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:47:10.318 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:47:10.318 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_bytes": 0, 2024-09-19T09:47:10.318 INFO:teuthology.orchestra.run.smithi001.stdout: "pgmap_items": 0, 2024-09-19T09:47:10.318 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_bytes": 928, 2024-09-19T09:47:10.318 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_co_items": 2, 2024-09-19T09:47:10.318 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_bytes": 0, 2024-09-19T09:47:10.318 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_1_items": 0, 2024-09-19T09:47:10.318 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_bytes": 0, 2024-09-19T09:47:10.318 INFO:teuthology.orchestra.run.smithi001.stdout: "unittest_2_items": 0 2024-09-19T09:47:10.318 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-09-19T09:47:10.318 INFO:teuthology.orchestra.run.smithi001.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:47:10.319 INFO:teuthology.orchestra.run.smithi001.stdout: "val": 0, 2024-09-19T09:47:10.319 INFO:teuthology.orchestra.run.smithi001.stdout: "max": 104857600, 2024-09-19T09:47:10.319 INFO:teuthology.orchestra.run.smithi001.stdout: "get_started": 0, 2024-09-19T09:47:10.319 INFO:teuthology.orchestra.run.smithi001.stdout: "get": 191, 2024-09-19T09:47:10.319 INFO:teuthology.orchestra.run.smithi001.stdout: "get_sum": 444380, 2024-09-19T09:47:10.319 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_fail": 0, 2024-09-19T09:47:10.319 INFO:teuthology.orchestra.run.smithi001.stdout: "get_or_fail_success": 191, 2024-09-19T09:47:10.319 INFO:teuthology.orchestra.run.smithi001.stdout: "take": 0, 2024-09-19T09:47:10.319 INFO:teuthology.orchestra.run.smithi001.stdout: "take_sum": 0, 2024-09-19T09:47:10.319 INFO:teuthology.orchestra.run.smithi001.stdout: "put": 191, 2024-09-19T09:47:10.319 INFO:teuthology.orchestra.run.smithi001.stdout: "put_sum": 444380, 2024-09-19T09:47:10.319 INFO:teuthology.orchestra.run.smithi001.stdout: "wait": { 2024-09-19T09:47:10.319 INFO:teuthology.orchestra.run.smithi001.stdout: "avgcount": 0, 2024-09-19T09:47:10.319 INFO:teuthology.orchestra.run.smithi001.stdout: "sum": 0.000000000, 2024-09-19T09:47:10.319 INFO:teuthology.orchestra.run.smithi001.stdout: "avgtime": 0.000000000 2024-09-19T09:47:10.320 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:10.320 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-09-19T09:47:10.320 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-09-19T09:47:10.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:10 smithi001 ceph-mon[31225]: pgmap v611: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:47:10.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:10 smithi022 ceph-mon[35583]: pgmap v611: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:47:10.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:10 smithi121 ceph-mon[35577]: pgmap v611: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:47:10.995 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-09-19T09:47:10.995 DEBUG:tasks.check_counter:Getting stats from b 2024-09-19T09:47:10.996 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-19T09:47:11.302 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:47:11.948 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-19T09:47:11.948 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:47:11.949 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 4945, 2024-09-19T09:47:11.949 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 4947, 2024-09-19T09:47:11.949 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 1469883, 2024-09-19T09:47:11.949 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 26776073, 2024-09-19T09:47:11.949 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 11, 2024-09-19T09:47:11.949 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 4, 2024-09-19T09:47:11.949 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.614371211, 2024-09-19T09:47:11.949 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.192559606, 2024-09-19T09:47:11.949 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.095530571, 2024-09-19T09:47:11.949 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.287468897, 2024-09-19T09:47:11.949 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:11.949 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 4945, 2024-09-19T09:47:11.950 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.889395271, 2024-09-19T09:47:11.950 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000179857 2024-09-19T09:47:11.950 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.950 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:11.950 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 2, 2024-09-19T09:47:11.950 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000153, 2024-09-19T09:47:11.950 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000076 2024-09-19T09:47:11.950 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.950 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:47:11.950 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:47:11.950 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.950 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:47:11.950 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 3762, 2024-09-19T09:47:11.950 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 3905, 2024-09-19T09:47:11.950 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 1271395, 2024-09-19T09:47:11.951 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 28562833, 2024-09-19T09:47:11.951 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 151, 2024-09-19T09:47:11.951 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 7, 2024-09-19T09:47:11.951 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.440038414, 2024-09-19T09:47:11.951 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.173754469, 2024-09-19T09:47:11.951 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.120674673, 2024-09-19T09:47:11.951 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.119015719, 2024-09-19T09:47:11.951 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:11.951 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 3903, 2024-09-19T09:47:11.951 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.705178291, 2024-09-19T09:47:11.951 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000180675 2024-09-19T09:47:11.952 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.952 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:11.952 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 144, 2024-09-19T09:47:11.952 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000014349, 2024-09-19T09:47:11.952 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000099 2024-09-19T09:47:11.952 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.952 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:47:11.952 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 326736 2024-09-19T09:47:11.952 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.952 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:47:11.952 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 34264, 2024-09-19T09:47:11.952 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 39278, 2024-09-19T09:47:11.952 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 13939927, 2024-09-19T09:47:11.953 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 21923092, 2024-09-19T09:47:11.953 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 15, 2024-09-19T09:47:11.953 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 5, 2024-09-19T09:47:11.953 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 2.211658039, 2024-09-19T09:47:11.953 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.875110725, 2024-09-19T09:47:11.953 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 3.392720120, 2024-09-19T09:47:11.953 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.095252828, 2024-09-19T09:47:11.953 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:11.953 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 39278, 2024-09-19T09:47:11.953 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 11.078189736, 2024-09-19T09:47:11.953 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000282045 2024-09-19T09:47:11.953 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.953 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:11.954 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 56608, 2024-09-19T09:47:11.954 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.010619241, 2024-09-19T09:47:11.954 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000187 2024-09-19T09:47:11.954 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.954 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 13319472, 2024-09-19T09:47:11.954 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 17906560 2024-09-19T09:47:11.954 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.954 INFO:teuthology.orchestra.run.smithi022.stdout: "cct": { 2024-09-19T09:47:11.954 INFO:teuthology.orchestra.run.smithi022.stdout: "total_workers": 1, 2024-09-19T09:47:11.954 INFO:teuthology.orchestra.run.smithi022.stdout: "unhealthy_workers": 0 2024-09-19T09:47:11.954 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.954 INFO:teuthology.orchestra.run.smithi022.stdout: "finisher-MDSRank": { 2024-09-19T09:47:11.954 INFO:teuthology.orchestra.run.smithi022.stdout: "queue_len": 0, 2024-09-19T09:47:11.954 INFO:teuthology.orchestra.run.smithi022.stdout: "complete_latency": { 2024-09-19T09:47:11.955 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 6381, 2024-09-19T09:47:11.955 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 11.597764835, 2024-09-19T09:47:11.955 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.001817546 2024-09-19T09:47:11.955 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:47:11.955 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.955 INFO:teuthology.orchestra.run.smithi022.stdout: "finisher-PurgeQueue": { 2024-09-19T09:47:11.955 INFO:teuthology.orchestra.run.smithi022.stdout: "queue_len": 0, 2024-09-19T09:47:11.955 INFO:teuthology.orchestra.run.smithi022.stdout: "complete_latency": { 2024-09-19T09:47:11.955 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 4364, 2024-09-19T09:47:11.955 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.221400309, 2024-09-19T09:47:11.955 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000050733 2024-09-19T09:47:11.955 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:47:11.955 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.955 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": { 2024-09-19T09:47:11.956 INFO:teuthology.orchestra.run.smithi022.stdout: "request": 2768, 2024-09-19T09:47:11.956 INFO:teuthology.orchestra.run.smithi022.stdout: "reply": 2768, 2024-09-19T09:47:11.956 INFO:teuthology.orchestra.run.smithi022.stdout: "reply_latency": { 2024-09-19T09:47:11.956 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 2768, 2024-09-19T09:47:11.956 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 51.458673607, 2024-09-19T09:47:11.956 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.018590561 2024-09-19T09:47:11.956 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.956 INFO:teuthology.orchestra.run.smithi022.stdout: "slow_reply": 0, 2024-09-19T09:47:11.956 INFO:teuthology.orchestra.run.smithi022.stdout: "forward": 0, 2024-09-19T09:47:11.956 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_fetch_complete": 0, 2024-09-19T09:47:11.956 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_fetch_keys": 0, 2024-09-19T09:47:11.957 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_commit": 442, 2024-09-19T09:47:11.957 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_split": 1, 2024-09-19T09:47:11.957 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_merge": 0, 2024-09-19T09:47:11.957 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes": 25, 2024-09-19T09:47:11.957 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_top": 5, 2024-09-19T09:47:11.957 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_bottom": 20, 2024-09-19T09:47:11.957 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_pin_tail": 0, 2024-09-19T09:47:11.957 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_pinned": 17, 2024-09-19T09:47:11.957 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_expired": 0, 2024-09-19T09:47:11.957 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_with_caps": 3, 2024-09-19T09:47:11.957 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": 3, 2024-09-19T09:47:11.957 INFO:teuthology.orchestra.run.smithi022.stdout: "subtrees": 2, 2024-09-19T09:47:11.957 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse": 3437, 2024-09-19T09:47:11.957 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_hit": 3284, 2024-09-19T09:47:11.958 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_forward": 0, 2024-09-19T09:47:11.958 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_discover": 0, 2024-09-19T09:47:11.958 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:47:11.958 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_remote_ino": 0, 2024-09-19T09:47:11.958 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_lock": 51, 2024-09-19T09:47:11.958 INFO:teuthology.orchestra.run.smithi022.stdout: "load_cent": 0, 2024-09-19T09:47:11.958 INFO:teuthology.orchestra.run.smithi022.stdout: "q": 0, 2024-09-19T09:47:11.958 INFO:teuthology.orchestra.run.smithi022.stdout: "exported": 0, 2024-09-19T09:47:11.958 INFO:teuthology.orchestra.run.smithi022.stdout: "exported_inodes": 0, 2024-09-19T09:47:11.958 INFO:teuthology.orchestra.run.smithi022.stdout: "imported": 0, 2024-09-19T09:47:11.959 INFO:teuthology.orchestra.run.smithi022.stdout: "imported_inodes": 0, 2024-09-19T09:47:11.959 INFO:teuthology.orchestra.run.smithi022.stdout: "openino_dir_fetch": 0, 2024-09-19T09:47:11.959 INFO:teuthology.orchestra.run.smithi022.stdout: "openino_backtrace_fetch": 1545, 2024-09-19T09:47:11.959 INFO:teuthology.orchestra.run.smithi022.stdout: "openino_peer_discover": 0, 2024-09-19T09:47:11.959 INFO:teuthology.orchestra.run.smithi022.stdout: "root_rfiles": 4, 2024-09-19T09:47:11.959 INFO:teuthology.orchestra.run.smithi022.stdout: "root_rbytes": 234, 2024-09-19T09:47:11.959 INFO:teuthology.orchestra.run.smithi022.stdout: "root_rsnaps": 0, 2024-09-19T09:47:11.960 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_backtrace_fetch": 1545, 2024-09-19T09:47:11.960 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_set_tag": 0, 2024-09-19T09:47:11.960 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:47:11.960 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:47:11.960 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_dir_inodes": 380, 2024-09-19T09:47:11.960 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_dir_base_inodes": 7, 2024-09-19T09:47:11.960 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_dirfrag_rstats": 373, 2024-09-19T09:47:11.960 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_file_inodes": 1165, 2024-09-19T09:47:11.960 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:47:11.960 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_revoke": 1639, 2024-09-19T09:47:11.960 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_grant": 4818, 2024-09-19T09:47:11.960 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_trunc": 6, 2024-09-19T09:47:11.960 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:47:11.960 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:47:11.960 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_caps": 28615, 2024-09-19T09:47:11.961 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_caps_dirty": 26094, 2024-09-19T09:47:11.961 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_cap_release": 190, 2024-09-19T09:47:11.961 INFO:teuthology.orchestra.run.smithi022.stdout: "process_request_cap_release": 1486 2024-09-19T09:47:11.961 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.961 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_cache": { 2024-09-19T09:47:11.961 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_update": 0, 2024-09-19T09:47:11.961 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_update_receipt": 0, 2024-09-19T09:47:11.961 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_try_discover": 0, 2024-09-19T09:47:11.961 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_send_discover": 0, 2024-09-19T09:47:11.961 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_handle_discover": 0, 2024-09-19T09:47:11.961 INFO:teuthology.orchestra.run.smithi022.stdout: "num_strays": 1, 2024-09-19T09:47:11.962 INFO:teuthology.orchestra.run.smithi022.stdout: "num_strays_delayed": 0, 2024-09-19T09:47:11.962 INFO:teuthology.orchestra.run.smithi022.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:47:11.962 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_created": 934, 2024-09-19T09:47:11.962 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_enqueued": 872, 2024-09-19T09:47:11.962 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_reintegrated": 61, 2024-09-19T09:47:11.962 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_migrated": 0, 2024-09-19T09:47:11.962 INFO:teuthology.orchestra.run.smithi022.stdout: "num_recovering_processing": 0, 2024-09-19T09:47:11.962 INFO:teuthology.orchestra.run.smithi022.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:47:11.962 INFO:teuthology.orchestra.run.smithi022.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:47:11.962 INFO:teuthology.orchestra.run.smithi022.stdout: "recovery_started": 0, 2024-09-19T09:47:11.962 INFO:teuthology.orchestra.run.smithi022.stdout: "recovery_completed": 0, 2024-09-19T09:47:11.962 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_quiesce_path": 6, 2024-09-19T09:47:11.962 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_quiesce_inode": 1508, 2024-09-19T09:47:11.962 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_enqueue_scrub": 7, 2024-09-19T09:47:11.963 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_exportdir": 0, 2024-09-19T09:47:11.963 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_flush": 0, 2024-09-19T09:47:11.963 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_fragmentdir": 1, 2024-09-19T09:47:11.963 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_fragstats": 0, 2024-09-19T09:47:11.963 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_inodestats": 0 2024-09-19T09:47:11.963 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.963 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_log": { 2024-09-19T09:47:11.963 INFO:teuthology.orchestra.run.smithi022.stdout: "evlrg": 0, 2024-09-19T09:47:11.963 INFO:teuthology.orchestra.run.smithi022.stdout: "evadd": 30694, 2024-09-19T09:47:11.963 INFO:teuthology.orchestra.run.smithi022.stdout: "evex": 29793, 2024-09-19T09:47:11.963 INFO:teuthology.orchestra.run.smithi022.stdout: "evtrm": 29793, 2024-09-19T09:47:11.963 INFO:teuthology.orchestra.run.smithi022.stdout: "ev": 901, 2024-09-19T09:47:11.963 INFO:teuthology.orchestra.run.smithi022.stdout: "evexg": 0, 2024-09-19T09:47:11.963 INFO:teuthology.orchestra.run.smithi022.stdout: "evexd": 15, 2024-09-19T09:47:11.963 INFO:teuthology.orchestra.run.smithi022.stdout: "segadd": 62, 2024-09-19T09:47:11.963 INFO:teuthology.orchestra.run.smithi022.stdout: "segex": 61, 2024-09-19T09:47:11.964 INFO:teuthology.orchestra.run.smithi022.stdout: "segtrm": 61, 2024-09-19T09:47:11.964 INFO:teuthology.orchestra.run.smithi022.stdout: "seg": 1, 2024-09-19T09:47:11.964 INFO:teuthology.orchestra.run.smithi022.stdout: "segmjr": 1, 2024-09-19T09:47:11.964 INFO:teuthology.orchestra.run.smithi022.stdout: "segexg": 0, 2024-09-19T09:47:11.964 INFO:teuthology.orchestra.run.smithi022.stdout: "segexd": 1, 2024-09-19T09:47:11.964 INFO:teuthology.orchestra.run.smithi022.stdout: "expos": 68659195, 2024-09-19T09:47:11.964 INFO:teuthology.orchestra.run.smithi022.stdout: "wrpos": 70415241, 2024-09-19T09:47:11.964 INFO:teuthology.orchestra.run.smithi022.stdout: "rdpos": 0, 2024-09-19T09:47:11.964 INFO:teuthology.orchestra.run.smithi022.stdout: "jlat": { 2024-09-19T09:47:11.964 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 2675, 2024-09-19T09:47:11.964 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 287.533646065, 2024-09-19T09:47:11.964 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.107489213 2024-09-19T09:47:11.964 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.964 INFO:teuthology.orchestra.run.smithi022.stdout: "replayed": 0 2024-09-19T09:47:11.964 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.964 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_mem": { 2024-09-19T09:47:11.965 INFO:teuthology.orchestra.run.smithi022.stdout: "ino": 24, 2024-09-19T09:47:11.965 INFO:teuthology.orchestra.run.smithi022.stdout: "ino+": 903, 2024-09-19T09:47:11.965 INFO:teuthology.orchestra.run.smithi022.stdout: "ino-": 879, 2024-09-19T09:47:11.965 INFO:teuthology.orchestra.run.smithi022.stdout: "dir": 19, 2024-09-19T09:47:11.965 INFO:teuthology.orchestra.run.smithi022.stdout: "dir+": 125, 2024-09-19T09:47:11.965 INFO:teuthology.orchestra.run.smithi022.stdout: "dir-": 106, 2024-09-19T09:47:11.965 INFO:teuthology.orchestra.run.smithi022.stdout: "dn": 25, 2024-09-19T09:47:11.965 INFO:teuthology.orchestra.run.smithi022.stdout: "dn+": 1613, 2024-09-19T09:47:11.965 INFO:teuthology.orchestra.run.smithi022.stdout: "dn-": 1588, 2024-09-19T09:47:11.965 INFO:teuthology.orchestra.run.smithi022.stdout: "cap": 3, 2024-09-19T09:47:11.965 INFO:teuthology.orchestra.run.smithi022.stdout: "cap+": 1481, 2024-09-19T09:47:11.965 INFO:teuthology.orchestra.run.smithi022.stdout: "cap-": 1478, 2024-09-19T09:47:11.965 INFO:teuthology.orchestra.run.smithi022.stdout: "rss": 76520, 2024-09-19T09:47:11.965 INFO:teuthology.orchestra.run.smithi022.stdout: "heap": 231712 2024-09-19T09:47:11.965 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.965 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_server": { 2024-09-19T09:47:11.966 INFO:teuthology.orchestra.run.smithi022.stdout: "dispatch_client_request": 3374, 2024-09-19T09:47:11.966 INFO:teuthology.orchestra.run.smithi022.stdout: "dispatch_server_request": 0, 2024-09-19T09:47:11.966 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_request": 2768, 2024-09-19T09:47:11.966 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_session": 14, 2024-09-19T09:47:11.966 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_peer_request": 0, 2024-09-19T09:47:11.966 INFO:teuthology.orchestra.run.smithi022.stdout: "req_create_latency": { 2024-09-19T09:47:11.966 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 765, 2024-09-19T09:47:11.966 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 21.042392814, 2024-09-19T09:47:11.966 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.027506395 2024-09-19T09:47:11.966 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.966 INFO:teuthology.orchestra.run.smithi022.stdout: "req_getattr_latency": { 2024-09-19T09:47:11.966 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 79, 2024-09-19T09:47:11.966 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.011106243, 2024-09-19T09:47:11.966 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000140585 2024-09-19T09:47:11.966 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.966 INFO:teuthology.orchestra.run.smithi022.stdout: "req_getfilelock_latency": { 2024-09-19T09:47:11.967 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:11.967 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:11.967 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:11.967 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.967 INFO:teuthology.orchestra.run.smithi022.stdout: "req_link_latency": { 2024-09-19T09:47:11.967 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 61, 2024-09-19T09:47:11.967 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.044666540, 2024-09-19T09:47:11.967 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000732238 2024-09-19T09:47:11.967 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.967 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookup_latency": { 2024-09-19T09:47:11.967 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 154, 2024-09-19T09:47:11.967 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.154776512, 2024-09-19T09:47:11.967 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.001005042 2024-09-19T09:47:11.967 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.968 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookuphash_latency": { 2024-09-19T09:47:11.968 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:11.968 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:11.968 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:11.968 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.968 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupino_latency": { 2024-09-19T09:47:11.968 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 2, 2024-09-19T09:47:11.968 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000423500, 2024-09-19T09:47:11.968 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000211750 2024-09-19T09:47:11.968 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.968 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupname_latency": { 2024-09-19T09:47:11.968 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:11.968 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:11.968 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:11.969 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.969 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupparent_latency": { 2024-09-19T09:47:11.969 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:11.969 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:11.969 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:11.969 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.969 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupsnap_latency": { 2024-09-19T09:47:11.969 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:11.969 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:11.969 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:11.969 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.969 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lssnap_latency": { 2024-09-19T09:47:11.970 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:11.970 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:11.970 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:11.970 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.970 INFO:teuthology.orchestra.run.smithi022.stdout: "req_mkdir_latency": { 2024-09-19T09:47:11.970 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 105, 2024-09-19T09:47:11.970 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 16.480456015, 2024-09-19T09:47:11.970 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.156956723 2024-09-19T09:47:11.971 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.971 INFO:teuthology.orchestra.run.smithi022.stdout: "req_mknod_latency": { 2024-09-19T09:47:11.971 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:11.971 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:11.971 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:11.971 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.971 INFO:teuthology.orchestra.run.smithi022.stdout: "req_mksnap_latency": { 2024-09-19T09:47:11.971 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:11.971 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:11.971 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:11.971 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.971 INFO:teuthology.orchestra.run.smithi022.stdout: "req_open_latency": { 2024-09-19T09:47:11.971 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 300, 2024-09-19T09:47:11.971 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.706929225, 2024-09-19T09:47:11.972 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.002356430 2024-09-19T09:47:11.972 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.972 INFO:teuthology.orchestra.run.smithi022.stdout: "req_readdir_latency": { 2024-09-19T09:47:11.972 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 257, 2024-09-19T09:47:11.972 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.834221449, 2024-09-19T09:47:11.972 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.003245997 2024-09-19T09:47:11.972 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.972 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rename_latency": { 2024-09-19T09:47:11.972 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 113, 2024-09-19T09:47:11.972 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 10.313439002, 2024-09-19T09:47:11.972 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.091269371 2024-09-19T09:47:11.972 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.972 INFO:teuthology.orchestra.run.smithi022.stdout: "req_renamesnap_latency": { 2024-09-19T09:47:11.973 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:11.973 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:11.973 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:11.973 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.973 INFO:teuthology.orchestra.run.smithi022.stdout: "req_snapdiff_latency": { 2024-09-19T09:47:11.973 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:11.973 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:11.973 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:11.973 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.973 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rmdir_latency": { 2024-09-19T09:47:11.973 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 99, 2024-09-19T09:47:11.973 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.812872113, 2024-09-19T09:47:11.974 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.008210829 2024-09-19T09:47:11.974 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.974 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rmsnap_latency": { 2024-09-19T09:47:11.974 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:11.974 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:11.974 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:11.974 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.974 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rmxattr_latency": { 2024-09-19T09:47:11.974 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:11.974 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:11.974 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:11.974 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.974 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setattr_latency": { 2024-09-19T09:47:11.974 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 7, 2024-09-19T09:47:11.975 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.027058261, 2024-09-19T09:47:11.975 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.003865465 2024-09-19T09:47:11.975 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.975 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setdirlayout_latency": { 2024-09-19T09:47:11.975 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:11.975 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:11.975 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:11.975 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.975 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setfilelock_latency": { 2024-09-19T09:47:11.975 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 4, 2024-09-19T09:47:11.975 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000931143, 2024-09-19T09:47:11.975 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000232785 2024-09-19T09:47:11.976 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.976 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setlayout_latency": { 2024-09-19T09:47:11.976 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:11.976 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:11.976 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:11.976 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.976 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setxattr_latency": { 2024-09-19T09:47:11.977 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 7, 2024-09-19T09:47:11.977 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.017479077, 2024-09-19T09:47:11.977 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.002497011 2024-09-19T09:47:11.977 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.977 INFO:teuthology.orchestra.run.smithi022.stdout: "req_symlink_latency": { 2024-09-19T09:47:11.977 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 13, 2024-09-19T09:47:11.977 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.007974687, 2024-09-19T09:47:11.977 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000613437 2024-09-19T09:47:11.977 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.977 INFO:teuthology.orchestra.run.smithi022.stdout: "req_unlink_latency": { 2024-09-19T09:47:11.977 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 802, 2024-09-19T09:47:11.978 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 1.003947026, 2024-09-19T09:47:11.978 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.001251804 2024-09-19T09:47:11.978 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.978 INFO:teuthology.orchestra.run.smithi022.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:47:11.978 INFO:teuthology.orchestra.run.smithi022.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:47:11.978 INFO:teuthology.orchestra.run.smithi022.stdout: "req_getvxattr_latency": { 2024-09-19T09:47:11.978 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:11.978 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:11.978 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:11.978 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:47:11.978 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.978 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_sessions": { 2024-09-19T09:47:11.978 INFO:teuthology.orchestra.run.smithi022.stdout: "session_count": 1, 2024-09-19T09:47:11.978 INFO:teuthology.orchestra.run.smithi022.stdout: "session_add": 2, 2024-09-19T09:47:11.979 INFO:teuthology.orchestra.run.smithi022.stdout: "session_remove": 1, 2024-09-19T09:47:11.979 INFO:teuthology.orchestra.run.smithi022.stdout: "sessions_open": 1, 2024-09-19T09:47:11.979 INFO:teuthology.orchestra.run.smithi022.stdout: "sessions_stale": 0, 2024-09-19T09:47:11.979 INFO:teuthology.orchestra.run.smithi022.stdout: "total_load": 614, 2024-09-19T09:47:11.979 INFO:teuthology.orchestra.run.smithi022.stdout: "average_load": 614, 2024-09-19T09:47:11.979 INFO:teuthology.orchestra.run.smithi022.stdout: "avg_session_uptime": 546, 2024-09-19T09:47:11.979 INFO:teuthology.orchestra.run.smithi022.stdout: "mdthresh_evicted": 0 2024-09-19T09:47:11.979 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.979 INFO:teuthology.orchestra.run.smithi022.stdout: "mempool": { 2024-09-19T09:47:11.979 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:47:11.979 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_items": 0, 2024-09-19T09:47:11.979 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:47:11.979 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:47:11.980 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:47:11.980 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:47:11.980 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:47:11.980 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:47:11.980 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:47:11.980 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:47:11.980 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:47:11.980 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:47:11.980 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:47:11.980 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:47:11.980 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:47:11.980 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_items": 0, 2024-09-19T09:47:11.980 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:47:11.980 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_items": 0, 2024-09-19T09:47:11.981 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:47:11.981 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:47:11.981 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:47:11.981 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:47:11.981 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:47:11.981 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:47:11.981 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:47:11.981 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_items": 0, 2024-09-19T09:47:11.981 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:47:11.981 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:47:11.981 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:47:11.981 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_items": 0, 2024-09-19T09:47:11.981 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_bytes": 0, 2024-09-19T09:47:11.981 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_items": 0, 2024-09-19T09:47:11.982 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:47:11.982 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:47:11.982 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:47:11.982 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:47:11.982 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_bytes": 286508, 2024-09-19T09:47:11.982 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_items": 94, 2024-09-19T09:47:11.982 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:47:11.982 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_items": 0, 2024-09-19T09:47:11.982 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bytes": 0, 2024-09-19T09:47:11.982 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_items": 0, 2024-09-19T09:47:11.982 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:47:11.982 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_items": 0, 2024-09-19T09:47:11.982 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:47:11.982 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_items": 0, 2024-09-19T09:47:11.983 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_bytes": 7592, 2024-09-19T09:47:11.983 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_items": 156, 2024-09-19T09:47:11.983 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:47:11.983 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:47:11.983 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_bytes": 0, 2024-09-19T09:47:11.983 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_items": 0, 2024-09-19T09:47:11.983 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_bytes": 98778, 2024-09-19T09:47:11.983 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_items": 714, 2024-09-19T09:47:11.983 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_bytes": 0, 2024-09-19T09:47:11.983 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_items": 0, 2024-09-19T09:47:11.983 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_bytes": 0, 2024-09-19T09:47:11.983 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_items": 0 2024-09-19T09:47:11.983 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.983 INFO:teuthology.orchestra.run.smithi022.stdout: "objecter": { 2024-09-19T09:47:11.983 INFO:teuthology.orchestra.run.smithi022.stdout: "op_active": 0, 2024-09-19T09:47:11.984 INFO:teuthology.orchestra.run.smithi022.stdout: "op_laggy": 0, 2024-09-19T09:47:11.984 INFO:teuthology.orchestra.run.smithi022.stdout: "op_send": 10422, 2024-09-19T09:47:11.984 INFO:teuthology.orchestra.run.smithi022.stdout: "op_send_bytes": 68739160, 2024-09-19T09:47:11.984 INFO:teuthology.orchestra.run.smithi022.stdout: "op_resend": 37, 2024-09-19T09:47:11.984 INFO:teuthology.orchestra.run.smithi022.stdout: "op_reply": 10422, 2024-09-19T09:47:11.984 INFO:teuthology.orchestra.run.smithi022.stdout: "op_latency": { 2024-09-19T09:47:11.984 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 10422, 2024-09-19T09:47:11.984 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 1003.596203023, 2024-09-19T09:47:11.984 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.096295931 2024-09-19T09:47:11.984 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.984 INFO:teuthology.orchestra.run.smithi022.stdout: "op_inflight": 0, 2024-09-19T09:47:11.984 INFO:teuthology.orchestra.run.smithi022.stdout: "oplen_avg": { 2024-09-19T09:47:11.984 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 10422, 2024-09-19T09:47:11.984 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 12701 2024-09-19T09:47:11.985 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.985 INFO:teuthology.orchestra.run.smithi022.stdout: "op": 10422, 2024-09-19T09:47:11.985 INFO:teuthology.orchestra.run.smithi022.stdout: "op_r": 1575, 2024-09-19T09:47:11.985 INFO:teuthology.orchestra.run.smithi022.stdout: "op_w": 8847, 2024-09-19T09:47:11.985 INFO:teuthology.orchestra.run.smithi022.stdout: "op_rmw": 0, 2024-09-19T09:47:11.985 INFO:teuthology.orchestra.run.smithi022.stdout: "op_pg": 0, 2024-09-19T09:47:11.985 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_stat": 333, 2024-09-19T09:47:11.985 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_create": 590, 2024-09-19T09:47:11.985 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_read": 23, 2024-09-19T09:47:11.985 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_write": 2691, 2024-09-19T09:47:11.985 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_writefull": 125, 2024-09-19T09:47:11.985 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_writesame": 0, 2024-09-19T09:47:11.985 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_append": 0, 2024-09-19T09:47:11.985 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_zero": 0, 2024-09-19T09:47:11.986 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_truncate": 1, 2024-09-19T09:47:11.986 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_delete": 4702, 2024-09-19T09:47:11.986 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_mapext": 0, 2024-09-19T09:47:11.986 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_sparse_read": 0, 2024-09-19T09:47:11.986 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_clonerange": 0, 2024-09-19T09:47:11.986 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_getxattr": 1552, 2024-09-19T09:47:11.986 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_setxattr": 1182, 2024-09-19T09:47:11.986 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:47:11.986 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_rmxattr": 0, 2024-09-19T09:47:11.986 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:47:11.986 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_call": 0, 2024-09-19T09:47:11.986 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_watch": 0, 2024-09-19T09:47:11.986 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_notify": 0, 2024-09-19T09:47:11.986 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:47:11.986 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_pgls": 0, 2024-09-19T09:47:11.987 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:47:11.987 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_other": 6, 2024-09-19T09:47:11.987 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_active": 0, 2024-09-19T09:47:11.987 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_send": 0, 2024-09-19T09:47:11.987 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_resend": 0, 2024-09-19T09:47:11.987 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_ping": 0, 2024-09-19T09:47:11.987 INFO:teuthology.orchestra.run.smithi022.stdout: "poolop_active": 0, 2024-09-19T09:47:11.987 INFO:teuthology.orchestra.run.smithi022.stdout: "poolop_send": 0, 2024-09-19T09:47:11.987 INFO:teuthology.orchestra.run.smithi022.stdout: "poolop_resend": 0, 2024-09-19T09:47:11.987 INFO:teuthology.orchestra.run.smithi022.stdout: "poolstat_active": 0, 2024-09-19T09:47:11.987 INFO:teuthology.orchestra.run.smithi022.stdout: "poolstat_send": 0, 2024-09-19T09:47:11.987 INFO:teuthology.orchestra.run.smithi022.stdout: "poolstat_resend": 0, 2024-09-19T09:47:11.987 INFO:teuthology.orchestra.run.smithi022.stdout: "statfs_active": 0, 2024-09-19T09:47:11.987 INFO:teuthology.orchestra.run.smithi022.stdout: "statfs_send": 0, 2024-09-19T09:47:11.988 INFO:teuthology.orchestra.run.smithi022.stdout: "statfs_resend": 0, 2024-09-19T09:47:11.988 INFO:teuthology.orchestra.run.smithi022.stdout: "command_active": 0, 2024-09-19T09:47:11.988 INFO:teuthology.orchestra.run.smithi022.stdout: "command_send": 0, 2024-09-19T09:47:11.988 INFO:teuthology.orchestra.run.smithi022.stdout: "command_resend": 0, 2024-09-19T09:47:11.988 INFO:teuthology.orchestra.run.smithi022.stdout: "map_epoch": 84, 2024-09-19T09:47:11.988 INFO:teuthology.orchestra.run.smithi022.stdout: "map_full": 0, 2024-09-19T09:47:11.988 INFO:teuthology.orchestra.run.smithi022.stdout: "map_inc": 3, 2024-09-19T09:47:11.988 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_sessions": 12, 2024-09-19T09:47:11.988 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_session_open": 12, 2024-09-19T09:47:11.988 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_session_close": 0, 2024-09-19T09:47:11.988 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_laggy": 0, 2024-09-19T09:47:11.988 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_wr": 1263, 2024-09-19T09:47:11.988 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_rd": 0, 2024-09-19T09:47:11.988 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_del": 233 2024-09-19T09:47:11.989 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.989 INFO:teuthology.orchestra.run.smithi022.stdout: "oft": { 2024-09-19T09:47:11.989 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_objs": 1, 2024-09-19T09:47:11.989 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:47:11.989 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_updates": 0, 2024-09-19T09:47:11.989 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_removes": 0 2024-09-19T09:47:11.989 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.989 INFO:teuthology.orchestra.run.smithi022.stdout: "osd-slow-ops": { 2024-09-19T09:47:11.989 INFO:teuthology.orchestra.run.smithi022.stdout: "slow_ops_count": 1516 2024-09-19T09:47:11.989 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.989 INFO:teuthology.orchestra.run.smithi022.stdout: "purge_queue": { 2024-09-19T09:47:11.989 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing_ops": 0, 2024-09-19T09:47:11.989 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing_ops_high_water": 76, 2024-09-19T09:47:11.989 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing": 0, 2024-09-19T09:47:11.990 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing_high_water": 32, 2024-09-19T09:47:11.990 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executed_ops": 4160, 2024-09-19T09:47:11.990 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executed": 872, 2024-09-19T09:47:11.990 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_item_in_journal": 0 2024-09-19T09:47:11.990 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.990 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:47:11.990 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-19T09:47:11.990 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-19T09:47:11.990 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-19T09:47:11.990 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 42967, 2024-09-19T09:47:11.990 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 11202575, 2024-09-19T09:47:11.990 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-19T09:47:11.990 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 42967, 2024-09-19T09:47:11.990 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-19T09:47:11.990 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-19T09:47:11.991 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 42967, 2024-09-19T09:47:11.991 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 11202575, 2024-09-19T09:47:11.991 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-19T09:47:11.991 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:11.991 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:11.991 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:11.991 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:47:11.991 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.991 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-objecter_bytes": { 2024-09-19T09:47:11.991 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-19T09:47:11.991 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-19T09:47:11.991 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-19T09:47:11.991 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-19T09:47:11.991 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-19T09:47:11.992 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-19T09:47:11.992 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-19T09:47:11.992 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 10422, 2024-09-19T09:47:11.992 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 68827240, 2024-09-19T09:47:11.992 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 10422, 2024-09-19T09:47:11.992 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 68827240, 2024-09-19T09:47:11.992 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-19T09:47:11.992 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:11.992 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:11.992 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:11.992 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:47:11.992 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.992 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-objecter_ops": { 2024-09-19T09:47:11.992 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-19T09:47:11.993 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 1024, 2024-09-19T09:47:11.993 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-19T09:47:11.993 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-19T09:47:11.993 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-19T09:47:11.993 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-19T09:47:11.993 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-19T09:47:11.993 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 10422, 2024-09-19T09:47:11.993 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 10422, 2024-09-19T09:47:11.993 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 10422, 2024-09-19T09:47:11.993 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 10422, 2024-09-19T09:47:11.993 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-19T09:47:11.993 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:11.993 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:11.993 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:11.994 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:47:11.994 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.994 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:47:11.994 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-19T09:47:11.994 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 3758096384, 2024-09-19T09:47:11.994 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-19T09:47:11.994 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 872, 2024-09-19T09:47:11.994 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 88080, 2024-09-19T09:47:11.994 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-19T09:47:11.994 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 872, 2024-09-19T09:47:11.994 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-19T09:47:11.994 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-19T09:47:11.994 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 16, 2024-09-19T09:47:11.994 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 88080, 2024-09-19T09:47:11.995 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-19T09:47:11.995 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:11.995 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:11.995 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:11.995 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:47:11.995 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:11.995 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-write_buf_throttle-0x5600e5d2a500": { 2024-09-19T09:47:11.995 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-19T09:47:11.995 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 3758096384, 2024-09-19T09:47:11.995 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-19T09:47:11.995 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 30694, 2024-09-19T09:47:11.995 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 66220937, 2024-09-19T09:47:11.995 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-19T09:47:11.995 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 30694, 2024-09-19T09:47:11.996 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-19T09:47:11.996 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-19T09:47:11.996 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 2675, 2024-09-19T09:47:11.996 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 66220937, 2024-09-19T09:47:11.996 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-19T09:47:11.996 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:11.996 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:11.996 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:11.996 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:47:11.996 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:47:11.996 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-19T09:47:12.496 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:12 smithi022 ceph-mon[35583]: pgmap v612: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:47:12.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:12 smithi001 ceph-mon[31225]: pgmap v612: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:47:12.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:12 smithi121 ceph-mon[35577]: pgmap v612: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:47:12.866 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=1 2024-09-19T09:47:12.866 DEBUG:tasks.check_counter:Getting stats from e 2024-09-19T09:47:12.866 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-19T09:47:13.118 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:47:13.754 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-19T09:47:13.754 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:47:13.754 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 0, 2024-09-19T09:47:13.754 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 2, 2024-09-19T09:47:13.754 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 0, 2024-09-19T09:47:13.755 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 0, 2024-09-19T09:47:13.755 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 4, 2024-09-19T09:47:13.755 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 0, 2024-09-19T09:47:13.755 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.001201091, 2024-09-19T09:47:13.755 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T09:47:13.755 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.000289025, 2024-09-19T09:47:13.755 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:47:13.755 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:13.755 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:13.755 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:13.755 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:13.755 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:13.755 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:13.756 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:13.756 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:13.756 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:13.756 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:13.756 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:47:13.756 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:47:13.756 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:13.756 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:47:13.756 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 1, 2024-09-19T09:47:13.756 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 141, 2024-09-19T09:47:13.756 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 160, 2024-09-19T09:47:13.756 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 103296, 2024-09-19T09:47:13.756 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 3, 2024-09-19T09:47:13.757 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 2, 2024-09-19T09:47:13.757 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.008809324, 2024-09-19T09:47:13.757 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.006444844, 2024-09-19T09:47:13.757 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.000787216, 2024-09-19T09:47:13.757 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:47:13.757 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:13.757 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 139, 2024-09-19T09:47:13.757 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.006792460, 2024-09-19T09:47:13.757 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000048866 2024-09-19T09:47:13.757 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:13.757 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:13.757 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:13.758 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:13.758 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:13.758 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:13.758 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:47:13.758 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 103296 2024-09-19T09:47:13.758 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:13.758 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:47:13.758 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 193, 2024-09-19T09:47:13.758 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 188, 2024-09-19T09:47:13.758 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 473968, 2024-09-19T09:47:13.758 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 114576, 2024-09-19T09:47:13.758 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 2, 2024-09-19T09:47:13.758 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 1, 2024-09-19T09:47:13.758 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.028872561, 2024-09-19T09:47:13.758 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.011848230, 2024-09-19T09:47:13.759 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.022359018, 2024-09-19T09:47:13.759 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:47:13.759 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:13.759 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 188, 2024-09-19T09:47:13.759 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.013879979, 2024-09-19T09:47:13.759 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000073829 2024-09-19T09:47:13.759 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:13.759 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:13.759 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:13.759 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:13.759 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:13.759 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:13.759 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 473968, 2024-09-19T09:47:13.759 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 114576 2024-09-19T09:47:13.759 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:13.760 INFO:teuthology.orchestra.run.smithi022.stdout: "cct": { 2024-09-19T09:47:13.760 INFO:teuthology.orchestra.run.smithi022.stdout: "total_workers": 0, 2024-09-19T09:47:13.760 INFO:teuthology.orchestra.run.smithi022.stdout: "unhealthy_workers": 0 2024-09-19T09:47:13.760 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:13.760 INFO:teuthology.orchestra.run.smithi022.stdout: "mempool": { 2024-09-19T09:47:13.760 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:47:13.760 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_items": 0, 2024-09-19T09:47:13.760 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:47:13.760 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:47:13.760 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:47:13.760 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:47:13.760 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:47:13.760 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:47:13.760 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:47:13.760 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:47:13.761 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:47:13.761 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:47:13.761 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:47:13.761 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:47:13.761 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:47:13.761 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_items": 0, 2024-09-19T09:47:13.761 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:47:13.761 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_items": 0, 2024-09-19T09:47:13.761 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:47:13.761 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:47:13.761 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:47:13.761 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:47:13.761 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:47:13.762 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:47:13.762 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:47:13.762 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_items": 0, 2024-09-19T09:47:13.762 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:47:13.762 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:47:13.762 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:47:13.762 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_items": 0, 2024-09-19T09:47:13.762 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_bytes": 0, 2024-09-19T09:47:13.762 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_items": 0, 2024-09-19T09:47:13.762 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:47:13.762 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:47:13.762 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:47:13.762 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:47:13.762 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_bytes": 148984, 2024-09-19T09:47:13.763 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_items": 30, 2024-09-19T09:47:13.763 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:47:13.763 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_items": 0, 2024-09-19T09:47:13.763 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bytes": 0, 2024-09-19T09:47:13.763 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_items": 0, 2024-09-19T09:47:13.763 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:47:13.763 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_items": 0, 2024-09-19T09:47:13.763 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:47:13.763 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_items": 0, 2024-09-19T09:47:13.763 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_bytes": 0, 2024-09-19T09:47:13.763 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_items": 0, 2024-09-19T09:47:13.763 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:47:13.763 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:47:13.763 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_bytes": 0, 2024-09-19T09:47:13.763 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_items": 0, 2024-09-19T09:47:13.764 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_bytes": 928, 2024-09-19T09:47:13.764 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_items": 2, 2024-09-19T09:47:13.764 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_bytes": 0, 2024-09-19T09:47:13.764 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_items": 0, 2024-09-19T09:47:13.764 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_bytes": 0, 2024-09-19T09:47:13.764 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_items": 0 2024-09-19T09:47:13.764 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:13.764 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:47:13.764 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-19T09:47:13.764 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-19T09:47:13.764 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-19T09:47:13.764 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 190, 2024-09-19T09:47:13.764 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 444250, 2024-09-19T09:47:13.765 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-19T09:47:13.765 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 190, 2024-09-19T09:47:13.765 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-19T09:47:13.765 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-19T09:47:13.765 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 190, 2024-09-19T09:47:13.765 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 444250, 2024-09-19T09:47:13.765 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-19T09:47:13.765 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:13.765 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:13.765 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:13.765 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:47:13.766 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:47:13.766 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-19T09:47:14.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:14 smithi022 ceph-mon[35583]: pgmap v613: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:47:14.445 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.e 2024-09-19T09:47:14.445 DEBUG:tasks.check_counter:Getting stats from h 2024-09-19T09:47:14.445 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-19T09:47:14.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:14 smithi001 ceph-mon[31225]: pgmap v613: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:47:14.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:14 smithi121 ceph-mon[35577]: pgmap v613: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:47:14.702 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:47:15.252 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-19T09:47:15.252 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:47:15.252 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 211, 2024-09-19T09:47:15.252 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 213, 2024-09-19T09:47:15.252 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 63597, 2024-09-19T09:47:15.252 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 67108, 2024-09-19T09:47:15.253 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 7, 2024-09-19T09:47:15.253 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 3, 2024-09-19T09:47:15.253 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.021909243, 2024-09-19T09:47:15.253 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.007025649, 2024-09-19T09:47:15.253 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.006053963, 2024-09-19T09:47:15.253 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.006394219, 2024-09-19T09:47:15.253 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:15.253 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 211, 2024-09-19T09:47:15.253 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.023819211, 2024-09-19T09:47:15.253 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000112887 2024-09-19T09:47:15.253 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.253 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:15.253 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.253 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.254 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.254 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.254 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:47:15.254 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:47:15.254 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.254 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:47:15.254 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 57, 2024-09-19T09:47:15.254 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 196, 2024-09-19T09:47:15.254 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 4222738, 2024-09-19T09:47:15.254 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 177129, 2024-09-19T09:47:15.254 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 5, 2024-09-19T09:47:15.254 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 4, 2024-09-19T09:47:15.254 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.015912366, 2024-09-19T09:47:15.254 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.007386394, 2024-09-19T09:47:15.255 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.005105198, 2024-09-19T09:47:15.255 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.001582566, 2024-09-19T09:47:15.255 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:15.255 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 194, 2024-09-19T09:47:15.255 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.046642815, 2024-09-19T09:47:15.255 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000240426 2024-09-19T09:47:15.255 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.255 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:15.255 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.255 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.255 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.255 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.255 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:47:15.256 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 159264 2024-09-19T09:47:15.256 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.256 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:47:15.256 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 343, 2024-09-19T09:47:15.256 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 338, 2024-09-19T09:47:15.256 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 3828854, 2024-09-19T09:47:15.256 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 160726, 2024-09-19T09:47:15.256 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 4, 2024-09-19T09:47:15.256 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 3, 2024-09-19T09:47:15.256 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.048585569, 2024-09-19T09:47:15.256 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.015256062, 2024-09-19T09:47:15.256 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.033317253, 2024-09-19T09:47:15.256 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.004010134, 2024-09-19T09:47:15.256 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:15.257 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 338, 2024-09-19T09:47:15.257 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.043481327, 2024-09-19T09:47:15.257 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000128642 2024-09-19T09:47:15.257 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.257 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:15.257 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.257 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.257 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.257 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.257 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 484384, 2024-09-19T09:47:15.257 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 114288 2024-09-19T09:47:15.257 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.257 INFO:teuthology.orchestra.run.smithi022.stdout: "cct": { 2024-09-19T09:47:15.257 INFO:teuthology.orchestra.run.smithi022.stdout: "total_workers": 1, 2024-09-19T09:47:15.258 INFO:teuthology.orchestra.run.smithi022.stdout: "unhealthy_workers": 0 2024-09-19T09:47:15.258 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.258 INFO:teuthology.orchestra.run.smithi022.stdout: "finisher-MDSRank": { 2024-09-19T09:47:15.258 INFO:teuthology.orchestra.run.smithi022.stdout: "queue_len": 0, 2024-09-19T09:47:15.258 INFO:teuthology.orchestra.run.smithi022.stdout: "complete_latency": { 2024-09-19T09:47:15.258 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 686, 2024-09-19T09:47:15.258 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.020888560, 2024-09-19T09:47:15.258 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000030449 2024-09-19T09:47:15.258 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:47:15.258 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.258 INFO:teuthology.orchestra.run.smithi022.stdout: "finisher-PurgeQueue": { 2024-09-19T09:47:15.258 INFO:teuthology.orchestra.run.smithi022.stdout: "queue_len": 0, 2024-09-19T09:47:15.258 INFO:teuthology.orchestra.run.smithi022.stdout: "complete_latency": { 2024-09-19T09:47:15.258 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.259 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.259 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.259 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:47:15.259 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.259 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": { 2024-09-19T09:47:15.259 INFO:teuthology.orchestra.run.smithi022.stdout: "request": 0, 2024-09-19T09:47:15.259 INFO:teuthology.orchestra.run.smithi022.stdout: "reply": 0, 2024-09-19T09:47:15.259 INFO:teuthology.orchestra.run.smithi022.stdout: "reply_latency": { 2024-09-19T09:47:15.259 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.259 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.259 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.259 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.259 INFO:teuthology.orchestra.run.smithi022.stdout: "slow_reply": 0, 2024-09-19T09:47:15.259 INFO:teuthology.orchestra.run.smithi022.stdout: "forward": 0, 2024-09-19T09:47:15.260 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_fetch_complete": 0, 2024-09-19T09:47:15.260 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_fetch_keys": 0, 2024-09-19T09:47:15.260 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_commit": 0, 2024-09-19T09:47:15.260 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_split": 0, 2024-09-19T09:47:15.260 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_merge": 0, 2024-09-19T09:47:15.260 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes": 411, 2024-09-19T09:47:15.260 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_top": 0, 2024-09-19T09:47:15.260 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_bottom": 411, 2024-09-19T09:47:15.260 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_pin_tail": 0, 2024-09-19T09:47:15.260 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_pinned": 411, 2024-09-19T09:47:15.260 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_expired": 0, 2024-09-19T09:47:15.260 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_with_caps": 0, 2024-09-19T09:47:15.260 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": 0, 2024-09-19T09:47:15.260 INFO:teuthology.orchestra.run.smithi022.stdout: "subtrees": 2, 2024-09-19T09:47:15.261 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse": 0, 2024-09-19T09:47:15.261 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_hit": 0, 2024-09-19T09:47:15.261 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_forward": 0, 2024-09-19T09:47:15.261 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_discover": 0, 2024-09-19T09:47:15.261 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:47:15.261 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_remote_ino": 0, 2024-09-19T09:47:15.261 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_lock": 0, 2024-09-19T09:47:15.261 INFO:teuthology.orchestra.run.smithi022.stdout: "load_cent": 0, 2024-09-19T09:47:15.261 INFO:teuthology.orchestra.run.smithi022.stdout: "q": 0, 2024-09-19T09:47:15.261 INFO:teuthology.orchestra.run.smithi022.stdout: "exported": 0, 2024-09-19T09:47:15.261 INFO:teuthology.orchestra.run.smithi022.stdout: "exported_inodes": 0, 2024-09-19T09:47:15.261 INFO:teuthology.orchestra.run.smithi022.stdout: "imported": 0, 2024-09-19T09:47:15.261 INFO:teuthology.orchestra.run.smithi022.stdout: "imported_inodes": 0, 2024-09-19T09:47:15.261 INFO:teuthology.orchestra.run.smithi022.stdout: "openino_dir_fetch": 0, 2024-09-19T09:47:15.262 INFO:teuthology.orchestra.run.smithi022.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:47:15.262 INFO:teuthology.orchestra.run.smithi022.stdout: "openino_peer_discover": 0, 2024-09-19T09:47:15.262 INFO:teuthology.orchestra.run.smithi022.stdout: "root_rfiles": 4, 2024-09-19T09:47:15.262 INFO:teuthology.orchestra.run.smithi022.stdout: "root_rbytes": 234, 2024-09-19T09:47:15.262 INFO:teuthology.orchestra.run.smithi022.stdout: "root_rsnaps": 0, 2024-09-19T09:47:15.262 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:47:15.262 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_set_tag": 0, 2024-09-19T09:47:15.262 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:47:15.262 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:47:15.262 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:47:15.262 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:47:15.262 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:47:15.262 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_file_inodes": 0, 2024-09-19T09:47:15.262 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:47:15.263 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T09:47:15.263 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_grant": 0, 2024-09-19T09:47:15.263 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:47:15.263 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:47:15.263 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:47:15.263 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_caps": 0, 2024-09-19T09:47:15.263 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:47:15.263 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_cap_release": 0, 2024-09-19T09:47:15.263 INFO:teuthology.orchestra.run.smithi022.stdout: "process_request_cap_release": 0 2024-09-19T09:47:15.263 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.263 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_cache": { 2024-09-19T09:47:15.263 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_update": 0, 2024-09-19T09:47:15.263 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_update_receipt": 0, 2024-09-19T09:47:15.263 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_try_discover": 0, 2024-09-19T09:47:15.264 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_send_discover": 0, 2024-09-19T09:47:15.264 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_handle_discover": 0, 2024-09-19T09:47:15.264 INFO:teuthology.orchestra.run.smithi022.stdout: "num_strays": 0, 2024-09-19T09:47:15.264 INFO:teuthology.orchestra.run.smithi022.stdout: "num_strays_delayed": 0, 2024-09-19T09:47:15.264 INFO:teuthology.orchestra.run.smithi022.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:47:15.264 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_created": 0, 2024-09-19T09:47:15.264 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_enqueued": 0, 2024-09-19T09:47:15.264 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_reintegrated": 0, 2024-09-19T09:47:15.264 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_migrated": 0, 2024-09-19T09:47:15.264 INFO:teuthology.orchestra.run.smithi022.stdout: "num_recovering_processing": 0, 2024-09-19T09:47:15.264 INFO:teuthology.orchestra.run.smithi022.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:47:15.264 INFO:teuthology.orchestra.run.smithi022.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:47:15.264 INFO:teuthology.orchestra.run.smithi022.stdout: "recovery_started": 0, 2024-09-19T09:47:15.264 INFO:teuthology.orchestra.run.smithi022.stdout: "recovery_completed": 0, 2024-09-19T09:47:15.264 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:47:15.265 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:47:15.265 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:47:15.265 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_exportdir": 0, 2024-09-19T09:47:15.265 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_flush": 0, 2024-09-19T09:47:15.265 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:47:15.265 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_fragstats": 0, 2024-09-19T09:47:15.265 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_inodestats": 0 2024-09-19T09:47:15.265 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.265 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_log": { 2024-09-19T09:47:15.265 INFO:teuthology.orchestra.run.smithi022.stdout: "evlrg": 0, 2024-09-19T09:47:15.265 INFO:teuthology.orchestra.run.smithi022.stdout: "evadd": 0, 2024-09-19T09:47:15.265 INFO:teuthology.orchestra.run.smithi022.stdout: "evex": 0, 2024-09-19T09:47:15.265 INFO:teuthology.orchestra.run.smithi022.stdout: "evtrm": 0, 2024-09-19T09:47:15.265 INFO:teuthology.orchestra.run.smithi022.stdout: "ev": 3451, 2024-09-19T09:47:15.266 INFO:teuthology.orchestra.run.smithi022.stdout: "evexg": 0, 2024-09-19T09:47:15.266 INFO:teuthology.orchestra.run.smithi022.stdout: "evexd": 0, 2024-09-19T09:47:15.266 INFO:teuthology.orchestra.run.smithi022.stdout: "segadd": 0, 2024-09-19T09:47:15.266 INFO:teuthology.orchestra.run.smithi022.stdout: "segex": 0, 2024-09-19T09:47:15.266 INFO:teuthology.orchestra.run.smithi022.stdout: "segtrm": 0, 2024-09-19T09:47:15.266 INFO:teuthology.orchestra.run.smithi022.stdout: "seg": 2, 2024-09-19T09:47:15.266 INFO:teuthology.orchestra.run.smithi022.stdout: "segmjr": 7, 2024-09-19T09:47:15.266 INFO:teuthology.orchestra.run.smithi022.stdout: "segexg": 0, 2024-09-19T09:47:15.266 INFO:teuthology.orchestra.run.smithi022.stdout: "segexd": 0, 2024-09-19T09:47:15.266 INFO:teuthology.orchestra.run.smithi022.stdout: "expos": 68659195, 2024-09-19T09:47:15.266 INFO:teuthology.orchestra.run.smithi022.stdout: "wrpos": 70415241, 2024-09-19T09:47:15.266 INFO:teuthology.orchestra.run.smithi022.stdout: "rdpos": 70411483, 2024-09-19T09:47:15.266 INFO:teuthology.orchestra.run.smithi022.stdout: "jlat": { 2024-09-19T09:47:15.266 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.266 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.267 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.267 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.267 INFO:teuthology.orchestra.run.smithi022.stdout: "replayed": 3451 2024-09-19T09:47:15.267 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.267 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_mem": { 2024-09-19T09:47:15.267 INFO:teuthology.orchestra.run.smithi022.stdout: "ino": 9, 2024-09-19T09:47:15.267 INFO:teuthology.orchestra.run.smithi022.stdout: "ino+": 412, 2024-09-19T09:47:15.267 INFO:teuthology.orchestra.run.smithi022.stdout: "ino-": 403, 2024-09-19T09:47:15.267 INFO:teuthology.orchestra.run.smithi022.stdout: "dir": 8, 2024-09-19T09:47:15.267 INFO:teuthology.orchestra.run.smithi022.stdout: "dir+": 92, 2024-09-19T09:47:15.267 INFO:teuthology.orchestra.run.smithi022.stdout: "dir-": 84, 2024-09-19T09:47:15.267 INFO:teuthology.orchestra.run.smithi022.stdout: "dn": 411, 2024-09-19T09:47:15.267 INFO:teuthology.orchestra.run.smithi022.stdout: "dn+": 813, 2024-09-19T09:47:15.267 INFO:teuthology.orchestra.run.smithi022.stdout: "dn-": 402, 2024-09-19T09:47:15.268 INFO:teuthology.orchestra.run.smithi022.stdout: "cap": 0, 2024-09-19T09:47:15.268 INFO:teuthology.orchestra.run.smithi022.stdout: "cap+": 0, 2024-09-19T09:47:15.268 INFO:teuthology.orchestra.run.smithi022.stdout: "cap-": 0, 2024-09-19T09:47:15.268 INFO:teuthology.orchestra.run.smithi022.stdout: "rss": 51908, 2024-09-19T09:47:15.268 INFO:teuthology.orchestra.run.smithi022.stdout: "heap": 215328 2024-09-19T09:47:15.268 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.268 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_server": { 2024-09-19T09:47:15.268 INFO:teuthology.orchestra.run.smithi022.stdout: "dispatch_client_request": 0, 2024-09-19T09:47:15.268 INFO:teuthology.orchestra.run.smithi022.stdout: "dispatch_server_request": 0, 2024-09-19T09:47:15.268 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_request": 0, 2024-09-19T09:47:15.268 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_session": 0, 2024-09-19T09:47:15.268 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_peer_request": 0, 2024-09-19T09:47:15.268 INFO:teuthology.orchestra.run.smithi022.stdout: "req_create_latency": { 2024-09-19T09:47:15.268 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.269 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.269 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.269 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.269 INFO:teuthology.orchestra.run.smithi022.stdout: "req_getattr_latency": { 2024-09-19T09:47:15.269 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.269 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.269 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.269 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.269 INFO:teuthology.orchestra.run.smithi022.stdout: "req_getfilelock_latency": { 2024-09-19T09:47:15.269 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.269 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.269 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.269 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.269 INFO:teuthology.orchestra.run.smithi022.stdout: "req_link_latency": { 2024-09-19T09:47:15.269 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.270 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.270 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.270 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.270 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookup_latency": { 2024-09-19T09:47:15.270 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.270 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.270 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.270 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.270 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookuphash_latency": { 2024-09-19T09:47:15.270 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.270 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.270 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.270 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.270 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupino_latency": { 2024-09-19T09:47:15.271 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.271 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.271 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.271 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.271 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupname_latency": { 2024-09-19T09:47:15.271 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.271 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.271 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.271 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.271 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupparent_latency": { 2024-09-19T09:47:15.271 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.271 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.271 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.271 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.272 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupsnap_latency": { 2024-09-19T09:47:15.272 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.272 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.272 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.272 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.272 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lssnap_latency": { 2024-09-19T09:47:15.272 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.272 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.272 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.272 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.272 INFO:teuthology.orchestra.run.smithi022.stdout: "req_mkdir_latency": { 2024-09-19T09:47:15.273 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.273 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.273 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.273 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.273 INFO:teuthology.orchestra.run.smithi022.stdout: "req_mknod_latency": { 2024-09-19T09:47:15.273 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.273 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.273 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.273 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.274 INFO:teuthology.orchestra.run.smithi022.stdout: "req_mksnap_latency": { 2024-09-19T09:47:15.274 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.274 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.274 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.274 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.274 INFO:teuthology.orchestra.run.smithi022.stdout: "req_open_latency": { 2024-09-19T09:47:15.274 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.274 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.274 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.274 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.274 INFO:teuthology.orchestra.run.smithi022.stdout: "req_readdir_latency": { 2024-09-19T09:47:15.274 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.274 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.274 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.275 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.275 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rename_latency": { 2024-09-19T09:47:15.275 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.275 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.275 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.275 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.275 INFO:teuthology.orchestra.run.smithi022.stdout: "req_renamesnap_latency": { 2024-09-19T09:47:15.275 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.275 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.275 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.275 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.275 INFO:teuthology.orchestra.run.smithi022.stdout: "req_snapdiff_latency": { 2024-09-19T09:47:15.275 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.275 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.275 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.276 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.276 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rmdir_latency": { 2024-09-19T09:47:15.276 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.276 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.276 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.276 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.276 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rmsnap_latency": { 2024-09-19T09:47:15.276 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.276 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.276 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.276 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.276 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rmxattr_latency": { 2024-09-19T09:47:15.276 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.276 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.277 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.277 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.277 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setattr_latency": { 2024-09-19T09:47:15.277 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.277 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.277 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.277 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.277 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setdirlayout_latency": { 2024-09-19T09:47:15.277 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.277 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.277 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.277 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.277 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setfilelock_latency": { 2024-09-19T09:47:15.278 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.278 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.278 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.278 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.278 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setlayout_latency": { 2024-09-19T09:47:15.278 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.278 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.278 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.278 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.278 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setxattr_latency": { 2024-09-19T09:47:15.278 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.278 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.278 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.278 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.279 INFO:teuthology.orchestra.run.smithi022.stdout: "req_symlink_latency": { 2024-09-19T09:47:15.279 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.279 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.279 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.279 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.279 INFO:teuthology.orchestra.run.smithi022.stdout: "req_unlink_latency": { 2024-09-19T09:47:15.279 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.279 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.279 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.279 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.279 INFO:teuthology.orchestra.run.smithi022.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:47:15.279 INFO:teuthology.orchestra.run.smithi022.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:47:15.279 INFO:teuthology.orchestra.run.smithi022.stdout: "req_getvxattr_latency": { 2024-09-19T09:47:15.279 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.280 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.280 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.280 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:47:15.280 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.280 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_sessions": { 2024-09-19T09:47:15.280 INFO:teuthology.orchestra.run.smithi022.stdout: "session_count": 1, 2024-09-19T09:47:15.280 INFO:teuthology.orchestra.run.smithi022.stdout: "session_add": 1, 2024-09-19T09:47:15.280 INFO:teuthology.orchestra.run.smithi022.stdout: "session_remove": 0, 2024-09-19T09:47:15.280 INFO:teuthology.orchestra.run.smithi022.stdout: "sessions_open": 0, 2024-09-19T09:47:15.281 INFO:teuthology.orchestra.run.smithi022.stdout: "sessions_stale": 0, 2024-09-19T09:47:15.281 INFO:teuthology.orchestra.run.smithi022.stdout: "total_load": 0, 2024-09-19T09:47:15.281 INFO:teuthology.orchestra.run.smithi022.stdout: "average_load": 0, 2024-09-19T09:47:15.281 INFO:teuthology.orchestra.run.smithi022.stdout: "avg_session_uptime": 1808, 2024-09-19T09:47:15.281 INFO:teuthology.orchestra.run.smithi022.stdout: "mdthresh_evicted": 0 2024-09-19T09:47:15.281 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.281 INFO:teuthology.orchestra.run.smithi022.stdout: "mempool": { 2024-09-19T09:47:15.281 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:47:15.281 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_items": 0, 2024-09-19T09:47:15.281 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:47:15.281 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:47:15.281 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:47:15.281 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:47:15.281 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:47:15.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:47:15.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:47:15.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:47:15.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:47:15.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:47:15.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:47:15.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:47:15.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:47:15.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_items": 0, 2024-09-19T09:47:15.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:47:15.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_items": 0, 2024-09-19T09:47:15.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:47:15.283 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:47:15.283 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:47:15.283 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:47:15.283 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:47:15.283 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:47:15.283 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:47:15.283 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_items": 0, 2024-09-19T09:47:15.283 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:47:15.283 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:47:15.284 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:47:15.284 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_items": 0, 2024-09-19T09:47:15.284 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_bytes": 0, 2024-09-19T09:47:15.284 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_items": 0, 2024-09-19T09:47:15.284 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:47:15.284 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:47:15.284 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:47:15.284 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:47:15.284 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_bytes": 206388, 2024-09-19T09:47:15.284 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_items": 61, 2024-09-19T09:47:15.284 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:47:15.284 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_items": 0, 2024-09-19T09:47:15.284 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bytes": 0, 2024-09-19T09:47:15.285 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_items": 0, 2024-09-19T09:47:15.285 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:47:15.285 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_items": 0, 2024-09-19T09:47:15.285 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:47:15.285 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_items": 0, 2024-09-19T09:47:15.285 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_bytes": 7592, 2024-09-19T09:47:15.285 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_items": 156, 2024-09-19T09:47:15.285 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:47:15.285 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:47:15.285 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_bytes": 0, 2024-09-19T09:47:15.285 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_items": 0, 2024-09-19T09:47:15.285 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_bytes": 320613, 2024-09-19T09:47:15.285 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_items": 1848, 2024-09-19T09:47:15.286 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_bytes": 0, 2024-09-19T09:47:15.286 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_items": 0, 2024-09-19T09:47:15.286 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_bytes": 0, 2024-09-19T09:47:15.286 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_items": 0 2024-09-19T09:47:15.286 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.286 INFO:teuthology.orchestra.run.smithi022.stdout: "objecter": { 2024-09-19T09:47:15.286 INFO:teuthology.orchestra.run.smithi022.stdout: "op_active": 0, 2024-09-19T09:47:15.286 INFO:teuthology.orchestra.run.smithi022.stdout: "op_laggy": 0, 2024-09-19T09:47:15.286 INFO:teuthology.orchestra.run.smithi022.stdout: "op_send": 413, 2024-09-19T09:47:15.286 INFO:teuthology.orchestra.run.smithi022.stdout: "op_send_bytes": 26, 2024-09-19T09:47:15.286 INFO:teuthology.orchestra.run.smithi022.stdout: "op_resend": 4, 2024-09-19T09:47:15.286 INFO:teuthology.orchestra.run.smithi022.stdout: "op_reply": 413, 2024-09-19T09:47:15.286 INFO:teuthology.orchestra.run.smithi022.stdout: "op_latency": { 2024-09-19T09:47:15.286 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 413, 2024-09-19T09:47:15.287 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 24.156693508, 2024-09-19T09:47:15.287 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.058490783 2024-09-19T09:47:15.287 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.287 INFO:teuthology.orchestra.run.smithi022.stdout: "op_inflight": 0, 2024-09-19T09:47:15.287 INFO:teuthology.orchestra.run.smithi022.stdout: "oplen_avg": { 2024-09-19T09:47:15.287 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 413, 2024-09-19T09:47:15.287 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 414 2024-09-19T09:47:15.287 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.287 INFO:teuthology.orchestra.run.smithi022.stdout: "op": 413, 2024-09-19T09:47:15.287 INFO:teuthology.orchestra.run.smithi022.stdout: "op_r": 413, 2024-09-19T09:47:15.287 INFO:teuthology.orchestra.run.smithi022.stdout: "op_w": 0, 2024-09-19T09:47:15.287 INFO:teuthology.orchestra.run.smithi022.stdout: "op_rmw": 0, 2024-09-19T09:47:15.287 INFO:teuthology.orchestra.run.smithi022.stdout: "op_pg": 0, 2024-09-19T09:47:15.287 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_stat": 246, 2024-09-19T09:47:15.287 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_create": 0, 2024-09-19T09:47:15.287 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_read": 164, 2024-09-19T09:47:15.288 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_write": 0, 2024-09-19T09:47:15.288 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_writefull": 0, 2024-09-19T09:47:15.288 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_writesame": 0, 2024-09-19T09:47:15.288 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_append": 0, 2024-09-19T09:47:15.288 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_zero": 0, 2024-09-19T09:47:15.288 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_truncate": 0, 2024-09-19T09:47:15.288 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_delete": 0, 2024-09-19T09:47:15.288 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_mapext": 0, 2024-09-19T09:47:15.288 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_sparse_read": 0, 2024-09-19T09:47:15.288 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_clonerange": 0, 2024-09-19T09:47:15.288 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_getxattr": 2, 2024-09-19T09:47:15.288 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_setxattr": 0, 2024-09-19T09:47:15.288 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:47:15.289 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_rmxattr": 0, 2024-09-19T09:47:15.289 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:47:15.289 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_call": 0, 2024-09-19T09:47:15.289 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_watch": 0, 2024-09-19T09:47:15.289 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_notify": 0, 2024-09-19T09:47:15.289 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:47:15.289 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_pgls": 0, 2024-09-19T09:47:15.289 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:47:15.289 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_other": 0, 2024-09-19T09:47:15.289 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_active": 0, 2024-09-19T09:47:15.289 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_send": 0, 2024-09-19T09:47:15.289 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_resend": 0, 2024-09-19T09:47:15.289 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_ping": 0, 2024-09-19T09:47:15.293 INFO:teuthology.orchestra.run.smithi022.stdout: "poolop_active": 0, 2024-09-19T09:47:15.293 INFO:teuthology.orchestra.run.smithi022.stdout: "poolop_send": 0, 2024-09-19T09:47:15.293 INFO:teuthology.orchestra.run.smithi022.stdout: "poolop_resend": 0, 2024-09-19T09:47:15.293 INFO:teuthology.orchestra.run.smithi022.stdout: "poolstat_active": 0, 2024-09-19T09:47:15.293 INFO:teuthology.orchestra.run.smithi022.stdout: "poolstat_send": 0, 2024-09-19T09:47:15.294 INFO:teuthology.orchestra.run.smithi022.stdout: "poolstat_resend": 0, 2024-09-19T09:47:15.294 INFO:teuthology.orchestra.run.smithi022.stdout: "statfs_active": 0, 2024-09-19T09:47:15.294 INFO:teuthology.orchestra.run.smithi022.stdout: "statfs_send": 0, 2024-09-19T09:47:15.294 INFO:teuthology.orchestra.run.smithi022.stdout: "statfs_resend": 0, 2024-09-19T09:47:15.294 INFO:teuthology.orchestra.run.smithi022.stdout: "command_active": 0, 2024-09-19T09:47:15.294 INFO:teuthology.orchestra.run.smithi022.stdout: "command_send": 0, 2024-09-19T09:47:15.294 INFO:teuthology.orchestra.run.smithi022.stdout: "command_resend": 0, 2024-09-19T09:47:15.294 INFO:teuthology.orchestra.run.smithi022.stdout: "map_epoch": 0, 2024-09-19T09:47:15.294 INFO:teuthology.orchestra.run.smithi022.stdout: "map_full": 0, 2024-09-19T09:47:15.294 INFO:teuthology.orchestra.run.smithi022.stdout: "map_inc": 0, 2024-09-19T09:47:15.294 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_sessions": 7, 2024-09-19T09:47:15.294 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_session_open": 7, 2024-09-19T09:47:15.294 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_session_close": 0, 2024-09-19T09:47:15.294 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_laggy": 0, 2024-09-19T09:47:15.295 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_wr": 0, 2024-09-19T09:47:15.295 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_rd": 2, 2024-09-19T09:47:15.295 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_del": 0 2024-09-19T09:47:15.295 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.295 INFO:teuthology.orchestra.run.smithi022.stdout: "oft": { 2024-09-19T09:47:15.295 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_objs": 0, 2024-09-19T09:47:15.295 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:47:15.295 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_updates": 0, 2024-09-19T09:47:15.295 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_removes": 0 2024-09-19T09:47:15.295 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.295 INFO:teuthology.orchestra.run.smithi022.stdout: "osd-slow-ops": { 2024-09-19T09:47:15.295 INFO:teuthology.orchestra.run.smithi022.stdout: "slow_ops_count": 0 2024-09-19T09:47:15.295 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.295 INFO:teuthology.orchestra.run.smithi022.stdout: "purge_queue": { 2024-09-19T09:47:15.296 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing_ops": 0, 2024-09-19T09:47:15.296 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:47:15.296 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing": 0, 2024-09-19T09:47:15.296 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing_high_water": 0, 2024-09-19T09:47:15.296 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executed_ops": 0, 2024-09-19T09:47:15.296 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executed": 0, 2024-09-19T09:47:15.296 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_item_in_journal": 0 2024-09-19T09:47:15.296 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.296 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:47:15.296 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-19T09:47:15.296 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-19T09:47:15.296 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-19T09:47:15.296 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 607, 2024-09-19T09:47:15.296 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 8047622, 2024-09-19T09:47:15.297 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-19T09:47:15.297 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 607, 2024-09-19T09:47:15.297 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-19T09:47:15.297 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-19T09:47:15.297 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 607, 2024-09-19T09:47:15.297 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 8047622, 2024-09-19T09:47:15.297 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-19T09:47:15.297 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.297 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.297 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.297 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:47:15.297 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.297 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-objecter_bytes": { 2024-09-19T09:47:15.297 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-19T09:47:15.297 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-19T09:47:15.298 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-19T09:47:15.298 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-19T09:47:15.298 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-19T09:47:15.298 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-19T09:47:15.298 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-19T09:47:15.298 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 413, 2024-09-19T09:47:15.298 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 7498225, 2024-09-19T09:47:15.298 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 413, 2024-09-19T09:47:15.298 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 7498225, 2024-09-19T09:47:15.298 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-19T09:47:15.298 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.298 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.298 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.298 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:47:15.299 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.299 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-objecter_ops": { 2024-09-19T09:47:15.299 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-19T09:47:15.299 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 1024, 2024-09-19T09:47:15.299 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-19T09:47:15.299 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-19T09:47:15.299 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-19T09:47:15.299 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-19T09:47:15.299 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-19T09:47:15.299 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 413, 2024-09-19T09:47:15.299 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 413, 2024-09-19T09:47:15.299 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 413, 2024-09-19T09:47:15.299 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 413, 2024-09-19T09:47:15.299 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-19T09:47:15.299 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.300 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.300 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.300 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:47:15.300 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.300 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:47:15.300 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-19T09:47:15.300 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 3758096384, 2024-09-19T09:47:15.300 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-19T09:47:15.300 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-19T09:47:15.300 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-19T09:47:15.300 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-19T09:47:15.300 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-19T09:47:15.300 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-19T09:47:15.301 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-19T09:47:15.301 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 0, 2024-09-19T09:47:15.301 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 0, 2024-09-19T09:47:15.301 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-19T09:47:15.301 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.301 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.301 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.301 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:47:15.301 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:15.301 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-write_buf_throttle-0x5605fbd946e0": { 2024-09-19T09:47:15.301 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-19T09:47:15.301 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 3758096384, 2024-09-19T09:47:15.301 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-19T09:47:15.301 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-19T09:47:15.301 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-19T09:47:15.302 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-19T09:47:15.302 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-19T09:47:15.302 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-19T09:47:15.302 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-19T09:47:15.302 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 0, 2024-09-19T09:47:15.302 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 0, 2024-09-19T09:47:15.302 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-19T09:47:15.302 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:15.302 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:15.302 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:15.302 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:47:15.302 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:47:15.302 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-19T09:47:16.054 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2024-09-19T09:47:16.054 DEBUG:tasks.check_counter:Getting stats from k 2024-09-19T09:47:16.054 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-19T09:47:16.308 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:47:16.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:16 smithi001 ceph-mon[31225]: pgmap v614: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:47:16.583 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:16 smithi022 ceph-mon[35583]: pgmap v614: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:47:16.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:16 smithi121 ceph-mon[35577]: pgmap v614: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:47:16.811 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-19T09:47:16.812 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:47:16.812 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 0, 2024-09-19T09:47:16.812 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 2, 2024-09-19T09:47:16.812 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 0, 2024-09-19T09:47:16.812 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 0, 2024-09-19T09:47:16.812 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 4, 2024-09-19T09:47:16.812 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 0, 2024-09-19T09:47:16.812 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.001246893, 2024-09-19T09:47:16.812 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T09:47:16.812 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.000376034, 2024-09-19T09:47:16.812 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:47:16.812 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:16.813 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:16.813 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:16.813 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:16.813 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:16.813 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:16.813 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:16.813 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:16.813 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:16.813 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:16.813 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:47:16.813 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:47:16.813 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:16.813 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:47:16.814 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 196, 2024-09-19T09:47:16.814 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 191, 2024-09-19T09:47:16.814 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 474784, 2024-09-19T09:47:16.814 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 116496, 2024-09-19T09:47:16.814 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 2, 2024-09-19T09:47:16.814 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 1, 2024-09-19T09:47:16.814 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.031707007, 2024-09-19T09:47:16.814 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.012219867, 2024-09-19T09:47:16.814 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.023964952, 2024-09-19T09:47:16.814 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:47:16.814 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:16.814 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 191, 2024-09-19T09:47:16.815 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.018133985, 2024-09-19T09:47:16.815 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000094942 2024-09-19T09:47:16.815 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:16.815 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:16.815 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:16.815 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:16.815 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:16.815 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:16.815 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 474784, 2024-09-19T09:47:16.815 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 116496 2024-09-19T09:47:16.815 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:16.815 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:47:16.815 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 1, 2024-09-19T09:47:16.816 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 144, 2024-09-19T09:47:16.816 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 160, 2024-09-19T09:47:16.816 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 103824, 2024-09-19T09:47:16.816 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 3, 2024-09-19T09:47:16.816 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 2, 2024-09-19T09:47:16.816 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.008642734, 2024-09-19T09:47:16.816 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.006085317, 2024-09-19T09:47:16.816 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.000970744, 2024-09-19T09:47:16.816 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:47:16.816 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:16.816 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 142, 2024-09-19T09:47:16.816 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.009693909, 2024-09-19T09:47:16.816 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000068266 2024-09-19T09:47:16.817 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:16.817 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:16.817 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:16.817 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:16.817 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:16.817 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:16.817 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:47:16.817 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 103824 2024-09-19T09:47:16.817 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:16.817 INFO:teuthology.orchestra.run.smithi022.stdout: "cct": { 2024-09-19T09:47:16.817 INFO:teuthology.orchestra.run.smithi022.stdout: "total_workers": 0, 2024-09-19T09:47:16.817 INFO:teuthology.orchestra.run.smithi022.stdout: "unhealthy_workers": 0 2024-09-19T09:47:16.817 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:16.817 INFO:teuthology.orchestra.run.smithi022.stdout: "mempool": { 2024-09-19T09:47:16.818 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:47:16.818 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_items": 0, 2024-09-19T09:47:16.818 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:47:16.818 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:47:16.818 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:47:16.818 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:47:16.818 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:47:16.818 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:47:16.818 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:47:16.818 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:47:16.818 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:47:16.818 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:47:16.818 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:47:16.818 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:47:16.818 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:47:16.819 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_items": 0, 2024-09-19T09:47:16.819 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:47:16.819 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_items": 0, 2024-09-19T09:47:16.819 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:47:16.819 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:47:16.819 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:47:16.819 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:47:16.819 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:47:16.819 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:47:16.819 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:47:16.819 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_items": 0, 2024-09-19T09:47:16.819 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:47:16.819 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:47:16.819 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:47:16.819 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_items": 0, 2024-09-19T09:47:16.820 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_bytes": 0, 2024-09-19T09:47:16.820 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_items": 0, 2024-09-19T09:47:16.820 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:47:16.820 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:47:16.820 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:47:16.820 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:47:16.820 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_bytes": 148967, 2024-09-19T09:47:16.820 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_items": 29, 2024-09-19T09:47:16.820 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:47:16.820 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_items": 0, 2024-09-19T09:47:16.820 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bytes": 0, 2024-09-19T09:47:16.820 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_items": 0, 2024-09-19T09:47:16.820 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:47:16.820 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_items": 0, 2024-09-19T09:47:16.821 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:47:16.821 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_items": 0, 2024-09-19T09:47:16.821 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_bytes": 0, 2024-09-19T09:47:16.821 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_items": 0, 2024-09-19T09:47:16.821 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:47:16.821 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:47:16.821 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_bytes": 0, 2024-09-19T09:47:16.821 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_items": 0, 2024-09-19T09:47:16.821 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_bytes": 928, 2024-09-19T09:47:16.821 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_items": 2, 2024-09-19T09:47:16.821 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_bytes": 0, 2024-09-19T09:47:16.821 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_items": 0, 2024-09-19T09:47:16.821 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_bytes": 0, 2024-09-19T09:47:16.821 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_items": 0 2024-09-19T09:47:16.822 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-19T09:47:16.822 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:47:16.822 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-19T09:47:16.822 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-19T09:47:16.822 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-19T09:47:16.822 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 193, 2024-09-19T09:47:16.822 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 444640, 2024-09-19T09:47:16.822 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-19T09:47:16.822 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 193, 2024-09-19T09:47:16.822 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-19T09:47:16.822 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-19T09:47:16.822 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 193, 2024-09-19T09:47:16.822 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 444640, 2024-09-19T09:47:16.822 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-19T09:47:16.823 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-19T09:47:16.823 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-19T09:47:16.823 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-19T09:47:16.823 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:47:16.823 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-19T09:47:16.823 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-19T09:47:17.527 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2024-09-19T09:47:17.527 DEBUG:tasks.check_counter:Getting stats from c 2024-09-19T09:47:17.528 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-19T09:47:17.877 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:47:18.251 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:18 smithi121 ceph-mon[35577]: pgmap v615: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:47:18.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:18 smithi001 ceph-mon[31225]: pgmap v615: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:47:18.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:18 smithi022 ceph-mon[35583]: pgmap v615: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:47:19.105 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-19T09:47:19.105 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:47:19.105 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 4, 2024-09-19T09:47:19.105 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 4, 2024-09-19T09:47:19.105 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 2992, 2024-09-19T09:47:19.105 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 448, 2024-09-19T09:47:19.106 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 4, 2024-09-19T09:47:19.106 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 0, 2024-09-19T09:47:19.106 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.003086551, 2024-09-19T09:47:19.106 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.000044009, 2024-09-19T09:47:19.106 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.002196745, 2024-09-19T09:47:19.106 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:47:19.106 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:19.106 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 3, 2024-09-19T09:47:19.106 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.004040286, 2024-09-19T09:47:19.106 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.001346762 2024-09-19T09:47:19.106 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:19.107 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:19.107 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-19T09:47:19.107 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-19T09:47:19.107 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-19T09:47:19.107 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:19.107 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-19T09:47:19.107 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T09:47:19.107 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:19.107 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:47:19.107 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 1, 2024-09-19T09:47:19.107 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 142, 2024-09-19T09:47:19.107 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 160, 2024-09-19T09:47:19.107 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 103472, 2024-09-19T09:47:19.108 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 3, 2024-09-19T09:47:19.108 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 2, 2024-09-19T09:47:19.108 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.008825434, 2024-09-19T09:47:19.108 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.006178157, 2024-09-19T09:47:19.108 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.001033940, 2024-09-19T09:47:19.108 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:47:19.108 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:19.108 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 140, 2024-09-19T09:47:19.108 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.014262981, 2024-09-19T09:47:19.108 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000101878 2024-09-19T09:47:19.108 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:19.108 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:19.108 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-19T09:47:19.108 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-19T09:47:19.108 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-19T09:47:19.109 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:19.109 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:47:19.109 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 103472 2024-09-19T09:47:19.109 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:19.109 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:47:19.109 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 189, 2024-09-19T09:47:19.109 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 186, 2024-09-19T09:47:19.109 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 470976, 2024-09-19T09:47:19.109 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 114128, 2024-09-19T09:47:19.109 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 2, 2024-09-19T09:47:19.109 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 1, 2024-09-19T09:47:19.109 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.029285015, 2024-09-19T09:47:19.109 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.013061617, 2024-09-19T09:47:19.110 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.020535644, 2024-09-19T09:47:19.110 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:47:19.110 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:19.110 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 185, 2024-09-19T09:47:19.110 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.010200476, 2024-09-19T09:47:19.110 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000055137 2024-09-19T09:47:19.110 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:19.110 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:19.110 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-19T09:47:19.110 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-19T09:47:19.110 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-19T09:47:19.110 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:19.111 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 470976, 2024-09-19T09:47:19.111 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 114128 2024-09-19T09:47:19.111 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:19.111 INFO:teuthology.orchestra.run.smithi121.stdout: "cct": { 2024-09-19T09:47:19.111 INFO:teuthology.orchestra.run.smithi121.stdout: "total_workers": 0, 2024-09-19T09:47:19.111 INFO:teuthology.orchestra.run.smithi121.stdout: "unhealthy_workers": 0 2024-09-19T09:47:19.111 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:19.111 INFO:teuthology.orchestra.run.smithi121.stdout: "mempool": { 2024-09-19T09:47:19.111 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:47:19.111 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_items": 0, 2024-09-19T09:47:19.111 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:47:19.111 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:47:19.111 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:47:19.111 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:47:19.111 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:47:19.111 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:47:19.112 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:47:19.112 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:47:19.112 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:47:19.112 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:47:19.112 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:47:19.112 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:47:19.112 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:47:19.112 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_items": 0, 2024-09-19T09:47:19.112 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:47:19.112 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_items": 0, 2024-09-19T09:47:19.112 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:47:19.112 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:47:19.112 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:47:19.112 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:47:19.113 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:47:19.113 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:47:19.113 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:47:19.113 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_items": 0, 2024-09-19T09:47:19.113 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:47:19.113 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:47:19.113 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:47:19.113 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_items": 0, 2024-09-19T09:47:19.113 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_bytes": 0, 2024-09-19T09:47:19.114 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_items": 0, 2024-09-19T09:47:19.114 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:47:19.114 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:47:19.114 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:47:19.114 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:47:19.114 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_bytes": 148984, 2024-09-19T09:47:19.114 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_items": 30, 2024-09-19T09:47:19.114 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:47:19.114 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_items": 0, 2024-09-19T09:47:19.114 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_bytes": 0, 2024-09-19T09:47:19.114 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_items": 0, 2024-09-19T09:47:19.114 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:47:19.114 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_items": 0, 2024-09-19T09:47:19.114 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:47:19.114 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_items": 0, 2024-09-19T09:47:19.115 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_bytes": 0, 2024-09-19T09:47:19.115 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_items": 0, 2024-09-19T09:47:19.115 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:47:19.115 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:47:19.115 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_bytes": 0, 2024-09-19T09:47:19.115 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_items": 0, 2024-09-19T09:47:19.115 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_bytes": 928, 2024-09-19T09:47:19.115 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_items": 2, 2024-09-19T09:47:19.115 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_bytes": 0, 2024-09-19T09:47:19.115 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_items": 0, 2024-09-19T09:47:19.115 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_bytes": 0, 2024-09-19T09:47:19.115 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_items": 0 2024-09-19T09:47:19.115 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:19.115 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:47:19.115 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-19T09:47:19.115 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-09-19T09:47:19.116 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-19T09:47:19.116 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 190, 2024-09-19T09:47:19.116 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 444250, 2024-09-19T09:47:19.116 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-19T09:47:19.116 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 190, 2024-09-19T09:47:19.116 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-09-19T09:47:19.116 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-09-19T09:47:19.116 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 190, 2024-09-19T09:47:19.116 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 444250, 2024-09-19T09:47:19.116 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-19T09:47:19.116 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-19T09:47:19.116 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-19T09:47:19.116 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-19T09:47:19.116 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-19T09:47:19.116 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-19T09:47:19.117 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-19T09:47:20.062 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.c 2024-09-19T09:47:20.063 DEBUG:tasks.check_counter:Getting stats from f 2024-09-19T09:47:20.063 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-19T09:47:20.324 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:47:20.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:20 smithi121 ceph-mon[35577]: pgmap v616: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:47:20.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:20 smithi022 ceph-mon[35583]: pgmap v616: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:47:20.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:20 smithi001 ceph-mon[31225]: pgmap v616: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:47:21.009 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-19T09:47:21.009 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:47:21.009 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 0, 2024-09-19T09:47:21.010 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 2, 2024-09-19T09:47:21.010 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 0, 2024-09-19T09:47:21.010 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 0, 2024-09-19T09:47:21.010 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 4, 2024-09-19T09:47:21.010 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 0, 2024-09-19T09:47:21.010 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.001032612, 2024-09-19T09:47:21.010 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T09:47:21.010 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.000194910, 2024-09-19T09:47:21.010 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:47:21.010 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:21.010 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-19T09:47:21.011 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-19T09:47:21.011 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-19T09:47:21.011 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:21.011 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:21.011 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-19T09:47:21.011 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-19T09:47:21.011 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-19T09:47:21.011 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:21.011 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:47:21.011 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:47:21.011 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:21.011 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:47:21.011 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 5, 2024-09-19T09:47:21.011 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 144, 2024-09-19T09:47:21.012 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 3152, 2024-09-19T09:47:21.012 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 103920, 2024-09-19T09:47:21.012 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 3, 2024-09-19T09:47:21.012 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 2, 2024-09-19T09:47:21.012 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.010532580, 2024-09-19T09:47:21.012 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.006112516, 2024-09-19T09:47:21.013 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.002974856, 2024-09-19T09:47:21.013 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:47:21.013 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:21.013 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 143, 2024-09-19T09:47:21.013 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.013427782, 2024-09-19T09:47:21.013 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000093900 2024-09-19T09:47:21.013 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:21.013 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:21.013 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-19T09:47:21.013 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-19T09:47:21.013 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-19T09:47:21.013 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:21.013 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-19T09:47:21.013 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 103920 2024-09-19T09:47:21.013 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:21.013 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:47:21.014 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 190, 2024-09-19T09:47:21.014 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 187, 2024-09-19T09:47:21.014 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 471248, 2024-09-19T09:47:21.014 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 114768, 2024-09-19T09:47:21.014 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 2, 2024-09-19T09:47:21.014 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 1, 2024-09-19T09:47:21.014 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.028898779, 2024-09-19T09:47:21.014 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.012370113, 2024-09-19T09:47:21.014 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.020597123, 2024-09-19T09:47:21.014 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:47:21.014 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:21.014 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 186, 2024-09-19T09:47:21.014 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.014207549, 2024-09-19T09:47:21.014 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000076384 2024-09-19T09:47:21.015 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:21.015 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:21.015 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-19T09:47:21.015 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-19T09:47:21.015 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-19T09:47:21.015 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:21.015 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 471248, 2024-09-19T09:47:21.015 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 114768 2024-09-19T09:47:21.015 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:21.015 INFO:teuthology.orchestra.run.smithi121.stdout: "cct": { 2024-09-19T09:47:21.015 INFO:teuthology.orchestra.run.smithi121.stdout: "total_workers": 0, 2024-09-19T09:47:21.015 INFO:teuthology.orchestra.run.smithi121.stdout: "unhealthy_workers": 0 2024-09-19T09:47:21.015 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:21.015 INFO:teuthology.orchestra.run.smithi121.stdout: "mempool": { 2024-09-19T09:47:21.016 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:47:21.016 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_items": 0, 2024-09-19T09:47:21.016 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:47:21.016 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:47:21.016 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:47:21.016 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:47:21.016 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:47:21.016 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:47:21.016 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:47:21.016 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:47:21.016 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:47:21.016 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:47:21.016 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:47:21.017 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:47:21.017 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:47:21.017 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_items": 0, 2024-09-19T09:47:21.017 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:47:21.017 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_items": 0, 2024-09-19T09:47:21.017 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:47:21.017 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:47:21.017 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:47:21.017 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:47:21.017 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:47:21.017 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:47:21.017 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:47:21.017 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_items": 0, 2024-09-19T09:47:21.017 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:47:21.018 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:47:21.018 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:47:21.018 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_items": 0, 2024-09-19T09:47:21.018 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_bytes": 0, 2024-09-19T09:47:21.018 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_items": 0, 2024-09-19T09:47:21.018 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:47:21.018 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:47:21.018 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:47:21.018 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:47:21.018 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_bytes": 148967, 2024-09-19T09:47:21.018 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_items": 29, 2024-09-19T09:47:21.018 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:47:21.018 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_items": 0, 2024-09-19T09:47:21.018 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_bytes": 0, 2024-09-19T09:47:21.018 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_items": 0, 2024-09-19T09:47:21.018 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:47:21.019 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_items": 0, 2024-09-19T09:47:21.019 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:47:21.019 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_items": 0, 2024-09-19T09:47:21.019 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_bytes": 0, 2024-09-19T09:47:21.019 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_items": 0, 2024-09-19T09:47:21.019 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:47:21.019 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:47:21.019 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_bytes": 0, 2024-09-19T09:47:21.019 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_items": 0, 2024-09-19T09:47:21.019 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_bytes": 928, 2024-09-19T09:47:21.019 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_items": 2, 2024-09-19T09:47:21.019 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_bytes": 0, 2024-09-19T09:47:21.019 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_items": 0, 2024-09-19T09:47:21.019 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_bytes": 0, 2024-09-19T09:47:21.019 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_items": 0 2024-09-19T09:47:21.019 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:21.020 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:47:21.020 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-19T09:47:21.020 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-09-19T09:47:21.020 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-19T09:47:21.020 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 191, 2024-09-19T09:47:21.020 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 444380, 2024-09-19T09:47:21.020 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-19T09:47:21.020 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 191, 2024-09-19T09:47:21.020 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-09-19T09:47:21.020 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-09-19T09:47:21.020 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 191, 2024-09-19T09:47:21.020 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 444380, 2024-09-19T09:47:21.020 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-19T09:47:21.020 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-19T09:47:21.020 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-19T09:47:21.020 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-19T09:47:21.021 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-19T09:47:21.021 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-19T09:47:21.021 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-19T09:47:21.918 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.f 2024-09-19T09:47:21.918 DEBUG:tasks.check_counter:Getting stats from i 2024-09-19T09:47:21.918 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-19T09:47:22.167 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:47:22.546 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:22 smithi121 ceph-mon[35577]: pgmap v617: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:47:22.550 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:22 smithi001 ceph-mon[31225]: pgmap v617: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:47:22.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:22 smithi022 ceph-mon[35583]: pgmap v617: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:47:22.689 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-19T09:47:22.690 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:47:22.690 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 0, 2024-09-19T09:47:22.690 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 2, 2024-09-19T09:47:22.690 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 0, 2024-09-19T09:47:22.690 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 0, 2024-09-19T09:47:22.690 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 4, 2024-09-19T09:47:22.690 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 0, 2024-09-19T09:47:22.690 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.003898299, 2024-09-19T09:47:22.690 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T09:47:22.690 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.000246707, 2024-09-19T09:47:22.690 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:47:22.691 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:22.691 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-19T09:47:22.691 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-19T09:47:22.691 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-19T09:47:22.691 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:22.691 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:22.691 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-19T09:47:22.691 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-19T09:47:22.691 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-19T09:47:22.691 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:22.691 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:47:22.691 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:47:22.692 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:22.692 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:47:22.692 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 50, 2024-09-19T09:47:22.692 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 47, 2024-09-19T09:47:22.692 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 156416, 2024-09-19T09:47:22.692 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 27024, 2024-09-19T09:47:22.692 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 2, 2024-09-19T09:47:22.692 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 1, 2024-09-19T09:47:22.692 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.012412013, 2024-09-19T09:47:22.692 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.002528341, 2024-09-19T09:47:22.692 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.011810514, 2024-09-19T09:47:22.692 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:47:22.692 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:22.692 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 47, 2024-09-19T09:47:22.693 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.014192684, 2024-09-19T09:47:22.693 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000301972 2024-09-19T09:47:22.693 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:22.693 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:22.693 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-19T09:47:22.693 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-19T09:47:22.693 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-19T09:47:22.693 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:22.693 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 156416, 2024-09-19T09:47:22.693 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 27024 2024-09-19T09:47:22.693 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:22.693 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:47:22.693 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 1, 2024-09-19T09:47:22.694 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 34, 2024-09-19T09:47:22.694 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 160, 2024-09-19T09:47:22.694 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 84464, 2024-09-19T09:47:22.694 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 3, 2024-09-19T09:47:22.694 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 2, 2024-09-19T09:47:22.694 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.003712340, 2024-09-19T09:47:22.694 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.001277858, 2024-09-19T09:47:22.694 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.001915860, 2024-09-19T09:47:22.694 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:47:22.694 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:22.694 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 32, 2024-09-19T09:47:22.694 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.001520073, 2024-09-19T09:47:22.694 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000047502 2024-09-19T09:47:22.694 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:22.694 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:22.695 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-19T09:47:22.695 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-19T09:47:22.695 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-19T09:47:22.695 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:22.695 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:47:22.695 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 84464 2024-09-19T09:47:22.695 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:22.695 INFO:teuthology.orchestra.run.smithi121.stdout: "cct": { 2024-09-19T09:47:22.695 INFO:teuthology.orchestra.run.smithi121.stdout: "total_workers": 0, 2024-09-19T09:47:22.695 INFO:teuthology.orchestra.run.smithi121.stdout: "unhealthy_workers": 0 2024-09-19T09:47:22.695 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:22.695 INFO:teuthology.orchestra.run.smithi121.stdout: "mempool": { 2024-09-19T09:47:22.695 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:47:22.695 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_items": 0, 2024-09-19T09:47:22.695 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:47:22.695 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:47:22.696 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:47:22.696 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:47:22.696 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:47:22.696 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:47:22.696 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:47:22.696 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:47:22.696 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:47:22.696 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:47:22.696 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:47:22.696 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:47:22.696 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:47:22.696 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_items": 0, 2024-09-19T09:47:22.696 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:47:22.696 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_items": 0, 2024-09-19T09:47:22.697 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:47:22.697 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:47:22.697 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:47:22.697 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:47:22.697 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:47:22.697 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:47:22.697 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:47:22.697 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_items": 0, 2024-09-19T09:47:22.697 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:47:22.697 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:47:22.697 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:47:22.697 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_items": 0, 2024-09-19T09:47:22.698 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_bytes": 0, 2024-09-19T09:47:22.698 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_items": 0, 2024-09-19T09:47:22.698 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:47:22.698 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:47:22.698 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:47:22.698 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:47:22.698 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_bytes": 148039, 2024-09-19T09:47:22.698 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_items": 25, 2024-09-19T09:47:22.698 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:47:22.698 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_items": 0, 2024-09-19T09:47:22.698 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_bytes": 0, 2024-09-19T09:47:22.698 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_items": 0, 2024-09-19T09:47:22.698 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:47:22.698 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_items": 0, 2024-09-19T09:47:22.699 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:47:22.699 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_items": 0, 2024-09-19T09:47:22.699 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_bytes": 0, 2024-09-19T09:47:22.699 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_items": 0, 2024-09-19T09:47:22.699 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:47:22.699 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:47:22.699 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_bytes": 0, 2024-09-19T09:47:22.699 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_items": 0, 2024-09-19T09:47:22.699 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_bytes": 928, 2024-09-19T09:47:22.699 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_items": 2, 2024-09-19T09:47:22.699 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_bytes": 0, 2024-09-19T09:47:22.699 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_items": 0, 2024-09-19T09:47:22.699 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_bytes": 0, 2024-09-19T09:47:22.699 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_items": 0 2024-09-19T09:47:22.700 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:22.700 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:47:22.700 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-19T09:47:22.700 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-09-19T09:47:22.700 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-19T09:47:22.700 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 47, 2024-09-19T09:47:22.700 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 146955, 2024-09-19T09:47:22.700 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-19T09:47:22.700 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 47, 2024-09-19T09:47:22.700 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-09-19T09:47:22.700 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-09-19T09:47:22.700 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 47, 2024-09-19T09:47:22.700 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 146955, 2024-09-19T09:47:22.700 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-19T09:47:22.701 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-19T09:47:22.701 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-19T09:47:22.701 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-19T09:47:22.701 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-19T09:47:22.701 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-19T09:47:22.701 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-19T09:47:23.485 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.i 2024-09-19T09:47:23.486 DEBUG:tasks.check_counter:Getting stats from l 2024-09-19T09:47:23.486 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-19T09:47:23.733 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:47:24.229 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-19T09:47:24.229 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:47:24.229 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 195, 2024-09-19T09:47:24.229 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 192, 2024-09-19T09:47:24.229 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 472608, 2024-09-19T09:47:24.229 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 117968, 2024-09-19T09:47:24.229 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 4, 2024-09-19T09:47:24.229 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 0, 2024-09-19T09:47:24.229 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.028206062, 2024-09-19T09:47:24.229 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.012164605, 2024-09-19T09:47:24.230 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.020151381, 2024-09-19T09:47:24.230 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:47:24.230 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:24.230 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 191, 2024-09-19T09:47:24.230 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.010762185, 2024-09-19T09:47:24.230 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000056346 2024-09-19T09:47:24.230 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:24.230 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:24.230 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-19T09:47:24.230 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-19T09:47:24.230 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-19T09:47:24.230 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:24.230 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 472608, 2024-09-19T09:47:24.230 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 117968 2024-09-19T09:47:24.230 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:24.231 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:47:24.231 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 5, 2024-09-19T09:47:24.231 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 148, 2024-09-19T09:47:24.231 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 3152, 2024-09-19T09:47:24.231 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 104624, 2024-09-19T09:47:24.231 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 3, 2024-09-19T09:47:24.231 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 2, 2024-09-19T09:47:24.231 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.010059480, 2024-09-19T09:47:24.231 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.006216537, 2024-09-19T09:47:24.231 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.002458697, 2024-09-19T09:47:24.231 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:47:24.231 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:24.231 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 147, 2024-09-19T09:47:24.232 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.014037368, 2024-09-19T09:47:24.232 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000095492 2024-09-19T09:47:24.232 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:24.232 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:24.232 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-19T09:47:24.232 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-19T09:47:24.232 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-19T09:47:24.232 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:24.232 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-19T09:47:24.232 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 104624 2024-09-19T09:47:24.232 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:24.232 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:47:24.232 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 0, 2024-09-19T09:47:24.233 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 2, 2024-09-19T09:47:24.233 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 0, 2024-09-19T09:47:24.233 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 0, 2024-09-19T09:47:24.233 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 2, 2024-09-19T09:47:24.233 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 1, 2024-09-19T09:47:24.233 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.000282688, 2024-09-19T09:47:24.233 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T09:47:24.233 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.000214670, 2024-09-19T09:47:24.233 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:47:24.233 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:47:24.233 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-19T09:47:24.233 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-19T09:47:24.233 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-19T09:47:24.234 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:24.234 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:47:24.234 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-19T09:47:24.234 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-19T09:47:24.234 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-19T09:47:24.234 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:24.234 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:47:24.234 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:47:24.234 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:24.234 INFO:teuthology.orchestra.run.smithi121.stdout: "cct": { 2024-09-19T09:47:24.234 INFO:teuthology.orchestra.run.smithi121.stdout: "total_workers": 0, 2024-09-19T09:47:24.234 INFO:teuthology.orchestra.run.smithi121.stdout: "unhealthy_workers": 0 2024-09-19T09:47:24.234 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:24.234 INFO:teuthology.orchestra.run.smithi121.stdout: "mempool": { 2024-09-19T09:47:24.234 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:47:24.235 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_items": 0, 2024-09-19T09:47:24.235 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:47:24.235 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:47:24.235 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:47:24.235 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:47:24.235 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:47:24.235 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:47:24.235 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:47:24.235 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:47:24.235 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:47:24.235 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:47:24.235 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:47:24.235 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:47:24.236 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:47:24.236 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_items": 0, 2024-09-19T09:47:24.236 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:47:24.236 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_items": 0, 2024-09-19T09:47:24.236 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:47:24.236 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:47:24.236 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:47:24.236 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:47:24.236 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:47:24.236 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:47:24.236 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:47:24.236 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_items": 0, 2024-09-19T09:47:24.237 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:47:24.237 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:47:24.237 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:47:24.237 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_items": 0, 2024-09-19T09:47:24.237 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_bytes": 0, 2024-09-19T09:47:24.237 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_items": 0, 2024-09-19T09:47:24.237 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:47:24.237 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:47:24.237 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:47:24.237 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:47:24.237 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_bytes": 149001, 2024-09-19T09:47:24.237 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_items": 31, 2024-09-19T09:47:24.237 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:47:24.238 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_items": 0, 2024-09-19T09:47:24.238 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_bytes": 0, 2024-09-19T09:47:24.238 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_items": 0, 2024-09-19T09:47:24.238 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:47:24.238 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_items": 0, 2024-09-19T09:47:24.238 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:47:24.238 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_items": 0, 2024-09-19T09:47:24.238 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_bytes": 0, 2024-09-19T09:47:24.238 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_items": 0, 2024-09-19T09:47:24.238 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:47:24.238 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:47:24.238 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_bytes": 0, 2024-09-19T09:47:24.238 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_items": 0, 2024-09-19T09:47:24.238 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_bytes": 928, 2024-09-19T09:47:24.239 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_items": 2, 2024-09-19T09:47:24.239 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_bytes": 0, 2024-09-19T09:47:24.239 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_items": 0, 2024-09-19T09:47:24.239 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_bytes": 0, 2024-09-19T09:47:24.239 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_items": 0 2024-09-19T09:47:24.239 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-19T09:47:24.239 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:47:24.239 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-19T09:47:24.239 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-09-19T09:47:24.239 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-19T09:47:24.239 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 196, 2024-09-19T09:47:24.239 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 445030, 2024-09-19T09:47:24.239 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-19T09:47:24.239 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 196, 2024-09-19T09:47:24.239 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-09-19T09:47:24.240 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-09-19T09:47:24.240 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 196, 2024-09-19T09:47:24.240 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 445030, 2024-09-19T09:47:24.240 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-19T09:47:24.240 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-19T09:47:24.240 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-19T09:47:24.240 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-19T09:47:24.240 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-19T09:47:24.240 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-19T09:47:24.240 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-19T09:47:24.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:24 smithi022 ceph-mon[35583]: pgmap v618: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:47:24.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:24 smithi121 ceph-mon[35577]: pgmap v618: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:47:24.748 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:24 smithi001 ceph-mon[31225]: pgmap v618: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-19T09:47:25.003 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2024-09-19T09:47:25.003 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-19T09:47:25.013 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-19T09:47:25.013 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T09:47:25.013 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:47:25.050 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-09-19T09:47:25.050 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:47:25.107 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T09:47:25.406 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:47:25.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.903+0000 7fe40c48e640 1 -- 172.21.15.1:0/889991517 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe404102ef0 msgr2=0x7fe40410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:25.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.903+0000 7fe40c48e640 1 --2- 172.21.15.1:0/889991517 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe404102ef0 0x7fe40410da40 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc009ca0 tx=0x7fe3fc02a950 comp rx=0 tx=0).stop 2024-09-19T09:47:25.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.903+0000 7fe40c48e640 1 -- 172.21.15.1:0/889991517 shutdown_connections 2024-09-19T09:47:25.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.903+0000 7fe40c48e640 1 --2- 172.21.15.1:0/889991517 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe404102ef0 0x7fe40410da40 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:25.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.903+0000 7fe40c48e640 1 --2- 172.21.15.1:0/889991517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe404102570 0x7fe4041029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:25.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.903+0000 7fe40c48e640 1 --2- 172.21.15.1:0/889991517 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe404100e20 0x7fe404101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:25.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.903+0000 7fe40c48e640 1 -- 172.21.15.1:0/889991517 >> 172.21.15.1:0/889991517 conn(0x7fe4040fc7d0 msgr2=0x7fe4040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:25.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.903+0000 7fe40c48e640 1 -- 172.21.15.1:0/889991517 shutdown_connections 2024-09-19T09:47:25.922 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.903+0000 7fe40c48e640 1 -- 172.21.15.1:0/889991517 wait complete. 2024-09-19T09:47:25.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.904+0000 7fe40c48e640 1 Processor -- start 2024-09-19T09:47:25.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.904+0000 7fe40c48e640 1 -- start start 2024-09-19T09:47:25.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.904+0000 7fe40c48e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe404100e20 0x7fe40419a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:25.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.904+0000 7fe40c48e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe404102570 0x7fe40419ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:25.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.904+0000 7fe40c48e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe404102ef0 0x7fe40419f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:25.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.904+0000 7fe40c48e640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe404110f80 con 0x7fe404102ef0 2024-09-19T09:47:25.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.904+0000 7fe40c48e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe404110e00 con 0x7fe404100e20 2024-09-19T09:47:25.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.904+0000 7fe40c48e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe404111100 con 0x7fe404102570 2024-09-19T09:47:25.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.905+0000 7fe40aa2b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe404102ef0 0x7fe40419f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:25.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.905+0000 7fe40aa2b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe404102ef0 0x7fe40419f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59144/0 (socket says 172.21.15.1:59144) 2024-09-19T09:47:25.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.905+0000 7fe40aa2b640 1 -- 172.21.15.1:0/3231282720 learned_addr learned my addr 172.21.15.1:0/3231282720 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:47:25.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.905+0000 7fe40a22a640 1 --2- 172.21.15.1:0/3231282720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe404100e20 0x7fe40419a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:25.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.905+0000 7fe409a29640 1 --2- 172.21.15.1:0/3231282720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe404102570 0x7fe40419ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:25.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.905+0000 7fe40aa2b640 1 -- 172.21.15.1:0/3231282720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe404102570 msgr2=0x7fe40419ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:25.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.905+0000 7fe40aa2b640 1 --2- 172.21.15.1:0/3231282720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe404102570 0x7fe40419ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:25.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.905+0000 7fe40aa2b640 1 -- 172.21.15.1:0/3231282720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe404100e20 msgr2=0x7fe40419a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:25.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.905+0000 7fe40aa2b640 1 --2- 172.21.15.1:0/3231282720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe404100e20 0x7fe40419a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:25.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.905+0000 7fe40aa2b640 1 -- 172.21.15.1:0/3231282720 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe40419f6f0 con 0x7fe404102ef0 2024-09-19T09:47:25.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.905+0000 7fe40aa2b640 1 --2- 172.21.15.1:0/3231282720 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe404102ef0 0x7fe40419f010 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc02ae70 tx=0x7fe3fc02f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:25.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.905+0000 7fe3fb7fe640 1 -- 172.21.15.1:0/3231282720 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc034040 con 0x7fe404102ef0 2024-09-19T09:47:25.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.905+0000 7fe40c48e640 1 -- 172.21.15.1:0/3231282720 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe40419f980 con 0x7fe404102ef0 2024-09-19T09:47:25.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.905+0000 7fe3fb7fe640 1 -- 172.21.15.1:0/3231282720 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3fc030920 con 0x7fe404102ef0 2024-09-19T09:47:25.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.906+0000 7fe40c48e640 1 -- 172.21.15.1:0/3231282720 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4041a72c0 con 0x7fe404102ef0 2024-09-19T09:47:25.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.906+0000 7fe3fb7fe640 1 -- 172.21.15.1:0/3231282720 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc045480 con 0x7fe404102ef0 2024-09-19T09:47:25.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.907+0000 7fe40c48e640 1 -- 172.21.15.1:0/3231282720 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe404101200 con 0x7fe404102ef0 2024-09-19T09:47:25.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.908+0000 7fe3fb7fe640 1 -- 172.21.15.1:0/3231282720 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fe3fc037020 con 0x7fe404102ef0 2024-09-19T09:47:25.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.908+0000 7fe3fb7fe640 1 --2- 172.21.15.1:0/3231282720 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe3f00a3240 0x7fe3f00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:25.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.908+0000 7fe40a22a640 1 --2- 172.21.15.1:0/3231282720 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe3f00a3240 0x7fe3f00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:25.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.908+0000 7fe3fb7fe640 1 -- 172.21.15.1:0/3231282720 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fe3fc0f0820 con 0x7fe404102ef0 2024-09-19T09:47:25.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.909+0000 7fe40a22a640 1 --2- 172.21.15.1:0/3231282720 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe3f00a3240 0x7fe3f00a5700 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe400005fd0 tx=0x7fe40000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:25.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:25.913+0000 7fe3fb7fe640 1 -- 172.21.15.1:0/3231282720 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe3fc0bd540 con 0x7fe404102ef0 2024-09-19T09:47:26.102 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:26.100+0000 7fe40c48e640 1 -- 172.21.15.1:0/3231282720 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe4041a7490 con 0x7fe404102ef0 2024-09-19T09:47:26.103 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:26.101+0000 7fe3fb7fe640 1 -- 172.21.15.1:0/3231282720 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v84) ==== 81+0+582 (secure 0 0 0) 0x7fe3fc0bce40 con 0x7fe404102ef0 2024-09-19T09:47:26.103 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6800/1028873727 2024-09-20T09:29:14.046960+0000 2024-09-19T09:47:26.103 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/3137949087 2024-09-20T09:29:14.046960+0000 2024-09-19T09:47:26.103 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/1951370933 2024-09-20T09:29:14.046960+0000 2024-09-19T09:47:26.103 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/2008363642 2024-09-20T09:28:50.074985+0000 2024-09-19T09:47:26.103 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/3006931063 2024-09-20T09:29:14.046960+0000 2024-09-19T09:47:26.104 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/2486161758 2024-09-20T09:28:50.074985+0000 2024-09-19T09:47:26.104 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6801/1296304385 2024-09-20T09:28:50.074985+0000 2024-09-19T09:47:26.104 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6801/1028873727 2024-09-20T09:29:14.046960+0000 2024-09-19T09:47:26.104 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:0/2783823049 2024-09-20T09:28:50.074985+0000 2024-09-19T09:47:26.104 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1:6800/1296304385 2024-09-20T09:28:50.074985+0000 2024-09-19T09:47:26.104 INFO:teuthology.orchestra.run.smithi001.stderr:listed 10 entries 2024-09-19T09:47:26.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:26.103+0000 7fe40c48e640 1 -- 172.21.15.1:0/3231282720 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe3f00a3240 msgr2=0x7fe3f00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:26.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:26.103+0000 7fe40c48e640 1 --2- 172.21.15.1:0/3231282720 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe3f00a3240 0x7fe3f00a5700 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe400005fd0 tx=0x7fe40000b390 comp rx=0 tx=0).stop 2024-09-19T09:47:26.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:26.103+0000 7fe40c48e640 1 -- 172.21.15.1:0/3231282720 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe404102ef0 msgr2=0x7fe40419f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:26.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:26.103+0000 7fe40c48e640 1 --2- 172.21.15.1:0/3231282720 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe404102ef0 0x7fe40419f010 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc02ae70 tx=0x7fe3fc02f5d0 comp rx=0 tx=0).stop 2024-09-19T09:47:26.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:26.103+0000 7fe40c48e640 1 -- 172.21.15.1:0/3231282720 shutdown_connections 2024-09-19T09:47:26.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:26.103+0000 7fe40c48e640 1 --2- 172.21.15.1:0/3231282720 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe404102ef0 0x7fe40419f010 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:26.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:26.103+0000 7fe40c48e640 1 --2- 172.21.15.1:0/3231282720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe404102570 0x7fe40419ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:26.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:26.103+0000 7fe40c48e640 1 --2- 172.21.15.1:0/3231282720 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe3f00a3240 0x7fe3f00a5700 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:26.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:26.103+0000 7fe40c48e640 1 --2- 172.21.15.1:0/3231282720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe404100e20 0x7fe40419a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:26.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:26.103+0000 7fe40c48e640 1 -- 172.21.15.1:0/3231282720 >> 172.21.15.1:0/3231282720 conn(0x7fe4040fc7d0 msgr2=0x7fe404069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:26.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:26.103+0000 7fe40c48e640 1 -- 172.21.15.1:0/3231282720 shutdown_connections 2024-09-19T09:47:26.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:26.103+0000 7fe40c48e640 1 -- 172.21.15.1:0/3231282720 wait complete. 2024-09-19T09:47:26.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:26 smithi001 ceph-mon[31225]: pgmap v619: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:47:26.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:26 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/3231282720' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:47:26.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:26 smithi022 ceph-mon[35583]: pgmap v619: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:47:26.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:26 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/3231282720' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:47:26.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:26 smithi121 ceph-mon[35577]: pgmap v619: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 2 op/s 2024-09-19T09:47:26.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:26 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/3231282720' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:47:27.019 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T09:47:27.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:47:27.019 DEBUG:teuthology.orchestra.run.smithi001:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-19T09:47:27.078 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi001.front.sepia.ceph.com 2024-09-19T09:47:27.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:47:27.078 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T09:47:27.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:47:27.137 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2024-09-19T09:47:27.204 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T09:47:27.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:47:27.204 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:47:27.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:47:27.252 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link delete ceph-brx 2024-09-19T09:47:27.311 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-19T09:47:27.321 INFO:tasks.cephadm:Teardown begin 2024-09-19T09:47:27.321 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T09:47:27.322 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:47:27.578 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:47:28.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.038+0000 7f5124fca640 1 -- 172.21.15.1:0/2483566661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5120102790 msgr2=0x7f51201067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:28.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.038+0000 7f5124fca640 1 --2- 172.21.15.1:0/2483566661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5120102790 0x7f51201067e0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f5114009900 tx=0x7f511402a410 comp rx=0 tx=0).stop 2024-09-19T09:47:28.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.039+0000 7f5124fca640 1 -- 172.21.15.1:0/2483566661 shutdown_connections 2024-09-19T09:47:28.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.039+0000 7f5124fca640 1 --2- 172.21.15.1:0/2483566661 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5120106f10 0x7f512010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:28.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.039+0000 7f5124fca640 1 --2- 172.21.15.1:0/2483566661 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5120102790 0x7f51201067e0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:28.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.039+0000 7f5124fca640 1 --2- 172.21.15.1:0/2483566661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5120101de0 0x7f51201021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:28.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.039+0000 7f5124fca640 1 -- 172.21.15.1:0/2483566661 >> 172.21.15.1:0/2483566661 conn(0x7f51200fd8c0 msgr2=0x7f51200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:28.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.039+0000 7f5124fca640 1 -- 172.21.15.1:0/2483566661 shutdown_connections 2024-09-19T09:47:28.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.039+0000 7f5124fca640 1 -- 172.21.15.1:0/2483566661 wait complete. 2024-09-19T09:47:28.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.039+0000 7f5124fca640 1 Processor -- start 2024-09-19T09:47:28.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.040+0000 7f5124fca640 1 -- start start 2024-09-19T09:47:28.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.040+0000 7f5124fca640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5120101de0 0x7f5120198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:28.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.040+0000 7f5124fca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5120102790 0x7f5120198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:28.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.040+0000 7f5124fca640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5120106f10 0x7f512019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:28.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.040+0000 7f5124fca640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5120111f30 con 0x7f5120106f10 2024-09-19T09:47:28.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.040+0000 7f5124fca640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5120111db0 con 0x7f5120102790 2024-09-19T09:47:28.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.040+0000 7f5124fca640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f51201120b0 con 0x7f5120101de0 2024-09-19T09:47:28.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.040+0000 7f511ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5120106f10 0x7f512019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:28.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.040+0000 7f511ed9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5120106f10 0x7f512019cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59156/0 (socket says 172.21.15.1:59156) 2024-09-19T09:47:28.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.040+0000 7f511ed9d640 1 -- 172.21.15.1:0/1693313650 learned_addr learned my addr 172.21.15.1:0/1693313650 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:47:28.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.040+0000 7f511e59c640 1 --2- 172.21.15.1:0/1693313650 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5120101de0 0x7f5120198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:28.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.040+0000 7f511dd9b640 1 --2- 172.21.15.1:0/1693313650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5120102790 0x7f5120198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:28.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.040+0000 7f511ed9d640 1 -- 172.21.15.1:0/1693313650 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5120101de0 msgr2=0x7f5120198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:28.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.040+0000 7f511ed9d640 1 --2- 172.21.15.1:0/1693313650 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5120101de0 0x7f5120198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:28.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.040+0000 7f511ed9d640 1 -- 172.21.15.1:0/1693313650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5120102790 msgr2=0x7f5120198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:28.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.040+0000 7f511ed9d640 1 --2- 172.21.15.1:0/1693313650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5120102790 0x7f5120198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:28.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.040+0000 7f511ed9d640 1 -- 172.21.15.1:0/1693313650 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f512019d3e0 con 0x7f5120106f10 2024-09-19T09:47:28.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.040+0000 7f511dd9b640 1 --2- 172.21.15.1:0/1693313650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5120102790 0x7f5120198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:47:28.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.040+0000 7f511ed9d640 1 --2- 172.21.15.1:0/1693313650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5120106f10 0x7f512019cd00 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f511800eb10 tx=0x7f511800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:28.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.041+0000 7f510f7fe640 1 -- 172.21.15.1:0/1693313650 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5118004b20 con 0x7f5120106f10 2024-09-19T09:47:28.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.041+0000 7f5124fca640 1 -- 172.21.15.1:0/1693313650 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f512019d6d0 con 0x7f5120106f10 2024-09-19T09:47:28.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.041+0000 7f510f7fe640 1 -- 172.21.15.1:0/1693313650 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5118004cc0 con 0x7f5120106f10 2024-09-19T09:47:28.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.041+0000 7f510f7fe640 1 -- 172.21.15.1:0/1693313650 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5118010760 con 0x7f5120106f10 2024-09-19T09:47:28.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.041+0000 7f5124fca640 1 -- 172.21.15.1:0/1693313650 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51201a4fb0 con 0x7f5120106f10 2024-09-19T09:47:28.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.042+0000 7f5124fca640 1 -- 172.21.15.1:0/1693313650 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51201021c0 con 0x7f5120106f10 2024-09-19T09:47:28.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.043+0000 7f510f7fe640 1 -- 172.21.15.1:0/1693313650 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f5118005020 con 0x7f5120106f10 2024-09-19T09:47:28.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.044+0000 7f510f7fe640 1 --2- 172.21.15.1:0/1693313650 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f51080a3240 0x7f51080a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:28.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.044+0000 7f511e59c640 1 --2- 172.21.15.1:0/1693313650 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f51080a3240 0x7f51080a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:28.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.044+0000 7f510f7fe640 1 -- 172.21.15.1:0/1693313650 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f51180cfeb0 con 0x7f5120106f10 2024-09-19T09:47:28.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.044+0000 7f511e59c640 1 --2- 172.21.15.1:0/1693313650 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f51080a3240 0x7f51080a5700 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f511000bbe0 tx=0x7f511000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:28.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.048+0000 7f510f7fe640 1 -- 172.21.15.1:0/1693313650 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f511809cbd0 con 0x7f5120106f10 2024-09-19T09:47:28.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.260+0000 7f5124fca640 1 -- 172.21.15.1:0/1693313650 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5120109b60 con 0x7f5120106f10 2024-09-19T09:47:28.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.261+0000 7f510f7fe640 1 -- 172.21.15.1:0/1693313650 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11838 (secure 0 0 0) 0x7f511809c4d0 con 0x7f5120106f10 2024-09-19T09:47:28.263 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:47:28.263 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T09:44:50:770090+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":16287,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6839/1975960689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":1975960689},{"type":"v1","addr":"172.21.15.121:6839","nonce":1975960689}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:44:50.770010+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24479":{"gid":24479,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:47:28.263 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T09:47:28.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.263+0000 7f5124fca640 1 -- 172.21.15.1:0/1693313650 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f51080a3240 msgr2=0x7f51080a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:28.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.263+0000 7f5124fca640 1 --2- 172.21.15.1:0/1693313650 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f51080a3240 0x7f51080a5700 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f511000bbe0 tx=0x7f511000b390 comp rx=0 tx=0).stop 2024-09-19T09:47:28.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.263+0000 7f5124fca640 1 -- 172.21.15.1:0/1693313650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5120106f10 msgr2=0x7f512019cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:28.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.263+0000 7f5124fca640 1 --2- 172.21.15.1:0/1693313650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5120106f10 0x7f512019cd00 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f511800eb10 tx=0x7f511800c2d0 comp rx=0 tx=0).stop 2024-09-19T09:47:28.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.263+0000 7f5124fca640 1 -- 172.21.15.1:0/1693313650 shutdown_connections 2024-09-19T09:47:28.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.263+0000 7f5124fca640 1 --2- 172.21.15.1:0/1693313650 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5120106f10 0x7f512019cd00 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:28.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.263+0000 7f5124fca640 1 --2- 172.21.15.1:0/1693313650 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f51080a3240 0x7f51080a5700 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:28.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.263+0000 7f5124fca640 1 --2- 172.21.15.1:0/1693313650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5120102790 0x7f5120198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:28.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.263+0000 7f5124fca640 1 --2- 172.21.15.1:0/1693313650 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5120101de0 0x7f5120198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:28.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.263+0000 7f5124fca640 1 -- 172.21.15.1:0/1693313650 >> 172.21.15.1:0/1693313650 conn(0x7f51200fd8c0 msgr2=0x7f51200fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:28.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.263+0000 7f5124fca640 1 -- 172.21.15.1:0/1693313650 shutdown_connections 2024-09-19T09:47:28.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:28.263+0000 7f5124fca640 1 -- 172.21.15.1:0/1693313650 wait complete. 2024-09-19T09:47:28.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:28 smithi022 ceph-mon[35583]: pgmap v620: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:47:28.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:28 smithi121 ceph-mon[35577]: pgmap v620: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:47:28.715 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:28 smithi001 ceph-mon[31225]: pgmap v620: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-19T09:47:28.943 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:47:29.202 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:47:29.592 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:29 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1693313650' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:47:29.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:29 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1693313650' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:47:29.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:29 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1693313650' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:47:29.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.673+0000 7f020b21d640 1 -- 172.21.15.1:0/739351454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0204106f10 msgr2=0x7f020410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:29.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.673+0000 7f020b21d640 1 --2- 172.21.15.1:0/739351454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0204106f10 0x7f020410ea90 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f01fc009ca0 tx=0x7f01fc02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:47:29.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.673+0000 7f020b21d640 1 -- 172.21.15.1:0/739351454 shutdown_connections 2024-09-19T09:47:29.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.673+0000 7f020b21d640 1 --2- 172.21.15.1:0/739351454 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0204106f10 0x7f020410ea90 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:29.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.673+0000 7f020b21d640 1 --2- 172.21.15.1:0/739351454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0204102790 0x7f02041067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:29.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.673+0000 7f020b21d640 1 --2- 172.21.15.1:0/739351454 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0204101de0 0x7f02041021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:29.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.673+0000 7f020b21d640 1 -- 172.21.15.1:0/739351454 >> 172.21.15.1:0/739351454 conn(0x7f02040fd8c0 msgr2=0x7f02040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:29.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.673+0000 7f020b21d640 1 -- 172.21.15.1:0/739351454 shutdown_connections 2024-09-19T09:47:29.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.673+0000 7f020b21d640 1 -- 172.21.15.1:0/739351454 wait complete. 2024-09-19T09:47:29.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.674+0000 7f020b21d640 1 Processor -- start 2024-09-19T09:47:29.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.674+0000 7f020b21d640 1 -- start start 2024-09-19T09:47:29.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.674+0000 7f020b21d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0204101de0 0x7f02040744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:29.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.674+0000 7f020b21d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0204102790 0x7f0204074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:29.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.674+0000 7f020b21d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0204106f10 0x7f0204074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:29.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.674+0000 7f020b21d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0204111f90 con 0x7f0204102790 2024-09-19T09:47:29.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.674+0000 7f020b21d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0204111e10 con 0x7f0204101de0 2024-09-19T09:47:29.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.674+0000 7f020b21d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0204112110 con 0x7f0204106f10 2024-09-19T09:47:29.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.674+0000 7f0203fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0204102790 0x7f0204074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:29.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.674+0000 7f0203fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0204102790 0x7f0204074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59170/0 (socket says 172.21.15.1:59170) 2024-09-19T09:47:29.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.674+0000 7f0203fff640 1 -- 172.21.15.1:0/2274148823 learned_addr learned my addr 172.21.15.1:0/2274148823 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:47:29.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.674+0000 7f02097ba640 1 --2- 172.21.15.1:0/2274148823 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0204106f10 0x7f0204074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:29.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.674+0000 7f0208fb9640 1 --2- 172.21.15.1:0/2274148823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0204101de0 0x7f02040744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:29.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.674+0000 7f0203fff640 1 -- 172.21.15.1:0/2274148823 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0204106f10 msgr2=0x7f0204074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:29.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.674+0000 7f0203fff640 1 --2- 172.21.15.1:0/2274148823 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0204106f10 0x7f0204074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:29.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.674+0000 7f0203fff640 1 -- 172.21.15.1:0/2274148823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0204101de0 msgr2=0x7f02040744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:29.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.674+0000 7f0203fff640 1 --2- 172.21.15.1:0/2274148823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0204101de0 0x7f02040744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:29.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.674+0000 7f0203fff640 1 -- 172.21.15.1:0/2274148823 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02041a6920 con 0x7f0204102790 2024-09-19T09:47:29.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.674+0000 7f02097ba640 1 --2- 172.21.15.1:0/2274148823 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0204106f10 0x7f0204074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:47:29.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.675+0000 7f0203fff640 1 --2- 172.21.15.1:0/2274148823 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0204102790 0x7f0204074a30 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f01f400c890 tx=0x7f01f400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:29.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.675+0000 7f0201ffb640 1 -- 172.21.15.1:0/2274148823 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f4004220 con 0x7f0204102790 2024-09-19T09:47:29.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.675+0000 7f0201ffb640 1 -- 172.21.15.1:0/2274148823 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01f40043c0 con 0x7f0204102790 2024-09-19T09:47:29.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.675+0000 7f020b21d640 1 -- 172.21.15.1:0/2274148823 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02041a6c10 con 0x7f0204102790 2024-09-19T09:47:29.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.675+0000 7f0201ffb640 1 -- 172.21.15.1:0/2274148823 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f40049e0 con 0x7f0204102790 2024-09-19T09:47:29.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.675+0000 7f020b21d640 1 -- 172.21.15.1:0/2274148823 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02041a7150 con 0x7f0204102790 2024-09-19T09:47:29.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.676+0000 7f020b21d640 1 -- 172.21.15.1:0/2274148823 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02041021c0 con 0x7f0204102790 2024-09-19T09:47:29.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.677+0000 7f0201ffb640 1 -- 172.21.15.1:0/2274148823 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f01f40079b0 con 0x7f0204102790 2024-09-19T09:47:29.703 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.678+0000 7f0201ffb640 1 --2- 172.21.15.1:0/2274148823 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f01f00a3240 0x7f01f00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:29.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.678+0000 7f0201ffb640 1 -- 172.21.15.1:0/2274148823 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f01f40cfa60 con 0x7f0204102790 2024-09-19T09:47:29.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.678+0000 7f0208fb9640 1 --2- 172.21.15.1:0/2274148823 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f01f00a3240 0x7f01f00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:29.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.678+0000 7f0208fb9640 1 --2- 172.21.15.1:0/2274148823 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f01f00a3240 0x7f01f00a5700 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009890 tx=0x7f01ec008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:29.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.682+0000 7f0201ffb640 1 -- 172.21.15.1:0/2274148823 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f01f4014030 con 0x7f0204102790 2024-09-19T09:47:29.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.893+0000 7f020b21d640 1 -- 172.21.15.1:0/2274148823 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0204109b60 con 0x7f0204102790 2024-09-19T09:47:29.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.894+0000 7f0201ffb640 1 -- 172.21.15.1:0/2274148823 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11838 (secure 0 0 0) 0x7f01f409c740 con 0x7f0204102790 2024-09-19T09:47:29.896 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:47:29.896 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":21,"btime":"2024-09-19T09:44:50:770090+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14529,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/553959571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":553959571},{"type":"v1","addr":"172.21.15.1:6835","nonce":553959571}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14541,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/2692725949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":2692725949},{"type":"v1","addr":"172.21.15.1:6837","nonce":2692725949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14589,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6839/2581765152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6838","nonce":2581765152},{"type":"v1","addr":"172.21.15.1:6839","nonce":2581765152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14601,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6841/3388580532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6840","nonce":3388580532},{"type":"v1","addr":"172.21.15.1:6841","nonce":3388580532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":16287,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6839/1975960689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":1975960689},{"type":"v1","addr":"172.21.15.121:6839","nonce":1975960689}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/3676626194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3676626194},{"type":"v1","addr":"172.21.15.22:6833","nonce":3676626194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24436,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/2706759319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":2706759319},{"type":"v1","addr":"172.21.15.121:6833","nonce":2706759319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24458,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/2003930762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":2003930762},{"type":"v1","addr":"172.21.15.22:6835","nonce":2003930762}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2300524808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2300524808},{"type":"v1","addr":"172.21.15.121:6835","nonce":2300524808}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3966150520","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3966150520},{"type":"v1","addr":"172.21.15.121:6837","nonce":3966150520}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T09:36:13.637508+0000","modified":"2024-09-19T09:44:50.770010+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24479":{"gid":24479,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6837/1288432373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":1288432373},{"type":"v1","addr":"172.21.15.22:6837","nonce":1288432373}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6839/2513831228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":2513831228},{"type":"v1","addr":"172.21.15.22:6839","nonce":2513831228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497]},"id":1}]} 2024-09-19T09:47:29.897 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 21 2024-09-19T09:47:29.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.897+0000 7f020b21d640 1 -- 172.21.15.1:0/2274148823 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f01f00a3240 msgr2=0x7f01f00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:29.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.897+0000 7f020b21d640 1 --2- 172.21.15.1:0/2274148823 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f01f00a3240 0x7f01f00a5700 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009890 tx=0x7f01ec008040 comp rx=0 tx=0).stop 2024-09-19T09:47:29.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.897+0000 7f020b21d640 1 -- 172.21.15.1:0/2274148823 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0204102790 msgr2=0x7f0204074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:29.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.897+0000 7f020b21d640 1 --2- 172.21.15.1:0/2274148823 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0204102790 0x7f0204074a30 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f01f400c890 tx=0x7f01f400cd50 comp rx=0 tx=0).stop 2024-09-19T09:47:29.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.897+0000 7f020b21d640 1 -- 172.21.15.1:0/2274148823 shutdown_connections 2024-09-19T09:47:29.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.897+0000 7f020b21d640 1 --2- 172.21.15.1:0/2274148823 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0204106f10 0x7f0204074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:29.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.897+0000 7f020b21d640 1 --2- 172.21.15.1:0/2274148823 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0204102790 0x7f0204074a30 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:29.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.897+0000 7f020b21d640 1 --2- 172.21.15.1:0/2274148823 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f01f00a3240 0x7f01f00a5700 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:29.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.897+0000 7f020b21d640 1 --2- 172.21.15.1:0/2274148823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0204101de0 0x7f02040744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:29.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.897+0000 7f020b21d640 1 -- 172.21.15.1:0/2274148823 >> 172.21.15.1:0/2274148823 conn(0x7f02040fd8c0 msgr2=0x7f02040fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:29.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.897+0000 7f020b21d640 1 -- 172.21.15.1:0/2274148823 shutdown_connections 2024-09-19T09:47:29.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:29.897+0000 7f020b21d640 1 -- 172.21.15.1:0/2274148823 wait complete. 2024-09-19T09:47:30.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:30 smithi001 ceph-mon[31225]: pgmap v621: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-09-19T09:47:30.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:30 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/2274148823' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:47:30.516 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:30 smithi022 ceph-mon[35583]: pgmap v621: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-09-19T09:47:30.516 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:30 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/2274148823' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:47:30.552 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:47:30.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:30 smithi121 ceph-mon[35577]: pgmap v621: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 0 B/s wr, 1 op/s 2024-09-19T09:47:30.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:30 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/2274148823' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:47:30.809 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:47:31.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.283+0000 7f497f742640 1 -- 172.21.15.1:0/2680898901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f497810e480 msgr2=0x7f4978110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:31.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.283+0000 7f497f742640 1 --2- 172.21.15.1:0/2680898901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f497810e480 0x7f4978110870 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f4970009ca0 tx=0x7f497002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:47:31.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.283+0000 7f497f742640 1 -- 172.21.15.1:0/2680898901 shutdown_connections 2024-09-19T09:47:31.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.283+0000 7f497f742640 1 --2- 172.21.15.1:0/2680898901 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f497810e480 0x7f4978110870 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:31.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.283+0000 7f497f742640 1 --2- 172.21.15.1:0/2680898901 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4978101280 0x7f497810df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:31.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.283+0000 7f497f742640 1 --2- 172.21.15.1:0/2680898901 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49781008d0 0x7f4978100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:31.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.283+0000 7f497f742640 1 -- 172.21.15.1:0/2680898901 >> 172.21.15.1:0/2680898901 conn(0x7f49780fc7a0 msgr2=0x7f49780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:31.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.283+0000 7f497f742640 1 -- 172.21.15.1:0/2680898901 shutdown_connections 2024-09-19T09:47:31.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.283+0000 7f497f742640 1 -- 172.21.15.1:0/2680898901 wait complete. 2024-09-19T09:47:31.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.284+0000 7f497f742640 1 Processor -- start 2024-09-19T09:47:31.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.284+0000 7f497f742640 1 -- start start 2024-09-19T09:47:31.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.284+0000 7f497f742640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49781008d0 0x7f497819a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:31.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.284+0000 7f497f742640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4978101280 0x7f497819ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:31.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.284+0000 7f497f742640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f497810e480 0x7f497819efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:31.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.284+0000 7f497f742640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4978114160 con 0x7f49781008d0 2024-09-19T09:47:31.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.284+0000 7f497f742640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4978113fe0 con 0x7f497810e480 2024-09-19T09:47:31.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.284+0000 7f497f742640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f49781142e0 con 0x7f4978101280 2024-09-19T09:47:31.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.284+0000 7f497d4de640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49781008d0 0x7f497819a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:31.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.284+0000 7f497d4de640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49781008d0 0x7f497819a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59194/0 (socket says 172.21.15.1:59194) 2024-09-19T09:47:31.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.284+0000 7f497d4de640 1 -- 172.21.15.1:0/2757242260 learned_addr learned my addr 172.21.15.1:0/2757242260 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:47:31.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.284+0000 7f497dcdf640 1 --2- 172.21.15.1:0/2757242260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f497810e480 0x7f497819efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:31.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.284+0000 7f497ccdd640 1 --2- 172.21.15.1:0/2757242260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4978101280 0x7f497819ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:31.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.284+0000 7f497d4de640 1 -- 172.21.15.1:0/2757242260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4978101280 msgr2=0x7f497819ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:31.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.284+0000 7f497d4de640 1 --2- 172.21.15.1:0/2757242260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4978101280 0x7f497819ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:31.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.284+0000 7f497d4de640 1 -- 172.21.15.1:0/2757242260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f497810e480 msgr2=0x7f497819efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:31.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.284+0000 7f497d4de640 1 --2- 172.21.15.1:0/2757242260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f497810e480 0x7f497819efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:31.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.284+0000 7f497d4de640 1 -- 172.21.15.1:0/2757242260 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497819f690 con 0x7f49781008d0 2024-09-19T09:47:31.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.285+0000 7f497d4de640 1 --2- 172.21.15.1:0/2757242260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49781008d0 0x7f497819a6e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f497400d950 tx=0x7f497400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:31.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.285+0000 7f496e7fc640 1 -- 172.21.15.1:0/2757242260 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4974017070 con 0x7f49781008d0 2024-09-19T09:47:31.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.285+0000 7f496e7fc640 1 -- 172.21.15.1:0/2757242260 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4974009c30 con 0x7f49781008d0 2024-09-19T09:47:31.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.285+0000 7f497f742640 1 -- 172.21.15.1:0/2757242260 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f497819f980 con 0x7f49781008d0 2024-09-19T09:47:31.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.285+0000 7f496e7fc640 1 -- 172.21.15.1:0/2757242260 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497400f6b0 con 0x7f49781008d0 2024-09-19T09:47:31.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.285+0000 7f497f742640 1 -- 172.21.15.1:0/2757242260 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49781a7260 con 0x7f49781008d0 2024-09-19T09:47:31.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.286+0000 7f497f742640 1 -- 172.21.15.1:0/2757242260 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4978100cb0 con 0x7f49781008d0 2024-09-19T09:47:31.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.287+0000 7f496e7fc640 1 -- 172.21.15.1:0/2757242260 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f49740109d0 con 0x7f49781008d0 2024-09-19T09:47:31.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.288+0000 7f496e7fc640 1 --2- 172.21.15.1:0/2757242260 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f49640a32c0 0x7f49640a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:31.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.288+0000 7f497ccdd640 1 --2- 172.21.15.1:0/2757242260 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f49640a32c0 0x7f49640a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:31.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.288+0000 7f496e7fc640 1 -- 172.21.15.1:0/2757242260 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7f49740cf460 con 0x7f49781008d0 2024-09-19T09:47:31.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.288+0000 7f497ccdd640 1 --2- 172.21.15.1:0/2757242260 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f49640a32c0 0x7f49640a5780 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f497810ed50 tx=0x7f496800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:31.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.291+0000 7f496e7fc640 1 -- 172.21.15.1:0/2757242260 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4974009de0 con 0x7f49781008d0 2024-09-19T09:47:31.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.467+0000 7f497f742640 1 -- 172.21.15.1:0/2757242260 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f497819ba40 con 0x7f49781008d0 2024-09-19T09:47:31.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.469+0000 7f496e7fc640 1 -- 172.21.15.1:0/2757242260 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22612 (secure 0 0 0) 0x7f497819ba40 con 0x7f49781008d0 2024-09-19T09:47:31.472 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-09-19T09:47:31.472 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":84,"fsid":"57238232-7669-11ef-bceb-c7b262605968","created":"2024-09-19T09:28:28.406983+0000","modified":"2024-09-19T09:44:50.109294+0000","last_up_change":"2024-09-19T09:35:21.422825+0000","last_in_change":"2024-09-19T09:34:57.199184+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:31:30.566509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:36:09.521275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:36:11.954337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c165571d-43f1-4c43-ba1e-35872d914f11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6803","nonce":502676986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6805","nonce":502676986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6809","nonce":502676986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":502676986},{"type":"v1","addr":"172.21.15.1:6807","nonce":502676986}]},"public_addr":"172.21.15.1:6803/502676986","cluster_addr":"172.21.15.1:6805/502676986","heartbeat_back_addr":"172.21.15.1:6809/502676986","heartbeat_front_addr":"172.21.15.1:6807/502676986","state":["exists","up"]},{"osd":1,"uuid":"baf120f8-8ba3-4aa5-a12a-41cdc97ff11b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6801","nonce":3735826323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6803","nonce":3735826323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6807","nonce":3735826323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":3735826323},{"type":"v1","addr":"172.21.15.22:6805","nonce":3735826323}]},"public_addr":"172.21.15.22:6801/3735826323","cluster_addr":"172.21.15.22:6803/3735826323","heartbeat_back_addr":"172.21.15.22:6807/3735826323","heartbeat_front_addr":"172.21.15.22:6805/3735826323","state":["exists","up"]},{"osd":2,"uuid":"72c520bf-c5cc-44ee-a38c-c9bac0a6280b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6801","nonce":1924970833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6803","nonce":1924970833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6807","nonce":1924970833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":1924970833},{"type":"v1","addr":"172.21.15.121:6805","nonce":1924970833}]},"public_addr":"172.21.15.121:6801/1924970833","cluster_addr":"172.21.15.121:6803/1924970833","heartbeat_back_addr":"172.21.15.121:6807/1924970833","heartbeat_front_addr":"172.21.15.121:6805/1924970833","state":["exists","up"]},{"osd":3,"uuid":"adad6d17-16d9-4c43-b581-35ac1bb9d807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6811","nonce":1515009793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6813","nonce":1515009793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6817","nonce":1515009793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":1515009793},{"type":"v1","addr":"172.21.15.1:6815","nonce":1515009793}]},"public_addr":"172.21.15.1:6811/1515009793","cluster_addr":"172.21.15.1:6813/1515009793","heartbeat_back_addr":"172.21.15.1:6817/1515009793","heartbeat_front_addr":"172.21.15.1:6815/1515009793","state":["exists","up"]},{"osd":4,"uuid":"8fb06efe-c3a0-48a3-9730-3e8f3e60922d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6809","nonce":923697266}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6811","nonce":923697266}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6815","nonce":923697266}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":923697266},{"type":"v1","addr":"172.21.15.22:6813","nonce":923697266}]},"public_addr":"172.21.15.22:6809/923697266","cluster_addr":"172.21.15.22:6811/923697266","heartbeat_back_addr":"172.21.15.22:6815/923697266","heartbeat_front_addr":"172.21.15.22:6813/923697266","state":["exists","up"]},{"osd":5,"uuid":"3b2f428c-8a5a-49be-9f43-a9f379a1c7e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6809","nonce":3137245658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6811","nonce":3137245658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6815","nonce":3137245658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3137245658},{"type":"v1","addr":"172.21.15.121:6813","nonce":3137245658}]},"public_addr":"172.21.15.121:6809/3137245658","cluster_addr":"172.21.15.121:6811/3137245658","heartbeat_back_addr":"172.21.15.121:6815/3137245658","heartbeat_front_addr":"172.21.15.121:6813/3137245658","state":["exists","up"]},{"osd":6,"uuid":"5aecec68-ff7e-440c-bd39-cc35ab89cc91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6819","nonce":3376780798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6821","nonce":3376780798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6825","nonce":3376780798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":3376780798},{"type":"v1","addr":"172.21.15.1:6823","nonce":3376780798}]},"public_addr":"172.21.15.1:6819/3376780798","cluster_addr":"172.21.15.1:6821/3376780798","heartbeat_back_addr":"172.21.15.1:6825/3376780798","heartbeat_front_addr":"172.21.15.1:6823/3376780798","state":["exists","up"]},{"osd":7,"uuid":"46556bdf-199e-4268-873b-6d87b54e1176","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6817","nonce":2920985295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6819","nonce":2920985295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6823","nonce":2920985295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":2920985295},{"type":"v1","addr":"172.21.15.22:6821","nonce":2920985295}]},"public_addr":"172.21.15.22:6817/2920985295","cluster_addr":"172.21.15.22:6819/2920985295","heartbeat_back_addr":"172.21.15.22:6823/2920985295","heartbeat_front_addr":"172.21.15.22:6821/2920985295","state":["exists","up"]},{"osd":8,"uuid":"e7c3792a-94a4-4440-be74-d6abdf3d9566","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6817","nonce":3589985967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6819","nonce":3589985967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6823","nonce":3589985967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":3589985967},{"type":"v1","addr":"172.21.15.121:6821","nonce":3589985967}]},"public_addr":"172.21.15.121:6817/3589985967","cluster_addr":"172.21.15.121:6819/3589985967","heartbeat_back_addr":"172.21.15.121:6823/3589985967","heartbeat_front_addr":"172.21.15.121:6821/3589985967","state":["exists","up"]},{"osd":9,"uuid":"8af80ac9-d681-4966-b083-ead5185eff12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6827","nonce":1143859822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6829","nonce":1143859822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6833","nonce":1143859822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":1143859822},{"type":"v1","addr":"172.21.15.1:6831","nonce":1143859822}]},"public_addr":"172.21.15.1:6827/1143859822","cluster_addr":"172.21.15.1:6829/1143859822","heartbeat_back_addr":"172.21.15.1:6833/1143859822","heartbeat_front_addr":"172.21.15.1:6831/1143859822","state":["exists","up"]},{"osd":10,"uuid":"34edd06a-7f60-4465-bfe1-0c646abd53f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6825","nonce":343155547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6827","nonce":343155547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6831","nonce":343155547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":343155547},{"type":"v1","addr":"172.21.15.22:6829","nonce":343155547}]},"public_addr":"172.21.15.22:6825/343155547","cluster_addr":"172.21.15.22:6827/343155547","heartbeat_back_addr":"172.21.15.22:6831/343155547","heartbeat_front_addr":"172.21.15.22:6829/343155547","state":["exists","up"]},{"osd":11,"uuid":"5a831eb6-ad66-4ab6-a30a-b6299ce1f88d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6825","nonce":3202514460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6827","nonce":3202514460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6831","nonce":3202514460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3202514460},{"type":"v1","addr":"172.21.15.121:6829","nonce":3202514460}]},"public_addr":"172.21.15.121:6825/3202514460","cluster_addr":"172.21.15.121:6827/3202514460","heartbeat_back_addr":"172.21.15.121:6831/3202514460","heartbeat_front_addr":"172.21.15.121:6829/3202514460","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:30:37.582893+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:01.915252+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:26.783477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:31:53.407014+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:19.407005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:32:45.022320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:11.377986+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:33:36.818700+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:01.745428+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:27.928916+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:34:53.363906+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:35:19.037551+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.1:6800/1028873727":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/3137949087":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/1951370933":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2008363642":"2024-09-20T09:28:50.074985+0000","172.21.15.1:0/3006931063":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2486161758":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6801/1296304385":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6801/1028873727":"2024-09-20T09:29:14.046960+0000","172.21.15.1:0/2783823049":"2024-09-20T09:28:50.074985+0000","172.21.15.1:6800/1296304385":"2024-09-20T09:28:50.074985+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:47:31.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.471+0000 7f497f742640 1 -- 172.21.15.1:0/2757242260 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f49640a32c0 msgr2=0x7f49640a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:31.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.471+0000 7f497f742640 1 --2- 172.21.15.1:0/2757242260 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f49640a32c0 0x7f49640a5780 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f497810ed50 tx=0x7f496800b410 comp rx=0 tx=0).stop 2024-09-19T09:47:31.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.471+0000 7f497f742640 1 -- 172.21.15.1:0/2757242260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49781008d0 msgr2=0x7f497819a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:31.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.471+0000 7f497f742640 1 --2- 172.21.15.1:0/2757242260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49781008d0 0x7f497819a6e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f497400d950 tx=0x7f497400de10 comp rx=0 tx=0).stop 2024-09-19T09:47:31.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.472+0000 7f497f742640 1 -- 172.21.15.1:0/2757242260 shutdown_connections 2024-09-19T09:47:31.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.472+0000 7f497f742640 1 --2- 172.21.15.1:0/2757242260 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f49640a32c0 0x7f49640a5780 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:31.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.472+0000 7f497f742640 1 --2- 172.21.15.1:0/2757242260 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f497810e480 0x7f497819efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:31.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.472+0000 7f497f742640 1 --2- 172.21.15.1:0/2757242260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4978101280 0x7f497819ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:31.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.472+0000 7f497f742640 1 --2- 172.21.15.1:0/2757242260 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f49781008d0 0x7f497819a6e0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:31.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.472+0000 7f497f742640 1 -- 172.21.15.1:0/2757242260 >> 172.21.15.1:0/2757242260 conn(0x7f49780fc7a0 msgr2=0x7f49780feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:31.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.472+0000 7f497f742640 1 -- 172.21.15.1:0/2757242260 shutdown_connections 2024-09-19T09:47:31.474 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:31.472+0000 7f497f742640 1 -- 172.21.15.1:0/2757242260 wait complete. 2024-09-19T09:47:32.139 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-19T09:47:32.397 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:47:32.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:32 smithi001 ceph-mon[31225]: pgmap v622: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-19T09:47:32.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:32 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/2757242260' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:47:32.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:32 smithi022 ceph-mon[35583]: pgmap v622: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-19T09:47:32.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:32 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/2757242260' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:47:32.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:32 smithi121 ceph-mon[35577]: pgmap v622: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-19T09:47:32.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:32 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/2757242260' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:47:32.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.884+0000 7fe54f999640 1 -- 172.21.15.1:0/2827714204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe548102570 msgr2=0x7fe5481029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:32.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.884+0000 7fe54f999640 1 --2- 172.21.15.1:0/2827714204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe548102570 0x7fe5481029b0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fe53c009900 tx=0x7fe53c02a480 comp rx=0 tx=0).stop 2024-09-19T09:47:32.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.884+0000 7fe54f999640 1 -- 172.21.15.1:0/2827714204 shutdown_connections 2024-09-19T09:47:32.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.884+0000 7fe54f999640 1 --2- 172.21.15.1:0/2827714204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe548102ef0 0x7fe54810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:32.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.884+0000 7fe54f999640 1 --2- 172.21.15.1:0/2827714204 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe548102570 0x7fe5481029b0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:32.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.884+0000 7fe54f999640 1 --2- 172.21.15.1:0/2827714204 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe548100e20 0x7fe548101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:32.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.884+0000 7fe54f999640 1 -- 172.21.15.1:0/2827714204 >> 172.21.15.1:0/2827714204 conn(0x7fe5480fc7d0 msgr2=0x7fe5480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:32.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.884+0000 7fe54f999640 1 -- 172.21.15.1:0/2827714204 shutdown_connections 2024-09-19T09:47:32.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.884+0000 7fe54f999640 1 -- 172.21.15.1:0/2827714204 wait complete. 2024-09-19T09:47:32.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.884+0000 7fe54f999640 1 Processor -- start 2024-09-19T09:47:32.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.884+0000 7fe54f999640 1 -- start start 2024-09-19T09:47:32.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.885+0000 7fe54f999640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe548100e20 0x7fe548199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:32.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.885+0000 7fe54f999640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe548102570 0x7fe548199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:32.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.885+0000 7fe54f999640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe548102ef0 0x7fe5481a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:32.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.885+0000 7fe54f999640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe548110f80 con 0x7fe548100e20 2024-09-19T09:47:32.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.885+0000 7fe54f999640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe548110e00 con 0x7fe548102570 2024-09-19T09:47:32.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.885+0000 7fe54f999640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe548111100 con 0x7fe548102ef0 2024-09-19T09:47:32.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.885+0000 7fe54d735640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe548100e20 0x7fe548199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:32.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.885+0000 7fe54d735640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe548100e20 0x7fe548199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59212/0 (socket says 172.21.15.1:59212) 2024-09-19T09:47:32.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.885+0000 7fe54d735640 1 -- 172.21.15.1:0/1931993671 learned_addr learned my addr 172.21.15.1:0/1931993671 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:47:32.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.885+0000 7fe54df36640 1 --2- 172.21.15.1:0/1931993671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe548102ef0 0x7fe5481a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:32.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.885+0000 7fe54cf34640 1 --2- 172.21.15.1:0/1931993671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe548102570 0x7fe548199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:32.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.885+0000 7fe54d735640 1 -- 172.21.15.1:0/1931993671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe548102ef0 msgr2=0x7fe5481a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:32.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.885+0000 7fe54d735640 1 --2- 172.21.15.1:0/1931993671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe548102ef0 0x7fe5481a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:32.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.885+0000 7fe54d735640 1 -- 172.21.15.1:0/1931993671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe548102570 msgr2=0x7fe548199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:32.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.885+0000 7fe54d735640 1 --2- 172.21.15.1:0/1931993671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe548102570 0x7fe548199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:32.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.885+0000 7fe54d735640 1 -- 172.21.15.1:0/1931993671 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5481a4910 con 0x7fe548100e20 2024-09-19T09:47:32.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.885+0000 7fe54df36640 1 --2- 172.21.15.1:0/1931993671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe548102ef0 0x7fe5481a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:47:32.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.885+0000 7fe54d735640 1 --2- 172.21.15.1:0/1931993671 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe548100e20 0x7fe548199350 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fe53800ea80 tx=0x7fe53800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:32.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.885+0000 7fe5467fc640 1 -- 172.21.15.1:0/1931993671 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53800ce40 con 0x7fe548100e20 2024-09-19T09:47:32.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.885+0000 7fe5467fc640 1 -- 172.21.15.1:0/1931993671 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe538005020 con 0x7fe548100e20 2024-09-19T09:47:32.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.885+0000 7fe54f999640 1 -- 172.21.15.1:0/1931993671 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5481a4ae0 con 0x7fe548100e20 2024-09-19T09:47:32.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.885+0000 7fe5467fc640 1 -- 172.21.15.1:0/1931993671 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe538011760 con 0x7fe548100e20 2024-09-19T09:47:32.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.885+0000 7fe54f999640 1 -- 172.21.15.1:0/1931993671 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5481a4fa0 con 0x7fe548100e20 2024-09-19T09:47:32.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.886+0000 7fe54f999640 1 -- 172.21.15.1:0/1931993671 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe548101200 con 0x7fe548100e20 2024-09-19T09:47:32.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.888+0000 7fe5467fc640 1 -- 172.21.15.1:0/1931993671 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7fe5380051d0 con 0x7fe548100e20 2024-09-19T09:47:32.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.888+0000 7fe5467fc640 1 --2- 172.21.15.1:0/1931993671 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe5300a3240 0x7fe5300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:32.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.888+0000 7fe54cf34640 1 --2- 172.21.15.1:0/1931993671 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe5300a3240 0x7fe5300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:32.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.888+0000 7fe5467fc640 1 -- 172.21.15.1:0/1931993671 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8240+0+0 (secure 0 0 0) 0x7fe5380d0000 con 0x7fe548100e20 2024-09-19T09:47:32.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.889+0000 7fe54cf34640 1 --2- 172.21.15.1:0/1931993671 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe5300a3240 0x7fe5300a5700 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe53c0096c0 tx=0x7fe53c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:32.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:32.891+0000 7fe5467fc640 1 -- 172.21.15.1:0/1931993671 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe538016030 con 0x7fe548100e20 2024-09-19T09:47:33.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:33.104+0000 7fe54f999640 1 -- 172.21.15.1:0/1931993671 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe54806a560 con 0x7fe548100e20 2024-09-19T09:47:33.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:33.106+0000 7fe5467fc640 1 -- 172.21.15.1:0/1931993671 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) ==== 161+0+0 (secure 0 0 0) 0x7fe54806a560 con 0x7fe548100e20 2024-09-19T09:47:33.108 INFO:teuthology.orchestra.run.smithi001.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T09:47:33.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:33.109+0000 7fe54f999640 1 -- 172.21.15.1:0/1931993671 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe5300a3240 msgr2=0x7fe5300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:33.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:33.109+0000 7fe54f999640 1 --2- 172.21.15.1:0/1931993671 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe5300a3240 0x7fe5300a5700 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe53c0096c0 tx=0x7fe53c000bc0 comp rx=0 tx=0).stop 2024-09-19T09:47:33.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:33.109+0000 7fe54f999640 1 -- 172.21.15.1:0/1931993671 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe548100e20 msgr2=0x7fe548199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:33.111 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:33.109+0000 7fe54f999640 1 --2- 172.21.15.1:0/1931993671 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe548100e20 0x7fe548199350 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fe53800ea80 tx=0x7fe53800ef40 comp rx=0 tx=0).stop 2024-09-19T09:47:33.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:33.109+0000 7fe54f999640 1 -- 172.21.15.1:0/1931993671 shutdown_connections 2024-09-19T09:47:33.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:33.109+0000 7fe54f999640 1 --2- 172.21.15.1:0/1931993671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe548102ef0 0x7fe5481a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:33.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:33.109+0000 7fe54f999640 1 --2- 172.21.15.1:0/1931993671 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7fe5300a3240 0x7fe5300a5700 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:33.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:33.109+0000 7fe54f999640 1 --2- 172.21.15.1:0/1931993671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe548102570 0x7fe548199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:33.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:33.109+0000 7fe54f999640 1 --2- 172.21.15.1:0/1931993671 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe548100e20 0x7fe548199350 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:33.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:33.109+0000 7fe54f999640 1 -- 172.21.15.1:0/1931993671 >> 172.21.15.1:0/1931993671 conn(0x7fe5480fc7d0 msgr2=0x7fe5480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:33.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:33.110+0000 7fe54f999640 1 -- 172.21.15.1:0/1931993671 shutdown_connections 2024-09-19T09:47:33.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:33.110+0000 7fe54f999640 1 -- 172.21.15.1:0/1931993671 wait complete. 2024-09-19T09:47:33.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:33 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mon-a[31221]: 2024-09-19T09:47:33.105+0000 7f1a83a8f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:47:33.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:33 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1931993671' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T09:47:33.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:33 smithi001 ceph-mon[31225]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:47:33.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:33 smithi001 ceph-mon[31225]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:47:33.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:33 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1931993671' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T09:47:33.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:33 smithi001 ceph-mon[31225]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T09:47:33.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:33 smithi001 ceph-mon[31225]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-19T09:47:33.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:33 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1931993671' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T09:47:33.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:33 smithi022 ceph-mon[35583]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:47:33.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:33 smithi022 ceph-mon[35583]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:47:33.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:33 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1931993671' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T09:47:33.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:33 smithi022 ceph-mon[35583]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T09:47:33.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:33 smithi022 ceph-mon[35583]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-19T09:47:33.615 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:47:33 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-b[65343]: ignoring --setuser ceph since I am not root 2024-09-19T09:47:33.615 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:47:33 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-b[65343]: ignoring --setgroup ceph since I am not root 2024-09-19T09:47:33.616 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:47:33 smithi022 ceph-mds[65347]: -- 172.21.15.22:0/2610676975 <== mon.2 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5647e9cebc20 con 0x5647e9cc9400 2024-09-19T09:47:33.616 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:47:33 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-b[65343]: starting mds.b at 2024-09-19T09:47:33.616 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:47:33 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-h[65031]: ignoring --setuser ceph since I am not root 2024-09-19T09:47:33.616 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:47:33 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-h[65031]: ignoring --setgroup ceph since I am not root 2024-09-19T09:47:33.616 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:47:33 smithi022 ceph-mds[65035]: -- 172.21.15.22:0/1109884459 <== mon.2 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561709427c20 con 0x561709405000 2024-09-19T09:47:33.616 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:47:33 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-h[65031]: starting mds.h at 2024-09-19T09:47:33.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:33 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1931993671' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T09:47:33.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:33 smithi121 ceph-mon[35577]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:47:33.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:33 smithi121 ceph-mon[35577]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:47:33.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:33 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1931993671' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T09:47:33.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:33 smithi121 ceph-mon[35577]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T09:47:33.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:33 smithi121 ceph-mon[35577]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-19T09:47:33.907 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T09:47:34.168 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:47:34.556 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:34 smithi001 ceph-mon[31225]: pgmap v623: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:47:34.556 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:34 smithi001 ceph-mon[31225]: mds.? [v2:172.21.15.22:6836/1424813820,v1:172.21.15.22:6838/1424813820] up:boot 2024-09-19T09:47:34.556 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:34 smithi001 ceph-mon[31225]: mds.? [v2:172.21.15.22:6837/36374321,v1:172.21.15.22:6839/36374321] up:boot 2024-09-19T09:47:34.556 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:34 smithi001 ceph-mon[31225]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-19T09:47:34.556 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:34 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:47:34.556 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:34 smithi001 ceph-mon[31225]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:47:34.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:34 smithi022 ceph-mon[35583]: pgmap v623: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:47:34.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:34 smithi022 ceph-mon[35583]: mds.? [v2:172.21.15.22:6836/1424813820,v1:172.21.15.22:6838/1424813820] up:boot 2024-09-19T09:47:34.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:34 smithi022 ceph-mon[35583]: mds.? [v2:172.21.15.22:6837/36374321,v1:172.21.15.22:6839/36374321] up:boot 2024-09-19T09:47:34.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:34 smithi022 ceph-mon[35583]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-19T09:47:34.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:34 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:47:34.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:34 smithi022 ceph-mon[35583]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:47:34.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:34 smithi121 ceph-mon[35577]: pgmap v623: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 2 op/s 2024-09-19T09:47:34.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:34 smithi121 ceph-mon[35577]: mds.? [v2:172.21.15.22:6836/1424813820,v1:172.21.15.22:6838/1424813820] up:boot 2024-09-19T09:47:34.618 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:34 smithi121 ceph-mon[35577]: mds.? [v2:172.21.15.22:6837/36374321,v1:172.21.15.22:6839/36374321] up:boot 2024-09-19T09:47:34.618 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:34 smithi121 ceph-mon[35577]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-19T09:47:34.618 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:34 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:47:34.618 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:34 smithi121 ceph-mon[35577]: from='mgr.14150 172.21.15.1:0/717424603' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:47:34.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.638+0000 7f35733de640 1 -- 172.21.15.1:0/870695915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f356c102790 msgr2=0x7f356c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:34.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.638+0000 7f35733de640 1 --2- 172.21.15.1:0/870695915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f356c102790 0x7f356c1067e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f355c009900 tx=0x7f355c02a410 comp rx=0 tx=0).stop 2024-09-19T09:47:34.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.638+0000 7f35733de640 1 -- 172.21.15.1:0/870695915 shutdown_connections 2024-09-19T09:47:34.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.638+0000 7f35733de640 1 --2- 172.21.15.1:0/870695915 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f356c106f10 0x7f356c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:34.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.638+0000 7f35733de640 1 --2- 172.21.15.1:0/870695915 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f356c102790 0x7f356c1067e0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:34.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.638+0000 7f35733de640 1 --2- 172.21.15.1:0/870695915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f356c101de0 0x7f356c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:34.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.638+0000 7f35733de640 1 -- 172.21.15.1:0/870695915 >> 172.21.15.1:0/870695915 conn(0x7f356c0fd8c0 msgr2=0x7f356c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:34.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.638+0000 7f35733de640 1 -- 172.21.15.1:0/870695915 shutdown_connections 2024-09-19T09:47:34.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.638+0000 7f35733de640 1 -- 172.21.15.1:0/870695915 wait complete. 2024-09-19T09:47:34.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.639+0000 7f35733de640 1 Processor -- start 2024-09-19T09:47:34.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.639+0000 7f35733de640 1 -- start start 2024-09-19T09:47:34.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.639+0000 7f35733de640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f356c101de0 0x7f356c1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:34.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.639+0000 7f35733de640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f356c102790 0x7f356c1989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:34.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.639+0000 7f35733de640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f356c106f10 0x7f356c19cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:34.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.639+0000 7f35733de640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f356c111fe0 con 0x7f356c102790 2024-09-19T09:47:34.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.639+0000 7f35733de640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f356c111e60 con 0x7f356c101de0 2024-09-19T09:47:34.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.639+0000 7f35733de640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f356c112160 con 0x7f356c106f10 2024-09-19T09:47:34.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.639+0000 7f3570979640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f356c102790 0x7f356c1989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:34.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.639+0000 7f3570979640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f356c102790 0x7f356c1989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:59230/0 (socket says 172.21.15.1:59230) 2024-09-19T09:47:34.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.639+0000 7f3570979640 1 -- 172.21.15.1:0/1000095545 learned_addr learned my addr 172.21.15.1:0/1000095545 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:47:34.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.639+0000 7f357117a640 1 --2- 172.21.15.1:0/1000095545 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f356c101de0 0x7f356c1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:34.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.640+0000 7f357197b640 1 --2- 172.21.15.1:0/1000095545 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f356c106f10 0x7f356c19cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:34.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.640+0000 7f3570979640 1 -- 172.21.15.1:0/1000095545 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f356c106f10 msgr2=0x7f356c19cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:34.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.640+0000 7f3570979640 1 --2- 172.21.15.1:0/1000095545 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f356c106f10 0x7f356c19cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:34.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.640+0000 7f3570979640 1 -- 172.21.15.1:0/1000095545 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f356c101de0 msgr2=0x7f356c1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:34.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.640+0000 7f3570979640 1 --2- 172.21.15.1:0/1000095545 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f356c101de0 0x7f356c1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:34.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.640+0000 7f3570979640 1 -- 172.21.15.1:0/1000095545 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f356c19d450 con 0x7f356c102790 2024-09-19T09:47:34.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.640+0000 7f3570979640 1 --2- 172.21.15.1:0/1000095545 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f356c102790 0x7f356c1989e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f355c004770 tx=0x7f355c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:34.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.640+0000 7f35627fc640 1 -- 172.21.15.1:0/1000095545 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355c03f070 con 0x7f356c102790 2024-09-19T09:47:34.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.640+0000 7f35627fc640 1 -- 172.21.15.1:0/1000095545 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f355c031ca0 con 0x7f356c102790 2024-09-19T09:47:34.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.640+0000 7f35733de640 1 -- 172.21.15.1:0/1000095545 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f356c19d6e0 con 0x7f356c102790 2024-09-19T09:47:34.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.640+0000 7f35627fc640 1 -- 172.21.15.1:0/1000095545 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355c035030 con 0x7f356c102790 2024-09-19T09:47:34.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.640+0000 7f35733de640 1 -- 172.21.15.1:0/1000095545 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f356c1a5020 con 0x7f356c102790 2024-09-19T09:47:34.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.641+0000 7f35733de640 1 -- 172.21.15.1:0/1000095545 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f356c1021c0 con 0x7f356c102790 2024-09-19T09:47:34.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.642+0000 7f35627fc640 1 -- 172.21.15.1:0/1000095545 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f355c042070 con 0x7f356c102790 2024-09-19T09:47:34.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.643+0000 7f35627fc640 1 --2- 172.21.15.1:0/1000095545 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f35580a32c0 0x7f35580a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:34.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.643+0000 7f357117a640 1 --2- 172.21.15.1:0/1000095545 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f35580a32c0 0x7f35580a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:34.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.643+0000 7f35627fc640 1 -- 172.21.15.1:0/1000095545 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8326+0+0 (secure 0 0 0) 0x7f355c0f0170 con 0x7f356c102790 2024-09-19T09:47:34.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.644+0000 7f357117a640 1 --2- 172.21.15.1:0/1000095545 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f35580a32c0 0x7f35580a5780 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3568009990 tx=0x7f3568009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:34.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.648+0000 7f35627fc640 1 -- 172.21.15.1:0/1000095545 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f355c0bcdd0 con 0x7f356c102790 2024-09-19T09:47:34.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:34.862+0000 7f35733de640 1 -- 172.21.15.1:0/1000095545 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f356c10a120 con 0x7f356c102790 2024-09-19T09:47:35.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:35.277+0000 7f35627fc640 1 -- 172.21.15.1:0/1000095545 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) ==== 104+0+0 (secure 0 0 0) 0x7f355c0bc6d0 con 0x7f356c102790 2024-09-19T09:47:35.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:35.279+0000 7f35733de640 1 -- 172.21.15.1:0/1000095545 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f35580a32c0 msgr2=0x7f35580a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:35.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:35.279+0000 7f35733de640 1 --2- 172.21.15.1:0/1000095545 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f35580a32c0 0x7f35580a5780 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3568009990 tx=0x7f3568009110 comp rx=0 tx=0).stop 2024-09-19T09:47:35.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:35.279+0000 7f35733de640 1 -- 172.21.15.1:0/1000095545 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f356c102790 msgr2=0x7f356c1989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:35.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:35.279+0000 7f35733de640 1 --2- 172.21.15.1:0/1000095545 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f356c102790 0x7f356c1989e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f355c004770 tx=0x7f355c003c10 comp rx=0 tx=0).stop 2024-09-19T09:47:35.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:35.279+0000 7f35733de640 1 -- 172.21.15.1:0/1000095545 shutdown_connections 2024-09-19T09:47:35.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:35.279+0000 7f35733de640 1 --2- 172.21.15.1:0/1000095545 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f356c106f10 0x7f356c19cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:35.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:35.279+0000 7f35733de640 1 --2- 172.21.15.1:0/1000095545 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f356c102790 0x7f356c1989e0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:35.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:35.279+0000 7f35733de640 1 --2- 172.21.15.1:0/1000095545 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f35580a32c0 0x7f35580a5780 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:35.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:35.279+0000 7f35733de640 1 --2- 172.21.15.1:0/1000095545 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f356c101de0 0x7f356c1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:35.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:35.279+0000 7f35733de640 1 -- 172.21.15.1:0/1000095545 >> 172.21.15.1:0/1000095545 conn(0x7f356c0fd8c0 msgr2=0x7f356c0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:35.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:35.279+0000 7f35733de640 1 -- 172.21.15.1:0/1000095545 shutdown_connections 2024-09-19T09:47:35.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:35.279+0000 7f35733de640 1 -- 172.21.15.1:0/1000095545 wait complete. 2024-09-19T09:47:35.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:35 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1000095545' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:47:35.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:35 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1000095545' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:47:35.652 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:35 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1000095545' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:47:35.988 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T09:47:36.250 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:47:36.529 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:36 smithi001 ceph-mon[31225]: pgmap v625: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-19T09:47:36.529 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:36 smithi001 ceph-mon[31225]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:47:36.529 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:36 smithi001 ceph-mon[31225]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:47:36.529 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:36 smithi001 ceph-mon[31225]: Cluster is now healthy 2024-09-19T09:47:36.529 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:36 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/1000095545' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:47:36.529 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:36 smithi001 ceph-mon[31225]: fsmap 12 up:standby 2024-09-19T09:47:36.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:36 smithi022 ceph-mon[35583]: pgmap v625: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-19T09:47:36.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:36 smithi022 ceph-mon[35583]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:47:36.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:36 smithi022 ceph-mon[35583]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:47:36.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:36 smithi022 ceph-mon[35583]: Cluster is now healthy 2024-09-19T09:47:36.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:36 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/1000095545' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:47:36.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:36 smithi022 ceph-mon[35583]: fsmap 12 up:standby 2024-09-19T09:47:36.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:36 smithi121 ceph-mon[35577]: pgmap v625: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 307 B/s wr, 2 op/s 2024-09-19T09:47:36.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:36 smithi121 ceph-mon[35577]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:47:36.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:36 smithi121 ceph-mon[35577]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:47:36.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:36 smithi121 ceph-mon[35577]: Cluster is now healthy 2024-09-19T09:47:36.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:36 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/1000095545' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:47:36.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:36 smithi121 ceph-mon[35577]: fsmap 12 up:standby 2024-09-19T09:47:36.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.742+0000 7f3a6a9ae640 1 -- 172.21.15.1:0/1931278267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a64100a80 msgr2=0x7f3a64100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:36.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.742+0000 7f3a6a9ae640 1 --2- 172.21.15.1:0/1931278267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a64100a80 0x7f3a64100ee0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009930 tx=0x7f3a5802a420 comp rx=0 tx=0).stop 2024-09-19T09:47:36.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.742+0000 7f3a6a9ae640 1 -- 172.21.15.1:0/1931278267 shutdown_connections 2024-09-19T09:47:36.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.742+0000 7f3a6a9ae640 1 --2- 172.21.15.1:0/1931278267 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a64101420 0x7f3a6410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:36.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.742+0000 7f3a6a9ae640 1 --2- 172.21.15.1:0/1931278267 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a64100a80 0x7f3a64100ee0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:36.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.742+0000 7f3a6a9ae640 1 --2- 172.21.15.1:0/1931278267 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a64106a80 0x7f3a64106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:36.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.742+0000 7f3a6a9ae640 1 -- 172.21.15.1:0/1931278267 >> 172.21.15.1:0/1931278267 conn(0x7f3a640fc7a0 msgr2=0x7f3a640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:36.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.742+0000 7f3a6a9ae640 1 -- 172.21.15.1:0/1931278267 shutdown_connections 2024-09-19T09:47:36.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.742+0000 7f3a6a9ae640 1 -- 172.21.15.1:0/1931278267 wait complete. 2024-09-19T09:47:36.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.742+0000 7f3a6a9ae640 1 Processor -- start 2024-09-19T09:47:36.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.742+0000 7f3a6a9ae640 1 -- start start 2024-09-19T09:47:36.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.743+0000 7f3a6a9ae640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a64100a80 0x7f3a64198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:36.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.743+0000 7f3a6a9ae640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a64101420 0x7f3a641989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:36.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.743+0000 7f3a6a9ae640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a64106a80 0x7f3a6419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:36.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.743+0000 7f3a6a9ae640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3a64110e80 con 0x7f3a64101420 2024-09-19T09:47:36.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.743+0000 7f3a6a9ae640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3a64110d00 con 0x7f3a64100a80 2024-09-19T09:47:36.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.743+0000 7f3a6a9ae640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3a64111000 con 0x7f3a64106a80 2024-09-19T09:47:36.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.743+0000 7f3a637fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a64101420 0x7f3a641989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:36.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.743+0000 7f3a637fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a64101420 0x7f3a641989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38706/0 (socket says 172.21.15.1:38706) 2024-09-19T09:47:36.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.743+0000 7f3a637fe640 1 -- 172.21.15.1:0/2975231283 learned_addr learned my addr 172.21.15.1:0/2975231283 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:47:36.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.743+0000 7f3a63fff640 1 --2- 172.21.15.1:0/2975231283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a64100a80 0x7f3a64198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:36.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.743+0000 7f3a68f4b640 1 --2- 172.21.15.1:0/2975231283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a64106a80 0x7f3a6419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:36.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.743+0000 7f3a637fe640 1 -- 172.21.15.1:0/2975231283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a64106a80 msgr2=0x7f3a6419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:36.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.743+0000 7f3a637fe640 1 --2- 172.21.15.1:0/2975231283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a64106a80 0x7f3a6419cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:36.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.743+0000 7f3a637fe640 1 -- 172.21.15.1:0/2975231283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a64100a80 msgr2=0x7f3a64198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:36.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.743+0000 7f3a637fe640 1 --2- 172.21.15.1:0/2975231283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a64100a80 0x7f3a64198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:36.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.743+0000 7f3a637fe640 1 -- 172.21.15.1:0/2975231283 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a6419d410 con 0x7f3a64101420 2024-09-19T09:47:36.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.743+0000 7f3a637fe640 1 --2- 172.21.15.1:0/2975231283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a64101420 0x7f3a641989a0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009a50 tx=0x7f3a58004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:36.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.744+0000 7f3a617fa640 1 -- 172.21.15.1:0/2975231283 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5803f030 con 0x7f3a64101420 2024-09-19T09:47:36.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.744+0000 7f3a6a9ae640 1 -- 172.21.15.1:0/2975231283 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a6419d6a0 con 0x7f3a64101420 2024-09-19T09:47:36.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.744+0000 7f3a617fa640 1 -- 172.21.15.1:0/2975231283 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a58003ce0 con 0x7f3a64101420 2024-09-19T09:47:36.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.744+0000 7f3a617fa640 1 -- 172.21.15.1:0/2975231283 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a58035070 con 0x7f3a64101420 2024-09-19T09:47:36.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.744+0000 7f3a6a9ae640 1 -- 172.21.15.1:0/2975231283 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a641a4fe0 con 0x7f3a64101420 2024-09-19T09:47:36.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.745+0000 7f3a6a9ae640 1 -- 172.21.15.1:0/2975231283 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a641021c0 con 0x7f3a64101420 2024-09-19T09:47:36.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.746+0000 7f3a617fa640 1 -- 172.21.15.1:0/2975231283 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f3a58042030 con 0x7f3a64101420 2024-09-19T09:47:36.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.747+0000 7f3a617fa640 1 --2- 172.21.15.1:0/2975231283 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3a4c0a3240 0x7f3a4c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:36.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.747+0000 7f3a63fff640 1 --2- 172.21.15.1:0/2975231283 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3a4c0a3240 0x7f3a4c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:36.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.747+0000 7f3a617fa640 1 -- 172.21.15.1:0/2975231283 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8326+0+0 (secure 0 0 0) 0x7f3a580f0360 con 0x7f3a64101420 2024-09-19T09:47:36.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.748+0000 7f3a63fff640 1 --2- 172.21.15.1:0/2975231283 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3a4c0a3240 0x7f3a4c0a5700 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3a540058c0 tx=0x7f3a5400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:36.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.750+0000 7f3a617fa640 1 -- 172.21.15.1:0/2975231283 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3a580bd020 con 0x7f3a64101420 2024-09-19T09:47:36.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:36.925+0000 7f3a6a9ae640 1 -- 172.21.15.1:0/2975231283 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3a6410a000 con 0x7f3a64101420 2024-09-19T09:47:37.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:37.279+0000 7f3a617fa640 1 -- 172.21.15.1:0/2975231283 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v86) ==== 181+0+0 (secure 0 0 0) 0x7f3a580bc920 con 0x7f3a64101420 2024-09-19T09:47:37.282 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' removed 2024-09-19T09:47:37.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:37.283+0000 7f3a6a9ae640 1 -- 172.21.15.1:0/2975231283 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3a4c0a3240 msgr2=0x7f3a4c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:37.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:37.283+0000 7f3a6a9ae640 1 --2- 172.21.15.1:0/2975231283 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3a4c0a3240 0x7f3a4c0a5700 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3a540058c0 tx=0x7f3a5400a2d0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:37.283+0000 7f3a6a9ae640 1 -- 172.21.15.1:0/2975231283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a64101420 msgr2=0x7f3a641989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:37.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:37.283+0000 7f3a6a9ae640 1 --2- 172.21.15.1:0/2975231283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a64101420 0x7f3a641989a0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009a50 tx=0x7f3a58004270 comp rx=0 tx=0).stop 2024-09-19T09:47:37.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:37.284+0000 7f3a6a9ae640 1 -- 172.21.15.1:0/2975231283 shutdown_connections 2024-09-19T09:47:37.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:37.284+0000 7f3a6a9ae640 1 --2- 172.21.15.1:0/2975231283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a64106a80 0x7f3a6419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:37.284+0000 7f3a6a9ae640 1 --2- 172.21.15.1:0/2975231283 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3a64101420 0x7f3a641989a0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:37.284+0000 7f3a6a9ae640 1 --2- 172.21.15.1:0/2975231283 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f3a4c0a3240 0x7f3a4c0a5700 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.286 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:37.284+0000 7f3a6a9ae640 1 --2- 172.21.15.1:0/2975231283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a64100a80 0x7f3a64198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:37.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:37.284+0000 7f3a6a9ae640 1 -- 172.21.15.1:0/2975231283 >> 172.21.15.1:0/2975231283 conn(0x7f3a640fc7a0 msgr2=0x7f3a6406aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:37.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:37.285+0000 7f3a6a9ae640 1 -- 172.21.15.1:0/2975231283 shutdown_connections 2024-09-19T09:47:37.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:37.285+0000 7f3a6a9ae640 1 -- 172.21.15.1:0/2975231283 wait complete. 2024-09-19T09:47:37.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:37 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/2975231283' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:47:37.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:37 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/2975231283' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:47:37.653 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:37 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/2975231283' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:47:38.066 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 57238232-7669-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T09:47:38.330 INFO:teuthology.orchestra.run.smithi001.stderr:Inferring config /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:47:38.608 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:38 smithi001 ceph-mon[31225]: pgmap v626: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 307 B/s wr, 2 op/s 2024-09-19T09:47:38.608 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:38 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/2975231283' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:47:38.608 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:38 smithi001 ceph-mon[31225]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T09:47:38.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:38 smithi022 ceph-mon[35583]: pgmap v626: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 307 B/s wr, 2 op/s 2024-09-19T09:47:38.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:38 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/2975231283' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:47:38.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:38 smithi022 ceph-mon[35583]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T09:47:38.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:38 smithi121 ceph-mon[35577]: pgmap v626: 97 pgs: 97 active+clean; 3.8 MiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 307 B/s wr, 2 op/s 2024-09-19T09:47:38.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:38 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/2975231283' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:47:38.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:38 smithi121 ceph-mon[35577]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T09:47:38.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.853+0000 7f20b2b8a640 1 -- 172.21.15.1:0/2612281370 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20ac101de0 msgr2=0x7f20ac1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:38.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.853+0000 7f20b2b8a640 1 --2- 172.21.15.1:0/2612281370 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20ac101de0 0x7f20ac1021c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f20a0009900 tx=0x7f20a002a410 comp rx=0 tx=0).stop 2024-09-19T09:47:38.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.853+0000 7f20b2b8a640 1 -- 172.21.15.1:0/2612281370 shutdown_connections 2024-09-19T09:47:38.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.853+0000 7f20b2b8a640 1 --2- 172.21.15.1:0/2612281370 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f20ac106f10 0x7f20ac10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:38.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.853+0000 7f20b2b8a640 1 --2- 172.21.15.1:0/2612281370 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20ac102790 0x7f20ac1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:38.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.853+0000 7f20b2b8a640 1 --2- 172.21.15.1:0/2612281370 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20ac101de0 0x7f20ac1021c0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:38.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.853+0000 7f20b2b8a640 1 -- 172.21.15.1:0/2612281370 >> 172.21.15.1:0/2612281370 conn(0x7f20ac0fd8c0 msgr2=0x7f20ac0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:38.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.853+0000 7f20b2b8a640 1 -- 172.21.15.1:0/2612281370 shutdown_connections 2024-09-19T09:47:38.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.853+0000 7f20b2b8a640 1 -- 172.21.15.1:0/2612281370 wait complete. 2024-09-19T09:47:38.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.854+0000 7f20b2b8a640 1 Processor -- start 2024-09-19T09:47:38.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.854+0000 7f20b2b8a640 1 -- start start 2024-09-19T09:47:38.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.854+0000 7f20b2b8a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20ac101de0 0x7f20ac198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:38.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.854+0000 7f20b2b8a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f20ac102790 0x7f20ac198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:38.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.854+0000 7f20b2b8a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20ac106f10 0x7f20ac19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:38.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.854+0000 7f20b2b8a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f20ac111f70 con 0x7f20ac101de0 2024-09-19T09:47:38.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.854+0000 7f20b2b8a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f20ac111df0 con 0x7f20ac106f10 2024-09-19T09:47:38.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.854+0000 7f20b2b8a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f20ac1120f0 con 0x7f20ac102790 2024-09-19T09:47:38.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.854+0000 7f20b0926640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20ac101de0 0x7f20ac198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:38.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.854+0000 7f20b0926640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20ac101de0 0x7f20ac198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:38724/0 (socket says 172.21.15.1:38724) 2024-09-19T09:47:38.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.854+0000 7f20b0926640 1 -- 172.21.15.1:0/4243678612 learned_addr learned my addr 172.21.15.1:0/4243678612 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-09-19T09:47:38.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.854+0000 7f20b1127640 1 --2- 172.21.15.1:0/4243678612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20ac106f10 0x7f20ac19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:38.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.854+0000 7f20abfff640 1 --2- 172.21.15.1:0/4243678612 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f20ac102790 0x7f20ac198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:38.860 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.854+0000 7f20b0926640 1 -- 172.21.15.1:0/4243678612 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f20ac102790 msgr2=0x7f20ac198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:38.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.854+0000 7f20b0926640 1 --2- 172.21.15.1:0/4243678612 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f20ac102790 0x7f20ac198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:38.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.854+0000 7f20b0926640 1 -- 172.21.15.1:0/4243678612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20ac106f10 msgr2=0x7f20ac19cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:38.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.854+0000 7f20b0926640 1 --2- 172.21.15.1:0/4243678612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20ac106f10 0x7f20ac19cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:38.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.854+0000 7f20b0926640 1 -- 172.21.15.1:0/4243678612 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ac19d3e0 con 0x7f20ac101de0 2024-09-19T09:47:38.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.854+0000 7f20b0926640 1 --2- 172.21.15.1:0/4243678612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20ac101de0 0x7f20ac198430 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f20a0006010 tx=0x7f20a00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:38.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.855+0000 7f20a9ffb640 1 -- 172.21.15.1:0/4243678612 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a003f030 con 0x7f20ac101de0 2024-09-19T09:47:38.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.855+0000 7f20a9ffb640 1 -- 172.21.15.1:0/4243678612 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20a0003ce0 con 0x7f20ac101de0 2024-09-19T09:47:38.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.855+0000 7f20b2b8a640 1 -- 172.21.15.1:0/4243678612 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20ac19d670 con 0x7f20ac101de0 2024-09-19T09:47:38.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.855+0000 7f20a9ffb640 1 -- 172.21.15.1:0/4243678612 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a0035070 con 0x7f20ac101de0 2024-09-19T09:47:38.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.855+0000 7f20b2b8a640 1 -- 172.21.15.1:0/4243678612 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20ac1a4fb0 con 0x7f20ac101de0 2024-09-19T09:47:38.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.856+0000 7f20b2b8a640 1 -- 172.21.15.1:0/4243678612 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20ac1021c0 con 0x7f20ac101de0 2024-09-19T09:47:38.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.857+0000 7f20a9ffb640 1 -- 172.21.15.1:0/4243678612 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 18) ==== 138354+0+0 (secure 0 0 0) 0x7f20a0042030 con 0x7f20ac101de0 2024-09-19T09:47:38.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.858+0000 7f20a9ffb640 1 --2- 172.21.15.1:0/4243678612 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f209c0a32c0 0x7f209c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:47:38.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.858+0000 7f20abfff640 1 --2- 172.21.15.1:0/4243678612 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f209c0a32c0 0x7f209c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:47:38.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.858+0000 7f20a9ffb640 1 -- 172.21.15.1:0/4243678612 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7772+0+0 (secure 0 0 0) 0x7f20a00ef860 con 0x7f20ac101de0 2024-09-19T09:47:38.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.859+0000 7f20abfff640 1 --2- 172.21.15.1:0/4243678612 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f209c0a32c0 0x7f209c0a5780 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2098005fd0 tx=0x7f2098005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:47:38.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:38.863+0000 7f20a9ffb640 1 -- 172.21.15.1:0/4243678612 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f20a00bc860 con 0x7f20ac101de0 2024-09-19T09:47:39.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:39.043+0000 7f20b2b8a640 1 -- 172.21.15.1:0/4243678612 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f20ac10a0f0 con 0x7f20ac101de0 2024-09-19T09:47:39.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:39.286+0000 7f20a9ffb640 1 -- 172.21.15.1:0/4243678612 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v87) ==== 169+0+0 (secure 0 0 0) 0x7f20a00bc160 con 0x7f20ac101de0 2024-09-19T09:47:39.289 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' removed 2024-09-19T09:47:39.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:39.290+0000 7f20b2b8a640 1 -- 172.21.15.1:0/4243678612 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f209c0a32c0 msgr2=0x7f209c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:39.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:39.290+0000 7f20b2b8a640 1 --2- 172.21.15.1:0/4243678612 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f209c0a32c0 0x7f209c0a5780 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2098005fd0 tx=0x7f2098005850 comp rx=0 tx=0).stop 2024-09-19T09:47:39.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:39.290+0000 7f20b2b8a640 1 -- 172.21.15.1:0/4243678612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20ac101de0 msgr2=0x7f20ac198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:47:39.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:39.290+0000 7f20b2b8a640 1 --2- 172.21.15.1:0/4243678612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20ac101de0 0x7f20ac198430 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f20a0006010 tx=0x7f20a00042f0 comp rx=0 tx=0).stop 2024-09-19T09:47:39.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:39.290+0000 7f20b2b8a640 1 -- 172.21.15.1:0/4243678612 shutdown_connections 2024-09-19T09:47:39.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:39.290+0000 7f20b2b8a640 1 --2- 172.21.15.1:0/4243678612 >> [v2:172.21.15.1:6800/3871697789,v1:172.21.15.1:6801/3871697789] conn(0x7f209c0a32c0 0x7f209c0a5780 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:39.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:39.290+0000 7f20b2b8a640 1 --2- 172.21.15.1:0/4243678612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20ac106f10 0x7f20ac19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:39.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:39.290+0000 7f20b2b8a640 1 --2- 172.21.15.1:0/4243678612 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f20ac102790 0x7f20ac198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:39.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:39.290+0000 7f20b2b8a640 1 --2- 172.21.15.1:0/4243678612 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f20ac101de0 0x7f20ac198430 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:47:39.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:39.290+0000 7f20b2b8a640 1 -- 172.21.15.1:0/4243678612 >> 172.21.15.1:0/4243678612 conn(0x7f20ac0fd8c0 msgr2=0x7f20ac0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:47:39.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:39.291+0000 7f20b2b8a640 1 -- 172.21.15.1:0/4243678612 shutdown_connections 2024-09-19T09:47:39.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-09-19T09:47:39.291+0000 7f20b2b8a640 1 -- 172.21.15.1:0/4243678612 wait complete. 2024-09-19T09:47:39.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:39 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/4243678612' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:47:39.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:39 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/4243678612' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:47:39.655 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:39 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/4243678612' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:47:40.109 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:47:40.150 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:47:40.191 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:47:40.229 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-19T09:47:40.229 DEBUG:teuthology.orchestra.run.smithi001:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:47:40.246 DEBUG:teuthology.orchestra.run.smithi022:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:47:40.261 DEBUG:teuthology.orchestra.run.smithi121:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:47:40.285 INFO:tasks.cephadm:Stopping all daemons... 2024-09-19T09:47:40.285 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-19T09:47:40.285 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-57238232-7669-11ef-bceb-c7b262605968@mon.a 2024-09-19T09:47:40.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:40 smithi001 ceph-mon[31225]: pgmap v628: 65 pgs: 65 active+clean; 577 KiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:47:40.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:40 smithi001 ceph-mon[31225]: from='client.? 172.21.15.1:0/4243678612' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:47:40.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:40 smithi001 ceph-mon[31225]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T09:47:40.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:40 smithi001 systemd[1]: Stopping Ceph mon.a for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:47:40.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:40 smithi022 ceph-mon[35583]: pgmap v628: 65 pgs: 65 active+clean; 577 KiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:47:40.614 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:40 smithi022 ceph-mon[35583]: from='client.? 172.21.15.1:0/4243678612' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:47:40.615 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:40 smithi022 ceph-mon[35583]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T09:47:40.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:40 smithi121 ceph-mon[35577]: pgmap v628: 65 pgs: 65 active+clean; 577 KiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:47:40.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:40 smithi121 ceph-mon[35577]: from='client.? 172.21.15.1:0/4243678612' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:47:40.617 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:40 smithi121 ceph-mon[35577]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T09:47:40.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:40 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mon-a[31221]: 2024-09-19T09:47:40.601+0000 7f1a8929a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:47:40.998 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:40 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mon-a[31221]: 2024-09-19T09:47:40.601+0000 7f1a8929a640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-19T09:47:40.999 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:40 smithi001 podman[96532]: 2024-09-19 09:47:40.847130623 +0000 UTC m=+0.366181268 container died d867c9163aff5076f45b5af8d1207f1ae9b2c6c9c1ffcc023ae0b30e07ed267e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-19T09:47:41.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:41 smithi001 podman[96532]: 2024-09-19 09:47:41.235300638 +0000 UTC m=+0.754351280 container cleanup d867c9163aff5076f45b5af8d1207f1ae9b2c6c9c1ffcc023ae0b30e07ed267e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:47:41.498 INFO:journalctl@ceph.mon.a.smithi001.stdout:Sep 19 09:47:41 smithi001 bash[96532]: ceph-57238232-7669-11ef-bceb-c7b262605968-mon-a 2024-09-19T09:47:41.687 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mon.a.service' 2024-09-19T09:47:41.773 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:47:41.773 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-19T09:47:41.773 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-19T09:47:41.774 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-57238232-7669-11ef-bceb-c7b262605968@mon.b 2024-09-19T09:47:42.086 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:41 smithi022 systemd[1]: Stopping Ceph mon.b for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:47:42.364 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:42 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mon-b[35579]: 2024-09-19T09:47:42.132+0000 7f3e9fc9c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:47:42.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:42 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mon-b[35579]: 2024-09-19T09:47:42.132+0000 7f3e9fc9c640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-19T09:47:42.365 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:42 smithi022 podman[68804]: 2024-09-19 09:47:42.173859923 +0000 UTC m=+0.153973093 container died 26853768412dfa2288934008380ce58793dd6a2638e2eb195801aae88fa32969 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mon-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T09:47:42.861 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:42 smithi022 podman[68804]: 2024-09-19 09:47:42.574876058 +0000 UTC m=+0.554989225 container cleanup 26853768412dfa2288934008380ce58793dd6a2638e2eb195801aae88fa32969 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mon-b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:47:42.862 INFO:journalctl@ceph.mon.b.smithi022.stdout:Sep 19 09:47:42 smithi022 bash[68804]: ceph-57238232-7669-11ef-bceb-c7b262605968-mon-b 2024-09-19T09:47:42.992 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mon.b.service' 2024-09-19T09:47:43.043 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:47:43.043 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-19T09:47:43.044 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-19T09:47:43.044 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-57238232-7669-11ef-bceb-c7b262605968@mon.c 2024-09-19T09:47:43.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:43 smithi121 systemd[1]: Stopping Ceph mon.c for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:47:43.682 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:43 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mon-c[35573]: 2024-09-19T09:47:43.425+0000 7fef1b17e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:47:43.682 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:43 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mon-c[35573]: 2024-09-19T09:47:43.425+0000 7fef1b17e640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-19T09:47:44.028 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:43 smithi121 podman[68883]: 2024-09-19 09:47:43.681023307 +0000 UTC m=+0.381137110 container died 30f334dd4683a731baa006f076cce1cae5a321086b865e7dabbf7858a39a29f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mon-c, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T09:47:44.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:44 smithi121 podman[68883]: 2024-09-19 09:47:44.126071003 +0000 UTC m=+0.826184812 container cleanup 30f334dd4683a731baa006f076cce1cae5a321086b865e7dabbf7858a39a29f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:47:44.367 INFO:journalctl@ceph.mon.c.smithi121.stdout:Sep 19 09:47:44 smithi121 bash[68883]: ceph-57238232-7669-11ef-bceb-c7b262605968-mon-c 2024-09-19T09:47:44.593 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mon.c.service' 2024-09-19T09:47:44.641 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:47:44.641 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-19T09:47:44.641 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-19T09:47:44.641 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-57238232-7669-11ef-bceb-c7b262605968@mgr.x 2024-09-19T09:47:44.959 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:47:44 smithi001 systemd[1]: Stopping Ceph mgr.x for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:47:45.248 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:47:44 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x[31454]: 2024-09-19T09:47:44.957+0000 7f90427e8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:47:45.248 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:47:44 smithi001 podman[96653]: 2024-09-19 09:47:44.988470828 +0000 UTC m=+0.148389772 container died e056032c4e14ebda6a7c461eb3643a0926ec76cca1d37065d5dc8dad1e88bf8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-19T09:47:45.653 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:47:45 smithi001 podman[96653]: 2024-09-19 09:47:45.391662329 +0000 UTC m=+0.551581271 container cleanup e056032c4e14ebda6a7c461eb3643a0926ec76cca1d37065d5dc8dad1e88bf8b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-19T09:47:45.654 INFO:journalctl@ceph.mgr.x.smithi001.stdout:Sep 19 09:47:45 smithi001 bash[96653]: ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-x 2024-09-19T09:47:45.783 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-19T09:47:45.820 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:47:45.821 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-19T09:47:45.821 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-19T09:47:45.821 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-57238232-7669-11ef-bceb-c7b262605968@mgr.y 2024-09-19T09:47:46.115 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:47:45 smithi022 systemd[1]: Stopping Ceph mgr.y for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:47:46.432 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:47:46 smithi022 podman[68925]: 2024-09-19 09:47:46.169151634 +0000 UTC m=+0.149049200 container died 370f98ebcb09405f0cbae26511b0dd65a1395b993798434d174b20479a8ce759 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-19T09:47:46.750 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:47:46 smithi022 podman[68925]: 2024-09-19 09:47:46.513615564 +0000 UTC m=+0.493513125 container cleanup 370f98ebcb09405f0cbae26511b0dd65a1395b993798434d174b20479a8ce759 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:47:46.750 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:47:46 smithi022 bash[68925]: ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y 2024-09-19T09:47:46.994 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-19T09:47:47.016 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:47:46 smithi022 podman[68937]: 2024-09-19 09:47:46.748822704 +0000 UTC m=+0.574627169 container remove 370f98ebcb09405f0cbae26511b0dd65a1395b993798434d174b20479a8ce759 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-y, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:47:47.016 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:47:46 smithi022 systemd[1]: ceph-57238232-7669-11ef-bceb-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-19T09:47:47.016 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:47:46 smithi022 systemd[1]: ceph-57238232-7669-11ef-bceb-c7b262605968@mgr.y.service: Failed with result 'exit-code'. 2024-09-19T09:47:47.016 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:47:46 smithi022 systemd[1]: Stopped Ceph mgr.y for 57238232-7669-11ef-bceb-c7b262605968. 2024-09-19T09:47:47.016 INFO:journalctl@ceph.mgr.y.smithi022.stdout:Sep 19 09:47:46 smithi022 systemd[1]: ceph-57238232-7669-11ef-bceb-c7b262605968@mgr.y.service: Consumed 6.703s CPU time. 2024-09-19T09:47:47.029 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:47:47.029 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-19T09:47:47.029 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-19T09:47:47.030 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-57238232-7669-11ef-bceb-c7b262605968@mgr.z 2024-09-19T09:47:47.353 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:47:47 smithi121 systemd[1]: Stopping Ceph mgr.z for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:47:47.617 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:47:47 smithi121 podman[69007]: 2024-09-19 09:47:47.351941889 +0000 UTC m=+0.129175449 container died 6c24a9ea2d7629e89bc9ee78bf317b8ad43f62b38a56e3b78057e158c9aab8f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-19T09:47:48.035 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:47:47 smithi121 podman[69007]: 2024-09-19 09:47:47.765031864 +0000 UTC m=+0.542265434 container cleanup 6c24a9ea2d7629e89bc9ee78bf317b8ad43f62b38a56e3b78057e158c9aab8f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T09:47:48.035 INFO:journalctl@ceph.mgr.z.smithi121.stdout:Sep 19 09:47:47 smithi121 bash[69007]: ceph-57238232-7669-11ef-bceb-c7b262605968-mgr-z 2024-09-19T09:47:48.186 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-19T09:47:48.221 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:47:48.221 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-19T09:47:48.221 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-19T09:47:48.221 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-57238232-7669-11ef-bceb-c7b262605968@osd.0 2024-09-19T09:47:48.540 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:47:48 smithi001 systemd[1]: Stopping Ceph osd.0 for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:47:48.998 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:47:48 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-0[42367]: 2024-09-19T09:47:48.537+0000 7ff22dffd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:47:48.998 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:47:48 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-0[42367]: 2024-09-19T09:47:48.537+0000 7ff22dffd640 -1 osd.0 87 *** Got signal Terminated *** 2024-09-19T09:47:48.998 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:47:48 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-0[42367]: 2024-09-19T09:47:48.537+0000 7ff22dffd640 -1 osd.0 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:47:54.248 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:47:53 smithi001 podman[96778]: 2024-09-19 09:47:53.984924794 +0000 UTC m=+5.566441350 container died a1a5dae90caae229b75cf785da1e3e6d303299de372b508037194aeb602008ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T09:47:54.512 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:47:54 smithi001 podman[96778]: 2024-09-19 09:47:54.489575913 +0000 UTC m=+6.071092502 container cleanup a1a5dae90caae229b75cf785da1e3e6d303299de372b508037194aeb602008ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-0, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T09:47:54.512 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:47:54 smithi001 bash[96778]: ceph-57238232-7669-11ef-bceb-c7b262605968-osd-0 2024-09-19T09:47:54.998 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:47:54 smithi001 podman[96791]: 2024-09-19 09:47:54.741344049 +0000 UTC m=+0.756440008 container remove a1a5dae90caae229b75cf785da1e3e6d303299de372b508037194aeb602008ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-19T09:47:55.250 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:47:55 smithi001 podman[96884]: 2024-09-19 09:47:54.977343059 +0000 UTC m=+0.016315844 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:47:55.250 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:47:55 smithi001 podman[96884]: 2024-09-19 09:47:55.100988597 +0000 UTC m=+0.139961364 container create 925b4fbbe3afa16be0722bdf3312ba820f33810d9ded0a3303d8e55bec91345e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T09:47:55.748 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:47:55 smithi001 podman[96884]: 2024-09-19 09:47:55.379401152 +0000 UTC m=+0.418373929 container init 925b4fbbe3afa16be0722bdf3312ba820f33810d9ded0a3303d8e55bec91345e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:47:55.749 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:47:55 smithi001 podman[96884]: 2024-09-19 09:47:55.383448096 +0000 UTC m=+0.422420875 container start 925b4fbbe3afa16be0722bdf3312ba820f33810d9ded0a3303d8e55bec91345e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True) 2024-09-19T09:47:55.749 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:47:55 smithi001 podman[96884]: 2024-09-19 09:47:55.479421007 +0000 UTC m=+0.518393844 container attach 925b4fbbe3afa16be0722bdf3312ba820f33810d9ded0a3303d8e55bec91345e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-19T09:47:56.134 INFO:journalctl@ceph.osd.0.smithi001.stdout:Sep 19 09:47:55 smithi001 podman[96884]: 2024-09-19 09:47:55.771189028 +0000 UTC m=+0.810161807 container died 925b4fbbe3afa16be0722bdf3312ba820f33810d9ded0a3303d8e55bec91345e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-19T09:47:56.475 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@osd.0.service' 2024-09-19T09:47:56.522 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:47:56.522 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-19T09:47:56.522 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-19T09:47:56.522 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-57238232-7669-11ef-bceb-c7b262605968@osd.1 2024-09-19T09:47:56.854 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:47:56 smithi022 systemd[1]: Stopping Ceph osd.1 for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:47:57.114 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:47:56 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-1[40053]: 2024-09-19T09:47:56.850+0000 7f83eb306640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:47:57.115 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:47:56 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-1[40053]: 2024-09-19T09:47:56.850+0000 7f83eb306640 -1 osd.1 87 *** Got signal Terminated *** 2024-09-19T09:47:57.115 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:47:56 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-1[40053]: 2024-09-19T09:47:56.850+0000 7f83eb306640 -1 osd.1 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:48:02.720 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:48:02 smithi022 podman[69050]: 2024-09-19 09:48:02.404310801 +0000 UTC m=+5.681591072 container died d3ae10d59bdd2fe8621d97dd8e46f15b15979e4995e68ca697b73e096a4fe805 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-1, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:48:03.013 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:48:02 smithi022 podman[69050]: 2024-09-19 09:48:02.826637123 +0000 UTC m=+6.103917391 container cleanup d3ae10d59bdd2fe8621d97dd8e46f15b15979e4995e68ca697b73e096a4fe805 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T09:48:03.013 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:48:02 smithi022 bash[69050]: ceph-57238232-7669-11ef-bceb-c7b262605968-osd-1 2024-09-19T09:48:03.364 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:48:03 smithi022 podman[69066]: 2024-09-19 09:48:03.112203499 +0000 UTC m=+0.701962175 container remove d3ae10d59bdd2fe8621d97dd8e46f15b15979e4995e68ca697b73e096a4fe805 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-1, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T09:48:03.892 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:48:03 smithi022 podman[69165]: 2024-09-19 09:48:03.531073345 +0000 UTC m=+0.016211568 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:48:03.892 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:48:03 smithi022 podman[69165]: 2024-09-19 09:48:03.638131239 +0000 UTC m=+0.123269443 container create 70bbfc74aee5f14c6c57b5647075a39903cfa569725698610872dac70e129e33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:48:04.166 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:48:03 smithi022 podman[69165]: 2024-09-19 09:48:03.890746116 +0000 UTC m=+0.375884320 container init 70bbfc74aee5f14c6c57b5647075a39903cfa569725698610872dac70e129e33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-19T09:48:04.166 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:48:03 smithi022 podman[69165]: 2024-09-19 09:48:03.894339832 +0000 UTC m=+0.379478044 container start 70bbfc74aee5f14c6c57b5647075a39903cfa569725698610872dac70e129e33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T09:48:04.166 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:48:03 smithi022 podman[69165]: 2024-09-19 09:48:03.982675642 +0000 UTC m=+0.467813865 container attach 70bbfc74aee5f14c6c57b5647075a39903cfa569725698610872dac70e129e33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:48:04.166 INFO:journalctl@ceph.osd.1.smithi022.stdout:Sep 19 09:48:04 smithi022 podman[69165]: 2024-09-19 09:48:04.140573436 +0000 UTC m=+0.625711653 container died 70bbfc74aee5f14c6c57b5647075a39903cfa569725698610872dac70e129e33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True) 2024-09-19T09:48:04.763 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@osd.1.service' 2024-09-19T09:48:04.806 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:48:04.806 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-19T09:48:04.806 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-19T09:48:04.806 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-57238232-7669-11ef-bceb-c7b262605968@osd.2 2024-09-19T09:48:05.113 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 19 09:48:04 smithi121 systemd[1]: Stopping Ceph osd.2 for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:48:05.367 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 19 09:48:05 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-2[40547]: 2024-09-19T09:48:05.110+0000 7fdd15446640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:48:05.367 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 19 09:48:05 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-2[40547]: 2024-09-19T09:48:05.110+0000 7fdd15446640 -1 osd.2 87 *** Got signal Terminated *** 2024-09-19T09:48:05.367 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 19 09:48:05 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-2[40547]: 2024-09-19T09:48:05.110+0000 7fdd15446640 -1 osd.2 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:48:10.979 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 19 09:48:10 smithi121 podman[69133]: 2024-09-19 09:48:10.671408372 +0000 UTC m=+5.675176545 container died 4abedf36e01572051d84eadf74a2536d9f2a0de993c1bd9a9eab900aed1942a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-2, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T09:48:11.338 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 19 09:48:11 smithi121 podman[69133]: 2024-09-19 09:48:11.076793346 +0000 UTC m=+6.080561528 container cleanup 4abedf36e01572051d84eadf74a2536d9f2a0de993c1bd9a9eab900aed1942a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T09:48:11.338 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 19 09:48:11 smithi121 bash[69133]: ceph-57238232-7669-11ef-bceb-c7b262605968-osd-2 2024-09-19T09:48:11.617 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 19 09:48:11 smithi121 podman[69149]: 2024-09-19 09:48:11.337142204 +0000 UTC m=+0.667471727 container remove 4abedf36e01572051d84eadf74a2536d9f2a0de993c1bd9a9eab900aed1942a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:48:12.025 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 19 09:48:11 smithi121 podman[69241]: 2024-09-19 09:48:11.582473964 +0000 UTC m=+0.015632694 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:48:12.025 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 19 09:48:11 smithi121 podman[69241]: 2024-09-19 09:48:11.704558515 +0000 UTC m=+0.137717246 container create e343d2e711128cf46e146afa3e310d3c2d58385547237f632d2f0e190737ef2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T09:48:12.025 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 19 09:48:11 smithi121 podman[69241]: 2024-09-19 09:48:11.923762909 +0000 UTC m=+0.356921639 container init e343d2e711128cf46e146afa3e310d3c2d58385547237f632d2f0e190737ef2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T09:48:12.026 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 19 09:48:11 smithi121 podman[69241]: 2024-09-19 09:48:11.927005769 +0000 UTC m=+0.360164509 container start e343d2e711128cf46e146afa3e310d3c2d58385547237f632d2f0e190737ef2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T09:48:12.026 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 19 09:48:12 smithi121 podman[69241]: 2024-09-19 09:48:12.024024157 +0000 UTC m=+0.457182903 container attach e343d2e711128cf46e146afa3e310d3c2d58385547237f632d2f0e190737ef2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T09:48:12.618 INFO:journalctl@ceph.osd.2.smithi121.stdout:Sep 19 09:48:12 smithi121 podman[69241]: 2024-09-19 09:48:12.354793049 +0000 UTC m=+0.787951780 container died e343d2e711128cf46e146afa3e310d3c2d58385547237f632d2f0e190737ef2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T09:48:12.989 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@osd.2.service' 2024-09-19T09:48:13.027 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:48:13.028 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-19T09:48:13.028 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-19T09:48:13.028 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-57238232-7669-11ef-bceb-c7b262605968@osd.3 2024-09-19T09:48:13.364 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 09:48:13 smithi001 systemd[1]: Stopping Ceph osd.3 for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:48:13.748 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 09:48:13 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-3[48813]: 2024-09-19T09:48:13.362+0000 7f595facb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:48:13.748 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 09:48:13 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-3[48813]: 2024-09-19T09:48:13.362+0000 7f595facb640 -1 osd.3 87 *** Got signal Terminated *** 2024-09-19T09:48:13.748 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 09:48:13 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-3[48813]: 2024-09-19T09:48:13.362+0000 7f595facb640 -1 osd.3 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:48:19.248 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 09:48:18 smithi001 podman[97000]: 2024-09-19 09:48:18.995906493 +0000 UTC m=+5.767452027 container died 2fa8035e86ca7d8bf4cbbad14c2870042857c68981a62c6f44d4527e05f4f1ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-19T09:48:19.715 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 09:48:19 smithi001 podman[97000]: 2024-09-19 09:48:19.512423495 +0000 UTC m=+6.283969028 container cleanup 2fa8035e86ca7d8bf4cbbad14c2870042857c68981a62c6f44d4527e05f4f1ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T09:48:19.716 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 09:48:19 smithi001 bash[97000]: ceph-57238232-7669-11ef-bceb-c7b262605968-osd-3 2024-09-19T09:48:19.998 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 09:48:19 smithi001 podman[97015]: 2024-09-19 09:48:19.714288291 +0000 UTC m=+0.718948731 container remove 2fa8035e86ca7d8bf4cbbad14c2870042857c68981a62c6f44d4527e05f4f1ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:48:20.478 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 09:48:20 smithi001 podman[97103]: 2024-09-19 09:48:20.037288637 +0000 UTC m=+0.016502208 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:48:20.478 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 09:48:20 smithi001 podman[97103]: 2024-09-19 09:48:20.148816668 +0000 UTC m=+0.128030220 container create 19f7dbd7e8948e4e4da76bea03e7b9b3d585835e2118bdabe341c89c5512cd1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:48:20.478 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 09:48:20 smithi001 podman[97103]: 2024-09-19 09:48:20.376197869 +0000 UTC m=+0.355411439 container init 19f7dbd7e8948e4e4da76bea03e7b9b3d585835e2118bdabe341c89c5512cd1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-19T09:48:20.478 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 09:48:20 smithi001 podman[97103]: 2024-09-19 09:48:20.379608115 +0000 UTC m=+0.358821673 container start 19f7dbd7e8948e4e4da76bea03e7b9b3d585835e2118bdabe341c89c5512cd1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731) 2024-09-19T09:48:20.478 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 09:48:20 smithi001 podman[97103]: 2024-09-19 09:48:20.476319561 +0000 UTC m=+0.455533120 container attach 19f7dbd7e8948e4e4da76bea03e7b9b3d585835e2118bdabe341c89c5512cd1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T09:48:20.748 INFO:journalctl@ceph.osd.3.smithi001.stdout:Sep 19 09:48:20 smithi001 podman[97103]: 2024-09-19 09:48:20.578155452 +0000 UTC m=+0.557369014 container died 19f7dbd7e8948e4e4da76bea03e7b9b3d585835e2118bdabe341c89c5512cd1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-19T09:48:21.215 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@osd.3.service' 2024-09-19T09:48:21.263 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:48:21.263 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-19T09:48:21.264 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-19T09:48:21.264 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-57238232-7669-11ef-bceb-c7b262605968@osd.4 2024-09-19T09:48:21.599 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:48:21 smithi022 systemd[1]: Stopping Ceph osd.4 for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:48:21.864 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:48:21 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-4[46791]: 2024-09-19T09:48:21.598+0000 7f296e4c9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:48:21.865 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:48:21 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-4[46791]: 2024-09-19T09:48:21.598+0000 7f296e4c9640 -1 osd.4 87 *** Got signal Terminated *** 2024-09-19T09:48:21.865 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:48:21 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-4[46791]: 2024-09-19T09:48:21.598+0000 7f296e4c9640 -1 osd.4 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:48:27.309 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:48:27 smithi022 podman[69272]: 2024-09-19 09:48:27.015646831 +0000 UTC m=+5.550034230 container died 861916e76af8c42cf88e3226d3529a3c75d62c9af827a976f00d91aa2eab3aea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T09:48:27.614 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:48:27 smithi022 podman[69272]: 2024-09-19 09:48:27.389156431 +0000 UTC m=+5.923543819 container cleanup 861916e76af8c42cf88e3226d3529a3c75d62c9af827a976f00d91aa2eab3aea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-4, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T09:48:27.615 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:48:27 smithi022 bash[69272]: ceph-57238232-7669-11ef-bceb-c7b262605968-osd-4 2024-09-19T09:48:27.996 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:48:27 smithi022 podman[69288]: 2024-09-19 09:48:27.682485151 +0000 UTC m=+0.665286081 container remove 861916e76af8c42cf88e3226d3529a3c75d62c9af827a976f00d91aa2eab3aea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-4, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T09:48:28.270 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:48:27 smithi022 podman[69374]: 2024-09-19 09:48:27.898058404 +0000 UTC m=+0.015879188 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:48:28.271 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:48:28 smithi022 podman[69374]: 2024-09-19 09:48:28.0169077 +0000 UTC m=+0.134728517 container create 7a09b22cd28345085be2ada71174e7df377b8d2685816b0fe45906e2100df00a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T09:48:28.615 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:48:28 smithi022 podman[69374]: 2024-09-19 09:48:28.269241035 +0000 UTC m=+0.387061810 container init 7a09b22cd28345085be2ada71174e7df377b8d2685816b0fe45906e2100df00a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-19T09:48:28.615 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:48:28 smithi022 podman[69374]: 2024-09-19 09:48:28.272685903 +0000 UTC m=+0.390506677 container start 7a09b22cd28345085be2ada71174e7df377b8d2685816b0fe45906e2100df00a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T09:48:28.615 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:48:28 smithi022 podman[69374]: 2024-09-19 09:48:28.369327553 +0000 UTC m=+0.487148336 container attach 7a09b22cd28345085be2ada71174e7df377b8d2685816b0fe45906e2100df00a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T09:48:28.615 INFO:journalctl@ceph.osd.4.smithi022.stdout:Sep 19 09:48:28 smithi022 podman[69374]: 2024-09-19 09:48:28.470534025 +0000 UTC m=+0.588354800 container died 7a09b22cd28345085be2ada71174e7df377b8d2685816b0fe45906e2100df00a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-19T09:48:29.052 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@osd.4.service' 2024-09-19T09:48:29.093 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:48:29.093 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-19T09:48:29.093 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-19T09:48:29.093 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-57238232-7669-11ef-bceb-c7b262605968@osd.5 2024-09-19T09:48:29.418 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 19 09:48:29 smithi121 systemd[1]: Stopping Ceph osd.5 for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:48:29.867 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 19 09:48:29 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-5[47045]: 2024-09-19T09:48:29.416+0000 7f457c52b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:48:29.867 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 19 09:48:29 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-5[47045]: 2024-09-19T09:48:29.416+0000 7f457c52b640 -1 osd.5 87 *** Got signal Terminated *** 2024-09-19T09:48:29.867 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 19 09:48:29 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-5[47045]: 2024-09-19T09:48:29.416+0000 7f457c52b640 -1 osd.5 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:48:35.365 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 19 09:48:35 smithi121 podman[69357]: 2024-09-19 09:48:35.045064133 +0000 UTC m=+5.762545765 container died 7ce7275b06562138679fc20ef8f1c80334e961b86e8c2a3f68b2c205a403a30c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=squid-2f599a4) 2024-09-19T09:48:35.617 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 19 09:48:35 smithi121 podman[69357]: 2024-09-19 09:48:35.479556856 +0000 UTC m=+6.197038487 container cleanup 7ce7275b06562138679fc20ef8f1c80334e961b86e8c2a3f68b2c205a403a30c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-19T09:48:35.617 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 19 09:48:35 smithi121 bash[69357]: ceph-57238232-7669-11ef-bceb-c7b262605968-osd-5 2024-09-19T09:48:36.117 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 19 09:48:35 smithi121 podman[69372]: 2024-09-19 09:48:35.723010919 +0000 UTC m=+0.675947971 container remove 7ce7275b06562138679fc20ef8f1c80334e961b86e8c2a3f68b2c205a403a30c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-5, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:48:36.444 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 19 09:48:36 smithi121 podman[69462]: 2024-09-19 09:48:36.032074103 +0000 UTC m=+0.015546118 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:48:36.444 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 19 09:48:36 smithi121 podman[69462]: 2024-09-19 09:48:36.157136701 +0000 UTC m=+0.140608716 container create f43de296f9ab30f203c2e372c5380d25e3bc90dc9d4ecd8cb2d79755ac1b36bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-19T09:48:36.444 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 19 09:48:36 smithi121 podman[69462]: 2024-09-19 09:48:36.376214997 +0000 UTC m=+0.359687009 container init f43de296f9ab30f203c2e372c5380d25e3bc90dc9d4ecd8cb2d79755ac1b36bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True) 2024-09-19T09:48:36.444 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 19 09:48:36 smithi121 podman[69462]: 2024-09-19 09:48:36.379442289 +0000 UTC m=+0.362914307 container start f43de296f9ab30f203c2e372c5380d25e3bc90dc9d4ecd8cb2d79755ac1b36bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-19T09:48:36.444 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 19 09:48:36 smithi121 podman[69462]: 2024-09-19 09:48:36.442813762 +0000 UTC m=+0.426285788 container attach f43de296f9ab30f203c2e372c5380d25e3bc90dc9d4ecd8cb2d79755ac1b36bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-19T09:48:36.867 INFO:journalctl@ceph.osd.5.smithi121.stdout:Sep 19 09:48:36 smithi121 podman[69462]: 2024-09-19 09:48:36.566165584 +0000 UTC m=+0.549637597 container died f43de296f9ab30f203c2e372c5380d25e3bc90dc9d4ecd8cb2d79755ac1b36bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-19T09:48:37.262 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@osd.5.service' 2024-09-19T09:48:37.303 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:48:37.303 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-19T09:48:37.303 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-19T09:48:37.303 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-57238232-7669-11ef-bceb-c7b262605968@osd.6 2024-09-19T09:48:37.635 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:48:37 smithi001 systemd[1]: Stopping Ceph osd.6 for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:48:37.906 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:48:37 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-6[55253]: 2024-09-19T09:48:37.633+0000 7f718ee7c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:48:37.906 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:48:37 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-6[55253]: 2024-09-19T09:48:37.633+0000 7f718ee7c640 -1 osd.6 87 *** Got signal Terminated *** 2024-09-19T09:48:37.906 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:48:37 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-6[55253]: 2024-09-19T09:48:37.633+0000 7f718ee7c640 -1 osd.6 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:48:43.370 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:48:43 smithi001 podman[97207]: 2024-09-19 09:48:43.095785593 +0000 UTC m=+5.585783435 container died 49b66c8210fc45e9803ccaa2e3e5734183ebbd27c40649b724a0165054a0723c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-6, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T09:48:43.748 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:48:43 smithi001 podman[97207]: 2024-09-19 09:48:43.542101901 +0000 UTC m=+6.032099788 container cleanup 49b66c8210fc45e9803ccaa2e3e5734183ebbd27c40649b724a0165054a0723c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-6, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T09:48:43.748 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:48:43 smithi001 bash[97207]: ceph-57238232-7669-11ef-bceb-c7b262605968-osd-6 2024-09-19T09:48:44.168 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:48:43 smithi001 podman[97235]: 2024-09-19 09:48:43.751850239 +0000 UTC m=+0.649955511 container remove 49b66c8210fc45e9803ccaa2e3e5734183ebbd27c40649b724a0165054a0723c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-6, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T09:48:44.450 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:48:44 smithi001 podman[97324]: 2024-09-19 09:48:44.069929044 +0000 UTC m=+0.016521547 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:48:44.450 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:48:44 smithi001 podman[97324]: 2024-09-19 09:48:44.177954426 +0000 UTC m=+0.124546970 container create 980b8fab0a4769ca7202bcec0ad586d5f07097d62979d39ee697ffa2c4fec2f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T09:48:44.450 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:48:44 smithi001 podman[97324]: 2024-09-19 09:48:44.448561137 +0000 UTC m=+0.395153646 container init 980b8fab0a4769ca7202bcec0ad586d5f07097d62979d39ee697ffa2c4fec2f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T09:48:44.748 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:48:44 smithi001 podman[97324]: 2024-09-19 09:48:44.452198043 +0000 UTC m=+0.398790546 container start 980b8fab0a4769ca7202bcec0ad586d5f07097d62979d39ee697ffa2c4fec2f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T09:48:44.749 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:48:44 smithi001 podman[97324]: 2024-09-19 09:48:44.548641207 +0000 UTC m=+0.495233737 container attach 980b8fab0a4769ca7202bcec0ad586d5f07097d62979d39ee697ffa2c4fec2f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-6-deactivate, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:48:44.749 INFO:journalctl@ceph.osd.6.smithi001.stdout:Sep 19 09:48:44 smithi001 podman[97324]: 2024-09-19 09:48:44.645817497 +0000 UTC m=+0.592410000 container died 980b8fab0a4769ca7202bcec0ad586d5f07097d62979d39ee697ffa2c4fec2f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-19T09:48:45.303 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@osd.6.service' 2024-09-19T09:48:45.348 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:48:45.348 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-19T09:48:45.348 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-19T09:48:45.349 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-57238232-7669-11ef-bceb-c7b262605968@osd.7 2024-09-19T09:48:45.660 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:48:45 smithi022 systemd[1]: Stopping Ceph osd.7 for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:48:46.058 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:48:45 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-7[53304]: 2024-09-19T09:48:45.658+0000 7fcd2b209640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:48:46.059 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:48:45 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-7[53304]: 2024-09-19T09:48:45.658+0000 7fcd2b209640 -1 osd.7 87 *** Got signal Terminated *** 2024-09-19T09:48:46.059 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:48:45 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-7[53304]: 2024-09-19T09:48:45.658+0000 7fcd2b209640 -1 osd.7 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:48:51.615 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:48:51 smithi022 podman[69476]: 2024-09-19 09:48:51.355621367 +0000 UTC m=+5.813818090 container died 28f7760e560027f80f0a00473730b61aad39335e715648899c64f8d80196faa7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-19T09:48:51.985 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:48:51 smithi022 podman[69476]: 2024-09-19 09:48:51.733012575 +0000 UTC m=+6.191209339 container cleanup 28f7760e560027f80f0a00473730b61aad39335e715648899c64f8d80196faa7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-7, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD) 2024-09-19T09:48:51.986 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:48:51 smithi022 bash[69476]: ceph-57238232-7669-11ef-bceb-c7b262605968-osd-7 2024-09-19T09:48:52.349 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:48:51 smithi022 podman[69506]: 2024-09-19 09:48:51.984148926 +0000 UTC m=+0.624399986 container remove 28f7760e560027f80f0a00473730b61aad39335e715648899c64f8d80196faa7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:48:52.600 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:48:52 smithi022 podman[69594]: 2024-09-19 09:48:52.250917704 +0000 UTC m=+0.015947346 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:48:52.600 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:48:52 smithi022 podman[69594]: 2024-09-19 09:48:52.351604858 +0000 UTC m=+0.116634533 container create d2ce09e7d202a2afd56fb7791c0f68d844a14c13c404324ccb28ecd8a53df03c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-2f599a4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-19T09:48:52.600 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:48:52 smithi022 podman[69594]: 2024-09-19 09:48:52.595676216 +0000 UTC m=+0.360705851 container init d2ce09e7d202a2afd56fb7791c0f68d844a14c13c404324ccb28ecd8a53df03c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:48:52.600 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:48:52 smithi022 podman[69594]: 2024-09-19 09:48:52.598927561 +0000 UTC m=+0.363957194 container start d2ce09e7d202a2afd56fb7791c0f68d844a14c13c404324ccb28ecd8a53df03c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:48:53.115 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:48:52 smithi022 podman[69594]: 2024-09-19 09:48:52.852415258 +0000 UTC m=+0.617444903 container attach d2ce09e7d202a2afd56fb7791c0f68d844a14c13c404324ccb28ecd8a53df03c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2) 2024-09-19T09:48:53.115 INFO:journalctl@ceph.osd.7.smithi022.stdout:Sep 19 09:48:52 smithi022 podman[69594]: 2024-09-19 09:48:52.853010378 +0000 UTC m=+0.618040014 container died d2ce09e7d202a2afd56fb7791c0f68d844a14c13c404324ccb28ecd8a53df03c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True) 2024-09-19T09:48:53.474 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@osd.7.service' 2024-09-19T09:48:53.521 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:48:53.521 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-19T09:48:53.522 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-19T09:48:53.522 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-57238232-7669-11ef-bceb-c7b262605968@osd.8 2024-09-19T09:48:53.800 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 19 09:48:53 smithi121 systemd[1]: Stopping Ceph osd.8 for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:48:53.800 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 19 09:48:53 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-8[53541]: 2024-09-19T09:48:53.797+0000 7efbfddf4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:48:53.801 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 19 09:48:53 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-8[53541]: 2024-09-19T09:48:53.797+0000 7efbfddf4640 -1 osd.8 87 *** Got signal Terminated *** 2024-09-19T09:48:53.801 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 19 09:48:53 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-8[53541]: 2024-09-19T09:48:53.797+0000 7efbfddf4640 -1 osd.8 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:48:55.867 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:48:55 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:48:55.450+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:50.346713+0000 front 2024-09-19T09:47:50.346804+0000 (oldest deadline 2024-09-19T09:48:54.446810+0000) 2024-09-19T09:48:56.867 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:48:56 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:48:56.478+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:50.346713+0000 front 2024-09-19T09:47:50.346804+0000 (oldest deadline 2024-09-19T09:48:54.446810+0000) 2024-09-19T09:48:57.867 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:48:57 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:48:57.473+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:50.346713+0000 front 2024-09-19T09:47:50.346804+0000 (oldest deadline 2024-09-19T09:48:54.446810+0000) 2024-09-19T09:48:58.865 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:48:58 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:48:58.515+0000 7fb838e35640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:53.010148+0000 front 2024-09-19T09:47:53.010312+0000 (oldest deadline 2024-09-19T09:48:57.710120+0000) 2024-09-19T09:48:58.867 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:48:58 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:48:58.522+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:50.346713+0000 front 2024-09-19T09:47:50.346804+0000 (oldest deadline 2024-09-19T09:48:54.446810+0000) 2024-09-19T09:48:59.248 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:48:58 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-9[62219]: 2024-09-19T09:48:58.870+0000 7f37ea3ff640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:48.009886+0000 front 2024-09-19T09:47:48.010037+0000 (oldest deadline 2024-09-19T09:48:58.010587+0000) 2024-09-19T09:48:59.666 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 19 09:48:59 smithi121 podman[69576]: 2024-09-19 09:48:59.385384476 +0000 UTC m=+5.672342337 container died c34c15a25623cd7aa5e51a8fad9f61493fffe19f7af6ae5c1095a3a8b18aeda8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-8, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T09:48:59.666 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:48:59 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:48:59.478+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:50.346713+0000 front 2024-09-19T09:47:50.346804+0000 (oldest deadline 2024-09-19T09:48:54.446810+0000) 2024-09-19T09:48:59.864 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:48:59 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:48:59.549+0000 7fb838e35640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:53.010148+0000 front 2024-09-19T09:47:53.010312+0000 (oldest deadline 2024-09-19T09:48:57.710120+0000) 2024-09-19T09:49:00.117 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 19 09:48:59 smithi121 podman[69576]: 2024-09-19 09:48:59.763788372 +0000 UTC m=+6.050746223 container cleanup c34c15a25623cd7aa5e51a8fad9f61493fffe19f7af6ae5c1095a3a8b18aeda8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-8, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-19T09:49:00.118 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 19 09:48:59 smithi121 bash[69576]: ceph-57238232-7669-11ef-bceb-c7b262605968-osd-8 2024-09-19T09:49:00.248 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:48:59 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-9[62219]: 2024-09-19T09:48:59.918+0000 7f37ea3ff640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:48.009886+0000 front 2024-09-19T09:47:48.010037+0000 (oldest deadline 2024-09-19T09:48:58.010587+0000) 2024-09-19T09:49:00.490 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 19 09:49:00 smithi121 podman[69591]: 2024-09-19 09:49:00.181822577 +0000 UTC m=+0.790301413 container remove c34c15a25623cd7aa5e51a8fad9f61493fffe19f7af6ae5c1095a3a8b18aeda8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-8, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-19T09:49:00.787 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:00 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:00.525+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:50.346713+0000 front 2024-09-19T09:47:50.346804+0000 (oldest deadline 2024-09-19T09:48:54.446810+0000) 2024-09-19T09:49:00.787 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 19 09:49:00 smithi121 podman[69676]: 2024-09-19 09:49:00.391116994 +0000 UTC m=+0.015607171 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:49:00.787 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 19 09:49:00 smithi121 podman[69676]: 2024-09-19 09:49:00.528434729 +0000 UTC m=+0.152924946 container create 644e9fcb727950dac6be55631920f800d42b08e07fb4aba617089f1dd03f5696 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T09:49:00.787 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 19 09:49:00 smithi121 podman[69676]: 2024-09-19 09:49:00.785277211 +0000 UTC m=+0.409767386 container init 644e9fcb727950dac6be55631920f800d42b08e07fb4aba617089f1dd03f5696 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:49:00.864 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:00 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:49:00.565+0000 7fb838e35640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:53.010148+0000 front 2024-09-19T09:47:53.010312+0000 (oldest deadline 2024-09-19T09:48:57.710120+0000) 2024-09-19T09:49:01.117 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 19 09:49:00 smithi121 podman[69676]: 2024-09-19 09:49:00.788867817 +0000 UTC m=+0.413357993 container start 644e9fcb727950dac6be55631920f800d42b08e07fb4aba617089f1dd03f5696 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:49:01.118 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 19 09:49:00 smithi121 podman[69676]: 2024-09-19 09:49:00.860379749 +0000 UTC m=+0.484869931 container attach 644e9fcb727950dac6be55631920f800d42b08e07fb4aba617089f1dd03f5696 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T09:49:01.118 INFO:journalctl@ceph.osd.8.smithi121.stdout:Sep 19 09:49:00 smithi121 podman[69676]: 2024-09-19 09:49:00.971587607 +0000 UTC m=+0.596077787 container died 644e9fcb727950dac6be55631920f800d42b08e07fb4aba617089f1dd03f5696 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-8-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-19T09:49:01.248 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:49:00 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-9[62219]: 2024-09-19T09:49:00.968+0000 7f37ea3ff640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:48.009886+0000 front 2024-09-19T09:47:48.010037+0000 (oldest deadline 2024-09-19T09:48:58.010587+0000) 2024-09-19T09:49:01.590 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:01 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:01.495+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:50.346713+0000 front 2024-09-19T09:47:50.346804+0000 (oldest deadline 2024-09-19T09:48:54.446810+0000) 2024-09-19T09:49:01.610 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@osd.8.service' 2024-09-19T09:49:01.650 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:49:01.650 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-19T09:49:01.651 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-19T09:49:01.651 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-57238232-7669-11ef-bceb-c7b262605968@osd.9 2024-09-19T09:49:01.930 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:49:01 smithi001 systemd[1]: Stopping Ceph osd.9 for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:49:02.114 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:01 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:49:01.614+0000 7fb838e35640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:53.010148+0000 front 2024-09-19T09:47:53.010312+0000 (oldest deadline 2024-09-19T09:48:57.710120+0000) 2024-09-19T09:49:02.248 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:49:01 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-9[62219]: 2024-09-19T09:49:01.928+0000 7f37ea3ff640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:48.009886+0000 front 2024-09-19T09:47:48.010037+0000 (oldest deadline 2024-09-19T09:48:58.010587+0000) 2024-09-19T09:49:02.249 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:49:01 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-9[62219]: 2024-09-19T09:49:01.945+0000 7f37f1df1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:49:02.249 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:49:01 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-9[62219]: 2024-09-19T09:49:01.945+0000 7f37f1df1640 -1 osd.9 87 *** Got signal Terminated *** 2024-09-19T09:49:02.249 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:49:01 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-9[62219]: 2024-09-19T09:49:01.945+0000 7f37f1df1640 -1 osd.9 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:49:02.812 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:02 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:02.540+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:50.346713+0000 front 2024-09-19T09:47:50.346804+0000 (oldest deadline 2024-09-19T09:48:54.446810+0000) 2024-09-19T09:49:02.864 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:02 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:49:02.593+0000 7fb838e35640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:53.010148+0000 front 2024-09-19T09:47:53.010312+0000 (oldest deadline 2024-09-19T09:48:57.710120+0000) 2024-09-19T09:49:03.248 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:49:02 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-9[62219]: 2024-09-19T09:49:02.943+0000 7f37ea3ff640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:48.009886+0000 front 2024-09-19T09:47:48.010037+0000 (oldest deadline 2024-09-19T09:48:58.010587+0000) 2024-09-19T09:49:03.248 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:49:02 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-9[62219]: 2024-09-19T09:49:02.943+0000 7f37ea3ff640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:47:58.011144+0000 front 2024-09-19T09:47:58.011055+0000 (oldest deadline 2024-09-19T09:49:02.611640+0000) 2024-09-19T09:49:03.864 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:03 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:49:03.604+0000 7fb838e35640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:53.010148+0000 front 2024-09-19T09:47:53.010312+0000 (oldest deadline 2024-09-19T09:48:57.710120+0000) 2024-09-19T09:49:03.867 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:03 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:03.586+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:50.346713+0000 front 2024-09-19T09:47:50.346804+0000 (oldest deadline 2024-09-19T09:48:54.446810+0000) 2024-09-19T09:49:03.867 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:03 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:03.586+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:47:59.747776+0000 front 2024-09-19T09:47:59.747805+0000 (oldest deadline 2024-09-19T09:49:03.148631+0000) 2024-09-19T09:49:04.248 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:49:03 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-9[62219]: 2024-09-19T09:49:03.951+0000 7f37ea3ff640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:48.009886+0000 front 2024-09-19T09:47:48.010037+0000 (oldest deadline 2024-09-19T09:48:58.010587+0000) 2024-09-19T09:49:04.248 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:49:03 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-9[62219]: 2024-09-19T09:49:03.951+0000 7f37ea3ff640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:47:58.011144+0000 front 2024-09-19T09:47:58.011055+0000 (oldest deadline 2024-09-19T09:49:02.611640+0000) 2024-09-19T09:49:04.864 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:04 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:49:04.570+0000 7fb838e35640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:53.010148+0000 front 2024-09-19T09:47:53.010312+0000 (oldest deadline 2024-09-19T09:48:57.710120+0000) 2024-09-19T09:49:05.117 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:04 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:04.618+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:50.346713+0000 front 2024-09-19T09:47:50.346804+0000 (oldest deadline 2024-09-19T09:48:54.446810+0000) 2024-09-19T09:49:05.117 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:04 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:04.618+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:47:59.747776+0000 front 2024-09-19T09:47:59.747805+0000 (oldest deadline 2024-09-19T09:49:03.148631+0000) 2024-09-19T09:49:05.248 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:49:04 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-9[62219]: 2024-09-19T09:49:04.908+0000 7f37ea3ff640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:48.009886+0000 front 2024-09-19T09:47:48.010037+0000 (oldest deadline 2024-09-19T09:48:58.010587+0000) 2024-09-19T09:49:05.248 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:49:04 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-9[62219]: 2024-09-19T09:49:04.908+0000 7f37ea3ff640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:47:58.011144+0000 front 2024-09-19T09:47:58.011055+0000 (oldest deadline 2024-09-19T09:49:02.611640+0000) 2024-09-19T09:49:05.864 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:05 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:49:05.548+0000 7fb838e35640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:53.010148+0000 front 2024-09-19T09:47:53.010312+0000 (oldest deadline 2024-09-19T09:48:57.710120+0000) 2024-09-19T09:49:06.019 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:05 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:05.647+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:50.346713+0000 front 2024-09-19T09:47:50.346804+0000 (oldest deadline 2024-09-19T09:48:54.446810+0000) 2024-09-19T09:49:06.019 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:05 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:05.647+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:47:59.747776+0000 front 2024-09-19T09:47:59.747805+0000 (oldest deadline 2024-09-19T09:49:03.148631+0000) 2024-09-19T09:49:06.248 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:49:05 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-9[62219]: 2024-09-19T09:49:05.948+0000 7f37ea3ff640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:48.009886+0000 front 2024-09-19T09:47:48.010037+0000 (oldest deadline 2024-09-19T09:48:58.010587+0000) 2024-09-19T09:49:06.248 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:49:05 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-9[62219]: 2024-09-19T09:49:05.948+0000 7f37ea3ff640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:47:58.011144+0000 front 2024-09-19T09:47:58.011055+0000 (oldest deadline 2024-09-19T09:49:02.611640+0000) 2024-09-19T09:49:06.864 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:06 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:49:06.573+0000 7fb838e35640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:53.010148+0000 front 2024-09-19T09:47:53.010312+0000 (oldest deadline 2024-09-19T09:48:57.710120+0000) 2024-09-19T09:49:07.117 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:06 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:06.657+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:50.346713+0000 front 2024-09-19T09:47:50.346804+0000 (oldest deadline 2024-09-19T09:48:54.446810+0000) 2024-09-19T09:49:07.118 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:06 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:06.657+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:47:59.747776+0000 front 2024-09-19T09:47:59.747805+0000 (oldest deadline 2024-09-19T09:49:03.148631+0000) 2024-09-19T09:49:07.248 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:49:06 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-9[62219]: 2024-09-19T09:49:06.941+0000 7f37ea3ff640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:48.009886+0000 front 2024-09-19T09:47:48.010037+0000 (oldest deadline 2024-09-19T09:48:58.010587+0000) 2024-09-19T09:49:07.248 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:49:06 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-9[62219]: 2024-09-19T09:49:06.941+0000 7f37ea3ff640 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:47:58.011144+0000 front 2024-09-19T09:47:58.011055+0000 (oldest deadline 2024-09-19T09:49:02.611640+0000) 2024-09-19T09:49:07.748 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:49:07 smithi001 podman[97425]: 2024-09-19 09:49:07.575006904 +0000 UTC m=+5.728871668 container died 268d9335944941e504593feb3a7658fe39726c84bb198406aa41fb853076ffba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-9, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-19T09:49:07.864 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:07 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:49:07.596+0000 7fb838e35640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:53.010148+0000 front 2024-09-19T09:47:53.010312+0000 (oldest deadline 2024-09-19T09:48:57.710120+0000) 2024-09-19T09:49:07.865 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:07 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:49:07.596+0000 7fb838e35640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:48:01.711689+0000 front 2024-09-19T09:48:01.711732+0000 (oldest deadline 2024-09-19T09:49:06.912359+0000) 2024-09-19T09:49:08.117 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:07 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:07.659+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:50.346713+0000 front 2024-09-19T09:47:50.346804+0000 (oldest deadline 2024-09-19T09:48:54.446810+0000) 2024-09-19T09:49:08.117 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:07 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:07.659+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:47:59.747776+0000 front 2024-09-19T09:47:59.747805+0000 (oldest deadline 2024-09-19T09:49:03.148631+0000) 2024-09-19T09:49:08.248 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:49:08 smithi001 podman[97425]: 2024-09-19 09:49:08.038248232 +0000 UTC m=+6.192113002 container cleanup 268d9335944941e504593feb3a7658fe39726c84bb198406aa41fb853076ffba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-9, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T09:49:08.248 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:49:08 smithi001 bash[97425]: ceph-57238232-7669-11ef-bceb-c7b262605968-osd-9 2024-09-19T09:49:08.679 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:49:08 smithi001 podman[97444]: 2024-09-19 09:49:08.331374609 +0000 UTC m=+0.748493251 container remove 268d9335944941e504593feb3a7658fe39726c84bb198406aa41fb853076ffba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-9, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T09:49:08.865 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:08 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:49:08.588+0000 7fb838e35640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:53.010148+0000 front 2024-09-19T09:47:53.010312+0000 (oldest deadline 2024-09-19T09:48:57.710120+0000) 2024-09-19T09:49:08.865 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:08 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:49:08.588+0000 7fb838e35640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:48:01.711689+0000 front 2024-09-19T09:48:01.711732+0000 (oldest deadline 2024-09-19T09:49:06.912359+0000) 2024-09-19T09:49:08.931 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:49:08 smithi001 podman[97538]: 2024-09-19 09:49:08.580408886 +0000 UTC m=+0.016382495 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:49:08.931 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:49:08 smithi001 podman[97538]: 2024-09-19 09:49:08.682198946 +0000 UTC m=+0.118172544 container create a60ca509bfe899b3fd11bb403b9c8d02b6df2bde0cb348dd9997f2970db4f271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:49:08.931 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:49:08 smithi001 podman[97538]: 2024-09-19 09:49:08.926878413 +0000 UTC m=+0.362852015 container init a60ca509bfe899b3fd11bb403b9c8d02b6df2bde0cb348dd9997f2970db4f271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:49:08.931 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:49:08 smithi001 podman[97538]: 2024-09-19 09:49:08.930292502 +0000 UTC m=+0.366266107 container start a60ca509bfe899b3fd11bb403b9c8d02b6df2bde0cb348dd9997f2970db4f271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T09:49:09.117 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:08 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:08.615+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:50.346713+0000 front 2024-09-19T09:47:50.346804+0000 (oldest deadline 2024-09-19T09:48:54.446810+0000) 2024-09-19T09:49:09.118 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:08 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:08.615+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:47:59.747776+0000 front 2024-09-19T09:47:59.747805+0000 (oldest deadline 2024-09-19T09:49:03.148631+0000) 2024-09-19T09:49:09.248 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:49:09 smithi001 podman[97538]: 2024-09-19 09:49:09.035376262 +0000 UTC m=+0.471349879 container attach a60ca509bfe899b3fd11bb403b9c8d02b6df2bde0cb348dd9997f2970db4f271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-19T09:49:09.248 INFO:journalctl@ceph.osd.9.smithi001.stdout:Sep 19 09:49:09 smithi001 podman[97538]: 2024-09-19 09:49:09.125779373 +0000 UTC m=+0.561752981 container died a60ca509bfe899b3fd11bb403b9c8d02b6df2bde0cb348dd9997f2970db4f271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-2f599a4) 2024-09-19T09:49:09.798 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@osd.9.service' 2024-09-19T09:49:09.843 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:49:09.843 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-19T09:49:09.843 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-19T09:49:09.844 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-57238232-7669-11ef-bceb-c7b262605968@osd.10 2024-09-19T09:49:09.864 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:09 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:49:09.609+0000 7fb838e35640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:53.010148+0000 front 2024-09-19T09:47:53.010312+0000 (oldest deadline 2024-09-19T09:48:57.710120+0000) 2024-09-19T09:49:09.864 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:09 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:49:09.609+0000 7fb838e35640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:48:01.711689+0000 front 2024-09-19T09:48:01.711732+0000 (oldest deadline 2024-09-19T09:49:06.912359+0000) 2024-09-19T09:49:10.117 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:09 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:09.649+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:50.346713+0000 front 2024-09-19T09:47:50.346804+0000 (oldest deadline 2024-09-19T09:48:54.446810+0000) 2024-09-19T09:49:10.118 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:09 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:09.649+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:47:59.747776+0000 front 2024-09-19T09:47:59.747805+0000 (oldest deadline 2024-09-19T09:49:03.148631+0000) 2024-09-19T09:49:10.170 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:09 smithi022 systemd[1]: Stopping Ceph osd.10 for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:49:10.170 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:10 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:49:10.167+0000 7fb840827640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:49:10.170 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:10 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:49:10.167+0000 7fb840827640 -1 osd.10 87 *** Got signal Terminated *** 2024-09-19T09:49:10.614 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:10 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:49:10.167+0000 7fb840827640 -1 osd.10 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:49:11.115 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:10 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:49:10.646+0000 7fb838e35640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:53.010148+0000 front 2024-09-19T09:47:53.010312+0000 (oldest deadline 2024-09-19T09:48:57.710120+0000) 2024-09-19T09:49:11.115 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:10 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:49:10.646+0000 7fb838e35640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:48:01.711689+0000 front 2024-09-19T09:48:01.711732+0000 (oldest deadline 2024-09-19T09:49:06.912359+0000) 2024-09-19T09:49:11.117 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:10 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:10.696+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:50.346713+0000 front 2024-09-19T09:47:50.346804+0000 (oldest deadline 2024-09-19T09:48:54.446810+0000) 2024-09-19T09:49:11.117 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:10 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:10.696+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:47:59.747776+0000 front 2024-09-19T09:47:59.747805+0000 (oldest deadline 2024-09-19T09:49:03.148631+0000) 2024-09-19T09:49:12.114 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:11 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:49:11.617+0000 7fb838e35640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:53.010148+0000 front 2024-09-19T09:47:53.010312+0000 (oldest deadline 2024-09-19T09:48:57.710120+0000) 2024-09-19T09:49:12.115 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:11 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:49:11.617+0000 7fb838e35640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:48:01.711689+0000 front 2024-09-19T09:48:01.711732+0000 (oldest deadline 2024-09-19T09:49:06.912359+0000) 2024-09-19T09:49:12.117 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:11 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:11.661+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:50.346713+0000 front 2024-09-19T09:47:50.346804+0000 (oldest deadline 2024-09-19T09:48:54.446810+0000) 2024-09-19T09:49:12.117 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:11 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:11.661+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:47:59.747776+0000 front 2024-09-19T09:47:59.747805+0000 (oldest deadline 2024-09-19T09:49:03.148631+0000) 2024-09-19T09:49:12.117 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:11 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:11.661+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-19T09:48:09.851967+0000 front 2024-09-19T09:48:09.852001+0000 (oldest deadline 2024-09-19T09:49:10.952041+0000) 2024-09-19T09:49:12.864 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:12 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:49:12.568+0000 7fb838e35640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:53.010148+0000 front 2024-09-19T09:47:53.010312+0000 (oldest deadline 2024-09-19T09:48:57.710120+0000) 2024-09-19T09:49:12.864 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:12 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:49:12.568+0000 7fb838e35640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:48:01.711689+0000 front 2024-09-19T09:48:01.711732+0000 (oldest deadline 2024-09-19T09:49:06.912359+0000) 2024-09-19T09:49:13.117 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:12 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:12.629+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:50.346713+0000 front 2024-09-19T09:47:50.346804+0000 (oldest deadline 2024-09-19T09:48:54.446810+0000) 2024-09-19T09:49:13.117 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:12 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:12.629+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:47:59.747776+0000 front 2024-09-19T09:47:59.747805+0000 (oldest deadline 2024-09-19T09:49:03.148631+0000) 2024-09-19T09:49:13.118 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:12 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:12.629+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-19T09:48:09.851967+0000 front 2024-09-19T09:48:09.852001+0000 (oldest deadline 2024-09-19T09:49:10.952041+0000) 2024-09-19T09:49:14.114 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:13 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:49:13.613+0000 7fb838e35640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:53.010148+0000 front 2024-09-19T09:47:53.010312+0000 (oldest deadline 2024-09-19T09:48:57.710120+0000) 2024-09-19T09:49:14.114 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:13 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:49:13.613+0000 7fb838e35640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:48:01.711689+0000 front 2024-09-19T09:48:01.711732+0000 (oldest deadline 2024-09-19T09:49:06.912359+0000) 2024-09-19T09:49:14.120 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:13 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:13.617+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:50.346713+0000 front 2024-09-19T09:47:50.346804+0000 (oldest deadline 2024-09-19T09:48:54.446810+0000) 2024-09-19T09:49:14.120 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:13 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:13.617+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:47:59.747776+0000 front 2024-09-19T09:47:59.747805+0000 (oldest deadline 2024-09-19T09:49:03.148631+0000) 2024-09-19T09:49:14.120 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:13 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:13.617+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-19T09:48:09.851967+0000 front 2024-09-19T09:48:09.852001+0000 (oldest deadline 2024-09-19T09:49:10.952041+0000) 2024-09-19T09:49:14.864 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:14 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:49:14.567+0000 7fb838e35640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:53.010148+0000 front 2024-09-19T09:47:53.010312+0000 (oldest deadline 2024-09-19T09:48:57.710120+0000) 2024-09-19T09:49:14.865 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:14 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:49:14.567+0000 7fb838e35640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:48:01.711689+0000 front 2024-09-19T09:48:01.711732+0000 (oldest deadline 2024-09-19T09:49:06.912359+0000) 2024-09-19T09:49:14.865 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:14 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10[60129]: 2024-09-19T09:49:14.567+0000 7fb838e35640 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-19T09:48:09.813392+0000 front 2024-09-19T09:48:09.813372+0000 (oldest deadline 2024-09-19T09:49:14.513331+0000) 2024-09-19T09:49:15.117 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:14 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:14.617+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:50.346713+0000 front 2024-09-19T09:47:50.346804+0000 (oldest deadline 2024-09-19T09:48:54.446810+0000) 2024-09-19T09:49:15.118 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:14 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:14.617+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:47:59.747776+0000 front 2024-09-19T09:47:59.747805+0000 (oldest deadline 2024-09-19T09:49:03.148631+0000) 2024-09-19T09:49:15.118 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:14 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:14.617+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-19T09:48:09.851967+0000 front 2024-09-19T09:48:09.852001+0000 (oldest deadline 2024-09-19T09:49:10.952041+0000) 2024-09-19T09:49:16.069 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:15 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:15.626+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:50.346713+0000 front 2024-09-19T09:47:50.346804+0000 (oldest deadline 2024-09-19T09:48:54.446810+0000) 2024-09-19T09:49:16.069 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:15 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:15.626+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:47:59.747776+0000 front 2024-09-19T09:47:59.747805+0000 (oldest deadline 2024-09-19T09:49:03.148631+0000) 2024-09-19T09:49:16.069 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:15 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:15.626+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-19T09:48:09.851967+0000 front 2024-09-19T09:48:09.852001+0000 (oldest deadline 2024-09-19T09:49:10.952041+0000) 2024-09-19T09:49:16.115 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:15 smithi022 podman[69698]: 2024-09-19 09:49:15.789227569 +0000 UTC m=+5.751364080 container died 10bcd9485144dd21b49aac9d311d7724d30658d65b2a0c300491e163ad01e91e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T09:49:16.411 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:16 smithi022 podman[69698]: 2024-09-19 09:49:16.217462732 +0000 UTC m=+6.179599243 container cleanup 10bcd9485144dd21b49aac9d311d7724d30658d65b2a0c300491e163ad01e91e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-19T09:49:16.412 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:16 smithi022 bash[69698]: ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10 2024-09-19T09:49:16.824 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:16 smithi022 podman[69715]: 2024-09-19 09:49:16.410367708 +0000 UTC m=+0.619850599 container remove 10bcd9485144dd21b49aac9d311d7724d30658d65b2a0c300491e163ad01e91e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T09:49:17.115 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:16 smithi022 podman[69808]: 2024-09-19 09:49:16.72609169 +0000 UTC m=+0.016417450 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:49:17.115 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:16 smithi022 podman[69808]: 2024-09-19 09:49:16.827515971 +0000 UTC m=+0.117841728 container create 352fa4ce3c37b9a8e46a8ce532851a2836ba8677222d7ff323e110d60b133e3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T09:49:17.115 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:17 smithi022 podman[69808]: 2024-09-19 09:49:17.04666427 +0000 UTC m=+0.336990019 container init 352fa4ce3c37b9a8e46a8ce532851a2836ba8677222d7ff323e110d60b133e3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:49:17.115 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:17 smithi022 podman[69808]: 2024-09-19 09:49:17.050021212 +0000 UTC m=+0.340346963 container start 352fa4ce3c37b9a8e46a8ce532851a2836ba8677222d7ff323e110d60b133e3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T09:49:17.117 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:16 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:16.619+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:50.346713+0000 front 2024-09-19T09:47:50.346804+0000 (oldest deadline 2024-09-19T09:48:54.446810+0000) 2024-09-19T09:49:17.117 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:16 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:16.619+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:47:59.747776+0000 front 2024-09-19T09:47:59.747805+0000 (oldest deadline 2024-09-19T09:49:03.148631+0000) 2024-09-19T09:49:17.117 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:16 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:16.619+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-19T09:48:09.851967+0000 front 2024-09-19T09:48:09.852001+0000 (oldest deadline 2024-09-19T09:49:10.952041+0000) 2024-09-19T09:49:17.514 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:17 smithi022 podman[69808]: 2024-09-19 09:49:17.138007597 +0000 UTC m=+0.428333354 container attach 352fa4ce3c37b9a8e46a8ce532851a2836ba8677222d7ff323e110d60b133e3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T09:49:17.514 INFO:journalctl@ceph.osd.10.smithi022.stdout:Sep 19 09:49:17 smithi022 podman[69808]: 2024-09-19 09:49:17.240309976 +0000 UTC m=+0.530635736 container died 352fa4ce3c37b9a8e46a8ce532851a2836ba8677222d7ff323e110d60b133e3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:49:17.922 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@osd.10.service' 2024-09-19T09:49:18.001 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:49:18.004 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-19T09:49:18.004 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-19T09:49:18.004 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-57238232-7669-11ef-bceb-c7b262605968@osd.11 2024-09-19T09:49:18.033 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:17 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:17.653+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:50.346713+0000 front 2024-09-19T09:47:50.346804+0000 (oldest deadline 2024-09-19T09:48:54.446810+0000) 2024-09-19T09:49:18.033 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:17 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:17.653+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:47:59.747776+0000 front 2024-09-19T09:47:59.747805+0000 (oldest deadline 2024-09-19T09:49:03.148631+0000) 2024-09-19T09:49:18.033 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:17 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:17.653+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-19T09:48:09.851967+0000 front 2024-09-19T09:48:09.852001+0000 (oldest deadline 2024-09-19T09:49:10.952041+0000) 2024-09-19T09:49:18.317 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:18 smithi121 systemd[1]: Stopping Ceph osd.11 for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:49:18.617 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:18 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:18.315+0000 7f4064557640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:49:18.617 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:18 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:18.315+0000 7f4064557640 -1 osd.11 87 *** Got signal Terminated *** 2024-09-19T09:49:18.617 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:18 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:18.315+0000 7f4064557640 -1 osd.11 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:49:19.117 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:18 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:18.654+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:50.346713+0000 front 2024-09-19T09:47:50.346804+0000 (oldest deadline 2024-09-19T09:48:54.446810+0000) 2024-09-19T09:49:19.118 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:18 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:18.654+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:47:59.747776+0000 front 2024-09-19T09:47:59.747805+0000 (oldest deadline 2024-09-19T09:49:03.148631+0000) 2024-09-19T09:49:19.118 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:18 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:18.654+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-19T09:48:09.851967+0000 front 2024-09-19T09:48:09.852001+0000 (oldest deadline 2024-09-19T09:49:10.952041+0000) 2024-09-19T09:49:20.117 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:19 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:19.663+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:50.346713+0000 front 2024-09-19T09:47:50.346804+0000 (oldest deadline 2024-09-19T09:48:54.446810+0000) 2024-09-19T09:49:20.117 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:19 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:19.663+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:47:59.747776+0000 front 2024-09-19T09:47:59.747805+0000 (oldest deadline 2024-09-19T09:49:03.148631+0000) 2024-09-19T09:49:20.117 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:19 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:19.663+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-19T09:48:09.851967+0000 front 2024-09-19T09:48:09.852001+0000 (oldest deadline 2024-09-19T09:49:10.952041+0000) 2024-09-19T09:49:21.117 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:20 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:20.632+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:50.346713+0000 front 2024-09-19T09:47:50.346804+0000 (oldest deadline 2024-09-19T09:48:54.446810+0000) 2024-09-19T09:49:21.118 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:20 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:20.632+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:47:59.747776+0000 front 2024-09-19T09:47:59.747805+0000 (oldest deadline 2024-09-19T09:49:03.148631+0000) 2024-09-19T09:49:21.118 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:20 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:20.632+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-19T09:48:09.851967+0000 front 2024-09-19T09:48:09.852001+0000 (oldest deadline 2024-09-19T09:49:10.952041+0000) 2024-09-19T09:49:22.117 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:21 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:21.677+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:50.346713+0000 front 2024-09-19T09:47:50.346804+0000 (oldest deadline 2024-09-19T09:48:54.446810+0000) 2024-09-19T09:49:22.117 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:21 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:21.677+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:47:59.747776+0000 front 2024-09-19T09:47:59.747805+0000 (oldest deadline 2024-09-19T09:49:03.148631+0000) 2024-09-19T09:49:22.118 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:21 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:21.677+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-19T09:48:09.851967+0000 front 2024-09-19T09:48:09.852001+0000 (oldest deadline 2024-09-19T09:49:10.952041+0000) 2024-09-19T09:49:23.117 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:22 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:22.664+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.1:6806 osd.0 since back 2024-09-19T09:47:50.346713+0000 front 2024-09-19T09:47:50.346804+0000 (oldest deadline 2024-09-19T09:48:54.446810+0000) 2024-09-19T09:49:23.118 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:22 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:22.664+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.22:6804 osd.1 since back 2024-09-19T09:47:59.747776+0000 front 2024-09-19T09:47:59.747805+0000 (oldest deadline 2024-09-19T09:49:03.148631+0000) 2024-09-19T09:49:23.118 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:22 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:22.664+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.121:6804 osd.2 since back 2024-09-19T09:48:09.851967+0000 front 2024-09-19T09:48:09.852001+0000 (oldest deadline 2024-09-19T09:49:10.952041+0000) 2024-09-19T09:49:23.118 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:22 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11[60049]: 2024-09-19T09:49:22.664+0000 7f405cb65640 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.1:6814 osd.3 since back 2024-09-19T09:48:15.553421+0000 front 2024-09-19T09:48:15.553441+0000 (oldest deadline 2024-09-19T09:49:21.954066+0000) 2024-09-19T09:49:24.109 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:23 smithi121 podman[69791]: 2024-09-19 09:49:23.831804806 +0000 UTC m=+5.630301430 container died a3eb8d92236b7cc2ba79b539a8e516356622a661288da56efd61b2a2f0cecfcb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:49:24.367 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:24 smithi121 podman[69791]: 2024-09-19 09:49:24.198018026 +0000 UTC m=+5.996514647 container cleanup a3eb8d92236b7cc2ba79b539a8e516356622a661288da56efd61b2a2f0cecfcb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:49:24.367 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:24 smithi121 bash[69791]: ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11 2024-09-19T09:49:24.801 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:24 smithi121 podman[69805]: 2024-09-19 09:49:24.474384382 +0000 UTC m=+0.645410870 container remove a3eb8d92236b7cc2ba79b539a8e516356622a661288da56efd61b2a2f0cecfcb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-19T09:49:25.117 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:24 smithi121 podman[69894]: 2024-09-19 09:49:24.702748464 +0000 UTC m=+0.015795580 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:49:25.118 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:24 smithi121 podman[69894]: 2024-09-19 09:49:24.808517005 +0000 UTC m=+0.121564145 container create 0c9cc382ad24ef3095faf6285db1a6cadf39c7b20c7980e5b790651bd423ea49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS) 2024-09-19T09:49:25.118 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:25 smithi121 podman[69894]: 2024-09-19 09:49:25.010761208 +0000 UTC m=+0.323808306 container init 0c9cc382ad24ef3095faf6285db1a6cadf39c7b20c7980e5b790651bd423ea49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:49:25.118 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:25 smithi121 podman[69894]: 2024-09-19 09:49:25.01399903 +0000 UTC m=+0.327046128 container start 0c9cc382ad24ef3095faf6285db1a6cadf39c7b20c7980e5b790651bd423ea49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True) 2024-09-19T09:49:25.524 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:25 smithi121 podman[69894]: 2024-09-19 09:49:25.127225884 +0000 UTC m=+0.440272986 container attach 0c9cc382ad24ef3095faf6285db1a6cadf39c7b20c7980e5b790651bd423ea49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T09:49:25.524 INFO:journalctl@ceph.osd.11.smithi121.stdout:Sep 19 09:49:25 smithi121 podman[69894]: 2024-09-19 09:49:25.202912332 +0000 UTC m=+0.515959431 container died 0c9cc382ad24ef3095faf6285db1a6cadf39c7b20c7980e5b790651bd423ea49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T09:49:25.837 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@osd.11.service' 2024-09-19T09:49:25.922 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:49:25.923 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-19T09:49:25.923 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-19T09:49:25.923 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-57238232-7669-11ef-bceb-c7b262605968@mds.a 2024-09-19T09:49:26.226 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 09:49:25 smithi001 systemd[1]: Stopping Ceph mds.a for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:49:26.498 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 09:49:26 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-a[69094]: 2024-09-19T09:49:26.224+0000 7f934fd14640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:49:26.498 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 09:49:26 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-a[69094]: 2024-09-19T09:49:26.224+0000 7f934fd14640 -1 mds.a *** got signal Terminated *** 2024-09-19T09:49:28.779 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 09:49:28 smithi001 podman[97640]: 2024-09-19 09:49:28.512478696 +0000 UTC m=+2.389994474 container died 1c9036e8984a700d01f0071734f7c93c571240d8bf41bb987605f00fd0839dbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-a, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T09:49:29.135 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 09:49:28 smithi001 podman[97640]: 2024-09-19 09:49:28.949066371 +0000 UTC m=+2.826582149 container cleanup 1c9036e8984a700d01f0071734f7c93c571240d8bf41bb987605f00fd0839dbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:49:29.135 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 09:49:28 smithi001 bash[97640]: ceph-57238232-7669-11ef-bceb-c7b262605968-mds-a 2024-09-19T09:49:29.384 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mds.a.service' 2024-09-19T09:49:29.407 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 09:49:29 smithi001 podman[97652]: 2024-09-19 09:49:29.13388765 +0000 UTC m=+0.616450993 container remove 1c9036e8984a700d01f0071734f7c93c571240d8bf41bb987605f00fd0839dbe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:49:29.407 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 09:49:29 smithi001 systemd[1]: ceph-57238232-7669-11ef-bceb-c7b262605968@mds.a.service: Deactivated successfully. 2024-09-19T09:49:29.407 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 09:49:29 smithi001 systemd[1]: Stopped Ceph mds.a for 57238232-7669-11ef-bceb-c7b262605968. 2024-09-19T09:49:29.407 INFO:journalctl@ceph.mds.a.smithi001.stdout:Sep 19 09:49:29 smithi001 systemd[1]: ceph-57238232-7669-11ef-bceb-c7b262605968@mds.a.service: Consumed 1.037s CPU time. 2024-09-19T09:49:29.420 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:49:29.421 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-19T09:49:29.421 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-19T09:49:29.421 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-57238232-7669-11ef-bceb-c7b262605968@mds.d 2024-09-19T09:49:29.748 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 09:49:29 smithi001 systemd[1]: Stopping Ceph mds.d for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:49:30.248 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 09:49:29 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-d[67905]: 2024-09-19T09:49:29.752+0000 7faea549c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:49:30.248 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 09:49:29 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-d[67905]: 2024-09-19T09:49:29.752+0000 7faea549c640 -1 mds.d *** got signal Terminated *** 2024-09-19T09:49:33.222 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 09:49:32 smithi001 podman[97761]: 2024-09-19 09:49:32.926061192 +0000 UTC m=+3.281143315 container died 5e8d87397b2c19050f70ef9f8b620d113161cb1195f27f875c4e4103d4cedeae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-d, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731) 2024-09-19T09:49:33.498 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 09:49:33 smithi001 podman[97761]: 2024-09-19 09:49:33.370324273 +0000 UTC m=+3.725406387 container cleanup 5e8d87397b2c19050f70ef9f8b620d113161cb1195f27f875c4e4103d4cedeae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-d, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-19T09:49:33.498 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 09:49:33 smithi001 bash[97761]: ceph-57238232-7669-11ef-bceb-c7b262605968-mds-d 2024-09-19T09:49:33.848 INFO:journalctl@ceph.mds.d.smithi001.stdout:Sep 19 09:49:33 smithi001 podman[97776]: 2024-09-19 09:49:33.596908032 +0000 UTC m=+0.646846484 container remove 5e8d87397b2c19050f70ef9f8b620d113161cb1195f27f875c4e4103d4cedeae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-d, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-19T09:49:33.869 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mds.d.service' 2024-09-19T09:49:33.903 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:49:33.903 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-19T09:49:33.903 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-19T09:49:33.904 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-57238232-7669-11ef-bceb-c7b262605968@mds.g 2024-09-19T09:49:34.226 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 09:49:33 smithi001 systemd[1]: Stopping Ceph mds.g for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:49:34.498 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 09:49:34 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-g[68707]: 2024-09-19T09:49:34.224+0000 7f63d3434640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:49:34.498 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 09:49:34 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-g[68707]: 2024-09-19T09:49:34.224+0000 7f63d3434640 -1 mds.g *** got signal Terminated *** 2024-09-19T09:49:37.176 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 09:49:36 smithi001 podman[97884]: 2024-09-19 09:49:36.8782736 +0000 UTC m=+2.748726470 container died 14008ea33ca1a88a75fcff0dc8c9d93eb857d734aad64747cfa77172576ec545 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-g, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:49:37.498 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 09:49:37 smithi001 podman[97884]: 2024-09-19 09:49:37.299703153 +0000 UTC m=+3.170156021 container cleanup 14008ea33ca1a88a75fcff0dc8c9d93eb857d734aad64747cfa77172576ec545 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-g, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True) 2024-09-19T09:49:37.498 INFO:journalctl@ceph.mds.g.smithi001.stdout:Sep 19 09:49:37 smithi001 bash[97884]: ceph-57238232-7669-11ef-bceb-c7b262605968-mds-g 2024-09-19T09:49:37.747 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mds.g.service' 2024-09-19T09:49:37.782 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:49:37.782 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-19T09:49:37.782 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-19T09:49:37.782 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ceph-57238232-7669-11ef-bceb-c7b262605968@mds.j 2024-09-19T09:49:38.113 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 09:49:37 smithi001 systemd[1]: Stopping Ceph mds.j for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:49:38.498 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 09:49:38 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-j[67509]: 2024-09-19T09:49:38.111+0000 7fb7d022c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:49:38.498 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 09:49:38 smithi001 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-j[67509]: 2024-09-19T09:49:38.111+0000 7fb7d022c640 -1 mds.j *** got signal Terminated *** 2024-09-19T09:49:41.498 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 09:49:41 smithi001 podman[98002]: 2024-09-19 09:49:41.284097542 +0000 UTC m=+3.273109081 container died 5b9ead5d5375c403492b04bc3f4b2281b205693903b7c748a6beacce3ec316f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-j, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:49:41.948 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 09:49:41 smithi001 podman[98002]: 2024-09-19 09:49:41.695861259 +0000 UTC m=+3.684872840 container cleanup 5b9ead5d5375c403492b04bc3f4b2281b205693903b7c748a6beacce3ec316f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-j, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T09:49:41.948 INFO:journalctl@ceph.mds.j.smithi001.stdout:Sep 19 09:49:41 smithi001 bash[98002]: ceph-57238232-7669-11ef-bceb-c7b262605968-mds-j 2024-09-19T09:49:42.170 DEBUG:teuthology.orchestra.run.smithi001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mds.j.service' 2024-09-19T09:49:42.207 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:49:42.207 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-19T09:49:42.207 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-19T09:49:42.207 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-57238232-7669-11ef-bceb-c7b262605968@mds.b 2024-09-19T09:49:42.527 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:49:42 smithi022 systemd[1]: Stopping Ceph mds.b for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:49:42.864 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:49:42 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-b[65343]: 2024-09-19T09:49:42.525+0000 7fbc95aa8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:49:42.865 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:49:42 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-b[65343]: 2024-09-19T09:49:42.525+0000 7fbc95aa8640 -1 mds.b *** got signal Terminated *** 2024-09-19T09:49:45.534 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:49:45 smithi022 podman[69922]: 2024-09-19 09:49:45.179984272 +0000 UTC m=+2.772418865 container died 3f7d58492c6e29a8de24eab0296a96302861de9cfc4b0ad097c1b8f409a17c74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-19T09:49:45.827 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:49:45 smithi022 podman[69922]: 2024-09-19 09:49:45.533007712 +0000 UTC m=+3.125442303 container cleanup 3f7d58492c6e29a8de24eab0296a96302861de9cfc4b0ad097c1b8f409a17c74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T09:49:45.828 INFO:journalctl@ceph.mds.b.smithi022.stdout:Sep 19 09:49:45 smithi022 bash[69922]: ceph-57238232-7669-11ef-bceb-c7b262605968-mds-b 2024-09-19T09:49:45.968 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mds.b.service' 2024-09-19T09:49:46.002 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:49:46.002 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-19T09:49:46.002 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-19T09:49:46.002 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-57238232-7669-11ef-bceb-c7b262605968@mds.e 2024-09-19T09:49:46.114 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:49:46 smithi022 systemd[1]: Stopping Ceph mds.e for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:49:46.614 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:49:46 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-e[64729]: 2024-09-19T09:49:46.320+0000 7fbffb4d3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:49:46.615 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:49:46 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-e[64729]: 2024-09-19T09:49:46.320+0000 7fbffb4d3640 -1 mds.e *** got signal Terminated *** 2024-09-19T09:49:47.972 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:49:47 smithi022 podman[70043]: 2024-09-19 09:49:47.698444902 +0000 UTC m=+1.479005426 container died e4de37a7b3cb124677a3d87de48065258b5a45bb2b0039bdd40c10146cd8c04a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-e, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-19T09:49:48.322 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:49:48 smithi022 podman[70043]: 2024-09-19 09:49:48.086707476 +0000 UTC m=+1.867268001 container cleanup e4de37a7b3cb124677a3d87de48065258b5a45bb2b0039bdd40c10146cd8c04a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-e, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:49:48.323 INFO:journalctl@ceph.mds.e.smithi022.stdout:Sep 19 09:49:48 smithi022 bash[70043]: ceph-57238232-7669-11ef-bceb-c7b262605968-mds-e 2024-09-19T09:49:48.474 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mds.e.service' 2024-09-19T09:49:48.508 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:49:48.508 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-19T09:49:48.509 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-19T09:49:48.509 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-57238232-7669-11ef-bceb-c7b262605968@mds.h 2024-09-19T09:49:48.864 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:49:48 smithi022 systemd[1]: Stopping Ceph mds.h for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:49:48.865 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:49:48 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-h[65031]: 2024-09-19T09:49:48.833+0000 7ff77af4e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:49:48.865 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:49:48 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-h[65031]: 2024-09-19T09:49:48.833+0000 7ff77af4e640 -1 mds.h *** got signal Terminated *** 2024-09-19T09:49:53.115 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:49:52 smithi022 podman[70177]: 2024-09-19 09:49:52.83918897 +0000 UTC m=+4.111095686 container died 8d4f635f858e8d87b92588c491d25e8b0412ff38bf086120743ce24fdb168ff0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-h, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True) 2024-09-19T09:49:53.615 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:49:53 smithi022 podman[70177]: 2024-09-19 09:49:53.215947526 +0000 UTC m=+4.487854251 container cleanup 8d4f635f858e8d87b92588c491d25e8b0412ff38bf086120743ce24fdb168ff0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-h, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-19T09:49:53.615 INFO:journalctl@ceph.mds.h.smithi022.stdout:Sep 19 09:49:53 smithi022 bash[70177]: ceph-57238232-7669-11ef-bceb-c7b262605968-mds-h 2024-09-19T09:49:53.811 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mds.h.service' 2024-09-19T09:49:53.845 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:49:53.846 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-19T09:49:53.846 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-19T09:49:53.846 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-57238232-7669-11ef-bceb-c7b262605968@mds.k 2024-09-19T09:49:54.365 INFO:journalctl@ceph.mds.k.smithi022.stdout:Sep 19 09:49:53 smithi022 systemd[1]: Stopping Ceph mds.k for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:49:54.365 INFO:journalctl@ceph.mds.k.smithi022.stdout:Sep 19 09:49:54 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-k[64412]: 2024-09-19T09:49:54.152+0000 7fdf376a8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:49:54.365 INFO:journalctl@ceph.mds.k.smithi022.stdout:Sep 19 09:49:54 smithi022 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-k[64412]: 2024-09-19T09:49:54.152+0000 7fdf376a8640 -1 mds.k *** got signal Terminated *** 2024-09-19T09:49:58.154 INFO:journalctl@ceph.mds.k.smithi022.stdout:Sep 19 09:49:57 smithi022 podman[70300]: 2024-09-19 09:49:57.924261271 +0000 UTC m=+3.861101850 container died 7e839c0b40c0b8815ced5f03d07d8bf7fd3a231276f9daf3ff03cfdf80cfaf9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-k, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T09:49:58.480 INFO:journalctl@ceph.mds.k.smithi022.stdout:Sep 19 09:49:58 smithi022 podman[70300]: 2024-09-19 09:49:58.227128845 +0000 UTC m=+4.163969413 container cleanup 7e839c0b40c0b8815ced5f03d07d8bf7fd3a231276f9daf3ff03cfdf80cfaf9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-k, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T09:49:58.480 INFO:journalctl@ceph.mds.k.smithi022.stdout:Sep 19 09:49:58 smithi022 bash[70300]: ceph-57238232-7669-11ef-bceb-c7b262605968-mds-k 2024-09-19T09:49:58.661 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mds.k.service' 2024-09-19T09:49:58.693 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:49:58.693 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-19T09:49:58.693 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-19T09:49:58.693 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-57238232-7669-11ef-bceb-c7b262605968@mds.c 2024-09-19T09:49:58.989 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 19 09:49:58 smithi121 systemd[1]: Stopping Ceph mds.c for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:49:59.241 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 19 09:49:58 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-c[64887]: 2024-09-19T09:49:58.986+0000 7f730ffff640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:49:59.242 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 19 09:49:58 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-c[64887]: 2024-09-19T09:49:58.986+0000 7f730ffff640 -1 mds.c *** got signal Terminated *** 2024-09-19T09:50:01.052 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 19 09:50:00 smithi121 podman[69996]: 2024-09-19 09:50:00.779991518 +0000 UTC m=+1.896430587 container died 1a89475d9e5c66225846f5d74a027212f897cbf079562948033f1b1e6656c3d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-c, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True) 2024-09-19T09:50:01.367 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 19 09:50:01 smithi121 podman[69996]: 2024-09-19 09:50:01.178092547 +0000 UTC m=+2.294531603 container cleanup 1a89475d9e5c66225846f5d74a027212f897cbf079562948033f1b1e6656c3d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-c, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:50:01.367 INFO:journalctl@ceph.mds.c.smithi121.stdout:Sep 19 09:50:01 smithi121 bash[69996]: ceph-57238232-7669-11ef-bceb-c7b262605968-mds-c 2024-09-19T09:50:01.602 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mds.c.service' 2024-09-19T09:50:01.639 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:50:01.639 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-19T09:50:01.640 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-19T09:50:01.640 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-57238232-7669-11ef-bceb-c7b262605968@mds.f 2024-09-19T09:50:01.984 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 19 09:50:01 smithi121 systemd[1]: Stopping Ceph mds.f for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:50:02.367 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 19 09:50:01 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-f[64581]: 2024-09-19T09:50:01.982+0000 7f8f8f503640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:50:02.368 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 19 09:50:01 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-f[64581]: 2024-09-19T09:50:01.982+0000 7f8f8f503640 -1 mds.f *** got signal Terminated *** 2024-09-19T09:50:06.267 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 19 09:50:05 smithi121 podman[70132]: 2024-09-19 09:50:05.995786176 +0000 UTC m=+4.130683548 container died 7f23f6a767fb58e1220e50c0a77bd816aaa7527d05ea80bb7e9df071bb06a0cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-f, RELEASE=squid-2f599a4, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T09:50:06.617 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 19 09:50:06 smithi121 podman[70132]: 2024-09-19 09:50:06.356551392 +0000 UTC m=+4.491448760 container cleanup 7f23f6a767fb58e1220e50c0a77bd816aaa7527d05ea80bb7e9df071bb06a0cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-f, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T09:50:06.618 INFO:journalctl@ceph.mds.f.smithi121.stdout:Sep 19 09:50:06 smithi121 bash[70132]: ceph-57238232-7669-11ef-bceb-c7b262605968-mds-f 2024-09-19T09:50:06.789 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mds.f.service' 2024-09-19T09:50:06.823 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:50:06.823 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-19T09:50:06.823 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-19T09:50:06.823 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-57238232-7669-11ef-bceb-c7b262605968@mds.i 2024-09-19T09:50:07.367 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 19 09:50:06 smithi121 systemd[1]: Stopping Ceph mds.i for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:50:07.368 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 19 09:50:07 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-i[65189]: 2024-09-19T09:50:07.126+0000 7f999cbbb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:50:07.368 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 19 09:50:07 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-i[65189]: 2024-09-19T09:50:07.126+0000 7f999cbbb640 -1 mds.i *** got signal Terminated *** 2024-09-19T09:50:10.428 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 19 09:50:10 smithi121 podman[70254]: 2024-09-19 09:50:10.135949867 +0000 UTC m=+3.093604988 container died c569610bce6a6272a799b0e19fdbf3069ab7255cdee61a8b801c9c125196d021 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-i, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:50:10.754 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 19 09:50:10 smithi121 podman[70254]: 2024-09-19 09:50:10.518519652 +0000 UTC m=+3.476174773 container cleanup c569610bce6a6272a799b0e19fdbf3069ab7255cdee61a8b801c9c125196d021 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-i, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T09:50:10.755 INFO:journalctl@ceph.mds.i.smithi121.stdout:Sep 19 09:50:10 smithi121 bash[70254]: ceph-57238232-7669-11ef-bceb-c7b262605968-mds-i 2024-09-19T09:50:10.886 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mds.i.service' 2024-09-19T09:50:10.919 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:50:10.920 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-19T09:50:10.920 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-19T09:50:10.920 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-57238232-7669-11ef-bceb-c7b262605968@mds.l 2024-09-19T09:50:11.117 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 19 09:50:11 smithi121 systemd[1]: Stopping Ceph mds.l for 57238232-7669-11ef-bceb-c7b262605968... 2024-09-19T09:50:11.617 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 19 09:50:11 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-l[64280]: 2024-09-19T09:50:11.237+0000 7fcea02b0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:50:11.617 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 19 09:50:11 smithi121 ceph-57238232-7669-11ef-bceb-c7b262605968-mds-l[64280]: 2024-09-19T09:50:11.237+0000 7fcea02b0640 -1 mds.l *** got signal Terminated *** 2024-09-19T09:50:15.415 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 19 09:50:15 smithi121 podman[70375]: 2024-09-19 09:50:15.16179636 +0000 UTC m=+4.022961218 container died 77f3a4df8fad6945cdfc121dd39a18d595bb3e6a9a00bd51c3c09b828b8f6e7a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-l, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=squid-2f599a4) 2024-09-19T09:50:15.682 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 19 09:50:15 smithi121 podman[70375]: 2024-09-19 09:50:15.496694867 +0000 UTC m=+4.357859728 container cleanup 77f3a4df8fad6945cdfc121dd39a18d595bb3e6a9a00bd51c3c09b828b8f6e7a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-l, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:50:15.682 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 19 09:50:15 smithi121 bash[70375]: ceph-57238232-7669-11ef-bceb-c7b262605968-mds-l 2024-09-19T09:50:15.909 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-57238232-7669-11ef-bceb-c7b262605968@mds.l.service' 2024-09-19T09:50:15.932 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 19 09:50:15 smithi121 podman[70387]: 2024-09-19 09:50:15.680961637 +0000 UTC m=+0.512470520 container remove 77f3a4df8fad6945cdfc121dd39a18d595bb3e6a9a00bd51c3c09b828b8f6e7a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-57238232-7669-11ef-bceb-c7b262605968-mds-l, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T09:50:15.932 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 19 09:50:15 smithi121 systemd[1]: ceph-57238232-7669-11ef-bceb-c7b262605968@mds.l.service: Deactivated successfully. 2024-09-19T09:50:15.933 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 19 09:50:15 smithi121 systemd[1]: Stopped Ceph mds.l for 57238232-7669-11ef-bceb-c7b262605968. 2024-09-19T09:50:15.933 INFO:journalctl@ceph.mds.l.smithi121.stdout:Sep 19 09:50:15 smithi121 systemd[1]: ceph-57238232-7669-11ef-bceb-c7b262605968@mds.l.service: Consumed 1.008s CPU time. 2024-09-19T09:50:15.942 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:50:15.942 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-19T09:50:15.942 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 57238232-7669-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T09:50:16.158 INFO:teuthology.orchestra.run.smithi001.stdout:Deleting cluster with fsid: 57238232-7669-11ef-bceb-c7b262605968 2024-09-19T09:50:18.850 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 57238232-7669-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T09:50:19.059 INFO:teuthology.orchestra.run.smithi022.stdout:Deleting cluster with fsid: 57238232-7669-11ef-bceb-c7b262605968 2024-09-19T09:50:21.532 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 57238232-7669-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T09:50:21.733 INFO:teuthology.orchestra.run.smithi121.stdout:Deleting cluster with fsid: 57238232-7669-11ef-bceb-c7b262605968 2024-09-19T09:50:24.310 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:50:24.345 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:50:24.377 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:50:24.404 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-19T09:50:24.406 DEBUG:teuthology.misc:Transferring archived files from smithi001:/var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911916/remote/smithi001/crash 2024-09-19T09:50:24.407 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/crash -- . 2024-09-19T09:50:24.448 INFO:teuthology.orchestra.run.smithi001.stderr:tar: /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T09:50:24.449 INFO:teuthology.orchestra.run.smithi001.stderr:tar: Error is not recoverable: exiting now 2024-09-19T09:50:24.450 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911916/remote/smithi022/crash 2024-09-19T09:50:24.451 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/crash -- . 2024-09-19T09:50:24.490 INFO:teuthology.orchestra.run.smithi022.stderr:tar: /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T09:50:24.491 INFO:teuthology.orchestra.run.smithi022.stderr:tar: Error is not recoverable: exiting now 2024-09-19T09:50:24.492 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911916/remote/smithi121/crash 2024-09-19T09:50:24.493 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/crash -- . 2024-09-19T09:50:24.565 INFO:teuthology.orchestra.run.smithi121.stderr:tar: /var/lib/ceph/57238232-7669-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T09:50:24.565 INFO:teuthology.orchestra.run.smithi121.stderr:tar: Error is not recoverable: exiting now 2024-09-19T09:50:24.566 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-19T09:50:24.567 DEBUG:teuthology.orchestra.run.smithi001:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-19T09:50:24.659 INFO:tasks.cephadm:Compressing logs... 2024-09-19T09:50:24.659 DEBUG:teuthology.orchestra.run.smithi001:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:50:24.662 DEBUG:teuthology.orchestra.run.smithi022:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:50:24.664 DEBUG:teuthology.orchestra.run.smithi121:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:50:24.687 INFO:teuthology.orchestra.run.smithi001.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-19T09:50:24.687 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-19T09:50:24.687 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-19T09:50:24.688 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T09:50:24.688 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T09:50:24.689 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-19T09:50:24.689 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T09:50:24.691 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-19T09:50:24.691 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-19T09:50:24.691 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-19T09:50:24.691 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph.log 2024-09-19T09:50:24.691 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-19T09:50:24.691 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-19T09:50:24.691 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-19T09:50:24.692 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-19T09:50:24.693 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.j.log: gzip 94.6% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-19T09:50:24.693 INFO:teuthology.orchestra.run.smithi001.stderr: -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T09:50:24.693 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 94.6% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-19T09:50:24.693 INFO:teuthology.orchestra.run.smithi001.stderr: 86.5% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T09:50:24.693 INFO:teuthology.orchestra.run.smithi001.stderr: 94.6% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-19T09:50:24.695 INFO:teuthology.orchestra.run.smithi001.stderr: 94.7% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-19T09:50:24.708 INFO:teuthology.orchestra.run.smithi022.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-19T09:50:24.708 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-19T09:50:24.708 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-19T09:50:24.709 INFO:teuthology.orchestra.run.smithi121.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-19T09:50:24.709 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T09:50:24.709 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T09:50:24.709 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-19T09:50:24.710 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-19T09:50:24.715 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T09:50:24.715 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-19T09:50:24.715 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-19T09:50:24.715 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-19T09:50:24.715 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph.log 2024-09-19T09:50:24.715 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-19T09:50:24.715 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-19T09:50:24.715 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-19T09:50:24.716 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.8.log: -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-19T09:50:24.716 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-19T09:50:24.716 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T09:50:24.716 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 94.8% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-19T09:50:24.716 INFO:teuthology.orchestra.run.smithi121.stderr: 94.7% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-19T09:50:24.716 INFO:teuthology.orchestra.run.smithi121.stderr: 94.7% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-19T09:50:24.717 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-19T09:50:24.717 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.10.log: /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T09:50:24.717 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-19T09:50:24.717 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-19T09:50:24.717 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-19T09:50:24.717 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T09:50:24.717 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T09:50:24.717 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-19T09:50:24.718 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph.log 2024-09-19T09:50:24.718 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-19T09:50:24.718 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-19T09:50:24.718 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-19T09:50:24.718 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T09:50:24.718 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 94.5% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-19T09:50:24.718 INFO:teuthology.orchestra.run.smithi022.stderr: 94.6% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-19T09:50:24.760 INFO:teuthology.orchestra.run.smithi022.stderr: 90.4% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T09:50:24.812 INFO:teuthology.orchestra.run.smithi001.stderr: 93.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T09:50:24.832 INFO:teuthology.orchestra.run.smithi022.stderr: 92.6% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-19T09:50:24.841 INFO:teuthology.orchestra.run.smithi022.stderr: 90.9% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T09:50:24.853 INFO:teuthology.orchestra.run.smithi121.stderr: 91.0% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T09:50:24.856 INFO:teuthology.orchestra.run.smithi022.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T09:50:24.859 INFO:teuthology.orchestra.run.smithi001.stderr: 90.9% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T09:50:24.869 INFO:teuthology.orchestra.run.smithi001.stderr: 90.0% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-19T09:50:24.878 INFO:teuthology.orchestra.run.smithi001.stderr: 82.4% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T09:50:24.886 INFO:teuthology.orchestra.run.smithi022.stderr: 95.5% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-19T09:50:24.894 INFO:teuthology.orchestra.run.smithi121.stderr: 92.8% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-19T09:50:24.953 INFO:teuthology.orchestra.run.smithi121.stderr: 82.3% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T09:50:24.955 INFO:teuthology.orchestra.run.smithi121.stderr: 86.5% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T09:50:24.959 INFO:teuthology.orchestra.run.smithi022.stderr: 86.5% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T09:50:24.967 INFO:teuthology.orchestra.run.smithi022.stderr: 82.4% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T09:50:25.005 INFO:teuthology.orchestra.run.smithi121.stderr: 90.4% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T09:50:25.066 INFO:teuthology.orchestra.run.smithi001.stderr: 90.2% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T09:50:25.105 INFO:teuthology.orchestra.run.smithi121.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T09:50:26.714 INFO:teuthology.orchestra.run.smithi121.stderr: 91.8% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-19T09:50:27.024 INFO:teuthology.orchestra.run.smithi022.stderr: 91.6% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-19T09:50:31.989 INFO:teuthology.orchestra.run.smithi001.stderr: 90.2% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-19T09:50:39.599 INFO:teuthology.orchestra.run.smithi121.stderr: 96.4% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-19T09:53:19.808 INFO:teuthology.orchestra.run.smithi022.stderr: 95.2% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-19T09:53:23.629 INFO:teuthology.orchestra.run.smithi022.stderr: 92.0% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-19T09:54:07.671 INFO:teuthology.orchestra.run.smithi001.stderr: 91.8% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-19T09:56:20.272 INFO:teuthology.orchestra.run.smithi022.stderr: 92.1% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-19T09:58:13.553 INFO:teuthology.orchestra.run.smithi022.stderr: 92.0% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-19T09:58:25.411 INFO:teuthology.orchestra.run.smithi022.stderr: 92.0% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-19T09:58:25.413 INFO:teuthology.orchestra.run.smithi022.stderr: 2024-09-19T09:58:25.413 INFO:teuthology.orchestra.run.smithi022.stderr:real 8m0.733s 2024-09-19T09:58:25.413 INFO:teuthology.orchestra.run.smithi022.stderr:user 7m37.224s 2024-09-19T09:58:25.413 INFO:teuthology.orchestra.run.smithi022.stderr:sys 0m16.604s 2024-09-19T09:59:45.763 INFO:teuthology.orchestra.run.smithi001.stderr: 92.0% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-19T10:00:41.135 INFO:teuthology.orchestra.run.smithi001.stderr: 92.1% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-19T10:01:34.266 INFO:teuthology.orchestra.run.smithi001.stderr: 91.9% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-19T10:01:34.267 INFO:teuthology.orchestra.run.smithi001.stderr: 2024-09-19T10:01:34.267 INFO:teuthology.orchestra.run.smithi001.stderr:real 11m9.591s 2024-09-19T10:01:34.267 INFO:teuthology.orchestra.run.smithi001.stderr:user 7m12.484s 2024-09-19T10:01:34.268 INFO:teuthology.orchestra.run.smithi001.stderr:sys 0m16.386s 2024-09-19T10:07:01.822 INFO:teuthology.orchestra.run.smithi121.stderr: 92.0% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-19T10:08:05.708 INFO:teuthology.orchestra.run.smithi121.stderr: 92.0% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-19T10:08:29.968 INFO:teuthology.orchestra.run.smithi121.stderr: 92.0% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-19T10:09:01.789 INFO:teuthology.orchestra.run.smithi121.stderr: 91.9% -- replaced with /var/log/ceph/57238232-7669-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-19T10:09:01.791 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-19T10:09:01.791 INFO:teuthology.orchestra.run.smithi121.stderr:real 18m37.108s 2024-09-19T10:09:01.791 INFO:teuthology.orchestra.run.smithi121.stderr:user 7m7.075s 2024-09-19T10:09:01.791 INFO:teuthology.orchestra.run.smithi121.stderr:sys 0m19.077s 2024-09-19T10:09:01.792 INFO:tasks.cephadm:Archiving logs... 2024-09-19T10:09:01.792 DEBUG:teuthology.misc:Transferring archived files from smithi001:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911916/remote/smithi001/log 2024-09-19T10:09:01.793 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T10:10:10.862 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911916/remote/smithi022/log 2024-09-19T10:10:10.863 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T10:11:23.918 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911916/remote/smithi121/log 2024-09-19T10:11:23.919 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T10:12:35.810 INFO:tasks.cephadm:Removing cluster... 2024-09-19T10:12:35.811 DEBUG:teuthology.orchestra.run.smithi001:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 57238232-7669-11ef-bceb-c7b262605968 --force 2024-09-19T10:12:36.025 INFO:teuthology.orchestra.run.smithi001.stdout:Deleting cluster with fsid: 57238232-7669-11ef-bceb-c7b262605968 2024-09-19T10:12:36.789 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 57238232-7669-11ef-bceb-c7b262605968 --force 2024-09-19T10:12:37.115 INFO:teuthology.orchestra.run.smithi022.stdout:Deleting cluster with fsid: 57238232-7669-11ef-bceb-c7b262605968 2024-09-19T10:12:37.897 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 57238232-7669-11ef-bceb-c7b262605968 --force 2024-09-19T10:12:38.274 INFO:teuthology.orchestra.run.smithi121.stdout:Deleting cluster with fsid: 57238232-7669-11ef-bceb-c7b262605968 2024-09-19T10:12:38.983 INFO:tasks.cephadm:Removing cephadm ... 2024-09-19T10:12:38.983 DEBUG:teuthology.orchestra.run.smithi001:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T10:12:39.003 DEBUG:teuthology.orchestra.run.smithi022:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T10:12:39.022 DEBUG:teuthology.orchestra.run.smithi121:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T10:12:39.039 INFO:tasks.cephadm:Teardown complete 2024-09-19T10:12:39.039 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T10:12:39.051 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T10:12:39.051 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T10:12:39.054 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T10:12:39.065 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T10:12:39.221 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T10:12:39.232 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T10:12:39.233 DEBUG:teuthology.orchestra.run.smithi001:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T10:12:39.236 DEBUG:teuthology.orchestra.run.smithi022:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T10:12:39.238 DEBUG:teuthology.orchestra.run.smithi121:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T10:12:39.251 INFO:teuthology.orchestra.run.smithi001.stderr:bash: line 1: ntpq: command not found 2024-09-19T10:12:39.253 INFO:teuthology.orchestra.run.smithi022.stderr:bash: line 1: ntpq: command not found 2024-09-19T10:12:39.253 INFO:teuthology.orchestra.run.smithi121.stderr:bash: line 1: ntpq: command not found 2024-09-19T10:12:39.274 INFO:teuthology.orchestra.run.smithi001.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T10:12:39.275 INFO:teuthology.orchestra.run.smithi001.stdout:=============================================================================== 2024-09-19T10:12:39.275 INFO:teuthology.orchestra.run.smithi001.stdout:^* hv01.front.sepia.ceph.com 3 6 377 56 +518us[ +524us] +/- 57ms 2024-09-19T10:12:39.275 INFO:teuthology.orchestra.run.smithi001.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 54 -1133us[-1133us] +/- 63ms 2024-09-19T10:12:39.275 INFO:teuthology.orchestra.run.smithi001.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 55 +801us[ +801us] +/- 81ms 2024-09-19T10:12:39.275 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T10:12:39.282 INFO:teuthology.orchestra.run.smithi022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T10:12:39.282 INFO:teuthology.orchestra.run.smithi022.stdout:=============================================================================== 2024-09-19T10:12:39.282 INFO:teuthology.orchestra.run.smithi022.stdout:^* hv01.front.sepia.ceph.com 3 6 377 52 +504us[ +518us] +/- 57ms 2024-09-19T10:12:39.282 INFO:teuthology.orchestra.run.smithi022.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 54 -1139us[-1125us] +/- 63ms 2024-09-19T10:12:39.282 INFO:teuthology.orchestra.run.smithi022.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 53 +777us[ +791us] +/- 81ms 2024-09-19T10:12:39.282 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T10:12:39.286 INFO:teuthology.orchestra.run.smithi121.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T10:12:39.286 INFO:teuthology.orchestra.run.smithi121.stdout:=============================================================================== 2024-09-19T10:12:39.287 INFO:teuthology.orchestra.run.smithi121.stdout:^* hv01.front.sepia.ceph.com 3 6 377 53 +451us[ +464us] +/- 57ms 2024-09-19T10:12:39.287 INFO:teuthology.orchestra.run.smithi121.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 57 -1180us[-1168us] +/- 63ms 2024-09-19T10:12:39.287 INFO:teuthology.orchestra.run.smithi121.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 120 +764us[ +782us] +/- 80ms 2024-09-19T10:12:39.287 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T10:12:39.288 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T10:12:39.299 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T10:12:39.300 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T10:12:39.313 DEBUG:teuthology.orchestra.run.smithi001:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T10:12:39.450 DEBUG:teuthology.orchestra.run.smithi022:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T10:12:39.545 DEBUG:teuthology.orchestra.run.smithi121:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T10:12:39.641 DEBUG:teuthology.orchestra.run.smithi001:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T10:12:39.674 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T10:12:39.675 DEBUG:teuthology.orchestra.run.smithi022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T10:12:39.705 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T10:12:39.706 DEBUG:teuthology.orchestra.run.smithi121:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T10:12:39.734 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T10:12:39.734 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T10:12:39.745 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T10:12:39.756 INFO:teuthology.task.internal:Duration was 3093.509703 seconds 2024-09-19T10:12:39.757 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T10:12:39.770 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T10:12:39.770 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T10:12:39.773 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T10:12:39.778 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T10:12:39.827 INFO:teuthology.orchestra.run.smithi022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T10:12:39.828 INFO:teuthology.orchestra.run.smithi001.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T10:12:39.845 INFO:teuthology.orchestra.run.smithi121.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T10:12:40.173 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T10:12:40.173 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi001.front.sepia.ceph.com 2024-09-19T10:12:40.173 DEBUG:teuthology.orchestra.run.smithi001:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T10:12:40.198 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi022.front.sepia.ceph.com 2024-09-19T10:12:40.198 DEBUG:teuthology.orchestra.run.smithi022:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T10:12:40.229 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi121.front.sepia.ceph.com 2024-09-19T10:12:40.229 DEBUG:teuthology.orchestra.run.smithi121:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T10:12:40.253 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T10:12:40.253 DEBUG:teuthology.orchestra.run.smithi001:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T10:12:40.255 DEBUG:teuthology.orchestra.run.smithi022:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T10:12:40.272 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T10:12:40.320 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T10:12:40.320 DEBUG:teuthology.orchestra.run.smithi001:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T10:12:40.327 DEBUG:teuthology.orchestra.run.smithi022:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T10:12:40.355 DEBUG:teuthology.orchestra.run.smithi121:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T10:12:41.085 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T10:12:41.096 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T10:12:41.096 DEBUG:teuthology.orchestra.run.smithi001:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T10:12:41.130 DEBUG:teuthology.orchestra.run.smithi022:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T10:12:41.158 DEBUG:teuthology.orchestra.run.smithi121:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T10:12:41.187 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T10:12:41.198 DEBUG:teuthology.orchestra.run.smithi001:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T10:12:41.201 DEBUG:teuthology.orchestra.run.smithi022:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T10:12:41.206 DEBUG:teuthology.orchestra.run.smithi121:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T10:12:41.235 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = core 2024-09-19T10:12:41.241 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern = core 2024-09-19T10:12:41.259 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = core 2024-09-19T10:12:41.302 DEBUG:teuthology.orchestra.run.smithi001:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T10:12:41.318 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T10:12:41.318 DEBUG:teuthology.orchestra.run.smithi022:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T10:12:41.333 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T10:12:41.333 DEBUG:teuthology.orchestra.run.smithi121:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T10:12:41.357 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T10:12:41.358 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T10:12:41.369 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T10:12:41.370 DEBUG:teuthology.misc:Transferring archived files from smithi001:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911916/remote/smithi001 2024-09-19T10:12:41.370 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T10:12:41.425 DEBUG:teuthology.misc:Transferring archived files from smithi022:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911916/remote/smithi022 2024-09-19T10:12:41.426 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T10:12:41.463 DEBUG:teuthology.misc:Transferring archived files from smithi121:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911916/remote/smithi121 2024-09-19T10:12:41.463 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T10:12:41.501 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T10:12:41.501 DEBUG:teuthology.orchestra.run.smithi001:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T10:12:41.503 DEBUG:teuthology.orchestra.run.smithi022:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T10:12:41.506 DEBUG:teuthology.orchestra.run.smithi121:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T10:12:41.551 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T10:12:41.564 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T10:12:41.564 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T10:12:41.575 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T10:12:41.575 DEBUG:teuthology.orchestra.run.smithi001:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T10:12:41.577 DEBUG:teuthology.orchestra.run.smithi022:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T10:12:41.580 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T10:12:41.590 INFO:teuthology.orchestra.run.smithi001.stdout: 265336 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 10:12 /home/ubuntu/cephtest 2024-09-19T10:12:41.592 INFO:teuthology.orchestra.run.smithi022.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 10:12 /home/ubuntu/cephtest 2024-09-19T10:12:41.607 INFO:teuthology.orchestra.run.smithi121.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 10:12 /home/ubuntu/cephtest 2024-09-19T10:12:41.608 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T10:12:41.619 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T10:12:41.646 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/ffsb}} duration: 3093.509702682495 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-19T10:12:41.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T10:12:41.724 INFO:teuthology.run:pass